2024-03-18T14:27:36.480 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-18T14:27:36.481 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} --name pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849 --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/orig.config.yaml 2024-03-18T14:27:36.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T14:27:36.619 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849 branch: wip-batrick-testing-20240314.183243 description: fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} email: pdonnell@redhat.com first_in_suite: false job_id: '7608849' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - mons down, quorum - out of quorum - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240314.183243 sha1: 4e19f704afd9957ea657ab858f9ecf76401fef6f owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 4e19f704afd9957ea657ab858f9ecf76401fef6f targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAJfV/jyRQmvrL+3NnMMQg6k3n71Nw5hcbLSieS0T2q+yKEAl8+wqbncR9HYcYlDzM6d4nOQrec4Wj+jlXWcfQ= smithi087.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCncwcaS3ehB2ay4KEnSJKHfPNQmVRubaRsYO3lulZE+fAjF1tLzuzrEl71eyvFV8IwGIZeP6g9YbH+nIUYMRbk= smithi129.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb2+khwLDMJH2Uy3mBoJdiwh56TQVI8Yk90WBgifLD5l1p/j+51boEicE5oInvcALKY3yoihdFya6ixKzZAz9w= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - workunit: clients: all: - suites/fsstress.sh - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: quincy - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-18_14:19:46 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-18T14:27:36.620 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa; will attempt to use it 2024-03-18T14:27:36.620 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks 2024-03-18T14:27:36.620 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-18T14:27:36.622 INFO:teuthology.task.internal:Checking packages... 2024-03-18T14:27:36.644 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-18T14:27:36.644 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:27:36.644 INFO:teuthology.packaging:ref: None 2024-03-18T14:27:36.644 INFO:teuthology.packaging:tag: None 2024-03-18T14:27:36.644 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-18T14:27:36.644 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:27:36.644 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-18T14:27:36.855 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162.g3d78f5ba 2024-03-18T14:27:36.856 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-18T14:27:36.864 INFO:teuthology.task.internal:no buildpackages task found 2024-03-18T14:27:36.864 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-18T14:27:36.876 INFO:teuthology.task.internal:Saving configuration 2024-03-18T14:27:36.893 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-18T14:27:36.899 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T14:27:36.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.267992', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAJfV/jyRQmvrL+3NnMMQg6k3n71Nw5hcbLSieS0T2q+yKEAl8+wqbncR9HYcYlDzM6d4nOQrec4Wj+jlXWcfQ='} 2024-03-18T14:27:36.948 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.266254', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCncwcaS3ehB2ay4KEnSJKHfPNQmVRubaRsYO3lulZE+fAjF1tLzuzrEl71eyvFV8IwGIZeP6g9YbH+nIUYMRbk='} 2024-03-18T14:27:36.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.269644', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb2+khwLDMJH2Uy3mBoJdiwh56TQVI8Yk90WBgifLD5l1p/j+51boEicE5oInvcALKY3yoihdFya6ixKzZAz9w='} 2024-03-18T14:27:36.969 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-18T14:27:36.975 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-03-18T14:27:36.975 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['client.0'] 2024-03-18T14:27:36.976 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['client.1'] 2024-03-18T14:27:36.976 INFO:teuthology.run_tasks:Running task console_log... 2024-03-18T14:27:37.075 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f588ab65160>, signals=[15]) 2024-03-18T14:27:37.075 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-18T14:27:37.081 INFO:teuthology.task.internal:Opening connections... 2024-03-18T14:27:37.081 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:27:37.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:27:37.161 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2024-03-18T14:27:37.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:27:37.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi129.front.sepia.ceph.com 2024-03-18T14:27:37.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:27:37.302 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-18T14:27:37.310 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-03-18T14:27:37.333 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-03-18T14:27:37.334 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-18T14:27:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-03-18T14:27:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2024-03-18T14:27:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-03-18T14:27:37.395 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-18T14:27:37.396 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T14:27:37.397 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-18T14:27:37.440 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-03-18T14:27:37.462 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-03-18T14:27:37.462 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2024-03-18T14:27:37.523 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-18T14:27:37.524 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2024-03-18T14:27:37.524 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T14:27:37.524 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-18T14:27:37.524 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T14:27:37.524 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-03-18T14:27:37.556 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2024-03-18T14:27:37.578 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2024-03-18T14:27:37.579 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2024-03-18T14:27:37.640 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2024-03-18T14:27:37.640 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-18T14:27:37.641 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T14:27:37.641 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2024-03-18T14:27:37.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-18T14:27:37.682 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-18T14:27:37.688 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-18T14:27:37.689 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-03-18T14:27:37.691 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2024-03-18T14:27:37.693 DEBUG:teuthology.orchestra.run.smithi129:> test '!' -e /home/ubuntu/cephtest 2024-03-18T14:27:37.713 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-18T14:27:37.719 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-18T14:27:37.719 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-03-18T14:27:37.753 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2024-03-18T14:27:37.755 DEBUG:teuthology.orchestra.run.smithi129:> test -z $(ls -A /var/lib/ceph) 2024-03-18T14:27:37.788 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-18T14:27:37.860 INFO:teuthology.run_tasks:Running task kernel... 2024-03-18T14:27:37.875 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-18T14:27:37.875 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-18T14:27:37.875 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T14:27:37.875 DEBUG:teuthology.orchestra.run.smithi087:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T14:27:37.876 DEBUG:teuthology.orchestra.run.smithi129:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T14:27:37.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:27:37.896 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-03-18T14:27:37.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:27:37.897 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-03-18T14:27:37.897 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:27:37.898 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-03-18T14:27:37.956 INFO:teuthology.orchestra.run.smithi129.stdout:4.18.0-489.el8.x86_64 2024-03-18T14:27:37.956 INFO:teuthology.task.kernel:Running kernel on smithi129: 4.18.0-489.el8.x86_64 2024-03-18T14:27:37.956 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum install -y kernel 2024-03-18T14:27:37.957 INFO:teuthology.orchestra.run.smithi087.stdout:4.18.0-489.el8.x86_64 2024-03-18T14:27:37.957 INFO:teuthology.task.kernel:Running kernel on smithi087: 4.18.0-489.el8.x86_64 2024-03-18T14:27:37.957 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum install -y kernel 2024-03-18T14:27:37.960 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-489.el8.x86_64 2024-03-18T14:27:37.960 INFO:teuthology.task.kernel:Running kernel on smithi057: 4.18.0-489.el8.x86_64 2024-03-18T14:27:37.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2024-03-18T14:27:41.151 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - AppStream 36 MB/s | 28 MB 00:00 2024-03-18T14:27:41.337 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 31 MB/s | 28 MB 00:00 2024-03-18T14:27:41.402 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - AppStream 29 MB/s | 28 MB 00:00 2024-03-18T14:27:49.859 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - BaseOS 2.8 MB/s | 10 MB 00:03 2024-03-18T14:27:51.336 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 2.2 MB/s | 10 MB 00:04 2024-03-18T14:27:51.627 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - BaseOS 2.0 MB/s | 10 MB 00:05 2024-03-18T14:27:51.734 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras 66 kB/s | 18 kB 00:00 2024-03-18T14:27:52.143 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 7.5 kB 00:00 2024-03-18T14:27:52.378 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-03-18T14:27:53.370 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2024-03-18T14:27:53.410 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - Extras 102 kB/s | 18 kB 00:00 2024-03-18T14:27:53.553 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2024-03-18T14:27:53.937 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.5 kB 00:00 2024-03-18T14:27:54.180 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-03-18T14:27:55.036 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - Extras common packages 5.0 kB/s | 7.5 kB 00:01 2024-03-18T14:27:55.288 INFO:teuthology.orchestra.run.smithi087.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-03-18T14:27:57.299 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2024-03-18T14:27:57.312 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 604 kB/s | 24 kB 00:00 2024-03-18T14:28:00.292 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-03-18T14:28:00.292 INFO:teuthology.orchestra.run.smithi129.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-03-18T14:28:00.401 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: kernel x86_64 4.18.0-544.el8 baseos 10 M 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-core x86_64 4.18.0-544.el8 baseos 44 M 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules x86_64 4.18.0-544.el8 baseos 36 M 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:00.402 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:Install 3 Packages 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 90 M 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 97 M 2024-03-18T14:28:00.403 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:28:01.063 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 560 kB/s | 24 kB 00:00 2024-03-18T14:28:02.063 INFO:teuthology.orchestra.run.smithi129.stdout:(1/3): kernel-4.18.0-544.el8.x86_64.rpm 6.4 MB/s | 10 MB 00:01 2024-03-18T14:28:03.205 INFO:teuthology.orchestra.run.smithi129.stdout:(2/3): kernel-modules-4.18.0-544.el8.x86_64.rpm 13 MB/s | 36 MB 00:02 2024-03-18T14:28:03.985 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-03-18T14:28:03.985 INFO:teuthology.orchestra.run.smithi087.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-03-18T14:28:04.022 INFO:teuthology.orchestra.run.smithi129.stdout:(3/3): kernel-core-4.18.0-544.el8.x86_64.rpm 12 MB/s | 44 MB 00:03 2024-03-18T14:28:04.022 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:28:04.022 INFO:teuthology.orchestra.run.smithi129.stdout:Total 25 MB/s | 90 MB 00:03 2024-03-18T14:28:04.097 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:28:04.098 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:28:04.098 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:28:04.098 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: kernel x86_64 4.18.0-544.el8 baseos 10 M 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-core x86_64 4.18.0-544.el8 baseos 44 M 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules x86_64 4.18.0-544.el8 baseos 36 M 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout:Install 3 Packages 2024-03-18T14:28:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:04.100 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 90 M 2024-03-18T14:28:04.100 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 97 M 2024-03-18T14:28:04.100 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:28:04.711 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:28:05.139 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:28:05.139 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:28:06.379 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:28:06.400 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:28:06.918 INFO:teuthology.orchestra.run.smithi087.stdout:(1/3): kernel-4.18.0-544.el8.x86_64.rpm 6.4 MB/s | 10 MB 00:01 2024-03-18T14:28:08.223 INFO:teuthology.orchestra.run.smithi087.stdout:(2/3): kernel-modules-4.18.0-544.el8.x86_64.rpm 12 MB/s | 36 MB 00:02 2024-03-18T14:28:09.169 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:28:09.699 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:10.274 INFO:teuthology.orchestra.run.smithi087.stdout:(3/3): kernel-core-4.18.0-544.el8.x86_64.rpm 8.8 MB/s | 44 MB 00:04 2024-03-18T14:28:10.274 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:28:10.274 INFO:teuthology.orchestra.run.smithi087.stdout:Total 15 MB/s | 90 MB 00:06 2024-03-18T14:28:10.515 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 16 MB 00:16 2024-03-18T14:28:10.958 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:28:11.371 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:28:12.606 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:28:12.624 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:28:13.243 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:13.632 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:14.588 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 273 kB/s | 24 kB 00:00 2024-03-18T14:28:15.425 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:28:15.897 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:17.072 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:17.349 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:17.825 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-03-18T14:28:17.826 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-03-18T14:28:17.941 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:28:17.942 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:28:17.942 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 4.18.0-544.el8 baseos 10 M 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-core x86_64 4.18.0-544.el8 baseos 44 M 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules x86_64 4.18.0-544.el8 baseos 36 M 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout:Install 3 Packages 2024-03-18T14:28:17.943 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:28:17.944 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 90 M 2024-03-18T14:28:17.944 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 97 M 2024-03-18T14:28:17.944 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:28:19.474 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:19.863 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:21.022 INFO:teuthology.orchestra.run.smithi057.stdout:(1/3): kernel-4.18.0-544.el8.x86_64.rpm 3.4 MB/s | 10 MB 00:03 2024-03-18T14:28:22.030 INFO:teuthology.orchestra.run.smithi057.stdout:(2/3): kernel-core-4.18.0-544.el8.x86_64.rpm 11 MB/s | 44 MB 00:04 2024-03-18T14:28:23.295 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:23.603 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:26.411 INFO:teuthology.orchestra.run.smithi057.stdout:(3/3): kernel-modules-4.18.0-544.el8.x86_64.rpm 4.3 MB/s | 36 MB 00:08 2024-03-18T14:28:26.412 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:28:26.412 INFO:teuthology.orchestra.run.smithi057.stdout:Total 11 MB/s | 90 MB 00:08 2024-03-18T14:28:27.134 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:28:27.583 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:28:27.583 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:28:28.903 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:28:28.931 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:28:32.016 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:28:32.544 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:36.269 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:36.676 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:39.192 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:39.215 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:39.564 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:39.564 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:39.564 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-core-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-4.18.0-544.el8.x86_64 kernel-core-4.18.0-544.el8.x86_64 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: kernel-modules-4.18.0-544.el8.x86_64 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:40.024 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:28:40.170 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:28:40.362 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:40.387 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:28:40.388 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:28:40.388 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-544.el8.x86_64 2024-03-18T14:28:40.388 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T14:28:40.388 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T14:28:40.388 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-18T14:28:40.388 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi129.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T14:28:40.389 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:28:40.600 INFO:teuthology.orchestra.run.smithi129.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:28:40.600 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:28:40.600 DEBUG:teuthology.orchestra.run.smithi129:> sudo rpm -qi grub2-tools 2024-03-18T14:28:40.632 INFO:teuthology.orchestra.run.smithi129.stdout:Name : grub2-tools 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Epoch : 1 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Version : 2.02 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Release : 129.el8 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Architecture: x86_64 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Group : System Environment/Base 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Size : 9265586 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:License : GPLv3+ 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-18T14:28:40.633 INFO:teuthology.orchestra.run.smithi129.stdout:Relocations : (not relocatable) 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:Packager : CentOS BuildSystem 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:Vendor : CentOS 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:Summary : Support tools for GRUB. 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:Description : 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout:hardware devices. 2024-03-18T14:28:40.634 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:28:40.635 INFO:teuthology.orchestra.run.smithi129.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T14:28:40.635 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T14:28:40.636 INFO:teuthology.task.kernel:Updating grub on smithi129 to boot 4.18.0-544.el8.x86_64 2024-03-18T14:28:40.636 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T14:28:40.671 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:42.273 INFO:teuthology.orchestra.run.smithi129.stderr:Generating grub configuration file ... 2024-03-18T14:28:44.831 INFO:teuthology.orchestra.run.smithi129.stderr:done 2024-03-18T14:28:44.833 DEBUG:teuthology.orchestra.run.smithi129:> mktemp 2024-03-18T14:28:44.896 INFO:teuthology.orchestra.run.smithi129.stdout:/tmp/tmp.w2qcNSP55X 2024-03-18T14:28:44.897 DEBUG:teuthology.orchestra.run.smithi129:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.w2qcNSP55X 2024-03-18T14:28:44.971 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0666 /tmp/tmp.w2qcNSP55X 2024-03-18T14:28:45.113 DEBUG:teuthology.orchestra.remote:smithi129:/tmp/tmp.w2qcNSP55X is 6KB 2024-03-18T14:28:45.161 DEBUG:teuthology.orchestra.run.smithi129:> rm -fr /tmp/tmp.w2qcNSP55X 2024-03-18T14:28:45.178 DEBUG:teuthology.orchestra.run.smithi129:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T14:28:45.256 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-18T14:28:45.256 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-18T14:28:45.257 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-18T14:28:45.257 INFO:teuthology.orchestra.run.smithi129.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64.conf 2024-03-18T14:28:45.258 DEBUG:teuthology.orchestra.run.smithi129:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64 2024-03-18T14:28:45.421 DEBUG:teuthology.orchestra.run.smithi129:> sudo shutdown -r now 2024-03-18T14:28:45.685 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:45.708 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:28:46.058 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-core-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-4.18.0-544.el8.x86_64 kernel-core-4.18.0-544.el8.x86_64 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: kernel-modules-4.18.0-544.el8.x86_64 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:46.541 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:28:46.684 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:28:46.903 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:28:46.903 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:28:46.904 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-544.el8.x86_64 2024-03-18T14:28:46.904 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T14:28:46.904 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T14:28:46.904 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-18T14:28:46.904 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T14:28:46.904 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:28:47.113 INFO:teuthology.orchestra.run.smithi087.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:28:47.113 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:28:47.114 DEBUG:teuthology.orchestra.run.smithi087:> sudo rpm -qi grub2-tools 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Name : grub2-tools 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Epoch : 1 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Version : 2.02 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Release : 129.el8 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: x86_64 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Group : System Environment/Base 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Size : 9265586 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:License : GPLv3+ 2024-03-18T14:28:47.147 INFO:teuthology.orchestra.run.smithi087.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Relocations : (not relocatable) 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Packager : CentOS BuildSystem 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Vendor : CentOS 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Summary : Support tools for GRUB. 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:Description : 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T14:28:47.148 INFO:teuthology.orchestra.run.smithi087.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T14:28:47.149 INFO:teuthology.orchestra.run.smithi087.stdout:hardware devices. 2024-03-18T14:28:47.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:28:47.149 INFO:teuthology.orchestra.run.smithi087.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T14:28:47.150 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T14:28:47.150 INFO:teuthology.task.kernel:Updating grub on smithi087 to boot 4.18.0-544.el8.x86_64 2024-03-18T14:28:47.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T14:28:48.739 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2024-03-18T14:28:51.074 INFO:teuthology.orchestra.run.smithi087.stderr:done 2024-03-18T14:28:51.075 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2024-03-18T14:28:51.112 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.qjUWoqoiVA 2024-03-18T14:28:51.112 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.qjUWoqoiVA 2024-03-18T14:28:51.184 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.qjUWoqoiVA 2024-03-18T14:28:51.324 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.qjUWoqoiVA is 6KB 2024-03-18T14:28:51.373 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.qjUWoqoiVA 2024-03-18T14:28:51.390 DEBUG:teuthology.orchestra.run.smithi087:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T14:28:51.463 INFO:teuthology.orchestra.run.smithi087.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-18T14:28:51.463 INFO:teuthology.orchestra.run.smithi087.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-18T14:28:51.463 INFO:teuthology.orchestra.run.smithi087.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-18T14:28:51.463 INFO:teuthology.orchestra.run.smithi087.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64.conf 2024-03-18T14:28:51.465 DEBUG:teuthology.orchestra.run.smithi087:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64 2024-03-18T14:28:51.617 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2024-03-18T14:29:04.014 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:29:04.039 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:29:04.403 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:29:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-4.18.0-544.el8.x86_64 1/3 2024-03-18T14:29:04.404 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-core-4.18.0-544.el8.x86_64 2/3 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-4.18.0-544.el8.x86_64 kernel-core-4.18.0-544.el8.x86_64 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-modules-4.18.0-544.el8.x86_64 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:29:04.907 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:29:05.049 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:29:05.279 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:29:05.280 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:29:05.280 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-544.el8.x86_64 2024-03-18T14:29:05.280 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T14:29:05.280 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T14:29:05.280 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-18T14:29:05.280 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T14:29:05.280 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:29:05.500 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-18T14:29:05.501 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-18T14:29:05.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.02 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 129.el8 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Group : System Environment/Base 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 9265586 2024-03-18T14:29:05.535 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Relocations : (not relocatable) 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : CentOS BuildSystem 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:29:05.536 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T14:29:05.537 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T14:29:05.537 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 4.18.0-544.el8.x86_64 2024-03-18T14:29:05.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T14:29:07.150 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-03-18T14:29:09.178 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-03-18T14:29:09.179 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-18T14:29:09.211 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.aNrcaZC4Ja 2024-03-18T14:29:09.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aNrcaZC4Ja 2024-03-18T14:29:09.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.aNrcaZC4Ja 2024-03-18T14:29:09.423 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.aNrcaZC4Ja is 6KB 2024-03-18T14:29:09.472 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.aNrcaZC4Ja 2024-03-18T14:29:09.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T14:29:09.564 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-18T14:29:09.564 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-18T14:29:09.564 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-18T14:29:09.564 INFO:teuthology.orchestra.run.smithi057.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64.conf 2024-03-18T14:29:09.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64 2024-03-18T14:29:09.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-03-18T14:29:15.430 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-18T14:29:15.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:29:15.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:21.626 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-18T14:29:21.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:29:21.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:33.855 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-18T14:29:39.766 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-18T14:29:39.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:29:39.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:39.998 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-03-18T14:29:42.857 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:29:42.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:45.918 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-18T14:29:49.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:29:49.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:52.062 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-03-18T14:29:57.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:29:57.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:29:58.175 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-18T14:30:04.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:30:04.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:30:07.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:30:07.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:30:10.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-18T14:30:16.351 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.129 2024-03-18T14:30:22.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:30:22.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:30:22.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-03-18T14:30:31.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:30:31.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:30:31.726 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-03-18T14:30:32.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:30:32.200 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-544.el8.x86_64"... 2024-03-18T14:30:32.200 DEBUG:teuthology.orchestra.run.smithi129:> uname -r 2024-03-18T14:30:32.238 INFO:teuthology.orchestra.run.smithi129.stdout:4.18.0-544.el8.x86_64 2024-03-18T14:30:32.275 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-544.el8.x86_64 vs 4.18.0-544.el8.x86_64 2024-03-18T14:30:32.275 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T14:30:32.275 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T14:30:33.276 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-03-18T14:30:33.276 DEBUG:teuthology.orchestra.run.smithi129:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-18T14:30:33.880 INFO:teuthology.orchestra.run.smithi129.stdout:ttyS1 2024-03-18T14:30:33.894 DEBUG:teuthology.parallel:result is None 2024-03-18T14:30:37.495 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:30:37.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:30:37.855 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-03-18T14:30:38.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:30:38.174 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-544.el8.x86_64"... 2024-03-18T14:30:38.175 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2024-03-18T14:30:38.191 INFO:teuthology.orchestra.run.smithi087.stdout:4.18.0-544.el8.x86_64 2024-03-18T14:30:38.191 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-544.el8.x86_64 vs 4.18.0-544.el8.x86_64 2024-03-18T14:30:38.191 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T14:30:38.192 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T14:30:39.192 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-03-18T14:30:39.192 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-18T14:30:39.978 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2024-03-18T14:30:40.005 DEBUG:teuthology.parallel:result is None 2024-03-18T14:31:22.252 DEBUG:teuthology.orchestra.remote:timed out 2024-03-18T14:31:37.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:31:37.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:31:37.693 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-18T14:31:37.993 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:31:37.993 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-544.el8.x86_64"... 2024-03-18T14:31:37.993 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-03-18T14:31:38.013 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-544.el8.x86_64 2024-03-18T14:31:38.013 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-544.el8.x86_64 vs 4.18.0-544.el8.x86_64 2024-03-18T14:31:38.013 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T14:31:38.013 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T14:31:39.016 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-18T14:31:39.016 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-18T14:31:39.106 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-03-18T14:31:39.119 DEBUG:teuthology.parallel:result is None 2024-03-18T14:31:39.119 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-18T14:31:39.135 INFO:teuthology.task.internal:Creating test directory... 2024-03-18T14:31:39.136 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T14:31:39.138 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T14:31:39.141 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T14:31:39.165 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-18T14:31:39.172 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-18T14:31:39.183 INFO:teuthology.task.internal:Creating archive directory... 2024-03-18T14:31:39.183 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T14:31:39.201 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T14:31:39.203 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T14:31:39.247 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-18T14:31:39.254 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-18T14:31:39.255 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T14:31:39.273 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T14:31:39.275 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T14:31:39.305 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.316 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.317 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.317 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.328 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.328 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:31:39.329 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-18T14:31:39.337 INFO:teuthology.task.internal:Configuring sudo... 2024-03-18T14:31:39.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T14:31:39.361 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T14:31:39.371 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T14:31:39.400 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-18T14:31:39.410 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-18T14:31:39.411 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T14:31:39.432 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T14:31:39.440 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T14:31:39.459 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:39.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:39.595 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:39.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:39.725 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:31:39.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T14:31:39.794 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:39.842 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:39.891 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:39.980 DEBUG:teuthology.orchestra.run.smithi087:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:40.022 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:31:40.022 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T14:31:40.091 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:40.142 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:31:40.194 DEBUG:teuthology.orchestra.run.smithi129:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:40.283 DEBUG:teuthology.orchestra.run.smithi129:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:31:40.326 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:31:40.326 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T14:31:40.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-03-18T14:31:40.398 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2024-03-18T14:31:40.401 DEBUG:teuthology.orchestra.run.smithi129:> sudo service rsyslog restart 2024-03-18T14:31:40.467 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:31:40.474 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:31:40.515 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:31:40.965 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-18T14:31:40.973 INFO:teuthology.task.internal:Starting timer... 2024-03-18T14:31:40.973 INFO:teuthology.run_tasks:Running task pcp... 2024-03-18T14:31:40.984 INFO:teuthology.run_tasks:Running task selinux... 2024-03-18T14:31:40.991 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-18T14:31:40.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-03-18T14:31:41.087 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-03-18T14:31:41.089 DEBUG:teuthology.orchestra.run.smithi087:> sudo service auditd rotate 2024-03-18T14:31:41.166 INFO:teuthology.orchestra.run.smithi087.stdout:Rotating logs: 2024-03-18T14:31:41.168 DEBUG:teuthology.orchestra.run.smithi129:> sudo service auditd rotate 2024-03-18T14:31:41.251 INFO:teuthology.orchestra.run.smithi129.stdout:Rotating logs: 2024-03-18T14:31:41.253 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-18T14:31:41.253 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-03-18T14:31:41.279 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-03-18T14:31:41.279 DEBUG:teuthology.orchestra.run.smithi087:> /usr/sbin/getenforce 2024-03-18T14:31:41.307 INFO:teuthology.orchestra.run.smithi087.stdout:Permissive 2024-03-18T14:31:41.308 DEBUG:teuthology.orchestra.run.smithi129:> /usr/sbin/getenforce 2024-03-18T14:31:41.342 INFO:teuthology.orchestra.run.smithi129.stdout:Permissive 2024-03-18T14:31:41.342 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi087.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi129.front.sepia.ceph.com': 'permissive'} 2024-03-18T14:31:41.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:31:41.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:31:41.373 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:31:41.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:31:41.400 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:31:41.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:31:41.430 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-18T14:31:41.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-03-18T14:31:41.458 DEBUG:teuthology.orchestra.run.smithi087:> sudo /usr/sbin/setenforce permissive 2024-03-18T14:31:41.485 DEBUG:teuthology.orchestra.run.smithi129:> sudo /usr/sbin/setenforce permissive 2024-03-18T14:31:41.512 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-18T14:31:41.523 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-18T14:31:41.538 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-18T14:31:41.540 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi087.front.sepia.ceph.com,smithi129.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-18T14:37:54.019 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com'), Remote(name='ubuntu@smithi129.front.sepia.ceph.com')] 2024-03-18T14:37:54.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:37:54.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:37:54.110 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-18T14:37:54.178 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-18T14:37:54.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:37:54.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:37:54.254 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-03-18T14:37:54.322 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-03-18T14:37:54.322 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:37:54.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:37:54.403 DEBUG:teuthology.orchestra.run.smithi129:> true 2024-03-18T14:37:54.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2024-03-18T14:37:54.476 INFO:teuthology.run_tasks:Running task clock... 2024-03-18T14:37:54.488 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-18T14:37:54.489 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T14:37:54.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:37:54.492 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T14:37:54.492 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:37:54.494 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T14:37:54.495 DEBUG:teuthology.orchestra.run.smithi129:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:37:54.526 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T14:37:54.529 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T14:37:54.541 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T14:37:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T14:37:54.555 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T14:37:54.566 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T14:37:54.607 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: ntpd: command not found 2024-03-18T14:37:54.613 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-03-18T14:37:54.614 INFO:teuthology.orchestra.run.smithi087.stdout:506 Cannot talk to daemon 2024-03-18T14:37:54.628 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-03-18T14:37:54.629 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T14:37:54.633 INFO:teuthology.orchestra.run.smithi129.stderr:sudo: ntpd: command not found 2024-03-18T14:37:54.641 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T14:37:54.643 INFO:teuthology.orchestra.run.smithi087.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T14:37:54.644 INFO:teuthology.orchestra.run.smithi129.stdout:506 Cannot talk to daemon 2024-03-18T14:37:54.656 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T14:37:54.658 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T14:37:54.671 INFO:teuthology.orchestra.run.smithi129.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T14:37:54.707 INFO:teuthology.orchestra.run.smithi087.stderr:bash: ntpq: command not found 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.711 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.732 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-03-18T14:37:54.736 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:37:54.736 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-03-18T14:37:54.736 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.737 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.737 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.737 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.742 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.746 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:37:54.747 INFO:teuthology.run_tasks:Running task install... 2024-03-18T14:37:54.756 DEBUG:teuthology.task.install:project ceph 2024-03-18T14:37:54.756 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-18T14:37:54.756 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-18T14:37:54.756 INFO:teuthology.task.install:Using flavor: default 2024-03-18T14:37:54.762 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-18T14:37:54.762 INFO:teuthology.task.install:extra packages: ['librados2'] 2024-03-18T14:37:54.763 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T14:37:54.763 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:54.763 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:54.763 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:54.763 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:54.763 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:54.763 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:37:54.765 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T14:37:54.765 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:54.766 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:54.766 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:54.766 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:54.766 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:54.766 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:37:54.767 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T14:37:54.767 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:54.767 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:54.767 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:54.767 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:54.767 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:54.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:37:54.987 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-03-18T14:37:54.987 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-03-18T14:37:55.007 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-03-18T14:37:55.007 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-03-18T14:37:55.030 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:37:55.030 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:37:55.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:37:55.053 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:37:55.054 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:37:55.054 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:37:55.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-03-18T14:37:55.062 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:55.062 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:55.063 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:55.063 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:55.063 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:55.063 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:37:55.081 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-03-18T14:37:55.082 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:55.082 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:55.082 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:55.082 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:55.082 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:55.082 DEBUG:teuthology.orchestra.run.smithi129:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:37:55.093 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-03-18T14:37:55.094 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-03-18T14:37:55.119 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:37:55.120 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:37:55.120 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:37:55.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:37:55.147 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-03-18T14:37:55.147 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:37:55.147 INFO:teuthology.packaging:ref: None 2024-03-18T14:37:55.147 INFO:teuthology.packaging:tag: None 2024-03-18T14:37:55.148 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:37:55.148 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:37:55.148 DEBUG:teuthology.orchestra.run.smithi087:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:37:55.149 DEBUG:teuthology.orchestra.run.smithi129:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:37:55.214 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:37:55.215 DEBUG:teuthology.orchestra.run.smithi087:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:37:55.227 DEBUG:teuthology.orchestra.run.smithi129:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:37:55.283 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-03-18T14:37:55.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-03-18T14:37:55.292 DEBUG:teuthology.orchestra.run.smithi087:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:37:55.293 INFO:teuthology.orchestra.run.smithi129.stdout:check_obsoletes = 1 2024-03-18T14:37:55.294 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum clean all 2024-03-18T14:37:55.358 INFO:teuthology.orchestra.run.smithi087.stdout:check_obsoletes = 1 2024-03-18T14:37:55.359 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum clean all 2024-03-18T14:37:55.561 INFO:teuthology.orchestra.run.smithi129.stdout:76 files removed 2024-03-18T14:37:55.561 INFO:teuthology.orchestra.run.smithi057.stdout:76 files removed 2024-03-18T14:37:55.588 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-radosgw 2024-03-18T14:37:55.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw 2024-03-18T14:37:55.624 INFO:teuthology.orchestra.run.smithi087.stdout:76 files removed 2024-03-18T14:37:55.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-radosgw 2024-03-18T14:37:56.129 INFO:teuthology.orchestra.run.smithi087.stdout:ceph packages for x86_64 912 kB/s | 68 kB 00:00 2024-03-18T14:37:56.134 INFO:teuthology.orchestra.run.smithi129.stdout:ceph packages for x86_64 487 kB/s | 68 kB 00:00 2024-03-18T14:37:56.139 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 563 kB/s | 68 kB 00:00 2024-03-18T14:37:56.274 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 159 kB/s | 15 kB 00:00 2024-03-18T14:37:56.276 INFO:teuthology.orchestra.run.smithi129.stdout:ceph noarch packages 142 kB/s | 15 kB 00:00 2024-03-18T14:37:56.327 INFO:teuthology.orchestra.run.smithi087.stdout:ceph noarch packages 92 kB/s | 15 kB 00:00 2024-03-18T14:37:56.428 INFO:teuthology.orchestra.run.smithi087.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-03-18T14:37:56.432 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 13 kB/s | 1.7 kB 00:00 2024-03-18T14:37:56.452 INFO:teuthology.orchestra.run.smithi129.stdout:ceph source packages 12 kB/s | 1.7 kB 00:00 2024-03-18T14:37:57.216 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 37 MB/s | 28 MB 00:00 2024-03-18T14:37:57.228 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - AppStream 37 MB/s | 28 MB 00:00 2024-03-18T14:37:57.228 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - AppStream 36 MB/s | 28 MB 00:00 2024-03-18T14:38:09.025 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 1.6 MB/s | 10 MB 00:06 2024-03-18T14:38:09.412 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - BaseOS 1.4 MB/s | 10 MB 00:07 2024-03-18T14:38:10.077 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - BaseOS 1.3 MB/s | 10 MB 00:07 2024-03-18T14:38:11.270 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - Extras 65 kB/s | 18 kB 00:00 2024-03-18T14:38:11.480 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 23 kB/s | 18 kB 00:00 2024-03-18T14:38:11.938 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.5 kB 00:00 2024-03-18T14:38:12.010 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 7.5 kB 00:00 2024-03-18T14:38:12.178 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2024-03-18T14:38:12.705 INFO:teuthology.orchestra.run.smithi087.stdout:CentOS Stream 8 - PowerTools 7.2 MB/s | 4.9 MB 00:00 2024-03-18T14:38:12.846 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 7.5 kB 00:00 2024-03-18T14:38:13.041 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - PowerTools 5.3 MB/s | 4.9 MB 00:00 2024-03-18T14:38:13.714 INFO:teuthology.orchestra.run.smithi129.stdout:CentOS Stream 8 - PowerTools 6.3 MB/s | 4.9 MB 00:00 2024-03-18T14:38:13.974 INFO:teuthology.orchestra.run.smithi087.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2024-03-18T14:38:14.246 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2024-03-18T14:38:14.973 INFO:teuthology.orchestra.run.smithi129.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-03-18T14:38:15.983 INFO:teuthology.orchestra.run.smithi129.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-03-18T14:38:16.149 INFO:teuthology.orchestra.run.smithi087.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:02 2024-03-18T14:38:16.514 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 16 MB 00:02 2024-03-18T14:38:19.800 INFO:teuthology.orchestra.run.smithi129.stdout:lab-extras 370 kB/s | 24 kB 00:00 2024-03-18T14:38:19.899 INFO:teuthology.orchestra.run.smithi087.stdout:lab-extras 515 kB/s | 24 kB 00:00 2024-03-18T14:38:20.464 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 397 kB/s | 24 kB 00:00 2024-03-18T14:38:23.372 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:38:23.374 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrading: 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-03-18T14:38:23.375 INFO:teuthology.orchestra.run.smithi129.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-03-18T14:38:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout:Install 22 Packages 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout:Upgrade 2 Packages 2024-03-18T14:38:23.377 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:38:23.378 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 49 M 2024-03-18T14:38:23.378 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:38:23.505 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrading: 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-03-18T14:38:23.507 INFO:teuthology.orchestra.run.smithi087.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-18T14:38:23.508 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout:Install 22 Packages 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout:Upgrade 2 Packages 2024-03-18T14:38:23.509 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:38:23.510 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 49 M 2024-03-18T14:38:23.510 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:38:24.276 INFO:teuthology.orchestra.run.smithi087.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 41 MB/s | 5.6 MB 00:00 2024-03-18T14:38:24.301 INFO:teuthology.orchestra.run.smithi129.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 7.4 MB/s | 5.6 MB 00:00 2024-03-18T14:38:24.317 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-03-18T14:38:24.320 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-18T14:38:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:38:24.322 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:38:24.323 INFO:teuthology.orchestra.run.smithi057.stdout:Install 22 Packages 2024-03-18T14:38:24.323 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 2 Packages 2024-03-18T14:38:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:38:24.323 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 49 M 2024-03-18T14:38:24.323 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:38:24.335 INFO:teuthology.orchestra.run.smithi087.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 438 kB/s | 25 kB 00:00 2024-03-18T14:38:24.393 INFO:teuthology.orchestra.run.smithi087.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 8.5 MB/s | 508 kB 00:00 2024-03-18T14:38:24.409 INFO:teuthology.orchestra.run.smithi129.stdout:(2/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 12 MB/s | 9.9 MB 00:00 2024-03-18T14:38:24.435 INFO:teuthology.orchestra.run.smithi129.stdout:(3/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 191 kB/s | 25 kB 00:00 2024-03-18T14:38:24.468 INFO:teuthology.orchestra.run.smithi129.stdout:(4/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 8.5 MB/s | 508 kB 00:00 2024-03-18T14:38:24.493 INFO:teuthology.orchestra.run.smithi087.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 3.7 MB/s | 380 kB 00:00 2024-03-18T14:38:24.502 INFO:teuthology.orchestra.run.smithi129.stdout:(5/24): libradosstriper1-15.2.17-0.el8.x86_64.r 5.6 MB/s | 380 kB 00:00 2024-03-18T14:38:24.602 INFO:teuthology.orchestra.run.smithi129.stdout:(6/24): librgw2-15.2.17-0.el8.x86_64.rpm 24 MB/s | 3.2 MB 00:00 2024-03-18T14:38:24.619 INFO:teuthology.orchestra.run.smithi087.stdout:(5/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 21 MB/s | 9.9 MB 00:00 2024-03-18T14:38:24.627 INFO:teuthology.orchestra.run.smithi129.stdout:(7/24): python3-ceph-argparse-15.2.17-0.el8.x86 318 kB/s | 40 kB 00:00 2024-03-18T14:38:24.644 INFO:teuthology.orchestra.run.smithi087.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-03-18T14:38:24.644 INFO:teuthology.orchestra.run.smithi129.stdout:(8/24): python3-ceph-common-15.2.17-0.el8.x86_6 1.8 MB/s | 77 kB 00:00 2024-03-18T14:38:24.669 INFO:teuthology.orchestra.run.smithi087.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-03-18T14:38:24.703 INFO:teuthology.orchestra.run.smithi087.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 4.8 MB/s | 164 kB 00:00 2024-03-18T14:38:24.762 INFO:teuthology.orchestra.run.smithi087.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 6.1 MB/s | 364 kB 00:00 2024-03-18T14:38:24.820 INFO:teuthology.orchestra.run.smithi087.stdout:(10/24): librgw2-15.2.17-0.el8.x86_64.rpm 9.8 MB/s | 3.2 MB 00:00 2024-03-18T14:38:24.846 INFO:teuthology.orchestra.run.smithi087.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 4.1 MB/s | 349 kB 00:00 2024-03-18T14:38:24.871 INFO:teuthology.orchestra.run.smithi087.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-03-18T14:38:24.890 INFO:teuthology.orchestra.run.smithi129.stdout:(9/24): ceph-common-15.2.17-0.el8.x86_64.rpm 15 MB/s | 21 MB 00:01 2024-03-18T14:38:24.920 INFO:teuthology.orchestra.run.smithi129.stdout:(10/24): python3-cephfs-15.2.17-0.el8.x86_64.rp 562 kB/s | 164 kB 00:00 2024-03-18T14:38:24.945 INFO:teuthology.orchestra.run.smithi129.stdout:(11/24): python3-rados-15.2.17-0.el8.x86_64.rpm 1.2 MB/s | 364 kB 00:00 2024-03-18T14:38:24.971 INFO:teuthology.orchestra.run.smithi129.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-03-18T14:38:24.996 INFO:teuthology.orchestra.run.smithi129.stdout:(13/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 3.2 MB/s | 349 kB 00:00 2024-03-18T14:38:25.113 INFO:teuthology.orchestra.run.smithi087.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 21 MB/s | 21 MB 00:00 2024-03-18T14:38:25.113 INFO:teuthology.orchestra.run.smithi129.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 377 kB/s | 44 kB 00:00 2024-03-18T14:38:25.124 INFO:teuthology.orchestra.run.smithi057.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 34 MB/s | 5.6 MB 00:00 2024-03-18T14:38:25.147 INFO:teuthology.orchestra.run.smithi129.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-03-18T14:38:25.157 INFO:teuthology.orchestra.run.smithi057.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 764 kB/s | 25 kB 00:00 2024-03-18T14:38:25.180 INFO:teuthology.orchestra.run.smithi129.stdout:(16/24): librdkafka-1.6.1-1.el8.x86_64.rpm 2.8 MB/s | 677 kB 00:00 2024-03-18T14:38:25.191 INFO:teuthology.orchestra.run.smithi057.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-03-18T14:38:25.213 INFO:teuthology.orchestra.run.smithi087.stdout:(14/24): python3-prettytable-0.7.2-14.el8.noarc 440 kB/s | 44 kB 00:00 2024-03-18T14:38:25.233 INFO:teuthology.orchestra.run.smithi057.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 9.0 MB/s | 380 kB 00:00 2024-03-18T14:38:25.255 INFO:teuthology.orchestra.run.smithi087.stdout:(15/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 676 kB/s | 259 kB 00:00 2024-03-18T14:38:25.256 INFO:teuthology.orchestra.run.smithi129.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 330 kB/s | 47 kB 00:00 2024-03-18T14:38:25.288 INFO:teuthology.orchestra.run.smithi087.stdout:(16/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 677 kB 00:00 2024-03-18T14:38:25.358 INFO:teuthology.orchestra.run.smithi057.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 26 MB/s | 3.2 MB 00:00 2024-03-18T14:38:25.376 INFO:teuthology.orchestra.run.smithi057.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 2.4 MB/s | 40 kB 00:00 2024-03-18T14:38:25.389 INFO:teuthology.orchestra.run.smithi087.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 268 kB/s | 47 kB 00:00 2024-03-18T14:38:25.401 INFO:teuthology.orchestra.run.smithi057.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-03-18T14:38:25.426 INFO:teuthology.orchestra.run.smithi057.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.5 MB/s | 164 kB 00:00 2024-03-18T14:38:25.535 INFO:teuthology.orchestra.run.smithi057.stdout:(9/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 17 MB/s | 9.9 MB 00:00 2024-03-18T14:38:25.548 INFO:teuthology.orchestra.run.smithi129.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 290 kB/s | 116 kB 00:00 2024-03-18T14:38:25.594 INFO:teuthology.orchestra.run.smithi057.stdout:(10/24): python3-rados-15.2.17-0.el8.x86_64.rpm 2.1 MB/s | 364 kB 00:00 2024-03-18T14:38:25.619 INFO:teuthology.orchestra.run.smithi057.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 4.1 MB/s | 349 kB 00:00 2024-03-18T14:38:25.644 INFO:teuthology.orchestra.run.smithi057.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-03-18T14:38:25.665 INFO:teuthology.orchestra.run.smithi129.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 504 kB/s | 59 kB 00:00 2024-03-18T14:38:25.690 INFO:teuthology.orchestra.run.smithi129.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 601 kB/s | 306 kB 00:00 2024-03-18T14:38:25.782 INFO:teuthology.orchestra.run.smithi129.stdout:(21/24): leveldb-1.22-1.el8.x86_64.rpm 344 kB/s | 181 kB 00:00 2024-03-18T14:38:25.807 INFO:teuthology.orchestra.run.smithi129.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 528 kB/s | 75 kB 00:00 2024-03-18T14:38:25.866 INFO:teuthology.orchestra.run.smithi129.stdout:(23/24): librados2-15.2.17-0.el8.x86_64.rpm 20 MB/s | 3.5 MB 00:00 2024-03-18T14:38:25.908 INFO:teuthology.orchestra.run.smithi129.stdout:(24/24): librbd1-15.2.17-0.el8.x86_64.rpm 15 MB/s | 1.9 MB 00:00 2024-03-18T14:38:25.910 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:38:25.910 INFO:teuthology.orchestra.run.smithi129.stdout:Total 19 MB/s | 49 MB 00:02 2024-03-18T14:38:25.954 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:38:25.969 INFO:teuthology.orchestra.run.smithi057.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 21 MB/s | 21 MB 00:01 2024-03-18T14:38:25.972 INFO:teuthology.orchestra.run.smithi087.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 162 kB/s | 116 kB 00:00 2024-03-18T14:38:25.995 INFO:teuthology.orchestra.run.smithi057.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 742 kB/s | 259 kB 00:00 2024-03-18T14:38:26.000 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:38:26.000 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:38:26.020 INFO:teuthology.orchestra.run.smithi057.stdout:(15/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.6 MB/s | 677 kB 00:00 2024-03-18T14:38:26.079 INFO:teuthology.orchestra.run.smithi057.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 404 kB/s | 44 kB 00:00 2024-03-18T14:38:26.140 INFO:teuthology.orchestra.run.smithi087.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 244 kB/s | 181 kB 00:00 2024-03-18T14:38:26.173 INFO:teuthology.orchestra.run.smithi087.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 294 kB/s | 59 kB 00:00 2024-03-18T14:38:26.187 INFO:teuthology.orchestra.run.smithi057.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 244 kB/s | 47 kB 00:00 2024-03-18T14:38:26.198 INFO:teuthology.orchestra.run.smithi087.stdout:(21/24): gperftools-libs-2.7-9.el8.x86_64.rpm 337 kB/s | 306 kB 00:00 2024-03-18T14:38:26.249 INFO:teuthology.orchestra.run.smithi087.stdout:(22/24): librbd1-15.2.17-0.el8.x86_64.rpm 39 MB/s | 1.9 MB 00:00 2024-03-18T14:38:26.296 INFO:teuthology.orchestra.run.smithi057.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 422 kB/s | 116 kB 00:00 2024-03-18T14:38:26.307 INFO:teuthology.orchestra.run.smithi087.stdout:(23/24): librados2-15.2.17-0.el8.x86_64.rpm 26 MB/s | 3.5 MB 00:00 2024-03-18T14:38:26.307 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:38:26.310 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:38:26.341 INFO:teuthology.orchestra.run.smithi087.stdout:(24/24): libunwind-1.3.1-3.el8.x86_64.rpm 374 kB/s | 75 kB 00:00 2024-03-18T14:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:38:26.345 INFO:teuthology.orchestra.run.smithi087.stdout:Total 17 MB/s | 49 MB 00:02 2024-03-18T14:38:26.346 INFO:teuthology.orchestra.run.smithi057.stdout:(19/24): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2024-03-18T14:38:26.386 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:38:26.405 INFO:teuthology.orchestra.run.smithi057.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 954 kB/s | 306 kB 00:00 2024-03-18T14:38:26.430 INFO:teuthology.orchestra.run.smithi057.stdout:(21/24): libunwind-1.3.1-3.el8.x86_64.rpm 897 kB/s | 75 kB 00:00 2024-03-18T14:38:26.433 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:38:26.433 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:38:26.456 INFO:teuthology.orchestra.run.smithi057.stdout:(22/24): leveldb-1.22-1.el8.x86_64.rpm 676 kB/s | 181 kB 00:00 2024-03-18T14:38:26.522 INFO:teuthology.orchestra.run.smithi057.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 21 MB/s | 1.9 MB 00:00 2024-03-18T14:38:26.581 INFO:teuthology.orchestra.run.smithi057.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 20 MB/s | 3.5 MB 00:00 2024-03-18T14:38:26.586 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:38:26.586 INFO:teuthology.orchestra.run.smithi057.stdout:Total 21 MB/s | 49 MB 00:02 2024-03-18T14:38:26.630 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:38:26.682 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:38:26.683 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:38:26.753 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:38:26.756 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:38:27.031 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:38:27.035 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:38:27.412 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:38:27.638 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-03-18T14:38:27.842 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-03-18T14:38:27.910 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:38:28.033 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:28.156 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-03-18T14:38:28.183 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:38:28.408 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-03-18T14:38:28.409 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:28.515 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-03-18T14:38:28.608 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:28.613 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:28.691 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:28.871 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-03-18T14:38:28.948 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:38:29.003 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:29.036 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:29.092 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:29.238 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:29.295 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:29.331 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-03-18T14:38:29.524 INFO:teuthology.orchestra.run.smithi129.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:29.572 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:29.595 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:38:29.686 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:29.766 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:29.784 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-03-18T14:38:29.797 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:30.019 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:38:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:30.243 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-03-18T14:38:30.271 INFO:teuthology.orchestra.run.smithi087.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:30.355 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:30.399 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:30.463 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:30.479 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:30.598 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-03-18T14:38:30.679 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-03-18T14:38:30.769 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:30.847 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:30.850 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:38:31.019 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:38:31.063 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-03-18T14:38:31.099 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-03-18T14:38:31.215 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-03-18T14:38:31.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:31.440 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-03-18T14:38:31.541 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:31.616 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:31.683 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:31.724 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-03-18T14:38:31.726 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-03-18T14:38:31.898 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:38:31.901 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-03-18T14:38:31.969 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:32.043 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:32.063 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:38:32.091 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-03-18T14:38:32.249 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-03-18T14:38:32.257 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-03-18T14:38:32.280 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-03-18T14:38:32.417 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-03-18T14:38:32.447 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:38:32.479 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-03-18T14:38:32.666 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:38:32.679 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:32.751 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:32.872 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-03-18T14:38:32.982 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-03-18T14:38:33.095 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-03-18T14:38:33.164 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-03-18T14:38:33.277 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:33.352 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-03-18T14:38:33.382 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-03-18T14:38:33.563 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-03-18T14:38:33.590 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-03-18T14:38:33.795 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-03-18T14:38:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-03-18T14:38:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-03-18T14:38:34.573 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:34.758 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:35.405 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:35.634 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:35.738 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:35.802 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:35.899 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:36.021 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:36.677 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:36.698 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:36.944 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:36.957 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:37.058 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:37.201 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:37.643 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-03-18T14:38:37.905 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:38.039 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-03-18T14:38:38.160 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:54.742 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /sys 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /proc 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /run 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /mnt 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /var/tmp 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /home 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /tmp 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout:skipping the directory /dev 2024-03-18T14:38:54.743 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:38:55.773 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:55.847 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:55.847 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:56.056 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:56.056 INFO:teuthology.orchestra.run.smithi129.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /sys 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /proc 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /run 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /mnt 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /var/tmp 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /home 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /tmp 2024-03-18T14:38:56.138 INFO:teuthology.orchestra.run.smithi087.stdout:skipping the directory /dev 2024-03-18T14:38:56.139 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:56.749 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-03-18T14:38:56.750 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-03-18T14:38:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-03-18T14:38:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-03-18T14:38:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-03-18T14:38:56.751 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-03-18T14:38:57.196 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:57.261 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:57.261 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:57.487 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:57.488 INFO:teuthology.orchestra.run.smithi087.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout:Upgraded: 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: fmt-6.2.1-1.el8.x86_64 2024-03-18T14:38:57.588 INFO:teuthology.orchestra.run.smithi129.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: leveldb-1.22-1.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.589 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:57.590 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:38:57.590 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:38:57.878 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:57.878 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-03-18T14:38:57.878 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2024-03-18T14:38:57.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:38:57.895 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-test 2024-03-18T14:38:58.187 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:58.187 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-03-18T14:38:58.188 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-03-18T14:38:58.189 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-03-18T14:38:58.649 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:39 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:38:58.943 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:59.048 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-03-18T14:38:59.048 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:59.172 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout:Upgraded: 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: fmt-6.2.1-1.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: leveldb-1.22-1.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-18T14:38:59.173 INFO:teuthology.orchestra.run.smithi087.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:38:59.174 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:38:59.251 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-03-18T14:38:59.251 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:38:59.501 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-test 2024-03-18T14:39:00.055 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-03-18T14:39:00.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-03-18T14:39:00.057 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-03-18T14:39:00.058 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-03-18T14:39:00.058 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-03-18T14:39:00.058 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-03-18T14:39:00.244 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:00.244 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:00.245 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:00.246 INFO:teuthology.orchestra.run.smithi129.stdout:Install 5 Packages 2024-03-18T14:39:00.246 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:00.246 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 43 M 2024-03-18T14:39:00.246 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 155 M 2024-03-18T14:39:00.246 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:00.252 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:41 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:00.656 INFO:teuthology.orchestra.run.smithi129.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-03-18T14:39:00.682 INFO:teuthology.orchestra.run.smithi129.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.1 MB/s | 203 kB 00:00 2024-03-18T14:39:00.732 INFO:teuthology.orchestra.run.smithi129.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2024-03-18T14:39:00.757 INFO:teuthology.orchestra.run.smithi129.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 941 kB/s | 71 kB 00:00 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: fmt-6.2.1-1.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb-1.22-1.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-18T14:39:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:01.018 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:01.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-test 2024-03-18T14:39:01.566 INFO:teuthology.orchestra.run.smithi129.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 39 MB/s | 42 MB 00:01 2024-03-18T14:39:01.567 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:01.567 INFO:teuthology.orchestra.run.smithi129.stdout:Total 32 MB/s | 43 MB 00:01 2024-03-18T14:39:01.609 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:01.628 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:01.628 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:01.849 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:01.850 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:01.850 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:01.850 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout:Install 5 Packages 2024-03-18T14:39:01.851 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:01.852 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 43 M 2024-03-18T14:39:01.852 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 155 M 2024-03-18T14:39:01.852 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:01.901 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:01.905 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:02.162 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:42 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:02.318 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:02.525 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-03-18T14:39:02.698 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-03-18T14:39:02.820 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:02.886 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:03.241 INFO:teuthology.orchestra.run.smithi087.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.0 MB/s | 188 kB 00:00 2024-03-18T14:39:03.269 INFO:teuthology.orchestra.run.smithi087.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 951 kB/s | 203 kB 00:00 2024-03-18T14:39:03.320 INFO:teuthology.orchestra.run.smithi087.stdout:(3/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-18T14:39:03.345 INFO:teuthology.orchestra.run.smithi087.stdout:(4/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.0 MB/s | 323 kB 00:00 2024-03-18T14:39:03.779 INFO:teuthology.orchestra.run.smithi087.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 58 MB/s | 42 MB 00:00 2024-03-18T14:39:03.780 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:03.780 INFO:teuthology.orchestra.run.smithi087.stdout:Total 22 MB/s | 43 MB 00:01 2024-03-18T14:39:03.821 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:03.840 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:03.840 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:03.872 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:03.872 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:03.873 INFO:teuthology.orchestra.run.smithi057.stdout:Install 5 Packages 2024-03-18T14:39:03.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:03.874 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 43 M 2024-03-18T14:39:03.874 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 155 M 2024-03-18T14:39:03.874 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:04.120 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:04.123 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:04.560 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:04.784 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-03-18T14:39:04.982 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-03-18T14:39:05.109 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:05.183 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:06.249 INFO:teuthology.orchestra.run.smithi057.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-03-18T14:39:06.274 INFO:teuthology.orchestra.run.smithi057.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.0 MB/s | 203 kB 00:00 2024-03-18T14:39:06.324 INFO:teuthology.orchestra.run.smithi057.stdout:(3/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-18T14:39:06.350 INFO:teuthology.orchestra.run.smithi057.stdout:(4/5): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-03-18T14:39:06.702 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-03-18T14:39:06.825 INFO:teuthology.orchestra.run.smithi057.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 56 MB/s | 42 MB 00:00 2024-03-18T14:39:06.826 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:06.826 INFO:teuthology.orchestra.run.smithi057.stdout:Total 15 MB/s | 43 MB 00:02 2024-03-18T14:39:06.869 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:06.889 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:06.890 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:06.901 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:07.188 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:07.188 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:07.189 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-03-18T14:39:07.189 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-03-18T14:39:07.189 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:07.189 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-03-18T14:39:07.191 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-03-18T14:39:07.617 INFO:teuthology.orchestra.run.smithi129.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-03-18T14:39:07.618 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:07.618 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:07.860 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph 2024-03-18T14:39:07.910 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-03-18T14:39:08.105 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-03-18T14:39:08.255 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:08.331 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:08.623 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:00:49 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:09.041 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-03-18T14:39:09.273 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:09.558 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:09.558 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-03-18T14:39:09.558 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-03-18T14:39:09.558 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:09.558 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-03-18T14:39:09.976 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-03-18T14:39:09.976 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:09.976 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-03-18T14:39:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-03-18T14:39:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-03-18T14:39:09.977 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:09.977 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:10.200 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph 2024-03-18T14:39:10.218 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:10.221 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:10.221 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repository Size 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-18T14:39:10.222 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-18T14:39:10.223 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout:Install 32 Packages 2024-03-18T14:39:10.224 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:10.225 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 28 M 2024-03-18T14:39:10.225 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 91 M 2024-03-18T14:39:10.225 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:10.858 INFO:teuthology.orchestra.run.smithi129.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 76 kB/s | 6.3 kB 00:00 2024-03-18T14:39:10.917 INFO:teuthology.orchestra.run.smithi129.stdout:(2/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-03-18T14:39:10.956 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:00:51 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:11.242 INFO:teuthology.orchestra.run.smithi129.stdout:(3/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 3.1 MB/s | 1.4 MB 00:00 2024-03-18T14:39:11.276 INFO:teuthology.orchestra.run.smithi129.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-03-18T14:39:11.343 INFO:teuthology.orchestra.run.smithi129.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 9.0 MB/s | 4.3 MB 00:00 2024-03-18T14:39:11.518 INFO:teuthology.orchestra.run.smithi129.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 28 MB/s | 17 MB 00:00 2024-03-18T14:39:11.621 INFO:teuthology.orchestra.run.smithi129.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 456 kB/s | 157 kB 00:00 2024-03-18T14:39:11.696 INFO:teuthology.orchestra.run.smithi129.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 760 kB/s | 57 kB 00:00 2024-03-18T14:39:11.721 INFO:teuthology.orchestra.run.smithi129.stdout:(9/32): python3-markupsafe-0.23-19.el8.x86_64.r 102 kB/s | 39 kB 00:00 2024-03-18T14:39:11.747 INFO:teuthology.orchestra.run.smithi129.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 454 kB/s | 103 kB 00:00 2024-03-18T14:39:12.030 INFO:teuthology.orchestra.run.smithi129.stdout:(11/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 806 kB/s | 249 kB 00:00 2024-03-18T14:39:12.139 INFO:teuthology.orchestra.run.smithi129.stdout:(12/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.0 MB/s | 457 kB 00:00 2024-03-18T14:39:12.164 INFO:teuthology.orchestra.run.smithi129.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 817 kB/s | 109 kB 00:00 2024-03-18T14:39:12.339 INFO:teuthology.orchestra.run.smithi129.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.1 MB/s | 641 kB 00:00 2024-03-18T14:39:12.407 INFO:teuthology.orchestra.run.smithi129.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 163 kB/s | 44 kB 00:00 2024-03-18T14:39:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-03-18T14:39:12.524 INFO:teuthology.orchestra.run.smithi129.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 516 kB/s | 185 kB 00:00 2024-03-18T14:39:12.556 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repository Size 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-03-18T14:39:12.559 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-18T14:39:12.560 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-18T14:39:12.561 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-18T14:39:12.562 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-18T14:39:12.563 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:12.564 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:12.565 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:12.565 INFO:teuthology.orchestra.run.smithi087.stdout:Install 32 Packages 2024-03-18T14:39:12.565 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:12.566 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 28 M 2024-03-18T14:39:12.566 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 91 M 2024-03-18T14:39:12.566 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:12.624 INFO:teuthology.orchestra.run.smithi129.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2024-03-18T14:39:12.649 INFO:teuthology.orchestra.run.smithi129.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2024-03-18T14:39:12.699 INFO:teuthology.orchestra.run.smithi129.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 480 kB/s | 173 kB 00:00 2024-03-18T14:39:12.716 INFO:teuthology.orchestra.run.smithi129.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 191 kB/s | 18 kB 00:00 2024-03-18T14:39:12.720 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:12.741 INFO:teuthology.orchestra.run.smithi129.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 528 kB/s | 49 kB 00:00 2024-03-18T14:39:12.775 INFO:teuthology.orchestra.run.smithi129.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2024-03-18T14:39:12.834 INFO:teuthology.orchestra.run.smithi129.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2024-03-18T14:39:12.851 INFO:teuthology.orchestra.run.smithi129.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2024-03-18T14:39:12.876 INFO:teuthology.orchestra.run.smithi129.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 186 kB/s | 19 kB 00:00 2024-03-18T14:39:12.902 INFO:teuthology.orchestra.run.smithi129.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 356 kB/s | 24 kB 00:00 2024-03-18T14:39:12.960 INFO:teuthology.orchestra.run.smithi129.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 269 kB/s | 29 kB 00:00 2024-03-18T14:39:12.985 INFO:teuthology.orchestra.run.smithi129.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 253 kB/s | 27 kB 00:00 2024-03-18T14:39:13.016 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-03-18T14:39:13.017 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-03-18T14:39:13.017 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-03-18T14:39:13.017 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-03-18T14:39:13.017 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-03-18T14:39:13.052 INFO:teuthology.orchestra.run.smithi129.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.7 MB/s | 255 kB 00:00 2024-03-18T14:39:13.119 INFO:teuthology.orchestra.run.smithi129.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 639 kB/s | 85 kB 00:00 2024-03-18T14:39:13.144 INFO:teuthology.orchestra.run.smithi129.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 250 kB/s | 23 kB 00:00 2024-03-18T14:39:13.269 INFO:teuthology.orchestra.run.smithi129.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 812 kB/s | 251 kB 00:00 2024-03-18T14:39:13.271 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:13.271 INFO:teuthology.orchestra.run.smithi129.stdout:Total 9.3 MB/s | 28 MB 00:03 2024-03-18T14:39:13.352 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:13.390 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:13.391 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:13.493 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:13.696 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:13.699 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:13.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph 2024-03-18T14:39:13.779 INFO:teuthology.orchestra.run.smithi087.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 114 kB/s | 6.3 kB 00:00 2024-03-18T14:39:13.829 INFO:teuthology.orchestra.run.smithi087.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-03-18T14:39:13.872 INFO:teuthology.orchestra.run.smithi087.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-03-18T14:39:13.905 INFO:teuthology.orchestra.run.smithi087.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-03-18T14:39:13.981 INFO:teuthology.orchestra.run.smithi087.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 22 MB/s | 4.3 MB 00:00 2024-03-18T14:39:14.198 INFO:teuthology.orchestra.run.smithi087.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 46 MB/s | 17 MB 00:00 2024-03-18T14:39:14.223 INFO:teuthology.orchestra.run.smithi087.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 160 kB/s | 39 kB 00:00 2024-03-18T14:39:14.248 INFO:teuthology.orchestra.run.smithi087.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 458 kB/s | 157 kB 00:00 2024-03-18T14:39:14.307 INFO:teuthology.orchestra.run.smithi087.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 682 kB/s | 57 kB 00:00 2024-03-18T14:39:14.332 INFO:teuthology.orchestra.run.smithi087.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 773 kB/s | 103 kB 00:00 2024-03-18T14:39:14.391 INFO:teuthology.orchestra.run.smithi087.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.1 MB/s | 457 kB 00:00 2024-03-18T14:39:14.524 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:54 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:14.782 INFO:teuthology.orchestra.run.smithi087.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 523 kB/s | 249 kB 00:00 2024-03-18T14:39:14.794 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:14.833 INFO:teuthology.orchestra.run.smithi087.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 247 kB/s | 109 kB 00:00 2024-03-18T14:39:14.891 INFO:teuthology.orchestra.run.smithi087.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 402 kB/s | 44 kB 00:00 2024-03-18T14:39:14.917 INFO:teuthology.orchestra.run.smithi087.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.2 MB/s | 185 kB 00:00 2024-03-18T14:39:14.950 INFO:teuthology.orchestra.run.smithi087.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2024-03-18T14:39:14.975 INFO:teuthology.orchestra.run.smithi087.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 446 kB/s | 11 kB 00:00 2024-03-18T14:39:15.009 INFO:teuthology.orchestra.run.smithi087.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.1 MB/s | 384 kB 00:00 2024-03-18T14:39:15.014 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-03-18T14:39:15.034 INFO:teuthology.orchestra.run.smithi087.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 300 kB/s | 18 kB 00:00 2024-03-18T14:39:15.051 INFO:teuthology.orchestra.run.smithi087.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 1.1 MB/s | 49 kB 00:00 2024-03-18T14:39:15.101 INFO:teuthology.orchestra.run.smithi087.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 879 kB/s | 59 kB 00:00 2024-03-18T14:39:15.135 INFO:teuthology.orchestra.run.smithi087.stdout:(22/32): python3-cryptography-3.2.1-7.el8.x86_6 799 kB/s | 641 kB 00:00 2024-03-18T14:39:15.160 INFO:teuthology.orchestra.run.smithi087.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-03-18T14:39:15.186 INFO:teuthology.orchestra.run.smithi087.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2024-03-18T14:39:15.209 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-03-18T14:39:15.211 INFO:teuthology.orchestra.run.smithi087.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-03-18T14:39:15.236 INFO:teuthology.orchestra.run.smithi087.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 317 kB/s | 24 kB 00:00 2024-03-18T14:39:15.262 INFO:teuthology.orchestra.run.smithi087.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 387 kB/s | 29 kB 00:00 2024-03-18T14:39:15.287 INFO:teuthology.orchestra.run.smithi087.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2024-03-18T14:39:15.320 INFO:teuthology.orchestra.run.smithi087.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 4.3 MB/s | 255 kB 00:00 2024-03-18T14:39:15.362 INFO:teuthology.orchestra.run.smithi087.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2024-03-18T14:39:15.388 INFO:teuthology.orchestra.run.smithi087.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2024-03-18T14:39:15.408 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-03-18T14:39:15.412 INFO:teuthology.orchestra.run.smithi087.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2024-03-18T14:39:15.414 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:15.414 INFO:teuthology.orchestra.run.smithi087.stdout:Total 10 MB/s | 28 MB 00:02 2024-03-18T14:39:15.497 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:15.535 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:15.675 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-03-18T14:39:15.828 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:15.831 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:15.847 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-03-18T14:39:15.994 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-03-18T14:39:16.188 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-03-18T14:39:16.257 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:16.260 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-18T14:39:16.260 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:16.260 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-18T14:39:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-18T14:39:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout:Install 32 Packages 2024-03-18T14:39:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:16.264 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 28 M 2024-03-18T14:39:16.264 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 91 M 2024-03-18T14:39:16.264 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:16.374 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-03-18T14:39:16.449 INFO:teuthology.orchestra.run.smithi057.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 136 kB/s | 6.3 kB 00:00 2024-03-18T14:39:16.491 INFO:teuthology.orchestra.run.smithi057.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-03-18T14:39:16.533 INFO:teuthology.orchestra.run.smithi057.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2024-03-18T14:39:16.559 INFO:teuthology.orchestra.run.smithi057.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 7.6 MB/s | 193 kB 00:00 2024-03-18T14:39:16.566 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-03-18T14:39:16.671 INFO:teuthology.orchestra.run.smithi057.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 20 MB/s | 4.3 MB 00:00 2024-03-18T14:39:16.829 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-03-18T14:39:16.901 INFO:teuthology.orchestra.run.smithi057.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 41 MB/s | 17 MB 00:00 2024-03-18T14:39:16.951 INFO:teuthology.orchestra.run.smithi057.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 138 kB/s | 39 kB 00:00 2024-03-18T14:39:16.976 INFO:teuthology.orchestra.run.smithi057.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 376 kB/s | 157 kB 00:00 2024-03-18T14:39:17.010 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:17.018 INFO:teuthology.orchestra.run.smithi057.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 853 kB/s | 57 kB 00:00 2024-03-18T14:39:17.052 INFO:teuthology.orchestra.run.smithi057.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 687 kB/s | 103 kB 00:00 2024-03-18T14:39:17.058 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-03-18T14:39:17.077 INFO:teuthology.orchestra.run.smithi057.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.4 MB/s | 457 kB 00:00 2024-03-18T14:39:17.212 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-03-18T14:39:17.290 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-03-18T14:39:17.327 INFO:teuthology.orchestra.run.smithi057.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 436 kB/s | 109 kB 00:00 2024-03-18T14:39:17.353 INFO:teuthology.orchestra.run.smithi057.stdout:(13/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 744 kB/s | 249 kB 00:00 2024-03-18T14:39:17.398 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-03-18T14:39:17.578 INFO:teuthology.orchestra.run.smithi057.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 1.2 MB/s | 641 kB 00:00 2024-03-18T14:39:17.614 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-03-18T14:39:17.695 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-03-18T14:39:17.880 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-03-18T14:39:17.920 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-03-18T14:39:18.094 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-03-18T14:39:18.117 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-03-18T14:39:18.220 INFO:teuthology.orchestra.run.smithi057.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 49 kB/s | 44 kB 00:00 2024-03-18T14:39:18.266 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-03-18T14:39:18.278 INFO:teuthology.orchestra.run.smithi057.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 246 kB/s | 173 kB 00:00 2024-03-18T14:39:18.304 INFO:teuthology.orchestra.run.smithi057.stdout:(17/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 195 kB/s | 185 kB 00:00 2024-03-18T14:39:18.308 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-03-18T14:39:18.396 INFO:teuthology.orchestra.run.smithi057.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.1 MB/s | 384 kB 00:00 2024-03-18T14:39:18.460 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-03-18T14:39:18.494 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:18.679 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-03-18T14:39:18.817 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-03-18T14:39:18.913 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-03-18T14:39:19.015 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-03-18T14:39:19.151 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-03-18T14:39:19.220 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-03-18T14:39:19.413 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-03-18T14:39:19.431 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-03-18T14:39:19.636 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-03-18T14:39:19.686 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-03-18T14:39:19.896 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-03-18T14:39:20.003 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-03-18T14:39:20.136 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-03-18T14:39:20.276 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-03-18T14:39:20.435 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-03-18T14:39:20.506 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-03-18T14:39:20.751 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-03-18T14:39:20.760 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-03-18T14:39:20.923 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:21.089 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-03-18T14:39:21.247 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-03-18T14:39:21.286 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:21.362 INFO:teuthology.orchestra.run.smithi057.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 3.6 kB/s | 11 kB 00:03 2024-03-18T14:39:21.379 INFO:teuthology.orchestra.run.smithi057.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 5.7 kB/s | 18 kB 00:03 2024-03-18T14:39:21.396 INFO:teuthology.orchestra.run.smithi057.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 16 kB/s | 49 kB 00:03 2024-03-18T14:39:21.428 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-03-18T14:39:21.650 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-03-18T14:39:21.655 INFO:teuthology.orchestra.run.smithi057.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 201 kB/s | 59 kB 00:00 2024-03-18T14:39:21.714 INFO:teuthology.orchestra.run.smithi057.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 49 kB/s | 16 kB 00:00 2024-03-18T14:39:21.739 INFO:teuthology.orchestra.run.smithi057.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 787 kB/s | 283 kB 00:00 2024-03-18T14:39:21.764 INFO:teuthology.orchestra.run.smithi057.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-03-18T14:39:21.831 INFO:teuthology.orchestra.run.smithi057.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 204 kB/s | 24 kB 00:00 2024-03-18T14:39:21.856 INFO:teuthology.orchestra.run.smithi057.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 249 kB/s | 29 kB 00:00 2024-03-18T14:39:21.878 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-03-18T14:39:21.881 INFO:teuthology.orchestra.run.smithi057.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 235 kB/s | 27 kB 00:00 2024-03-18T14:39:22.194 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-03-18T14:39:22.410 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-03-18T14:39:22.600 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-03-18T14:39:22.650 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:22.665 INFO:teuthology.orchestra.run.smithi057.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 109 kB/s | 85 kB 00:00 2024-03-18T14:39:22.682 INFO:teuthology.orchestra.run.smithi057.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 314 kB/s | 251 kB 00:00 2024-03-18T14:39:22.774 INFO:teuthology.orchestra.run.smithi057.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2024-03-18T14:39:22.799 INFO:teuthology.orchestra.run.smithi057.stdout:(32/32): python3-waitress-1.4.3-1.el8.noarch.rp 264 kB/s | 255 kB 00:00 2024-03-18T14:39:22.800 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:22.801 INFO:teuthology.orchestra.run.smithi057.stdout:Total 4.3 MB/s | 28 MB 00:06 2024-03-18T14:39:22.809 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:22.886 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:22.909 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-03-18T14:39:22.927 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:22.927 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:23.197 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:23.217 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-03-18T14:39:23.248 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:23.251 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:23.376 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:23.558 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:23.571 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-03-18T14:39:23.693 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:23.710 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:23.760 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:23.874 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-03-18T14:39:24.265 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-03-18T14:39:24.266 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-03-18T14:39:24.267 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-03-18T14:39:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:24.721 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-03-18T14:39:24.927 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-03-18T14:39:25.113 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-03-18T14:39:25.113 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:25.113 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:25.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:25.113 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-18T14:39:25.114 INFO:teuthology.orchestra.run.smithi129.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-portend-2.6-1.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-18T14:39:25.115 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-18T14:39:25.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-18T14:39:25.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-18T14:39:25.116 INFO:teuthology.orchestra.run.smithi129.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-18T14:39:25.116 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:25.116 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:25.119 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-03-18T14:39:25.273 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:25.361 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-base 2024-03-18T14:39:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-03-18T14:39:25.616 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-03-18T14:39:25.652 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:25.814 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-03-18T14:39:25.865 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-03-18T14:39:26.046 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:26.120 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:07 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:26.206 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:26.223 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:26.242 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-03-18T14:39:26.348 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:26.463 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-03-18T14:39:26.724 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-03-18T14:39:26.760 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-03-18T14:39:26.761 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-03-18T14:39:26.762 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-03-18T14:39:26.963 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-03-18T14:39:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-03-18T14:39:27.642 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-03-18T14:39:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-03-18T14:39:27.643 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:27.643 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-18T14:39:27.644 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-portend-2.6-1.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-18T14:39:27.645 INFO:teuthology.orchestra.run.smithi087.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:27.646 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:27.675 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:27.721 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:27.722 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:27.722 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:27.833 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-immutable-object-cache 2024-03-18T14:39:27.915 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-03-18T14:39:27.940 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-base 2024-03-18T14:39:28.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-03-18T14:39:28.376 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-03-18T14:39:28.572 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:28.587 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:09 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:28.695 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:09 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:28.914 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-03-18T14:39:29.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-03-18T14:39:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-03-18T14:39:29.558 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-03-18T14:39:29.878 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-03-18T14:39:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-03-18T14:39:30.182 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout: Package Arch Version Repo Size 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:30.183 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:39:30.184 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:30.184 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 203 k 2024-03-18T14:39:30.184 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 599 k 2024-03-18T14:39:30.184 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:30.212 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:30.259 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:30.260 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:30.260 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:30.270 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 2.3 MB/s | 203 kB 00:00 2024-03-18T14:39:30.271 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:30.271 INFO:teuthology.orchestra.run.smithi129.stdout:Total 2.3 MB/s | 203 kB 00:00 2024-03-18T14:39:30.271 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:30.282 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:30.282 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:30.329 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:30.332 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:30.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-immutable-object-cache 2024-03-18T14:39:30.374 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-03-18T14:39:30.449 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:30.591 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:30.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-03-18T14:39:31.002 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:31.035 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-03-18T14:39:31.109 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:12 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:31.364 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:31.365 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:31.365 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:31.365 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:31.365 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:31.365 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:31.399 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-03-18T14:39:31.563 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-mgr 2024-03-18T14:39:31.613 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:32.326 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:13 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:32.682 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:32.682 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: Package Arch Version Repo Size 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 203 k 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 599 k 2024-03-18T14:39:32.683 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:32.734 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 3.9 MB/s | 203 kB 00:00 2024-03-18T14:39:32.735 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:32.735 INFO:teuthology.orchestra.run.smithi087.stdout:Total 3.8 MB/s | 203 kB 00:00 2024-03-18T14:39:32.735 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:32.746 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:32.746 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:32.794 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:32.797 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:32.939 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:33.059 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-03-18T14:39:33.072 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:33.243 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:33.495 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:33.648 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-03-18T14:39:33.860 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:33.871 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:33.878 INFO:teuthology.orchestra.run.smithi129.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:33.924 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:33.925 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:33.926 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:34.042 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install ceph-fuse 2024-03-18T14:39:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-03-18T14:39:34.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-mgr 2024-03-18T14:39:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-03-18T14:39:34.402 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:34.792 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:15 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:34.821 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-03-18T14:39:34.822 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-03-18T14:39:34.823 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-03-18T14:39:34.824 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-03-18T14:39:34.824 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-03-18T14:39:34.825 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-03-18T14:39:34.825 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-03-18T14:39:34.825 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-03-18T14:39:34.825 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-03-18T14:39:34.885 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:15 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-03-18T14:39:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:35.669 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:35.669 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-18T14:39:35.670 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-18T14:39:35.671 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:35.672 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:35.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-base 2024-03-18T14:39:36.392 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:36.393 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:36.393 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:36.393 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:36.393 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout:Installing dependencies: 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:36.394 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:36.395 INFO:teuthology.orchestra.run.smithi129.stdout:Install 2 Packages 2024-03-18T14:39:36.395 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:36.396 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 656 k 2024-03-18T14:39:36.396 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 1.8 M 2024-03-18T14:39:36.396 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:36.416 INFO:teuthology.orchestra.run.smithi087.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:36.464 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:36.466 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:36.466 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:36.641 INFO:teuthology.orchestra.run.smithi129.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 8.8 MB/s | 572 kB 00:00 2024-03-18T14:39:36.705 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:16 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:36.724 INFO:teuthology.orchestra.run.smithi129.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 567 kB/s | 83 kB 00:00 2024-03-18T14:39:36.725 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:36.725 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.9 MB/s | 656 kB 00:00 2024-03-18T14:39:36.735 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:36.756 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:36.756 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:36.839 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:36.840 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:36.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install ceph-fuse 2024-03-18T14:39:37.020 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:37.229 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-03-18T14:39:37.415 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:37.683 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:18 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:37.806 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:37.807 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:38.154 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:38.354 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados-devel 2024-03-18T14:39:38.396 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:38.445 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:38.446 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:39:38.447 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:38.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-immutable-object-cache 2024-03-18T14:39:39.122 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:20 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:39.277 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:Installing dependencies: 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout:Install 2 Packages 2024-03-18T14:39:39.278 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:39.279 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 656 k 2024-03-18T14:39:39.279 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 1.8 M 2024-03-18T14:39:39.279 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:39.354 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:19 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:39.537 INFO:teuthology.orchestra.run.smithi087.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 11 MB/s | 572 kB 00:00 2024-03-18T14:39:39.662 INFO:teuthology.orchestra.run.smithi087.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 467 kB/s | 83 kB 00:00 2024-03-18T14:39:39.663 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:39.663 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.7 MB/s | 656 kB 00:00 2024-03-18T14:39:39.673 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:39.693 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:39.693 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:39.776 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:39.779 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:39.990 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:40.242 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-03-18T14:39:40.378 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:40.712 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:40.712 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:40.712 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:40.712 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:40.712 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 140 k 2024-03-18T14:39:40.713 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 478 k 2024-03-18T14:39:40.714 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:40.783 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:40.783 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-03-18T14:39:40.995 INFO:teuthology.orchestra.run.smithi129.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 499 kB/s | 140 kB 00:00 2024-03-18T14:39:40.996 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:40.997 INFO:teuthology.orchestra.run.smithi129.stdout:Total 496 kB/s | 140 kB 00:00 2024-03-18T14:39:40.997 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:41.002 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:41.002 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:41.050 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:41.053 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:41.053 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:39:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:41.055 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 203 k 2024-03-18T14:39:41.055 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 599 k 2024-03-18T14:39:41.055 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:41.138 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 2.4 MB/s | 203 kB 00:00 2024-03-18T14:39:41.139 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:41.139 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.4 MB/s | 203 kB 00:00 2024-03-18T14:39:41.139 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:41.149 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:41.149 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:41.159 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:41.181 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:41.201 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:41.204 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:41.363 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:41.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados-devel 2024-03-18T14:39:41.465 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:41.651 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:41.656 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:42.005 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:42.006 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:42.006 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:42.006 INFO:teuthology.orchestra.run.smithi129.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:42.006 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:42.006 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:42.078 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:42.189 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:23 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:42.215 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs2 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:42.615 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:42.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr 2024-03-18T14:39:42.972 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:23 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:43.704 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:23 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:43.786 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 140 k 2024-03-18T14:39:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 478 k 2024-03-18T14:39:43.788 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 3.1 MB/s | 140 kB 00:00 2024-03-18T14:39:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:Total 3.0 MB/s | 140 kB 00:00 2024-03-18T14:39:43.833 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:43.838 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:43.886 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:43.889 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:43.991 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:44.169 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:44.451 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:44.484 INFO:teuthology.orchestra.run.smithi129.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:44.530 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:44.531 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:44.531 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:44.636 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install libcephfs-devel 2024-03-18T14:39:44.865 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:44.865 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:44.865 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:44.866 INFO:teuthology.orchestra.run.smithi087.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:44.866 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:44.866 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:45.088 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs2 2024-03-18T14:39:45.354 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:45.392 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:26 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:45.404 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:45.405 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:39:45.406 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:45.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-fuse 2024-03-18T14:39:45.844 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:26 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:46.357 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:26 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:46.994 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:39:46.995 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:39:46.996 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:46.996 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 22 k 2024-03-18T14:39:46.996 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 78 k 2024-03-18T14:39:46.996 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:39:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 487 kB/s | 22 kB 00:00 2024-03-18T14:39:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:Total 473 kB/s | 22 kB 00:00 2024-03-18T14:39:47.041 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:39:47.045 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:39:47.045 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:39:47.046 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:39:47.049 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:39:47.101 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:39:47.254 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:47.392 INFO:teuthology.orchestra.run.smithi087.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:47.440 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:47.441 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:47.442 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:47.519 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:47.550 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install libcephfs-devel 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:39:47.861 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:47.979 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados2 2024-03-18T14:39:48.055 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-03-18T14:39:48.056 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:48.057 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 656 k 2024-03-18T14:39:48.057 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 1.8 M 2024-03-18T14:39:48.057 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:48.156 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 9.6 MB/s | 572 kB 00:00 2024-03-18T14:39:48.273 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 476 kB/s | 83 kB 00:00 2024-03-18T14:39:48.273 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:48.274 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.0 MB/s | 656 kB 00:00 2024-03-18T14:39:48.284 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:48.302 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:29 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:48.305 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:48.306 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:48.394 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:48.397 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:48.658 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:48.737 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:29 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-03-18T14:39:49.066 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:49.459 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-03-18T14:39:49.460 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-03-18T14:39:49.980 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:39:49.981 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:49.982 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 22 k 2024-03-18T14:39:49.982 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 78 k 2024-03-18T14:39:49.982 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:39:50.035 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 410 kB/s | 22 kB 00:00 2024-03-18T14:39:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:Total 401 kB/s | 22 kB 00:00 2024-03-18T14:39:50.036 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:39:50.039 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:39:50.039 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:39:50.041 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:39:50.044 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:39:50.056 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-03-18T14:39:50.056 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:50.056 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:50.056 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-03-18T14:39:50.056 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:50.057 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:50.091 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:39:50.268 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:50.272 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:50.318 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:50.323 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:50.323 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:50.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados-devel 2024-03-18T14:39:50.431 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librbd1 2024-03-18T14:39:50.537 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:50.883 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:50.884 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:39:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:50.884 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:39:50.884 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:50.997 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados2 2024-03-18T14:39:51.140 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:31 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:51.191 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:32 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:51.747 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:32 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:52.732 INFO:teuthology.orchestra.run.smithi129.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:52.781 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:52.782 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:52.782 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:52.846 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:39:52.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:52.848 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 140 k 2024-03-18T14:39:52.848 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 478 k 2024-03-18T14:39:52.848 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:52.901 INFO:teuthology.orchestra.run.smithi057.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.6 MB/s | 140 kB 00:00 2024-03-18T14:39:52.902 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:52.902 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.5 MB/s | 140 kB 00:00 2024-03-18T14:39:52.902 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:52.907 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:52.908 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:52.923 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rados 2024-03-18T14:39:52.958 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:52.962 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:53.074 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:53.297 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:53.313 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:53.359 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:53.360 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:53.360 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:53.475 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librbd1 2024-03-18T14:39:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:53.676 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:34 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:53.961 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:54.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs2 2024-03-18T14:39:54.230 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:35 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:54.996 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:34 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:55.230 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:55.277 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:55.278 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:55.278 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:55.381 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rgw 2024-03-18T14:39:55.779 INFO:teuthology.orchestra.run.smithi087.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:55.847 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:55.848 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:55.848 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:55.958 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rados 2024-03-18T14:39:56.134 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:37 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:56.657 INFO:teuthology.orchestra.run.smithi057.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:56.710 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:56.711 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:39:56.711 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:39:56.714 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:37 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:56.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs-devel 2024-03-18T14:39:57.619 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:37 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:39:57.675 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:57.722 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:39:57.723 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:39:57.723 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:39:57.831 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-cephfs 2024-03-18T14:39:58.274 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:39:58.320 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:39:58.321 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:39:58.321 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:39:58.586 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:39 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:58.712 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rgw 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-03-18T14:39:59.329 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 22 k 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 78 k 2024-03-18T14:39:59.330 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:39:59.370 INFO:teuthology.orchestra.run.smithi057.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 554 kB/s | 22 kB 00:00 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:Total 536 kB/s | 22 kB 00:00 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:39:59.376 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:39:59.379 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:39:59.429 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:39:59.463 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:40 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:39:59.588 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:39:59.840 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:00.133 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:00.180 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:00.181 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:40:00.181 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:00.215 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:40:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:00.215 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:00.297 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install python3-rbd 2024-03-18T14:40:00.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-03-18T14:40:01.008 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:01.046 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:42 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:01.069 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:01.070 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:40:01.070 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:01.141 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:41 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:01.174 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-cephfs 2024-03-18T14:40:01.930 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:42 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:02.591 INFO:teuthology.orchestra.run.smithi129.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:02.638 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:02.639 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:40:02.639 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:02.754 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-fuse 2024-03-18T14:40:02.788 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:02.839 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:02.840 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:02.841 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:02.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librbd1 2024-03-18T14:40:03.469 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:03.513 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:44 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:03.515 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:03.517 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:40:03.517 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:03.622 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install python3-rbd 2024-03-18T14:40:03.756 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:43 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:04.365 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:45 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:05.086 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 73 k 2024-03-18T14:40:05.087 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 188 k 2024-03-18T14:40:05.088 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:40:05.145 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.2 MB/s | 73 kB 00:00 2024-03-18T14:40:05.146 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:05.146 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.2 MB/s | 73 kB 00:00 2024-03-18T14:40:05.146 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:40:05.155 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:40:05.155 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:40:05.203 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:40:05.205 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:40:05.307 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:40:05.426 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:05.476 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:05.477 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:05.478 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:05.484 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:05.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rados 2024-03-18T14:40:05.772 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:05.900 INFO:teuthology.orchestra.run.smithi087.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:05.947 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:05.948 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:40:05.948 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:06.049 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-fuse 2024-03-18T14:40:06.158 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:06.158 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:06.159 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:40:06.159 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:06.159 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:06.159 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:06.396 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-mirror 2024-03-18T14:40:06.524 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:46 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:06.797 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:47 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:07.160 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:48 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:08.212 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:08.263 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:08.264 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:08.264 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:08.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rgw 2024-03-18T14:40:08.392 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:08.393 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:08.393 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:08.393 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:08.393 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 73 k 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 188 k 2024-03-18T14:40:08.394 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:40:08.440 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.6 MB/s | 73 kB 00:00 2024-03-18T14:40:08.440 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:08.440 INFO:teuthology.orchestra.run.smithi087.stdout:Total 1.5 MB/s | 73 kB 00:00 2024-03-18T14:40:08.441 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:40:08.450 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:40:08.450 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:40:08.498 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:40:08.501 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:40:08.598 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:40:08.755 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:40:08.756 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 2.7 M 2024-03-18T14:40:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 9.8 M 2024-03-18T14:40:08.757 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:40:08.799 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:08.898 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 19 MB/s | 2.7 MB 00:00 2024-03-18T14:40:08.899 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:08.900 INFO:teuthology.orchestra.run.smithi129.stdout:Total 19 MB/s | 2.7 MB 00:00 2024-03-18T14:40:08.900 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:40:08.911 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:40:08.911 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:40:08.967 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:40:08.969 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:40:09.084 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:09.178 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:49 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:09.309 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:40:09.478 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:09.480 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:09.480 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:09.480 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:40:09.481 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:09.481 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:09.481 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:09.697 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-mirror 2024-03-18T14:40:09.919 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:10.299 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:10.461 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:51 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:10.545 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install rbd-nbd 2024-03-18T14:40:10.838 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:10.887 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:10.889 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:10.889 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:11.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-cephfs 2024-03-18T14:40:11.308 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:52 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:11.793 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:51 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:12.057 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:40:12.058 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:12.059 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 2.7 M 2024-03-18T14:40:12.059 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 9.8 M 2024-03-18T14:40:12.059 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:40:12.158 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 28 MB/s | 2.7 MB 00:00 2024-03-18T14:40:12.158 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:12.159 INFO:teuthology.orchestra.run.smithi087.stdout:Total 27 MB/s | 2.7 MB 00:00 2024-03-18T14:40:12.159 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:40:12.170 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:40:12.170 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:40:12.226 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:40:12.230 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:40:12.566 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:40:12.742 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:12.907 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout:Installing: 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:40:12.909 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction Summary 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:================================================================================ 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:Install 1 Package 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:Total download size: 140 k 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:Installed size: 418 k 2024-03-18T14:40:12.910 INFO:teuthology.orchestra.run.smithi129.stdout:Downloading Packages: 2024-03-18T14:40:12.986 INFO:teuthology.orchestra.run.smithi129.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 1.8 MB/s | 140 kB 00:00 2024-03-18T14:40:12.986 INFO:teuthology.orchestra.run.smithi129.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:12.987 INFO:teuthology.orchestra.run.smithi129.stdout:Total 1.8 MB/s | 140 kB 00:00 2024-03-18T14:40:12.987 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction check 2024-03-18T14:40:12.996 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction check succeeded. 2024-03-18T14:40:12.996 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction test 2024-03-18T14:40:13.043 INFO:teuthology.orchestra.run.smithi129.stdout:Transaction test succeeded. 2024-03-18T14:40:13.046 INFO:teuthology.orchestra.run.smithi129.stdout:Running transaction 2024-03-18T14:40:13.154 INFO:teuthology.orchestra.run.smithi129.stdout: Preparing : 1/1 2024-03-18T14:40:13.162 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:13.351 INFO:teuthology.orchestra.run.smithi129.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:13.442 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:13.494 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:13.494 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:13.494 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:13.541 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:13.612 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rbd 2024-03-18T14:40:13.643 INFO:teuthology.orchestra.run.smithi129.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:13.733 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install rbd-nbd 2024-03-18T14:40:14.017 INFO:teuthology.orchestra.run.smithi129.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:14.018 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:14.018 INFO:teuthology.orchestra.run.smithi129.stdout:Installed: 2024-03-18T14:40:14.018 INFO:teuthology.orchestra.run.smithi129.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:14.018 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:14.018 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:14.232 DEBUG:teuthology.orchestra.run.smithi129:> sudo yum -y install librados2 2024-03-18T14:40:14.401 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:54 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:14.497 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:55 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:14.995 INFO:teuthology.orchestra.run.smithi129.stdout:Last metadata expiration check: 0:01:55 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:16.077 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:Installing: 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction Summary 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:================================================================================ 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:Install 1 Package 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:Total download size: 140 k 2024-03-18T14:40:16.078 INFO:teuthology.orchestra.run.smithi087.stdout:Installed size: 418 k 2024-03-18T14:40:16.079 INFO:teuthology.orchestra.run.smithi087.stdout:Downloading Packages: 2024-03-18T14:40:16.089 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:16.130 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.7 MB/s | 140 kB 00:00 2024-03-18T14:40:16.130 INFO:teuthology.orchestra.run.smithi087.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:16.131 INFO:teuthology.orchestra.run.smithi087.stdout:Total 2.6 MB/s | 140 kB 00:00 2024-03-18T14:40:16.131 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction check 2024-03-18T14:40:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction check succeeded. 2024-03-18T14:40:16.140 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction test 2024-03-18T14:40:16.142 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:16.143 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:16.143 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:16.187 INFO:teuthology.orchestra.run.smithi087.stdout:Transaction test succeeded. 2024-03-18T14:40:16.190 INFO:teuthology.orchestra.run.smithi087.stdout:Running transaction 2024-03-18T14:40:16.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-fuse 2024-03-18T14:40:16.304 INFO:teuthology.orchestra.run.smithi087.stdout: Preparing : 1/1 2024-03-18T14:40:16.498 INFO:teuthology.orchestra.run.smithi087.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:16.545 INFO:teuthology.orchestra.run.smithi129.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:16.591 INFO:teuthology.orchestra.run.smithi129.stdout:Dependencies resolved. 2024-03-18T14:40:16.592 INFO:teuthology.orchestra.run.smithi129.stdout:Nothing to do. 2024-03-18T14:40:16.592 INFO:teuthology.orchestra.run.smithi129.stdout:Complete! 2024-03-18T14:40:16.701 DEBUG:teuthology.parallel:result is None 2024-03-18T14:40:16.786 INFO:teuthology.orchestra.run.smithi087.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:17.061 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:57 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout:Installed: 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:17.173 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:17.416 DEBUG:teuthology.orchestra.run.smithi087:> sudo yum -y install librados2 2024-03-18T14:40:18.180 INFO:teuthology.orchestra.run.smithi087.stdout:Last metadata expiration check: 0:01:59 ago on Mon 18 Mar 2024 02:38:19 PM UTC. 2024-03-18T14:40:18.763 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-03-18T14:40:18.764 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 73 k 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 188 k 2024-03-18T14:40:18.765 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:40:18.815 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.4 MB/s | 73 kB 00:00 2024-03-18T14:40:18.816 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:18.816 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.4 MB/s | 73 kB 00:00 2024-03-18T14:40:18.816 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:40:18.826 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:40:18.826 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:40:18.876 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:40:18.879 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:40:18.978 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:40:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:19.488 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:19.718 INFO:teuthology.orchestra.run.smithi087.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:19.765 INFO:teuthology.orchestra.run.smithi087.stdout:Dependencies resolved. 2024-03-18T14:40:19.766 INFO:teuthology.orchestra.run.smithi087.stdout:Nothing to do. 2024-03-18T14:40:19.766 INFO:teuthology.orchestra.run.smithi087.stdout:Complete! 2024-03-18T14:40:19.874 DEBUG:teuthology.parallel:result is None 2024-03-18T14:40:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:19.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:19.928 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:40:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:19.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:19.928 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:20.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-mirror 2024-03-18T14:40:20.984 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:00 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:22.684 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:22.685 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:22.685 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:40:22.686 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:22.687 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:40:22.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:22.687 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.7 M 2024-03-18T14:40:22.687 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 9.8 M 2024-03-18T14:40:22.687 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:40:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 33 MB/s | 2.7 MB 00:00 2024-03-18T14:40:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:Total 33 MB/s | 2.7 MB 00:00 2024-03-18T14:40:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:40:22.781 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:40:22.781 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:40:22.840 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:40:22.843 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:40:23.197 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:40:23.377 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:23.817 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:24.202 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:24.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-nbd 2024-03-18T14:40:25.279 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:05 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-18T14:40:26.991 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 140 k 2024-03-18T14:40:26.992 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 418 k 2024-03-18T14:40:26.993 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:40:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.6 MB/s | 140 kB 00:00 2024-03-18T14:40:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:40:27.045 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.6 MB/s | 140 kB 00:00 2024-03-18T14:40:27.046 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:40:27.056 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:40:27.056 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:40:27.106 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:40:27.109 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:40:27.217 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:40:27.417 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:27.722 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:28.089 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-03-18T14:40:28.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:40:28.089 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-03-18T14:40:28.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:28.090 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:28.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-03-18T14:40:29.123 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:09 ago on Mon 18 Mar 2024 02:38:20 PM UTC. 2024-03-18T14:40:30.767 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-03-18T14:40:30.819 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:40:30.820 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-03-18T14:40:30.820 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:40:30.951 DEBUG:teuthology.parallel:result is None 2024-03-18T14:40:30.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:40:30.952 INFO:teuthology.packaging:ref: None 2024-03-18T14:40:30.952 INFO:teuthology.packaging:tag: None 2024-03-18T14:40:30.952 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:40:30.952 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:40:30.952 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:40:31.309 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:40:31.333 INFO:teuthology.orchestra.run.smithi057.stdout:15.2.17-0.el8 2024-03-18T14:40:31.333 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-03-18T14:40:31.334 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-03-18T14:40:31.335 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:40:31.335 INFO:teuthology.packaging:ref: None 2024-03-18T14:40:31.336 INFO:teuthology.packaging:tag: None 2024-03-18T14:40:31.336 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:40:31.336 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:40:31.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:40:31.686 DEBUG:teuthology.orchestra.run.smithi087:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:40:31.712 INFO:teuthology.orchestra.run.smithi087.stdout:15.2.17-0.el8 2024-03-18T14:40:31.713 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-03-18T14:40:31.713 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-03-18T14:40:31.715 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:40:31.715 INFO:teuthology.packaging:ref: None 2024-03-18T14:40:31.715 INFO:teuthology.packaging:tag: None 2024-03-18T14:40:31.715 INFO:teuthology.packaging:branch: octopus 2024-03-18T14:40:31.715 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:40:31.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-03-18T14:40:31.915 DEBUG:teuthology.orchestra.run.smithi129:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:40:31.942 INFO:teuthology.orchestra.run.smithi129.stdout:15.2.17-0.el8 2024-03-18T14:40:31.942 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-03-18T14:40:31.943 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-03-18T14:40:31.945 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-18T14:40:31.945 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:31.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T14:40:31.978 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:31.979 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T14:40:32.011 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:32.011 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T14:40:32.042 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-18T14:40:32.042 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:32.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T14:40:32.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T14:40:32.149 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:32.150 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T14:40:32.182 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T14:40:32.252 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:32.253 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T14:40:32.285 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T14:40:32.357 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-18T14:40:32.358 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:32.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T14:40:32.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T14:40:32.466 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:32.466 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T14:40:32.499 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T14:40:32.568 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:32.568 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T14:40:32.600 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T14:40:32.670 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-18T14:40:32.670 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:32.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T14:40:32.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T14:40:32.777 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:32.777 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T14:40:32.809 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T14:40:32.880 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:32.880 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T14:40:32.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T14:40:32.983 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:40:32.993 INFO:teuthology.task.print:**** done installing octopus 2024-03-18T14:40:32.993 INFO:teuthology.run_tasks:Running task ceph... 2024-03-18T14:40:33.118 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-18T14:40:33.118 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-03-18T14:40:33.121 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2024-03-18T14:40:33.123 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 777 /var/log/ceph 2024-03-18T14:40:33.154 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-18T14:40:33.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T14:40:33.196 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T14:40:33.198 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T14:40:33.230 INFO:tasks.ceph:Creating extra log directories... 2024-03-18T14:40:33.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T14:40:33.273 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T14:40:33.275 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T14:40:33.316 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-18T14:40:33.316 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-18T14:40:33.317 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'branch': 'wip-batrick-testing-20240314.183243', 'description': 'fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7608849', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240314.183243'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240314.183243', 'sha1': '4e19f704afd9957ea657ab858f9ecf76401fef6f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 4770, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'sleep_before_teardown': 0, 'subset': '498/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240314.183243', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': '4e19f704afd9957ea657ab858f9ecf76401fef6f', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAJfV/jyRQmvrL+3NnMMQg6k3n71Nw5hcbLSieS0T2q+yKEAl8+wqbncR9HYcYlDzM6d4nOQrec4Wj+jlXWcfQ=', 'smithi087.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCncwcaS3ehB2ay4KEnSJKHfPNQmVRubaRsYO3lulZE+fAjF1tLzuzrEl71eyvFV8IwGIZeP6g9YbH+nIUYMRbk=', 'smithi129.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb2+khwLDMJH2Uy3mBoJdiwh56TQVI8Yk90WBgifLD5l1p/j+51boEicE5oInvcALKY3yoihdFya6ixKzZAz9w='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-18_14:19:46', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-18T14:40:33.317 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T14:40:33.346 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T14:40:33.348 DEBUG:teuthology.orchestra.run.smithi129:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T14:40:33.367 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T14:40:33.408 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T14:40:33.410 DEBUG:teuthology.orchestra.run.smithi129:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T14:40:33.440 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:33.441 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T14:40:33.502 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T14:40:33.502 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-03-18T14:40:33.563 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T14:40:33.563 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:40:33.563 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 167310 Links: 1 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-18 14:40:23.563848589 +0000 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-18 14:37:22.031001360 +0000 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-18 14:37:22.031001360 +0000 2024-03-18T14:40:33.564 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-03-18T14:40:33.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T14:40:33.633 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-18T14:40:33.633 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-18T14:40:33.633 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000287931 s, 1.8 MB/s 2024-03-18T14:40:33.635 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T14:40:33.697 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 165632 Links: 1 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-18 14:40:23.563848589 +0000 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-18 14:37:22.477994955 +0000 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-18 14:37:22.477994955 +0000 2024-03-18T14:40:33.758 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-03-18T14:40:33.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T14:40:33.828 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-18T14:40:33.828 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-18T14:40:33.828 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000309554 s, 1.7 MB/s 2024-03-18T14:40:33.829 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T14:40:33.890 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-03-18T14:40:33.949 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T14:40:33.949 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:40:33.949 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 165692 Links: 1 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-18 14:40:23.563848589 +0000 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-18 14:37:22.880989180 +0000 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-18 14:37:22.880989180 +0000 2024-03-18T14:40:33.950 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-03-18T14:40:33.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T14:40:34.017 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-18T14:40:34.017 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-18T14:40:34.017 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000266711 s, 1.9 MB/s 2024-03-18T14:40:34.019 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T14:40:34.080 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-03-18T14:40:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 171569 Links: 1 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-18 14:40:23.563848589 +0000 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-18 14:37:23.268983621 +0000 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-18 14:37:23.268983621 +0000 2024-03-18T14:40:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2024-03-18T14:40:34.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T14:40:34.207 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-18T14:40:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-18T14:40:34.208 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000341782 s, 1.5 MB/s 2024-03-18T14:40:34.209 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T14:40:34.269 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:40:34.269 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-03-18T14:40:34.269 INFO:tasks.ceph:Generating config... 2024-03-18T14:40:34.271 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-03-18T14:40:34.271 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-03-18T14:40:34.271 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2024-03-18T14:40:34.271 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2024-03-18T14:40:34.271 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-03-18T14:40:34.271 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-18T14:40:34.271 INFO:tasks.ceph:[client] debug client = 20 2024-03-18T14:40:34.271 INFO:tasks.ceph:[client] debug ms = 1 2024-03-18T14:40:34.271 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-18T14:40:34.271 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-18T14:40:34.271 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-18T14:40:34.272 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-18T14:40:34.273 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-18T14:40:34.273 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-18T14:40:34.273 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-18T14:40:34.274 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-18T14:40:34.274 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-18T14:40:34.274 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-18T14:40:34.274 INFO:tasks.ceph:Setting up mon.a... 2024-03-18T14:40:34.274 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-18T14:40:34.442 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-03-18T14:40:34.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-18T14:40:34.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:40:34.556 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]'), ('mon.c', '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]')] 2024-03-18T14:40:34.556 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-18T14:40:34.557 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:34.557 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T14:40:34.614 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --addv b '[v2:172.21.15.57:3301,v1:172.21.15.57:6790]' --addv c '[v2:172.21.15.57:3302,v1:172.21.15.57:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 347a5fae-6424-47b3-8c67-8d3421f1b0dd 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 347a5fae-6424-47b3-8c67-8d3421f1b0dd 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-03-18T14:40:34.697967+0000 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-03-18T14:40:34.697967+0000 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 0 (unknown) 2024-03-18T14:40:34.699 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-03-18T14:40:34.700 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] mon.b 2024-03-18T14:40:34.700 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] mon.c 2024-03-18T14:40:34.700 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-18T14:40:34.701 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T14:40:34.719 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 347a5fae-6424-47b3-8c67-8d3421f1b0dd... 2024-03-18T14:40:34.720 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T14:40:34.762 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T14:40:34.764 DEBUG:teuthology.orchestra.run.smithi129:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T14:40:34.804 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-03-18T14:40:34.805 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-03-18T14:40:34.806 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-03-18T14:40:34.807 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on pool no app = False 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: ms bind msgr2 = False 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore warn on legacy statfs = False 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore warn on no per pool omap = False 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn min per osd = 0 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 347a5fae-6424-47b3-8c67-8d3421f1b0dd 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.808 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-03-18T14:40:34.809 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = bitmap 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-03-18T14:40:34.811 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-18T14:40:34.812 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T14:40:34.813 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = False 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-03-18T14:40:34.814 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2024-03-18T14:40:34.815 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout:[global] 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: chdir = "" 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: auth supported = cephx 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: filestore xattr use omap = true 2024-03-18T14:40:34.817 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: mon clock drift allowed = 1.000 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: osd crush chooseleaf type = 0 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: auth debug = true 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on old message = true 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: ms die on bug = true 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn max object skew = 0 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T14:40:34.818 INFO:teuthology.orchestra.run.smithi129.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default size = 2 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow primary affinity = true 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd allow pg remap = true 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on legacy crush tunables = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on crush straw calc version zero = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on no sortbitwise = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on too few osds = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: mon_allow_pool_size_one = true 2024-03-18T14:40:34.819 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: osd default data pool replay window = 5 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon allow pool delete = true 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon cluster log file level = debug 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: debug asserts on shutdown = true 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon health detail to clog = false 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on pool no app = False 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: ms bind msgr2 = False 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore warn on legacy statfs = False 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore warn on no per pool omap = False 2024-03-18T14:40:34.820 INFO:teuthology.orchestra.run.smithi129.stdout: mon pg warn min per osd = 0 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: fsid = 347a5fae-6424-47b3-8c67-8d3421f1b0dd 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout:[osd] 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd journal size = 100 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub load threshold = 5.0 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd scrub max interval = 600 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd mclock profile = high_recovery_ops 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd recover clone overlap = true 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd recovery max chunk = 1048576 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.821 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug shutdown = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug op order = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug verify stray on activate = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug trim objects = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd open classes on start = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug pg log writeout = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd deep scrub update digest min age = 30 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: osd map max advance = 10 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: journal zero on create = true 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.822 INFO:teuthology.orchestra.run.smithi129.stdout: filestore ondisk finisher threads = 3 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: filestore apply finisher threads = 3 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bdev debug aio = true 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: osd debug misdirected ops = true 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bdev async discard = True 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bdev enable discard = True 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore allocator = bitmap 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore block size = 96636764160 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: bluestore fsck on mount = True 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluefs = 1/20 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: debug bluestore = 1/20 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: debug osd = 20 2024-03-18T14:40:34.823 INFO:teuthology.orchestra.run.smithi129.stdout: debug rocksdb = 4/10 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd full ratio = 0.9 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd nearfull ratio = 0.8 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: osd failsafe full ratio = 0.95 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: osd objectstore = bluestore 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout:[mgr] 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: debug mgr = 20 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: mgr/telemetry/nag = false 2024-03-18T14:40:34.824 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout:[mon] 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: debug mon = 20 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: debug paxos = 20 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: debug auth = 20 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon data avail warn = 5 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon mgr mkfs grace = 240 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd reporter subtree level = osd 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon osd prime pg temp = true 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T14:40:34.825 INFO:teuthology.orchestra.run.smithi129.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: # 1m isn't quite enough 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon_down_mkfs_grace = 2m 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon_warn_on_filestore_osds = false 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon op complaint time = 120 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: mon warn on osd down out interval zero = False 2024-03-18T14:40:34.826 INFO:teuthology.orchestra.run.smithi129.stdout: 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout:[client] 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: rgw cache enabled = true 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable ops log = true 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: rgw enable usage log = true 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: client mount timeout = 600 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: debug client = 20 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.a] 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.b] 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout:[mon.c] 2024-03-18T14:40:34.827 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.a] 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.b] 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout:[mds.c] 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout:[mds] 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds = 20 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: debug mds balancer = 20 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: debug ms = 1 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug frag = True 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: mds debug scatterstat = True 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: mds op complaint time = 180 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: mds verify scatter = True 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: osd op complaint time = 180 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi129.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.828 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2024-03-18T14:40:34.829 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2024-03-18T14:40:34.830 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2024-03-18T14:40:34.831 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = "172.21.15.57,[v2:172.21.15.57:3301,v1:172.21.15.57:6790],[v2:172.21.15.57:3302,v1:172.21.15.57:6791]" 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on pool no app = False 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: ms bind msgr2 = False 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore warn on legacy statfs = False 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore warn on no per pool omap = False 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn min per osd = 0 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 347a5fae-6424-47b3-8c67-8d3421f1b0dd 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.832 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd mclock profile = high_recovery_ops 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug trim objects = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2024-03-18T14:40:34.833 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2024-03-18T14:40:34.834 INFO:teuthology.orchestra.run.smithi087.stdout: bdev async discard = True 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: bdev enable discard = True 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore allocator = bitmap 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore block size = 96636764160 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: bluestore fsck on mount = True 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluefs = 1/20 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: debug bluestore = 1/20 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: debug rocksdb = 4/10 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd full ratio = 0.9 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd nearfull ratio = 0.8 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: osd failsafe full ratio = 0.95 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: osd objectstore = bluestore 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-03-18T14:40:34.835 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2024-03-18T14:40:34.836 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: # 1m isn't quite enough 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: mon_down_mkfs_grace = 2m 2024-03-18T14:40:34.837 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_filestore_osds = false 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: mon op complaint time = 120 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = False 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: client mount timeout = 600 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: debug client = 20 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-03-18T14:40:34.838 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.b] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.c] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.a] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.b] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mds.c] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout:[mds] 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds = 20 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: debug mds balancer = 20 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug frag = True 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: mds debug scatterstat = True 2024-03-18T14:40:34.839 INFO:teuthology.orchestra.run.smithi087.stdout: mds op complaint time = 180 2024-03-18T14:40:34.840 INFO:teuthology.orchestra.run.smithi087.stdout: mds verify scatter = True 2024-03-18T14:40:34.840 INFO:teuthology.orchestra.run.smithi087.stdout: osd op complaint time = 180 2024-03-18T14:40:34.840 INFO:teuthology.orchestra.run.smithi087.stdout: rados mon op timeout = 900 2024-03-18T14:40:34.840 INFO:teuthology.orchestra.run.smithi087.stdout: rados osd op timeout = 900 2024-03-18T14:40:34.841 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-18T14:40:34.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-18T14:40:34.933 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-18T14:40:34.933 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:34.933 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-18T14:40:34.952 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:34.952 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-18T14:40:35.011 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:40:35.011 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:35.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T14:40:35.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:40:35.088 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:35.088 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:35.146 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2024-03-18T14:40:35.146 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:35.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T14:40:35.147 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:40:35.189 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:35.189 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:35.250 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi129.front.sepia.ceph.com 2024-03-18T14:40:35.250 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:35.250 DEBUG:teuthology.orchestra.run.smithi129:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T14:40:35.250 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:40:35.293 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:35.293 DEBUG:teuthology.orchestra.run.smithi129:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:35.355 INFO:tasks.ceph:Setting up mon nodes... 2024-03-18T14:40:35.355 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-18T14:40:35.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T14:40:35.406 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T14:40:35.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T14:40:35.458 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T14:40:35.460 INFO:tasks.ceph:Setting up mds nodes... 2024-03-18T14:40:35.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T14:40:35.511 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T14:40:35.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-18T14:40:35.540 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T14:40:35.630 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T14:40:35.632 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-18T14:40:35.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T14:40:35.749 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T14:40:35.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-18T14:40:35.778 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-18T14:40:35.779 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-18T14:40:35.910 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-18T14:40:35.924 DEBUG:teuthology.orchestra.run.smithi129:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-18T14:40:36.047 INFO:teuthology.orchestra.run.smithi129.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-18T14:40:36.062 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-18T14:40:36.062 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-03-18T14:40:36.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-18T14:40:36.090 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:40:36.091 INFO:tasks.ceph:role: osd.0 2024-03-18T14:40:36.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:40:36.091 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T14:40:36.186 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:40:36.186 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:40:36.186 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:40:36.187 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:40:37.472 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-18T14:40:37.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-18T14:40:37.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-18T14:40:37.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-18T14:40:37.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-18T14:40:37.630 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:40:37.630 INFO:tasks.ceph:role: osd.1 2024-03-18T14:40:37.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:40:37.630 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:40:37.728 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:40:37.729 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:40:37.729 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T14:40:37.729 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:40:37.729 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:40:39.010 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-18T14:40:39.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-18T14:40:39.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-18T14:40:39.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-18T14:40:39.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-18T14:40:39.168 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:40:39.168 INFO:tasks.ceph:role: osd.2 2024-03-18T14:40:39.168 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:40:39.169 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T14:40:39.266 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:40:39.267 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:40:40.550 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-18T14:40:40.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-18T14:40:40.552 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-18T14:40:40.601 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-18T14:40:40.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-18T14:40:40.706 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:40:40.706 INFO:tasks.ceph:role: osd.3 2024-03-18T14:40:40.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:40:40.707 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:40:40.804 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:40:40.805 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-18T14:40:40.805 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:40:40.805 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:40:42.087 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-18T14:40:42.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-18T14:40:42.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-18T14:40:42.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-18T14:40:42.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.290+0000 7f0dd0702f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-18T14:40:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.290+0000 7f0dd0702f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-18T14:40:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.290+0000 7f0dd0702f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:40:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.290+0000 7f0dd0702f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:40:42.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.290+0000 7f0dd0702f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:40:42.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.291+0000 7f0dd0702f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-18T14:40:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:42.311+0000 7f0dd0702f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-03-18T14:40:44.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-18T14:40:44.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:44.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.749+0000 7fc4705ecf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-18T14:40:44.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.750+0000 7fc4705ecf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-18T14:40:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.750+0000 7fc4705ecf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:40:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.750+0000 7fc4705ecf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:40:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.750+0000 7fc4705ecf00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:40:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.750+0000 7fc4705ecf00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-18T14:40:44.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:44.770+0000 7fc4705ecf00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-03-18T14:40:47.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-18T14:40:47.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:47.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.217+0000 7f0963b69f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-18T14:40:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.217+0000 7f0963b69f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-18T14:40:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.217+0000 7f0963b69f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:40:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.217+0000 7f0963b69f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:40:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.217+0000 7f0963b69f00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:40:47.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.218+0000 7f0963b69f00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-18T14:40:47.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:47.258+0000 7f0963b69f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-03-18T14:40:49.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-18T14:40:49.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:49.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.676+0000 7f3cc3bbff00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-18T14:40:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.676+0000 7f3cc3bbff00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-18T14:40:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.676+0000 7f3cc3bbff00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:40:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.676+0000 7f3cc3bbff00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:40:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.676+0000 7f3cc3bbff00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:40:49.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.677+0000 7f3cc3bbff00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-18T14:40:49.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:49.701+0000 7f3cc3bbff00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-03-18T14:40:52.020 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-18T14:40:52.054 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-18T14:40:52.054 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-18T14:40:52.126 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-18T14:40:52.197 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.197 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-18T14:40:52.267 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-18T14:40:52.337 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.337 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-18T14:40:52.406 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.407 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-18T14:40:52.475 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-18T14:40:52.543 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-18T14:40:52.611 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:52.611 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-18T14:40:52.679 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:40:52.679 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-18T14:40:52.701 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:40:52.701 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-18T14:40:52.723 INFO:tasks.ceph:Adding keys to all mons... 2024-03-18T14:40:52.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T14:40:52.749 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-03-18T14:40:52.749 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlkPkrGBAA6Mm8FO1VptaUOQBZaPrvSg== 2024-03-18T14:40:52.749 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlil5JGxAAAfVnq6bGosxYocgYPhWafA== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlDwdlHhAA7bUFS2gZ1gcI1jBUf4SsGw== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlPyx9JRAA680wa4b9hq4QU1kQ0tvNMw== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlLBygLBAAsjmhoV6wmPwETpCwiKdfaA== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBqUvhlH1BmERAAzcsgtnNXwl8QSVXV064ATQ== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBsUvhl62DFLBAAbs/RKSf+96KCvFYaScKdyg== 2024-03-18T14:40:52.750 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBvUvhl1zAHDRAAQTnl0Ntd9u3Z8I0HaRHBFw== 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBxUvhlGc9fKBAAkgs4Yd9dp2POveW4K15Bvw== 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBjUvhlK4YxNhAAoRViOhN1rrbXp9v8ibXHRQ== 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2024-03-18T14:40:52.751 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQBkUvhl3kXIAhAAJq5gCQEVsnGggtTkuw721w== 2024-03-18T14:40:52.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T14:40:52.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T14:40:52.890 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T14:40:52.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T14:40:52.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T14:40:53.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T14:40:53.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T14:40:53.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T14:40:53.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T14:40:53.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T14:40:53.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T14:40:53.345 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-18T14:40:53.345 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-18T14:40:53.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T14:40:53.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-18T14:40:53.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-18T14:40:53.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T14:40:53.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-18T14:40:53.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-18T14:40:53.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T14:40:53.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-18T14:40:53.881 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:40:53.939 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-18T14:40:53.939 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-18T14:40:53.939 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-18T14:40:53.981 INFO:tasks.ceph.mon.a:Started 2024-03-18T14:40:53.982 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-18T14:40:53.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-18T14:40:53.984 INFO:tasks.ceph.mon.b:Started 2024-03-18T14:40:53.984 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-18T14:40:53.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-18T14:40:53.986 INFO:tasks.ceph.mon.c:Started 2024-03-18T14:40:53.986 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-18T14:40:53.986 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-18T14:40:53.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-18T14:40:53.988 INFO:tasks.ceph.mgr.x:Started 2024-03-18T14:40:53.989 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-18T14:40:53.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-18T14:40:53.991 INFO:tasks.ceph.mgr.y:Started 2024-03-18T14:40:53.991 INFO:tasks.ceph:Setting crush tunables to default 2024-03-18T14:40:53.991 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-03-18T14:40:54.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.130+0000 7fc8146af700 1 Processor -- start 2024-03-18T14:40:54.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.130+0000 7fc8146af700 1 -- start start 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc8146af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc8146af700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc8146af700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c05b970 con 0x7fc80c05d370 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc8146af700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c136710 con 0x7fc80c136bf0 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc8146af700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1369d0 con 0x7fc80c136210 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc811c4a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc812c4c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc80c05d370 0x7fc80c1397e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57736/0 (socket says 172.21.15.57:57736) 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37508/0 (socket says 172.21.15.57:37508) 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc812c4c700 1 -- 172.21.15.57:0/30620578 learned_addr learned my addr 172.21.15.57:0/30620578 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 msgr2=0x7fc80c05bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 msgr2=0x7fc80c05bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc811c4a700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc80c05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc811c4a700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc80c05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-18T14:40:54.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.131+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 msgr2=0x7fc80c05bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 msgr2=0x7fc80c05bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc811c4a700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc80c05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc811c4a700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc80c05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-03-18T14:40:54.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.332+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-03-18T14:40:54.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.351+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979505460 0 0) 0x7fc80c05b970 con 0x7fc80c05d370 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f4003260 con 0x7fc80c05d370 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 888918549 0 0) 0x7fc7f4003260 con 0x7fc80c05d370 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc80c05ce80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc80c05ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 msgr2=0x7fc80c05bde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 --2- 172.21.15.57:0/30620578 >> v2:172.21.15.57:3300/0 conn(0x7fc80c136bf0 0x7fc80c05bde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c136fd0 con 0x7fc80c05d370 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 564621487 0 0) 0x7fc8040019e0 con 0x7fc80c05d370 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 >> v1:172.21.15.57:6789/0 conn(0x7fc80c05d370 legacy=0x7fc80c1397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc7f4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc7f4004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f40049f0 0x7fc7f4004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c136710 con 0x7fc7f4003750 2024-03-18T14:40:54.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1369d0 con 0x7fc80c136210 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f400b780 con 0x7fc7f40049f0 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc7f4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc812c4c700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f40049f0 0x7fc7f4004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc7f4004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f40049f0 msgr2=0x7fc7f4004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f40049f0 0x7fc7f4004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 msgr2=0x7fc7f4004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc7f4004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.352+0000 7fc81244b700 1 -- 172.21.15.57:0/30620578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4003260 con 0x7fc7f4003750 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc811c4a700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c136210 0x7fc7f4004500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc81244b700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc7f4003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc80800a000 tx=0x7fc808008040).ready entity=mon.0 client_cookie=4a0691e3428ea725 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808017070 con 0x7fc7f4003750 2024-03-18T14:40:54.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8080135f0 con 0x7fc7f4003750 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc811449700 1 -- 172.21.15.57:0/30620578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc808013950 con 0x7fc7f4003750 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc8146af700 1 -- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 msgr2=0x7fc7f4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc8146af700 1 --2- 172.21.15.57:0/30620578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc7f4003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fc80800a000 tx=0x7fc808008040).stop 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.353+0000 7fc812c4c700 1 -- 172.21.15.57:0/30620578 reap_dead start 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.354+0000 7fc8146af700 1 -- 172.21.15.57:0/30620578 shutdown_connections 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.354+0000 7fc8146af700 1 -- 172.21.15.57:0/30620578 >> 172.21.15.57:0/30620578 conn(0x7fc80c066a50 msgr2=0x7fc80c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.354+0000 7fc8146af700 1 -- 172.21.15.57:0/30620578 shutdown_connections 2024-03-18T14:40:54.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.354+0000 7fc8146af700 1 -- 172.21.15.57:0/30620578 wait complete. 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 Processor -- start 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 -- start start 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c145e10 con 0x7fc7f4003750 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0a67b0 con 0x7fc80c0a62d0 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc8146af700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0a51d0 con 0x7fc80c115ee0 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc81244b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc81244b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37580/0 (socket says 172.21.15.57:37580) 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc81244b700 1 -- 172.21.15.57:0/464407543 learned_addr learned my addr 172.21.15.57:0/464407543 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc812c4c700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc811c4a700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc812c4c700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 msgr2=0x7fc80c1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc812c4c700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 msgr2=0x7fc80c1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc812c4c700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc811c4a700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 msgr2=0x7fc80c146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc811c4a700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 msgr2=0x7fc80c146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc811c4a700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.355+0000 7fc812c4c700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-18T14:40:54.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc811c4a700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 msgr2=0x7fc80c1464f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 msgr2=0x7fc80c146000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 -- 172.21.15.57:0/464407543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c132ed0 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc81244b700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc80c0a68f0 tx=0x7fc808008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80801c870 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc808000e90 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc80801cbc0 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c1140f0 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c114ca0 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc80802f070 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.356+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc80801fab0 con 0x7fc7f4003750 2024-03-18T14:40:54.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.357+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c146d60 con 0x7fc7f4003750 2024-03-18T14:40:54.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.360+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc808046870 con 0x7fc7f4003750 2024-03-18T14:40:54.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.428+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc80c060150 con 0x7fc7f4003750 2024-03-18T14:40:54.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.435+0000 7fc7fb7fe700 1 -- 172.21.15.57:0/464407543 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc808036070 con 0x7fc7f4003750 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.436+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 msgr2=0x7fc80c0a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.436+0000 7fc8146af700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fc80c0a68f0 tx=0x7fc808008040).stop 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.436+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 shutdown_connections 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc80c115ee0 0x7fc80c1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f4003750 0x7fc80c0a5de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 --2- 172.21.15.57:0/464407543 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc80c0a62d0 0x7fc80c146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 >> 172.21.15.57:0/464407543 conn(0x7fc80c066a50 msgr2=0x7fc80c0aa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 shutdown_connections 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.437+0000 7fc8146af700 1 -- 172.21.15.57:0/464407543 wait complete. 2024-03-18T14:40:54.440 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-03-18T14:40:54.450 INFO:tasks.ceph:check_enable_crimson: False 2024-03-18T14:40:54.450 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-18T14:40:54.450 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:54.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-18T14:40:54.478 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:54.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-18T14:40:54.545 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:54.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-18T14:40:54.615 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:40:54.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-18T14:40:54.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 674b74ac-d72f-4d09-bacf-b63061fe0927 0 2024-03-18T14:40:54.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.827+0000 7f195a7e3700 1 Processor -- start 2024-03-18T14:40:54.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.827+0000 7f195a7e3700 1 -- start start 2024-03-18T14:40:54.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f195a7e3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 0x7f1954065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f195a7e3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f19541409e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f195a7e3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1954066520 con 0x7f1954066c90 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f195a7e3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a4da0 con 0x7f1954139bb0 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f195a7e3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1954065fb0 con 0x7f19540a4360 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f19537fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1954066c90 0x7f1954139f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57742/0 (socket says 172.21.15.57:57742) 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f19537fe700 1 -- 172.21.15.57:0/2579915857 learned_addr learned my addr 172.21.15.57:0/2579915857 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f1953fff700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 0x7f1954065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f1958d80700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f19541409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f1953fff700 1 -- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 msgr2=0x7f19541409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f1952ffd700 1 -- 172.21.15.57:0/2579915857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197779421 0 0) 0x7f1954066520 con 0x7f1954066c90 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.828+0000 7f1953fff700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f19541409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1953fff700 1 -- 172.21.15.57:0/2579915857 >> v1:172.21.15.57:6789/0 conn(0x7f1954066c90 legacy=0x7f1954139f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1953fff700 1 -- 172.21.15.57:0/2579915857 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19540a4b00 con 0x7f1954139bb0 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1958d80700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f19541409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:54.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1953fff700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 0x7f1954065ac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006df0).ready entity=mon.1 client_cookie=e8630579d8708220 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1952ffd700 1 -- 172.21.15.57:0/2579915857 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d570 con 0x7f1954139bb0 2024-03-18T14:40:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1952ffd700 1 -- 172.21.15.57:0/2579915857 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944000e90 con 0x7f1954139bb0 2024-03-18T14:40:54.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f1952ffd700 1 -- 172.21.15.57:0/2579915857 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194400d8c0 con 0x7f1954139bb0 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f195a7e3700 1 -- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 msgr2=0x7f1954065ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.829+0000 7f195a7e3700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 0x7f1954065ac0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944006df0).stop 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 -- 172.21.15.57:0/2579915857 shutdown_connections 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f19541409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 --2- 172.21.15.57:0/2579915857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954139bb0 0x7f1954065ac0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 -- 172.21.15.57:0/2579915857 >> 172.21.15.57:0/2579915857 conn(0x7f19540a89d0 msgr2=0x7f19540a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 -- 172.21.15.57:0/2579915857 shutdown_connections 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.830+0000 7f195a7e3700 1 -- 172.21.15.57:0/2579915857 wait complete. 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.831+0000 7f195a7e3700 1 Processor -- start 2024-03-18T14:40:54.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.831+0000 7f195a7e3700 1 -- start start 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f1954132180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 0x7f1954132670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a0fd0 con 0x7f1954139bb0 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540a1e10 con 0x7f1954066c90 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f195a7e3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f195409e810 con 0x7f19540a4360 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54544/0 (socket says 172.21.15.57:54544) 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 -- 172.21.15.57:0/1736255670 learned_addr learned my addr 172.21.15.57:0/1736255670 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f19537fe700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f1954132180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1958d80700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 0x7f1954132670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:54.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 -- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 msgr2=0x7f1954132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f1954132180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 -- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 msgr2=0x7f1954132670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 0x7f1954132670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 -- 172.21.15.57:0/1736255670 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c009470 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1958d80700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 0x7f1954132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.832+0000 7f1953fff700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1944013e90 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944006780 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194400b180 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194401e5f0 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19540a2c50 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f1944025030 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.833+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1944028790 con 0x7f1954066c90 2024-03-18T14:40:54.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.834+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19540a1140 con 0x7f1954066c90 2024-03-18T14:40:54.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.838+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f1944023070 con 0x7f1954066c90 2024-03-18T14:40:54.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.914+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd new", "uuid": "674b74ac-d72f-4d09-bacf-b63061fe0927", "id": 0} v 0) v1 -- 0x7f1954067350 con 0x7f1954066c90 2024-03-18T14:40:54.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.922+0000 7f19517fa700 1 -- 172.21.15.57:0/1736255670 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "674b74ac-d72f-4d09-bacf-b63061fe0927", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1944019030 con 0x7f1954066c90 2024-03-18T14:40:54.925 INFO:teuthology.orchestra.run.smithi057.stdout:0 2024-03-18T14:40:54.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 msgr2=0x7f19540a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:54.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1944002f70 tx=0x7f1944014000).stop 2024-03-18T14:40:54.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 shutdown_connections 2024-03-18T14:40:54.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1954139bb0 0x7f1954132670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1954066c90 0x7f19540a1440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 --2- 172.21.15.57:0/1736255670 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f19540a4360 0x7f1954132180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:54.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 >> 172.21.15.57:0/1736255670 conn(0x7f19540a89d0 msgr2=0x7f19540a5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:54.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 shutdown_connections 2024-03-18T14:40:54.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:54.923+0000 7f195a7e3700 1 -- 172.21.15.57:0/1736255670 wait complete. 2024-03-18T14:40:54.936 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new eb13ed10-144d-4d6f-9b89-7b855befb612 1 2024-03-18T14:40:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.041+0000 7fd04a726700 1 Processor -- start 2024-03-18T14:40:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.041+0000 7fd04a726700 1 -- start start 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd04a726700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 0x7fd044133620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd04a726700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd0440646b0 0x7fd044136890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd04a726700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd044132df0 con 0x7fd044136d80 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd04a726700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440639f0 con 0x7fd0440646b0 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd04a726700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044133020 con 0x7fd044133240 2024-03-18T14:40:55.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 0x7fd044133620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd0437fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd0440646b0 0x7fd044136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd048cc3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd044136d80 0x7fd044099930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57748/0 (socket says 172.21.15.57:57748) 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd048cc3700 1 -- 172.21.15.57:0/1536515199 learned_addr learned my addr 172.21.15.57:0/1536515199 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 -- 172.21.15.57:0/1536515199 >> v2:172.21.15.57:3300/0 conn(0x7fd0440646b0 msgr2=0x7fd044136890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 --2- 172.21.15.57:0/1536515199 >> v2:172.21.15.57:3300/0 conn(0x7fd0440646b0 0x7fd044136890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 -- 172.21.15.57:0/1536515199 >> v1:172.21.15.57:6789/0 conn(0x7fd044136d80 legacy=0x7fd044099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 -- 172.21.15.57:0/1536515199 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04409b1d0 con 0x7fd044133240 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.042+0000 7fd043fff700 1 --2- 172.21.15.57:0/1536515199 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 0x7fd044133620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd034002f70 tx=0x7fd034006e80).ready entity=mon.1 client_cookie=b8d0656490228750 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.043+0000 7fd042ffd700 1 -- 172.21.15.57:0/1536515199 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03400b7d0 con 0x7fd044133240 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.043+0000 7fd042ffd700 1 -- 172.21.15.57:0/1536515199 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400b930 con 0x7fd044133240 2024-03-18T14:40:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.043+0000 7fd042ffd700 1 -- 172.21.15.57:0/1536515199 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd03400bc90 con 0x7fd044133240 2024-03-18T14:40:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.043+0000 7fd04a726700 1 -- 172.21.15.57:0/1536515199 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 msgr2=0x7fd044133620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.043+0000 7fd04a726700 1 --2- 172.21.15.57:0/1536515199 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 0x7fd044133620 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fd034002f70 tx=0x7fd034006e80).stop 2024-03-18T14:40:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 -- 172.21.15.57:0/1536515199 shutdown_connections 2024-03-18T14:40:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 --2- 172.21.15.57:0/1536515199 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd044133240 0x7fd044133620 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 --2- 172.21.15.57:0/1536515199 >> v2:172.21.15.57:3300/0 conn(0x7fd0440646b0 0x7fd044136890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 -- 172.21.15.57:0/1536515199 >> 172.21.15.57:0/1536515199 conn(0x7fd04405cf10 msgr2=0x7fd04405d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 -- 172.21.15.57:0/1536515199 shutdown_connections 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 -- 172.21.15.57:0/1536515199 wait complete. 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.044+0000 7fd04a726700 1 Processor -- start 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 -- start start 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 0x7fd044092930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 0x7fd04412d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04412d8e0 con 0x7fd044133240 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044131490 con 0x7fd0440646b0 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd04a726700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd044098e40 con 0x7fd044136d80 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd048cc3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 0x7fd04412d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37638/0 (socket says 172.21.15.57:37638) 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd0437fe700 1 -- 172.21.15.57:0/900839518 learned_addr learned my addr 172.21.15.57:0/900839518 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.045+0000 7fd043fff700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 0x7fd044092930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 -- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 msgr2=0x7fd04412d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 0x7fd04412d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 -- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 msgr2=0x7fd044092930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 0x7fd044092930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 -- 172.21.15.57:0/900839518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03400d410 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd048cc3700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 0x7fd04412d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd043fff700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 0x7fd044092930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0437fe700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd03800c000 tx=0x7fd038006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd038010780 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0380108e0 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd044066780 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd038010c40 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd044067890 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.046+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd03801c460 con 0x7fd044133240 2024-03-18T14:40:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.047+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fd0380127b0 con 0x7fd044133240 2024-03-18T14:40:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.047+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0441362d0 con 0x7fd044133240 2024-03-18T14:40:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.049+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd03801cb50 con 0x7fd044133240 2024-03-18T14:40:55.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.144+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb13ed10-144d-4d6f-9b89-7b855befb612", "id": 1} v 0) v1 -- 0x7fd044057a60 con 0x7fd044133240 2024-03-18T14:40:55.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.151+0000 7fd0417fa700 1 -- 172.21.15.57:0/900839518 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb13ed10-144d-4d6f-9b89-7b855befb612", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd03801ccf0 con 0x7fd044133240 2024-03-18T14:40:55.154 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 msgr2=0x7fd04412cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd03800c000 tx=0x7fd038006df0).stop 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 shutdown_connections 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd044136d80 0x7fd04412d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd0440646b0 0x7fd044092930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 --2- 172.21.15.57:0/900839518 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd044133240 0x7fd04412cf00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 >> 172.21.15.57:0/900839518 conn(0x7fd04405cf10 msgr2=0x7fd044099930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 shutdown_connections 2024-03-18T14:40:55.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.152+0000 7fd04a726700 1 -- 172.21.15.57:0/900839518 wait complete. 2024-03-18T14:40:55.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad 2 2024-03-18T14:40:55.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.271+0000 7ff512f4b700 1 Processor -- start 2024-03-18T14:40:55.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.271+0000 7ff512f4b700 1 -- start start 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 0x7ff50c137af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c134740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50c1376d0 con 0x7ff50c0657f0 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0a9aa0 con 0x7ff50c137fe0 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff512f4b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c064b50 con 0x7ff50c0a96c0 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff50bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff50bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37646/0 (socket says 172.21.15.57:37646) 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 0x7ff50c137af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff50bfff700 1 -- 172.21.15.57:0/1915305399 learned_addr learned my addr 172.21.15.57:0/1915305399 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff5114e8700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c134740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 -- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 msgr2=0x7ff50c134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c134740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 -- 172.21.15.57:0/1915305399 >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 msgr2=0x7ff50c134250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1915305399 >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff510ce7700 1 -- 172.21.15.57:0/1915305399 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c133f90 con 0x7ff50c0a96c0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.272+0000 7ff50bfff700 1 --2- 172.21.15.57:0/1915305399 >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 0x7ff50c137af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff50c065210 tx=0x7ff4fc006df0).ready entity=mon.2 client_cookie=9ccd83eafdebcf50 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff50b7fe700 1 -- 172.21.15.57:0/1915305399 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc00d570 con 0x7ff50c0a96c0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff50b7fe700 1 -- 172.21.15.57:0/1915305399 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc000e90 con 0x7ff50c0a96c0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff50b7fe700 1 -- 172.21.15.57:0/1915305399 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc00d8c0 con 0x7ff50c0a96c0 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 -- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 msgr2=0x7ff50c137af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 0x7ff50c137af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff50c065210 tx=0x7ff4fc006df0).stop 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 -- 172.21.15.57:0/1915305399 shutdown_connections 2024-03-18T14:40:55.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c134740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1915305399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0a96c0 0x7ff50c137af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1915305399 >> v2:172.21.15.57:3300/0 conn(0x7ff50c0657f0 0x7ff50c134250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 -- 172.21.15.57:0/1915305399 >> 172.21.15.57:0/1915305399 conn(0x7ff50c05cf10 msgr2=0x7ff50c05d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.273+0000 7ff512f4b700 1 -- 172.21.15.57:0/1915305399 shutdown_connections 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.274+0000 7ff512f4b700 1 -- 172.21.15.57:0/1915305399 wait complete. 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.274+0000 7ff512f4b700 1 Processor -- start 2024-03-18T14:40:55.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.274+0000 7ff512f4b700 1 -- start start 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c095290 con 0x7ff50c0a96c0 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c095570 con 0x7ff50c137fe0 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff512f4b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c0933d0 con 0x7ff50c0657f0 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff510ce7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff50bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff510ce7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37036/0 (socket says 172.21.15.57:37036) 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff510ce7700 1 -- 172.21.15.57:0/1817771265 learned_addr learned my addr 172.21.15.57:0/1817771265 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff50bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37654/0 (socket says 172.21.15.57:37654) 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.275+0000 7ff5114e8700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 -- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 msgr2=0x7ff50c092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 -- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 msgr2=0x7ff50c092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 -- 172.21.15.57:0/1817771265 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f400b1e0 con 0x7ff50c0657f0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff50bfff700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff510ce7700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff50c065210 tx=0x7ff4fc014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc020070 con 0x7ff50c0657f0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc002f70 con 0x7ff50c0657f0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc00b180 con 0x7ff50c0657f0 2024-03-18T14:40:55.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4fc01b270 con 0x7ff50c0657f0 2024-03-18T14:40:55.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c136a10 con 0x7ff50c0657f0 2024-03-18T14:40:55.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7ff4fc00f030 con 0x7ff50c0657f0 2024-03-18T14:40:55.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.276+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff4fc00de40 con 0x7ff50c0657f0 2024-03-18T14:40:55.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.277+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50c1373d0 con 0x7ff50c0657f0 2024-03-18T14:40:55.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.279+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff4fc012460 con 0x7ff50c0657f0 2024-03-18T14:40:55.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.357+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd new", "uuid": "11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad", "id": 2} v 0) v1 -- 0x7ff50c057a60 con 0x7ff50c0657f0 2024-03-18T14:40:55.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.374+0000 7ff509ffb700 1 -- 172.21.15.57:0/1817771265 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4fc012600 con 0x7ff50c0657f0 2024-03-18T14:40:55.376 INFO:teuthology.orchestra.run.smithi057.stdout:2 2024-03-18T14:40:55.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 msgr2=0x7ff50c095a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff50c065210 tx=0x7ff4fc014000).stop 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 shutdown_connections 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff50c137fe0 0x7ff50c092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff50c0657f0 0x7ff50c095a70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 --2- 172.21.15.57:0/1817771265 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff50c0a96c0 0x7ff50c092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 >> 172.21.15.57:0/1817771265 conn(0x7ff50c05cf10 msgr2=0x7ff50c067910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 shutdown_connections 2024-03-18T14:40:55.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.375+0000 7ff512f4b700 1 -- 172.21.15.57:0/1817771265 wait complete. 2024-03-18T14:40:55.387 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 208ece67-3817-45fa-9e1c-415cf5fd1e00 3 2024-03-18T14:40:55.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.491+0000 7fec9ec7b700 1 Processor -- start 2024-03-18T14:40:55.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.491+0000 7fec9ec7b700 1 -- start start 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 0x7fec98065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 0x7fec980a4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec980a4da0 con 0x7fec98139bb0 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec98065fb0 con 0x7fec98139f90 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ec7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec98066520 con 0x7fec98066c90 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ca17700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 0x7fec98065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54572/0 (socket says 172.21.15.57:54572) 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 -- 172.21.15.57:0/1406976258 learned_addr learned my addr 172.21.15.57:0/1406976258 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec97fff700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 0x7fec980a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 -- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 msgr2=0x7fec980a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 0x7fec980a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 -- 172.21.15.57:0/1406976258 >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 msgr2=0x7fec98065ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 --2- 172.21.15.57:0/1406976258 >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 0x7fec98065ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 -- 172.21.15.57:0/1406976258 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980a4b00 con 0x7fec98139f90 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9ca17700 1 --2- 172.21.15.57:0/1406976258 >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 0x7fec98065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec97fff700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 0x7fec980a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.492+0000 7fec9d218700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fec98066be0 tx=0x7fec90009290).ready entity=mon.1 client_cookie=b41c8460a7fe6b55 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.493+0000 7fec977fe700 1 -- 172.21.15.57:0/1406976258 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec90009e60 con 0x7fec98139f90 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.493+0000 7fec977fe700 1 -- 172.21.15.57:0/1406976258 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9000b820 con 0x7fec98139f90 2024-03-18T14:40:55.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.493+0000 7fec977fe700 1 -- 172.21.15.57:0/1406976258 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec9000b990 con 0x7fec98139f90 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 -- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 msgr2=0x7fec9805b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fec98066be0 tx=0x7fec90009290).stop 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 -- 172.21.15.57:0/1406976258 shutdown_connections 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec9805b970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/1406976258 >> v2:172.21.15.57:3300/0 conn(0x7fec98139bb0 0x7fec98065ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/1406976258 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98066c90 0x7fec980a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 -- 172.21.15.57:0/1406976258 >> 172.21.15.57:0/1406976258 conn(0x7fec980a89d0 msgr2=0x7fec980a8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 -- 172.21.15.57:0/1406976258 shutdown_connections 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.494+0000 7fec9ec7b700 1 -- 172.21.15.57:0/1406976258 wait complete. 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 Processor -- start 2024-03-18T14:40:55.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 -- start start 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98139bb0 0x7fec981341a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec98134690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec980933d0 con 0x7fec98066c90 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec980a0b20 con 0x7fec98139f90 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.495+0000 7fec9ec7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec98092030 con 0x7fec98139bb0 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37662/0 (socket says 172.21.15.57:37662) 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 -- 172.21.15.57:0/2557221327 learned_addr learned my addr 172.21.15.57:0/2557221327 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec97fff700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98139bb0 0x7fec981341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9d218700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec98134690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 -- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98139bb0 msgr2=0x7fec981341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98139bb0 0x7fec981341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 -- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 msgr2=0x7fec98134690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec98134690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 -- 172.21.15.57:0/2557221327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8400b180 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ca17700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fec8c00c000 tx=0x7fec8c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8c00c7e0 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00c940 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec8c00cca0 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c00b180 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.496+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec90009530 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.497+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fec8c01c460 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.497+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fec8c01c6f0 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.497+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98092640 con 0x7fec98066c90 2024-03-18T14:40:55.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.500+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fec8c01ccd0 con 0x7fec98066c90 2024-03-18T14:40:55.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.576+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "208ece67-3817-45fa-9e1c-415cf5fd1e00", "id": 3} v 0) v1 -- 0x7fec980a4850 con 0x7fec98066c90 2024-03-18T14:40:55.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.589+0000 7fec95ffb700 1 -- 172.21.15.57:0/2557221327 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "208ece67-3817-45fa-9e1c-415cf5fd1e00", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec8c026430 con 0x7fec98066c90 2024-03-18T14:40:55.591 INFO:teuthology.orchestra.run.smithi057.stdout:3 2024-03-18T14:40:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 msgr2=0x7fec98092a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fec8c00c000 tx=0x7fec8c006df0).stop 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 shutdown_connections 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec98139f90 0x7fec98134690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec98066c90 0x7fec98092a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 --2- 172.21.15.57:0/2557221327 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec98139bb0 0x7fec981341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 >> 172.21.15.57:0/2557221327 conn(0x7fec980a89d0 msgr2=0x7fec980a5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 shutdown_connections 2024-03-18T14:40:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.590+0000 7fec9ec7b700 1 -- 172.21.15.57:0/2557221327 wait complete. 2024-03-18T14:40:55.603 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-18T14:40:55.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-18T14:40:55.605 INFO:tasks.ceph.osd.0:Started 2024-03-18T14:40:55.606 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-18T14:40:55.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-18T14:40:55.608 INFO:tasks.ceph.osd.1:Started 2024-03-18T14:40:55.608 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-18T14:40:55.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-18T14:40:55.610 INFO:tasks.ceph.osd.2:Started 2024-03-18T14:40:55.610 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-18T14:40:55.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-18T14:40:55.612 INFO:tasks.ceph.osd.3:Started 2024-03-18T14:40:55.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:40:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.766+0000 7fd6016b4700 1 Processor -- start 2024-03-18T14:40:55.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.766+0000 7fd6016b4700 1 -- start start 2024-03-18T14:40:55.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd6016b4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd6016b4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 0x7fd5fc139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd6016b4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5fc067990 con 0x7fd5fc139d80 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd6016b4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0a4c50 con 0x7fd5fc067570 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd6016b4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0a4f10 con 0x7fd5fc1337e0 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd5fa7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 0x7fd5fc139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd5fb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd5fc139d80 0x7fd5fc140c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57800/0 (socket says 172.21.15.57:57800) 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd5fb7fe700 1 -- 172.21.15.57:0/1513095421 learned_addr learned my addr 172.21.15.57:0/1513095421 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.767+0000 7fd5faffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5fa7fc700 1 -- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 msgr2=0x7fd5fc133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5fa7fc700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5fa7fc700 1 -- 172.21.15.57:0/1513095421 >> v1:172.21.15.57:6789/0 conn(0x7fd5fc139d80 legacy=0x7fd5fc140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5f9ffb700 1 -- 172.21.15.57:0/1513095421 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280238190 0 0) 0x7fd5fc067990 con 0x7fd5fc139d80 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5fa7fc700 1 -- 172.21.15.57:0/1513095421 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc060520 con 0x7fd5fc067570 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5faffd700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:55.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5fa7fc700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 0x7fd5fc139890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd5f0002f70 tx=0x7fd5f0006df0).ready entity=mon.1 client_cookie=e57e514efa22ab60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5f9ffb700 1 -- 172.21.15.57:0/1513095421 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f000d570 con 0x7fd5fc067570 2024-03-18T14:40:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5f9ffb700 1 -- 172.21.15.57:0/1513095421 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f0000e90 con 0x7fd5fc067570 2024-03-18T14:40:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.768+0000 7fd5f9ffb700 1 -- 172.21.15.57:0/1513095421 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5f000d8c0 con 0x7fd5fc067570 2024-03-18T14:40:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 -- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 msgr2=0x7fd5fc139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 0x7fd5fc139890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fd5f0002f70 tx=0x7fd5f0006df0).stop 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 -- 172.21.15.57:0/1513095421 shutdown_connections 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 --2- 172.21.15.57:0/1513095421 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc067570 0x7fd5fc139890 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 -- 172.21.15.57:0/1513095421 >> 172.21.15.57:0/1513095421 conn(0x7fd5fc0a93f0 msgr2=0x7fd5fc0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 -- 172.21.15.57:0/1513095421 shutdown_connections 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.769+0000 7fd6016b4700 1 -- 172.21.15.57:0/1513095421 wait complete. 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.770+0000 7fd6016b4700 1 Processor -- start 2024-03-18T14:40:55.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.770+0000 7fd6016b4700 1 -- start start 2024-03-18T14:40:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc09fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc139d80 0x7fd5fc0a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0a2a40 con 0x7fd5fc067570 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0a1750 con 0x7fd5fc139d80 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd6016b4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5fc0a19f0 con 0x7fd5fc1337e0 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37702/0 (socket says 172.21.15.57:37702) 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 -- 172.21.15.57:0/3308158249 learned_addr learned my addr 172.21.15.57:0/3308158249 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5fb7fe700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc139d80 0x7fd5fc0a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5fa7fc700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc09fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 -- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 msgr2=0x7fd5fc09fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc09fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 -- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc139d80 msgr2=0x7fd5fc0a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc139d80 0x7fd5fc0a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 -- 172.21.15.57:0/3308158249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec00b180 con 0x7fd5fc067570 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5faffd700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd5ec00c000 tx=0x7fd5ec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:55.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5ec00c7e0 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.771+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00c940 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.772+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5ec00cca0 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.772+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f000b180 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.772+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5fc0a2620 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.772+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fd5ec02d460 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.772+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd5ec02db90 con 0x7fd5fc067570 2024-03-18T14:40:55.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.773+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5fc057a60 con 0x7fd5fc067570 2024-03-18T14:40:55.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.776+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd5ec02dda0 con 0x7fd5fc067570 2024-03-18T14:40:55.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.840+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5fc0a7c80 con 0x7fd5fc067570 2024-03-18T14:40:55.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.841+0000 7fd5ebfff700 1 -- 172.21.15.57:0/3308158249 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7fd5ec037430 con 0x7fd5fc067570 2024-03-18T14:40:55.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:40:55.843 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:40:55.578454+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:40:55.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 msgr2=0x7fd5fc0a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fd5ec00c000 tx=0x7fd5ec006df0).stop 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 shutdown_connections 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd5fc139d80 0x7fd5fc0a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5fc067570 0x7fd5fc0a1090 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 --2- 172.21.15.57:0/3308158249 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd5fc1337e0 0x7fd5fc09fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 >> 172.21.15.57:0/3308158249 conn(0x7fd5fc0a93f0 msgr2=0x7fd5fc067950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 shutdown_connections 2024-03-18T14:40:55.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:40:55.842+0000 7fd6016b4700 1 -- 172.21.15.57:0/3308158249 wait complete. 2024-03-18T14:40:55.855 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-18T14:40:55.855 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-18T14:40:55.973 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:40:55.971+0000 7f6006af5f00 -1 Falling back to public interface 2024-03-18T14:40:55.985 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:40:55.982+0000 7f16049b5f00 -1 Falling back to public interface 2024-03-18T14:40:56.255 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:40:56.252+0000 7eff5988ef00 -1 Falling back to public interface 2024-03-18T14:40:56.259 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T14:40:56.266 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:40:56.263+0000 7f842ee35f00 -1 Falling back to public interface 2024-03-18T14:40:56.377 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.374+0000 7f4dc8dfa700 1 Processor -- start 2024-03-18T14:40:56.377 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.374+0000 7f4dc8dfa700 1 -- start start 2024-03-18T14:40:56.378 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.375+0000 7f4dc8dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:56.378 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.375+0000 7f4dc8dfa700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4dc40a4780 0x7f4dc405b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:56.378 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.375+0000 7f4dc8dfa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc409bb80 con 0x7f4dc405be90 2024-03-18T14:40:56.378 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.375+0000 7f4dc8dfa700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc409b980 con 0x7f4dc40a4780 2024-03-18T14:40:56.378 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.375+0000 7f4dc8dfa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40a4eb0 con 0x7f4dc413e080 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54644/0 (socket says 172.21.15.57:54644) 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc259c700 1 -- 172.21.15.57:0/4233791425 learned_addr learned my addr 172.21.15.57:0/4233791425 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4233791425 >> v2:172.21.15.57:3300/0 conn(0x7f4dc40a4780 0x7f4dc405b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 msgr2=0x7f4dc413e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc159a700 1 -- 172.21.15.57:0/4233791425 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656197934 0 0) 0x7f4dc409bb80 con 0x7f4dc405be90 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4233791425 >> v1:172.21.15.57:6789/0 conn(0x7f4dc405be90 legacy=0x7f4dc4144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:56.379 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4233791425 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc413d950 con 0x7f4dc40a4780 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc259c700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.376+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc40a4780 0x7f4dc405b9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4db8002f70 tx=0x7f4db8006df0).ready entity=mon.0 client_cookie=c3cb9cfb4a332ae1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.377+0000 7f4dc159a700 1 -- 172.21.15.57:0/4233791425 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db800d570 con 0x7f4dc40a4780 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.377+0000 7f4dc159a700 1 -- 172.21.15.57:0/4233791425 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8000e90 con 0x7f4dc40a4780 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.377+0000 7f4dc159a700 1 -- 172.21.15.57:0/4233791425 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db800d8c0 con 0x7f4dc40a4780 2024-03-18T14:40:56.380 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.377+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc40a4780 msgr2=0x7f4dc405b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.377+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc40a4780 0x7f4dc405b9a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f4db8002f70 tx=0x7f4db8006df0).stop 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4233791425 shutdown_connections 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc413e080 0x7f4dc413e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4233791425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc40a4780 0x7f4dc405b9a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4233791425 >> 172.21.15.57:0/4233791425 conn(0x7f4dc40a8960 msgr2=0x7f4dc40a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4233791425 shutdown_connections 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.378+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4233791425 wait complete. 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.379+0000 7f4dc8dfa700 1 Processor -- start 2024-03-18T14:40:56.381 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.379+0000 7f4dc8dfa700 1 -- start start 2024-03-18T14:40:56.382 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4dc405be90 0x7f4dc40a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc413e080 0x7f4dc414d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40a2930 con 0x7f4dc413e080 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40a19c0 con 0x7f4dc40a4780 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54660/0 (socket says 172.21.15.57:54660) 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4227522281 learned_addr learned my addr 172.21.15.57:0/4227522281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc2d9d700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc413e080 0x7f4dc414d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:56.383 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.380+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40a16b0 con 0x7f4dc405be90 2024-03-18T14:40:56.384 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc259c700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4dc405be90 0x7f4dc40a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:40:56.384 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4dc405be90 msgr2=0x7f4dc40a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:56.384 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4dc405be90 0x7f4dc40a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.384 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc413e080 msgr2=0x7f4dc414d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc413e080 0x7f4dc414d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db400b1e0 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc1d9b700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4dc409f370 tx=0x7f4db8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db8016070 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8013980 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db800b180 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4db8013ce0 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.381+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40a1c10 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.382+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4db8025030 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.382+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4db8013e40 con 0x7f4dc40a4780 2024-03-18T14:40:56.385 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.383+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40a2a70 con 0x7f4dc40a4780 2024-03-18T14:40:56.387 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.385+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4dc40a2a70 con 0x7f4dc40a4780 2024-03-18T14:40:56.403 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.401+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mgrmap(e 2) v1 ==== 20942+0+0 (secure 0 0 0) 0x7f4db800f030 con 0x7f4dc40a4780 2024-03-18T14:40:56.502 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.500+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc409b480 con 0x7f4dc40a4780 2024-03-18T14:40:56.503 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.500+0000 7f4db37fe700 1 -- 172.21.15.57:0/4227522281 <== mon.1 v2:172.21.15.57:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7f4db8023070 con 0x7f4dc40a4780 2024-03-18T14:40:56.503 INFO:teuthology.misc.health.smithi057.stdout: 2024-03-18T14:40:56.503 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":6,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:40:55.578454+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.501+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 msgr2=0x7f4dc414d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.501+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4dc409f370 tx=0x7f4db8014000).stop 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.502+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 shutdown_connections 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.502+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4dc413e080 0x7f4dc414d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.502+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4dc405be90 0x7f4dc40a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.502+0000 7f4dc8dfa700 1 --2- 172.21.15.57:0/4227522281 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4dc40a4780 0x7f4dc414d100 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:40:56.504 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.502+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 >> 172.21.15.57:0/4227522281 conn(0x7f4dc40a8960 msgr2=0x7f4dc409aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:40:56.505 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.503+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 shutdown_connections 2024-03-18T14:40:56.505 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:40:56.503+0000 7f4dc8dfa700 1 -- 172.21.15.57:0/4227522281 wait complete. 2024-03-18T14:40:56.517 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-03-18T14:40:57.305 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:40:57.302+0000 7f6006af5f00 -1 osd.0 0 log_to_monitors {default=true} 2024-03-18T14:40:57.331 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:40:57.329+0000 7f16049b5f00 -1 osd.1 0 log_to_monitors {default=true} 2024-03-18T14:40:57.348 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:40:57.345+0000 7eff5988ef00 -1 osd.2 0 log_to_monitors {default=true} 2024-03-18T14:40:57.353 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:40:57.350+0000 7f842ee35f00 -1 osd.3 0 log_to_monitors {default=true} 2024-03-18T14:40:58.425 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:40:58.423+0000 7f15ece80700 -1 osd.1 0 waiting for initial osdmap 2024-03-18T14:40:58.426 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:40:58.423+0000 7f8417300700 -1 osd.3 0 waiting for initial osdmap 2024-03-18T14:40:58.426 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:40:58.423+0000 7eff41d59700 -1 osd.2 0 waiting for initial osdmap 2024-03-18T14:40:58.427 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:40:58.425+0000 7f5feefc0700 -1 osd.0 0 waiting for initial osdmap 2024-03-18T14:40:58.432 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:40:58.430+0000 7f15f889d700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:40:58.432 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:40:58.430+0000 7f8422d1d700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:40:58.433 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:40:58.431+0000 7eff4d776700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:40:58.435 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:40:58.433+0000 7f5ffa9dd700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:41:02.922 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:03.034 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.033+0000 7f9e8fc1e700 1 Processor -- start 2024-03-18T14:41:03.035 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.033+0000 7f9e8fc1e700 1 -- start start 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8fc1e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e88135d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8fc1e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 0x7f9e8805d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8fc1e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8805cc20 con 0x7f9e881392f0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8fc1e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8805c720 con 0x7f9e8806c7d0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8fc1e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881362d0 con 0x7f9e8805d0d0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 0x7f9e8805d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8e1bb700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9e881392f0 0x7f9e881397a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57858/0 (socket says 172.21.15.57:57858) 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8e1bb700 1 -- 172.21.15.57:0/2918717245 learned_addr learned my addr 172.21.15.57:0/2918717245 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d9ba700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e88135d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8c9b8700 1 -- 172.21.15.57:0/2918717245 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895770731 0 0) 0x7f9e8805cc20 con 0x7f9e881392f0 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 -- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 msgr2=0x7f9e88135d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:03.037 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e88135d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 -- 172.21.15.57:0/2918717245 >> v1:172.21.15.57:6789/0 conn(0x7f9e881392f0 legacy=0x7f9e881397a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 -- 172.21.15.57:0/2918717245 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88136590 con 0x7f9e8805d0d0 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d9ba700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e88135d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.034+0000 7f9e8d1b9700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 0x7f9e8805d830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9e78002f70 tx=0x7f9e78006df0).ready entity=mon.2 client_cookie=cf3eeab51a4ddc64 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8c9b8700 1 -- 172.21.15.57:0/2918717245 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7800d570 con 0x7f9e8805d0d0 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8c9b8700 1 -- 172.21.15.57:0/2918717245 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78000e90 con 0x7f9e8805d0d0 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8c9b8700 1 -- 172.21.15.57:0/2918717245 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e7800d8c0 con 0x7f9e8805d0d0 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 msgr2=0x7f9e8805d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 0x7f9e8805d830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f9e78002f70 tx=0x7f9e78006df0).stop 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2918717245 shutdown_connections 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e88135d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2918717245 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e8805d0d0 0x7f9e8805d830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2918717245 >> 172.21.15.57:0/2918717245 conn(0x7f9e88067ab0 msgr2=0x7f9e8806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:03.038 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2918717245 shutdown_connections 2024-03-18T14:41:03.039 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.035+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2918717245 wait complete. 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.036+0000 7f9e8fc1e700 1 Processor -- start 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.036+0000 7f9e8fc1e700 1 -- start start 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e8812e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 0x7f9e8812e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e880a0c20 con 0x7f9e8805d0d0 2024-03-18T14:41:03.041 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e880a3240 con 0x7f9e8806c7d0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8fc1e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e880a4430 con 0x7f9e881392f0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8d9ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8e1bb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 0x7f9e8812e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8d1b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e8812e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8d9ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37784/0 (socket says 172.21.15.57:37784) 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.037+0000 7f9e8d9ba700 1 -- 172.21.15.57:0/2753081440 learned_addr learned my addr 172.21.15.57:0/2753081440 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 -- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 msgr2=0x7f9e8812e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 0x7f9e8812e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 -- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 msgr2=0x7f9e8812e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e8812e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 -- 172.21.15.57:0/2753081440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8400b180 con 0x7f9e8805d0d0 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d1b9700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e8812e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8e1bb700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 0x7f9e8812e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.042 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8d9ba700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9e8400c000 tx=0x7f9e84006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8400c5f0 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400c750 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7800b180 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e8400cab0 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.038+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e88137c80 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.039+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9e8400cc10 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.039+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f9e8404a8e0 con 0x7f9e8805d0d0 2024-03-18T14:41:03.043 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.039+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e880a3c80 con 0x7f9e8805d0d0 2024-03-18T14:41:03.044 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.043+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9e880a3c80 con 0x7f9e8805d0d0 2024-03-18T14:41:03.163 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.161+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e880a3c80 con 0x7f9e8805d0d0 2024-03-18T14:41:03.164 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.162+0000 7f9e76ffd700 1 -- 172.21.15.57:0/2753081440 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6237 (secure 0 0 0) 0x7f9e880a3c80 con 0x7f9e8805d0d0 2024-03-18T14:41:03.164 INFO:teuthology.misc.health.smithi057.stdout: 2024-03-18T14:41:03.164 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":11,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:01.437372+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 >> v1:172.21.15.57:6816/39496 conn(0x7f9e68038da0 legacy=0x7f9e6803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 msgr2=0x7f9e880a3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9e8400c000 tx=0x7f9e84006df0).stop 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 shutdown_connections 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9e881392f0 0x7f9e8812e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9e8805d0d0 0x7f9e880a3f40 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 --2- 172.21.15.57:0/2753081440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9e8806c7d0 0x7f9e8812e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 >> 172.21.15.57:0/2753081440 conn(0x7f9e88067ab0 msgr2=0x7f9e8812fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:03.166 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 shutdown_connections 2024-03-18T14:41:03.167 INFO:teuthology.misc.health.smithi057.stderr:2024-03-18T14:41:03.164+0000 7f9e8fc1e700 1 -- 172.21.15.57:0/2753081440 wait complete. 2024-03-18T14:41:03.175 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-03-18T14:41:03.175 INFO:tasks.ceph:Creating RBD pool 2024-03-18T14:41:03.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.279+0000 7f3852d06700 1 Processor -- start 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.279+0000 7f3852d06700 1 -- start start 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f3852d06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 0x7f384c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f3852d06700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 0x7f384c099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f3852d06700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c136f20 con 0x7f384c1366f0 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f3852d06700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c09a380 con 0x7f384c136ad0 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f3852d06700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c135fe0 con 0x7f384c09b520 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f38512a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 0x7f384c099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 0x7f384c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f38512a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 0x7f384c099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37792/0 (socket says 172.21.15.57:37792) 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f38512a3700 1 -- 172.21.15.57:0/2996188610 learned_addr learned my addr 172.21.15.57:0/2996188610 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 -- 172.21.15.57:0/2996188610 >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 msgr2=0x7f384c099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 --2- 172.21.15.57:0/2996188610 >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 0x7f384c099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 -- 172.21.15.57:0/2996188610 >> v1:172.21.15.57:6789/0 conn(0x7f384c1366f0 legacy=0x7f384c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 -- 172.21.15.57:0/2996188610 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c09a0c0 con 0x7f384c09b520 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384bfff700 1 --2- 172.21.15.57:0/2996188610 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 0x7f384c09bbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3838002f70 tx=0x7f3838006d90).ready entity=mon.1 client_cookie=a14c5646303974e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384b7fe700 1 -- 172.21.15.57:0/2996188610 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383800d4a0 con 0x7f384c09b520 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384b7fe700 1 -- 172.21.15.57:0/2996188610 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3838000e90 con 0x7f384c09b520 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.280+0000 7f384b7fe700 1 -- 172.21.15.57:0/2996188610 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383800d7f0 con 0x7f384c09b520 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 -- 172.21.15.57:0/2996188610 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 msgr2=0x7f384c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 --2- 172.21.15.57:0/2996188610 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 0x7f384c09bbb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f3838002f70 tx=0x7f3838006d90).stop 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 -- 172.21.15.57:0/2996188610 shutdown_connections 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 --2- 172.21.15.57:0/2996188610 >> v2:172.21.15.57:3300/0 conn(0x7f384c136ad0 0x7f384c099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 --2- 172.21.15.57:0/2996188610 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c09b520 0x7f384c09bbb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 -- 172.21.15.57:0/2996188610 >> 172.21.15.57:0/2996188610 conn(0x7f384c06c0c0 msgr2=0x7f384c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 -- 172.21.15.57:0/2996188610 shutdown_connections 2024-03-18T14:41:03.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.281+0000 7f3852d06700 1 -- 172.21.15.57:0/2996188610 wait complete. 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.282+0000 7f3852d06700 1 Processor -- start 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.282+0000 7f3852d06700 1 -- start start 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c1366f0 0x7f384c12d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 0x7f384c12ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c0956f0 con 0x7f384c136ad0 2024-03-18T14:41:03.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c094ad0 con 0x7f384c1366f0 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f384c097280 con 0x7f384c09b520 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37186/0 (socket says 172.21.15.57:37186) 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 -- 172.21.15.57:0/3554230791 learned_addr learned my addr 172.21.15.57:0/3554230791 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f384bfff700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c1366f0 0x7f384c12d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f38512a3700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 0x7f384c12ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 -- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c1366f0 msgr2=0x7f384c12d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c1366f0 0x7f384c12d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 -- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 msgr2=0x7f384c12ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 0x7f384c12ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 -- 172.21.15.57:0/3554230791 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383800b120 con 0x7f384c09b520 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f38512a3700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 0x7f384c12ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3850aa2700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f384c05cde0 tx=0x7f3840007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3840007030 con 0x7f384c09b520 2024-03-18T14:41:03.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840007190 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c097540 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.283+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3840006510 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.284+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c139ed0 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.284+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3840010030 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.285+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c057a60 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.285+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f3840049f00 con 0x7f384c09b520 2024-03-18T14:41:03.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.288+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f384002f0e0 con 0x7f384c09b520 2024-03-18T14:41:03.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.405+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f384c060880 con 0x7f384c09b520 2024-03-18T14:41:03.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.517+0000 7f3849ffb700 1 -- 172.21.15.57:0/3554230791 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (secure 0 0 0) 0x7f3840032f10 con 0x7f384c09b520 2024-03-18T14:41:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 >> v1:172.21.15.57:6816/39496 conn(0x7f382c038e30 legacy=0x7f382c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 msgr2=0x7f384c095cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f384c05cde0 tx=0x7f3840007c10).stop 2024-03-18T14:41:03.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 shutdown_connections 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f384c136ad0 0x7f384c12ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f384c09b520 0x7f384c095cc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 --2- 172.21.15.57:0/3554230791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f384c1366f0 0x7f384c12d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 >> 172.21.15.57:0/3554230791 conn(0x7f384c06c0c0 msgr2=0x7f384c137670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 shutdown_connections 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.518+0000 7f3852d06700 1 -- 172.21.15.57:0/3554230791 wait complete. 2024-03-18T14:41:03.521 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2024-03-18T14:41:03.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-18T14:41:03.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.637+0000 7f1ca1883700 1 Processor -- start 2024-03-18T14:41:03.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.637+0000 7f1ca1883700 1 -- start start 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1ca1883700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1ca1883700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1ca1883700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c099e70 con 0x7f1c9c099a00 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1ca1883700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c09a380 con 0x7f1c9c09b520 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1ca1883700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c135fe0 con 0x7f1c9c1366f0 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c9c099a00 0x7f1c9c139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37862/0 (socket says 172.21.15.57:37862) 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9b7fe700 1 -- 172.21.15.57:0/4049093770 learned_addr learned my addr 172.21.15.57:0/4049093770 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9a7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55756/0 (socket says 172.21.15.57:55756) 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.638+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59270/0 (socket says 172.21.15.57:59270) 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9affd700 1 -- 172.21.15.57:0/4049093770 >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 msgr2=0x7f1c9c136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9affd700 1 --2- 172.21.15.57:0/4049093770 >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9affd700 1 -- 172.21.15.57:0/4049093770 >> v1:172.21.15.57:6789/0 conn(0x7f1c9c099a00 legacy=0x7f1c9c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9affd700 1 -- 172.21.15.57:0/4049093770 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c09a0c0 con 0x7f1c9c1366f0 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c99ffb700 1 -- 172.21.15.57:0/4049093770 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752272149 0 0) 0x7f1c9c099e70 con 0x7f1c9c099a00 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9a7fc700 1 --2- 172.21.15.57:0/4049093770 >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c9affd700 1 --2- 172.21.15.57:0/4049093770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1c90002f70 tx=0x7f1c90006df0).ready entity=mon.1 client_cookie=2430ac215e274cf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c99ffb700 1 -- 172.21.15.57:0/4049093770 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9000d570 con 0x7f1c9c1366f0 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c99ffb700 1 -- 172.21.15.57:0/4049093770 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90000e90 con 0x7f1c9c1366f0 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1c99ffb700 1 -- 172.21.15.57:0/4049093770 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9000d8c0 con 0x7f1c9c1366f0 2024-03-18T14:41:03.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 -- 172.21.15.57:0/4049093770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 msgr2=0x7f1c9c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 --2- 172.21.15.57:0/4049093770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1c90002f70 tx=0x7f1c90006df0).stop 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 -- 172.21.15.57:0/4049093770 shutdown_connections 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 --2- 172.21.15.57:0/4049093770 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c1366f0 0x7f1c9c09bbb0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 --2- 172.21.15.57:0/4049093770 >> v2:172.21.15.57:3300/0 conn(0x7f1c9c09b520 0x7f1c9c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.639+0000 7f1ca1883700 1 -- 172.21.15.57:0/4049093770 >> 172.21.15.57:0/4049093770 conn(0x7f1c9c06c0c0 msgr2=0x7f1c9c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.640+0000 7f1ca1883700 1 -- 172.21.15.57:0/4049093770 shutdown_connections 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.640+0000 7f1ca1883700 1 -- 172.21.15.57:0/4049093770 wait complete. 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.640+0000 7f1ca1883700 1 Processor -- start 2024-03-18T14:41:03.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.640+0000 7f1ca1883700 1 -- start start 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c09b520 0x7f1c9c148ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 0x7f1c9c149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0970a0 con 0x7f1c9c1366f0 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0972d0 con 0x7f1c9c09b520 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1ca1883700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c097970 con 0x7f1c9c099a00 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37740/0 (socket says 172.21.15.57:37740) 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 -- 172.21.15.57:0/3905260826 learned_addr learned my addr 172.21.15.57:0/3905260826 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9b7fe700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 0x7f1c9c149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9a7fc700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c09b520 0x7f1c9c148ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:03.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 -- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c09b520 msgr2=0x7f1c9c148ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c09b520 0x7f1c9c148ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 -- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 msgr2=0x7f1c9c149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 0x7f1c9c149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9affd700 1 -- 172.21.15.57:0/3905260826 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c00b120 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.641+0000 7f1c9b7fe700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 0x7f1c9c149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1c9affd700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1c90002f70 tx=0x7f1c90014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c90013de0 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9001e400 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9000b180 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c9001e760 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.642+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c095610 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.643+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1c90025030 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.643+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2811+0+0 (secure 0 0 0) 0x7f1c9004b2c0 con 0x7f1c9c099a00 2024-03-18T14:41:03.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.643+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c0985a0 con 0x7f1c9c099a00 2024-03-18T14:41:03.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.646+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1c900058c0 con 0x7f1c9c099a00 2024-03-18T14:41:03.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:03.764+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1c9c057a60 con 0x7f1c9c099a00 2024-03-18T14:41:04.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.532+0000 7f1c8bfff700 1 -- 172.21.15.57:0/3905260826 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1c90001f00 con 0x7f1c9c099a00 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 >> v1:172.21.15.57:6816/39496 conn(0x7f1c78038dd0 legacy=0x7f1c7803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 msgr2=0x7f1c9c0925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f1c90002f70 tx=0x7f1c90014000).stop 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 shutdown_connections 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c9c1366f0 0x7f1c9c149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c9c099a00 0x7f1c9c0925c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 --2- 172.21.15.57:0/3905260826 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c9c09b520 0x7f1c9c148ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 >> 172.21.15.57:0/3905260826 conn(0x7f1c9c06c0c0 msgr2=0x7f1c9c132320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 shutdown_connections 2024-03-18T14:41:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.536+0000 7f1ca1883700 1 -- 172.21.15.57:0/3905260826 wait complete. 2024-03-18T14:41:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-18T14:41:04.552 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-18T14:41:04.552 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T14:41:04.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T14:41:04.555 INFO:tasks.ceph.mds.a:Started 2024-03-18T14:41:04.555 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T14:41:04.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T14:41:04.557 INFO:tasks.ceph.mds.b:Started 2024-03-18T14:41:04.557 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T14:41:04.557 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T14:41:04.559 INFO:tasks.ceph.mds.c:Started 2024-03-18T14:41:04.560 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-18T14:41:04.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:04.643 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-03-18T14:41:04.644 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-03-18T14:41:04.644 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2024-03-18T14:41:04.644 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-18T14:41:04.642+0000 7fa5f8a6a700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6818/0: (98) Address already in use 2024-03-18T14:41:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.681+0000 7f3102f1e700 1 Processor -- start 2024-03-18T14:41:04.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.681+0000 7f3102f1e700 1 -- start start 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3102f1e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 0x7f30fc060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3102f1e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc13e600 0x7f30fc1409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3102f1e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30fc0603c0 con 0x7f30fc0aae90 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3102f1e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1338e0 con 0x7f30fc132df0 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3102f1e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0aa230 con 0x7f30fc13e600 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f30fc0aae90 0x7f30fc1331d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37928/0 (socket says 172.21.15.57:37928) 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fbfff700 1 -- 172.21.15.57:0/2826323143 learned_addr learned my addr 172.21.15.57:0/2826323143 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f31014bb700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc13e600 0x7f30fc1409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 0x7f30fc060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fb7fe700 1 -- 172.21.15.57:0/2826323143 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060990962 0 0) 0x7f30fc0603c0 con 0x7f30fc0aae90 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fb7fe700 1 -- 172.21.15.57:0/2826323143 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30e0003260 con 0x7f30fc0aae90 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 -- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc13e600 msgr2=0x7f30fc1409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc13e600 0x7f30fc1409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 -- 172.21.15.57:0/2826323143 >> v1:172.21.15.57:6789/0 conn(0x7f30fc0aae90 legacy=0x7f30fc1331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 -- 172.21.15.57:0/2826323143 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0aa4d0 con 0x7f30fc132df0 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f3100cba700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 0x7f30fc060dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f30f0002f70 tx=0x7f30f0006df0).ready entity=mon.1 client_cookie=36df2ee41182f57d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fb7fe700 1 -- 172.21.15.57:0/2826323143 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f000d570 con 0x7f30fc132df0 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.682+0000 7f30fb7fe700 1 -- 172.21.15.57:0/2826323143 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f0000e90 con 0x7f30fc132df0 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 -- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 msgr2=0x7f30fc060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 0x7f30fc060dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f30f0002f70 tx=0x7f30f0006df0).stop 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 -- 172.21.15.57:0/2826323143 shutdown_connections 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc13e600 0x7f30fc1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 --2- 172.21.15.57:0/2826323143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc132df0 0x7f30fc060dc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 -- 172.21.15.57:0/2826323143 >> 172.21.15.57:0/2826323143 conn(0x7f30fc05c300 msgr2=0x7f30fc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 -- 172.21.15.57:0/2826323143 shutdown_connections 2024-03-18T14:41:04.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.683+0000 7f3102f1e700 1 -- 172.21.15.57:0/2826323143 wait complete. 2024-03-18T14:41:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.684+0000 7f3102f1e700 1 Processor -- start 2024-03-18T14:41:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.684+0000 7f3102f1e700 1 -- start start 2024-03-18T14:41:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 0x7f30fc092660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 0x7f30fc093fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc13e060 con 0x7f30fc0aae90 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc0937c0 con 0x7f30fc13e600 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc145160 con 0x7f30fc132df0 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3100cba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 0x7f30fc092660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f30fbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 0x7f30fc093fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3100cba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 0x7f30fc092660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55796/0 (socket says 172.21.15.57:55796) 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59288/0 (socket says 172.21.15.57:59288) 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f30fbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 0x7f30fc093fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37782/0 (socket says 172.21.15.57:37782) 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3100cba700 1 -- 172.21.15.57:0/1631473699 learned_addr learned my addr 172.21.15.57:0/1631473699 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 -- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 msgr2=0x7f30fc093fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 0x7f30fc093fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 -- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 msgr2=0x7f30fc092660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 0x7f30fc092660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 -- 172.21.15.57:0/1631473699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f000b180 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f31014bb700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30f400c000 tx=0x7f30f40091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4012600 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4012760 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc093aa0 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4012ac0 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.685+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc094490 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.686+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f30f4022070 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.686+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc13e1a0 con 0x7f30fc13e600 2024-03-18T14:41:04.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.687+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f30f404ab20 con 0x7f30fc13e600 2024-03-18T14:41:04.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.690+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f30f4033690 con 0x7f30fc13e600 2024-03-18T14:41:04.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.807+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30fc057a60 con 0x7f30fc13e600 2024-03-18T14:41:04.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.807+0000 7f30f9ffb700 1 -- 172.21.15.57:0/1631473699 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7622 (secure 0 0 0) 0x7f30f4033280 con 0x7f30fc13e600 2024-03-18T14:41:04.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:04.809 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:04.514209+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.808+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 >> v1:172.21.15.57:6816/39496 conn(0x7f30dc038da0 legacy=0x7f30dc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.808+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 msgr2=0x7f30fc145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.808+0000 7f3102f1e700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30f400c000 tx=0x7f30f40091d0).stop 2024-03-18T14:41:04.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 shutdown_connections 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30fc13e600 0x7f30fc145400 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30fc0aae90 0x7f30fc092660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 --2- 172.21.15.57:0/1631473699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30fc132df0 0x7f30fc093fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 >> 172.21.15.57:0/1631473699 conn(0x7f30fc05c300 msgr2=0x7f30fc0a9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 shutdown_connections 2024-03-18T14:41:04.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.809+0000 7f3102f1e700 1 -- 172.21.15.57:0/1631473699 wait complete. 2024-03-18T14:41:04.821 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-03-18T14:41:04.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-18T14:41:04.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.930+0000 7f6719033700 1 Processor -- start 2024-03-18T14:41:04.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.930+0000 7f6719033700 1 -- start start 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.930+0000 7f6719033700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 0x7f671409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6719033700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 0x7f6714136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6719033700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6719033700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f671409a380 con 0x7f671409b520 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6719033700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714135fe0 con 0x7f6714099a00 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6719033700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6714099eb0 con 0x7f67141366f0 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 0x7f6714136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6712d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 0x7f671409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59304/0 (socket says 172.21.15.57:59304) 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 0x7f6714136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55806/0 (socket says 172.21.15.57:55806) 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 -- 172.21.15.57:0/3187305527 learned_addr learned my addr 172.21.15.57:0/3187305527 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 -- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 msgr2=0x7f671409bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 0x7f671409bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 -- 172.21.15.57:0/3187305527 >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 msgr2=0x7f6714136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 --2- 172.21.15.57:0/3187305527 >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 0x7f6714136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 -- 172.21.15.57:0/3187305527 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671409a0c0 con 0x7f6714099a00 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6712d9d700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 0x7f671409bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f671359e700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f670c0032f0 tx=0x7f670c009290).ready entity=mon.1 client_cookie=1c914e389d08266f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6711d9b700 1 -- 172.21.15.57:0/3187305527 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670c00b6c0 con 0x7f6714099a00 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6711d9b700 1 -- 172.21.15.57:0/3187305527 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c00b820 con 0x7f6714099a00 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.931+0000 7f6711d9b700 1 -- 172.21.15.57:0/3187305527 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f670c00b990 con 0x7f6714099a00 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 -- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 msgr2=0x7f6714139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f670c0032f0 tx=0x7f670c009290).stop 2024-03-18T14:41:04.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 -- 172.21.15.57:0/3187305527 shutdown_connections 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6714099a00 0x7f6714139530 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 --2- 172.21.15.57:0/3187305527 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f67141366f0 0x7f671409bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 --2- 172.21.15.57:0/3187305527 >> v2:172.21.15.57:3300/0 conn(0x7f671409b520 0x7f6714136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 -- 172.21.15.57:0/3187305527 >> 172.21.15.57:0/3187305527 conn(0x7f671406c0c0 msgr2=0x7f671406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 -- 172.21.15.57:0/3187305527 shutdown_connections 2024-03-18T14:41:04.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.932+0000 7f6719033700 1 -- 172.21.15.57:0/3187305527 wait complete. 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.933+0000 7f6719033700 1 Processor -- start 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.933+0000 7f6719033700 1 -- start start 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671409b520 0x7f671412f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67141366f0 0x7f6714145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714095680 con 0x7f671409b520 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6714095b80 con 0x7f67141366f0 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6719033700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671412f830 con 0x7f6714099a00 2024-03-18T14:41:04.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f671359e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67141366f0 0x7f6714145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37792/0 (socket says 172.21.15.57:37792) 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 -- 172.21.15.57:0/2328668275 learned_addr learned my addr 172.21.15.57:0/2328668275 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f671259c700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671409b520 0x7f671412f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 -- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67141366f0 msgr2=0x7f6714145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67141366f0 0x7f6714145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 -- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671409b520 msgr2=0x7f671412f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671409b520 0x7f671412f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 -- 172.21.15.57:0/2328668275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670400b180 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.934+0000 7f6712d9d700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f670400c000 tx=0x7f6704006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6704010780 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67040108e0 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c009530 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6704010c40 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67140943b0 con 0x7f6714099a00 2024-03-18T14:41:04.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f670401c460 con 0x7f6714099a00 2024-03-18T14:41:04.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.935+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6714057a60 con 0x7f6714099a00 2024-03-18T14:41:04.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.936+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f670404a9a0 con 0x7f6714099a00 2024-03-18T14:41:04.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:04.939+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6704033620 con 0x7f6714099a00 2024-03-18T14:41:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.055+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f67140a7ba0 con 0x7f6714099a00 2024-03-18T14:41:05.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.056+0000 7f6703fff700 1 -- 172.21.15.57:0/2328668275 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6704033230 con 0x7f6714099a00 2024-03-18T14:41:05.057 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 >> v1:172.21.15.57:6816/39496 conn(0x7f66f0038da0 legacy=0x7f66f003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 msgr2=0x7f671412ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f670400c000 tx=0x7f6704006df0).stop 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 shutdown_connections 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f67141366f0 0x7f6714145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6714099a00 0x7f671412ee50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 --2- 172.21.15.57:0/2328668275 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f671409b520 0x7f671412f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 >> 172.21.15.57:0/2328668275 conn(0x7f671406c0c0 msgr2=0x7f6714066810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 shutdown_connections 2024-03-18T14:41:05.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.057+0000 7f6719033700 1 -- 172.21.15.57:0/2328668275 wait complete. 2024-03-18T14:41:05.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:41:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.176+0000 7f2f9d305700 1 Processor -- start 2024-03-18T14:41:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.176+0000 7f2f9d305700 1 -- start start 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f9d305700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f9d305700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 0x7f2f98061220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f9d305700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f9809b1b0 con 0x7f2f98135f10 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f9d305700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9809bdb0 con 0x7f2f9809b990 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f9d305700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98061b80 con 0x7f2f98139c00 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f967fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 0x7f2f98061220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f977fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2f98135f10 0x7f2f981363c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37944/0 (socket says 172.21.15.57:37944) 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f977fe700 1 -- 172.21.15.57:0/1068108804 learned_addr learned my addr 172.21.15.57:0/1068108804 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1068108804 >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 msgr2=0x7f2f98061220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 --2- 172.21.15.57:0/1068108804 >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 0x7f2f98061220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1068108804 >> v1:172.21.15.57:6789/0 conn(0x7f2f98135f10 legacy=0x7f2f981363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1068108804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9809c5a0 con 0x7f2f98139c00 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f967fc700 1 --2- 172.21.15.57:0/1068108804 >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 0x7f2f98061220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.177+0000 7f2f96ffd700 1 --2- 172.21.15.57:0/1068108804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98139fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f8c002f70 tx=0x7f2f8c006df0).ready entity=mon.1 client_cookie=dc330b44c589034e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f95ffb700 1 -- 172.21.15.57:0/1068108804 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c00d570 con 0x7f2f98139c00 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f95ffb700 1 -- 172.21.15.57:0/1068108804 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c000e90 con 0x7f2f98139c00 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f95ffb700 1 -- 172.21.15.57:0/1068108804 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c00d8c0 con 0x7f2f98139c00 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 -- 172.21.15.57:0/1068108804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 msgr2=0x7f2f98139fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1068108804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98139fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2f8c002f70 tx=0x7f2f8c006df0).stop 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 -- 172.21.15.57:0/1068108804 shutdown_connections 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1068108804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98139fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1068108804 >> v2:172.21.15.57:3300/0 conn(0x7f2f9809b990 0x7f2f98061220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 -- 172.21.15.57:0/1068108804 >> 172.21.15.57:0/1068108804 conn(0x7f2f9805cee0 msgr2=0x7f2f98062360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 -- 172.21.15.57:0/1068108804 shutdown_connections 2024-03-18T14:41:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.178+0000 7f2f9d305700 1 -- 172.21.15.57:0/1068108804 wait complete. 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.179+0000 7f2f9d305700 1 Processor -- start 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.179+0000 7f2f9d305700 1 -- start start 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2f98135f10 0x7f2f98097520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980971c0 con 0x7f2f9809b990 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f981386b0 con 0x7f2f98139c00 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98138850 con 0x7f2f98135f10 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55842/0 (socket says 172.21.15.57:55842) 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1495796107 learned_addr learned my addr 172.21.15.57:0/1495796107 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f977fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59344/0 (socket says 172.21.15.57:59344) 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f967fc700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2f98135f10 0x7f2f98097520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2f98135f10 msgr2=0x7f2f98097520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2f98135f10 0x7f2f98097520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 msgr2=0x7f2f98145c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 -- 172.21.15.57:0/1495796107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8800b180 con 0x7f2f9809b990 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f977fe700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f96ffd700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f8c002f70 tx=0x7f2f8c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c00dea0 con 0x7f2f9809b990 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8c013de0 con 0x7f2f9809b990 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f8c01e5f0 con 0x7f2f9809b990 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.180+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c00b180 con 0x7f2f9809b990 2024-03-18T14:41:05.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.181+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f98097e20 con 0x7f2f9809b990 2024-03-18T14:41:05.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.181+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2f8c025030 con 0x7f2f9809b990 2024-03-18T14:41:05.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.181+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f2f8c04b180 con 0x7f2f9809b990 2024-03-18T14:41:05.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.182+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f98099890 con 0x7f2f9809b990 2024-03-18T14:41:05.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.185+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2f8c006010 con 0x7f2f9809b990 2024-03-18T14:41:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.302+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f98057a60 con 0x7f2f9809b990 2024-03-18T14:41:05.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.303+0000 7f2f87fff700 1 -- 172.21.15.57:0/1495796107 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f8c0288b0 con 0x7f2f9809b990 2024-03-18T14:41:05.304 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 >> v1:172.21.15.57:6816/39496 conn(0x7f2f74038ec0 legacy=0x7f2f7403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 msgr2=0x7f2f98098570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2f8c002f70 tx=0x7f2f8c014000).stop 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 shutdown_connections 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2f98139c00 0x7f2f98145c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f9809b990 0x7f2f98098570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 --2- 172.21.15.57:0/1495796107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2f98135f10 0x7f2f98097520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 >> 172.21.15.57:0/1495796107 conn(0x7f2f9805cee0 msgr2=0x7f2f98137c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 shutdown_connections 2024-03-18T14:41:05.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.304+0000 7f2f9d305700 1 -- 172.21.15.57:0/1495796107 wait complete. 2024-03-18T14:41:05.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:05.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.420+0000 7ffb3ec36700 1 Processor -- start 2024-03-18T14:41:05.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.420+0000 7ffb3ec36700 1 -- start start 2024-03-18T14:41:05.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3ec36700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3ec36700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 0x7ffb381409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3ec36700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb380603c0 con 0x7ffb380aae90 2024-03-18T14:41:05.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3ec36700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb381338e0 con 0x7ffb38132df0 2024-03-18T14:41:05.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3ec36700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb380aa230 con 0x7ffb3813e600 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59360/0 (socket says 172.21.15.57:59360) 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 -- 172.21.15.57:0/1878436687 learned_addr learned my addr 172.21.15.57:0/1878436687 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3d1d3700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 0x7ffb381409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb377fe700 1 -- 172.21.15.57:0/1878436687 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399224969 0 0) 0x7ffb380603c0 con 0x7ffb380aae90 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 -- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 msgr2=0x7ffb381409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 0x7ffb381409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 -- 172.21.15.57:0/1878436687 >> v1:172.21.15.57:6789/0 conn(0x7ffb380aae90 legacy=0x7ffb381331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 -- 172.21.15.57:0/1878436687 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380aa4d0 con 0x7ffb38132df0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3d1d3700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 0x7ffb381409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.421+0000 7ffb3c9d2700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ffb2c002f70 tx=0x7ffb2c006eb0).ready entity=mon.1 client_cookie=ecb07da9bb55d46a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb377fe700 1 -- 172.21.15.57:0/1878436687 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2c00d570 con 0x7ffb38132df0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb377fe700 1 -- 172.21.15.57:0/1878436687 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c000e90 con 0x7ffb38132df0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb377fe700 1 -- 172.21.15.57:0/1878436687 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb2c00d8c0 con 0x7ffb38132df0 2024-03-18T14:41:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 msgr2=0x7ffb38060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7ffb2c002f70 tx=0x7ffb2c006eb0).stop 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1878436687 shutdown_connections 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb3813e600 0x7ffb381409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1878436687 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb38132df0 0x7ffb38060dc0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1878436687 >> 172.21.15.57:0/1878436687 conn(0x7ffb3805c300 msgr2=0x7ffb3806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1878436687 shutdown_connections 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.422+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1878436687 wait complete. 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.423+0000 7ffb3ec36700 1 Processor -- start 2024-03-18T14:41:05.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.423+0000 7ffb3ec36700 1 -- start start 2024-03-18T14:41:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 0x7ffb38139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 0x7ffb38131da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38138650 con 0x7ffb380aae90 2024-03-18T14:41:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38138200 con 0x7ffb3813e600 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3ec36700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb38063260 con 0x7ffb38132df0 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3c9d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 0x7ffb38131da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3c9d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55852/0 (socket says 172.21.15.57:55852) 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3c9d2700 1 -- 172.21.15.57:0/1272158883 learned_addr learned my addr 172.21.15.57:0/1272158883 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb37fff700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 0x7ffb38139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 -- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 msgr2=0x7ffb38139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 0x7ffb38139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 -- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 msgr2=0x7ffb38138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3d1d3700 1 -- 172.21.15.57:0/1272158883 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30009470 con 0x7ffb3813e600 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb3c9d2700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.424+0000 7ffb37fff700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 0x7ffb38139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb3d1d3700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 0x7ffb38131da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ffb38138790 tx=0x7ffb300091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb3000c6a0 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000c800 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c00b1e0 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb3000cb60 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.425+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb380638b0 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.426+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ffb30022070 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.426+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38139ba0 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.426+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7ffb3004ac90 con 0x7ffb3813e600 2024-03-18T14:41:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.429+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ffb38139ba0 con 0x7ffb3813e600 2024-03-18T14:41:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.581+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb38139ba0 con 0x7ffb3813e600 2024-03-18T14:41:05.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.581+0000 7ffb35ffb700 1 -- 172.21.15.57:0/1272158883 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+792 (secure 0 0 0) 0x7ffb38139ba0 con 0x7ffb3813e600 2024-03-18T14:41:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:05.583 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-03-18T14:41:05.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 >> v1:172.21.15.57:6816/39496 conn(0x7ffb18038ec0 legacy=0x7ffb1803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 msgr2=0x7ffb38131da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 0x7ffb38131da0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ffb38138790 tx=0x7ffb300091d0).stop 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 shutdown_connections 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffb3813e600 0x7ffb38131da0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb380aae90 0x7ffb38138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 --2- 172.21.15.57:0/1272158883 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffb38132df0 0x7ffb38139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 >> 172.21.15.57:0/1272158883 conn(0x7ffb3805c300 msgr2=0x7ffb38067c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 shutdown_connections 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:05.583+0000 7ffb3ec36700 1 -- 172.21.15.57:0/1272158883 wait complete. 2024-03-18T14:41:05.585 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-03-18T14:41:07.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:07.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.714+0000 7f9c9c8b5700 1 Processor -- start 2024-03-18T14:41:07.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.714+0000 7f9c9c8b5700 1 -- start start 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9c8b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c980a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9c8b5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 0x7f9c980a0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9c8b5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980a1f10 con 0x7f9c9809f5d0 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9c8b5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980a0f60 con 0x7f9c980a04e0 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9c8b5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980a1200 con 0x7f9c9805dfb0 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c96d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 0x7f9c980a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c980a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c96d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 0x7f9c980a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55858/0 (socket says 172.21.15.57:55858) 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c96d9d700 1 -- 172.21.15.57:0/1756010325 learned_addr learned my addr 172.21.15.57:0/1756010325 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c95d9b700 1 --1- 172.21.15.57:0/1756010325 >> v1:172.21.15.57:6789/0 conn(0x7f9c9809f5d0 0x7f9c9809fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37962/0 (socket says 172.21.15.57:37962) 2024-03-18T14:41:07.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 -- 172.21.15.57:0/1756010325 >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 msgr2=0x7f9c980a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 --2- 172.21.15.57:0/1756010325 >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 0x7f9c980a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 -- 172.21.15.57:0/1756010325 >> v1:172.21.15.57:6789/0 conn(0x7f9c9809f5d0 legacy=0x7f9c9809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 -- 172.21.15.57:0/1756010325 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98060520 con 0x7f9c9805dfb0 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9659c700 1 --2- 172.21.15.57:0/1756010325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c980a2780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9c8c002f70 tx=0x7f9c8c006df0).ready entity=mon.1 client_cookie=4784a4058c478a0c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.715+0000 7f9c9559a700 1 -- 172.21.15.57:0/1756010325 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c00d570 con 0x7f9c9805dfb0 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9559a700 1 -- 172.21.15.57:0/1756010325 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c000e90 con 0x7f9c9805dfb0 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9559a700 1 -- 172.21.15.57:0/1756010325 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c00d8c0 con 0x7f9c9805dfb0 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/1756010325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 msgr2=0x7f9c980a2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/1756010325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c980a2780 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9c8c002f70 tx=0x7f9c8c006df0).stop 2024-03-18T14:41:07.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/1756010325 shutdown_connections 2024-03-18T14:41:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/1756010325 >> v2:172.21.15.57:3300/0 conn(0x7f9c980a04e0 0x7f9c980a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/1756010325 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c980a2780 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/1756010325 >> 172.21.15.57:0/1756010325 conn(0x7f9c980a93f0 msgr2=0x7f9c980a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/1756010325 shutdown_connections 2024-03-18T14:41:07.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.716+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/1756010325 wait complete. 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.717+0000 7f9c9c8b5700 1 Processor -- start 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.717+0000 7f9c9c8b5700 1 -- start start 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c980a04e0 0x7f9c98144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:07.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98141b30 con 0x7f9c9809f5d0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980974a0 con 0x7f9c9805dfb0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9c8b5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98098870 con 0x7f9c980a04e0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c95d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59376/0 (socket says 172.21.15.57:59376) 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c95d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55860/0 (socket says 172.21.15.57:55860) 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 -- 172.21.15.57:0/3481937289 learned_addr learned my addr 172.21.15.57:0/3481937289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c96d9d700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c980a04e0 0x7f9c98144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 -- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c980a04e0 msgr2=0x7f9c98144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c980a04e0 0x7f9c98144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 -- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 msgr2=0x7f9c98096fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 -- 172.21.15.57:0/3481937289 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c00b180 con 0x7f9c9805dfb0 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c95d9b700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:07.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c9659c700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9c8c002f70 tx=0x7f9c8c014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c013de0 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.718+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c01e400 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.719+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c8c01e760 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.719+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c98143de0 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.719+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980a3670 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.719+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9c8c025030 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.720+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f9c8c04b400 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.720+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98097e80 con 0x7f9c9805dfb0 2024-03-18T14:41:07.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.723+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9c8c001f00 con 0x7f9c9805dfb0 2024-03-18T14:41:07.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.870+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c980a3890 con 0x7f9c9805dfb0 2024-03-18T14:41:07.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.871+0000 7f9c877fe700 1 -- 172.21.15.57:0/3481937289 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+792 (secure 0 0 0) 0x7f9c8c01e8c0 con 0x7f9c9805dfb0 2024-03-18T14:41:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:07.873 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-03-18T14:41:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 >> v1:172.21.15.57:6816/39496 conn(0x7f9c74038ec0 legacy=0x7f9c7403b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 msgr2=0x7f9c98098230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9c8c002f70 tx=0x7f9c8c014000).stop 2024-03-18T14:41:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 shutdown_connections 2024-03-18T14:41:07.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c980a04e0 0x7f9c98144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c9805dfb0 0x7f9c98098230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 --2- 172.21.15.57:0/3481937289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c9809f5d0 0x7f9c98096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 >> 172.21.15.57:0/3481937289 conn(0x7f9c980a93f0 msgr2=0x7f9c980a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 shutdown_connections 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:07.872+0000 7f9c9c8b5700 1 -- 172.21.15.57:0/3481937289 wait complete. 2024-03-18T14:41:07.875 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 2 2024-03-18T14:41:09.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 Processor -- start 2024-03-18T14:41:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 -- start start 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33f0064700 0x7f33f0136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f009b2a0 con 0x7f33f009adf0 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f009bc50 con 0x7f33f0064700 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.004+0000 7f33f6ddb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01367e0 con 0x7f33f009aa10 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33f4b77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33f4b77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59380/0 (socket says 172.21.15.57:59380) 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33f4b77700 1 -- 172.21.15.57:0/1997422387 learned_addr learned my addr 172.21.15.57:0/1997422387 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 --2- 172.21.15.57:0/1997422387 >> v2:172.21.15.57:3300/0 conn(0x7f33f0064700 0x7f33f0136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 -- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 msgr2=0x7f33f00621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 -- 172.21.15.57:0/1997422387 >> v1:172.21.15.57:6789/0 conn(0x7f33f009adf0 legacy=0x7f33f0132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 -- 172.21.15.57:0/1997422387 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0136aa0 con 0x7f33f0064700 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33ef7fe700 1 -- 172.21.15.57:0/1997422387 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661047332 0 0) 0x7f33e8001490 con 0x7f33f009adf0 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33f4b77700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33effff700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f0064700 0x7f33f0136140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33dc002f70 tx=0x7f33dc006d90).ready entity=mon.0 client_cookie=2254655d1c448a65 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33ef7fe700 1 -- 172.21.15.57:0/1997422387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33dc00d4a0 con 0x7f33f0064700 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33ef7fe700 1 -- 172.21.15.57:0/1997422387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc000e90 con 0x7f33f0064700 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.005+0000 7f33ef7fe700 1 -- 172.21.15.57:0/1997422387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33dc00d7f0 con 0x7f33f0064700 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f0064700 msgr2=0x7f33f0136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f0064700 0x7f33f0136140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f33dc002f70 tx=0x7f33dc006d90).stop 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1997422387 shutdown_connections 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f009aa10 0x7f33f00621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1997422387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f0064700 0x7f33f0136140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1997422387 >> 172.21.15.57:0/1997422387 conn(0x7f33f006c0c0 msgr2=0x7f33f006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1997422387 shutdown_connections 2024-03-18T14:41:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.006+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1997422387 wait complete. 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.007+0000 7f33f6ddb700 1 Processor -- start 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.007+0000 7f33f6ddb700 1 -- start start 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33f009aa10 0x7f33f01328f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 0x7f33f0132de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00652a0 con 0x7f33f009adf0 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0065540 con 0x7f33f0064700 2024-03-18T14:41:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f00a71d0 con 0x7f33f009aa10 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f5378700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 0x7f33f0132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59390/0 (socket says 172.21.15.57:59390) 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 -- 172.21.15.57:0/1621512107 learned_addr learned my addr 172.21.15.57:0/1621512107 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33effff700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33f009aa10 0x7f33f01328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 -- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33f009aa10 msgr2=0x7f33f01328f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33f009aa10 0x7f33f01328f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 -- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 msgr2=0x7f33f0132de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 0x7f33f0132de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 -- 172.21.15.57:0/1621512107 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e400b1e0 con 0x7f33f0064700 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f5378700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 0x7f33f0132de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f4b77700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33e400c000 tx=0x7f33e4006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e4012600 con 0x7f33f0064700 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4012760 con 0x7f33f0064700 2024-03-18T14:41:10.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33e4012ac0 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.008+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc00b120 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.009+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f012abf0 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.009+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f33e4022070 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.009+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f00a8fe0 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.010+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f33e404a990 con 0x7f33f0064700 2024-03-18T14:41:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.013+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f33f00a8fe0 con 0x7f33f0064700 2024-03-18T14:41:10.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.165+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33f00a8fe0 con 0x7f33f0064700 2024-03-18T14:41:10.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.166+0000 7f33edffb700 1 -- 172.21.15.57:0/1621512107 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1376 (secure 0 0 0) 0x7f33f00a8fe0 con 0x7f33f0064700 2024-03-18T14:41:10.167 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:10.167 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4193,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[]} 2024-03-18T14:41:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 >> v1:172.21.15.57:6816/39496 conn(0x7f33d0038e30 legacy=0x7f33d003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 msgr2=0x7f33f012a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f33e400c000 tx=0x7f33e4006eb0).stop 2024-03-18T14:41:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 shutdown_connections 2024-03-18T14:41:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33f009adf0 0x7f33f0132de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33f0064700 0x7f33f012a700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 --2- 172.21.15.57:0/1621512107 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33f009aa10 0x7f33f01328f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 >> 172.21.15.57:0/1621512107 conn(0x7f33f006c0c0 msgr2=0x7f33f005b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 shutdown_connections 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.167+0000 7f33f6ddb700 1 -- 172.21.15.57:0/1621512107 wait complete. 2024-03-18T14:41:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2024-03-18T14:41:10.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:10.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.283+0000 7fa8844c0700 1 Processor -- start 2024-03-18T14:41:10.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.283+0000 7fa8844c0700 1 -- start start 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa87c09b520 0x7fa87c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c09a380 con 0x7fa87c09b520 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c135fe0 con 0x7fa87c1366f0 2024-03-18T14:41:10.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa8844c0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c099eb0 con 0x7fa87c099a00 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa88225c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa882a5d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa88225c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59398/0 (socket says 172.21.15.57:59398) 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa88225c700 1 -- 172.21.15.57:0/1108371691 learned_addr learned my addr 172.21.15.57:0/1108371691 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa882a5d700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37848/0 (socket says 172.21.15.57:37848) 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.284+0000 7fa881a5b700 1 --2- 172.21.15.57:0/1108371691 >> v2:172.21.15.57:3300/0 conn(0x7fa87c09b520 0x7fa87c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 -- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 msgr2=0x7fa87c09bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 -- 172.21.15.57:0/1108371691 >> v2:172.21.15.57:3300/0 conn(0x7fa87c09b520 msgr2=0x7fa87c136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 --2- 172.21.15.57:0/1108371691 >> v2:172.21.15.57:3300/0 conn(0x7fa87c09b520 0x7fa87c136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 -- 172.21.15.57:0/1108371691 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c09a0c0 con 0x7fa87c099a00 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa88225c700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa882a5d700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa8740032f0 tx=0x7fa8740091d0).ready entity=mon.2 client_cookie=d3f7edb52475a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa88125a700 1 -- 172.21.15.57:0/1108371691 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87400b600 con 0x7fa87c099a00 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa88125a700 1 -- 172.21.15.57:0/1108371691 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87400b760 con 0x7fa87c099a00 2024-03-18T14:41:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa88125a700 1 -- 172.21.15.57:0/1108371691 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87400b8d0 con 0x7fa87c099a00 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa8844c0700 1 -- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 msgr2=0x7fa87c139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.285+0000 7fa8844c0700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fa8740032f0 tx=0x7fa8740091d0).stop 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 -- 172.21.15.57:0/1108371691 shutdown_connections 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c099a00 0x7fa87c139530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 --2- 172.21.15.57:0/1108371691 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c1366f0 0x7fa87c09bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 --2- 172.21.15.57:0/1108371691 >> v2:172.21.15.57:3300/0 conn(0x7fa87c09b520 0x7fa87c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 -- 172.21.15.57:0/1108371691 >> 172.21.15.57:0/1108371691 conn(0x7fa87c06c0c0 msgr2=0x7fa87c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 -- 172.21.15.57:0/1108371691 shutdown_connections 2024-03-18T14:41:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 -- 172.21.15.57:0/1108371691 wait complete. 2024-03-18T14:41:10.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 Processor -- start 2024-03-18T14:41:10.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.286+0000 7fa8844c0700 1 -- start start 2024-03-18T14:41:10.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c09b520 0x7fa87c148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 0x7fa87c149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0950c0 con 0x7fa87c1366f0 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c093760 con 0x7fa87c099a00 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa8844c0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c093a00 con 0x7fa87c09b520 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59412/0 (socket says 172.21.15.57:59412) 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 -- 172.21.15.57:0/812286274 learned_addr learned my addr 172.21.15.57:0/812286274 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa882a5d700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 0x7fa87c149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa881a5b700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c09b520 0x7fa87c148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 -- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c09b520 msgr2=0x7fa87c148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c09b520 0x7fa87c148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 -- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 msgr2=0x7fa87c149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 0x7fa87c149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa88225c700 1 -- 172.21.15.57:0/812286274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87800b1e0 con 0x7fa87c099a00 2024-03-18T14:41:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.287+0000 7fa882a5d700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 0x7fa87c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa88225c700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa87800c000 tx=0x7fa878006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87800b420 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa874009470 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c09bcd0 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa878012600 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.288+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8780129a0 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.289+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa878022070 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.289+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fa87804a9f0 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.289+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c067cb0 con 0x7fa87c099a00 2024-03-18T14:41:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.292+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa8780335d0 con 0x7fa87c099a00 2024-03-18T14:41:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.410+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87c057a60 con 0x7fa87c099a00 2024-03-18T14:41:10.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.410+0000 7fa86f7fe700 1 -- 172.21.15.57:0/812286274 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7609 (secure 0 0 0) 0x7fa8780331c0 con 0x7fa87c099a00 2024-03-18T14:41:10.412 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:10.412 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:05.534777+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 >> v1:172.21.15.57:6816/39496 conn(0x7fa85c038da0 legacy=0x7fa85c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 msgr2=0x7fa87c0959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fa87800c000 tx=0x7fa878006eb0).stop 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 shutdown_connections 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa87c1366f0 0x7fa87c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa87c099a00 0x7fa87c0959c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 --2- 172.21.15.57:0/812286274 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa87c09b520 0x7fa87c148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 >> 172.21.15.57:0/812286274 conn(0x7fa87c06c0c0 msgr2=0x7fa87c135120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 shutdown_connections 2024-03-18T14:41:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.412+0000 7fa8844c0700 1 -- 172.21.15.57:0/812286274 wait complete. 2024-03-18T14:41:10.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-03-18T14:41:10.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-18T14:41:10.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.532+0000 7f03d1489700 1 Processor -- start 2024-03-18T14:41:10.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.532+0000 7f03d1489700 1 -- start start 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03d1489700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 0x7f03cc137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03d1489700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03cc0650c0 0x7f03cc0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03d1489700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc063a70 con 0x7f03cc063590 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03d1489700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03cc0649c0 con 0x7f03cc0650c0 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03d1489700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc064bc0 con 0x7f03cc137860 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03ca7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f03cc0650c0 0x7f03cc0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03cb7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f03cc063590 0x7f03cc0a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37980/0 (socket says 172.21.15.57:37980) 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03cb7fe700 1 -- 172.21.15.57:0/2069632875 learned_addr learned my addr 172.21.15.57:0/2069632875 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:10.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03caffd700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 0x7f03cc137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03c9ffb700 1 -- 172.21.15.57:0/2069632875 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011610020 0 0) 0x7f03cc063a70 con 0x7f03cc063590 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03c9ffb700 1 -- 172.21.15.57:0/2069632875 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b0003260 con 0x7f03cc063590 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03ca7fc700 1 -- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 msgr2=0x7f03cc137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03ca7fc700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 0x7f03cc137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03ca7fc700 1 -- 172.21.15.57:0/2069632875 >> v1:172.21.15.57:6789/0 conn(0x7f03cc063590 legacy=0x7f03cc0a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03ca7fc700 1 -- 172.21.15.57:0/2069632875 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc0ab0d0 con 0x7f03cc0650c0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.533+0000 7f03caffd700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 0x7f03cc137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03ca7fc700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc0650c0 0x7f03cc0630a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f03bc002f70 tx=0x7f03bc006df0).ready entity=mon.0 client_cookie=60f7048deebd651b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03c9ffb700 1 -- 172.21.15.57:0/2069632875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc00d4a0 con 0x7f03cc0650c0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03c9ffb700 1 -- 172.21.15.57:0/2069632875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc000e90 con 0x7f03cc0650c0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03c9ffb700 1 -- 172.21.15.57:0/2069632875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc00d7f0 con 0x7f03cc0650c0 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 -- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc0650c0 msgr2=0x7f03cc0630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc0650c0 0x7f03cc0630a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f03bc002f70 tx=0x7f03bc006df0).stop 2024-03-18T14:41:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 -- 172.21.15.57:0/2069632875 shutdown_connections 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc137860 0x7f03cc137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 --2- 172.21.15.57:0/2069632875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc0650c0 0x7f03cc0630a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 -- 172.21.15.57:0/2069632875 >> 172.21.15.57:0/2069632875 conn(0x7f03cc05c300 msgr2=0x7f03cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 -- 172.21.15.57:0/2069632875 shutdown_connections 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.534+0000 7f03d1489700 1 -- 172.21.15.57:0/2069632875 wait complete. 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.535+0000 7f03d1489700 1 Processor -- start 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.535+0000 7f03d1489700 1 -- start start 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc063590 0x7f03cc093ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 0x7f03cc146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc094190 con 0x7f03cc063590 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0943d0 con 0x7f03cc0650c0 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03d1489700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc094670 con 0x7f03cc137860 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03cb7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 0x7f03cc146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59440/0 (socket says 172.21.15.57:59440) 2024-03-18T14:41:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 -- 172.21.15.57:0/1731249781 learned_addr learned my addr 172.21.15.57:0/1731249781 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03caffd700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc063590 0x7f03cc093ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 -- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 msgr2=0x7f03cc146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 0x7f03cc146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 -- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc063590 msgr2=0x7f03cc093ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc063590 0x7f03cc093ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 -- 172.21.15.57:0/1731249781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c000b180 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03cb7fe700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 0x7f03cc146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03ca7fc700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f03bc002f70 tx=0x7f03bc014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.536+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc016070 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.537+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc0137d0 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.537+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03bc00b180 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.537+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03bc013b30 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.537+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc096370 con 0x7f03cc0650c0 2024-03-18T14:41:10.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.537+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f03bc025030 con 0x7f03cc0650c0 2024-03-18T14:41:10.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.538+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f03bc04b370 con 0x7f03cc0650c0 2024-03-18T14:41:10.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.538+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc137200 con 0x7f03cc0650c0 2024-03-18T14:41:10.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.541+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f03bc023030 con 0x7f03cc0650c0 2024-03-18T14:41:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.656+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f03cc057a60 con 0x7f03cc0650c0 2024-03-18T14:41:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.657+0000 7f03bbfff700 1 -- 172.21.15.57:0/1731249781 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f03bc028610 con 0x7f03cc0650c0 2024-03-18T14:41:10.658 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 >> v1:172.21.15.57:6816/39496 conn(0x7f03a8038dd0 legacy=0x7f03a803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 msgr2=0x7f03cc146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f03bc002f70 tx=0x7f03bc014000).stop 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 shutdown_connections 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f03cc137860 0x7f03cc146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f03cc063590 0x7f03cc093ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 --2- 172.21.15.57:0/1731249781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f03cc0650c0 0x7f03cc146570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 >> 172.21.15.57:0/1731249781 conn(0x7f03cc05c300 msgr2=0x7f03cc067d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 shutdown_connections 2024-03-18T14:41:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.658+0000 7f03d1489700 1 -- 172.21.15.57:0/1731249781 wait complete. 2024-03-18T14:41:10.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:41:10.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.777+0000 7f360e17c700 1 Processor -- start 2024-03-18T14:41:10.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 -- start start 2024-03-18T14:41:10.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36080650c0 0x7f36080630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3608063a70 con 0x7f3608063590 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36080649c0 con 0x7f36080650c0 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f360e17c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608064bc0 con 0x7f3608137860 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f3606ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36080650c0 0x7f36080630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f36077fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f3606ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f36080650c0 0x7f36080630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55934/0 (socket says 172.21.15.57:55934) 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f36077fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59446/0 (socket says 172.21.15.57:59446) 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f3607fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3608063590 0x7f36080a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37982/0 (socket says 172.21.15.57:37982) 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.778+0000 7f3606ffd700 1 -- 172.21.15.57:0/3975517021 learned_addr learned my addr 172.21.15.57:0/3975517021 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f3606ffd700 1 -- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 msgr2=0x7f3608137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f3606ffd700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f3606ffd700 1 -- 172.21.15.57:0/3975517021 >> v1:172.21.15.57:6789/0 conn(0x7f3608063590 legacy=0x7f36080a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f3606ffd700 1 -- 172.21.15.57:0/3975517021 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36080ab0d0 con 0x7f36080650c0 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f36067fc700 1 -- 172.21.15.57:0/3975517021 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60954193 0 0) 0x7f3608063a70 con 0x7f3608063590 2024-03-18T14:41:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f36077fe700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f3606ffd700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080650c0 0x7f36080630a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f35fc002f70 tx=0x7f35fc006eb0).ready entity=mon.0 client_cookie=8f511fe570c80764 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f36067fc700 1 -- 172.21.15.57:0/3975517021 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc00d570 con 0x7f36080650c0 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f36067fc700 1 -- 172.21.15.57:0/3975517021 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc000e90 con 0x7f36080650c0 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f36067fc700 1 -- 172.21.15.57:0/3975517021 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35fc00d8c0 con 0x7f36080650c0 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 -- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080650c0 msgr2=0x7f36080630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080650c0 0x7f36080630a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f35fc002f70 tx=0x7f35fc006eb0).stop 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 -- 172.21.15.57:0/3975517021 shutdown_connections 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3608137860 0x7f3608137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 --2- 172.21.15.57:0/3975517021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f36080650c0 0x7f36080630a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.779+0000 7f360e17c700 1 -- 172.21.15.57:0/3975517021 >> 172.21.15.57:0/3975517021 conn(0x7f360805c300 msgr2=0x7f360806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.780+0000 7f360e17c700 1 -- 172.21.15.57:0/3975517021 shutdown_connections 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.780+0000 7f360e17c700 1 -- 172.21.15.57:0/3975517021 wait complete. 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.780+0000 7f360e17c700 1 Processor -- start 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 -- start start 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 0x7f3608146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360809c5b0 con 0x7f3608137860 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3608094c50 con 0x7f36080650c0 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f360e17c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36080920d0 con 0x7f3608063590 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f3607fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f36077fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f3607fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55938/0 (socket says 172.21.15.57:55938) 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f3607fff700 1 -- 172.21.15.57:0/1073099944 learned_addr learned my addr 172.21.15.57:0/1073099944 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:10.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f36077fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37860/0 (socket says 172.21.15.57:37860) 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.781+0000 7f3606ffd700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 0x7f3608146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 -- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 msgr2=0x7f3608094280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 -- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 msgr2=0x7f3608146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 0x7f3608146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 -- 172.21.15.57:0/1073099944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f800b180 con 0x7f3608137860 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f36077fe700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3606ffd700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 0x7f3608146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3607fff700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3600001250 tx=0x7f3600007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3600005ae0 con 0x7f3608137860 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3600005c40 con 0x7f3608137860 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc00b1e0 con 0x7f3608137860 2024-03-18T14:41:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36000070d0 con 0x7f3608137860 2024-03-18T14:41:10.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.782+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3608099db0 con 0x7f3608137860 2024-03-18T14:41:10.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.783+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3600010070 con 0x7f3608137860 2024-03-18T14:41:10.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.783+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3608137200 con 0x7f3608137860 2024-03-18T14:41:10.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.783+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f3600049f00 con 0x7f3608137860 2024-03-18T14:41:10.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.786+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f360002f150 con 0x7f3608137860 2024-03-18T14:41:10.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.904+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3608057a60 con 0x7f3608137860 2024-03-18T14:41:10.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.904+0000 7f3604ff9700 1 -- 172.21.15.57:0/1073099944 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3600032770 con 0x7f3608137860 2024-03-18T14:41:10.906 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:41:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 >> v1:172.21.15.57:6816/39496 conn(0x7f35e8038da0 legacy=0x7f35e803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 msgr2=0x7f3608146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:10.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f3600001250 tx=0x7f3600007d80).stop 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 shutdown_connections 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3608137860 0x7f3608146b10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3608063590 0x7f3608094280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 --2- 172.21.15.57:0/1073099944 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f36080650c0 0x7f3608146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 >> 172.21.15.57:0/1073099944 conn(0x7f360805c300 msgr2=0x7f36081365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 shutdown_connections 2024-03-18T14:41:10.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:10.905+0000 7f360e17c700 1 -- 172.21.15.57:0/1073099944 wait complete. 2024-03-18T14:41:10.917 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T14:41:11.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.022+0000 7ff5f078f700 1 Processor -- start 2024-03-18T14:41:11.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.022+0000 7ff5f078f700 1 -- start start 2024-03-18T14:41:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5f078f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5f078f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 0x7ff5e81331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5f078f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e80603c0 con 0x7ff5e80674b0 2024-03-18T14:41:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5f078f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e80aa230 con 0x7ff5e80aae90 2024-03-18T14:41:11.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5f078f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80aa4d0 con 0x7ff5e8132df0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5edd2a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 0x7ff5e81331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37862/0 (socket says 172.21.15.57:37862) 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5eed2c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff5e80674b0 0x7ff5e8067920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37994/0 (socket says 172.21.15.57:37994) 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 -- 172.21.15.57:0/931945557 learned_addr learned my addr 172.21.15.57:0/931945557 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 -- 172.21.15.57:0/931945557 >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 msgr2=0x7ff5e81331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 --2- 172.21.15.57:0/931945557 >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 0x7ff5e81331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 -- 172.21.15.57:0/931945557 >> v1:172.21.15.57:6789/0 conn(0x7ff5e80674b0 legacy=0x7ff5e8067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 -- 172.21.15.57:0/931945557 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e80aa790 con 0x7ff5e8132df0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ed529700 1 -- 172.21.15.57:0/931945557 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583667310 0 0) 0x7ff5e80603c0 con 0x7ff5e80674b0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5edd2a700 1 --2- 172.21.15.57:0/931945557 >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 0x7ff5e81331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.023+0000 7ff5ee52b700 1 --2- 172.21.15.57:0/931945557 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff5d8002f70 tx=0x7ff5d8006eb0).ready entity=mon.2 client_cookie=8eca9662f18744a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:11.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5ed529700 1 -- 172.21.15.57:0/931945557 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d800d570 con 0x7ff5e8132df0 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5ed529700 1 -- 172.21.15.57:0/931945557 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d8000e90 con 0x7ff5e8132df0 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5ed529700 1 -- 172.21.15.57:0/931945557 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d800d8c0 con 0x7ff5e8132df0 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 -- 172.21.15.57:0/931945557 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 msgr2=0x7ff5e8060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 --2- 172.21.15.57:0/931945557 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7ff5d8002f70 tx=0x7ff5d8006eb0).stop 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 -- 172.21.15.57:0/931945557 shutdown_connections 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 --2- 172.21.15.57:0/931945557 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e8132df0 0x7ff5e8060dc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 --2- 172.21.15.57:0/931945557 >> v2:172.21.15.57:3300/0 conn(0x7ff5e80aae90 0x7ff5e81331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 -- 172.21.15.57:0/931945557 >> 172.21.15.57:0/931945557 conn(0x7ff5e805c300 msgr2=0x7ff5e806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 -- 172.21.15.57:0/931945557 shutdown_connections 2024-03-18T14:41:11.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.024+0000 7ff5f078f700 1 -- 172.21.15.57:0/931945557 wait complete. 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.025+0000 7ff5f078f700 1 Processor -- start 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.025+0000 7ff5f078f700 1 -- start start 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 0x7ff5e81484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5e8132df0 0x7ff5e8148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8092f90 con 0x7ff5e80aae90 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8093180 con 0x7ff5e8132df0 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5f078f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e8136140 con 0x7ff5e80674b0 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5edd2a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 0x7ff5e81484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37864/0 (socket says 172.21.15.57:37864) 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 -- 172.21.15.57:0/663919237 learned_addr learned my addr 172.21.15.57:0/663919237 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5eed2c700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5e8132df0 0x7ff5e8148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 -- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5e8132df0 msgr2=0x7ff5e8148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5e8132df0 0x7ff5e8148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 -- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 msgr2=0x7ff5e81484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 0x7ff5e81484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5ee52b700 1 -- 172.21.15.57:0/663919237 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e400b180 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.026+0000 7ff5edd2a700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 0x7ff5e81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5ee52b700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff5e806cbe0 tx=0x7ff5d8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d80068b0 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800d8f0 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d800b1e0 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5d8011d30 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.027+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e8149280 con 0x7ff5e80674b0 2024-03-18T14:41:11.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.028+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff5d8025030 con 0x7ff5e80674b0 2024-03-18T14:41:11.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.028+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7ff5d804b7d0 con 0x7ff5e80674b0 2024-03-18T14:41:11.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.028+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e8148be0 con 0x7ff5e80674b0 2024-03-18T14:41:11.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.031+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff5d8023020 con 0x7ff5e80674b0 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.152+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff5e80a9a90 con 0x7ff5e80674b0 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.152+0000 7ff5d77fe700 1 -- 172.21.15.57:0/663919237 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v14) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff5d801eb90 con 0x7ff5e80674b0 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "device_health_metrics" 2024-03-18T14:41:11.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:41:11.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:41:11.155 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 2, 2024-03-18T14:41:11.155 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": "rbd" 2024-03-18T14:41:11.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:41:11.155 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 >> v1:172.21.15.57:6816/39496 conn(0x7ff5c8038da0 legacy=0x7ff5c803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 msgr2=0x7ff5e8094ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ff5e806cbe0 tx=0x7ff5d8015000).stop 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 shutdown_connections 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff5e8132df0 0x7ff5e8148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff5e80674b0 0x7ff5e8094ef0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 --2- 172.21.15.57:0/663919237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff5e80aae90 0x7ff5e81484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 >> 172.21.15.57:0/663919237 conn(0x7ff5e805c300 msgr2=0x7ff5e809bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 shutdown_connections 2024-03-18T14:41:11.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.154+0000 7ff5f078f700 1 -- 172.21.15.57:0/663919237 wait complete. 2024-03-18T14:41:11.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T14:41:11.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T14:41:11.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.274+0000 7f62cabf5700 1 Processor -- start 2024-03-18T14:41:11.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.274+0000 7f62cabf5700 1 -- start start 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c40a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62c409d540 0x7f62c40a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62c40a4190 con 0x7f62c409d540 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c405e550 con 0x7f62c405e170 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62cabf5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c40a5040 con 0x7f62c40a4ab0 2024-03-18T14:41:11.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c9192700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62c409d540 0x7f62c40a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c9192700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37872/0 (socket says 172.21.15.57:37872) 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c9192700 1 -- 172.21.15.57:0/3743241776 learned_addr learned my addr 172.21.15.57:0/3743241776 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c8991700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c40a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 -- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 msgr2=0x7f62c40a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 -- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 msgr2=0x7f62c40a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c40a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 -- 172.21.15.57:0/3743241776 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40a33a0 con 0x7f62c409d540 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c9192700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c8991700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c40a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.275+0000 7f62c3fff700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c40a1fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0006df0).ready entity=mon.0 client_cookie=b8168a19bf320389 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62c37fe700 1 -- 172.21.15.57:0/3743241776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b000d4a0 con 0x7f62c409d540 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62c37fe700 1 -- 172.21.15.57:0/3743241776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b0000e90 con 0x7f62c409d540 2024-03-18T14:41:11.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62c37fe700 1 -- 172.21.15.57:0/3743241776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b000d7f0 con 0x7f62c409d540 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 -- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 msgr2=0x7f62c40a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c40a1fe0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f62b0002f70 tx=0x7f62b0006df0).stop 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 -- 172.21.15.57:0/3743241776 shutdown_connections 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c40a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 --2- 172.21.15.57:0/3743241776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c40a1fe0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 -- 172.21.15.57:0/3743241776 >> 172.21.15.57:0/3743241776 conn(0x7f62c40a9450 msgr2=0x7f62c40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 -- 172.21.15.57:0/3743241776 shutdown_connections 2024-03-18T14:41:11.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.276+0000 7f62cabf5700 1 -- 172.21.15.57:0/3743241776 wait complete. 2024-03-18T14:41:11.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.277+0000 7f62cabf5700 1 Processor -- start 2024-03-18T14:41:11.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.277+0000 7f62cabf5700 1 -- start start 2024-03-18T14:41:11.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c4098080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40965f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4147c20 con 0x7f62c409d540 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4097730 con 0x7f62c405e170 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62cabf5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c4096330 con 0x7f62c40a4ab0 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55970/0 (socket says 172.21.15.57:55970) 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62c9192700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62c8991700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c4098080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.278+0000 7f62c3fff700 1 -- 172.21.15.57:0/2546844975 learned_addr learned my addr 172.21.15.57:0/2546844975 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 -- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 msgr2=0x7f62c40965f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40965f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 -- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 msgr2=0x7f62c4098080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:11.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c4098080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 -- 172.21.15.57:0/2546844975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b800b180 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c3fff700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62c40978c0 tx=0x7f62b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b0012860 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b00129c0 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62bc009530 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b0012d60 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.279+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b000b180 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.280+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c4147450 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.280+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f62b001c070 con 0x7f62c409d540 2024-03-18T14:41:11.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.281+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f62b004b760 con 0x7f62c409d540 2024-03-18T14:41:11.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.283+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f62b000e3f0 con 0x7f62c409d540 2024-03-18T14:41:11.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:11.399+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f62c4147450 con 0x7f62c409d540 2024-03-18T14:41:12.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.127+0000 7f62c1ffb700 1 -- 172.21.15.57:0/2546844975 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7f62c4147450 con 0x7f62c409d540 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.133+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 >> v1:172.21.15.57:6816/39496 conn(0x7f62a4038da0 legacy=0x7f62a403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.133+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 msgr2=0x7f62c4147730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.133+0000 7f62cabf5700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f62c40978c0 tx=0x7f62b0014000).stop 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 shutdown_connections 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c40a4ab0 0x7f62c40965f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c405e170 0x7f62c4098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 --2- 172.21.15.57:0/2546844975 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c409d540 0x7f62c4147730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 >> 172.21.15.57:0/2546844975 conn(0x7f62c40a9450 msgr2=0x7f62c405c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:12.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.134+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 shutdown_connections 2024-03-18T14:41:12.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.135+0000 7f62cabf5700 1 -- 172.21.15.57:0/2546844975 wait complete. 2024-03-18T14:41:12.140 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-03-18T14:41:12.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T14:41:12.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.267+0000 7f90ebbc0700 1 Processor -- start 2024-03-18T14:41:12.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.267+0000 7f90ebbc0700 1 -- start start 2024-03-18T14:41:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ebbc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ebbc0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:12.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ebbc0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e4136f40 con 0x7f90e409b520 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ebbc0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e409a380 con 0x7f90e4136ad0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ebbc0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4135fe0 con 0x7f90e41366f0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ea15d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37888/0 (socket says 172.21.15.57:37888) 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90ea15d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55976/0 (socket says 172.21.15.57:55976) 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 -- 172.21.15.57:0/660292794 learned_addr learned my addr 172.21.15.57:0/660292794 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e915b700 1 --1- 172.21.15.57:0/660292794 >> v1:172.21.15.57:6789/0 conn(0x7f90e409b520 0x7f90e4139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37996/0 (socket says 172.21.15.57:37996) 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 -- 172.21.15.57:0/660292794 >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 msgr2=0x7f90e4099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 --2- 172.21.15.57:0/660292794 >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.268+0000 7f90e995c700 1 -- 172.21.15.57:0/660292794 >> v1:172.21.15.57:6789/0 conn(0x7f90e409b520 legacy=0x7f90e4139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90e995c700 1 -- 172.21.15.57:0/660292794 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e409a0c0 con 0x7f90e41366f0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ea15d700 1 --2- 172.21.15.57:0/660292794 >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90e995c700 1 --2- 172.21.15.57:0/660292794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f90d4002f70 tx=0x7f90d4006eb0).ready entity=mon.2 client_cookie=31a59ab9180c1ab3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:12.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90e895a700 1 -- 172.21.15.57:0/660292794 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d400d570 con 0x7f90e41366f0 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90e895a700 1 -- 172.21.15.57:0/660292794 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d4000e90 con 0x7f90e41366f0 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90e895a700 1 -- 172.21.15.57:0/660292794 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d400d8c0 con 0x7f90e41366f0 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 -- 172.21.15.57:0/660292794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 msgr2=0x7f90e409bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/660292794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f90d4002f70 tx=0x7f90d4006eb0).stop 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 -- 172.21.15.57:0/660292794 shutdown_connections 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/660292794 >> v2:172.21.15.57:3300/0 conn(0x7f90e4136ad0 0x7f90e4099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/660292794 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e409bbb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 -- 172.21.15.57:0/660292794 >> 172.21.15.57:0/660292794 conn(0x7f90e406c0c0 msgr2=0x7f90e406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 -- 172.21.15.57:0/660292794 shutdown_connections 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.269+0000 7f90ebbc0700 1 -- 172.21.15.57:0/660292794 wait complete. 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.270+0000 7f90ebbc0700 1 Processor -- start 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 -- start start 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 0x7f90e41399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e4148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:12.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4136480 con 0x7f90e4136ad0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4093ae0 con 0x7f90e409b520 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ebbc0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90e4093da0 con 0x7f90e41366f0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ea15d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90e995c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 0x7f90e41399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90e915b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e4148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ea15d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55990/0 (socket says 172.21.15.57:55990) 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.271+0000 7f90ea15d700 1 -- 172.21.15.57:0/3907983810 learned_addr learned my addr 172.21.15.57:0/3907983810 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 -- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 msgr2=0x7f90e4148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e4148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 -- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 msgr2=0x7f90e41399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 0x7f90e41399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 -- 172.21.15.57:0/3907983810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc009470 con 0x7f90e4136ad0 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90e915b700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e4148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90e995c700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 0x7f90e41399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:12.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ea15d700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90dc00c000 tx=0x7f90dc0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90dc00ee60 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc00c850 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d400b1e0 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90dc00cbb0 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.272+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e4093240 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.273+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f90dc022070 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.273+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e4057a60 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.273+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3192+0+0 (secure 0 0 0) 0x7f90dc04ad90 con 0x7f90e4136ad0 2024-03-18T14:41:12.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.276+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f90dc033800 con 0x7f90e4136ad0 2024-03-18T14:41:12.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:12.394+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f90e4060880 con 0x7f90e4136ad0 2024-03-18T14:41:13.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.140+0000 7f90d2ffd700 1 -- 172.21.15.57:0/3907983810 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v16) v1 ==== 170+0+0 (secure 0 0 0) 0x7f90dc016020 con 0x7f90e4136ad0 2024-03-18T14:41:13.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.143+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 >> v1:172.21.15.57:6816/39496 conn(0x7f90c4038dd0 legacy=0x7f90c403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.143+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 msgr2=0x7f90e4149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.143+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f90dc00c000 tx=0x7f90dc0091d0).stop 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.145+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 shutdown_connections 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.145+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90e4136ad0 0x7f90e4149330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.145+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f90e409b520 0x7f90e41399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.145+0000 7f90ebbc0700 1 --2- 172.21.15.57:0/3907983810 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f90e41366f0 0x7f90e4148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.145+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 >> 172.21.15.57:0/3907983810 conn(0x7f90e406c0c0 msgr2=0x7f90e4131bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.146+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 shutdown_connections 2024-03-18T14:41:13.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.146+0000 7f90ebbc0700 1 -- 172.21.15.57:0/3907983810 wait complete. 2024-03-18T14:41:13.154 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-03-18T14:41:13.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T14:41:13.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 Processor -- start 2024-03-18T14:41:13.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 -- start start 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 0x7f337c13a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337c067990 con 0x7f337c067570 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c13a6f0 con 0x7f337c1337e0 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.290+0000 7f338226b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0a4c50 con 0x7f337c139d80 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59504/0 (socket says 172.21.15.57:59504) 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55994/0 (socket says 172.21.15.57:55994) 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f3380808700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 0x7f337c13a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 -- 172.21.15.57:0/3858065601 learned_addr learned my addr 172.21.15.57:0/3858065601 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 -- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 msgr2=0x7f337c13a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 0x7f337c13a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 -- 172.21.15.57:0/3858065601 >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 msgr2=0x7f337c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 --2- 172.21.15.57:0/3858065601 >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 -- 172.21.15.57:0/3858065601 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c0a4f10 con 0x7f337c1337e0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f3380808700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 0x7f337c13a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337b7fe700 1 --2- 172.21.15.57:0/3858065601 >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337bfff700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f336c002f70 tx=0x7f336c006eb0).ready entity=mon.1 client_cookie=b25c60dcd447db07 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337affd700 1 -- 172.21.15.57:0/3858065601 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336c00d570 con 0x7f337c1337e0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337affd700 1 -- 172.21.15.57:0/3858065601 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336c000e90 con 0x7f337c1337e0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.291+0000 7f337affd700 1 -- 172.21.15.57:0/3858065601 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f336c00d900 con 0x7f337c1337e0 2024-03-18T14:41:13.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 -- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 msgr2=0x7f337c133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f336c002f70 tx=0x7f336c006eb0).stop 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 -- 172.21.15.57:0/3858065601 shutdown_connections 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c139d80 0x7f337c13a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 --2- 172.21.15.57:0/3858065601 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c1337e0 0x7f337c133bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 --2- 172.21.15.57:0/3858065601 >> v2:172.21.15.57:3300/0 conn(0x7f337c067570 0x7f337c139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 -- 172.21.15.57:0/3858065601 >> 172.21.15.57:0/3858065601 conn(0x7f337c0a93f0 msgr2=0x7f337c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 -- 172.21.15.57:0/3858065601 shutdown_connections 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.292+0000 7f338226b700 1 -- 172.21.15.57:0/3858065601 wait complete. 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 Processor -- start 2024-03-18T14:41:13.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 -- start start 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c067570 0x7f337c09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 0x7f337c09ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c09d410 con 0x7f337c1337e0 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c092b70 con 0x7f337c139d80 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.293+0000 7f338226b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f337c09ea30 con 0x7f337c067570 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f3380808700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 0x7f337c09ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c067570 0x7f337c09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f3380808700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:59520/0 (socket says 172.21.15.57:59520) 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f3380808700 1 -- 172.21.15.57:0/1010945577 learned_addr learned my addr 172.21.15.57:0/1010945577 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 -- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c067570 msgr2=0x7f337c09c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c067570 0x7f337c09c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 -- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 msgr2=0x7f337c09cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 -- 172.21.15.57:0/1010945577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337000b180 con 0x7f337c1337e0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f3380808700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f337b7fe700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 0x7f337c09ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f337000c000 tx=0x7f3370006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3370010780 con 0x7f337c1337e0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33700108e0 con 0x7f337c1337e0 2024-03-18T14:41:13.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3374009470 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3370010c40 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.294+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c00b1e0 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.295+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f337001c460 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.295+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c09f8e0 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.295+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3574+0+0 (secure 0 0 0) 0x7f337004ac10 con 0x7f337c1337e0 2024-03-18T14:41:13.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.299+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f337c09f8e0 con 0x7f337c1337e0 2024-03-18T14:41:13.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.447+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f337c09f8e0 con 0x7f337c1337e0 2024-03-18T14:41:13.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.466+0000 7f33797fa700 1 -- 172.21.15.57:0/1010945577 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f337c09f8e0 con 0x7f337c1337e0 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 >> v1:172.21.15.57:6816/39496 conn(0x7f335c038da0 legacy=0x7f335c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 msgr2=0x7f337c09ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 0x7f337c09ca30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f337000c000 tx=0x7f3370006df0).stop 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 shutdown_connections 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f337c139d80 0x7f337c09cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f337c067570 0x7f337c09c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 --2- 172.21.15.57:0/1010945577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f337c1337e0 0x7f337c09ca30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 >> 172.21.15.57:0/1010945577 conn(0x7f337c0a93f0 msgr2=0x7f337c0a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 shutdown_connections 2024-03-18T14:41:13.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.468+0000 7f338226b700 1 -- 172.21.15.57:0/1010945577 wait complete. 2024-03-18T14:41:13.487 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 3 and data pool 4 2024-03-18T14:41:13.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:13.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 Processor -- start 2024-03-18T14:41:13.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 -- start start 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 0x7fe1c009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c009a380 con 0x7fe1c01366f0 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0135fe0 con 0x7fe1c0099a00 2024-03-18T14:41:13.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.615+0000 7fe1c675a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0099e90 con 0x7fe1c009b520 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1c4cf7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1c4cf7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46068/0 (socket says 172.21.15.57:46068) 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37548/0 (socket says 172.21.15.57:37548) 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1c4cf7700 1 -- 172.21.15.57:0/3808069541 learned_addr learned my addr 172.21.15.57:0/3808069541 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bffff700 1 --2- 172.21.15.57:0/3808069541 >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 0x7fe1c009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 -- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 msgr2=0x7fe1c0139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 -- 172.21.15.57:0/3808069541 >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 msgr2=0x7fe1c009bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 --2- 172.21.15.57:0/3808069541 >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 0x7fe1c009bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 -- 172.21.15.57:0/3808069541 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c009a0c0 con 0x7fe1c009b520 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1c4cf7700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bffff700 1 --2- 172.21.15.57:0/3808069541 >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 0x7fe1c009bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1bf7fe700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe1b4002f70 tx=0x7fe1b4006d90).ready entity=mon.2 client_cookie=e7a2bc643b7560a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1beffd700 1 -- 172.21.15.57:0/3808069541 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b400e540 con 0x7fe1c009b520 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1beffd700 1 -- 172.21.15.57:0/3808069541 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b4000e90 con 0x7fe1c009b520 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.616+0000 7fe1beffd700 1 -- 172.21.15.57:0/3808069541 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b400e890 con 0x7fe1c009b520 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 -- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 msgr2=0x7fe1c0136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe1b4002f70 tx=0x7fe1b4006d90).stop 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 -- 172.21.15.57:0/3808069541 shutdown_connections 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c0099a00 0x7fe1c0139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 --2- 172.21.15.57:0/3808069541 >> v2:172.21.15.57:3300/0 conn(0x7fe1c01366f0 0x7fe1c009bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 --2- 172.21.15.57:0/3808069541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c009b520 0x7fe1c0136ad0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 -- 172.21.15.57:0/3808069541 >> 172.21.15.57:0/3808069541 conn(0x7fe1c006c0c0 msgr2=0x7fe1c006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 -- 172.21.15.57:0/3808069541 shutdown_connections 2024-03-18T14:41:13.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.617+0000 7fe1c675a700 1 -- 172.21.15.57:0/3808069541 wait complete. 2024-03-18T14:41:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 Processor -- start 2024-03-18T14:41:13.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 -- start start 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 0x7fe1c00959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 0x7fe1c0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0094e80 con 0x7fe1c01366f0 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0096390 con 0x7fe1c009b520 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c675a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0093060 con 0x7fe1c0099a00 2024-03-18T14:41:13.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c4cf7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 0x7fe1c00959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 0x7fe1c0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c4cf7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40276/0 (socket says 172.21.15.57:40276) 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1c4cf7700 1 -- 172.21.15.57:0/4230240805 learned_addr learned my addr 172.21.15.57:0/4230240805 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.618+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 0x7fe1c0148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46084/0 (socket says 172.21.15.57:46084) 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 -- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 msgr2=0x7fe1c0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 0x7fe1c0148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 -- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 msgr2=0x7fe1c01491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 -- 172.21.15.57:0/4230240805 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009530 con 0x7fe1c0099a00 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1c4cf7700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bffff700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 0x7fe1c00959c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1b000c000 tx=0x7fe1b0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b0010780 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b00108e0 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b000b180 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1b0010c40 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.619+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b400b120 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.620+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe1b001c460 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.620+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0067cb0 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.620+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe1b004ac70 con 0x7fe1c0099a00 2024-03-18T14:41:13.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.623+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe1b00335a0 con 0x7fe1c0099a00 2024-03-18T14:41:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.739+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c0057a60 con 0x7fe1c0099a00 2024-03-18T14:41:13.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.740+0000 7fe1bd7fa700 1 -- 172.21.15.57:0/4230240805 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7fe1b0033190 con 0x7fe1c0099a00 2024-03-18T14:41:13.742 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:13.742 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:13.448103+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.741+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 >> v1:172.21.15.57:6816/39496 conn(0x7fe1a0038da0 legacy=0x7fe1a003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.741+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 msgr2=0x7fe1c00959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.741+0000 7fe1c675a700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 0x7fe1c00959c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fe1b000c000 tx=0x7fe1b0006df0).stop 2024-03-18T14:41:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 shutdown_connections 2024-03-18T14:41:13.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe1c01366f0 0x7fe1c01491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe1c0099a00 0x7fe1c00959c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 --2- 172.21.15.57:0/4230240805 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe1c009b520 0x7fe1c0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 >> 172.21.15.57:0/4230240805 conn(0x7fe1c006c0c0 msgr2=0x7fe1c01351d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 shutdown_connections 2024-03-18T14:41:13.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.742+0000 7fe1c675a700 1 -- 172.21.15.57:0/4230240805 wait complete. 2024-03-18T14:41:13.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:13.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.858+0000 7f3f466f0700 1 Processor -- start 2024-03-18T14:41:13.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.858+0000 7f3f466f0700 1 -- start start 2024-03-18T14:41:13.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f466f0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 0x7f3f400621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f466f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f4009adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f466f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4009bc50 con 0x7f3f4009aa10 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f466f0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4009b2e0 con 0x7f3f40064700 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f466f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401365d0 con 0x7f3f40136140 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 0x7f3f400621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f3ffff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3f4009aa10 0x7f3f40132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39508/0 (socket says 172.21.15.57:39508) 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f3ffff700 1 -- 172.21.15.57:0/2261796434 learned_addr learned my addr 172.21.15.57:0/2261796434 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f44c8d700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f4009adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f44c8d700 1 -- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 msgr2=0x7f3f400621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f44c8d700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 0x7f3f400621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f44c8d700 1 -- 172.21.15.57:0/2261796434 >> v1:172.21.15.57:6789/0 conn(0x7f3f4009aa10 legacy=0x7f3f40132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f3effd700 1 -- 172.21.15.57:0/2261796434 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595635636 0 0) 0x7f3f4009bc50 con 0x7f3f4009aa10 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f44c8d700 1 -- 172.21.15.57:0/2261796434 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f401367e0 con 0x7f3f40136140 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.859+0000 7f3f3f7fe700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 0x7f3f400621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f44c8d700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f4009adf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3f380032f0 tx=0x7f3f380091d0).ready entity=mon.2 client_cookie=91438c1e0e3c3b38 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f3effd700 1 -- 172.21.15.57:0/2261796434 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3800b6c0 con 0x7f3f40136140 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f3effd700 1 -- 172.21.15.57:0/2261796434 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3800b820 con 0x7f3f40136140 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f3effd700 1 -- 172.21.15.57:0/2261796434 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f3800b990 con 0x7f3f40136140 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 -- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 msgr2=0x7f3f4009adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f4009adf0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3f380032f0 tx=0x7f3f380091d0).stop 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 -- 172.21.15.57:0/2261796434 shutdown_connections 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f4009adf0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 --2- 172.21.15.57:0/2261796434 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f40064700 0x7f3f400621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 -- 172.21.15.57:0/2261796434 >> 172.21.15.57:0/2261796434 conn(0x7f3f4006c0c0 msgr2=0x7f3f4006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 -- 172.21.15.57:0/2261796434 shutdown_connections 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.860+0000 7f3f466f0700 1 -- 172.21.15.57:0/2261796434 wait complete. 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.861+0000 7f3f466f0700 1 Processor -- start 2024-03-18T14:41:13.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.861+0000 7f3f466f0700 1 -- start start 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f4009aa10 0x7f3f40148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f40149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f400a6ee0 con 0x7f3f40064700 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401462a0 con 0x7f3f4009aa10 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f466f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f40146560 con 0x7f3f40136140 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f44c8d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f40149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40288/0 (socket says 172.21.15.57:40288) 2024-03-18T14:41:13.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 -- 172.21.15.57:0/1446701111 learned_addr learned my addr 172.21.15.57:0/1446701111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3f7fe700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f4009aa10 0x7f3f40148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 -- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 msgr2=0x7f3f40149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f40149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 -- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f4009aa10 msgr2=0x7f3f40148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f4009aa10 0x7f3f40148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 -- 172.21.15.57:0/1446701111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2800b120 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f44c8d700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f40149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.862+0000 7f3f3ffff700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3f30000bc0 tx=0x7f3f30007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.863+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f300070d0 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.863+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f30007230 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.863+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f38009470 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.863+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3f30005610 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.863+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f400675c0 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.864+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f400a95c0 con 0x7f3f40064700 2024-03-18T14:41:13.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.864+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3f3001a060 con 0x7f3f40064700 2024-03-18T14:41:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.864+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3f30049f10 con 0x7f3f40064700 2024-03-18T14:41:13.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.867+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3f3002ee10 con 0x7f3f40064700 2024-03-18T14:41:13.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.983+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f40057a60 con 0x7f3f40064700 2024-03-18T14:41:13.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.983+0000 7f3f3d7fa700 1 -- 172.21.15.57:0/1446701111 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10545 (secure 0 0 0) 0x7f3f30024950 con 0x7f3f40064700 2024-03-18T14:41:13.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:13.985 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:13.448103+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:13.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 >> v1:172.21.15.57:6816/39496 conn(0x7f3f24038da0 legacy=0x7f3f2403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 msgr2=0x7f3f40145900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3f30000bc0 tx=0x7f3f30007a60).stop 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 shutdown_connections 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3f40136140 0x7f3f40149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3f40064700 0x7f3f40145900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 --2- 172.21.15.57:0/1446701111 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3f4009aa10 0x7f3f40148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 >> 172.21.15.57:0/1446701111 conn(0x7f3f4006c0c0 msgr2=0x7f3f40135130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 shutdown_connections 2024-03-18T14:41:13.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:13.985+0000 7f3f466f0700 1 -- 172.21.15.57:0/1446701111 wait complete. 2024-03-18T14:41:13.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T14:41:14.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.105+0000 7fa72fd0c700 1 Processor -- start 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.105+0000 7fa72fd0c700 1 -- start start 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72fd0c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 0x7fa72809f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72fd0c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 0x7fa72813d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72fd0c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72809c8f0 con 0x7fa72809f010 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72fd0c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa72809c5e0 con 0x7fa72809f8e0 2024-03-18T14:41:14.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72fd0c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280a1540 con 0x7fa7280a4fa0 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 0x7fa72809f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72daa8700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa72809f010 0x7fa7280a1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39516/0 (socket says 172.21.15.57:39516) 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72daa8700 1 -- 172.21.15.57:0/1792813161 learned_addr learned my addr 172.21.15.57:0/1792813161 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72e2a9700 1 --2- 172.21.15.57:0/1792813161 >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 0x7fa72813d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72caa6700 1 -- 172.21.15.57:0/1792813161 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910365174 0 0) 0x7fa72809c8f0 con 0x7fa72809f010 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72caa6700 1 -- 172.21.15.57:0/1792813161 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa710003260 con 0x7fa72809f010 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 -- 172.21.15.57:0/1792813161 >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 msgr2=0x7fa72813d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:14.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 --2- 172.21.15.57:0/1792813161 >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 0x7fa72813d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 -- 172.21.15.57:0/1792813161 >> v1:172.21.15.57:6789/0 conn(0x7fa72809f010 legacy=0x7fa7280a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 -- 172.21.15.57:0/1792813161 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72809cb20 con 0x7fa7280a4fa0 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72e2a9700 1 --2- 172.21.15.57:0/1792813161 >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 0x7fa72813d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72d2a7700 1 --2- 172.21.15.57:0/1792813161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 0x7fa72809f3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa7280a0030 tx=0x7fa718006df0).ready entity=mon.2 client_cookie=e96a9b8d0670b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72caa6700 1 -- 172.21.15.57:0/1792813161 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71800d570 con 0x7fa7280a4fa0 2024-03-18T14:41:14.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72caa6700 1 -- 172.21.15.57:0/1792813161 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa718000e90 con 0x7fa7280a4fa0 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.106+0000 7fa72caa6700 1 -- 172.21.15.57:0/1792813161 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa71800d8c0 con 0x7fa7280a4fa0 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 -- 172.21.15.57:0/1792813161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 msgr2=0x7fa72809f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/1792813161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 0x7fa72809f3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fa7280a0030 tx=0x7fa718006df0).stop 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 -- 172.21.15.57:0/1792813161 shutdown_connections 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/1792813161 >> v2:172.21.15.57:3300/0 conn(0x7fa72809f8e0 0x7fa72813d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/1792813161 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa7280a4fa0 0x7fa72809f3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 -- 172.21.15.57:0/1792813161 >> 172.21.15.57:0/1792813161 conn(0x7fa7280a93f0 msgr2=0x7fa7280a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 -- 172.21.15.57:0/1792813161 shutdown_connections 2024-03-18T14:41:14.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.107+0000 7fa72fd0c700 1 -- 172.21.15.57:0/1792813161 wait complete. 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.108+0000 7fa72fd0c700 1 Processor -- start 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.108+0000 7fa72fd0c700 1 -- start start 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 0x7fa72809bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 0x7fa728066c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280a7780 con 0x7fa7280a4fa0 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa728064540 con 0x7fa72809f010 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa728064770 con 0x7fa72809f8e0 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72d2a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 0x7fa728066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72daa8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 0x7fa72809bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40308/0 (socket says 172.21.15.57:40308) 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72d2a7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 0x7fa728066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37586/0 (socket says 172.21.15.57:37586) 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 -- 172.21.15.57:0/3429204447 learned_addr learned my addr 172.21.15.57:0/3429204447 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 -- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 msgr2=0x7fa728066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:14.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 0x7fa728066c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 -- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 msgr2=0x7fa72809bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 0x7fa72809bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 -- 172.21.15.57:0/3429204447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71800b180 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72daa8700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 0x7fa72809bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72e2a9700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa72000a000 tx=0x7fa720008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa72000c070 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7200133f0 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa728067170 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa720013750 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.109+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7280a70a0 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.110+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa7200138b0 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.111+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa72004a4d0 con 0x7fa7280a4fa0 2024-03-18T14:41:14.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.111+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7280a5e80 con 0x7fa7280a4fa0 2024-03-18T14:41:14.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.114+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa72002f220 con 0x7fa7280a4fa0 2024-03-18T14:41:14.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:14.263+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa728057a60 con 0x7fa7280a4fa0 2024-03-18T14:41:15.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.159+0000 7fa716ffd700 1 -- 172.21.15.57:0/3429204447 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa72000f040 con 0x7fa7280a4fa0 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 >> v1:172.21.15.57:6816/39496 conn(0x7fa708038da0 legacy=0x7fa70803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 msgr2=0x7fa7281365b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fa72000a000 tx=0x7fa720008040).stop 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 shutdown_connections 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa7280a4fa0 0x7fa7281365b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa72809f010 0x7fa72809bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 --2- 172.21.15.57:0/3429204447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa72809f8e0 0x7fa728066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 >> 172.21.15.57:0/3429204447 conn(0x7fa7280a93f0 msgr2=0x7fa72805dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 shutdown_connections 2024-03-18T14:41:15.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.161+0000 7fa72fd0c700 1 -- 172.21.15.57:0/3429204447 wait complete. 2024-03-18T14:41:15.175 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2024-03-18T14:41:15.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-03-18T14:41:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.289+0000 7fc785fae700 1 Processor -- start 2024-03-18T14:41:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.289+0000 7fc785fae700 1 -- start start 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc785fae700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc78009aa10 0x7fc7800621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc785fae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 0x7fc78009adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc785fae700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78009bc50 con 0x7fc780064700 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc785fae700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7801365f0 con 0x7fc78009aa10 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc785fae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc78009b2e0 con 0x7fc780136140 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc78009aa10 0x7fc7800621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc78009aa10 0x7fc7800621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40318/0 (socket says 172.21.15.57:40318) 2024-03-18T14:41:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc780064700 0x7fc780132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39528/0 (socket says 172.21.15.57:39528) 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 -- 172.21.15.57:0/921150871 learned_addr learned my addr 172.21.15.57:0/921150871 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 0x7fc78009adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 -- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 msgr2=0x7fc78009adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 0x7fc78009adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 -- 172.21.15.57:0/921150871 >> v1:172.21.15.57:6789/0 conn(0x7fc780064700 legacy=0x7fc780132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 -- 172.21.15.57:0/921150871 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7801367e0 con 0x7fc78009aa10 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77e7fc700 1 -- 172.21.15.57:0/921150871 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995422791 0 0) 0x7fc78009bc50 con 0x7fc780064700 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77ffff700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 0x7fc78009adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.290+0000 7fc77f7fe700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc78009aa10 0x7fc7800621e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc774002f70 tx=0x7fc774006eb0).ready entity=mon.0 client_cookie=f05b4bd0b2336473 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc77e7fc700 1 -- 172.21.15.57:0/921150871 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77400d570 con 0x7fc78009aa10 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc77e7fc700 1 -- 172.21.15.57:0/921150871 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774000e90 con 0x7fc78009aa10 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc77e7fc700 1 -- 172.21.15.57:0/921150871 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77400d8c0 con 0x7fc78009aa10 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 -- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc78009aa10 msgr2=0x7fc7800621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc78009aa10 0x7fc7800621e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc774002f70 tx=0x7fc774006eb0).stop 2024-03-18T14:41:15.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 -- 172.21.15.57:0/921150871 shutdown_connections 2024-03-18T14:41:15.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780136140 0x7fc78009adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 --2- 172.21.15.57:0/921150871 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc78009aa10 0x7fc7800621e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 -- 172.21.15.57:0/921150871 >> 172.21.15.57:0/921150871 conn(0x7fc78006c0c0 msgr2=0x7fc78006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:15.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 -- 172.21.15.57:0/921150871 shutdown_connections 2024-03-18T14:41:15.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.291+0000 7fc785fae700 1 -- 172.21.15.57:0/921150871 wait complete. 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.292+0000 7fc785fae700 1 Processor -- start 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 -- start start 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780064700 0x7fc780064ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 0x7fc780146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 0x7fc780146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800658a0 con 0x7fc780136140 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800a9dd0 con 0x7fc78009aa10 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc785fae700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7800a9450 con 0x7fc780064700 2024-03-18T14:41:15.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc77effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 0x7fc780146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc77ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 0x7fc780146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc77effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 0x7fc780146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46136/0 (socket says 172.21.15.57:46136) 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc77effd700 1 -- 172.21.15.57:0/297552235 learned_addr learned my addr 172.21.15.57:0/297552235 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.293+0000 7fc77f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780064700 0x7fc780064ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 -- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780064700 msgr2=0x7fc780064ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780064700 0x7fc780064ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 -- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 msgr2=0x7fc780146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 0x7fc780146aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 -- 172.21.15.57:0/297552235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc778009470 con 0x7fc780136140 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77ffff700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 0x7fc780146f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc7800a7c10 tx=0x7fc7780091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77800c670 con 0x7fc780136140 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77800c7d0 con 0x7fc780136140 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc77800cb30 con 0x7fc780136140 2024-03-18T14:41:15.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77400b1e0 con 0x7fc780136140 2024-03-18T14:41:15.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.294+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7800669a0 con 0x7fc780136140 2024-03-18T14:41:15.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.295+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc778022070 con 0x7fc780136140 2024-03-18T14:41:15.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.295+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc77804aed0 con 0x7fc780136140 2024-03-18T14:41:15.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.295+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7800a9f60 con 0x7fc780136140 2024-03-18T14:41:15.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.298+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc778016070 con 0x7fc780136140 2024-03-18T14:41:15.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:15.447+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fc780136aa0 con 0x7fc780136140 2024-03-18T14:41:16.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.162+0000 7fc77cff9700 1 -- 172.21.15.57:0/297552235 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v7) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc778016020 con 0x7fc780136140 2024-03-18T14:41:16.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.164+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 >> v1:172.21.15.57:6816/39496 conn(0x7fc760038e30 legacy=0x7fc76003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:16.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.164+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 msgr2=0x7fc780146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:16.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.164+0000 7fc785fae700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 0x7fc780146f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc7800a7c10 tx=0x7fc7780091d0).stop 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 shutdown_connections 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc780136140 0x7fc780146f90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc780064700 0x7fc780064ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 --2- 172.21.15.57:0/297552235 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc78009aa10 0x7fc780146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 >> 172.21.15.57:0/297552235 conn(0x7fc78006c0c0 msgr2=0x7fc78006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 shutdown_connections 2024-03-18T14:41:16.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.165+0000 7fc785fae700 1 -- 172.21.15.57:0/297552235 wait complete. 2024-03-18T14:41:16.185 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T14:41:16.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 Processor -- start 2024-03-18T14:41:16.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 -- start start 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f928809b520 0x7f9288136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f9288139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f928809a380 con 0x7f928809b520 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9288135fe0 con 0x7f9288099a00 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928ee0f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9288099eb0 con 0x7f92881366f0 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f9287fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f928809b520 0x7f9288136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928cbab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928cbab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37614/0 (socket says 172.21.15.57:37614) 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f9287fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f928809b520 0x7f9288136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40340/0 (socket says 172.21.15.57:40340) 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928cbab700 1 -- 172.21.15.57:0/1636830035 learned_addr learned my addr 172.21.15.57:0/1636830035 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:16.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.300+0000 7f928d3ac700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f9288139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 -- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 msgr2=0x7f928809bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 -- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 msgr2=0x7f9288139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f9288139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 -- 172.21.15.57:0/1636830035 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928809a0c0 con 0x7f928809b520 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f928cbab700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f9287fff700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928809b520 0x7f9288136ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9274002f70 tx=0x7f9274006d90).ready entity=mon.0 client_cookie=9445553c56aafc9f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f92877fe700 1 -- 172.21.15.57:0/1636830035 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927400e540 con 0x7f928809b520 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f92877fe700 1 -- 172.21.15.57:0/1636830035 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9274000e90 con 0x7f928809b520 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.301+0000 7f92877fe700 1 -- 172.21.15.57:0/1636830035 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927400e890 con 0x7f928809b520 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 -- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928809b520 msgr2=0x7f9288136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928809b520 0x7f9288136ad0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9274002f70 tx=0x7f9274006d90).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 -- 172.21.15.57:0/1636830035 shutdown_connections 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f9288139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f92881366f0 0x7f928809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1636830035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f928809b520 0x7f9288136ad0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 -- 172.21.15.57:0/1636830035 >> 172.21.15.57:0/1636830035 conn(0x7f928806c0c0 msgr2=0x7f928806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:16.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 -- 172.21.15.57:0/1636830035 shutdown_connections 2024-03-18T14:41:16.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 -- 172.21.15.57:0/1636830035 wait complete. 2024-03-18T14:41:16.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.302+0000 7f928ee0f700 1 Processor -- start 2024-03-18T14:41:16.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 -- start start 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 0x7f9288096350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 0x7f9288092fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9288096f20 con 0x7f92881366f0 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92880952b0 con 0x7f9288099a00 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928ee0f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9288095550 con 0x7f928809b520 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928cbab700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f9287fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 0x7f9288096350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928cbab700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46154/0 (socket says 172.21.15.57:46154) 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928cbab700 1 -- 172.21.15.57:0/1471982494 learned_addr learned my addr 172.21.15.57:0/1471982494 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.303+0000 7f928d3ac700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 0x7f9288092fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 -- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 msgr2=0x7f9288096350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 0x7f9288096350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 -- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 msgr2=0x7f9288092fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 0x7f9288092fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 -- 172.21.15.57:0/1471982494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c00b1e0 con 0x7f9288099a00 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f9287fff700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 0x7f9288096350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928d3ac700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 0x7f9288092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928cbab700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f927c00c000 tx=0x7f927c006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927c012600 con 0x7f9288099a00 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c012760 con 0x7f9288099a00 2024-03-18T14:41:16.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927400b120 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f927c012ac0 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.304+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9288097dc0 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.305+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f927c022070 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.305+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288057a60 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.305+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f927c04ad70 con 0x7f9288099a00 2024-03-18T14:41:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.308+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f927c033590 con 0x7f9288099a00 2024-03-18T14:41:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:16.461+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9288060880 con 0x7f9288099a00 2024-03-18T14:41:17.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.179+0000 7f9285ffb700 1 -- 172.21.15.57:0/1471982494 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f927c033180 con 0x7f9288099a00 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 >> v1:172.21.15.57:6816/39496 conn(0x7f9268038e60 legacy=0x7f926803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 msgr2=0x7f92880978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f927c00c000 tx=0x7f927c006eb0).stop 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 shutdown_connections 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f92881366f0 0x7f9288092fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9288099a00 0x7f92880978d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 --2- 172.21.15.57:0/1471982494 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f928809b520 0x7f9288096350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 >> 172.21.15.57:0/1471982494 conn(0x7f928806c0c0 msgr2=0x7f9288133310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 shutdown_connections 2024-03-18T14:41:17.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.181+0000 7f928ee0f700 1 -- 172.21.15.57:0/1471982494 wait complete. 2024-03-18T14:41:17.195 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T14:41:17.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:17.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 Processor -- start 2024-03-18T14:41:17.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 -- start start 2024-03-18T14:41:17.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe60809f5d0 0x7fe60813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 0x7fe60813da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6080a1f10 con 0x7fe60805dfb0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6080a0f60 con 0x7fe60809f5d0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60eb85700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6080a1200 con 0x7fe60813b6a0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe607fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe60809f5d0 0x7fe60813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60d122700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 0x7fe60813da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60c921700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe60805dfb0 0x7fe6080a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39534/0 (socket says 172.21.15.57:39534) 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.308+0000 7fe60c921700 1 -- 172.21.15.57:0/710532589 learned_addr learned my addr 172.21.15.57:0/710532589 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe607fff700 1 -- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 msgr2=0x7fe60813da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe607fff700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 0x7fe60813da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe607fff700 1 -- 172.21.15.57:0/710532589 >> v1:172.21.15.57:6789/0 conn(0x7fe60805dfb0 legacy=0x7fe6080a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe6077fe700 1 -- 172.21.15.57:0/710532589 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628091587 0 0) 0x7fe6080a1f10 con 0x7fe60805dfb0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe607fff700 1 -- 172.21.15.57:0/710532589 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe608060520 con 0x7fe60809f5d0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe60d122700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 0x7fe60813da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe607fff700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60809f5d0 0x7fe60813b1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe5f4002f70 tx=0x7fe5f4006df0).ready entity=mon.0 client_cookie=c72be53108fbaff4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe6077fe700 1 -- 172.21.15.57:0/710532589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f400d570 con 0x7fe60809f5d0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe6077fe700 1 -- 172.21.15.57:0/710532589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f4000e90 con 0x7fe60809f5d0 2024-03-18T14:41:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe6077fe700 1 -- 172.21.15.57:0/710532589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5f400d8c0 con 0x7fe60809f5d0 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe60eb85700 1 -- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60809f5d0 msgr2=0x7fe60813b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.309+0000 7fe60eb85700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60809f5d0 0x7fe60813b1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fe5f4002f70 tx=0x7fe5f4006df0).stop 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 -- 172.21.15.57:0/710532589 shutdown_connections 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60813b6a0 0x7fe60813da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 --2- 172.21.15.57:0/710532589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60809f5d0 0x7fe60813b1b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 -- 172.21.15.57:0/710532589 >> 172.21.15.57:0/710532589 conn(0x7fe6080a93f0 msgr2=0x7fe6080a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 -- 172.21.15.57:0/710532589 shutdown_connections 2024-03-18T14:41:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 -- 172.21.15.57:0/710532589 wait complete. 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 Processor -- start 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.310+0000 7fe60eb85700 1 -- start start 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe60809f5d0 0x7fe608061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe608063ee0 con 0x7fe60813b6a0 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60809b360 con 0x7fe60805dfb0 2024-03-18T14:41:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60eb85700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe608149260 con 0x7fe60809f5d0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60c921700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60d122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60c921700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46176/0 (socket says 172.21.15.57:46176) 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60d122700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40356/0 (socket says 172.21.15.57:40356) 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe60c921700 1 -- 172.21.15.57:0/2760295822 learned_addr learned my addr 172.21.15.57:0/2760295822 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.311+0000 7fe607fff700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe60809f5d0 0x7fe608061740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 -- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe60809f5d0 msgr2=0x7fe608061740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe60809f5d0 0x7fe608061740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 -- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 msgr2=0x7fe6081494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 -- 172.21.15.57:0/2760295822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009470 con 0x7fe60805dfb0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60d122700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60c921700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe5fc000bc0 tx=0x7fe5fc007a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc0070d0 con 0x7fe60805dfb0 2024-03-18T14:41:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc007230 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe5fc005610 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f400b180 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.312+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe608062e80 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.313+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe5fc010070 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.313+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe608061df0 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.313+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe5fc049fe0 con 0x7fe60805dfb0 2024-03-18T14:41:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.316+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe5fc02eee0 con 0x7fe60805dfb0 2024-03-18T14:41:17.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.466+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe608057a60 con 0x7fe60805dfb0 2024-03-18T14:41:17.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.466+0000 7fe605ffb700 1 -- 172.21.15.57:0/2760295822 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2318 (secure 0 0 0) 0x7fe5fc032500 con 0x7fe60805dfb0 2024-03-18T14:41:17.468 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:17.468 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:41:17.168864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 >> v1:172.21.15.57:6816/39496 conn(0x7fe5e8038da0 legacy=0x7fe5e803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 msgr2=0x7fe608063560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fe5fc000bc0 tx=0x7fe5fc007a60).stop 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 shutdown_connections 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe60813b6a0 0x7fe6081494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe60805dfb0 0x7fe608063560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 --2- 172.21.15.57:0/2760295822 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe60809f5d0 0x7fe608061740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 >> 172.21.15.57:0/2760295822 conn(0x7fe6080a93f0 msgr2=0x7fe60809dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 shutdown_connections 2024-03-18T14:41:17.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.468+0000 7fe60eb85700 1 -- 172.21.15.57:0/2760295822 wait complete. 2024-03-18T14:41:17.471 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-18T14:41:17.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:17.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 Processor -- start 2024-03-18T14:41:17.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 -- start start 2024-03-18T14:41:17.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f0c063c30 0x7f4f0c134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c063520 con 0x7f4f0c137360 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c134310 con 0x7f4f0c063c30 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f12607700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c063750 con 0x7f4f0c133e30 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f0b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f0bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4f0c063c30 0x7f4f0c134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46186/0 (socket says 172.21.15.57:46186) 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0b7fe700 1 -- 172.21.15.57:0/1876788500 learned_addr learned my addr 172.21.15.57:0/1876788500 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.585+0000 7f4f10ba4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4f0c137360 0x7f4f0c137810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39548/0 (socket says 172.21.15.57:39548) 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0bfff700 1 -- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 msgr2=0x7f4f0c064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0bfff700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0bfff700 1 -- 172.21.15.57:0/1876788500 >> v1:172.21.15.57:6789/0 conn(0x7f4f0c137360 legacy=0x7f4f0c137810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0affd700 1 -- 172.21.15.57:0/1876788500 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806932000 0 0) 0x7f4f0c063520 con 0x7f4f0c137360 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0bfff700 1 -- 172.21.15.57:0/1876788500 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c063a10 con 0x7f4f0c063c30 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0b7fe700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0bfff700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c063c30 0x7f4f0c134730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4efc002f70 tx=0x7f4efc006df0).ready entity=mon.0 client_cookie=e9827ba2c4ffa621 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0affd700 1 -- 172.21.15.57:0/1876788500 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00d570 con 0x7f4f0c063c30 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0affd700 1 -- 172.21.15.57:0/1876788500 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc000e90 con 0x7f4f0c063c30 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.586+0000 7f4f0affd700 1 -- 172.21.15.57:0/1876788500 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc00d8c0 con 0x7f4f0c063c30 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 -- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c063c30 msgr2=0x7f4f0c134730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c063c30 0x7f4f0c134730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f4efc002f70 tx=0x7f4efc006df0).stop 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 -- 172.21.15.57:0/1876788500 shutdown_connections 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c063c30 0x7f4f0c134730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 --2- 172.21.15.57:0/1876788500 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c133e30 0x7f4f0c064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 -- 172.21.15.57:0/1876788500 >> 172.21.15.57:0/1876788500 conn(0x7f4f0c06c0c0 msgr2=0x7f4f0c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 -- 172.21.15.57:0/1876788500 shutdown_connections 2024-03-18T14:41:17.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 -- 172.21.15.57:0/1876788500 wait complete. 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.587+0000 7f4f12607700 1 Processor -- start 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 -- start start 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4f0c133e30 0x7f4f0c0a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c09cf20 con 0x7f4f0c137360 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c09d120 con 0x7f4f0c063c30 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f12607700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0a9d00 con 0x7f4f0c133e30 2024-03-18T14:41:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f10ba4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f0bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f10ba4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40370/0 (socket says 172.21.15.57:40370) 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f10ba4700 1 -- 172.21.15.57:0/1981643310 learned_addr learned my addr 172.21.15.57:0/1981643310 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f0bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46194/0 (socket says 172.21.15.57:46194) 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.588+0000 7f4f0b7fe700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4f0c133e30 0x7f4f0c0a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 -- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4f0c133e30 msgr2=0x7f4f0c0a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4f0c133e30 0x7f4f0c0a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 -- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 msgr2=0x7f4f0c09da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 -- 172.21.15.57:0/1981643310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0000b1e0 con 0x7f4f0c137360 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f0bfff700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f10ba4700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4f04001250 tx=0x7f4f04001360).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f04005bb0 con 0x7f4f0c137360 2024-03-18T14:41:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f04005d10 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4efc00b180 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4f040072c0 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.589+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c09b5d0 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.590+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4f04010070 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.590+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c0aa120 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.590+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4f0404a360 con 0x7f4f0c137360 2024-03-18T14:41:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.593+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4f0402f1c0 con 0x7f4f0c137360 2024-03-18T14:41:17.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.709+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f0c05c980 con 0x7f4f0c137360 2024-03-18T14:41:17.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.710+0000 7f4f097fa700 1 -- 172.21.15.57:0/1981643310 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f4f040327e0 con 0x7f4f0c137360 2024-03-18T14:41:17.711 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:17.711 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 >> v1:172.21.15.57:6816/39496 conn(0x7f4eec038da0 legacy=0x7f4eec03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 msgr2=0x7f4f0c0a75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f4f04001250 tx=0x7f4f04001360).stop 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 shutdown_connections 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f0c137360 0x7f4f0c0a75c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4f0c063c30 0x7f4f0c09da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 --2- 172.21.15.57:0/1981643310 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4f0c133e30 0x7f4f0c0a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 >> 172.21.15.57:0/1981643310 conn(0x7f4f0c06c0c0 msgr2=0x7f4f0c137810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 shutdown_connections 2024-03-18T14:41:17.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.711+0000 7f4f12607700 1 -- 172.21.15.57:0/1981643310 wait complete. 2024-03-18T14:41:17.724 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T14:41:17.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:41:17.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.828+0000 7fb2e8958700 1 Processor -- start 2024-03-18T14:41:17.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.828+0000 7fb2e8958700 1 -- start start 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e8958700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e4133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e8958700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 0x7fb2e4141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e8958700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e4067990 con 0x7fb2e4067570 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e8958700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40a4c50 con 0x7fb2e41337e0 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e8958700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40a4f10 con 0x7fb2e4139fa0 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 0x7fb2e4141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e1d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2e4067570 0x7fb2e4139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39560/0 (socket says 172.21.15.57:39560) 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e1d9b700 1 -- 172.21.15.57:0/1508097577 learned_addr learned my addr 172.21.15.57:0/1508097577 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e259c700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e4133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 msgr2=0x7fb2e4133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:17.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e4133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/1508097577 >> v1:172.21.15.57:6789/0 conn(0x7fb2e4067570 legacy=0x7fb2e4139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/1508097577 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4060520 con 0x7fb2e4139fa0 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e159a700 1 -- 172.21.15.57:0/1508097577 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484623877 0 0) 0x7fb2e4067990 con 0x7fb2e4067570 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e259c700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e4133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 0x7fb2e4141c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb2dc0032f0 tx=0x7fb2dc0091d0).ready entity=mon.2 client_cookie=97eb9205f5d3af1c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.829+0000 7fb2e159a700 1 -- 172.21.15.57:0/1508097577 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2dc00b6c0 con 0x7fb2e4139fa0 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e159a700 1 -- 172.21.15.57:0/1508097577 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00b820 con 0x7fb2e4139fa0 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e159a700 1 -- 172.21.15.57:0/1508097577 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2dc00b990 con 0x7fb2e4139fa0 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 -- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 msgr2=0x7fb2e4141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 0x7fb2e4141c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb2dc0032f0 tx=0x7fb2dc0091d0).stop 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 -- 172.21.15.57:0/1508097577 shutdown_connections 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4139fa0 0x7fb2e4141c30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 --2- 172.21.15.57:0/1508097577 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e4133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 -- 172.21.15.57:0/1508097577 >> 172.21.15.57:0/1508097577 conn(0x7fb2e40a93f0 msgr2=0x7fb2e40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 -- 172.21.15.57:0/1508097577 shutdown_connections 2024-03-18T14:41:17.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.830+0000 7fb2e8958700 1 -- 172.21.15.57:0/1508097577 wait complete. 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.831+0000 7fb2e8958700 1 Processor -- start 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.831+0000 7fb2e8958700 1 -- start start 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 0x7fb2e40a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e40a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 0x7fb2e4132510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:17.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40a2640 con 0x7fb2e4139fa0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40927a0 con 0x7fb2e41337e0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e4093050 con 0x7fb2e4067570 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 0x7fb2e40a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e40a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 0x7fb2e40a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37662/0 (socket says 172.21.15.57:37662) 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e259c700 1 -- 172.21.15.57:0/2799927761 learned_addr learned my addr 172.21.15.57:0/2799927761 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 0x7fb2e4132510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 msgr2=0x7fb2e40a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 0x7fb2e40a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 msgr2=0x7fb2e40a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e40a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 -- 172.21.15.57:0/2799927761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d800b180 con 0x7fb2e4139fa0 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e1d9b700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e40a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:17.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e2d9d700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 0x7fb2e4132510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb2e40a1b90 tx=0x7fb2dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2dc00b6c0 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc021630 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2dc021990 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc009470 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.832+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e40a15c0 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.833+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb2dc027020 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.833+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb2dc04bbc0 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.834+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e409e580 con 0x7fb2e4139fa0 2024-03-18T14:41:17.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.837+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb2dc021d20 con 0x7fb2e4139fa0 2024-03-18T14:41:17.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.949+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 --> v1:172.21.15.57:6816/39496 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2e4065a50 con 0x7fb2c0038e30 2024-03-18T14:41:17.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.956+0000 7fb2d37fe700 1 -- 172.21.15.57:0/2799927761 <== mgr.4099 v1:172.21.15.57:6816/39496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246939 (unknown 2965378022 0 2861286254) 0x7fb2e4065a50 con 0x7fb2c0038e30 2024-03-18T14:41:17.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:17.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 >> v1:172.21.15.57:6816/39496 conn(0x7fb2c0038e30 legacy=0x7fb2c003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 msgr2=0x7fb2e4132510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 0x7fb2e4132510 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fb2e40a1b90 tx=0x7fb2dc016000).stop 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 shutdown_connections 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2e4139fa0 0x7fb2e4132510 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb2e4067570 0x7fb2e40a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 --2- 172.21.15.57:0/2799927761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb2e41337e0 0x7fb2e40a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 >> 172.21.15.57:0/2799927761 conn(0x7fb2e40a93f0 msgr2=0x7fb2e40a8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 shutdown_connections 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:17.958+0000 7fb2e8958700 1 -- 172.21.15.57:0/2799927761 wait complete. 2024-03-18T14:41:17.964 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:41:17.970 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-18T14:41:16.409709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195000,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292360,"statfs":{"total":386547056640,"available":382251376640,"internally_reserved":4294967296,"allocated":679936,"data_stored":203743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.283616"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504374+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:41:13.504374+0000","last_peered":"2024-03-18T14:41:13.504374+0000","last_clean":"2024-03-18T14:41:13.504374+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:41:13.504374+0000","last_undegraded":"2024-03-18T14:41:13.504374+0000","last_fullsized":"2024-03-18T14:41:13.504374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503047+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:41:13.503047+0000","last_peered":"2024-03-18T14:41:13.503047+0000","last_clean":"2024-03-18T14:41:13.503047+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:41:13.503047+0000","last_undegraded":"2024-03-18T14:41:13.503047+0000","last_fullsized":"2024-03-18T14:41:13.503047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509070+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:41:13.509070+0000","last_peered":"2024-03-18T14:41:13.509070+0000","last_clean":"2024-03-18T14:41:13.509070+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:41:13.509070+0000","last_undegraded":"2024-03-18T14:41:13.509070+0000","last_fullsized":"2024-03-18T14:41:13.509070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516068+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:41:13.516068+0000","last_peered":"2024-03-18T14:41:13.516068+0000","last_clean":"2024-03-18T14:41:13.516068+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:41:13.516068+0000","last_undegraded":"2024-03-18T14:41:13.516068+0000","last_fullsized":"2024-03-18T14:41:13.516068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508157+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:41:13.508157+0000","last_peered":"2024-03-18T14:41:13.508157+0000","last_clean":"2024-03-18T14:41:13.508157+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:41:13.508157+0000","last_undegraded":"2024-03-18T14:41:13.508157+0000","last_fullsized":"2024-03-18T14:41:13.508157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510313+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:41:13.510313+0000","last_peered":"2024-03-18T14:41:13.510313+0000","last_clean":"2024-03-18T14:41:13.510313+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:41:13.510313+0000","last_undegraded":"2024-03-18T14:41:13.510313+0000","last_fullsized":"2024-03-18T14:41:13.510313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503242+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:41:13.503242+0000","last_peered":"2024-03-18T14:41:13.503242+0000","last_clean":"2024-03-18T14:41:13.503242+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:41:13.503242+0000","last_undegraded":"2024-03-18T14:41:13.503242+0000","last_fullsized":"2024-03-18T14:41:13.503242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516825+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:41:13.516825+0000","last_peered":"2024-03-18T14:41:13.516825+0000","last_clean":"2024-03-18T14:41:13.516825+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:41:13.516825+0000","last_undegraded":"2024-03-18T14:41:13.516825+0000","last_fullsized":"2024-03-18T14:41:13.516825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507149+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:41:13.507149+0000","last_peered":"2024-03-18T14:41:13.507149+0000","last_clean":"2024-03-18T14:41:13.507149+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:41:13.507149+0000","last_undegraded":"2024-03-18T14:41:13.507149+0000","last_fullsized":"2024-03-18T14:41:13.507149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511816+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:41:13.511816+0000","last_peered":"2024-03-18T14:41:13.511816+0000","last_clean":"2024-03-18T14:41:13.511816+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:41:13.511816+0000","last_undegraded":"2024-03-18T14:41:13.511816+0000","last_fullsized":"2024-03-18T14:41:13.511816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509362+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:41:13.509362+0000","last_peered":"2024-03-18T14:41:13.509362+0000","last_clean":"2024-03-18T14:41:13.509362+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:41:13.509362+0000","last_undegraded":"2024-03-18T14:41:13.509362+0000","last_fullsized":"2024-03-18T14:41:13.509362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504253+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:41:13.504253+0000","last_peered":"2024-03-18T14:41:13.504253+0000","last_clean":"2024-03-18T14:41:13.504253+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:41:13.504253+0000","last_undegraded":"2024-03-18T14:41:13.504253+0000","last_fullsized":"2024-03-18T14:41:13.504253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504412+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:41:13.504412+0000","last_peered":"2024-03-18T14:41:13.504412+0000","last_clean":"2024-03-18T14:41:13.504412+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:41:13.504412+0000","last_undegraded":"2024-03-18T14:41:13.504412+0000","last_fullsized":"2024-03-18T14:41:13.504412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509284+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:41:13.509284+0000","last_peered":"2024-03-18T14:41:13.509284+0000","last_clean":"2024-03-18T14:41:13.509284+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:41:13.509284+0000","last_undegraded":"2024-03-18T14:41:13.509284+0000","last_fullsized":"2024-03-18T14:41:13.509284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508251+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:41:13.508251+0000","last_peered":"2024-03-18T14:41:13.508251+0000","last_clean":"2024-03-18T14:41:13.508251+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:41:13.508251+0000","last_undegraded":"2024-03-18T14:41:13.508251+0000","last_fullsized":"2024-03-18T14:41:13.508251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508362+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:41:13.508362+0000","last_peered":"2024-03-18T14:41:13.508362+0000","last_clean":"2024-03-18T14:41:13.508362+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:41:13.508362+0000","last_undegraded":"2024-03-18T14:41:13.508362+0000","last_fullsized":"2024-03-18T14:41:13.508362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508184+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:41:13.508184+0000","last_peered":"2024-03-18T14:41:13.508184+0000","last_clean":"2024-03-18T14:41:13.508184+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:41:13.508184+0000","last_undegraded":"2024-03-18T14:41:13.508184+0000","last_fullsized":"2024-03-18T14:41:13.508184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507979+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:41:13.507979+0000","last_peered":"2024-03-18T14:41:13.507979+0000","last_clean":"2024-03-18T14:41:13.507979+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:41:13.507979+0000","last_undegraded":"2024-03-18T14:41:13.507979+0000","last_fullsized":"2024-03-18T14:41:13.507979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499448+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:41:13.499448+0000","last_peered":"2024-03-18T14:41:13.499448+0000","last_clean":"2024-03-18T14:41:13.499448+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:41:13.499448+0000","last_undegraded":"2024-03-18T14:41:13.499448+0000","last_fullsized":"2024-03-18T14:41:13.499448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515134+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:41:13.515134+0000","last_peered":"2024-03-18T14:41:13.515134+0000","last_clean":"2024-03-18T14:41:13.515134+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:41:13.515134+0000","last_undegraded":"2024-03-18T14:41:13.515134+0000","last_fullsized":"2024-03-18T14:41:13.515134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516394+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:41:13.516394+0000","last_peered":"2024-03-18T14:41:13.516394+0000","last_clean":"2024-03-18T14:41:13.516394+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:41:13.516394+0000","last_undegraded":"2024-03-18T14:41:13.516394+0000","last_fullsized":"2024-03-18T14:41:13.516394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507867+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:41:13.507867+0000","last_peered":"2024-03-18T14:41:13.507867+0000","last_clean":"2024-03-18T14:41:13.507867+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:41:13.507867+0000","last_undegraded":"2024-03-18T14:41:13.507867+0000","last_fullsized":"2024-03-18T14:41:13.507867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507480+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:41:13.507480+0000","last_peered":"2024-03-18T14:41:13.507480+0000","last_clean":"2024-03-18T14:41:13.507480+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:41:13.507480+0000","last_undegraded":"2024-03-18T14:41:13.507480+0000","last_fullsized":"2024-03-18T14:41:13.507480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516851+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:41:13.516851+0000","last_peered":"2024-03-18T14:41:13.516851+0000","last_clean":"2024-03-18T14:41:13.516851+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:41:13.516851+0000","last_undegraded":"2024-03-18T14:41:13.516851+0000","last_fullsized":"2024-03-18T14:41:13.516851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516907+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:41:13.516907+0000","last_peered":"2024-03-18T14:41:13.516907+0000","last_clean":"2024-03-18T14:41:13.516907+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:41:13.516907+0000","last_undegraded":"2024-03-18T14:41:13.516907+0000","last_fullsized":"2024-03-18T14:41:13.516907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511840+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:41:13.511840+0000","last_peered":"2024-03-18T14:41:13.511840+0000","last_clean":"2024-03-18T14:41:13.511840+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:41:13.511840+0000","last_undegraded":"2024-03-18T14:41:13.511840+0000","last_fullsized":"2024-03-18T14:41:13.511840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507840+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:41:13.507840+0000","last_peered":"2024-03-18T14:41:13.507840+0000","last_clean":"2024-03-18T14:41:13.507840+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:41:13.507840+0000","last_undegraded":"2024-03-18T14:41:13.507840+0000","last_fullsized":"2024-03-18T14:41:13.507840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504184+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:41:13.504184+0000","last_peered":"2024-03-18T14:41:13.504184+0000","last_clean":"2024-03-18T14:41:13.504184+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:41:13.504184+0000","last_undegraded":"2024-03-18T14:41:13.504184+0000","last_fullsized":"2024-03-18T14:41:13.504184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512707+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:41:13.512707+0000","last_peered":"2024-03-18T14:41:13.512707+0000","last_clean":"2024-03-18T14:41:13.512707+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:41:13.512707+0000","last_undegraded":"2024-03-18T14:41:13.512707+0000","last_fullsized":"2024-03-18T14:41:13.512707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488074+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:41:13.488074+0000","last_peered":"2024-03-18T14:41:13.488074+0000","last_clean":"2024-03-18T14:41:13.488074+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:41:13.488074+0000","last_undegraded":"2024-03-18T14:41:13.488074+0000","last_fullsized":"2024-03-18T14:41:13.488074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508888+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:41:13.508888+0000","last_peered":"2024-03-18T14:41:13.508888+0000","last_clean":"2024-03-18T14:41:13.508888+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:41:13.508888+0000","last_undegraded":"2024-03-18T14:41:13.508888+0000","last_fullsized":"2024-03-18T14:41:13.508888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477453+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:41:13.477453+0000","last_peered":"2024-03-18T14:41:13.477453+0000","last_clean":"2024-03-18T14:41:13.477453+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:41:13.477453+0000","last_undegraded":"2024-03-18T14:41:13.477453+0000","last_fullsized":"2024-03-18T14:41:13.477453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509484+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:41:13.509484+0000","last_peered":"2024-03-18T14:41:13.509484+0000","last_clean":"2024-03-18T14:41:13.509484+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:41:13.509484+0000","last_undegraded":"2024-03-18T14:41:13.509484+0000","last_fullsized":"2024-03-18T14:41:13.509484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.472856+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:41:13.472856+0000","last_peered":"2024-03-18T14:41:13.472856+0000","last_clean":"2024-03-18T14:41:13.472856+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:41:13.472856+0000","last_undegraded":"2024-03-18T14:41:13.472856+0000","last_fullsized":"2024-03-18T14:41:13.472856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512366+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:41:13.512366+0000","last_peered":"2024-03-18T14:41:13.512366+0000","last_clean":"2024-03-18T14:41:13.512366+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:41:13.512366+0000","last_undegraded":"2024-03-18T14:41:13.512366+0000","last_fullsized":"2024-03-18T14:41:13.512366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.473392+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:41:13.473392+0000","last_peered":"2024-03-18T14:41:13.473392+0000","last_clean":"2024-03-18T14:41:13.473392+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:41:13.473392+0000","last_undegraded":"2024-03-18T14:41:13.473392+0000","last_fullsized":"2024-03-18T14:41:13.473392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507540+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:41:13.507540+0000","last_peered":"2024-03-18T14:41:13.507540+0000","last_clean":"2024-03-18T14:41:13.507540+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:41:13.507540+0000","last_undegraded":"2024-03-18T14:41:13.507540+0000","last_fullsized":"2024-03-18T14:41:13.507540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496672+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:41:13.496672+0000","last_peered":"2024-03-18T14:41:13.496672+0000","last_clean":"2024-03-18T14:41:13.496672+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:41:13.496672+0000","last_undegraded":"2024-03-18T14:41:13.496672+0000","last_fullsized":"2024-03-18T14:41:13.496672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509259+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:41:13.509259+0000","last_peered":"2024-03-18T14:41:13.509259+0000","last_clean":"2024-03-18T14:41:13.509259+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:41:13.509259+0000","last_undegraded":"2024-03-18T14:41:13.509259+0000","last_fullsized":"2024-03-18T14:41:13.509259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.517237+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:41:13.517237+0000","last_peered":"2024-03-18T14:41:13.517237+0000","last_clean":"2024-03-18T14:41:13.517237+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:41:13.517237+0000","last_undegraded":"2024-03-18T14:41:13.517237+0000","last_fullsized":"2024-03-18T14:41:13.517237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504392+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:41:13.504392+0000","last_peered":"2024-03-18T14:41:13.504392+0000","last_clean":"2024-03-18T14:41:13.504392+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:41:13.504392+0000","last_undegraded":"2024-03-18T14:41:13.504392+0000","last_fullsized":"2024-03-18T14:41:13.504392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510787+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:41:13.510787+0000","last_peered":"2024-03-18T14:41:13.510787+0000","last_clean":"2024-03-18T14:41:13.510787+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:41:13.510787+0000","last_undegraded":"2024-03-18T14:41:13.510787+0000","last_fullsized":"2024-03-18T14:41:13.510787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515468+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:41:13.515468+0000","last_peered":"2024-03-18T14:41:13.515468+0000","last_clean":"2024-03-18T14:41:13.515468+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:41:13.515468+0000","last_undegraded":"2024-03-18T14:41:13.515468+0000","last_fullsized":"2024-03-18T14:41:13.515468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.474515+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:41:13.474515+0000","last_peered":"2024-03-18T14:41:13.474515+0000","last_clean":"2024-03-18T14:41:13.474515+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:41:13.474515+0000","last_undegraded":"2024-03-18T14:41:13.474515+0000","last_fullsized":"2024-03-18T14:41:13.474515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507827+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:41:13.507827+0000","last_peered":"2024-03-18T14:41:13.507827+0000","last_clean":"2024-03-18T14:41:13.507827+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:41:13.507827+0000","last_undegraded":"2024-03-18T14:41:13.507827+0000","last_fullsized":"2024-03-18T14:41:13.507827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480111+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:41:13.480111+0000","last_peered":"2024-03-18T14:41:13.480111+0000","last_clean":"2024-03-18T14:41:13.480111+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:41:13.480111+0000","last_undegraded":"2024-03-18T14:41:13.480111+0000","last_fullsized":"2024-03-18T14:41:13.480111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.506508+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:41:13.506508+0000","last_peered":"2024-03-18T14:41:13.506508+0000","last_clean":"2024-03-18T14:41:13.506508+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:41:13.506508+0000","last_undegraded":"2024-03-18T14:41:13.506508+0000","last_fullsized":"2024-03-18T14:41:13.506508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516329+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:41:13.516329+0000","last_peered":"2024-03-18T14:41:13.516329+0000","last_clean":"2024-03-18T14:41:13.516329+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:41:13.516329+0000","last_undegraded":"2024-03-18T14:41:13.516329+0000","last_fullsized":"2024-03-18T14:41:13.516329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509504+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:41:13.509504+0000","last_peered":"2024-03-18T14:41:13.509504+0000","last_clean":"2024-03-18T14:41:13.509504+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:41:13.509504+0000","last_undegraded":"2024-03-18T14:41:13.509504+0000","last_fullsized":"2024-03-18T14:41:13.509504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501819+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:41:13.501819+0000","last_peered":"2024-03-18T14:41:13.501819+0000","last_clean":"2024-03-18T14:41:13.501819+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:41:13.501819+0000","last_undegraded":"2024-03-18T14:41:13.501819+0000","last_fullsized":"2024-03-18T14:41:13.501819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515787+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:41:13.515787+0000","last_peered":"2024-03-18T14:41:13.515787+0000","last_clean":"2024-03-18T14:41:13.515787+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:41:13.515787+0000","last_undegraded":"2024-03-18T14:41:13.515787+0000","last_fullsized":"2024-03-18T14:41:13.515787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.495818+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:41:13.495818+0000","last_peered":"2024-03-18T14:41:13.495818+0000","last_clean":"2024-03-18T14:41:13.495818+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:41:13.495818+0000","last_undegraded":"2024-03-18T14:41:13.495818+0000","last_fullsized":"2024-03-18T14:41:13.495818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509149+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:41:13.509149+0000","last_peered":"2024-03-18T14:41:13.509149+0000","last_clean":"2024-03-18T14:41:13.509149+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:41:13.509149+0000","last_undegraded":"2024-03-18T14:41:13.509149+0000","last_fullsized":"2024-03-18T14:41:13.509149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512633+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:41:13.512633+0000","last_peered":"2024-03-18T14:41:13.512633+0000","last_clean":"2024-03-18T14:41:13.512633+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:41:13.512633+0000","last_undegraded":"2024-03-18T14:41:13.512633+0000","last_fullsized":"2024-03-18T14:41:13.512633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496729+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:41:13.496729+0000","last_peered":"2024-03-18T14:41:13.496729+0000","last_clean":"2024-03-18T14:41:13.496729+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:41:13.496729+0000","last_undegraded":"2024-03-18T14:41:13.496729+0000","last_fullsized":"2024-03-18T14:41:13.496729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471863+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:41:13.471863+0000","last_peered":"2024-03-18T14:41:13.471863+0000","last_clean":"2024-03-18T14:41:13.471863+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:41:13.471863+0000","last_undegraded":"2024-03-18T14:41:13.471863+0000","last_fullsized":"2024-03-18T14:41:13.471863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508108+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:41:13.508108+0000","last_peered":"2024-03-18T14:41:13.508108+0000","last_clean":"2024-03-18T14:41:13.508108+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:41:13.508108+0000","last_undegraded":"2024-03-18T14:41:13.508108+0000","last_fullsized":"2024-03-18T14:41:13.508108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.497201+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:41:13.497201+0000","last_peered":"2024-03-18T14:41:13.497201+0000","last_clean":"2024-03-18T14:41:13.497201+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:41:13.497201+0000","last_undegraded":"2024-03-18T14:41:13.497201+0000","last_fullsized":"2024-03-18T14:41:13.497201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.492488+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:41:13.492488+0000","last_peered":"2024-03-18T14:41:13.492488+0000","last_clean":"2024-03-18T14:41:13.492488+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:41:13.492488+0000","last_undegraded":"2024-03-18T14:41:13.492488+0000","last_fullsized":"2024-03-18T14:41:13.492488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484336+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:41:13.484336+0000","last_peered":"2024-03-18T14:41:13.484336+0000","last_clean":"2024-03-18T14:41:13.484336+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:41:13.484336+0000","last_undegraded":"2024-03-18T14:41:13.484336+0000","last_fullsized":"2024-03-18T14:41:13.484336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512732+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:41:13.512732+0000","last_peered":"2024-03-18T14:41:13.512732+0000","last_clean":"2024-03-18T14:41:13.512732+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:41:13.512732+0000","last_undegraded":"2024-03-18T14:41:13.512732+0000","last_fullsized":"2024-03-18T14:41:13.512732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.479565+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:41:13.479565+0000","last_peered":"2024-03-18T14:41:13.479565+0000","last_clean":"2024-03-18T14:41:13.479565+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:41:13.479565+0000","last_undegraded":"2024-03-18T14:41:13.479565+0000","last_fullsized":"2024-03-18T14:41:13.479565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503072+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:41:13.503072+0000","last_peered":"2024-03-18T14:41:13.503072+0000","last_clean":"2024-03-18T14:41:13.503072+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:41:13.503072+0000","last_undegraded":"2024-03-18T14:41:13.503072+0000","last_fullsized":"2024-03-18T14:41:13.503072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477150+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:41:13.477150+0000","last_peered":"2024-03-18T14:41:13.477150+0000","last_clean":"2024-03-18T14:41:13.477150+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:41:13.477150+0000","last_undegraded":"2024-03-18T14:41:13.477150+0000","last_fullsized":"2024-03-18T14:41:13.477150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514205+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:41:13.514205+0000","last_peered":"2024-03-18T14:41:13.514205+0000","last_clean":"2024-03-18T14:41:13.514205+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:41:13.514205+0000","last_undegraded":"2024-03-18T14:41:13.514205+0000","last_fullsized":"2024-03-18T14:41:13.514205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.489432+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:13.489432+0000","last_peered":"2024-03-18T14:41:13.489432+0000","last_clean":"2024-03-18T14:41:13.489432+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:13.489432+0000","last_undegraded":"2024-03-18T14:41:13.489432+0000","last_fullsized":"2024-03-18T14:41:13.489432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471240+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:41:13.471240+0000","last_peered":"2024-03-18T14:41:13.471240+0000","last_clean":"2024-03-18T14:41:13.471240+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:41:13.471240+0000","last_undegraded":"2024-03-18T14:41:13.471240+0000","last_fullsized":"2024-03-18T14:41:13.471240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509233+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:41:13.509233+0000","last_peered":"2024-03-18T14:41:13.509233+0000","last_clean":"2024-03-18T14:41:13.509233+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:41:13.509233+0000","last_undegraded":"2024-03-18T14:41:13.509233+0000","last_fullsized":"2024-03-18T14:41:13.509233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.486304+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:13.486304+0000","last_peered":"2024-03-18T14:41:13.486304+0000","last_clean":"2024-03-18T14:41:13.486304+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:13.486304+0000","last_undegraded":"2024-03-18T14:41:13.486304+0000","last_fullsized":"2024-03-18T14:41:13.486304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.472527+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:41:13.472527+0000","last_peered":"2024-03-18T14:41:13.472527+0000","last_clean":"2024-03-18T14:41:13.472527+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:41:13.472527+0000","last_undegraded":"2024-03-18T14:41:13.472527+0000","last_fullsized":"2024-03-18T14:41:13.472527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512594+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:41:13.512594+0000","last_peered":"2024-03-18T14:41:13.512594+0000","last_clean":"2024-03-18T14:41:13.512594+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:41:13.512594+0000","last_undegraded":"2024-03-18T14:41:13.512594+0000","last_fullsized":"2024-03-18T14:41:13.512594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471693+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:13.471693+0000","last_peered":"2024-03-18T14:41:13.471693+0000","last_clean":"2024-03-18T14:41:13.471693+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:13.471693+0000","last_undegraded":"2024-03-18T14:41:13.471693+0000","last_fullsized":"2024-03-18T14:41:13.471693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488990+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:41:13.488990+0000","last_peered":"2024-03-18T14:41:13.488990+0000","last_clean":"2024-03-18T14:41:13.488990+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:41:13.488990+0000","last_undegraded":"2024-03-18T14:41:13.488990+0000","last_fullsized":"2024-03-18T14:41:13.488990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514181+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:41:13.514181+0000","last_peered":"2024-03-18T14:41:13.514181+0000","last_clean":"2024-03-18T14:41:13.514181+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:41:13.514181+0000","last_undegraded":"2024-03-18T14:41:13.514181+0000","last_fullsized":"2024-03-18T14:41:13.514181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.478113+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:13.478113+0000","last_peered":"2024-03-18T14:41:13.478113+0000","last_clean":"2024-03-18T14:41:13.478113+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:13.478113+0000","last_undegraded":"2024-03-18T14:41:13.478113+0000","last_fullsized":"2024-03-18T14:41:13.478113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488848+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:13.488848+0000","last_peered":"2024-03-18T14:41:13.488848+0000","last_clean":"2024-03-18T14:41:13.488848+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:13.488848+0000","last_undegraded":"2024-03-18T14:41:13.488848+0000","last_fullsized":"2024-03-18T14:41:13.488848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484063+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:41:13.484063+0000","last_peered":"2024-03-18T14:41:13.484063+0000","last_clean":"2024-03-18T14:41:13.484063+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:41:13.484063+0000","last_undegraded":"2024-03-18T14:41:13.484063+0000","last_fullsized":"2024-03-18T14:41:13.484063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512758+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:41:13.512758+0000","last_peered":"2024-03-18T14:41:13.512758+0000","last_clean":"2024-03-18T14:41:13.512758+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:41:13.512758+0000","last_undegraded":"2024-03-18T14:41:13.512758+0000","last_fullsized":"2024-03-18T14:41:13.512758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477322+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:13.477322+0000","last_peered":"2024-03-18T14:41:13.477322+0000","last_clean":"2024-03-18T14:41:13.477322+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:13.477322+0000","last_undegraded":"2024-03-18T14:41:13.477322+0000","last_fullsized":"2024-03-18T14:41:13.477322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.474621+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:41:13.474621+0000","last_peered":"2024-03-18T14:41:13.474621+0000","last_clean":"2024-03-18T14:41:13.474621+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:41:13.474621+0000","last_undegraded":"2024-03-18T14:41:13.474621+0000","last_fullsized":"2024-03-18T14:41:13.474621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508002+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:41:13.508002+0000","last_peered":"2024-03-18T14:41:13.508002+0000","last_clean":"2024-03-18T14:41:13.508002+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:41:13.508002+0000","last_undegraded":"2024-03-18T14:41:13.508002+0000","last_fullsized":"2024-03-18T14:41:13.508002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480432+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:13.480432+0000","last_peered":"2024-03-18T14:41:13.480432+0000","last_clean":"2024-03-18T14:41:13.480432+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:13.480432+0000","last_undegraded":"2024-03-18T14:41:13.480432+0000","last_fullsized":"2024-03-18T14:41:13.480432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488890+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:41:13.488890+0000","last_peered":"2024-03-18T14:41:13.488890+0000","last_clean":"2024-03-18T14:41:13.488890+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:41:13.488890+0000","last_undegraded":"2024-03-18T14:41:13.488890+0000","last_fullsized":"2024-03-18T14:41:13.488890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.505494+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:41:13.505494+0000","last_peered":"2024-03-18T14:41:13.505494+0000","last_clean":"2024-03-18T14:41:13.505494+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:41:13.505494+0000","last_undegraded":"2024-03-18T14:41:13.505494+0000","last_fullsized":"2024-03-18T14:41:13.505494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512531+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:41:13.512531+0000","last_peered":"2024-03-18T14:41:13.512531+0000","last_clean":"2024-03-18T14:41:13.512531+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:41:13.512531+0000","last_undegraded":"2024-03-18T14:41:13.512531+0000","last_fullsized":"2024-03-18T14:41:13.512531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488209+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:13.488209+0000","last_peered":"2024-03-18T14:41:13.488209+0000","last_clean":"2024-03-18T14:41:13.488209+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:13.488209+0000","last_undegraded":"2024-03-18T14:41:13.488209+0000","last_fullsized":"2024-03-18T14:41:13.488209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512337+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:41:13.512337+0000","last_peered":"2024-03-18T14:41:13.512337+0000","last_clean":"2024-03-18T14:41:13.512337+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:41:13.512337+0000","last_undegraded":"2024-03-18T14:41:13.512337+0000","last_fullsized":"2024-03-18T14:41:13.512337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477899+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:13.477899+0000","last_peered":"2024-03-18T14:41:13.477899+0000","last_clean":"2024-03-18T14:41:13.477899+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:13.477899+0000","last_undegraded":"2024-03-18T14:41:13.477899+0000","last_fullsized":"2024-03-18T14:41:13.477899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.552483+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:41:14.552483+0000","last_peered":"2024-03-18T14:41:14.552483+0000","last_clean":"2024-03-18T14:41:14.552483+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:41:14.552483+0000","last_undegraded":"2024-03-18T14:41:14.552483+0000","last_fullsized":"2024-03-18T14:41:14.552483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503135+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:41:13.503135+0000","last_peered":"2024-03-18T14:41:13.503135+0000","last_clean":"2024-03-18T14:41:13.503135+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:41:13.503135+0000","last_undegraded":"2024-03-18T14:41:13.503135+0000","last_fullsized":"2024-03-18T14:41:13.503135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510209+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:41:13.510209+0000","last_peered":"2024-03-18T14:41:13.510209+0000","last_clean":"2024-03-18T14:41:13.510209+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:41:13.510209+0000","last_undegraded":"2024-03-18T14:41:13.510209+0000","last_fullsized":"2024-03-18T14:41:13.510209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515520+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:41:13.515520+0000","last_peered":"2024-03-18T14:41:13.515520+0000","last_clean":"2024-03-18T14:41:13.515520+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:41:13.515520+0000","last_undegraded":"2024-03-18T14:41:13.515520+0000","last_fullsized":"2024-03-18T14:41:13.515520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514297+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:41:13.514297+0000","last_peered":"2024-03-18T14:41:13.514297+0000","last_clean":"2024-03-18T14:41:13.514297+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:41:13.514297+0000","last_undegraded":"2024-03-18T14:41:13.514297+0000","last_fullsized":"2024-03-18T14:41:13.514297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504368+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:41:13.504368+0000","last_peered":"2024-03-18T14:41:13.504368+0000","last_clean":"2024-03-18T14:41:13.504368+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:41:13.504368+0000","last_undegraded":"2024-03-18T14:41:13.504368+0000","last_fullsized":"2024-03-18T14:41:13.504368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.494592+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:41:13.494592+0000","last_peered":"2024-03-18T14:41:13.494592+0000","last_clean":"2024-03-18T14:41:13.494592+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:41:13.494592+0000","last_undegraded":"2024-03-18T14:41:13.494592+0000","last_fullsized":"2024-03-18T14:41:13.494592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496751+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:41:13.496751+0000","last_peered":"2024-03-18T14:41:13.496751+0000","last_clean":"2024-03-18T14:41:13.496751+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:41:13.496751+0000","last_undegraded":"2024-03-18T14:41:13.496751+0000","last_fullsized":"2024-03-18T14:41:13.496751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499356+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:41:13.499356+0000","last_peered":"2024-03-18T14:41:13.499356+0000","last_clean":"2024-03-18T14:41:13.499356+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:41:13.499356+0000","last_undegraded":"2024-03-18T14:41:13.499356+0000","last_fullsized":"2024-03-18T14:41:13.499356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512082+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:41:13.512082+0000","last_peered":"2024-03-18T14:41:13.512082+0000","last_clean":"2024-03-18T14:41:13.512082+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:41:13.512082+0000","last_undegraded":"2024-03-18T14:41:13.512082+0000","last_fullsized":"2024-03-18T14:41:13.512082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501675+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:41:13.501675+0000","last_peered":"2024-03-18T14:41:13.501675+0000","last_clean":"2024-03-18T14:41:13.501675+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:41:13.501675+0000","last_undegraded":"2024-03-18T14:41:13.501675+0000","last_fullsized":"2024-03-18T14:41:13.501675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507403+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:41:13.507403+0000","last_peered":"2024-03-18T14:41:13.507403+0000","last_clean":"2024-03-18T14:41:13.507403+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:41:13.507403+0000","last_undegraded":"2024-03-18T14:41:13.507403+0000","last_fullsized":"2024-03-18T14:41:13.507403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516799+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:41:13.516799+0000","last_peered":"2024-03-18T14:41:13.516799+0000","last_clean":"2024-03-18T14:41:13.516799+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:41:13.516799+0000","last_undegraded":"2024-03-18T14:41:13.516799+0000","last_fullsized":"2024-03-18T14:41:13.516799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507508+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:41:13.507508+0000","last_peered":"2024-03-18T14:41:13.507508+0000","last_clean":"2024-03-18T14:41:13.507508+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:41:13.507508+0000","last_undegraded":"2024-03-18T14:41:13.507508+0000","last_fullsized":"2024-03-18T14:41:13.507508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.487107+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:41:13.487107+0000","last_peered":"2024-03-18T14:41:13.487107+0000","last_clean":"2024-03-18T14:41:13.487107+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:41:13.487107+0000","last_undegraded":"2024-03-18T14:41:13.487107+0000","last_fullsized":"2024-03-18T14:41:13.487107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510682+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:41:13.510682+0000","last_peered":"2024-03-18T14:41:13.510682+0000","last_clean":"2024-03-18T14:41:13.510682+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:41:13.510682+0000","last_undegraded":"2024-03-18T14:41:13.510682+0000","last_fullsized":"2024-03-18T14:41:13.510682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512569+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:41:13.512569+0000","last_peered":"2024-03-18T14:41:13.512569+0000","last_clean":"2024-03-18T14:41:13.512569+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:41:13.512569+0000","last_undegraded":"2024-03-18T14:41:13.512569+0000","last_fullsized":"2024-03-18T14:41:13.512569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":48126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]}]}} 2024-03-18T14:41:17.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:41:18.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.115+0000 7fb89f6dd700 1 Processor -- start 2024-03-18T14:41:18.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.115+0000 7fb89f6dd700 1 -- start start 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89f6dd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89f6dd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb898136140 0x7fb89809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89f6dd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89809bc50 con 0x7fb898064700 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89f6dd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8981365f0 con 0x7fb898136140 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89f6dd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb89809b2e0 con 0x7fb89809aa10 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89d479700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb898136140 0x7fb89809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89cc78700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb898064700 0x7fb898132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39566/0 (socket says 172.21.15.57:39566) 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89d479700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37664/0 (socket says 172.21.15.57:37664) 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89cc78700 1 -- 172.21.15.57:0/64068145 learned_addr learned my addr 172.21.15.57:0/64068145 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:18.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 -- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 msgr2=0x7fb8980621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 -- 172.21.15.57:0/64068145 >> v1:172.21.15.57:6789/0 conn(0x7fb898064700 legacy=0x7fb898132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 -- 172.21.15.57:0/64068145 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8981367e0 con 0x7fb898136140 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb887fff700 1 -- 172.21.15.57:0/64068145 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552870365 0 0) 0x7fb89809bc50 con 0x7fb898064700 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89d479700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb89dc7a700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb89809adf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8900032f0 tx=0x7fb8900091d0).ready entity=mon.0 client_cookie=60dd26c42ac52c42 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb887fff700 1 -- 172.21.15.57:0/64068145 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb89000b6c0 con 0x7fb898136140 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb887fff700 1 -- 172.21.15.57:0/64068145 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89000b820 con 0x7fb898136140 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.116+0000 7fb887fff700 1 -- 172.21.15.57:0/64068145 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb89000b990 con 0x7fb898136140 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 -- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 msgr2=0x7fb89809adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb89809adf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb8900032f0 tx=0x7fb8900091d0).stop 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 -- 172.21.15.57:0/64068145 shutdown_connections 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb89809adf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/64068145 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb8980621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 -- 172.21.15.57:0/64068145 >> 172.21.15.57:0/64068145 conn(0x7fb89806c0c0 msgr2=0x7fb89806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 -- 172.21.15.57:0/64068145 shutdown_connections 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.117+0000 7fb89f6dd700 1 -- 172.21.15.57:0/64068145 wait complete. 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 Processor -- start 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 -- start start 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 0x7fb898145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981468a0 con 0x7fb898136140 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb898066ed0 con 0x7fb898064700 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.118+0000 7fb89f6dd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8981465e0 con 0x7fb89809aa10 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89dc7a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89d479700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 0x7fb898145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37666/0 (socket says 172.21.15.57:37666) 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 -- 172.21.15.57:0/1646451230 learned_addr learned my addr 172.21.15.57:0/1646451230 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89dc7a700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40400/0 (socket says 172.21.15.57:40400) 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 -- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 msgr2=0x7fb898145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 0x7fb898145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 -- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 msgr2=0x7fb898149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 -- 172.21.15.57:0/1646451230 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88800b180 con 0x7fb89809aa10 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89dc7a700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89d479700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 0x7fb898145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89cc78700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb894000bc0 tx=0x7fb8940017e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8940070d0 con 0x7fb89809aa10 2024-03-18T14:41:18.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb894007230 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb890009470 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.119+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8940073a0 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.120+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb898149c70 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.120+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb894010070 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.120+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb898136aa0 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.121+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb894049fa0 con 0x7fb89809aa10 2024-03-18T14:41:18.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.124+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb89402ed10 con 0x7fb89809aa10 2024-03-18T14:41:18.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.238+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 --> v1:172.21.15.57:6816/39496 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb898057a60 con 0x7fb878038e60 2024-03-18T14:41:18.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.245+0000 7fb8867fc700 1 -- 172.21.15.57:0/1646451230 <== mgr.4099 v1:172.21.15.57:6816/39496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246939 (unknown 2965378022 0 2861286254) 0x7fb898057a60 con 0x7fb878038e60 2024-03-18T14:41:18.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 >> v1:172.21.15.57:6816/39496 conn(0x7fb878038e60 legacy=0x7fb87803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 msgr2=0x7fb898149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb894000bc0 tx=0x7fb8940017e0).stop 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 shutdown_connections 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb898136140 0x7fb898149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb898064700 0x7fb898145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 --2- 172.21.15.57:0/1646451230 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb89809aa10 0x7fb898149290 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 >> 172.21.15.57:0/1646451230 conn(0x7fb89806c0c0 msgr2=0x7fb89806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 shutdown_connections 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.248+0000 7fb89f6dd700 1 -- 172.21.15.57:0/1646451230 wait complete. 2024-03-18T14:41:18.252 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:41:18.259 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-18T14:41:16.409709+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195000,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292360,"statfs":{"total":386547056640,"available":382251376640,"internally_reserved":4294967296,"allocated":679936,"data_stored":203743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.283616"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504374+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:41:13.504374+0000","last_peered":"2024-03-18T14:41:13.504374+0000","last_clean":"2024-03-18T14:41:13.504374+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:41:13.504374+0000","last_undegraded":"2024-03-18T14:41:13.504374+0000","last_fullsized":"2024-03-18T14:41:13.504374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503047+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:41:13.503047+0000","last_peered":"2024-03-18T14:41:13.503047+0000","last_clean":"2024-03-18T14:41:13.503047+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:41:13.503047+0000","last_undegraded":"2024-03-18T14:41:13.503047+0000","last_fullsized":"2024-03-18T14:41:13.503047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509070+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:41:13.509070+0000","last_peered":"2024-03-18T14:41:13.509070+0000","last_clean":"2024-03-18T14:41:13.509070+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:41:13.509070+0000","last_undegraded":"2024-03-18T14:41:13.509070+0000","last_fullsized":"2024-03-18T14:41:13.509070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516068+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:41:13.516068+0000","last_peered":"2024-03-18T14:41:13.516068+0000","last_clean":"2024-03-18T14:41:13.516068+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:41:13.516068+0000","last_undegraded":"2024-03-18T14:41:13.516068+0000","last_fullsized":"2024-03-18T14:41:13.516068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508157+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:41:13.508157+0000","last_peered":"2024-03-18T14:41:13.508157+0000","last_clean":"2024-03-18T14:41:13.508157+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:41:13.508157+0000","last_undegraded":"2024-03-18T14:41:13.508157+0000","last_fullsized":"2024-03-18T14:41:13.508157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510313+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:41:13.510313+0000","last_peered":"2024-03-18T14:41:13.510313+0000","last_clean":"2024-03-18T14:41:13.510313+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:41:13.510313+0000","last_undegraded":"2024-03-18T14:41:13.510313+0000","last_fullsized":"2024-03-18T14:41:13.510313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503242+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:41:13.503242+0000","last_peered":"2024-03-18T14:41:13.503242+0000","last_clean":"2024-03-18T14:41:13.503242+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:41:13.503242+0000","last_undegraded":"2024-03-18T14:41:13.503242+0000","last_fullsized":"2024-03-18T14:41:13.503242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516825+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:41:13.516825+0000","last_peered":"2024-03-18T14:41:13.516825+0000","last_clean":"2024-03-18T14:41:13.516825+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:41:13.516825+0000","last_undegraded":"2024-03-18T14:41:13.516825+0000","last_fullsized":"2024-03-18T14:41:13.516825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507149+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:41:13.507149+0000","last_peered":"2024-03-18T14:41:13.507149+0000","last_clean":"2024-03-18T14:41:13.507149+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:41:13.507149+0000","last_undegraded":"2024-03-18T14:41:13.507149+0000","last_fullsized":"2024-03-18T14:41:13.507149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511816+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:41:13.511816+0000","last_peered":"2024-03-18T14:41:13.511816+0000","last_clean":"2024-03-18T14:41:13.511816+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:41:13.511816+0000","last_undegraded":"2024-03-18T14:41:13.511816+0000","last_fullsized":"2024-03-18T14:41:13.511816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509362+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:41:13.509362+0000","last_peered":"2024-03-18T14:41:13.509362+0000","last_clean":"2024-03-18T14:41:13.509362+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:41:13.509362+0000","last_undegraded":"2024-03-18T14:41:13.509362+0000","last_fullsized":"2024-03-18T14:41:13.509362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504253+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:41:13.504253+0000","last_peered":"2024-03-18T14:41:13.504253+0000","last_clean":"2024-03-18T14:41:13.504253+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:41:13.504253+0000","last_undegraded":"2024-03-18T14:41:13.504253+0000","last_fullsized":"2024-03-18T14:41:13.504253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504412+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:41:13.504412+0000","last_peered":"2024-03-18T14:41:13.504412+0000","last_clean":"2024-03-18T14:41:13.504412+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:41:13.504412+0000","last_undegraded":"2024-03-18T14:41:13.504412+0000","last_fullsized":"2024-03-18T14:41:13.504412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509284+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:41:13.509284+0000","last_peered":"2024-03-18T14:41:13.509284+0000","last_clean":"2024-03-18T14:41:13.509284+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:41:13.509284+0000","last_undegraded":"2024-03-18T14:41:13.509284+0000","last_fullsized":"2024-03-18T14:41:13.509284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508251+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:41:13.508251+0000","last_peered":"2024-03-18T14:41:13.508251+0000","last_clean":"2024-03-18T14:41:13.508251+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:41:13.508251+0000","last_undegraded":"2024-03-18T14:41:13.508251+0000","last_fullsized":"2024-03-18T14:41:13.508251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508362+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:41:13.508362+0000","last_peered":"2024-03-18T14:41:13.508362+0000","last_clean":"2024-03-18T14:41:13.508362+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:41:13.508362+0000","last_undegraded":"2024-03-18T14:41:13.508362+0000","last_fullsized":"2024-03-18T14:41:13.508362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508184+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:41:13.508184+0000","last_peered":"2024-03-18T14:41:13.508184+0000","last_clean":"2024-03-18T14:41:13.508184+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:41:13.508184+0000","last_undegraded":"2024-03-18T14:41:13.508184+0000","last_fullsized":"2024-03-18T14:41:13.508184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507979+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:41:13.507979+0000","last_peered":"2024-03-18T14:41:13.507979+0000","last_clean":"2024-03-18T14:41:13.507979+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:41:13.507979+0000","last_undegraded":"2024-03-18T14:41:13.507979+0000","last_fullsized":"2024-03-18T14:41:13.507979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499448+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:41:13.499448+0000","last_peered":"2024-03-18T14:41:13.499448+0000","last_clean":"2024-03-18T14:41:13.499448+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:41:13.499448+0000","last_undegraded":"2024-03-18T14:41:13.499448+0000","last_fullsized":"2024-03-18T14:41:13.499448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515134+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:41:13.515134+0000","last_peered":"2024-03-18T14:41:13.515134+0000","last_clean":"2024-03-18T14:41:13.515134+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:41:13.515134+0000","last_undegraded":"2024-03-18T14:41:13.515134+0000","last_fullsized":"2024-03-18T14:41:13.515134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516394+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:41:13.516394+0000","last_peered":"2024-03-18T14:41:13.516394+0000","last_clean":"2024-03-18T14:41:13.516394+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:41:13.516394+0000","last_undegraded":"2024-03-18T14:41:13.516394+0000","last_fullsized":"2024-03-18T14:41:13.516394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507867+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:41:13.507867+0000","last_peered":"2024-03-18T14:41:13.507867+0000","last_clean":"2024-03-18T14:41:13.507867+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:41:13.507867+0000","last_undegraded":"2024-03-18T14:41:13.507867+0000","last_fullsized":"2024-03-18T14:41:13.507867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507480+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:41:13.507480+0000","last_peered":"2024-03-18T14:41:13.507480+0000","last_clean":"2024-03-18T14:41:13.507480+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:41:13.507480+0000","last_undegraded":"2024-03-18T14:41:13.507480+0000","last_fullsized":"2024-03-18T14:41:13.507480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516851+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:41:13.516851+0000","last_peered":"2024-03-18T14:41:13.516851+0000","last_clean":"2024-03-18T14:41:13.516851+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:41:13.516851+0000","last_undegraded":"2024-03-18T14:41:13.516851+0000","last_fullsized":"2024-03-18T14:41:13.516851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516907+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:41:13.516907+0000","last_peered":"2024-03-18T14:41:13.516907+0000","last_clean":"2024-03-18T14:41:13.516907+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:41:13.516907+0000","last_undegraded":"2024-03-18T14:41:13.516907+0000","last_fullsized":"2024-03-18T14:41:13.516907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511840+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:41:13.511840+0000","last_peered":"2024-03-18T14:41:13.511840+0000","last_clean":"2024-03-18T14:41:13.511840+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:41:13.511840+0000","last_undegraded":"2024-03-18T14:41:13.511840+0000","last_fullsized":"2024-03-18T14:41:13.511840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507840+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:41:13.507840+0000","last_peered":"2024-03-18T14:41:13.507840+0000","last_clean":"2024-03-18T14:41:13.507840+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:41:13.507840+0000","last_undegraded":"2024-03-18T14:41:13.507840+0000","last_fullsized":"2024-03-18T14:41:13.507840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504184+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:41:13.504184+0000","last_peered":"2024-03-18T14:41:13.504184+0000","last_clean":"2024-03-18T14:41:13.504184+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:41:13.504184+0000","last_undegraded":"2024-03-18T14:41:13.504184+0000","last_fullsized":"2024-03-18T14:41:13.504184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512707+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:41:13.512707+0000","last_peered":"2024-03-18T14:41:13.512707+0000","last_clean":"2024-03-18T14:41:13.512707+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:41:13.512707+0000","last_undegraded":"2024-03-18T14:41:13.512707+0000","last_fullsized":"2024-03-18T14:41:13.512707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488074+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:41:13.488074+0000","last_peered":"2024-03-18T14:41:13.488074+0000","last_clean":"2024-03-18T14:41:13.488074+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:41:13.488074+0000","last_undegraded":"2024-03-18T14:41:13.488074+0000","last_fullsized":"2024-03-18T14:41:13.488074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508888+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:41:13.508888+0000","last_peered":"2024-03-18T14:41:13.508888+0000","last_clean":"2024-03-18T14:41:13.508888+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:41:13.508888+0000","last_undegraded":"2024-03-18T14:41:13.508888+0000","last_fullsized":"2024-03-18T14:41:13.508888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477453+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:41:13.477453+0000","last_peered":"2024-03-18T14:41:13.477453+0000","last_clean":"2024-03-18T14:41:13.477453+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:41:13.477453+0000","last_undegraded":"2024-03-18T14:41:13.477453+0000","last_fullsized":"2024-03-18T14:41:13.477453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509484+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:41:13.509484+0000","last_peered":"2024-03-18T14:41:13.509484+0000","last_clean":"2024-03-18T14:41:13.509484+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:41:13.509484+0000","last_undegraded":"2024-03-18T14:41:13.509484+0000","last_fullsized":"2024-03-18T14:41:13.509484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.472856+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:41:13.472856+0000","last_peered":"2024-03-18T14:41:13.472856+0000","last_clean":"2024-03-18T14:41:13.472856+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:41:13.472856+0000","last_undegraded":"2024-03-18T14:41:13.472856+0000","last_fullsized":"2024-03-18T14:41:13.472856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512366+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:41:13.512366+0000","last_peered":"2024-03-18T14:41:13.512366+0000","last_clean":"2024-03-18T14:41:13.512366+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:41:13.512366+0000","last_undegraded":"2024-03-18T14:41:13.512366+0000","last_fullsized":"2024-03-18T14:41:13.512366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.473392+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:41:13.473392+0000","last_peered":"2024-03-18T14:41:13.473392+0000","last_clean":"2024-03-18T14:41:13.473392+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:41:13.473392+0000","last_undegraded":"2024-03-18T14:41:13.473392+0000","last_fullsized":"2024-03-18T14:41:13.473392+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507540+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:41:13.507540+0000","last_peered":"2024-03-18T14:41:13.507540+0000","last_clean":"2024-03-18T14:41:13.507540+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:41:13.507540+0000","last_undegraded":"2024-03-18T14:41:13.507540+0000","last_fullsized":"2024-03-18T14:41:13.507540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"17'3","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496672+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:41:13.496672+0000","last_peered":"2024-03-18T14:41:13.496672+0000","last_clean":"2024-03-18T14:41:13.496672+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:41:13.496672+0000","last_undegraded":"2024-03-18T14:41:13.496672+0000","last_fullsized":"2024-03-18T14:41:13.496672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509259+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:41:13.509259+0000","last_peered":"2024-03-18T14:41:13.509259+0000","last_clean":"2024-03-18T14:41:13.509259+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:41:13.509259+0000","last_undegraded":"2024-03-18T14:41:13.509259+0000","last_fullsized":"2024-03-18T14:41:13.509259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"17'6","reported_seq":16,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.517237+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:41:13.517237+0000","last_peered":"2024-03-18T14:41:13.517237+0000","last_clean":"2024-03-18T14:41:13.517237+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:41:13.517237+0000","last_undegraded":"2024-03-18T14:41:13.517237+0000","last_fullsized":"2024-03-18T14:41:13.517237+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504392+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:41:13.504392+0000","last_peered":"2024-03-18T14:41:13.504392+0000","last_clean":"2024-03-18T14:41:13.504392+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:41:13.504392+0000","last_undegraded":"2024-03-18T14:41:13.504392+0000","last_fullsized":"2024-03-18T14:41:13.504392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510787+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:41:13.510787+0000","last_peered":"2024-03-18T14:41:13.510787+0000","last_clean":"2024-03-18T14:41:13.510787+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:41:13.510787+0000","last_undegraded":"2024-03-18T14:41:13.510787+0000","last_fullsized":"2024-03-18T14:41:13.510787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515468+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:41:13.515468+0000","last_peered":"2024-03-18T14:41:13.515468+0000","last_clean":"2024-03-18T14:41:13.515468+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:41:13.515468+0000","last_undegraded":"2024-03-18T14:41:13.515468+0000","last_fullsized":"2024-03-18T14:41:13.515468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.474515+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:41:13.474515+0000","last_peered":"2024-03-18T14:41:13.474515+0000","last_clean":"2024-03-18T14:41:13.474515+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:41:13.474515+0000","last_undegraded":"2024-03-18T14:41:13.474515+0000","last_fullsized":"2024-03-18T14:41:13.474515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507827+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:41:13.507827+0000","last_peered":"2024-03-18T14:41:13.507827+0000","last_clean":"2024-03-18T14:41:13.507827+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:41:13.507827+0000","last_undegraded":"2024-03-18T14:41:13.507827+0000","last_fullsized":"2024-03-18T14:41:13.507827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480111+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:41:13.480111+0000","last_peered":"2024-03-18T14:41:13.480111+0000","last_clean":"2024-03-18T14:41:13.480111+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:41:13.480111+0000","last_undegraded":"2024-03-18T14:41:13.480111+0000","last_fullsized":"2024-03-18T14:41:13.480111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.506508+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:41:13.506508+0000","last_peered":"2024-03-18T14:41:13.506508+0000","last_clean":"2024-03-18T14:41:13.506508+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:41:13.506508+0000","last_undegraded":"2024-03-18T14:41:13.506508+0000","last_fullsized":"2024-03-18T14:41:13.506508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"17'8","reported_seq":18,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516329+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:41:13.516329+0000","last_peered":"2024-03-18T14:41:13.516329+0000","last_clean":"2024-03-18T14:41:13.516329+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:41:13.516329+0000","last_undegraded":"2024-03-18T14:41:13.516329+0000","last_fullsized":"2024-03-18T14:41:13.516329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509504+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:41:13.509504+0000","last_peered":"2024-03-18T14:41:13.509504+0000","last_clean":"2024-03-18T14:41:13.509504+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:41:13.509504+0000","last_undegraded":"2024-03-18T14:41:13.509504+0000","last_fullsized":"2024-03-18T14:41:13.509504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501819+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:41:13.501819+0000","last_peered":"2024-03-18T14:41:13.501819+0000","last_clean":"2024-03-18T14:41:13.501819+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:41:13.501819+0000","last_undegraded":"2024-03-18T14:41:13.501819+0000","last_fullsized":"2024-03-18T14:41:13.501819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515787+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:41:13.515787+0000","last_peered":"2024-03-18T14:41:13.515787+0000","last_clean":"2024-03-18T14:41:13.515787+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:41:13.515787+0000","last_undegraded":"2024-03-18T14:41:13.515787+0000","last_fullsized":"2024-03-18T14:41:13.515787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.495818+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:41:13.495818+0000","last_peered":"2024-03-18T14:41:13.495818+0000","last_clean":"2024-03-18T14:41:13.495818+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:41:13.495818+0000","last_undegraded":"2024-03-18T14:41:13.495818+0000","last_fullsized":"2024-03-18T14:41:13.495818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509149+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:41:13.509149+0000","last_peered":"2024-03-18T14:41:13.509149+0000","last_clean":"2024-03-18T14:41:13.509149+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:41:13.509149+0000","last_undegraded":"2024-03-18T14:41:13.509149+0000","last_fullsized":"2024-03-18T14:41:13.509149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512633+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:41:13.512633+0000","last_peered":"2024-03-18T14:41:13.512633+0000","last_clean":"2024-03-18T14:41:13.512633+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:41:13.512633+0000","last_undegraded":"2024-03-18T14:41:13.512633+0000","last_fullsized":"2024-03-18T14:41:13.512633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496729+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:41:13.496729+0000","last_peered":"2024-03-18T14:41:13.496729+0000","last_clean":"2024-03-18T14:41:13.496729+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:41:13.496729+0000","last_undegraded":"2024-03-18T14:41:13.496729+0000","last_fullsized":"2024-03-18T14:41:13.496729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471863+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:41:13.471863+0000","last_peered":"2024-03-18T14:41:13.471863+0000","last_clean":"2024-03-18T14:41:13.471863+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:41:13.471863+0000","last_undegraded":"2024-03-18T14:41:13.471863+0000","last_fullsized":"2024-03-18T14:41:13.471863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508108+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:41:13.508108+0000","last_peered":"2024-03-18T14:41:13.508108+0000","last_clean":"2024-03-18T14:41:13.508108+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:41:13.508108+0000","last_undegraded":"2024-03-18T14:41:13.508108+0000","last_fullsized":"2024-03-18T14:41:13.508108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.497201+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:41:13.497201+0000","last_peered":"2024-03-18T14:41:13.497201+0000","last_clean":"2024-03-18T14:41:13.497201+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:41:13.497201+0000","last_undegraded":"2024-03-18T14:41:13.497201+0000","last_fullsized":"2024-03-18T14:41:13.497201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.492488+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:41:13.492488+0000","last_peered":"2024-03-18T14:41:13.492488+0000","last_clean":"2024-03-18T14:41:13.492488+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:41:13.492488+0000","last_undegraded":"2024-03-18T14:41:13.492488+0000","last_fullsized":"2024-03-18T14:41:13.492488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484336+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:41:13.484336+0000","last_peered":"2024-03-18T14:41:13.484336+0000","last_clean":"2024-03-18T14:41:13.484336+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:41:13.484336+0000","last_undegraded":"2024-03-18T14:41:13.484336+0000","last_fullsized":"2024-03-18T14:41:13.484336+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512732+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:41:13.512732+0000","last_peered":"2024-03-18T14:41:13.512732+0000","last_clean":"2024-03-18T14:41:13.512732+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:41:13.512732+0000","last_undegraded":"2024-03-18T14:41:13.512732+0000","last_fullsized":"2024-03-18T14:41:13.512732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.479565+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:41:13.479565+0000","last_peered":"2024-03-18T14:41:13.479565+0000","last_clean":"2024-03-18T14:41:13.479565+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:41:13.479565+0000","last_undegraded":"2024-03-18T14:41:13.479565+0000","last_fullsized":"2024-03-18T14:41:13.479565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503072+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:41:13.503072+0000","last_peered":"2024-03-18T14:41:13.503072+0000","last_clean":"2024-03-18T14:41:13.503072+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:41:13.503072+0000","last_undegraded":"2024-03-18T14:41:13.503072+0000","last_fullsized":"2024-03-18T14:41:13.503072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477150+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:41:13.477150+0000","last_peered":"2024-03-18T14:41:13.477150+0000","last_clean":"2024-03-18T14:41:13.477150+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:41:13.477150+0000","last_undegraded":"2024-03-18T14:41:13.477150+0000","last_fullsized":"2024-03-18T14:41:13.477150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514205+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:41:13.514205+0000","last_peered":"2024-03-18T14:41:13.514205+0000","last_clean":"2024-03-18T14:41:13.514205+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:41:13.514205+0000","last_undegraded":"2024-03-18T14:41:13.514205+0000","last_fullsized":"2024-03-18T14:41:13.514205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.489432+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:13.489432+0000","last_peered":"2024-03-18T14:41:13.489432+0000","last_clean":"2024-03-18T14:41:13.489432+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:13.489432+0000","last_undegraded":"2024-03-18T14:41:13.489432+0000","last_fullsized":"2024-03-18T14:41:13.489432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471240+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:41:13.471240+0000","last_peered":"2024-03-18T14:41:13.471240+0000","last_clean":"2024-03-18T14:41:13.471240+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:41:13.471240+0000","last_undegraded":"2024-03-18T14:41:13.471240+0000","last_fullsized":"2024-03-18T14:41:13.471240+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509233+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:41:13.509233+0000","last_peered":"2024-03-18T14:41:13.509233+0000","last_clean":"2024-03-18T14:41:13.509233+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:41:13.509233+0000","last_undegraded":"2024-03-18T14:41:13.509233+0000","last_fullsized":"2024-03-18T14:41:13.509233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.486304+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:13.486304+0000","last_peered":"2024-03-18T14:41:13.486304+0000","last_clean":"2024-03-18T14:41:13.486304+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:13.486304+0000","last_undegraded":"2024-03-18T14:41:13.486304+0000","last_fullsized":"2024-03-18T14:41:13.486304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.472527+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:41:13.472527+0000","last_peered":"2024-03-18T14:41:13.472527+0000","last_clean":"2024-03-18T14:41:13.472527+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:41:13.472527+0000","last_undegraded":"2024-03-18T14:41:13.472527+0000","last_fullsized":"2024-03-18T14:41:13.472527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512594+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:41:13.512594+0000","last_peered":"2024-03-18T14:41:13.512594+0000","last_clean":"2024-03-18T14:41:13.512594+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:41:13.512594+0000","last_undegraded":"2024-03-18T14:41:13.512594+0000","last_fullsized":"2024-03-18T14:41:13.512594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471693+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:13.471693+0000","last_peered":"2024-03-18T14:41:13.471693+0000","last_clean":"2024-03-18T14:41:13.471693+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:13.471693+0000","last_undegraded":"2024-03-18T14:41:13.471693+0000","last_fullsized":"2024-03-18T14:41:13.471693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488990+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:41:13.488990+0000","last_peered":"2024-03-18T14:41:13.488990+0000","last_clean":"2024-03-18T14:41:13.488990+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:41:13.488990+0000","last_undegraded":"2024-03-18T14:41:13.488990+0000","last_fullsized":"2024-03-18T14:41:13.488990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514181+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:41:13.514181+0000","last_peered":"2024-03-18T14:41:13.514181+0000","last_clean":"2024-03-18T14:41:13.514181+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:41:13.514181+0000","last_undegraded":"2024-03-18T14:41:13.514181+0000","last_fullsized":"2024-03-18T14:41:13.514181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.478113+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:13.478113+0000","last_peered":"2024-03-18T14:41:13.478113+0000","last_clean":"2024-03-18T14:41:13.478113+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:13.478113+0000","last_undegraded":"2024-03-18T14:41:13.478113+0000","last_fullsized":"2024-03-18T14:41:13.478113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488848+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:13.488848+0000","last_peered":"2024-03-18T14:41:13.488848+0000","last_clean":"2024-03-18T14:41:13.488848+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:13.488848+0000","last_undegraded":"2024-03-18T14:41:13.488848+0000","last_fullsized":"2024-03-18T14:41:13.488848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484063+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:41:13.484063+0000","last_peered":"2024-03-18T14:41:13.484063+0000","last_clean":"2024-03-18T14:41:13.484063+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:41:13.484063+0000","last_undegraded":"2024-03-18T14:41:13.484063+0000","last_fullsized":"2024-03-18T14:41:13.484063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512758+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:41:13.512758+0000","last_peered":"2024-03-18T14:41:13.512758+0000","last_clean":"2024-03-18T14:41:13.512758+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:41:13.512758+0000","last_undegraded":"2024-03-18T14:41:13.512758+0000","last_fullsized":"2024-03-18T14:41:13.512758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477322+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:13.477322+0000","last_peered":"2024-03-18T14:41:13.477322+0000","last_clean":"2024-03-18T14:41:13.477322+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:13.477322+0000","last_undegraded":"2024-03-18T14:41:13.477322+0000","last_fullsized":"2024-03-18T14:41:13.477322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.474621+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:41:13.474621+0000","last_peered":"2024-03-18T14:41:13.474621+0000","last_clean":"2024-03-18T14:41:13.474621+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:41:13.474621+0000","last_undegraded":"2024-03-18T14:41:13.474621+0000","last_fullsized":"2024-03-18T14:41:13.474621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508002+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:41:13.508002+0000","last_peered":"2024-03-18T14:41:13.508002+0000","last_clean":"2024-03-18T14:41:13.508002+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:41:13.508002+0000","last_undegraded":"2024-03-18T14:41:13.508002+0000","last_fullsized":"2024-03-18T14:41:13.508002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480432+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:13.480432+0000","last_peered":"2024-03-18T14:41:13.480432+0000","last_clean":"2024-03-18T14:41:13.480432+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:13.480432+0000","last_undegraded":"2024-03-18T14:41:13.480432+0000","last_fullsized":"2024-03-18T14:41:13.480432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488890+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:41:13.488890+0000","last_peered":"2024-03-18T14:41:13.488890+0000","last_clean":"2024-03-18T14:41:13.488890+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:41:13.488890+0000","last_undegraded":"2024-03-18T14:41:13.488890+0000","last_fullsized":"2024-03-18T14:41:13.488890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.505494+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:41:13.505494+0000","last_peered":"2024-03-18T14:41:13.505494+0000","last_clean":"2024-03-18T14:41:13.505494+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:41:13.505494+0000","last_undegraded":"2024-03-18T14:41:13.505494+0000","last_fullsized":"2024-03-18T14:41:13.505494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512531+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:41:13.512531+0000","last_peered":"2024-03-18T14:41:13.512531+0000","last_clean":"2024-03-18T14:41:13.512531+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:41:13.512531+0000","last_undegraded":"2024-03-18T14:41:13.512531+0000","last_fullsized":"2024-03-18T14:41:13.512531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488209+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:13.488209+0000","last_peered":"2024-03-18T14:41:13.488209+0000","last_clean":"2024-03-18T14:41:13.488209+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:13.488209+0000","last_undegraded":"2024-03-18T14:41:13.488209+0000","last_fullsized":"2024-03-18T14:41:13.488209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512337+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:41:13.512337+0000","last_peered":"2024-03-18T14:41:13.512337+0000","last_clean":"2024-03-18T14:41:13.512337+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:41:13.512337+0000","last_undegraded":"2024-03-18T14:41:13.512337+0000","last_fullsized":"2024-03-18T14:41:13.512337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477899+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:13.477899+0000","last_peered":"2024-03-18T14:41:13.477899+0000","last_clean":"2024-03-18T14:41:13.477899+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:13.477899+0000","last_undegraded":"2024-03-18T14:41:13.477899+0000","last_fullsized":"2024-03-18T14:41:13.477899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.552483+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:41:14.552483+0000","last_peered":"2024-03-18T14:41:14.552483+0000","last_clean":"2024-03-18T14:41:14.552483+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:41:14.552483+0000","last_undegraded":"2024-03-18T14:41:14.552483+0000","last_fullsized":"2024-03-18T14:41:14.552483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503135+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:41:13.503135+0000","last_peered":"2024-03-18T14:41:13.503135+0000","last_clean":"2024-03-18T14:41:13.503135+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:41:13.503135+0000","last_undegraded":"2024-03-18T14:41:13.503135+0000","last_fullsized":"2024-03-18T14:41:13.503135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510209+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:41:13.510209+0000","last_peered":"2024-03-18T14:41:13.510209+0000","last_clean":"2024-03-18T14:41:13.510209+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:41:13.510209+0000","last_undegraded":"2024-03-18T14:41:13.510209+0000","last_fullsized":"2024-03-18T14:41:13.510209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515520+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:41:13.515520+0000","last_peered":"2024-03-18T14:41:13.515520+0000","last_clean":"2024-03-18T14:41:13.515520+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:41:13.515520+0000","last_undegraded":"2024-03-18T14:41:13.515520+0000","last_fullsized":"2024-03-18T14:41:13.515520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514297+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:41:13.514297+0000","last_peered":"2024-03-18T14:41:13.514297+0000","last_clean":"2024-03-18T14:41:13.514297+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:41:13.514297+0000","last_undegraded":"2024-03-18T14:41:13.514297+0000","last_fullsized":"2024-03-18T14:41:13.514297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504368+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:41:13.504368+0000","last_peered":"2024-03-18T14:41:13.504368+0000","last_clean":"2024-03-18T14:41:13.504368+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:41:13.504368+0000","last_undegraded":"2024-03-18T14:41:13.504368+0000","last_fullsized":"2024-03-18T14:41:13.504368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.494592+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:41:13.494592+0000","last_peered":"2024-03-18T14:41:13.494592+0000","last_clean":"2024-03-18T14:41:13.494592+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:41:13.494592+0000","last_undegraded":"2024-03-18T14:41:13.494592+0000","last_fullsized":"2024-03-18T14:41:13.494592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496751+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:41:13.496751+0000","last_peered":"2024-03-18T14:41:13.496751+0000","last_clean":"2024-03-18T14:41:13.496751+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:41:13.496751+0000","last_undegraded":"2024-03-18T14:41:13.496751+0000","last_fullsized":"2024-03-18T14:41:13.496751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499356+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:41:13.499356+0000","last_peered":"2024-03-18T14:41:13.499356+0000","last_clean":"2024-03-18T14:41:13.499356+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:41:13.499356+0000","last_undegraded":"2024-03-18T14:41:13.499356+0000","last_fullsized":"2024-03-18T14:41:13.499356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512082+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:41:13.512082+0000","last_peered":"2024-03-18T14:41:13.512082+0000","last_clean":"2024-03-18T14:41:13.512082+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:41:13.512082+0000","last_undegraded":"2024-03-18T14:41:13.512082+0000","last_fullsized":"2024-03-18T14:41:13.512082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501675+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:41:13.501675+0000","last_peered":"2024-03-18T14:41:13.501675+0000","last_clean":"2024-03-18T14:41:13.501675+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:41:13.501675+0000","last_undegraded":"2024-03-18T14:41:13.501675+0000","last_fullsized":"2024-03-18T14:41:13.501675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507403+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:41:13.507403+0000","last_peered":"2024-03-18T14:41:13.507403+0000","last_clean":"2024-03-18T14:41:13.507403+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:41:13.507403+0000","last_undegraded":"2024-03-18T14:41:13.507403+0000","last_fullsized":"2024-03-18T14:41:13.507403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516799+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:41:13.516799+0000","last_peered":"2024-03-18T14:41:13.516799+0000","last_clean":"2024-03-18T14:41:13.516799+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:41:13.516799+0000","last_undegraded":"2024-03-18T14:41:13.516799+0000","last_fullsized":"2024-03-18T14:41:13.516799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507508+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:41:13.507508+0000","last_peered":"2024-03-18T14:41:13.507508+0000","last_clean":"2024-03-18T14:41:13.507508+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:41:13.507508+0000","last_undegraded":"2024-03-18T14:41:13.507508+0000","last_fullsized":"2024-03-18T14:41:13.507508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.487107+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:41:13.487107+0000","last_peered":"2024-03-18T14:41:13.487107+0000","last_clean":"2024-03-18T14:41:13.487107+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:41:13.487107+0000","last_undegraded":"2024-03-18T14:41:13.487107+0000","last_fullsized":"2024-03-18T14:41:13.487107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510682+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:41:13.510682+0000","last_peered":"2024-03-18T14:41:13.510682+0000","last_clean":"2024-03-18T14:41:13.510682+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:41:13.510682+0000","last_undegraded":"2024-03-18T14:41:13.510682+0000","last_fullsized":"2024-03-18T14:41:13.510682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512569+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:41:13.512569+0000","last_peered":"2024-03-18T14:41:13.512569+0000","last_clean":"2024-03-18T14:41:13.512569+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:41:13.512569+0000","last_undegraded":"2024-03-18T14:41:13.512569+0000","last_fullsized":"2024-03-18T14:41:13.512569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048760,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323080,"statfs":{"total":96636764160,"available":95562833920,"internally_reserved":1073741824,"allocated":180224,"data_stored":52577,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048740,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323100,"statfs":{"total":96636764160,"available":95562854400,"internally_reserved":1073741824,"allocated":159744,"data_stored":48126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]}]}]}} 2024-03-18T14:41:18.263 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T14:41:18.264 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T14:41:18.264 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T14:41:18.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T14:41:18.265 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-18T14:41:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.404+0000 7f789d9ad700 1 Processor -- start 2024-03-18T14:41:18.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.404+0000 7f789d9ad700 1 -- start start 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f789d9ad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f789d9ad700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f789d9ad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78980603c0 con 0x7f7898132df0 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f789d9ad700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78980aa230 con 0x7f789813e600 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f789d9ad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78980aa4d0 con 0x7f78980aae90 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f7896ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7898132df0 0x7f7898060dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39570/0 (socket says 172.21.15.57:39570) 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46220/0 (socket says 172.21.15.57:46220) 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78977fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40414/0 (socket says 172.21.15.57:40414) 2024-03-18T14:41:18.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 -- 172.21.15.57:0/1901565063 learned_addr learned my addr 172.21.15.57:0/1901565063 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 -- 172.21.15.57:0/1901565063 >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 msgr2=0x7f78981409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 --2- 172.21.15.57:0/1901565063 >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 -- 172.21.15.57:0/1901565063 >> v1:172.21.15.57:6789/0 conn(0x7f7898132df0 legacy=0x7f7898060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 -- 172.21.15.57:0/1901565063 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980aa790 con 0x7f78980aae90 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78977fe700 1 --2- 172.21.15.57:0/1901565063 >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f78967fc700 1 --2- 172.21.15.57:0/1901565063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7888002f70 tx=0x7f7888006eb0).ready entity=mon.1 client_cookie=af8a2e82f3c13c1e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.405+0000 7f7895ffb700 1 -- 172.21.15.57:0/1901565063 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f788800d570 con 0x7f78980aae90 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f7895ffb700 1 -- 172.21.15.57:0/1901565063 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7888000e90 con 0x7f78980aae90 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f7895ffb700 1 -- 172.21.15.57:0/1901565063 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f788800d900 con 0x7f78980aae90 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 -- 172.21.15.57:0/1901565063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 msgr2=0x7f78981331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1901565063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7888002f70 tx=0x7f7888006eb0).stop 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 -- 172.21.15.57:0/1901565063 shutdown_connections 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1901565063 >> v2:172.21.15.57:3300/0 conn(0x7f789813e600 0x7f78981409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1901565063 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f78980aae90 0x7f78981331d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 -- 172.21.15.57:0/1901565063 >> 172.21.15.57:0/1901565063 conn(0x7f789805c300 msgr2=0x7f789806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 -- 172.21.15.57:0/1901565063 shutdown_connections 2024-03-18T14:41:18.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.406+0000 7f789d9ad700 1 -- 172.21.15.57:0/1901565063 wait complete. 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.407+0000 7f789d9ad700 1 Processor -- start 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.407+0000 7f789d9ad700 1 -- start start 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 0x7f7898092890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78980920a0 con 0x7f7898132df0 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789813bc90 con 0x7f789813e600 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f789d9ad700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78981457c0 con 0x7f78980aae90 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f7896ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 0x7f7898092890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78967fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40426/0 (socket says 172.21.15.57:40426) 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78967fc700 1 -- 172.21.15.57:0/1699250372 learned_addr learned my addr 172.21.15.57:0/1699250372 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46224/0 (socket says 172.21.15.57:46224) 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f7896ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 0x7f7898092890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37678/0 (socket says 172.21.15.57:37678) 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 -- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 msgr2=0x7f7898092890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 0x7f7898092890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 -- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 msgr2=0x7f7898093070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78977fe700 1 -- 172.21.15.57:0/1699250372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7890009470 con 0x7f789813e600 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.408+0000 7f78967fc700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f78977fe700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f789000c000 tx=0x7f78900091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7890012600 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7890012760 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788800b1e0 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7890012ac0 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.409+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78980945e0 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.410+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7890022070 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.410+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7898092d90 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.410+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f789004ae80 con 0x7f789813e600 2024-03-18T14:41:18.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.413+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f78900337b0 con 0x7f789813e600 2024-03-18T14:41:18.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.549+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f78980a9a90 con 0x7f789813e600 2024-03-18T14:41:18.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.551+0000 7f7887fff700 1 -- 172.21.15.57:0/1699250372 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84879 (secure 0 0 0) 0x7f78900333a0 con 0x7f789813e600 2024-03-18T14:41:18.553 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 >> v1:172.21.15.57:6816/39496 conn(0x7f7874038da0 legacy=0x7f787403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 msgr2=0x7f78980940f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f789000c000 tx=0x7f78900091d0).stop 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 shutdown_connections 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f789813e600 0x7f78980940f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f78980aae90 0x7f7898092890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 --2- 172.21.15.57:0/1699250372 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7898132df0 0x7f7898093070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.552+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 >> 172.21.15.57:0/1699250372 conn(0x7f789805c300 msgr2=0x7f78980a8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.553+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 shutdown_connections 2024-03-18T14:41:18.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.553+0000 7f789d9ad700 1 -- 172.21.15.57:0/1699250372 wait complete. 2024-03-18T14:41:18.564 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":39496}]},"active_addr":"172.21.15.57:6816/39496","active_change":"2024-03-18T14:40:56.396537+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2355346234}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2550387238}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1711862619}]}]}} 2024-03-18T14:41:18.566 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T14:41:18.566 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T14:41:18.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.670+0000 7fdc66498700 1 Processor -- start 2024-03-18T14:41:18.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.670+0000 7fdc66498700 1 -- start start 2024-03-18T14:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc600a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 0x7fdc600a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6009f800 con 0x7fdc600a4ab0 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600a50b0 con 0x7fdc6009d570 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc66498700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc600a4190 con 0x7fdc6005e170 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc600a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46238/0 (socket says 172.21.15.57:46238) 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5f7fe700 1 -- 172.21.15.57:0/2834308470 learned_addr learned my addr 172.21.15.57:0/2834308470 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc64a35700 1 --2- 172.21.15.57:0/2834308470 >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 0x7fdc600a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 -- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 msgr2=0x7fdc600a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 -- 172.21.15.57:0/2834308470 >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 msgr2=0x7fdc600a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 --2- 172.21.15.57:0/2834308470 >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 0x7fdc600a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 -- 172.21.15.57:0/2834308470 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6005e550 con 0x7fdc6005e170 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5f7fe700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc64a35700 1 --2- 172.21.15.57:0/2834308470 >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 0x7fdc600a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.671+0000 7fdc5ffff700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc600a45c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdc6009f940 tx=0x7fdc50006df0).ready entity=mon.2 client_cookie=6927acbe32dedd07 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc5effd700 1 -- 172.21.15.57:0/2834308470 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc5000d570 con 0x7fdc6005e170 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc5effd700 1 -- 172.21.15.57:0/2834308470 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50000e90 con 0x7fdc6005e170 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc5effd700 1 -- 172.21.15.57:0/2834308470 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc5000d8c0 con 0x7fdc6005e170 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 -- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 msgr2=0x7fdc600a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc600a45c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdc6009f940 tx=0x7fdc50006df0).stop 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 -- 172.21.15.57:0/2834308470 shutdown_connections 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 --2- 172.21.15.57:0/2834308470 >> v2:172.21.15.57:3300/0 conn(0x7fdc600a4ab0 0x7fdc600a24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc600a45c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 --2- 172.21.15.57:0/2834308470 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc6009d570 0x7fdc600a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 -- 172.21.15.57:0/2834308470 >> 172.21.15.57:0/2834308470 conn(0x7fdc600a93f0 msgr2=0x7fdc600a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 -- 172.21.15.57:0/2834308470 shutdown_connections 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.672+0000 7fdc66498700 1 -- 172.21.15.57:0/2834308470 wait complete. 2024-03-18T14:41:18.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.673+0000 7fdc66498700 1 Processor -- start 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.673+0000 7fdc66498700 1 -- start start 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc60131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 0x7fdc600a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 0x7fdc6012e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60131220 con 0x7fdc6009d570 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60130a40 con 0x7fdc600a4ab0 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc66498700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60137850 con 0x7fdc6005e170 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 0x7fdc600a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 0x7fdc600a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40438/0 (socket says 172.21.15.57:40438) 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc5f7fe700 1 -- 172.21.15.57:0/3022896127 learned_addr learned my addr 172.21.15.57:0/3022896127 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 0x7fdc6012e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc5ffff700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc60131670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 -- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 msgr2=0x7fdc60131670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc60131670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 -- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 msgr2=0x7fdc600a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 0x7fdc600a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 -- 172.21.15.57:0/3022896127 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5400b1e0 con 0x7fdc600a4ab0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc64a35700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 0x7fdc6012e310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdc5800c000 tx=0x7fdc580091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.674+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc58012600 con 0x7fdc600a4ab0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58012760 con 0x7fdc600a4ab0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc58009470 con 0x7fdc600a4ab0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc58012ac0 con 0x7fdc600a4ab0 2024-03-18T14:41:18.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5000b180 con 0x7fdc600a4ab0 2024-03-18T14:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdc58022070 con 0x7fdc600a4ab0 2024-03-18T14:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.675+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc60131390 con 0x7fdc600a4ab0 2024-03-18T14:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.676+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdc5804aeb0 con 0x7fdc600a4ab0 2024-03-18T14:41:18.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.679+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdc5802fdb0 con 0x7fdc600a4ab0 2024-03-18T14:41:18.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.797+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc6009df90 con 0x7fdc600a4ab0 2024-03-18T14:41:18.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.798+0000 7fdc5d7fa700 1 -- 172.21.15.57:0/3022896127 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fdc58016030 con 0x7fdc600a4ab0 2024-03-18T14:41:18.799 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:18.799 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 >> v1:172.21.15.57:6816/39496 conn(0x7fdc40038ec0 legacy=0x7fdc4003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 msgr2=0x7fdc6012e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 0x7fdc6012e310 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fdc5800c000 tx=0x7fdc580091d0).stop 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 shutdown_connections 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc600a4ab0 0x7fdc6012e310 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc6005e170 0x7fdc60131670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 --2- 172.21.15.57:0/3022896127 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc6009d570 0x7fdc600a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 >> 172.21.15.57:0/3022896127 conn(0x7fdc600a93f0 msgr2=0x7fdc6005b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 shutdown_connections 2024-03-18T14:41:18.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.799+0000 7fdc66498700 1 -- 172.21.15.57:0/3022896127 wait complete. 2024-03-18T14:41:18.811 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T14:41:18.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 Processor -- start 2024-03-18T14:41:18.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 -- start start 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c28067990 con 0x7f3c28067570 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a4c50 con 0x7f3c28139fa0 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2f018700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a4f10 con 0x7f3c281337e0 2024-03-18T14:41:18.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2cdb4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2d5b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c27fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3c28067570 0x7f3c28139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39584/0 (socket says 172.21.15.57:39584) 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2cdb4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37712/0 (socket says 172.21.15.57:37712) 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.916+0000 7f3c2d5b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46258/0 (socket says 172.21.15.57:46258) 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c27fff700 1 -- 172.21.15.57:0/3729616420 learned_addr learned my addr 172.21.15.57:0/3729616420 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c277fe700 1 -- 172.21.15.57:0/3729616420 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304896951 0 0) 0x7f3c28067990 con 0x7f3c28067570 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2cdb4700 1 -- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 msgr2=0x7f3c28141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2cdb4700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2cdb4700 1 -- 172.21.15.57:0/3729616420 >> v1:172.21.15.57:6789/0 conn(0x7f3c28067570 legacy=0x7f3c28139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2cdb4700 1 -- 172.21.15.57:0/3729616420 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28060520 con 0x7f3c281337e0 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2d5b5700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c2cdb4700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3c1c002f70 tx=0x7f3c1c006df0).ready entity=mon.2 client_cookie=d1aa9d3669c7bccf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c277fe700 1 -- 172.21.15.57:0/3729616420 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1c00d570 con 0x7f3c281337e0 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c277fe700 1 -- 172.21.15.57:0/3729616420 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c000e90 con 0x7f3c281337e0 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.917+0000 7f3c277fe700 1 -- 172.21.15.57:0/3729616420 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c1c00d8c0 con 0x7f3c281337e0 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 msgr2=0x7f3c28133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f3c1c002f70 tx=0x7f3c1c006df0).stop 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- 172.21.15.57:0/3729616420 shutdown_connections 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c28141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 --2- 172.21.15.57:0/3729616420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c281337e0 0x7f3c28133bc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- 172.21.15.57:0/3729616420 >> 172.21.15.57:0/3729616420 conn(0x7f3c280a93f0 msgr2=0x7f3c280a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- 172.21.15.57:0/3729616420 shutdown_connections 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- 172.21.15.57:0/3729616420 wait complete. 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 Processor -- start 2024-03-18T14:41:18.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.918+0000 7f3c2f018700 1 -- start start 2024-03-18T14:41:18.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c28067570 0x7f3c280a3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a2810 con 0x7f3c281337e0 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280a12a0 con 0x7f3c28139fa0 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2f018700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28092490 con 0x7f3c28067570 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2d5b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2d5b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46272/0 (socket says 172.21.15.57:46272) 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2cdb4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c28067570 0x7f3c280a3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c27fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40454/0 (socket says 172.21.15.57:40454) 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.919+0000 7f3c2d5b5700 1 -- 172.21.15.57:0/925931384 learned_addr learned my addr 172.21.15.57:0/925931384 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 -- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c28067570 msgr2=0x7f3c280a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c28067570 0x7f3c280a3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 -- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 msgr2=0x7f3c280a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:18.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 -- 172.21.15.57:0/925931384 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20009470 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c27fff700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2d5b5700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3c2000c000 tx=0x7f3c200091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2000c850 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2000c9b0 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c00b180 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2000cd10 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.920+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c28149350 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.921+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3c20022070 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.921+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c28065a50 con 0x7f3c28139fa0 2024-03-18T14:41:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.921+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3c2004b010 con 0x7f3c28139fa0 2024-03-18T14:41:18.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:18.924+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3c20033940 con 0x7f3c28139fa0 2024-03-18T14:41:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.041+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c28057a60 con 0x7f3c28139fa0 2024-03-18T14:41:19.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.042+0000 7f3c25ffb700 1 -- 172.21.15.57:0/925931384 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f3c20016070 con 0x7f3c28139fa0 2024-03-18T14:41:19.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:19.044 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:19.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 >> v1:172.21.15.57:6816/39496 conn(0x7f3c08038e60 legacy=0x7f3c0803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 msgr2=0x7f3c281497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f3c2000c000 tx=0x7f3c200091d0).stop 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 shutdown_connections 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3c28139fa0 0x7f3c281497a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3c28067570 0x7f3c280a3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 --2- 172.21.15.57:0/925931384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3c281337e0 0x7f3c280a2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 >> 172.21.15.57:0/925931384 conn(0x7f3c280a93f0 msgr2=0x7f3c280a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 shutdown_connections 2024-03-18T14:41:19.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.043+0000 7f3c2f018700 1 -- 172.21.15.57:0/925931384 wait complete. 2024-03-18T14:41:19.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T14:41:19.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T14:41:19.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T14:41:19.057 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T14:41:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.172+0000 7ff773344700 1 Processor -- start 2024-03-18T14:41:19.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.172+0000 7ff773344700 1 -- start start 2024-03-18T14:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff773344700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff76c137860 0x7ff76c137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff773344700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff773344700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76c063a70 con 0x7ff76c063590 2024-03-18T14:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff773344700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76c0649c0 con 0x7ff76c137860 2024-03-18T14:41:19.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff773344700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c064bc0 con 0x7ff76c0650c0 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff7710e0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff76c137860 0x7ff76c137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff7718e1700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff76c063590 0x7ff76c0a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39588/0 (socket says 172.21.15.57:39588) 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.173+0000 7ff7718e1700 1 -- 172.21.15.57:0/3109718651 learned_addr learned my addr 172.21.15.57:0/3109718651 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff7710e0700 1 -- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 msgr2=0x7ff76c0630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff7710e0700 1 --2- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff7710e0700 1 -- 172.21.15.57:0/3109718651 >> v1:172.21.15.57:6789/0 conn(0x7ff76c063590 legacy=0x7ff76c0a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff7710e0700 1 -- 172.21.15.57:0/3109718651 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c0ab0d0 con 0x7ff76c137860 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff7710e0700 1 --2- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 0x7ff76c137c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff768002f70 tx=0x7ff768006df0).ready entity=mon.0 client_cookie=41f7ccee5f80510f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff75bfff700 1 -- 172.21.15.57:0/3109718651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800d570 con 0x7ff76c137860 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff75bfff700 1 -- 172.21.15.57:0/3109718651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768000e90 con 0x7ff76c137860 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7ff75bfff700 1 -- 172.21.15.57:0/3109718651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800d8c0 con 0x7ff76c137860 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7fb70e2dc700 1 Processor -- start 2024-03-18T14:41:19.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.174+0000 7fb70e2dc700 1 -- start start 2024-03-18T14:41:19.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 -- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 msgr2=0x7ff76c137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 --2- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 0x7ff76c137c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7ff768002f70 tx=0x7ff768006df0).stop 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 -- 172.21.15.57:0/3109718651 shutdown_connections 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 --2- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 0x7ff76c137c40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 --2- 172.21.15.57:0/3109718651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c0630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 -- 172.21.15.57:0/3109718651 >> 172.21.15.57:0/3109718651 conn(0x7ff76c05c300 msgr2=0x7ff76c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 -- 172.21.15.57:0/3109718651 shutdown_connections 2024-03-18T14:41:19.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7ff773344700 1 -- 172.21.15.57:0/3109718651 wait complete. 2024-03-18T14:41:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 0x7fb70805bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb708136210 0x7fb70805ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb7081397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb70805b970 con 0x7fb708136210 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708136710 con 0x7fb708136bf0 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70e2dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081369d0 con 0x7fb70805d370 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.175+0000 7fb70c879700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb7081397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb70c879700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb7081397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37732/0 (socket says 172.21.15.57:37732) 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb70c879700 1 -- 172.21.15.57:0/445177717 learned_addr learned my addr 172.21.15.57:0/445177717 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 0x7fb70805bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb7077fe700 1 --2- 172.21.15.57:0/445177717 >> v2:172.21.15.57:3300/0 conn(0x7fb708136210 0x7fb70805ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 -- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 msgr2=0x7fb7081397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb7081397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 -- 172.21.15.57:0/445177717 >> v2:172.21.15.57:3300/0 conn(0x7fb708136210 msgr2=0x7fb70805ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 --2- 172.21.15.57:0/445177717 >> v2:172.21.15.57:3300/0 conn(0x7fb708136210 0x7fb70805ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 -- 172.21.15.57:0/445177717 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708136fd0 con 0x7fb708136bf0 2024-03-18T14:41:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7ff773344700 1 Processor -- start 2024-03-18T14:41:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7fb707fff700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 0x7fb70805bde0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb7000032f0 tx=0x7fb7000091d0).ready entity=mon.1 client_cookie=d25f4bc593555fde server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.176+0000 7ff773344700 1 -- start start 2024-03-18T14:41:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7fb706ffd700 1 -- 172.21.15.57:0/445177717 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000b600 con 0x7fb708136bf0 2024-03-18T14:41:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7fb706ffd700 1 -- 172.21.15.57:0/445177717 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b760 con 0x7fb708136bf0 2024-03-18T14:41:19.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7fb706ffd700 1 -- 172.21.15.57:0/445177717 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000b8d0 con 0x7fb708136bf0 2024-03-18T14:41:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 0x7ff76c0931f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 0x7ff76c061740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c1498e0 con 0x7ff76c137860 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c130bd0 con 0x7ff76c0650c0 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff773344700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff76c149ad0 con 0x7ff76c063590 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff7710e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 0x7ff76c0931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff7710e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 0x7ff76c0931f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37742/0 (socket says 172.21.15.57:37742) 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7fb70e2dc700 1 -- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 msgr2=0x7fb70805bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7fb70e2dc700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 0x7fb70805bde0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb7000032f0 tx=0x7fb7000091d0).stop 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.177+0000 7ff7710e0700 1 -- 172.21.15.57:0/3631667922 learned_addr learned my addr 172.21.15.57:0/3631667922 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7708df700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 -- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 msgr2=0x7ff76c092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 -- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 msgr2=0x7ff76c061740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff76c137860 0x7ff76c061740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 -- 172.21.15.57:0/3631667922 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76800b180 con 0x7ff76c063590 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7708df700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff76c0650c0 0x7ff76c092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff7710e0700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 0x7ff76c0931f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff768002f70 tx=0x7ff768015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76800d8f0 con 0x7ff76c063590 2024-03-18T14:41:19.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768011ce0 con 0x7ff76c063590 2024-03-18T14:41:19.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76c092520 con 0x7ff76c063590 2024-03-18T14:41:19.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff76801e650 con 0x7ff76c063590 2024-03-18T14:41:19.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.178+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c0928c0 con 0x7ff76c063590 2024-03-18T14:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 -- 172.21.15.57:0/445177717 shutdown_connections 2024-03-18T14:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb7081397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 --2- 172.21.15.57:0/445177717 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136bf0 0x7fb70805bde0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 --2- 172.21.15.57:0/445177717 >> v2:172.21.15.57:3300/0 conn(0x7fb708136210 0x7fb70805ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 -- 172.21.15.57:0/445177717 >> 172.21.15.57:0/445177717 conn(0x7fb708066a50 msgr2=0x7fb70806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 -- 172.21.15.57:0/445177717 shutdown_connections 2024-03-18T14:41:19.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7fb70e2dc700 1 -- 172.21.15.57:0/445177717 wait complete. 2024-03-18T14:41:19.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff76c0654c0 con 0x7ff76c063590 2024-03-18T14:41:19.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.179+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff768025030 con 0x7ff76c063590 2024-03-18T14:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.180+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff76804bd40 con 0x7ff76c063590 2024-03-18T14:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.180+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 --> v1:172.21.15.57:6812/40093 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff74c045600 con 0x7ff74c041910 2024-03-18T14:41:19.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.180+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff768051340 con 0x7ff76c063590 2024-03-18T14:41:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.180+0000 7fb70e2dc700 1 Processor -- start 2024-03-18T14:41:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.180+0000 7fb70e2dc700 1 -- start start 2024-03-18T14:41:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb708149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136210 0x7fb708145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb708136bf0 0x7fb708146230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb708130770 con 0x7fb708136bf0 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080a3740 con 0x7fb708136210 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70e2dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7080a3140 con 0x7fb70805d370 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb708149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb708149890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37756/0 (socket says 172.21.15.57:37756) 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 -- 172.21.15.57:0/3194138026 learned_addr learned my addr 172.21.15.57:0/3194138026 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb70c879700 1 --2- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb708136bf0 0x7fb708146230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 -- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136210 msgr2=0x7fb708145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 --2- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb708136210 0x7fb708145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 -- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb708136bf0 msgr2=0x7fb708146230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.181+0000 7fb707fff700 1 --2- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb708136bf0 0x7fb708146230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.182+0000 7fb707fff700 1 -- 172.21.15.57:0/3194138026 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009470 con 0x7fb70805d370 2024-03-18T14:41:19.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.182+0000 7fb707fff700 1 --2- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb708149890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb7000032f0 tx=0x7fb700016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.182+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== osd.3 v1:172.21.15.57:6812/40093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7ff74c045600 con 0x7ff74c041910 2024-03-18T14:41:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.182+0000 7f303b361700 1 Processor -- start 2024-03-18T14:41:19.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 -- start start 2024-03-18T14:41:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f3716fa5700 1 Processor -- start 2024-03-18T14:41:19.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f3716fa5700 1 -- start start 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3034061b60 0x7f3034061f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3034065350 con 0x7f3034065b60 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340650e0 con 0x7f3034061b60 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.183+0000 7f303b361700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3034061190 con 0x7f3034066b70 2024-03-18T14:41:19.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37762/0 (socket says 172.21.15.57:37762) 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 -- 172.21.15.57:0/2451289032 learned_addr learned my addr 172.21.15.57:0/2451289032 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 -- 172.21.15.57:0/2451289032 >> v2:172.21.15.57:3300/0 conn(0x7f3034061b60 msgr2=0x7f3034061f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 --2- 172.21.15.57:0/2451289032 >> v2:172.21.15.57:3300/0 conn(0x7f3034061b60 0x7f3034061f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 -- 172.21.15.57:0/2451289032 >> v1:172.21.15.57:6789/0 conn(0x7f3034065b60 legacy=0x7f3034066460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 -- 172.21.15.57:0/2451289032 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034061430 con 0x7f3034066b70 2024-03-18T14:41:19.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3716fa5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f371009f010 0x7f37100a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3716fa5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3716fa5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371009c8f0 con 0x7f37100a4fa0 2024-03-18T14:41:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3716fa5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f371009c5e0 con 0x7f371009f010 2024-03-18T14:41:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3716fa5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100a1540 con 0x7f37100a0dc0 2024-03-18T14:41:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3715542700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f30398fe700 1 --2- 172.21.15.57:0/2451289032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f303406cd50 tx=0x7f302c006f40).ready entity=mon.2 client_cookie=3ce28f0188abdcaf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3715542700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46326/0 (socket says 172.21.15.57:46326) 2024-03-18T14:41:19.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.184+0000 7f3715542700 1 -- 172.21.15.57:0/337577816 learned_addr learned my addr 172.21.15.57:0/337577816 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3033fff700 1 -- 172.21.15.57:0/2451289032 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c010070 con 0x7f3034066b70 2024-03-18T14:41:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3715542700 1 -- 172.21.15.57:0/337577816 >> v2:172.21.15.57:3300/0 conn(0x7f371009f010 msgr2=0x7f37100a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3715542700 1 --2- 172.21.15.57:0/337577816 >> v2:172.21.15.57:3300/0 conn(0x7f371009f010 0x7f37100a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3715542700 1 -- 172.21.15.57:0/337577816 >> v1:172.21.15.57:6789/0 conn(0x7f37100a4fa0 legacy=0x7f371009f3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:41:19.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3715542700 1 -- 172.21.15.57:0/337577816 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371009cb20 con 0x7f37100a0dc0 2024-03-18T14:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3033fff700 1 -- 172.21.15.57:0/2451289032 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c000e90 con 0x7f3034066b70 2024-03-18T14:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3033fff700 1 -- 172.21.15.57:0/2451289032 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302c008860 con 0x7f3034066b70 2024-03-18T14:41:19.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.185+0000 7f3715542700 1 --2- 172.21.15.57:0/337577816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f371005d070 tx=0x7f3708009290).ready entity=mon.1 client_cookie=f2b2c8c6246f2651 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 -- 172.21.15.57:0/2451289032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 msgr2=0x7f3034067020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 --2- 172.21.15.57:0/2451289032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f303406cd50 tx=0x7f302c006f40).stop 2024-03-18T14:41:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 -- 172.21.15.57:0/2451289032 shutdown_connections 2024-03-18T14:41:19.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 --2- 172.21.15.57:0/2451289032 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034066b70 0x7f3034067020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 --2- 172.21.15.57:0/2451289032 >> v2:172.21.15.57:3300/0 conn(0x7f3034061b60 0x7f3034061f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 -- 172.21.15.57:0/2451289032 >> 172.21.15.57:0/2451289032 conn(0x7f3034060130 msgr2=0x7f303406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 -- 172.21.15.57:0/2451289032 shutdown_connections 2024-03-18T14:41:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.186+0000 7f303b361700 1 -- 172.21.15.57:0/2451289032 wait complete. 2024-03-18T14:41:19.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7f303b361700 1 Processor -- start 2024-03-18T14:41:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70000b600 con 0x7fb70805d370 2024-03-18T14:41:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7000107a0 con 0x7fb70805d370 2024-03-18T14:41:19.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb700010b00 con 0x7fb70805d370 2024-03-18T14:41:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7f370f7fe700 1 -- 172.21.15.57:0/337577816 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370800b860 con 0x7f37100a0dc0 2024-03-18T14:41:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7f370f7fe700 1 -- 172.21.15.57:0/337577816 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800b9c0 con 0x7f37100a0dc0 2024-03-18T14:41:19.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7f370f7fe700 1 -- 172.21.15.57:0/337577816 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f370800bb70 con 0x7f37100a0dc0 2024-03-18T14:41:19.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7080a6a90 con 0x7fb70805d370 2024-03-18T14:41:19.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.187+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7081492b0 con 0x7fb70805d370 2024-03-18T14:41:19.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 -- start start 2024-03-18T14:41:19.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 -- 172.21.15.57:0/337577816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 msgr2=0x7f371005dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 --2- 172.21.15.57:0/337577816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f371005d070 tx=0x7f3708009290).stop 2024-03-18T14:41:19.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 -- 172.21.15.57:0/337577816 shutdown_connections 2024-03-18T14:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 --2- 172.21.15.57:0/337577816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f371005dfb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 --2- 172.21.15.57:0/337577816 >> v2:172.21.15.57:3300/0 conn(0x7f371009f010 0x7f37100a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f3716fa5700 1 -- 172.21.15.57:0/337577816 >> 172.21.15.57:0/337577816 conn(0x7f37100a93f0 msgr2=0x7f37100a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb708060150 con 0x7fb70805d370 2024-03-18T14:41:19.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 0x7f30340a1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3034065b60 0x7f30340a1a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3034066b70 0x7f30340a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340a2190 con 0x7f3034065b60 2024-03-18T14:41:19.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30341466e0 con 0x7f3034066b70 2024-03-18T14:41:19.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.188+0000 7f303b361700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3034145c50 con 0x7f3034061b60 2024-03-18T14:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f3716fa5700 1 -- 172.21.15.57:0/337577816 shutdown_connections 2024-03-18T14:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 0x7f30340a1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 0x7f30340a1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37774/0 (socket says 172.21.15.57:37774) 2024-03-18T14:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 -- 172.21.15.57:0/2708960198 learned_addr learned my addr 172.21.15.57:0/2708960198 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f3716fa5700 1 -- 172.21.15.57:0/337577816 wait complete. 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 -- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3034066b70 msgr2=0x7f30340a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 --2- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3034066b70 0x7f30340a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 -- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3034065b60 msgr2=0x7f30340a1a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 --2- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3034065b60 0x7f30340a1a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 -- 172.21.15.57:0/2708960198 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c008240 con 0x7f3034061b60 2024-03-18T14:41:19.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.189+0000 7f30390fd700 1 --2- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 0x7f30340a1200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f30280032f0 tx=0x7f30280092b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.190+0000 7f3716fa5700 1 Processor -- start 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.190+0000 7f3716fa5700 1 -- start start 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 0x7f3710093630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f3710066400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 0x7f3710144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3710096470 con 0x7f371009f010 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100961b0 con 0x7f37100a0dc0 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3716fa5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3710066a30 con 0x7f37100a4fa0 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f370ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f3710066400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3715542700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 0x7f3710144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3714d41700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 0x7f3710093630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3714d41700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 0x7f3710093630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40516/0 (socket says 172.21.15.57:40516) 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3715542700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 0x7f3710144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37784/0 (socket says 172.21.15.57:37784) 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3714d41700 1 -- 172.21.15.57:0/3584086479 learned_addr learned my addr 172.21.15.57:0/3584086479 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3715542700 1 -- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 msgr2=0x7f3710066400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3715542700 1 --2- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37100a0dc0 0x7f3710066400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f3715542700 1 -- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 msgr2=0x7f3710093630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302800d7f0 con 0x7f3034061b60 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302800d950 con 0x7f3034061b60 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.191+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f302800dcb0 con 0x7f3034061b60 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3034145f10 con 0x7f3034061b60 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f3715542700 1 --2- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 0x7f3710093630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f3715542700 1 -- 172.21.15.57:0/3584086479 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009530 con 0x7f37100a4fa0 2024-03-18T14:41:19.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f3714d41700 1 --2- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f371009f010 0x7f3710093630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:19.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f3715542700 1 --2- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 0x7f3710144cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f371005d070 tx=0x7f3708016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340a3040 con 0x7f3034061b60 2024-03-18T14:41:19.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.192+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb70001e070 con 0x7fb70805d370 2024-03-18T14:41:19.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30340a18e0 con 0x7f3034061b60 2024-03-18T14:41:19.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37080032f0 con 0x7f37100a4fa0 2024-03-18T14:41:19.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3710094630 con 0x7f37100a4fa0 2024-03-18T14:41:19.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3710095d00 con 0x7f37100a4fa0 2024-03-18T14:41:19.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb70004c110 con 0x7fb70805d370 2024-03-18T14:41:19.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 --> v1:172.21.15.57:6800/40076 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6e80455a0 con 0x7fb6e80418b0 2024-03-18T14:41:19.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370800bb30 con 0x7f37100a4fa0 2024-03-18T14:41:19.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.193+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3708020620 con 0x7f37100a4fa0 2024-03-18T14:41:19.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.194+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f36e8003660 con 0x7f37100a4fa0 2024-03-18T14:41:19.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.194+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3708026020 con 0x7f37100a4fa0 2024-03-18T14:41:19.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.194+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f370804bc80 con 0x7f37100a4fa0 2024-03-18T14:41:19.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.195+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 --> v1:172.21.15.57:6808/40092 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f36f00455b0 con 0x7f36f00418c0 2024-03-18T14:41:19.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.195+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f302800f460 con 0x7f3034061b60 2024-03-18T14:41:19.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.195+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== osd.0 v1:172.21.15.57:6800/40076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fb6e80455a0 con 0x7fb6e80418b0 2024-03-18T14:41:19.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.196+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f302804b9c0 con 0x7f3034061b60 2024-03-18T14:41:19.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.196+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 --> v1:172.21.15.57:6804/40091 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f301c045570 con 0x7f301c041880 2024-03-18T14:41:19.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.197+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3028034250 con 0x7f3034061b60 2024-03-18T14:41:19.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.197+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== osd.1 v1:172.21.15.57:6804/40091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f301c045570 con 0x7f301c041880 2024-03-18T14:41:19.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.197+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37080229b0 con 0x7f37100a4fa0 2024-03-18T14:41:19.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.198+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== osd.2 v1:172.21.15.57:6808/40092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f36f00455b0 con 0x7f36f00418c0 2024-03-18T14:41:19.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.200+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb700012070 con 0x7fb70805d370 2024-03-18T14:41:19.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.203+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 --> v1:172.21.15.57:6812/40093 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff76c14a1d0 con 0x7ff74c041910 2024-03-18T14:41:19.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.203+0000 7ff75a7fc700 1 -- 172.21.15.57:0/3631667922 <== osd.3 v1:172.21.15.57:6812/40093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7ff76c14a1d0 con 0x7ff74c041910 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.204+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 >> v1:172.21.15.57:6812/40093 conn(0x7ff74c041910 legacy=0x7ff74c043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 >> v1:172.21.15.57:6816/39496 conn(0x7ff74c038da0 legacy=0x7ff74c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 msgr2=0x7ff76c0931f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff773344700 1 --2- 172.21.15.57:0/3631667922 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff76c063590 0x7ff76c0931f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff768002f70 tx=0x7ff768015000).stop 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff7718e1700 1 -- 172.21.15.57:0/3631667922 reap_dead start 2024-03-18T14:41:19.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 shutdown_connections 2024-03-18T14:41:19.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.206+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 >> 172.21.15.57:0/3631667922 conn(0x7ff76c05c300 msgr2=0x7ff76c1365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.207+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 shutdown_connections 2024-03-18T14:41:19.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.207+0000 7ff773344700 1 -- 172.21.15.57:0/3631667922 wait complete. 2024-03-18T14:41:19.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.212+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 --> v1:172.21.15.57:6800/40076 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb708149590 con 0x7fb6e80418b0 2024-03-18T14:41:19.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.212+0000 7fb7057fa700 1 -- 172.21.15.57:0/3194138026 <== osd.0 v1:172.21.15.57:6800/40076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fb6f8000e90 con 0x7fb6e80418b0 2024-03-18T14:41:19.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.213+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 >> v1:172.21.15.57:6800/40076 conn(0x7fb6e80418b0 legacy=0x7fb6e8043d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.213+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 >> v1:172.21.15.57:6816/39496 conn(0x7fb6e8038e60 legacy=0x7fb6e803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.213+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 msgr2=0x7fb708149890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.213+0000 7fb70e2dc700 1 --2- 172.21.15.57:0/3194138026 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb70805d370 0x7fb708149890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fb7000032f0 tx=0x7fb700016000).stop 2024-03-18T14:41:19.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.213+0000 7fb70c879700 1 -- 172.21.15.57:0/3194138026 reap_dead start 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 shutdown_connections 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 >> 172.21.15.57:0/3194138026 conn(0x7fb708066a50 msgr2=0x7fb7080a9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 shutdown_connections 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7fb70e2dc700 1 -- 172.21.15.57:0/3194138026 wait complete. 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 --> v1:172.21.15.57:6804/40091 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3034065f40 con 0x7f301c041880 2024-03-18T14:41:19.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.214+0000 7f30327fc700 1 -- 172.21.15.57:0/2708960198 <== osd.1 v1:172.21.15.57:6804/40091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f3034065f40 con 0x7f301c041880 2024-03-18T14:41:19.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.215+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 >> v1:172.21.15.57:6804/40091 conn(0x7f301c041880 legacy=0x7f301c043d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.215+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 >> v1:172.21.15.57:6816/39496 conn(0x7f301c038e30 legacy=0x7f301c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.215+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 msgr2=0x7f30340a1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.215+0000 7f303b361700 1 --2- 172.21.15.57:0/2708960198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3034061b60 0x7f30340a1200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f30280032f0 tx=0x7f30280092b0).stop 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.215+0000 7f30398fe700 1 -- 172.21.15.57:0/2708960198 reap_dead start 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.216+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 shutdown_connections 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.216+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 >> 172.21.15.57:0/2708960198 conn(0x7f3034060130 msgr2=0x7f3034066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.216+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 shutdown_connections 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.217+0000 7f303b361700 1 -- 172.21.15.57:0/2708960198 wait complete. 2024-03-18T14:41:19.237 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:19.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:41:19.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.220+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 --> v1:172.21.15.57:6808/40092 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f36e8002810 con 0x7f36f00418c0 2024-03-18T14:41:19.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f370dffb700 1 -- 172.21.15.57:0/3584086479 <== osd.2 v1:172.21.15.57:6808/40092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f36e8002810 con 0x7f36f00418c0 2024-03-18T14:41:19.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 >> v1:172.21.15.57:6808/40092 conn(0x7f36f00418c0 legacy=0x7f36f0043d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 >> v1:172.21.15.57:6816/39496 conn(0x7f36f0038dd0 legacy=0x7f36f003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 msgr2=0x7f3710144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f3716fa5700 1 --2- 172.21.15.57:0/3584086479 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37100a4fa0 0x7f3710144cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f371005d070 tx=0x7f3708016000).stop 2024-03-18T14:41:19.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.221+0000 7f3715542700 1 -- 172.21.15.57:0/3584086479 reap_dead start 2024-03-18T14:41:19.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.222+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 shutdown_connections 2024-03-18T14:41:19.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.222+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 >> 172.21.15.57:0/3584086479 conn(0x7f37100a93f0 msgr2=0x7f371009cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.223+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 shutdown_connections 2024-03-18T14:41:19.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.223+0000 7f3716fa5700 1 -- 172.21.15.57:0/3584086479 wait complete. 2024-03-18T14:41:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:19.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:41:19.241 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:19.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:41:19.242 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-03-18T14:41:19.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:41:19.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.398+0000 7f1cc936e700 1 Processor -- start 2024-03-18T14:41:19.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.398+0000 7f1cc936e700 1 -- start start 2024-03-18T14:41:19.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.398+0000 7fca32fc8700 1 Processor -- start 2024-03-18T14:41:19.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.398+0000 7fca32fc8700 1 -- start start 2024-03-18T14:41:19.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1cc40a1910 0x7f1cc40a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc40a5260 con 0x7f1cc40a1910 2024-03-18T14:41:19.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc409b970 con 0x7f1cc40a1530 2024-03-18T14:41:19.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc936e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc40a5000 con 0x7f1cc409a840 2024-03-18T14:41:19.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca32fc8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca32fc8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c13a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46372/0 (socket says 172.21.15.57:46372) 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc2ffd700 1 -- 172.21.15.57:0/4089909966 learned_addr learned my addr 172.21.15.57:0/4089909966 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7f1cc37fe700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca32fc8700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2c0a4c50 con 0x7fca2c1337e0 2024-03-18T14:41:19.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca32fc8700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c133fe0 con 0x7fca2c139fa0 2024-03-18T14:41:19.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca32fc8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0a4f10 con 0x7fca2c133bc0 2024-03-18T14:41:19.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca30d64700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca2c1337e0 0x7fca2c139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39602/0 (socket says 172.21.15.57:39602) 2024-03-18T14:41:19.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca30d64700 1 -- 172.21.15.57:0/3112631448 learned_addr learned my addr 172.21.15.57:0/3112631448 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:19.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.399+0000 7fca2bfff700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc27fc700 1 --2- 172.21.15.57:0/4089909966 >> v2:172.21.15.57:3300/0 conn(0x7f1cc40a1910 0x7f1cc40a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c13a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 -- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 msgr2=0x7f1cc409acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 -- 172.21.15.57:0/4089909966 >> v2:172.21.15.57:3300/0 conn(0x7f1cc40a1910 msgr2=0x7f1cc40a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 --2- 172.21.15.57:0/4089909966 >> v2:172.21.15.57:3300/0 conn(0x7f1cc40a1910 0x7f1cc40a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 -- 172.21.15.57:0/4089909966 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40a62d0 con 0x7f1cc40a1530 2024-03-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 -- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 msgr2=0x7fca2c067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 -- 172.21.15.57:0/3112631448 >> v1:172.21.15.57:6789/0 conn(0x7fca2c1337e0 legacy=0x7fca2c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 -- 172.21.15.57:0/3112631448 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c060520 con 0x7fca2c139fa0 2024-03-18T14:41:19.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc2ffd700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1cb4002f70 tx=0x7f1cb4006eb0).ready entity=mon.1 client_cookie=420b1efbc812f18a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca2bfff700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:19.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc1ffb700 1 -- 172.21.15.57:0/4089909966 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb400d570 con 0x7f1cc40a1530 2024-03-18T14:41:19.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca31565700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c13a400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fca240032f0 tx=0x7fca240091d0).ready entity=mon.1 client_cookie=fc6e446564e38ae8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc1ffb700 1 -- 172.21.15.57:0/4089909966 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb4000e90 con 0x7f1cc40a1530 2024-03-18T14:41:19.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7f1cc1ffb700 1 -- 172.21.15.57:0/4089909966 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cb400d900 con 0x7f1cc40a1530 2024-03-18T14:41:19.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca2b7fe700 1 -- 172.21.15.57:0/3112631448 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2400b6c0 con 0x7fca2c139fa0 2024-03-18T14:41:19.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca2b7fe700 1 -- 172.21.15.57:0/3112631448 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400b820 con 0x7fca2c139fa0 2024-03-18T14:41:19.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.400+0000 7fca2b7fe700 1 -- 172.21.15.57:0/3112631448 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca2400b990 con 0x7fca2c139fa0 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 -- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 msgr2=0x7f1cc40a4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f1cb4002f70 tx=0x7f1cb4006eb0).stop 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 -- 172.21.15.57:0/4089909966 shutdown_connections 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 --2- 172.21.15.57:0/4089909966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1530 0x7f1cc40a4b10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 --2- 172.21.15.57:0/4089909966 >> v2:172.21.15.57:3300/0 conn(0x7f1cc40a1910 0x7f1cc40a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 -- 172.21.15.57:0/4089909966 >> 172.21.15.57:0/4089909966 conn(0x7f1cc40a93f0 msgr2=0x7f1cc40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 -- 172.21.15.57:0/4089909966 shutdown_connections 2024-03-18T14:41:19.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7f1cc936e700 1 -- 172.21.15.57:0/4089909966 wait complete. 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7fca32fc8700 1 -- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 msgr2=0x7fca2c13a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.401+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c13a400 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fca240032f0 tx=0x7fca240091d0).stop 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 -- 172.21.15.57:0/3112631448 shutdown_connections 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c13a400 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3112631448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 -- 172.21.15.57:0/3112631448 >> 172.21.15.57:0/3112631448 conn(0x7fca2c0a93f0 msgr2=0x7fca2c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 -- 172.21.15.57:0/3112631448 shutdown_connections 2024-03-18T14:41:19.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7fca32fc8700 1 -- 172.21.15.57:0/3112631448 wait complete. 2024-03-18T14:41:19.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7f1cc936e700 1 Processor -- start 2024-03-18T14:41:19.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.402+0000 7f1cc936e700 1 -- start start 2024-03-18T14:41:19.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7fca32fc8700 1 Processor -- start 2024-03-18T14:41:19.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7fca32fc8700 1 -- start start 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40a1530 0x7f1cc414a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc414d260 con 0x7f1cc40a1530 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc4149c50 con 0x7f1cc40a1910 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc936e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc414ab00 con 0x7f1cc409a840 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46378/0 (socket says 172.21.15.57:46378) 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 -- 172.21.15.57:0/636619061 learned_addr learned my addr 172.21.15.57:0/636619061 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 -- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 msgr2=0x7f1cc409ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 -- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40a1530 msgr2=0x7f1cc414a130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40a1530 0x7f1cc414a130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7f1cc37fe700 1 -- 172.21.15.57:0/636619061 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb400b1e0 con 0x7f1cc40a1910 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cc37fe700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1cbc006e00 tx=0x7f1cbc0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00c850 con 0x7f1cc40a1910 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc00c9b0 con 0x7f1cc40a1910 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1cbc00cd10 con 0x7f1cc40a1910 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc409f4f0 con 0x7f1cc40a1910 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.403+0000 7fca32fc8700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca2c1337e0 0x7fca2c0a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca32fc8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca32fc8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c0a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca32fc8700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c0a1280 con 0x7fca2c1337e0 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca32fc8700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c092440 con 0x7fca2c139fa0 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca32fc8700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c09ea00 con 0x7fca2c133bc0 2024-03-18T14:41:19.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37814/0 (socket says 172.21.15.57:37814) 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 -- 172.21.15.57:0/3354279925 learned_addr learned my addr 172.21.15.57:0/3354279925 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca30d64700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca2c1337e0 0x7fca2c0a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 -- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 msgr2=0x7fca2c0a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c0a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 -- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca2c1337e0 msgr2=0x7fca2c0a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca2c1337e0 0x7fca2c0a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 -- 172.21.15.57:0/3354279925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1800b180 con 0x7fca2c133bc0 2024-03-18T14:41:19.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc4065680 con 0x7f1cc40a1910 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.404+0000 7fca2bfff700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fca1800c000 tx=0x7fca18006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca1800c890 con 0x7fca2c133bc0 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1800c9f0 con 0x7fca2c133bc0 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca24009470 con 0x7fca2c133bc0 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fca1800cd50 con 0x7fca2c133bc0 2024-03-18T14:41:19.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2c09be70 con 0x7fca2c133bc0 2024-03-18T14:41:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.405+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1cbc022070 con 0x7f1cc40a1910 2024-03-18T14:41:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.406+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1cbc04afe0 con 0x7f1cc40a1910 2024-03-18T14:41:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.406+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca04003410 con 0x7fca2c133bc0 2024-03-18T14:41:19.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.407+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fca1801c460 con 0x7fca2c133bc0 2024-03-18T14:41:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.407+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fca1804af80 con 0x7fca2c133bc0 2024-03-18T14:41:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.409+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc40a0320 con 0x7f1cc40a1910 2024-03-18T14:41:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.410+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fca180337a0 con 0x7fca2c133bc0 2024-03-18T14:41:19.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.413+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1cbc016030 con 0x7f1cc40a1910 2024-03-18T14:41:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.420+0000 7f2538d40700 1 Processor -- start 2024-03-18T14:41:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.421+0000 7f2538d40700 1 -- start start 2024-03-18T14:41:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.421+0000 7fdddc29d700 1 Processor -- start 2024-03-18T14:41:19.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.421+0000 7fdddc29d700 1 -- start start 2024-03-18T14:41:19.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2538d40700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f253405dfb0 0x7f25340a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2538d40700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f253409f5d0 0x7f253409fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fdddc29d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddd40621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fdddc29d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddd4136140 0x7fddd409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fdddc29d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd409bc50 con 0x7fddd4064700 2024-03-18T14:41:19.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fdddc29d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd41365f0 con 0x7fddd4136140 2024-03-18T14:41:19.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fdddc29d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd409b2e0 con 0x7fddd409aa10 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fddd9838700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddd4064700 0x7fddd4132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39614/0 (socket says 172.21.15.57:39614) 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fddd9838700 1 -- 172.21.15.57:0/2647761816 learned_addr learned my addr 172.21.15.57:0/2647761816 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7fddda83a700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddd4136140 0x7fddd409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2538d40700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340a1f10 con 0x7f25340a02c0 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2538d40700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25340a0f60 con 0x7f253409f5d0 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2538d40700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25340a1200 con 0x7f253405dfb0 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2532d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f25340a02c0 0x7f25340a0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39610/0 (socket says 172.21.15.57:39610) 2024-03-18T14:41:19.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2532d9d700 1 -- 172.21.15.57:0/1640717118 learned_addr learned my addr 172.21.15.57:0/1640717118 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.422+0000 7f2531d9b700 1 --2- 172.21.15.57:0/1640717118 >> v2:172.21.15.57:3300/0 conn(0x7f253409f5d0 0x7f253409fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222494651 0 0) 0x7f25340a1f10 con 0x7f25340a02c0 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2518003260 con 0x7f25340a02c0 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183450058 0 0) 0x7fddd409bc50 con 0x7fddd4064700 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddbc003260 con 0x7fddd4064700 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603933943 0 0) 0x7fddbc003260 con 0x7fddd4064700 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 msgr2=0x7fddd40621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddd40621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1430882976 0 0) 0x7f2518003260 con 0x7f25340a02c0 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f253405dfb0 msgr2=0x7f25340a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f253405dfb0 0x7f25340a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 >> v2:172.21.15.57:3300/0 conn(0x7f253409f5d0 msgr2=0x7f253409fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddd4136140 msgr2=0x7fddd409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddd4136140 0x7fddd409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd41367e0 con 0x7fddd4064700 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 564621487 0 0) 0x7fddc40016b0 con 0x7fddd4064700 2024-03-18T14:41:19.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 >> v1:172.21.15.57:6789/0 conn(0x7fddd4064700 legacy=0x7fddd4132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddbc0037d0 0x7fddbc003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddbc004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddbc004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd409b2e0 con 0x7fddbc0037d0 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc00b7b0 con 0x7fddbc0049f0 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddbc00b970 con 0x7fddd409aa10 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 --2- 172.21.15.57:0/1640717118 >> v2:172.21.15.57:3300/0 conn(0x7f253409f5d0 0x7f253409fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534060520 con 0x7f25340a02c0 2024-03-18T14:41:19.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 564621487 0 0) 0x7f252c0019e0 con 0x7f25340a02c0 2024-03-18T14:41:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7fddd9838700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddbc004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 >> v1:172.21.15.57:6789/0 conn(0x7f25340a02c0 legacy=0x7f25340a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25180037d0 0x7f2518003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2518004500 0x7f2518004980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f251800b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25340a0f60 con 0x7f25180037d0 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340a1200 con 0x7f2518004ec0 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2518014610 con 0x7f2518004500 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.423+0000 7f2531d9b700 1 --2- 172.21.15.57:0/1640717118 >> v2:172.21.15.57:3300/0 conn(0x7f253409f5d0 0x7f253409fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f251800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2531d9b700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2518004500 0x7f2518004980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 -- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 msgr2=0x7fddbc004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddbc004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 -- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddbc0037d0 msgr2=0x7fddbc003bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddbc0037d0 0x7fddbc003bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 -- 172.21.15.57:0/2647761816 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc003260 con 0x7fddd409aa10 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 -- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2518004500 msgr2=0x7f2518004980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2518004500 0x7f2518004980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 -- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25180037d0 msgr2=0x7f2518003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25180037d0 0x7f2518003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 -- 172.21.15.57:0/1640717118 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518003260 con 0x7f2518004ec0 2024-03-18T14:41:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9838700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddbc004500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fddc40013c0 tx=0x7fddc4001dd0).ready entity=mon.2 client_cookie=5592c978d988865a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc40070d0 con 0x7fddd409aa10 2024-03-18T14:41:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4007230 con 0x7fddd409aa10 2024-03-18T14:41:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7fddd9037700 1 -- 172.21.15.57:0/2647761816 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc400c8c0 con 0x7fddd409aa10 2024-03-18T14:41:19.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f2532d9d700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f251800b750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f252c0016f0 tx=0x7f252c002190).ready entity=mon.1 client_cookie=f3d62758120d33b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.424+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252c00f070 con 0x7f2518004ec0 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c004a70 con 0x7f2518004ec0 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f253159a700 1 -- 172.21.15.57:0/1640717118 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f252c004dd0 con 0x7f2518004ec0 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 -- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 msgr2=0x7fddbc004500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddbc004500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fddc40013c0 tx=0x7fddc4001dd0).stop 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 -- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 msgr2=0x7f251800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 --2- 172.21.15.57:0/1640717118 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f251800b750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f252c0016f0 tx=0x7f252c002190).stop 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 -- 172.21.15.57:0/2647761816 shutdown_connections 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddbc004e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddd409aa10 0x7fddbc004500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 --2- 172.21.15.57:0/2647761816 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddbc0037d0 0x7fddbc003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 -- 172.21.15.57:0/2647761816 >> 172.21.15.57:0/2647761816 conn(0x7fddd406c0c0 msgr2=0x7fddd406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2532d9d700 1 -- 172.21.15.57:0/1640717118 reap_dead start 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 -- 172.21.15.57:0/1640717118 shutdown_connections 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 -- 172.21.15.57:0/1640717118 >> 172.21.15.57:0/1640717118 conn(0x7f25340a93f0 msgr2=0x7f25340a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 -- 172.21.15.57:0/2647761816 shutdown_connections 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 -- 172.21.15.57:0/1640717118 shutdown_connections 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7f2538d40700 1 -- 172.21.15.57:0/1640717118 wait complete. 2024-03-18T14:41:19.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.425+0000 7fdddc29d700 1 -- 172.21.15.57:0/2647761816 wait complete. 2024-03-18T14:41:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 Processor -- start 2024-03-18T14:41:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7fdddc29d700 1 Processor -- start 2024-03-18T14:41:19.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7fdddc29d700 1 -- start start 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 -- start start 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f2534145160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2534145650 0x7f25341421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534093620 con 0x7f25340960d0 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2534145b30 con 0x7f2518004ec0 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.427+0000 7f2538d40700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2534141810 con 0x7f2534145650 2024-03-18T14:41:19.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddbc0037d0 0x7fddd4098830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40568/0 (socket says 172.21.15.57:40568) 2024-03-18T14:41:19.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 -- 172.21.15.57:0/2814235200 learned_addr learned my addr 172.21.15.57:0/2814235200 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4064700 0x7fddd41555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4097540 con 0x7fddd4064700 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4094550 con 0x7fddbc0049f0 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fdddc29d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4095680 con 0x7fddbc0037d0 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46424/0 (socket says 172.21.15.57:46424) 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 -- 172.21.15.57:0/2242487804 learned_addr learned my addr 172.21.15.57:0/2242487804 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 -- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2534145650 msgr2=0x7f25341421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2534145650 0x7f25341421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 -- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 msgr2=0x7f2534145160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f2534145160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 -- 172.21.15.57:0/2814235200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25341426b0 con 0x7f25340960d0 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 -- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddbc0037d0 msgr2=0x7fddd4098830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddbc0037d0 0x7fddd4098830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 -- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4064700 msgr2=0x7fddd41555e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4064700 0x7fddd41555e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 -- 172.21.15.57:0/2242487804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4098130 con 0x7fddbc0049f0 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7fddd9838700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fddd4097b90 tx=0x7fddc4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.428+0000 7f2531d9b700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f25280030b0 tx=0x7f252800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4001bb0 con 0x7fddbc0049f0 2024-03-18T14:41:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc4004920 con 0x7fddbc0049f0 2024-03-18T14:41:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fddc4004c80 con 0x7fddbc0049f0 2024-03-18T14:41:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2528012610 con 0x7f25340960d0 2024-03-18T14:41:19.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7fdddc29d700 1 -- 172.21.15.57:0/2242487804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40948c0 con 0x7fddbc0049f0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7fdddc29d700 1 -- 172.21.15.57:0/2242487804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd4096eb0 con 0x7fddbc0049f0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528012770 con 0x7f25340960d0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25340675e0 con 0x7f25340960d0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2534066ba0 con 0x7f25340960d0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.429+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2528012b10 con 0x7f25340960d0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.430+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fddc4027070 con 0x7fddbc0049f0 2024-03-18T14:41:19.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.430+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fddc404b270 con 0x7fddbc0049f0 2024-03-18T14:41:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.431+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2528012c70 con 0x7f25340960d0 2024-03-18T14:41:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.431+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f25280312f0 con 0x7f25340960d0 2024-03-18T14:41:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.431+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd4057a60 con 0x7fddbc0049f0 2024-03-18T14:41:19.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.433+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c003410 con 0x7f25340960d0 2024-03-18T14:41:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.435+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fddc40487c0 con 0x7fddbc0049f0 2024-03-18T14:41:19.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.436+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2528050060 con 0x7f25340960d0 2024-03-18T14:41:19.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.536+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca040036c0 con 0x7fca2c133bc0 2024-03-18T14:41:19.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.536+0000 7fca29ffb700 1 -- 172.21.15.57:0/3354279925 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca18033390 con 0x7fca2c133bc0 2024-03-18T14:41:19.538 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 >> v1:172.21.15.57:6816/39496 conn(0x7fca0c038df0 legacy=0x7fca0c03b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 msgr2=0x7fca2c09fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fca1800c000 tx=0x7fca18006df0).stop 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 shutdown_connections 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fca2c139fa0 0x7fca2c0a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fca2c1337e0 0x7fca2c0a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 --2- 172.21.15.57:0/3354279925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fca2c133bc0 0x7fca2c09fd00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 >> 172.21.15.57:0/3354279925 conn(0x7fca2c0a93f0 msgr2=0x7fca2c0a75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 shutdown_connections 2024-03-18T14:41:19.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.538+0000 7fca32fc8700 1 -- 172.21.15.57:0/3354279925 wait complete. 2024-03-18T14:41:19.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-03-18T14:41:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.554+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f250c0036c0 con 0x7f25340960d0 2024-03-18T14:41:19.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.554+0000 7f25237fe700 1 -- 172.21.15.57:0/2814235200 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f252802f4f0 con 0x7f25340960d0 2024-03-18T14:41:19.556 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 >> v1:172.21.15.57:6816/39496 conn(0x7f2510038df0 legacy=0x7f251003b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 msgr2=0x7f2534141cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f25280030b0 tx=0x7f252800b040).stop 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 shutdown_connections 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2534145650 0x7f25341421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2518004ec0 0x7f2534145160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 --2- 172.21.15.57:0/2814235200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f25340960d0 0x7f2534141cd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 >> 172.21.15.57:0/2814235200 conn(0x7f25340a93f0 msgr2=0x7f25340a6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 shutdown_connections 2024-03-18T14:41:19.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.556+0000 7f2538d40700 1 -- 172.21.15.57:0/2814235200 wait complete. 2024-03-18T14:41:19.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-03-18T14:41:19.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.575+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1cc4149d90 con 0x7f1cc40a1910 2024-03-18T14:41:19.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.575+0000 7f1cb3fff700 1 -- 172.21.15.57:0/636619061 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cbc0336e0 con 0x7f1cc40a1910 2024-03-18T14:41:19.577 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 >> v1:172.21.15.57:6816/39496 conn(0x7f1ca0038f10 legacy=0x7f1ca003b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 msgr2=0x7f1cc414d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1cbc006e00 tx=0x7f1cbc0091d0).stop 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 shutdown_connections 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1cc40a1910 0x7f1cc414d690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1cc409a840 0x7f1cc409ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 --2- 172.21.15.57:0/636619061 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1cc40a1530 0x7f1cc414a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 >> 172.21.15.57:0/636619061 conn(0x7f1cc40a93f0 msgr2=0x7f1cc40a6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 shutdown_connections 2024-03-18T14:41:19.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.577+0000 7f1cc936e700 1 -- 172.21.15.57:0/636619061 wait complete. 2024-03-18T14:41:19.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-03-18T14:41:19.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.593+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddd4060880 con 0x7fddbc0049f0 2024-03-18T14:41:19.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.593+0000 7fddc37fe700 1 -- 172.21.15.57:0/2242487804 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddc402e030 con 0x7fddbc0049f0 2024-03-18T14:41:19.595 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 >> v1:172.21.15.57:6816/39496 conn(0x7fddb4038df0 legacy=0x7fddb403b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 msgr2=0x7fddd4097c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fddd4097b90 tx=0x7fddc4015000).stop 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 shutdown_connections 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddd4064700 0x7fddd41555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddbc0037d0 0x7fddd4098830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 --2- 172.21.15.57:0/2242487804 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddbc0049f0 0x7fddd4097c40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 >> 172.21.15.57:0/2242487804 conn(0x7fddd406c0c0 msgr2=0x7fddd4134ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 shutdown_connections 2024-03-18T14:41:19.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:19.595+0000 7fddb37fe700 1 -- 172.21.15.57:0/2242487804 wait complete. 2024-03-18T14:41:19.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-03-18T14:41:20.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:41:20.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:41:20.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:41:20.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:41:20.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.678+0000 7f399487c700 1 Processor -- start 2024-03-18T14:41:20.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.678+0000 7f399487c700 1 -- start start 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f010 0x7f39900a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f399009f8e0 0x7f39900a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399009c8f0 con 0x7f399009f8e0 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399009c5e0 con 0x7f399009f010 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f399487c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39900a1540 con 0x7f39900a4fa0 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.679+0000 7f398dd9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37880/0 (socket says 172.21.15.57:37880) 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 -- 172.21.15.57:0/1305329368 learned_addr learned my addr 172.21.15.57:0/1305329368 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398e59c700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f010 0x7f39900a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 -- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f010 msgr2=0x7f39900a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f010 0x7f39900a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 -- 172.21.15.57:0/1305329368 >> v2:172.21.15.57:3300/0 conn(0x7f399009f8e0 msgr2=0x7f39900a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 --2- 172.21.15.57:0/1305329368 >> v2:172.21.15.57:3300/0 conn(0x7f399009f8e0 0x7f39900a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 -- 172.21.15.57:0/1305329368 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399009cb20 con 0x7f39900a4fa0 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398dd9b700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3984002f70 tx=0x7f398400a200).ready entity=mon.2 client_cookie=80e27f84a8bbf98c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398d59a700 1 -- 172.21.15.57:0/1305329368 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398400bd90 con 0x7f39900a4fa0 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398d59a700 1 -- 172.21.15.57:0/1305329368 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984000e90 con 0x7f39900a4fa0 2024-03-18T14:41:20.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.680+0000 7f398d59a700 1 -- 172.21.15.57:0/1305329368 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39840185e0 con 0x7f39900a4fa0 2024-03-18T14:41:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 -- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 msgr2=0x7f399009f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3984002f70 tx=0x7f398400a200).stop 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 -- 172.21.15.57:0/1305329368 shutdown_connections 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 --2- 172.21.15.57:0/1305329368 >> v2:172.21.15.57:3300/0 conn(0x7f399009f8e0 0x7f39900a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f010 0x7f39900a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 --2- 172.21.15.57:0/1305329368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f399009f3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 -- 172.21.15.57:0/1305329368 >> 172.21.15.57:0/1305329368 conn(0x7f39900a93f0 msgr2=0x7f39900a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 -- 172.21.15.57:0/1305329368 shutdown_connections 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.681+0000 7f399487c700 1 -- 172.21.15.57:0/1305329368 wait complete. 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.682+0000 7f399487c700 1 Processor -- start 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.682+0000 7f399487c700 1 -- start start 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f399009f010 0x7f399009bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f3990134650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3990135500 con 0x7f399009f010 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3990063d80 con 0x7f399009f8e0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f399487c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39900671d0 con 0x7f39900a4fa0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f398dd9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f398dd9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46442/0 (socket says 172.21.15.57:46442) 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f398dd9b700 1 -- 172.21.15.57:0/787311652 learned_addr learned my addr 172.21.15.57:0/787311652 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.683+0000 7f398ed9d700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f3990134650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398e59c700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f399009f010 0x7f399009bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 -- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 msgr2=0x7f3990134650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f3990134650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 -- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f399009f010 msgr2=0x7f399009bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f399009f010 0x7f399009bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 -- 172.21.15.57:0/787311652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840107f0 con 0x7f399009f8e0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398ed9d700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f3990134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f398dd9b700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3984002f70 tx=0x7f3984018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f398401e070 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3984017750 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3990064550 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3984017ab0 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.684+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3990065be0 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.686+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3990057a60 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.686+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3984029030 con 0x7f399009f8e0 2024-03-18T14:41:20.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.686+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f398404f9a0 con 0x7f399009f8e0 2024-03-18T14:41:20.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.692+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3984006560 con 0x7f399009f8e0 2024-03-18T14:41:20.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.717+0000 7f501e856700 1 Processor -- start 2024-03-18T14:41:20.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.717+0000 7f501e856700 1 -- start start 2024-03-18T14:41:20.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5018137880 0x7f5018137c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5018138150 con 0x7f5018137880 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5018092470 con 0x7f50180a7580 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501e856700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50181373a0 con 0x7f5018093110 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f5017fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5018137880 0x7f5018137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46450/0 (socket says 172.21.15.57:46450) 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 -- 172.21.15.57:0/1040697773 learned_addr learned my addr 172.21.15.57:0/1040697773 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f50177fe700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 -- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 msgr2=0x7f50180a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 -- 172.21.15.57:0/1040697773 >> v2:172.21.15.57:3300/0 conn(0x7f5018137880 msgr2=0x7f5018137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 --2- 172.21.15.57:0/1040697773 >> v2:172.21.15.57:3300/0 conn(0x7f5018137880 0x7f5018137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f501cdf3700 1 -- 172.21.15.57:0/1040697773 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018137660 con 0x7f50180a7580 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.718+0000 7f50177fe700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f501cdf3700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f50100032f0 tx=0x7f5010009290).ready entity=mon.1 client_cookie=4f49ac699e8979d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f5016ffd700 1 -- 172.21.15.57:0/1040697773 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501000b8a0 con 0x7f50180a7580 2024-03-18T14:41:20.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f5016ffd700 1 -- 172.21.15.57:0/1040697773 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501000ba00 con 0x7f50180a7580 2024-03-18T14:41:20.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f5016ffd700 1 -- 172.21.15.57:0/1040697773 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f501000bb70 con 0x7f50180a7580 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f501e856700 1 -- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 msgr2=0x7f50180a7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.719+0000 7f501e856700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f50100032f0 tx=0x7f5010009290).stop 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 -- 172.21.15.57:0/1040697773 shutdown_connections 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f50180a7a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 --2- 172.21.15.57:0/1040697773 >> v2:172.21.15.57:3300/0 conn(0x7f5018137880 0x7f5018137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 --2- 172.21.15.57:0/1040697773 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 -- 172.21.15.57:0/1040697773 >> 172.21.15.57:0/1040697773 conn(0x7f501805c4c0 msgr2=0x7f501805c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 -- 172.21.15.57:0/1040697773 shutdown_connections 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.720+0000 7f501e856700 1 -- 172.21.15.57:0/1040697773 wait complete. 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.721+0000 7f501e856700 1 Processor -- start 2024-03-18T14:41:20.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.721+0000 7f501e856700 1 -- start start 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5018066640 con 0x7f5018137880 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50180680f0 con 0x7f50180a7580 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501e856700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5018066870 con 0x7f5018093110 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f50177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501cdf3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f50177fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46454/0 (socket says 172.21.15.57:46454) 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f50177fe700 1 -- 172.21.15.57:0/3666402397 learned_addr learned my addr 172.21.15.57:0/3666402397 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.722+0000 7f501cdf3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40610/0 (socket says 172.21.15.57:40610) 2024-03-18T14:41:20.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 -- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 msgr2=0x7f50180961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 -- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 msgr2=0x7f5018148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 -- 172.21.15.57:0/3666402397 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010009530 con 0x7f50180a7580 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f501cdf3700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50177fe700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f501809c640 tx=0x7f500c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500c010580 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c0106e0 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f500c010a40 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50180a6040 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50180971c0 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.724+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5018057a60 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f500c010ba0 con 0x7f50180a7580 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f5a544a2700 1 Processor -- start 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.723+0000 7f5a544a2700 1 -- start start 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a544a2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c061670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a544a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a544a2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0638c0 con 0x7f5a4c0a4330 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a544a2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c061b60 con 0x7f5a4c062570 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a544a2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c063b10 con 0x7f5a4c13cdf0 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46462/0 (socket says 172.21.15.57:46462) 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 -- 172.21.15.57:0/1753081456 learned_addr learned my addr 172.21.15.57:0/1753081456 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f500c04a960 con 0x7f50180a7580 2024-03-18T14:41:20.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a5223e700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c061670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 -- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 msgr2=0x7f5a4c061670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c061670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 -- 172.21.15.57:0/1753081456 >> v1:172.21.15.57:6789/0 conn(0x7f5a4c0a4330 legacy=0x7f5a4c0a47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.725+0000 7f5a51a3d700 1 -- 172.21.15.57:0/1753081456 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c09a6c0 con 0x7f5a4c062570 2024-03-18T14:41:20.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.726+0000 7f5a51a3d700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5a48002f70 tx=0x7f5a48006eb0).ready entity=mon.1 client_cookie=e31cdf886cbef068 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.728+0000 7f5a5123c700 1 -- 172.21.15.57:0/1753081456 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4800d570 con 0x7f5a4c062570 2024-03-18T14:41:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a5123c700 1 -- 172.21.15.57:0/1753081456 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a48000e90 con 0x7f5a4c062570 2024-03-18T14:41:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a5123c700 1 -- 172.21.15.57:0/1753081456 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a4800d8c0 con 0x7f5a4c062570 2024-03-18T14:41:20.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f500c02f860 con 0x7f50180a7580 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 -- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 msgr2=0x7f5a4c13d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f5a48002f70 tx=0x7f5a48006eb0).stop 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 -- 172.21.15.57:0/1753081456 shutdown_connections 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c061670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 --2- 172.21.15.57:0/1753081456 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c13d1d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 -- 172.21.15.57:0/1753081456 >> 172.21.15.57:0/1753081456 conn(0x7f5a4c060130 msgr2=0x7f5a4c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.729+0000 7f5a544a2700 1 -- 172.21.15.57:0/1753081456 shutdown_connections 2024-03-18T14:41:20.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.730+0000 7f5a544a2700 1 -- 172.21.15.57:0/1753081456 wait complete. 2024-03-18T14:41:20.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.730+0000 7f5a544a2700 1 Processor -- start 2024-03-18T14:41:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 -- start start 2024-03-18T14:41:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a4c0a4330 0x7f5a4c140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c1433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c144fa0 con 0x7f5a4c0a4330 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c135090 con 0x7f5a4c062570 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a544a2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c141150 con 0x7f5a4c13cdf0 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a5223e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a5223e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46472/0 (socket says 172.21.15.57:46472) 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a5223e700 1 -- 172.21.15.57:0/2326496653 learned_addr learned my addr 172.21.15.57:0/2326496653 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.731+0000 7f5a52a3f700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c1433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 -- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 msgr2=0x7f5a4c1433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c1433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 -- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a4c0a4330 msgr2=0x7f5a4c140c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a4c0a4330 0x7f5a4c140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 -- 172.21.15.57:0/2326496653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4800b1e0 con 0x7f5a4c062570 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a52a3f700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:20.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a5223e700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5a3c00c000 tx=0x7f5a3c006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c010780 con 0x7f5a4c062570 2024-03-18T14:41:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c1414c0 con 0x7f5a4c062570 2024-03-18T14:41:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.732+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c142dd0 con 0x7f5a4c062570 2024-03-18T14:41:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.733+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c0108e0 con 0x7f5a4c062570 2024-03-18T14:41:20.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.733+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a3c010c40 con 0x7f5a4c062570 2024-03-18T14:41:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.734+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a28003410 con 0x7f5a4c062570 2024-03-18T14:41:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.734+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5a3c01c460 con 0x7f5a4c062570 2024-03-18T14:41:20.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.735+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5a3c04ae50 con 0x7f5a4c062570 2024-03-18T14:41:20.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.741+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5a3c0335f0 con 0x7f5a4c062570 2024-03-18T14:41:20.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.760+0000 7f10a1162700 1 Processor -- start 2024-03-18T14:41:20.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.760+0000 7f10a1162700 1 -- start start 2024-03-18T14:41:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f10a1162700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f10a1162700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f109c09d570 0x7f109c0a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f10a1162700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109c0a50b0 con 0x7f109c0a4ab0 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f10a1162700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f109c09f800 con 0x7f109c09d570 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f10a1162700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c05e550 con 0x7f109c05e170 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f109c09d570 0x7f109c0a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f109c09d570 0x7f109c0a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40632/0 (socket says 172.21.15.57:40632) 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 -- 172.21.15.57:0/3204533085 learned_addr learned my addr 172.21.15.57:0/3204533085 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109ad9d700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 -- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 msgr2=0x7f109c0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 -- 172.21.15.57:0/3204533085 >> v1:172.21.15.57:6789/0 conn(0x7f109c0a4ab0 legacy=0x7f109c0a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 -- 172.21.15.57:0/3204533085 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c0a4190 con 0x7f109c09d570 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109ad9d700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f109a59c700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c09d570 0x7f109c0a1fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1090002f70 tx=0x7f1090006eb0).ready entity=mon.0 client_cookie=cf5a2a5c13c0b7c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.761+0000 7f1099d9b700 1 -- 172.21.15.57:0/3204533085 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1090009710 con 0x7f109c09d570 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f1099d9b700 1 -- 172.21.15.57:0/3204533085 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1090000e90 con 0x7f109c09d570 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f1099d9b700 1 -- 172.21.15.57:0/3204533085 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1090009a60 con 0x7f109c09d570 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 -- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c09d570 msgr2=0x7f109c0a1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c09d570 0x7f109c0a1fe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1090002f70 tx=0x7f1090006eb0).stop 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 -- 172.21.15.57:0/3204533085 shutdown_connections 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 --2- 172.21.15.57:0/3204533085 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c09d570 0x7f109c0a1fe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 -- 172.21.15.57:0/3204533085 >> 172.21.15.57:0/3204533085 conn(0x7f109c0a93f0 msgr2=0x7f109c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 -- 172.21.15.57:0/3204533085 shutdown_connections 2024-03-18T14:41:20.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.762+0000 7f10a1162700 1 -- 172.21.15.57:0/3204533085 wait complete. 2024-03-18T14:41:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.763+0000 7f10a1162700 1 Processor -- start 2024-03-18T14:41:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.763+0000 7f10a1162700 1 -- start start 2024-03-18T14:41:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f109c09d570 0x7f109c061f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c0a4ab0 0x7f109c0a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109c062f40 con 0x7f109c0a4ab0 2024-03-18T14:41:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109c063ba0 con 0x7f109c09d570 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f10a1162700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109c062920 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37930/0 (socket says 172.21.15.57:37930) 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 -- 172.21.15.57:0/233656828 learned_addr learned my addr 172.21.15.57:0/233656828 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 -- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f109c09d570 msgr2=0x7f109c061f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f109c09d570 0x7f109c061f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 -- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c0a4ab0 msgr2=0x7f109c0a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c0a4ab0 0x7f109c0a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 -- 172.21.15.57:0/233656828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109000f5f0 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f109ad9d700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f108c006940 tx=0x7f108c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.764+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f108c011780 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.765+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c0118e0 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.765+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f108c011c40 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.765+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109c0a1f40 con 0x7f109c05e170 2024-03-18T14:41:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.765+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109c1372f0 con 0x7f109c05e170 2024-03-18T14:41:20.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.766+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109c09df90 con 0x7f109c05e170 2024-03-18T14:41:20.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.766+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f108c012420 con 0x7f109c05e170 2024-03-18T14:41:20.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.766+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f108c04a850 con 0x7f109c05e170 2024-03-18T14:41:20.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.772+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f108c02f6b0 con 0x7f109c05e170 2024-03-18T14:41:20.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.827+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f39900a1210 con 0x7f399009f8e0 2024-03-18T14:41:20.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.827+0000 7f397f7fe700 1 -- 172.21.15.57:0/787311652 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3984023160 con 0x7f399009f8e0 2024-03-18T14:41:20.829 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 >> v1:172.21.15.57:6816/39496 conn(0x7f396c038e60 legacy=0x7f396c03b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 msgr2=0x7f3990134160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3984002f70 tx=0x7f3984018000).stop 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 shutdown_connections 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f39900a4fa0 0x7f3990134650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f399009f010 0x7f399009bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 --2- 172.21.15.57:0/787311652 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f399009f8e0 0x7f3990134160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 >> 172.21.15.57:0/787311652 conn(0x7f39900a93f0 msgr2=0x7f399009d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 shutdown_connections 2024-03-18T14:41:20.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.829+0000 7f399487c700 1 -- 172.21.15.57:0/787311652 wait complete. 2024-03-18T14:41:20.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.2 2024-03-18T14:41:20.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.871+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f501805dc30 con 0x7f50180a7580 2024-03-18T14:41:20.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.871+0000 7f50157fa700 1 -- 172.21.15.57:0/3666402397 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f500c032e80 con 0x7f50180a7580 2024-03-18T14:41:20.872 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 >> v1:172.21.15.57:6816/39496 conn(0x7f4ff8038da0 legacy=0x7f4ff803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 msgr2=0x7f5018148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f501809c640 tx=0x7f500c008040).stop 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 shutdown_connections 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5018137880 0x7f5018148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5018093110 0x7f50180961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 --2- 172.21.15.57:0/3666402397 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f50180a7580 0x7f5018148ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 >> 172.21.15.57:0/3666402397 conn(0x7f501805c4c0 msgr2=0x7f50181369b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 shutdown_connections 2024-03-18T14:41:20.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.872+0000 7f501e856700 1 -- 172.21.15.57:0/3666402397 wait complete. 2024-03-18T14:41:20.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-03-18T14:41:20.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.888+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5a280036c0 con 0x7f5a4c062570 2024-03-18T14:41:20.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.888+0000 7f5a437fe700 1 -- 172.21.15.57:0/2326496653 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a3c04c070 con 0x7f5a4c062570 2024-03-18T14:41:20.889 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:20.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 >> v1:172.21.15.57:6816/39496 conn(0x7f5a34038da0 legacy=0x7f5a3403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 msgr2=0x7f5a4c144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f5a3c00c000 tx=0x7f5a3c006df0).stop 2024-03-18T14:41:20.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 shutdown_connections 2024-03-18T14:41:20.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a4c13cdf0 0x7f5a4c1433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a4c062570 0x7f5a4c144ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 --2- 172.21.15.57:0/2326496653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a4c0a4330 0x7f5a4c140c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 >> 172.21.15.57:0/2326496653 conn(0x7f5a4c060130 msgr2=0x7f5a4c0a4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 shutdown_connections 2024-03-18T14:41:20.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.889+0000 7f5a544a2700 1 -- 172.21.15.57:0/2326496653 wait complete. 2024-03-18T14:41:20.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.891+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f109c057a60 con 0x7f109c05e170 2024-03-18T14:41:20.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.892+0000 7f108bfff700 1 -- 172.21.15.57:0/233656828 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f108c032cd0 con 0x7f109c05e170 2024-03-18T14:41:20.893 INFO:teuthology.orchestra.run.smithi057.stdout:38654705668 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 >> v1:172.21.15.57:6816/39496 conn(0x7f1078038ec0 legacy=0x7f107803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 msgr2=0x7f109c0636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f108c006940 tx=0x7f108c008040).stop 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 shutdown_connections 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f109c0a4ab0 0x7f109c0a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f109c05e170 0x7f109c0636b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:20.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 --2- 172.21.15.57:0/233656828 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f109c09d570 0x7f109c061f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:20.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 >> 172.21.15.57:0/233656828 conn(0x7f109c0a93f0 msgr2=0x7f109c1348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:20.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 shutdown_connections 2024-03-18T14:41:20.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:20.894+0000 7f10a1162700 1 -- 172.21.15.57:0/233656828 wait complete. 2024-03-18T14:41:20.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-03-18T14:41:20.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2024-03-18T14:41:21.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:41:21.886 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:41:21.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:41:21.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:41:21.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.970+0000 7fce76247700 1 Processor -- start 2024-03-18T14:41:21.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.970+0000 7fce76247700 1 -- start start 2024-03-18T14:41:21.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce7009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce70099a00 0x7fce70139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7009a380 con 0x7fce70099a00 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce70135fe0 con 0x7fce7009b520 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce76247700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce70099eb0 con 0x7fce701366f0 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46504/0 (socket says 172.21.15.57:46504) 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6effd700 1 -- 172.21.15.57:0/2976380765 learned_addr learned my addr 172.21.15.57:0/2976380765 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6ffff700 1 --2- 172.21.15.57:0/2976380765 >> v2:172.21.15.57:3300/0 conn(0x7fce70099a00 0x7fce70139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6f7fe700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce7009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6ffff700 1 -- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 msgr2=0x7fce7009bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.971+0000 7fce6ffff700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce7009bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6ffff700 1 -- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 msgr2=0x7fce70136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6ffff700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6ffff700 1 -- 172.21.15.57:0/2976380765 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7009a0c0 con 0x7fce70099a00 2024-03-18T14:41:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6effd700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6ffff700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce70099a00 0x7fce70139530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fce7009af80 tx=0x7fce680091d0).ready entity=mon.0 client_cookie=27bc79baeec68d1d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6e7fc700 1 -- 172.21.15.57:0/2976380765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce6800b680 con 0x7fce70099a00 2024-03-18T14:41:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6e7fc700 1 -- 172.21.15.57:0/2976380765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6800b7e0 con 0x7fce70099a00 2024-03-18T14:41:21.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.972+0000 7fce6e7fc700 1 -- 172.21.15.57:0/2976380765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce6800b950 con 0x7fce70099a00 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 -- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce70099a00 msgr2=0x7fce70139530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce70099a00 0x7fce70139530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fce7009af80 tx=0x7fce680091d0).stop 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 -- 172.21.15.57:0/2976380765 shutdown_connections 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce70099a00 0x7fce70139530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce7009bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 --2- 172.21.15.57:0/2976380765 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce7009b520 0x7fce70136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 -- 172.21.15.57:0/2976380765 >> 172.21.15.57:0/2976380765 conn(0x7fce7006c0c0 msgr2=0x7fce7006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 -- 172.21.15.57:0/2976380765 shutdown_connections 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.973+0000 7fce76247700 1 -- 172.21.15.57:0/2976380765 wait complete. 2024-03-18T14:41:21.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.975+0000 7fce76247700 1 Processor -- start 2024-03-18T14:41:21.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.975+0000 7fce76247700 1 -- start start 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce7009b520 0x7fce70148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce701491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce700984f0 con 0x7fce7009b520 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce70097190 con 0x7fce70099a00 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce76247700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce70094800 con 0x7fce701366f0 2024-03-18T14:41:21.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce6f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce6f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46514/0 (socket says 172.21.15.57:46514) 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce6f7fe700 1 -- 172.21.15.57:0/1243059407 learned_addr learned my addr 172.21.15.57:0/1243059407 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce6ffff700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce701491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.976+0000 7fce6effd700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce7009b520 0x7fce70148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 -- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 msgr2=0x7fce701491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce701491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 -- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce7009b520 msgr2=0x7fce70148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce7009b520 0x7fce70148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 -- 172.21.15.57:0/1243059407 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6400b1e0 con 0x7fce70099a00 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6ffff700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce701491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6f7fe700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fce600030b0 tx=0x7fce60008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce60011780 con 0x7fce70099a00 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce600118e0 con 0x7fce70099a00 2024-03-18T14:41:21.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce68009470 con 0x7fce70099a00 2024-03-18T14:41:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce60011c40 con 0x7fce70099a00 2024-03-18T14:41:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.977+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce70095a30 con 0x7fce70099a00 2024-03-18T14:41:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.978+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce70095380 con 0x7fce70099a00 2024-03-18T14:41:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.978+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fce60012420 con 0x7fce70099a00 2024-03-18T14:41:21.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.979+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fce6004a520 con 0x7fce70099a00 2024-03-18T14:41:21.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:21.982+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fce70095380 con 0x7fce70099a00 2024-03-18T14:41:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.010+0000 7f95a58a1700 1 Processor -- start 2024-03-18T14:41:22.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.010+0000 7f95a58a1700 1 -- start start 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95a009f010 0x7f95a00a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 0x7f95a009f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a009f8e0 0x7f95a00a3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a009c8f0 con 0x7f95a009f010 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a009c5e0 con 0x7f95a00a4fa0 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f95a58a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00a1540 con 0x7f95a009f8e0 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95a009f010 0x7f95a00a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95a009f010 0x7f95a00a1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40660/0 (socket says 172.21.15.57:40660) 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 -- 172.21.15.57:0/2425337496 learned_addr learned my addr 172.21.15.57:0/2425337496 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959e7fc700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 0x7f95a009f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959f7fe700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a009f8e0 0x7f95a00a3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 -- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a009f8e0 msgr2=0x7f95a00a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a009f8e0 0x7f95a00a3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 -- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 msgr2=0x7f95a009f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 0x7f95a009f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 -- 172.21.15.57:0/2425337496 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a009cb20 con 0x7f95a009f010 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959e7fc700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 0x7f95a009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.011+0000 7f959effd700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a00a1cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9590002f70 tx=0x7f9590006e40).ready entity=mon.0 client_cookie=5a160effd40eb901 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f959dffb700 1 -- 172.21.15.57:0/2425337496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959000b8d0 con 0x7f95a009f010 2024-03-18T14:41:22.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f959dffb700 1 -- 172.21.15.57:0/2425337496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590000e90 con 0x7f95a009f010 2024-03-18T14:41:22.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f959dffb700 1 -- 172.21.15.57:0/2425337496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959000bc20 con 0x7f95a009f010 2024-03-18T14:41:22.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 -- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 msgr2=0x7f95a00a1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a00a1cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f9590002f70 tx=0x7f9590006e40).stop 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 -- 172.21.15.57:0/2425337496 shutdown_connections 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a009f8e0 0x7f95a00a3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a00a1cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 --2- 172.21.15.57:0/2425337496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a00a4fa0 0x7f95a009f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.012+0000 7f95a58a1700 1 -- 172.21.15.57:0/2425337496 >> 172.21.15.57:0/2425337496 conn(0x7f95a00a93f0 msgr2=0x7f95a00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.013+0000 7f95a58a1700 1 -- 172.21.15.57:0/2425337496 shutdown_connections 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.013+0000 7f95a58a1700 1 -- 172.21.15.57:0/2425337496 wait complete. 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.013+0000 7f95a58a1700 1 Processor -- start 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.013+0000 7f95a58a1700 1 -- start start 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 0x7f95a01450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a00a4fa0 0x7f95a00925f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a013f3d0 con 0x7f95a009f010 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0144c00 con 0x7f95a009f8e0 2024-03-18T14:41:22.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f95a58a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00920d0 con 0x7f95a00a4fa0 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.014+0000 7f959effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40670/0 (socket says 172.21.15.57:40670) 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 -- 172.21.15.57:0/1113042069 learned_addr learned my addr 172.21.15.57:0/1113042069 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959f7fe700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a00a4fa0 0x7f95a00925f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959e7fc700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 0x7f95a01450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 -- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a00a4fa0 msgr2=0x7f95a00925f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a00a4fa0 0x7f95a00925f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 -- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 msgr2=0x7f95a01450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 0x7f95a01450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 -- 172.21.15.57:0/1113042069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959400b180 con 0x7f95a009f010 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959e7fc700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 0x7f95a01450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f959effd700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9590006fc0 tx=0x7f9590006e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9590020070 con 0x7f95a009f010 2024-03-18T14:41:22.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9590012e60 con 0x7f95a009f010 2024-03-18T14:41:22.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959000d4d0 con 0x7f95a009f010 2024-03-18T14:41:22.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f959001a800 con 0x7f95a009f010 2024-03-18T14:41:22.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.015+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a0096030 con 0x7f95a009f010 2024-03-18T14:41:22.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.016+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0057a60 con 0x7f95a009f010 2024-03-18T14:41:22.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.017+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f959001a960 con 0x7f95a009f010 2024-03-18T14:41:22.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.017+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f95900501a0 con 0x7f95a009f010 2024-03-18T14:41:22.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.020+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9590027e20 con 0x7f95a009f010 2024-03-18T14:41:22.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.066+0000 7f753b873700 1 Processor -- start 2024-03-18T14:41:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.066+0000 7f753b873700 1 -- start start 2024-03-18T14:41:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753b873700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 0x7f7534142c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753b873700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 0x7f7534145120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753b873700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753413d890 con 0x7f753413e190 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753b873700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7534137e70 con 0x7f753409a460 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753b873700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753413dac0 con 0x7f753413e570 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f7539e10700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 0x7f7534145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753960f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f753413e190 0x7f753409b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39644/0 (socket says 172.21.15.57:39644) 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f753960f700 1 -- 172.21.15.57:0/3653714263 learned_addr learned my addr 172.21.15.57:0/3653714263 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.067+0000 7f7538e0e700 1 --2- 172.21.15.57:0/3653714263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 0x7f7534142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7538e0e700 1 -- 172.21.15.57:0/3653714263 >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 msgr2=0x7f7534145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7538e0e700 1 --2- 172.21.15.57:0/3653714263 >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 0x7f7534145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7538e0e700 1 -- 172.21.15.57:0/3653714263 >> v1:172.21.15.57:6789/0 conn(0x7f753413e190 legacy=0x7f753409b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7523fff700 1 -- 172.21.15.57:0/3653714263 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167861474 0 0) 0x7f753413d890 con 0x7f753413e190 2024-03-18T14:41:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7538e0e700 1 -- 172.21.15.57:0/3653714263 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753413dd60 con 0x7f753413e570 2024-03-18T14:41:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7539e10700 1 --2- 172.21.15.57:0/3653714263 >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 0x7f7534145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7538e0e700 1 --2- 172.21.15.57:0/3653714263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 0x7f7534142c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7524002f70 tx=0x7f7524006d90).ready entity=mon.1 client_cookie=cc61aad30ea8bc20 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7523fff700 1 -- 172.21.15.57:0/3653714263 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752400d4a0 con 0x7f753413e570 2024-03-18T14:41:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7523fff700 1 -- 172.21.15.57:0/3653714263 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524000e90 con 0x7f753413e570 2024-03-18T14:41:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f7523fff700 1 -- 172.21.15.57:0/3653714263 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f752400d7f0 con 0x7f753413e570 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f753b873700 1 -- 172.21.15.57:0/3653714263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 msgr2=0x7f7534142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.068+0000 7f753b873700 1 --2- 172.21.15.57:0/3653714263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 0x7f7534142c20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7524002f70 tx=0x7f7524006d90).stop 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 -- 172.21.15.57:0/3653714263 shutdown_connections 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 --2- 172.21.15.57:0/3653714263 >> v2:172.21.15.57:3300/0 conn(0x7f753409a460 0x7f7534145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 --2- 172.21.15.57:0/3653714263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e570 0x7f7534142c20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 -- 172.21.15.57:0/3653714263 >> 172.21.15.57:0/3653714263 conn(0x7f753406c0c0 msgr2=0x7f753406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 -- 172.21.15.57:0/3653714263 shutdown_connections 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.069+0000 7f753b873700 1 -- 172.21.15.57:0/3653714263 wait complete. 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 Processor -- start 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 -- start start 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 0x7f7534067af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 0x7f75341407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753413f9e0 con 0x7f753413e570 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75341401d0 con 0x7f753413e190 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753b873700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7534137260 con 0x7f753409a460 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f7539e10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f7539e10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40688/0 (socket says 172.21.15.57:40688) 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f7539e10700 1 -- 172.21.15.57:0/117663887 learned_addr learned my addr 172.21.15.57:0/117663887 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f753960f700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 0x7f7534067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.070+0000 7f7538e0e700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 0x7f75341407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 -- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 msgr2=0x7f75341407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 0x7f75341407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 -- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 msgr2=0x7f7534135d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 -- 172.21.15.57:0/117663887 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c009470 con 0x7f753409a460 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f7539e10700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f7538e0e700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 0x7f75341407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753960f700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 0x7f7534067af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7534066e70 tx=0x7f7530007a00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75300070d0 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530007230 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752400b120 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7530005610 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.071+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753413ec00 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.072+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7530010070 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.073+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7530049f00 con 0x7f753409a460 2024-03-18T14:41:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.073+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75340681a0 con 0x7f753409a460 2024-03-18T14:41:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.076+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f753002ee00 con 0x7f753409a460 2024-03-18T14:41:22.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.090+0000 7f8417b83700 1 Processor -- start 2024-03-18T14:41:22.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.091+0000 7f8417b83700 1 -- start start 2024-03-18T14:41:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8417b83700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f841009f010 0x7f84100a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8417b83700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8417b83700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841009c8f0 con 0x7f84100a4fa0 2024-03-18T14:41:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8417b83700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841009c5e0 con 0x7f841009f010 2024-03-18T14:41:22.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8417b83700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84100a1540 con 0x7f84100a0dc0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:37994/0 (socket says 172.21.15.57:37994) 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 -- 172.21.15.57:0/2783244185 learned_addr learned my addr 172.21.15.57:0/2783244185 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 -- 172.21.15.57:0/2783244185 >> v2:172.21.15.57:3300/0 conn(0x7f841009f010 msgr2=0x7f84100a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 --2- 172.21.15.57:0/2783244185 >> v2:172.21.15.57:3300/0 conn(0x7f841009f010 0x7f84100a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 -- 172.21.15.57:0/2783244185 >> v1:172.21.15.57:6789/0 conn(0x7f84100a4fa0 legacy=0x7f841009f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 -- 172.21.15.57:0/2783244185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841009cb20 con 0x7f84100a0dc0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.092+0000 7f8416120700 1 --2- 172.21.15.57:0/2783244185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f841005d070 tx=0x7f8408009290).ready entity=mon.2 client_cookie=f7b2602560c6cb8d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.093+0000 7f841491d700 1 -- 172.21.15.57:0/2783244185 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840800b860 con 0x7f84100a0dc0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.093+0000 7f841491d700 1 -- 172.21.15.57:0/2783244185 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840800b9c0 con 0x7f84100a0dc0 2024-03-18T14:41:22.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.093+0000 7f841491d700 1 -- 172.21.15.57:0/2783244185 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840800bb70 con 0x7f84100a0dc0 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.093+0000 7f8417b83700 1 -- 172.21.15.57:0/2783244185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 msgr2=0x7f841013d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.093+0000 7f8417b83700 1 --2- 172.21.15.57:0/2783244185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f841005d070 tx=0x7f8408009290).stop 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 -- 172.21.15.57:0/2783244185 shutdown_connections 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 --2- 172.21.15.57:0/2783244185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f84100a0dc0 0x7f841013d1c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 --2- 172.21.15.57:0/2783244185 >> v2:172.21.15.57:3300/0 conn(0x7f841009f010 0x7f84100a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-18T14:41:22.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 -- 172.21.15.57:0/2783244185 >> 172.21.15.57:0/2783244185 conn(0x7f84100a93f0 msgr2=0x7f84100a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 -- 172.21.15.57:0/2783244185 shutdown_connections 2024-03-18T14:41:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.094+0000 7f8417b83700 1 -- 172.21.15.57:0/2783244185 wait complete. 2024-03-18T14:41:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.095+0000 7f8417b83700 1 Processor -- start 2024-03-18T14:41:22.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.095+0000 7f8417b83700 1 -- start start 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.096+0000 7f8417b83700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 0x7f841009a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.096+0000 7f841591f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 0x7f841009a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.096+0000 7f841591f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 0x7f841009a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:38006/0 (socket says 172.21.15.57:38006) 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8417b83700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 0x7f8410092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f841591f700 1 -- 172.21.15.57:0/2334559109 learned_addr learned my addr 172.21.15.57:0/2334559109 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8417b83700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 0x7f8410092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841013ddd0 con 0x7f84100a0dc0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100955f0 con 0x7f84100a4fa0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8410093880 con 0x7f841009f010 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f841511e700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 0x7f8410092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 0x7f8410092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 -- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 msgr2=0x7f841009a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 0x7f841009a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 -- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 msgr2=0x7f8410092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 0x7f8410092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8408009530 con 0x7f84100a4fa0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f841511e700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 0x7f8410092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.097+0000 7f8416120700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 0x7f8410092520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f841005d070 tx=0x7f8408016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.098+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840800b860 con 0x7f84100a4fa0 2024-03-18T14:41:22.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.098+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408021670 con 0x7f84100a4fa0 2024-03-18T14:41:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.098+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84080219d0 con 0x7f84100a4fa0 2024-03-18T14:41:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.098+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8410093b20 con 0x7f84100a4fa0 2024-03-18T14:41:22.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.098+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841009ad10 con 0x7f84100a4fa0 2024-03-18T14:41:22.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.100+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841013df80 con 0x7f84100a4fa0 2024-03-18T14:41:22.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.100+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f840800f070 con 0x7f84100a4fa0 2024-03-18T14:41:22.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.100+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f840804bad0 con 0x7f84100a4fa0 2024-03-18T14:41:22.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.103+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f841013df80 con 0x7f84100a4fa0 2024-03-18T14:41:22.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.151+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce70095380 con 0x7fce70099a00 2024-03-18T14:41:22.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.152+0000 7fce6cff9700 1 -- 172.21.15.57:0/1243059407 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fce70095380 con 0x7fce70099a00 2024-03-18T14:41:22.153 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 >> v1:172.21.15.57:6816/39496 conn(0x7fce50038da0 legacy=0x7fce5003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 msgr2=0x7fce70095540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fce600030b0 tx=0x7fce60008040).stop 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 shutdown_connections 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce701366f0 0x7fce701491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce70099a00 0x7fce70095540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 --2- 172.21.15.57:0/1243059407 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce7009b520 0x7fce70148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 >> 172.21.15.57:0/1243059407 conn(0x7fce7006c0c0 msgr2=0x7fce70066880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 shutdown_connections 2024-03-18T14:41:22.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.154+0000 7fce76247700 1 -- 172.21.15.57:0/1243059407 wait complete. 2024-03-18T14:41:22.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-03-18T14:41:22.170 DEBUG:teuthology.parallel:result is None 2024-03-18T14:41:22.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.175+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f95a00a1210 con 0x7f95a009f010 2024-03-18T14:41:22.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.175+0000 7f958ffff700 1 -- 172.21.15.57:0/1113042069 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f959002a020 con 0x7f95a009f010 2024-03-18T14:41:22.177 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 >> v1:172.21.15.57:6816/39496 conn(0x7f957c038da0 legacy=0x7f957c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 msgr2=0x7f95a0066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f9590006fc0 tx=0x7f9590006e40).stop 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 shutdown_connections 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f95a00a4fa0 0x7f95a00925f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a009f010 0x7f95a0066b50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 --2- 172.21.15.57:0/1113042069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f95a009f8e0 0x7f95a01450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 >> 172.21.15.57:0/1113042069 conn(0x7f95a00a93f0 msgr2=0x7f95a00a0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 shutdown_connections 2024-03-18T14:41:22.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.177+0000 7f95a58a1700 1 -- 172.21.15.57:0/1113042069 wait complete. 2024-03-18T14:41:22.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-03-18T14:41:22.189 DEBUG:teuthology.parallel:result is None 2024-03-18T14:41:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.252+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f753405c8c0 con 0x7f753409a460 2024-03-18T14:41:22.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.253+0000 7f75227fc700 1 -- 172.21.15.57:0/117663887 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7530032420 con 0x7f753409a460 2024-03-18T14:41:22.254 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 >> v1:172.21.15.57:6816/39496 conn(0x7f7514038da0 legacy=0x7f751403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 msgr2=0x7f7534067af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 0x7f7534067af0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f7534066e70 tx=0x7f7530007a00).stop 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 shutdown_connections 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f753413e570 0x7f7534135d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f753409a460 0x7f7534067af0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 --2- 172.21.15.57:0/117663887 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f753413e190 0x7f75341407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 >> 172.21.15.57:0/117663887 conn(0x7f753406c0c0 msgr2=0x7f753413ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 shutdown_connections 2024-03-18T14:41:22.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.254+0000 7f753b873700 1 -- 172.21.15.57:0/117663887 wait complete. 2024-03-18T14:41:22.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-03-18T14:41:22.266 DEBUG:teuthology.parallel:result is None 2024-03-18T14:41:22.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.273+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f841013df80 con 0x7f84100a4fa0 2024-03-18T14:41:22.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.274+0000 7f83feffd700 1 -- 172.21.15.57:0/2334559109 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f841013df80 con 0x7f84100a4fa0 2024-03-18T14:41:22.275 INFO:teuthology.orchestra.run.smithi057.stdout:38654705669 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 >> v1:172.21.15.57:6816/39496 conn(0x7f83f0038dd0 legacy=0x7f83f003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 msgr2=0x7f8410092520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 0x7f8410092520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f841005d070 tx=0x7f8408016000).stop 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 shutdown_connections 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f84100a4fa0 0x7f8410092520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f841009f010 0x7f841009a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 --2- 172.21.15.57:0/2334559109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f84100a0dc0 0x7f8410092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 >> 172.21.15.57:0/2334559109 conn(0x7f84100a93f0 msgr2=0x7f841009cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 shutdown_connections 2024-03-18T14:41:22.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.275+0000 7f8417b83700 1 -- 172.21.15.57:0/2334559109 wait complete. 2024-03-18T14:41:22.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2024-03-18T14:41:22.287 DEBUG:teuthology.parallel:result is None 2024-03-18T14:41:22.287 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T14:41:22.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.433+0000 7f532137f700 1 Processor -- start 2024-03-18T14:41:22.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.433+0000 7f532137f700 1 -- start start 2024-03-18T14:41:22.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f532137f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f532137f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f532137f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531c09b2a0 con 0x7f531c09adf0 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f532137f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c09bc50 con 0x7f531c09aa10 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f532137f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531c1367e0 con 0x7f531c064700 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531a7fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46554/0 (socket says 172.21.15.57:46554) 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 -- 172.21.15.57:0/2290282076 learned_addr learned my addr 172.21.15.57:0/2290282076 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 -- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 msgr2=0x7f531c136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 -- 172.21.15.57:0/2290282076 >> v1:172.21.15.57:6789/0 conn(0x7f531c09adf0 legacy=0x7f531c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f5319ffb700 1 -- 172.21.15.57:0/2290282076 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892095175 0 0) 0x7f5314001490 con 0x7f531c09adf0 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531affd700 1 -- 172.21.15.57:0/2290282076 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c136aa0 con 0x7f531c09aa10 2024-03-18T14:41:22.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.434+0000 7f531a7fc700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f531affd700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5310002f70 tx=0x7f5310006f40).ready entity=mon.1 client_cookie=86f24ec3005ae355 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f5319ffb700 1 -- 172.21.15.57:0/2290282076 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531000da80 con 0x7f531c09aa10 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f5319ffb700 1 -- 172.21.15.57:0/2290282076 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310000e90 con 0x7f531c09aa10 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f5319ffb700 1 -- 172.21.15.57:0/2290282076 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531000ddd0 con 0x7f531c09aa10 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 -- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 msgr2=0x7f531c0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5310002f70 tx=0x7f5310006f40).stop 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 -- 172.21.15.57:0/2290282076 shutdown_connections 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c0621e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 --2- 172.21.15.57:0/2290282076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 -- 172.21.15.57:0/2290282076 >> 172.21.15.57:0/2290282076 conn(0x7f531c06c0c0 msgr2=0x7f531c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 -- 172.21.15.57:0/2290282076 shutdown_connections 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.435+0000 7f532137f700 1 -- 172.21.15.57:0/2290282076 wait complete. 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.436+0000 7f532137f700 1 Processor -- start 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.436+0000 7f532137f700 1 -- start start 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 0x7f531c149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531c0975b0 con 0x7f531c09adf0 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f531c096870 con 0x7f531c09aa10 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f532137f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f531c096b10 con 0x7f531c064700 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:38028/0 (socket says 172.21.15.57:38028) 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 -- 172.21.15.57:0/3049121076 learned_addr learned my addr 172.21.15.57:0/3049121076 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531b7fe700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 0x7f531c149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531a7fc700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 -- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 msgr2=0x7f531c149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 -- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 msgr2=0x7f531c149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 0x7f531c149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 -- 172.21.15.57:0/3049121076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530c00b120 con 0x7f531c064700 2024-03-18T14:41:22.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531b7fe700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 0x7f531c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f531affd700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5310002f70 tx=0x7f5310006f40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f531001d070 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.437+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310018400 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.438+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f531000b460 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.438+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5310018760 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.438+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c0989f0 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.438+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f53100188c0 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.439+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f531004b8d0 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.439+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531c057a60 con 0x7f531c064700 2024-03-18T14:41:22.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.442+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5310023cc0 con 0x7f531c064700 2024-03-18T14:41:22.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.555+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 --> v1:172.21.15.57:6816/39496 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f531c060880 con 0x7f52f8038dd0 2024-03-18T14:41:22.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.561+0000 7f530bfff700 1 -- 172.21.15.57:0/3049121076 <== mgr.4099 v1:172.21.15.57:6816/39496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246941 (unknown 2965378022 0 976718321) 0x7f531c060880 con 0x7f52f8038dd0 2024-03-18T14:41:22.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:22.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 >> v1:172.21.15.57:6816/39496 conn(0x7f52f8038dd0 legacy=0x7f52f803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 msgr2=0x7f531c098500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f5310002f70 tx=0x7f5310006f40).stop 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 shutdown_connections 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f531c09adf0 0x7f531c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f531c064700 0x7f531c098500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 --2- 172.21.15.57:0/3049121076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f531c09aa10 0x7f531c149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 >> 172.21.15.57:0/3049121076 conn(0x7f531c06c0c0 msgr2=0x7f531c1335a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 shutdown_connections 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.564+0000 7f532137f700 1 -- 172.21.15.57:0/3049121076 wait complete. 2024-03-18T14:41:22.569 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:41:22.576 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-18T14:41:22.411165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.946415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504374+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:41:13.504374+0000","last_peered":"2024-03-18T14:41:13.504374+0000","last_clean":"2024-03-18T14:41:13.504374+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:41:13.504374+0000","last_undegraded":"2024-03-18T14:41:13.504374+0000","last_fullsized":"2024-03-18T14:41:13.504374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503047+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:41:13.503047+0000","last_peered":"2024-03-18T14:41:13.503047+0000","last_clean":"2024-03-18T14:41:13.503047+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:41:13.503047+0000","last_undegraded":"2024-03-18T14:41:13.503047+0000","last_fullsized":"2024-03-18T14:41:13.503047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509070+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:41:13.509070+0000","last_peered":"2024-03-18T14:41:13.509070+0000","last_clean":"2024-03-18T14:41:13.509070+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:41:13.509070+0000","last_undegraded":"2024-03-18T14:41:13.509070+0000","last_fullsized":"2024-03-18T14:41:13.509070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516068+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:41:13.516068+0000","last_peered":"2024-03-18T14:41:13.516068+0000","last_clean":"2024-03-18T14:41:13.516068+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:41:13.516068+0000","last_undegraded":"2024-03-18T14:41:13.516068+0000","last_fullsized":"2024-03-18T14:41:13.516068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508157+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:41:13.508157+0000","last_peered":"2024-03-18T14:41:13.508157+0000","last_clean":"2024-03-18T14:41:13.508157+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:41:13.508157+0000","last_undegraded":"2024-03-18T14:41:13.508157+0000","last_fullsized":"2024-03-18T14:41:13.508157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510313+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:41:13.510313+0000","last_peered":"2024-03-18T14:41:13.510313+0000","last_clean":"2024-03-18T14:41:13.510313+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:41:13.510313+0000","last_undegraded":"2024-03-18T14:41:13.510313+0000","last_fullsized":"2024-03-18T14:41:13.510313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503242+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:41:13.503242+0000","last_peered":"2024-03-18T14:41:13.503242+0000","last_clean":"2024-03-18T14:41:13.503242+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:41:13.503242+0000","last_undegraded":"2024-03-18T14:41:13.503242+0000","last_fullsized":"2024-03-18T14:41:13.503242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516825+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:41:13.516825+0000","last_peered":"2024-03-18T14:41:13.516825+0000","last_clean":"2024-03-18T14:41:13.516825+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:41:13.516825+0000","last_undegraded":"2024-03-18T14:41:13.516825+0000","last_fullsized":"2024-03-18T14:41:13.516825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507149+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:41:13.507149+0000","last_peered":"2024-03-18T14:41:13.507149+0000","last_clean":"2024-03-18T14:41:13.507149+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:41:13.507149+0000","last_undegraded":"2024-03-18T14:41:13.507149+0000","last_fullsized":"2024-03-18T14:41:13.507149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511816+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:41:13.511816+0000","last_peered":"2024-03-18T14:41:13.511816+0000","last_clean":"2024-03-18T14:41:13.511816+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:41:13.511816+0000","last_undegraded":"2024-03-18T14:41:13.511816+0000","last_fullsized":"2024-03-18T14:41:13.511816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509362+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:41:13.509362+0000","last_peered":"2024-03-18T14:41:13.509362+0000","last_clean":"2024-03-18T14:41:13.509362+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:41:13.509362+0000","last_undegraded":"2024-03-18T14:41:13.509362+0000","last_fullsized":"2024-03-18T14:41:13.509362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504253+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:41:13.504253+0000","last_peered":"2024-03-18T14:41:13.504253+0000","last_clean":"2024-03-18T14:41:13.504253+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:41:13.504253+0000","last_undegraded":"2024-03-18T14:41:13.504253+0000","last_fullsized":"2024-03-18T14:41:13.504253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504412+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:41:13.504412+0000","last_peered":"2024-03-18T14:41:13.504412+0000","last_clean":"2024-03-18T14:41:13.504412+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:41:13.504412+0000","last_undegraded":"2024-03-18T14:41:13.504412+0000","last_fullsized":"2024-03-18T14:41:13.504412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509284+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:41:13.509284+0000","last_peered":"2024-03-18T14:41:13.509284+0000","last_clean":"2024-03-18T14:41:13.509284+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:41:13.509284+0000","last_undegraded":"2024-03-18T14:41:13.509284+0000","last_fullsized":"2024-03-18T14:41:13.509284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508251+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:41:13.508251+0000","last_peered":"2024-03-18T14:41:13.508251+0000","last_clean":"2024-03-18T14:41:13.508251+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:41:13.508251+0000","last_undegraded":"2024-03-18T14:41:13.508251+0000","last_fullsized":"2024-03-18T14:41:13.508251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508362+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:41:13.508362+0000","last_peered":"2024-03-18T14:41:13.508362+0000","last_clean":"2024-03-18T14:41:13.508362+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:41:13.508362+0000","last_undegraded":"2024-03-18T14:41:13.508362+0000","last_fullsized":"2024-03-18T14:41:13.508362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508184+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:41:13.508184+0000","last_peered":"2024-03-18T14:41:13.508184+0000","last_clean":"2024-03-18T14:41:13.508184+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:41:13.508184+0000","last_undegraded":"2024-03-18T14:41:13.508184+0000","last_fullsized":"2024-03-18T14:41:13.508184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507979+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:41:13.507979+0000","last_peered":"2024-03-18T14:41:13.507979+0000","last_clean":"2024-03-18T14:41:13.507979+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:41:13.507979+0000","last_undegraded":"2024-03-18T14:41:13.507979+0000","last_fullsized":"2024-03-18T14:41:13.507979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499448+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:41:13.499448+0000","last_peered":"2024-03-18T14:41:13.499448+0000","last_clean":"2024-03-18T14:41:13.499448+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:41:13.499448+0000","last_undegraded":"2024-03-18T14:41:13.499448+0000","last_fullsized":"2024-03-18T14:41:13.499448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515134+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:41:13.515134+0000","last_peered":"2024-03-18T14:41:13.515134+0000","last_clean":"2024-03-18T14:41:13.515134+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:41:13.515134+0000","last_undegraded":"2024-03-18T14:41:13.515134+0000","last_fullsized":"2024-03-18T14:41:13.515134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516394+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:41:13.516394+0000","last_peered":"2024-03-18T14:41:13.516394+0000","last_clean":"2024-03-18T14:41:13.516394+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:41:13.516394+0000","last_undegraded":"2024-03-18T14:41:13.516394+0000","last_fullsized":"2024-03-18T14:41:13.516394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507867+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:41:13.507867+0000","last_peered":"2024-03-18T14:41:13.507867+0000","last_clean":"2024-03-18T14:41:13.507867+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:41:13.507867+0000","last_undegraded":"2024-03-18T14:41:13.507867+0000","last_fullsized":"2024-03-18T14:41:13.507867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507480+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:41:13.507480+0000","last_peered":"2024-03-18T14:41:13.507480+0000","last_clean":"2024-03-18T14:41:13.507480+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:41:13.507480+0000","last_undegraded":"2024-03-18T14:41:13.507480+0000","last_fullsized":"2024-03-18T14:41:13.507480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516851+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:41:13.516851+0000","last_peered":"2024-03-18T14:41:13.516851+0000","last_clean":"2024-03-18T14:41:13.516851+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:41:13.516851+0000","last_undegraded":"2024-03-18T14:41:13.516851+0000","last_fullsized":"2024-03-18T14:41:13.516851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516907+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:41:13.516907+0000","last_peered":"2024-03-18T14:41:13.516907+0000","last_clean":"2024-03-18T14:41:13.516907+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:41:13.516907+0000","last_undegraded":"2024-03-18T14:41:13.516907+0000","last_fullsized":"2024-03-18T14:41:13.516907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511840+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:41:13.511840+0000","last_peered":"2024-03-18T14:41:13.511840+0000","last_clean":"2024-03-18T14:41:13.511840+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:41:13.511840+0000","last_undegraded":"2024-03-18T14:41:13.511840+0000","last_fullsized":"2024-03-18T14:41:13.511840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507840+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:41:13.507840+0000","last_peered":"2024-03-18T14:41:13.507840+0000","last_clean":"2024-03-18T14:41:13.507840+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:41:13.507840+0000","last_undegraded":"2024-03-18T14:41:13.507840+0000","last_fullsized":"2024-03-18T14:41:13.507840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504184+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:41:13.504184+0000","last_peered":"2024-03-18T14:41:13.504184+0000","last_clean":"2024-03-18T14:41:13.504184+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:41:13.504184+0000","last_undegraded":"2024-03-18T14:41:13.504184+0000","last_fullsized":"2024-03-18T14:41:13.504184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512707+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:41:13.512707+0000","last_peered":"2024-03-18T14:41:13.512707+0000","last_clean":"2024-03-18T14:41:13.512707+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:41:13.512707+0000","last_undegraded":"2024-03-18T14:41:13.512707+0000","last_fullsized":"2024-03-18T14:41:13.512707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488074+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:41:13.488074+0000","last_peered":"2024-03-18T14:41:13.488074+0000","last_clean":"2024-03-18T14:41:13.488074+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:41:13.488074+0000","last_undegraded":"2024-03-18T14:41:13.488074+0000","last_fullsized":"2024-03-18T14:41:13.488074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508888+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:41:13.508888+0000","last_peered":"2024-03-18T14:41:13.508888+0000","last_clean":"2024-03-18T14:41:13.508888+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:41:13.508888+0000","last_undegraded":"2024-03-18T14:41:13.508888+0000","last_fullsized":"2024-03-18T14:41:13.508888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.472694+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:41:14.472694+0000","last_peered":"2024-03-18T14:41:14.472694+0000","last_clean":"2024-03-18T14:41:14.472694+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:41:14.472694+0000","last_undegraded":"2024-03-18T14:41:14.472694+0000","last_fullsized":"2024-03-18T14:41:14.472694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509484+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:41:13.509484+0000","last_peered":"2024-03-18T14:41:13.509484+0000","last_clean":"2024-03-18T14:41:13.509484+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:41:13.509484+0000","last_undegraded":"2024-03-18T14:41:13.509484+0000","last_fullsized":"2024-03-18T14:41:13.509484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185331+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:41:16.185331+0000","last_peered":"2024-03-18T14:41:16.185331+0000","last_clean":"2024-03-18T14:41:16.185331+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:41:16.185331+0000","last_undegraded":"2024-03-18T14:41:16.185331+0000","last_fullsized":"2024-03-18T14:41:16.185331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512366+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:41:13.512366+0000","last_peered":"2024-03-18T14:41:13.512366+0000","last_clean":"2024-03-18T14:41:13.512366+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:41:13.512366+0000","last_undegraded":"2024-03-18T14:41:13.512366+0000","last_fullsized":"2024-03-18T14:41:13.512366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184456+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:41:16.184456+0000","last_peered":"2024-03-18T14:41:16.184456+0000","last_clean":"2024-03-18T14:41:16.184456+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:41:16.184456+0000","last_undegraded":"2024-03-18T14:41:16.184456+0000","last_fullsized":"2024-03-18T14:41:16.184456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507540+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:41:13.507540+0000","last_peered":"2024-03-18T14:41:13.507540+0000","last_clean":"2024-03-18T14:41:13.507540+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:41:13.507540+0000","last_undegraded":"2024-03-18T14:41:13.507540+0000","last_fullsized":"2024-03-18T14:41:13.507540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.553308+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:41:14.553308+0000","last_peered":"2024-03-18T14:41:14.553308+0000","last_clean":"2024-03-18T14:41:14.553308+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:41:14.553308+0000","last_undegraded":"2024-03-18T14:41:14.553308+0000","last_fullsized":"2024-03-18T14:41:14.553308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509259+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:41:13.509259+0000","last_peered":"2024-03-18T14:41:13.509259+0000","last_clean":"2024-03-18T14:41:13.509259+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:41:13.509259+0000","last_undegraded":"2024-03-18T14:41:13.509259+0000","last_fullsized":"2024-03-18T14:41:13.509259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185641+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:41:16.185641+0000","last_peered":"2024-03-18T14:41:16.185641+0000","last_clean":"2024-03-18T14:41:16.185641+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:41:16.185641+0000","last_undegraded":"2024-03-18T14:41:16.185641+0000","last_fullsized":"2024-03-18T14:41:16.185641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504392+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:41:13.504392+0000","last_peered":"2024-03-18T14:41:13.504392+0000","last_clean":"2024-03-18T14:41:13.504392+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:41:13.504392+0000","last_undegraded":"2024-03-18T14:41:13.504392+0000","last_fullsized":"2024-03-18T14:41:13.504392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185419+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:41:16.185419+0000","last_peered":"2024-03-18T14:41:16.185419+0000","last_clean":"2024-03-18T14:41:16.185419+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:41:16.185419+0000","last_undegraded":"2024-03-18T14:41:16.185419+0000","last_fullsized":"2024-03-18T14:41:16.185419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515468+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:41:13.515468+0000","last_peered":"2024-03-18T14:41:13.515468+0000","last_clean":"2024-03-18T14:41:13.515468+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:41:13.515468+0000","last_undegraded":"2024-03-18T14:41:13.515468+0000","last_fullsized":"2024-03-18T14:41:13.515468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.183308+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:41:16.183308+0000","last_peered":"2024-03-18T14:41:16.183308+0000","last_clean":"2024-03-18T14:41:16.183308+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:41:16.183308+0000","last_undegraded":"2024-03-18T14:41:16.183308+0000","last_fullsized":"2024-03-18T14:41:16.183308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507827+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:41:13.507827+0000","last_peered":"2024-03-18T14:41:13.507827+0000","last_clean":"2024-03-18T14:41:13.507827+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:41:13.507827+0000","last_undegraded":"2024-03-18T14:41:13.507827+0000","last_fullsized":"2024-03-18T14:41:13.507827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480111+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:41:13.480111+0000","last_peered":"2024-03-18T14:41:13.480111+0000","last_clean":"2024-03-18T14:41:13.480111+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:41:13.480111+0000","last_undegraded":"2024-03-18T14:41:13.480111+0000","last_fullsized":"2024-03-18T14:41:13.480111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.506508+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:41:13.506508+0000","last_peered":"2024-03-18T14:41:13.506508+0000","last_clean":"2024-03-18T14:41:13.506508+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:41:13.506508+0000","last_undegraded":"2024-03-18T14:41:13.506508+0000","last_fullsized":"2024-03-18T14:41:13.506508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184958+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:41:16.184958+0000","last_peered":"2024-03-18T14:41:16.184958+0000","last_clean":"2024-03-18T14:41:16.184958+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:41:16.184958+0000","last_undegraded":"2024-03-18T14:41:16.184958+0000","last_fullsized":"2024-03-18T14:41:16.184958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509504+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:41:13.509504+0000","last_peered":"2024-03-18T14:41:13.509504+0000","last_clean":"2024-03-18T14:41:13.509504+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:41:13.509504+0000","last_undegraded":"2024-03-18T14:41:13.509504+0000","last_fullsized":"2024-03-18T14:41:13.509504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501819+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:41:13.501819+0000","last_peered":"2024-03-18T14:41:13.501819+0000","last_clean":"2024-03-18T14:41:13.501819+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:41:13.501819+0000","last_undegraded":"2024-03-18T14:41:13.501819+0000","last_fullsized":"2024-03-18T14:41:13.501819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515787+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:41:13.515787+0000","last_peered":"2024-03-18T14:41:13.515787+0000","last_clean":"2024-03-18T14:41:13.515787+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:41:13.515787+0000","last_undegraded":"2024-03-18T14:41:13.515787+0000","last_fullsized":"2024-03-18T14:41:13.515787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.495818+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:41:13.495818+0000","last_peered":"2024-03-18T14:41:13.495818+0000","last_clean":"2024-03-18T14:41:13.495818+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:41:13.495818+0000","last_undegraded":"2024-03-18T14:41:13.495818+0000","last_fullsized":"2024-03-18T14:41:13.495818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509149+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:41:13.509149+0000","last_peered":"2024-03-18T14:41:13.509149+0000","last_clean":"2024-03-18T14:41:13.509149+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:41:13.509149+0000","last_undegraded":"2024-03-18T14:41:13.509149+0000","last_fullsized":"2024-03-18T14:41:13.509149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512633+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:41:13.512633+0000","last_peered":"2024-03-18T14:41:13.512633+0000","last_clean":"2024-03-18T14:41:13.512633+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:41:13.512633+0000","last_undegraded":"2024-03-18T14:41:13.512633+0000","last_fullsized":"2024-03-18T14:41:13.512633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496729+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:41:13.496729+0000","last_peered":"2024-03-18T14:41:13.496729+0000","last_clean":"2024-03-18T14:41:13.496729+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:41:13.496729+0000","last_undegraded":"2024-03-18T14:41:13.496729+0000","last_fullsized":"2024-03-18T14:41:13.496729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471863+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:41:13.471863+0000","last_peered":"2024-03-18T14:41:13.471863+0000","last_clean":"2024-03-18T14:41:13.471863+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:41:13.471863+0000","last_undegraded":"2024-03-18T14:41:13.471863+0000","last_fullsized":"2024-03-18T14:41:13.471863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508108+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:41:13.508108+0000","last_peered":"2024-03-18T14:41:13.508108+0000","last_clean":"2024-03-18T14:41:13.508108+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:41:13.508108+0000","last_undegraded":"2024-03-18T14:41:13.508108+0000","last_fullsized":"2024-03-18T14:41:13.508108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185052+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:41:16.185052+0000","last_peered":"2024-03-18T14:41:16.185052+0000","last_clean":"2024-03-18T14:41:16.185052+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:41:16.185052+0000","last_undegraded":"2024-03-18T14:41:16.185052+0000","last_fullsized":"2024-03-18T14:41:16.185052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.492488+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:41:13.492488+0000","last_peered":"2024-03-18T14:41:13.492488+0000","last_clean":"2024-03-18T14:41:13.492488+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:41:13.492488+0000","last_undegraded":"2024-03-18T14:41:13.492488+0000","last_fullsized":"2024-03-18T14:41:13.492488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.472992+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:41:14.472992+0000","last_peered":"2024-03-18T14:41:14.472992+0000","last_clean":"2024-03-18T14:41:14.472992+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:41:14.472992+0000","last_undegraded":"2024-03-18T14:41:14.472992+0000","last_fullsized":"2024-03-18T14:41:14.472992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512732+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:41:13.512732+0000","last_peered":"2024-03-18T14:41:13.512732+0000","last_clean":"2024-03-18T14:41:13.512732+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:41:13.512732+0000","last_undegraded":"2024-03-18T14:41:13.512732+0000","last_fullsized":"2024-03-18T14:41:13.512732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184686+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:41:16.184686+0000","last_peered":"2024-03-18T14:41:16.184686+0000","last_clean":"2024-03-18T14:41:16.184686+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:41:16.184686+0000","last_undegraded":"2024-03-18T14:41:16.184686+0000","last_fullsized":"2024-03-18T14:41:16.184686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503072+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:41:13.503072+0000","last_peered":"2024-03-18T14:41:13.503072+0000","last_clean":"2024-03-18T14:41:13.503072+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:41:13.503072+0000","last_undegraded":"2024-03-18T14:41:13.503072+0000","last_fullsized":"2024-03-18T14:41:13.503072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.183842+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:41:16.183842+0000","last_peered":"2024-03-18T14:41:16.183842+0000","last_clean":"2024-03-18T14:41:16.183842+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:41:16.183842+0000","last_undegraded":"2024-03-18T14:41:16.183842+0000","last_fullsized":"2024-03-18T14:41:16.183842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514205+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:41:13.514205+0000","last_peered":"2024-03-18T14:41:13.514205+0000","last_clean":"2024-03-18T14:41:13.514205+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:41:13.514205+0000","last_undegraded":"2024-03-18T14:41:13.514205+0000","last_fullsized":"2024-03-18T14:41:13.514205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.489432+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:13.489432+0000","last_peered":"2024-03-18T14:41:13.489432+0000","last_clean":"2024-03-18T14:41:13.489432+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:13.489432+0000","last_undegraded":"2024-03-18T14:41:13.489432+0000","last_fullsized":"2024-03-18T14:41:13.489432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.471946+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:41:14.471946+0000","last_peered":"2024-03-18T14:41:14.471946+0000","last_clean":"2024-03-18T14:41:14.471946+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:41:14.471946+0000","last_undegraded":"2024-03-18T14:41:14.471946+0000","last_fullsized":"2024-03-18T14:41:14.471946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509233+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:41:13.509233+0000","last_peered":"2024-03-18T14:41:13.509233+0000","last_clean":"2024-03-18T14:41:13.509233+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:41:13.509233+0000","last_undegraded":"2024-03-18T14:41:13.509233+0000","last_fullsized":"2024-03-18T14:41:13.509233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.486304+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:13.486304+0000","last_peered":"2024-03-18T14:41:13.486304+0000","last_clean":"2024-03-18T14:41:13.486304+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:13.486304+0000","last_undegraded":"2024-03-18T14:41:13.486304+0000","last_fullsized":"2024-03-18T14:41:13.486304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185062+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:41:16.185062+0000","last_peered":"2024-03-18T14:41:16.185062+0000","last_clean":"2024-03-18T14:41:16.185062+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:41:16.185062+0000","last_undegraded":"2024-03-18T14:41:16.185062+0000","last_fullsized":"2024-03-18T14:41:16.185062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512594+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:41:13.512594+0000","last_peered":"2024-03-18T14:41:13.512594+0000","last_clean":"2024-03-18T14:41:13.512594+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:41:13.512594+0000","last_undegraded":"2024-03-18T14:41:13.512594+0000","last_fullsized":"2024-03-18T14:41:13.512594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471693+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:13.471693+0000","last_peered":"2024-03-18T14:41:13.471693+0000","last_clean":"2024-03-18T14:41:13.471693+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:13.471693+0000","last_undegraded":"2024-03-18T14:41:13.471693+0000","last_fullsized":"2024-03-18T14:41:13.471693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.553692+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:41:14.553692+0000","last_peered":"2024-03-18T14:41:14.553692+0000","last_clean":"2024-03-18T14:41:14.553692+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:41:14.553692+0000","last_undegraded":"2024-03-18T14:41:14.553692+0000","last_fullsized":"2024-03-18T14:41:14.553692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514181+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:41:13.514181+0000","last_peered":"2024-03-18T14:41:13.514181+0000","last_clean":"2024-03-18T14:41:13.514181+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:41:13.514181+0000","last_undegraded":"2024-03-18T14:41:13.514181+0000","last_fullsized":"2024-03-18T14:41:13.514181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.478113+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:13.478113+0000","last_peered":"2024-03-18T14:41:13.478113+0000","last_clean":"2024-03-18T14:41:13.478113+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:13.478113+0000","last_undegraded":"2024-03-18T14:41:13.478113+0000","last_fullsized":"2024-03-18T14:41:13.478113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488848+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:13.488848+0000","last_peered":"2024-03-18T14:41:13.488848+0000","last_clean":"2024-03-18T14:41:13.488848+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:13.488848+0000","last_undegraded":"2024-03-18T14:41:13.488848+0000","last_fullsized":"2024-03-18T14:41:13.488848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484063+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:41:13.484063+0000","last_peered":"2024-03-18T14:41:13.484063+0000","last_clean":"2024-03-18T14:41:13.484063+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:41:13.484063+0000","last_undegraded":"2024-03-18T14:41:13.484063+0000","last_fullsized":"2024-03-18T14:41:13.484063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512758+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:41:13.512758+0000","last_peered":"2024-03-18T14:41:13.512758+0000","last_clean":"2024-03-18T14:41:13.512758+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:41:13.512758+0000","last_undegraded":"2024-03-18T14:41:13.512758+0000","last_fullsized":"2024-03-18T14:41:13.512758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477322+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:13.477322+0000","last_peered":"2024-03-18T14:41:13.477322+0000","last_clean":"2024-03-18T14:41:13.477322+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:13.477322+0000","last_undegraded":"2024-03-18T14:41:13.477322+0000","last_fullsized":"2024-03-18T14:41:13.477322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.551766+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:41:14.551766+0000","last_peered":"2024-03-18T14:41:14.551766+0000","last_clean":"2024-03-18T14:41:14.551766+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:41:14.551766+0000","last_undegraded":"2024-03-18T14:41:14.551766+0000","last_fullsized":"2024-03-18T14:41:14.551766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508002+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:41:13.508002+0000","last_peered":"2024-03-18T14:41:13.508002+0000","last_clean":"2024-03-18T14:41:13.508002+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:41:13.508002+0000","last_undegraded":"2024-03-18T14:41:13.508002+0000","last_fullsized":"2024-03-18T14:41:13.508002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480432+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:13.480432+0000","last_peered":"2024-03-18T14:41:13.480432+0000","last_clean":"2024-03-18T14:41:13.480432+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:13.480432+0000","last_undegraded":"2024-03-18T14:41:13.480432+0000","last_fullsized":"2024-03-18T14:41:13.480432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488890+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:41:13.488890+0000","last_peered":"2024-03-18T14:41:13.488890+0000","last_clean":"2024-03-18T14:41:13.488890+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:41:13.488890+0000","last_undegraded":"2024-03-18T14:41:13.488890+0000","last_fullsized":"2024-03-18T14:41:13.488890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.505494+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:41:13.505494+0000","last_peered":"2024-03-18T14:41:13.505494+0000","last_clean":"2024-03-18T14:41:13.505494+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:41:13.505494+0000","last_undegraded":"2024-03-18T14:41:13.505494+0000","last_fullsized":"2024-03-18T14:41:13.505494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184401+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:41:16.184401+0000","last_peered":"2024-03-18T14:41:16.184401+0000","last_clean":"2024-03-18T14:41:16.184401+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:41:16.184401+0000","last_undegraded":"2024-03-18T14:41:16.184401+0000","last_fullsized":"2024-03-18T14:41:16.184401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488209+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:13.488209+0000","last_peered":"2024-03-18T14:41:13.488209+0000","last_clean":"2024-03-18T14:41:13.488209+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:13.488209+0000","last_undegraded":"2024-03-18T14:41:13.488209+0000","last_fullsized":"2024-03-18T14:41:13.488209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512337+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:41:13.512337+0000","last_peered":"2024-03-18T14:41:13.512337+0000","last_clean":"2024-03-18T14:41:13.512337+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:41:13.512337+0000","last_undegraded":"2024-03-18T14:41:13.512337+0000","last_fullsized":"2024-03-18T14:41:13.512337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477899+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:13.477899+0000","last_peered":"2024-03-18T14:41:13.477899+0000","last_clean":"2024-03-18T14:41:13.477899+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:13.477899+0000","last_undegraded":"2024-03-18T14:41:13.477899+0000","last_fullsized":"2024-03-18T14:41:13.477899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.552483+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:41:14.552483+0000","last_peered":"2024-03-18T14:41:14.552483+0000","last_clean":"2024-03-18T14:41:14.552483+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:41:14.552483+0000","last_undegraded":"2024-03-18T14:41:14.552483+0000","last_fullsized":"2024-03-18T14:41:14.552483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503135+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:41:13.503135+0000","last_peered":"2024-03-18T14:41:13.503135+0000","last_clean":"2024-03-18T14:41:13.503135+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:41:13.503135+0000","last_undegraded":"2024-03-18T14:41:13.503135+0000","last_fullsized":"2024-03-18T14:41:13.503135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185803+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:41:16.185803+0000","last_peered":"2024-03-18T14:41:16.185803+0000","last_clean":"2024-03-18T14:41:16.185803+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:41:16.185803+0000","last_undegraded":"2024-03-18T14:41:16.185803+0000","last_fullsized":"2024-03-18T14:41:16.185803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515520+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:41:13.515520+0000","last_peered":"2024-03-18T14:41:13.515520+0000","last_clean":"2024-03-18T14:41:13.515520+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:41:13.515520+0000","last_undegraded":"2024-03-18T14:41:13.515520+0000","last_fullsized":"2024-03-18T14:41:13.515520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514297+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:41:13.514297+0000","last_peered":"2024-03-18T14:41:13.514297+0000","last_clean":"2024-03-18T14:41:13.514297+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:41:13.514297+0000","last_undegraded":"2024-03-18T14:41:13.514297+0000","last_fullsized":"2024-03-18T14:41:13.514297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504368+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:41:13.504368+0000","last_peered":"2024-03-18T14:41:13.504368+0000","last_clean":"2024-03-18T14:41:13.504368+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:41:13.504368+0000","last_undegraded":"2024-03-18T14:41:13.504368+0000","last_fullsized":"2024-03-18T14:41:13.504368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.494592+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:41:13.494592+0000","last_peered":"2024-03-18T14:41:13.494592+0000","last_clean":"2024-03-18T14:41:13.494592+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:41:13.494592+0000","last_undegraded":"2024-03-18T14:41:13.494592+0000","last_fullsized":"2024-03-18T14:41:13.494592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496751+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:41:13.496751+0000","last_peered":"2024-03-18T14:41:13.496751+0000","last_clean":"2024-03-18T14:41:13.496751+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:41:13.496751+0000","last_undegraded":"2024-03-18T14:41:13.496751+0000","last_fullsized":"2024-03-18T14:41:13.496751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499356+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:41:13.499356+0000","last_peered":"2024-03-18T14:41:13.499356+0000","last_clean":"2024-03-18T14:41:13.499356+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:41:13.499356+0000","last_undegraded":"2024-03-18T14:41:13.499356+0000","last_fullsized":"2024-03-18T14:41:13.499356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512082+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:41:13.512082+0000","last_peered":"2024-03-18T14:41:13.512082+0000","last_clean":"2024-03-18T14:41:13.512082+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:41:13.512082+0000","last_undegraded":"2024-03-18T14:41:13.512082+0000","last_fullsized":"2024-03-18T14:41:13.512082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501675+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:41:13.501675+0000","last_peered":"2024-03-18T14:41:13.501675+0000","last_clean":"2024-03-18T14:41:13.501675+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:41:13.501675+0000","last_undegraded":"2024-03-18T14:41:13.501675+0000","last_fullsized":"2024-03-18T14:41:13.501675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507403+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:41:13.507403+0000","last_peered":"2024-03-18T14:41:13.507403+0000","last_clean":"2024-03-18T14:41:13.507403+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:41:13.507403+0000","last_undegraded":"2024-03-18T14:41:13.507403+0000","last_fullsized":"2024-03-18T14:41:13.507403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516799+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:41:13.516799+0000","last_peered":"2024-03-18T14:41:13.516799+0000","last_clean":"2024-03-18T14:41:13.516799+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:41:13.516799+0000","last_undegraded":"2024-03-18T14:41:13.516799+0000","last_fullsized":"2024-03-18T14:41:13.516799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507508+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:41:13.507508+0000","last_peered":"2024-03-18T14:41:13.507508+0000","last_clean":"2024-03-18T14:41:13.507508+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:41:13.507508+0000","last_undegraded":"2024-03-18T14:41:13.507508+0000","last_fullsized":"2024-03-18T14:41:13.507508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.487107+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:41:13.487107+0000","last_peered":"2024-03-18T14:41:13.487107+0000","last_clean":"2024-03-18T14:41:13.487107+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:41:13.487107+0000","last_undegraded":"2024-03-18T14:41:13.487107+0000","last_fullsized":"2024-03-18T14:41:13.487107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510682+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:41:13.510682+0000","last_peered":"2024-03-18T14:41:13.510682+0000","last_clean":"2024-03-18T14:41:13.510682+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:41:13.510682+0000","last_undegraded":"2024-03-18T14:41:13.510682+0000","last_fullsized":"2024-03-18T14:41:13.510682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512569+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:41:13.512569+0000","last_peered":"2024-03-18T14:41:13.512569+0000","last_clean":"2024-03-18T14:41:13.512569+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:41:13.512569+0000","last_undegraded":"2024-03-18T14:41:13.512569+0000","last_fullsized":"2024-03-18T14:41:13.512569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]}]}} 2024-03-18T14:41:22.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:41:22.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 Processor -- start 2024-03-18T14:41:22.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 -- start start 2024-03-18T14:41:22.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bb8137860 0x7f8bb8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 0x7f8bb813e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb8063a70 con 0x7f8bb80650c0 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80649c0 con 0x7f8bb8137860 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bc00ec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8064bc0 con 0x7f8bb813c420 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.722+0000 7f8bbde88700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bb8137860 0x7f8bb8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbe689700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 0x7f8bb813e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbd687700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8bb80650c0 0x7f8bb80630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39670/0 (socket says 172.21.15.57:39670) 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbd687700 1 -- 172.21.15.57:0/1300108241 learned_addr learned my addr 172.21.15.57:0/1300108241 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbce86700 1 -- 172.21.15.57:0/1300108241 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432126530 0 0) 0x7f8bb8063a70 con 0x7f8bb80650c0 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbce86700 1 -- 172.21.15.57:0/1300108241 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba0003260 con 0x7f8bb80650c0 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbde88700 1 -- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 msgr2=0x7f8bb813e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbde88700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 0x7f8bb813e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbde88700 1 -- 172.21.15.57:0/1300108241 >> v1:172.21.15.57:6789/0 conn(0x7f8bb80650c0 legacy=0x7f8bb80630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbde88700 1 -- 172.21.15.57:0/1300108241 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80ab0d0 con 0x7f8bb8137860 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbe689700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 0x7f8bb813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbde88700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb8137860 0x7f8bb8137c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4006df0).ready entity=mon.0 client_cookie=391e6c231423f64 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbce86700 1 -- 172.21.15.57:0/1300108241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb400d4a0 con 0x7f8bb8137860 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbce86700 1 -- 172.21.15.57:0/1300108241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4000e90 con 0x7f8bb8137860 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.723+0000 7f8bbce86700 1 -- 172.21.15.57:0/1300108241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb400d7f0 con 0x7f8bb8137860 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb8137860 msgr2=0x7f8bb8137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb8137860 0x7f8bb8137c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4006df0).stop 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1300108241 shutdown_connections 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb813c420 0x7f8bb813e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1300108241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb8137860 0x7f8bb8137c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1300108241 >> 172.21.15.57:0/1300108241 conn(0x7f8bb805c300 msgr2=0x7f8bb806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1300108241 shutdown_connections 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.724+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1300108241 wait complete. 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 Processor -- start 2024-03-18T14:41:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 -- start start 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 0x7f8bb81489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bb813c420 0x7f8bb8148e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8061c50 con 0x7f8bb80650c0 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8131270 con 0x7f8bb813c420 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bc00ec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80611e0 con 0x7f8bb8137860 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bbde88700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bbd687700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 0x7f8bb81489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bbde88700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40716/0 (socket says 172.21.15.57:40716) 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bbde88700 1 -- 172.21.15.57:0/1231834387 learned_addr learned my addr 172.21.15.57:0/1231834387 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.725+0000 7f8bbe689700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bb813c420 0x7f8bb8148e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 -- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 msgr2=0x7f8bb81489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 0x7f8bb81489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 -- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bb813c420 msgr2=0x7f8bb8148e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bb813c420 0x7f8bb8148e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 -- 172.21.15.57:0/1231834387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009470 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbd687700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 0x7f8bb81489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bbde88700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb4013ac0 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb4013c20 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb400b180 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8bb401e400 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.726+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb81314c0 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.727+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8bb4025030 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.727+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8bb404b720 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.727+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb813b270 con 0x7f8bb80650c0 2024-03-18T14:41:22.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.730+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8bb4023070 con 0x7f8bb80650c0 2024-03-18T14:41:22.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.841+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 --> v1:172.21.15.57:6816/39496 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bb80637b0 con 0x7f8b98038e30 2024-03-18T14:41:22.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.847+0000 7f8ba6ffd700 1 -- 172.21.15.57:0/1231834387 <== mgr.4099 v1:172.21.15.57:6816/39496 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246941 (unknown 2965378022 0 976718321) 0x7f8bb80637b0 con 0x7f8b98038e30 2024-03-18T14:41:22.852 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 >> v1:172.21.15.57:6816/39496 conn(0x7f8b98038e30 legacy=0x7f8b9803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 msgr2=0x7f8bb8060810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8bb4002f70 tx=0x7f8bb4014000).stop 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 shutdown_connections 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8bb813c420 0x7f8bb8148e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bb80650c0 0x7f8bb8060810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 --2- 172.21.15.57:0/1231834387 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8bb8137860 0x7f8bb81489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:22.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 >> 172.21.15.57:0/1231834387 conn(0x7f8bb805c300 msgr2=0x7f8bb81365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:22.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 shutdown_connections 2024-03-18T14:41:22.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:22.850+0000 7f8bc00ec700 1 -- 172.21.15.57:0/1231834387 wait complete. 2024-03-18T14:41:22.855 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:41:22.861 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-18T14:41:22.411165+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":86,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.946415"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504374+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:41:13.504374+0000","last_peered":"2024-03-18T14:41:13.504374+0000","last_clean":"2024-03-18T14:41:13.504374+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:41:13.504374+0000","last_undegraded":"2024-03-18T14:41:13.504374+0000","last_fullsized":"2024-03-18T14:41:13.504374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503047+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:41:13.503047+0000","last_peered":"2024-03-18T14:41:13.503047+0000","last_clean":"2024-03-18T14:41:13.503047+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:41:13.503047+0000","last_undegraded":"2024-03-18T14:41:13.503047+0000","last_fullsized":"2024-03-18T14:41:13.503047+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509070+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:41:13.509070+0000","last_peered":"2024-03-18T14:41:13.509070+0000","last_clean":"2024-03-18T14:41:13.509070+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:41:13.509070+0000","last_undegraded":"2024-03-18T14:41:13.509070+0000","last_fullsized":"2024-03-18T14:41:13.509070+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516068+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:41:13.516068+0000","last_peered":"2024-03-18T14:41:13.516068+0000","last_clean":"2024-03-18T14:41:13.516068+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:41:13.516068+0000","last_undegraded":"2024-03-18T14:41:13.516068+0000","last_fullsized":"2024-03-18T14:41:13.516068+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508157+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:41:13.508157+0000","last_peered":"2024-03-18T14:41:13.508157+0000","last_clean":"2024-03-18T14:41:13.508157+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:41:13.508157+0000","last_undegraded":"2024-03-18T14:41:13.508157+0000","last_fullsized":"2024-03-18T14:41:13.508157+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510313+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:41:13.510313+0000","last_peered":"2024-03-18T14:41:13.510313+0000","last_clean":"2024-03-18T14:41:13.510313+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:41:13.510313+0000","last_undegraded":"2024-03-18T14:41:13.510313+0000","last_fullsized":"2024-03-18T14:41:13.510313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503242+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:41:13.503242+0000","last_peered":"2024-03-18T14:41:13.503242+0000","last_clean":"2024-03-18T14:41:13.503242+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:41:13.503242+0000","last_undegraded":"2024-03-18T14:41:13.503242+0000","last_fullsized":"2024-03-18T14:41:13.503242+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516825+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:41:13.516825+0000","last_peered":"2024-03-18T14:41:13.516825+0000","last_clean":"2024-03-18T14:41:13.516825+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:41:13.516825+0000","last_undegraded":"2024-03-18T14:41:13.516825+0000","last_fullsized":"2024-03-18T14:41:13.516825+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507149+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:41:13.507149+0000","last_peered":"2024-03-18T14:41:13.507149+0000","last_clean":"2024-03-18T14:41:13.507149+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:41:13.507149+0000","last_undegraded":"2024-03-18T14:41:13.507149+0000","last_fullsized":"2024-03-18T14:41:13.507149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511816+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:41:13.511816+0000","last_peered":"2024-03-18T14:41:13.511816+0000","last_clean":"2024-03-18T14:41:13.511816+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:41:13.511816+0000","last_undegraded":"2024-03-18T14:41:13.511816+0000","last_fullsized":"2024-03-18T14:41:13.511816+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509362+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:41:13.509362+0000","last_peered":"2024-03-18T14:41:13.509362+0000","last_clean":"2024-03-18T14:41:13.509362+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:41:13.509362+0000","last_undegraded":"2024-03-18T14:41:13.509362+0000","last_fullsized":"2024-03-18T14:41:13.509362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504253+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:41:13.504253+0000","last_peered":"2024-03-18T14:41:13.504253+0000","last_clean":"2024-03-18T14:41:13.504253+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:41:13.504253+0000","last_undegraded":"2024-03-18T14:41:13.504253+0000","last_fullsized":"2024-03-18T14:41:13.504253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504412+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:41:13.504412+0000","last_peered":"2024-03-18T14:41:13.504412+0000","last_clean":"2024-03-18T14:41:13.504412+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:41:13.504412+0000","last_undegraded":"2024-03-18T14:41:13.504412+0000","last_fullsized":"2024-03-18T14:41:13.504412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509284+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:41:13.509284+0000","last_peered":"2024-03-18T14:41:13.509284+0000","last_clean":"2024-03-18T14:41:13.509284+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:41:13.509284+0000","last_undegraded":"2024-03-18T14:41:13.509284+0000","last_fullsized":"2024-03-18T14:41:13.509284+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508251+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:41:13.508251+0000","last_peered":"2024-03-18T14:41:13.508251+0000","last_clean":"2024-03-18T14:41:13.508251+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:41:13.508251+0000","last_undegraded":"2024-03-18T14:41:13.508251+0000","last_fullsized":"2024-03-18T14:41:13.508251+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508362+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:41:13.508362+0000","last_peered":"2024-03-18T14:41:13.508362+0000","last_clean":"2024-03-18T14:41:13.508362+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:41:13.508362+0000","last_undegraded":"2024-03-18T14:41:13.508362+0000","last_fullsized":"2024-03-18T14:41:13.508362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508184+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:41:13.508184+0000","last_peered":"2024-03-18T14:41:13.508184+0000","last_clean":"2024-03-18T14:41:13.508184+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:41:13.508184+0000","last_undegraded":"2024-03-18T14:41:13.508184+0000","last_fullsized":"2024-03-18T14:41:13.508184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507979+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:41:13.507979+0000","last_peered":"2024-03-18T14:41:13.507979+0000","last_clean":"2024-03-18T14:41:13.507979+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:41:13.507979+0000","last_undegraded":"2024-03-18T14:41:13.507979+0000","last_fullsized":"2024-03-18T14:41:13.507979+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499448+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:41:13.499448+0000","last_peered":"2024-03-18T14:41:13.499448+0000","last_clean":"2024-03-18T14:41:13.499448+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:41:13.499448+0000","last_undegraded":"2024-03-18T14:41:13.499448+0000","last_fullsized":"2024-03-18T14:41:13.499448+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515134+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:41:13.515134+0000","last_peered":"2024-03-18T14:41:13.515134+0000","last_clean":"2024-03-18T14:41:13.515134+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:41:13.515134+0000","last_undegraded":"2024-03-18T14:41:13.515134+0000","last_fullsized":"2024-03-18T14:41:13.515134+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516394+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:41:13.516394+0000","last_peered":"2024-03-18T14:41:13.516394+0000","last_clean":"2024-03-18T14:41:13.516394+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:41:13.516394+0000","last_undegraded":"2024-03-18T14:41:13.516394+0000","last_fullsized":"2024-03-18T14:41:13.516394+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507867+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:41:13.507867+0000","last_peered":"2024-03-18T14:41:13.507867+0000","last_clean":"2024-03-18T14:41:13.507867+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:41:13.507867+0000","last_undegraded":"2024-03-18T14:41:13.507867+0000","last_fullsized":"2024-03-18T14:41:13.507867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507480+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:41:13.507480+0000","last_peered":"2024-03-18T14:41:13.507480+0000","last_clean":"2024-03-18T14:41:13.507480+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:41:13.507480+0000","last_undegraded":"2024-03-18T14:41:13.507480+0000","last_fullsized":"2024-03-18T14:41:13.507480+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516851+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:41:13.516851+0000","last_peered":"2024-03-18T14:41:13.516851+0000","last_clean":"2024-03-18T14:41:13.516851+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:41:13.516851+0000","last_undegraded":"2024-03-18T14:41:13.516851+0000","last_fullsized":"2024-03-18T14:41:13.516851+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516907+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:41:13.516907+0000","last_peered":"2024-03-18T14:41:13.516907+0000","last_clean":"2024-03-18T14:41:13.516907+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:41:13.516907+0000","last_undegraded":"2024-03-18T14:41:13.516907+0000","last_fullsized":"2024-03-18T14:41:13.516907+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.511840+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:41:13.511840+0000","last_peered":"2024-03-18T14:41:13.511840+0000","last_clean":"2024-03-18T14:41:13.511840+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:41:13.511840+0000","last_undegraded":"2024-03-18T14:41:13.511840+0000","last_fullsized":"2024-03-18T14:41:13.511840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507840+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:41:13.507840+0000","last_peered":"2024-03-18T14:41:13.507840+0000","last_clean":"2024-03-18T14:41:13.507840+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:41:13.507840+0000","last_undegraded":"2024-03-18T14:41:13.507840+0000","last_fullsized":"2024-03-18T14:41:13.507840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504184+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:41:13.504184+0000","last_peered":"2024-03-18T14:41:13.504184+0000","last_clean":"2024-03-18T14:41:13.504184+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:41:13.504184+0000","last_undegraded":"2024-03-18T14:41:13.504184+0000","last_fullsized":"2024-03-18T14:41:13.504184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512707+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:41:13.512707+0000","last_peered":"2024-03-18T14:41:13.512707+0000","last_clean":"2024-03-18T14:41:13.512707+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:41:13.512707+0000","last_undegraded":"2024-03-18T14:41:13.512707+0000","last_fullsized":"2024-03-18T14:41:13.512707+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488074+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:41:13.488074+0000","last_peered":"2024-03-18T14:41:13.488074+0000","last_clean":"2024-03-18T14:41:13.488074+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:41:13.488074+0000","last_undegraded":"2024-03-18T14:41:13.488074+0000","last_fullsized":"2024-03-18T14:41:13.488074+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508888+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:41:13.508888+0000","last_peered":"2024-03-18T14:41:13.508888+0000","last_clean":"2024-03-18T14:41:13.508888+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:41:13.508888+0000","last_undegraded":"2024-03-18T14:41:13.508888+0000","last_fullsized":"2024-03-18T14:41:13.508888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.472694+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:41:14.472694+0000","last_peered":"2024-03-18T14:41:14.472694+0000","last_clean":"2024-03-18T14:41:14.472694+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:41:14.472694+0000","last_undegraded":"2024-03-18T14:41:14.472694+0000","last_fullsized":"2024-03-18T14:41:14.472694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509484+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:41:13.509484+0000","last_peered":"2024-03-18T14:41:13.509484+0000","last_clean":"2024-03-18T14:41:13.509484+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:41:13.509484+0000","last_undegraded":"2024-03-18T14:41:13.509484+0000","last_fullsized":"2024-03-18T14:41:13.509484+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185331+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:41:16.185331+0000","last_peered":"2024-03-18T14:41:16.185331+0000","last_clean":"2024-03-18T14:41:16.185331+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:41:16.185331+0000","last_undegraded":"2024-03-18T14:41:16.185331+0000","last_fullsized":"2024-03-18T14:41:16.185331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512366+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:41:13.512366+0000","last_peered":"2024-03-18T14:41:13.512366+0000","last_clean":"2024-03-18T14:41:13.512366+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:41:13.512366+0000","last_undegraded":"2024-03-18T14:41:13.512366+0000","last_fullsized":"2024-03-18T14:41:13.512366+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184456+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:41:16.184456+0000","last_peered":"2024-03-18T14:41:16.184456+0000","last_clean":"2024-03-18T14:41:16.184456+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:41:16.184456+0000","last_undegraded":"2024-03-18T14:41:16.184456+0000","last_fullsized":"2024-03-18T14:41:16.184456+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507540+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:41:13.507540+0000","last_peered":"2024-03-18T14:41:13.507540+0000","last_clean":"2024-03-18T14:41:13.507540+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:41:13.507540+0000","last_undegraded":"2024-03-18T14:41:13.507540+0000","last_fullsized":"2024-03-18T14:41:13.507540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.553308+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:41:14.553308+0000","last_peered":"2024-03-18T14:41:14.553308+0000","last_clean":"2024-03-18T14:41:14.553308+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:41:14.553308+0000","last_undegraded":"2024-03-18T14:41:14.553308+0000","last_fullsized":"2024-03-18T14:41:14.553308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509259+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:41:13.509259+0000","last_peered":"2024-03-18T14:41:13.509259+0000","last_clean":"2024-03-18T14:41:13.509259+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:41:13.509259+0000","last_undegraded":"2024-03-18T14:41:13.509259+0000","last_fullsized":"2024-03-18T14:41:13.509259+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185641+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:41:16.185641+0000","last_peered":"2024-03-18T14:41:16.185641+0000","last_clean":"2024-03-18T14:41:16.185641+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:41:16.185641+0000","last_undegraded":"2024-03-18T14:41:16.185641+0000","last_fullsized":"2024-03-18T14:41:16.185641+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504392+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:41:13.504392+0000","last_peered":"2024-03-18T14:41:13.504392+0000","last_clean":"2024-03-18T14:41:13.504392+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:41:13.504392+0000","last_undegraded":"2024-03-18T14:41:13.504392+0000","last_fullsized":"2024-03-18T14:41:13.504392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185419+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:41:16.185419+0000","last_peered":"2024-03-18T14:41:16.185419+0000","last_clean":"2024-03-18T14:41:16.185419+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:41:16.185419+0000","last_undegraded":"2024-03-18T14:41:16.185419+0000","last_fullsized":"2024-03-18T14:41:16.185419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515468+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:41:13.515468+0000","last_peered":"2024-03-18T14:41:13.515468+0000","last_clean":"2024-03-18T14:41:13.515468+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:41:13.515468+0000","last_undegraded":"2024-03-18T14:41:13.515468+0000","last_fullsized":"2024-03-18T14:41:13.515468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.183308+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:41:16.183308+0000","last_peered":"2024-03-18T14:41:16.183308+0000","last_clean":"2024-03-18T14:41:16.183308+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:41:16.183308+0000","last_undegraded":"2024-03-18T14:41:16.183308+0000","last_fullsized":"2024-03-18T14:41:16.183308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507827+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:41:13.507827+0000","last_peered":"2024-03-18T14:41:13.507827+0000","last_clean":"2024-03-18T14:41:13.507827+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:41:13.507827+0000","last_undegraded":"2024-03-18T14:41:13.507827+0000","last_fullsized":"2024-03-18T14:41:13.507827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480111+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:41:13.480111+0000","last_peered":"2024-03-18T14:41:13.480111+0000","last_clean":"2024-03-18T14:41:13.480111+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:41:13.480111+0000","last_undegraded":"2024-03-18T14:41:13.480111+0000","last_fullsized":"2024-03-18T14:41:13.480111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.506508+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:41:13.506508+0000","last_peered":"2024-03-18T14:41:13.506508+0000","last_clean":"2024-03-18T14:41:13.506508+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:41:13.506508+0000","last_undegraded":"2024-03-18T14:41:13.506508+0000","last_fullsized":"2024-03-18T14:41:13.506508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184958+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:41:16.184958+0000","last_peered":"2024-03-18T14:41:16.184958+0000","last_clean":"2024-03-18T14:41:16.184958+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:41:16.184958+0000","last_undegraded":"2024-03-18T14:41:16.184958+0000","last_fullsized":"2024-03-18T14:41:16.184958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509504+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:41:13.509504+0000","last_peered":"2024-03-18T14:41:13.509504+0000","last_clean":"2024-03-18T14:41:13.509504+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:41:13.509504+0000","last_undegraded":"2024-03-18T14:41:13.509504+0000","last_fullsized":"2024-03-18T14:41:13.509504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501819+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:41:13.501819+0000","last_peered":"2024-03-18T14:41:13.501819+0000","last_clean":"2024-03-18T14:41:13.501819+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:41:13.501819+0000","last_undegraded":"2024-03-18T14:41:13.501819+0000","last_fullsized":"2024-03-18T14:41:13.501819+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515787+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:41:13.515787+0000","last_peered":"2024-03-18T14:41:13.515787+0000","last_clean":"2024-03-18T14:41:13.515787+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:41:13.515787+0000","last_undegraded":"2024-03-18T14:41:13.515787+0000","last_fullsized":"2024-03-18T14:41:13.515787+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.495818+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:41:13.495818+0000","last_peered":"2024-03-18T14:41:13.495818+0000","last_clean":"2024-03-18T14:41:13.495818+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:41:13.495818+0000","last_undegraded":"2024-03-18T14:41:13.495818+0000","last_fullsized":"2024-03-18T14:41:13.495818+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509149+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:41:13.509149+0000","last_peered":"2024-03-18T14:41:13.509149+0000","last_clean":"2024-03-18T14:41:13.509149+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:41:13.509149+0000","last_undegraded":"2024-03-18T14:41:13.509149+0000","last_fullsized":"2024-03-18T14:41:13.509149+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512633+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:41:13.512633+0000","last_peered":"2024-03-18T14:41:13.512633+0000","last_clean":"2024-03-18T14:41:13.512633+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:41:13.512633+0000","last_undegraded":"2024-03-18T14:41:13.512633+0000","last_fullsized":"2024-03-18T14:41:13.512633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496729+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:41:13.496729+0000","last_peered":"2024-03-18T14:41:13.496729+0000","last_clean":"2024-03-18T14:41:13.496729+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:41:13.496729+0000","last_undegraded":"2024-03-18T14:41:13.496729+0000","last_fullsized":"2024-03-18T14:41:13.496729+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471863+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:41:13.471863+0000","last_peered":"2024-03-18T14:41:13.471863+0000","last_clean":"2024-03-18T14:41:13.471863+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:41:13.471863+0000","last_undegraded":"2024-03-18T14:41:13.471863+0000","last_fullsized":"2024-03-18T14:41:13.471863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508108+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:41:13.508108+0000","last_peered":"2024-03-18T14:41:13.508108+0000","last_clean":"2024-03-18T14:41:13.508108+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:41:13.508108+0000","last_undegraded":"2024-03-18T14:41:13.508108+0000","last_fullsized":"2024-03-18T14:41:13.508108+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185052+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:41:16.185052+0000","last_peered":"2024-03-18T14:41:16.185052+0000","last_clean":"2024-03-18T14:41:16.185052+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:41:16.185052+0000","last_undegraded":"2024-03-18T14:41:16.185052+0000","last_fullsized":"2024-03-18T14:41:16.185052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.492488+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:41:13.492488+0000","last_peered":"2024-03-18T14:41:13.492488+0000","last_clean":"2024-03-18T14:41:13.492488+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:41:13.492488+0000","last_undegraded":"2024-03-18T14:41:13.492488+0000","last_fullsized":"2024-03-18T14:41:13.492488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.472992+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:41:14.472992+0000","last_peered":"2024-03-18T14:41:14.472992+0000","last_clean":"2024-03-18T14:41:14.472992+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:41:14.472992+0000","last_undegraded":"2024-03-18T14:41:14.472992+0000","last_fullsized":"2024-03-18T14:41:14.472992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512732+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:41:13.512732+0000","last_peered":"2024-03-18T14:41:13.512732+0000","last_clean":"2024-03-18T14:41:13.512732+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:41:13.512732+0000","last_undegraded":"2024-03-18T14:41:13.512732+0000","last_fullsized":"2024-03-18T14:41:13.512732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184686+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:41:16.184686+0000","last_peered":"2024-03-18T14:41:16.184686+0000","last_clean":"2024-03-18T14:41:16.184686+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:41:16.184686+0000","last_undegraded":"2024-03-18T14:41:16.184686+0000","last_fullsized":"2024-03-18T14:41:16.184686+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503072+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:41:13.503072+0000","last_peered":"2024-03-18T14:41:13.503072+0000","last_clean":"2024-03-18T14:41:13.503072+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:41:13.503072+0000","last_undegraded":"2024-03-18T14:41:13.503072+0000","last_fullsized":"2024-03-18T14:41:13.503072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.183842+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:41:16.183842+0000","last_peered":"2024-03-18T14:41:16.183842+0000","last_clean":"2024-03-18T14:41:16.183842+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:41:16.183842+0000","last_undegraded":"2024-03-18T14:41:16.183842+0000","last_fullsized":"2024-03-18T14:41:16.183842+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514205+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:41:13.514205+0000","last_peered":"2024-03-18T14:41:13.514205+0000","last_clean":"2024-03-18T14:41:13.514205+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:41:13.514205+0000","last_undegraded":"2024-03-18T14:41:13.514205+0000","last_fullsized":"2024-03-18T14:41:13.514205+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.489432+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:13.489432+0000","last_peered":"2024-03-18T14:41:13.489432+0000","last_clean":"2024-03-18T14:41:13.489432+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:13.489432+0000","last_undegraded":"2024-03-18T14:41:13.489432+0000","last_fullsized":"2024-03-18T14:41:13.489432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.471946+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:41:14.471946+0000","last_peered":"2024-03-18T14:41:14.471946+0000","last_clean":"2024-03-18T14:41:14.471946+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:41:14.471946+0000","last_undegraded":"2024-03-18T14:41:14.471946+0000","last_fullsized":"2024-03-18T14:41:14.471946+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.509233+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:41:13.509233+0000","last_peered":"2024-03-18T14:41:13.509233+0000","last_clean":"2024-03-18T14:41:13.509233+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:41:13.509233+0000","last_undegraded":"2024-03-18T14:41:13.509233+0000","last_fullsized":"2024-03-18T14:41:13.509233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.486304+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:13.486304+0000","last_peered":"2024-03-18T14:41:13.486304+0000","last_clean":"2024-03-18T14:41:13.486304+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:13.486304+0000","last_undegraded":"2024-03-18T14:41:13.486304+0000","last_fullsized":"2024-03-18T14:41:13.486304+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185062+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:41:16.185062+0000","last_peered":"2024-03-18T14:41:16.185062+0000","last_clean":"2024-03-18T14:41:16.185062+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:41:16.185062+0000","last_undegraded":"2024-03-18T14:41:16.185062+0000","last_fullsized":"2024-03-18T14:41:16.185062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512594+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:41:13.512594+0000","last_peered":"2024-03-18T14:41:13.512594+0000","last_clean":"2024-03-18T14:41:13.512594+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:41:13.512594+0000","last_undegraded":"2024-03-18T14:41:13.512594+0000","last_fullsized":"2024-03-18T14:41:13.512594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.471693+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:13.471693+0000","last_peered":"2024-03-18T14:41:13.471693+0000","last_clean":"2024-03-18T14:41:13.471693+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:13.471693+0000","last_undegraded":"2024-03-18T14:41:13.471693+0000","last_fullsized":"2024-03-18T14:41:13.471693+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.553692+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:41:14.553692+0000","last_peered":"2024-03-18T14:41:14.553692+0000","last_clean":"2024-03-18T14:41:14.553692+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:41:14.553692+0000","last_undegraded":"2024-03-18T14:41:14.553692+0000","last_fullsized":"2024-03-18T14:41:14.553692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514181+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:41:13.514181+0000","last_peered":"2024-03-18T14:41:13.514181+0000","last_clean":"2024-03-18T14:41:13.514181+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:41:13.514181+0000","last_undegraded":"2024-03-18T14:41:13.514181+0000","last_fullsized":"2024-03-18T14:41:13.514181+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.478113+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:13.478113+0000","last_peered":"2024-03-18T14:41:13.478113+0000","last_clean":"2024-03-18T14:41:13.478113+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:13.478113+0000","last_undegraded":"2024-03-18T14:41:13.478113+0000","last_fullsized":"2024-03-18T14:41:13.478113+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488848+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:13.488848+0000","last_peered":"2024-03-18T14:41:13.488848+0000","last_clean":"2024-03-18T14:41:13.488848+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:13.488848+0000","last_undegraded":"2024-03-18T14:41:13.488848+0000","last_fullsized":"2024-03-18T14:41:13.488848+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.484063+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:41:13.484063+0000","last_peered":"2024-03-18T14:41:13.484063+0000","last_clean":"2024-03-18T14:41:13.484063+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:41:13.484063+0000","last_undegraded":"2024-03-18T14:41:13.484063+0000","last_fullsized":"2024-03-18T14:41:13.484063+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512758+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:41:13.512758+0000","last_peered":"2024-03-18T14:41:13.512758+0000","last_clean":"2024-03-18T14:41:13.512758+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:41:13.512758+0000","last_undegraded":"2024-03-18T14:41:13.512758+0000","last_fullsized":"2024-03-18T14:41:13.512758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477322+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:13.477322+0000","last_peered":"2024-03-18T14:41:13.477322+0000","last_clean":"2024-03-18T14:41:13.477322+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:13.477322+0000","last_undegraded":"2024-03-18T14:41:13.477322+0000","last_fullsized":"2024-03-18T14:41:13.477322+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.551766+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:41:14.551766+0000","last_peered":"2024-03-18T14:41:14.551766+0000","last_clean":"2024-03-18T14:41:14.551766+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:41:14.551766+0000","last_undegraded":"2024-03-18T14:41:14.551766+0000","last_fullsized":"2024-03-18T14:41:14.551766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.508002+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:41:13.508002+0000","last_peered":"2024-03-18T14:41:13.508002+0000","last_clean":"2024-03-18T14:41:13.508002+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:41:13.508002+0000","last_undegraded":"2024-03-18T14:41:13.508002+0000","last_fullsized":"2024-03-18T14:41:13.508002+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.480432+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:13.480432+0000","last_peered":"2024-03-18T14:41:13.480432+0000","last_clean":"2024-03-18T14:41:13.480432+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:13.480432+0000","last_undegraded":"2024-03-18T14:41:13.480432+0000","last_fullsized":"2024-03-18T14:41:13.480432+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488890+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:41:13.488890+0000","last_peered":"2024-03-18T14:41:13.488890+0000","last_clean":"2024-03-18T14:41:13.488890+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:41:13.488890+0000","last_undegraded":"2024-03-18T14:41:13.488890+0000","last_fullsized":"2024-03-18T14:41:13.488890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.505494+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:41:13.505494+0000","last_peered":"2024-03-18T14:41:13.505494+0000","last_clean":"2024-03-18T14:41:13.505494+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:41:13.505494+0000","last_undegraded":"2024-03-18T14:41:13.505494+0000","last_fullsized":"2024-03-18T14:41:13.505494+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.184401+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:41:16.184401+0000","last_peered":"2024-03-18T14:41:16.184401+0000","last_clean":"2024-03-18T14:41:16.184401+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:41:16.184401+0000","last_undegraded":"2024-03-18T14:41:16.184401+0000","last_fullsized":"2024-03-18T14:41:16.184401+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.488209+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:13.488209+0000","last_peered":"2024-03-18T14:41:13.488209+0000","last_clean":"2024-03-18T14:41:13.488209+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:13.488209+0000","last_undegraded":"2024-03-18T14:41:13.488209+0000","last_fullsized":"2024-03-18T14:41:13.488209+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512337+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:41:13.512337+0000","last_peered":"2024-03-18T14:41:13.512337+0000","last_clean":"2024-03-18T14:41:13.512337+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:41:13.512337+0000","last_undegraded":"2024-03-18T14:41:13.512337+0000","last_fullsized":"2024-03-18T14:41:13.512337+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.477899+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:13.477899+0000","last_peered":"2024-03-18T14:41:13.477899+0000","last_clean":"2024-03-18T14:41:13.477899+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:13.477899+0000","last_undegraded":"2024-03-18T14:41:13.477899+0000","last_fullsized":"2024-03-18T14:41:13.477899+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:14.552483+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:41:14.552483+0000","last_peered":"2024-03-18T14:41:14.552483+0000","last_clean":"2024-03-18T14:41:14.552483+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:41:14.552483+0000","last_undegraded":"2024-03-18T14:41:14.552483+0000","last_fullsized":"2024-03-18T14:41:14.552483+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.503135+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:41:13.503135+0000","last_peered":"2024-03-18T14:41:13.503135+0000","last_clean":"2024-03-18T14:41:13.503135+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:41:13.503135+0000","last_undegraded":"2024-03-18T14:41:13.503135+0000","last_fullsized":"2024-03-18T14:41:13.503135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-03-18T14:41:16.185803+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:41:16.185803+0000","last_peered":"2024-03-18T14:41:16.185803+0000","last_clean":"2024-03-18T14:41:16.185803+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:41:16.185803+0000","last_undegraded":"2024-03-18T14:41:16.185803+0000","last_fullsized":"2024-03-18T14:41:16.185803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.515520+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:41:13.515520+0000","last_peered":"2024-03-18T14:41:13.515520+0000","last_clean":"2024-03-18T14:41:13.515520+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:41:13.515520+0000","last_undegraded":"2024-03-18T14:41:13.515520+0000","last_fullsized":"2024-03-18T14:41:13.515520+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.514297+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:41:13.514297+0000","last_peered":"2024-03-18T14:41:13.514297+0000","last_clean":"2024-03-18T14:41:13.514297+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:41:13.514297+0000","last_undegraded":"2024-03-18T14:41:13.514297+0000","last_fullsized":"2024-03-18T14:41:13.514297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.504368+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:41:13.504368+0000","last_peered":"2024-03-18T14:41:13.504368+0000","last_clean":"2024-03-18T14:41:13.504368+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:41:13.504368+0000","last_undegraded":"2024-03-18T14:41:13.504368+0000","last_fullsized":"2024-03-18T14:41:13.504368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.494592+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:41:13.494592+0000","last_peered":"2024-03-18T14:41:13.494592+0000","last_clean":"2024-03-18T14:41:13.494592+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:41:13.494592+0000","last_undegraded":"2024-03-18T14:41:13.494592+0000","last_fullsized":"2024-03-18T14:41:13.494592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.496751+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:41:13.496751+0000","last_peered":"2024-03-18T14:41:13.496751+0000","last_clean":"2024-03-18T14:41:13.496751+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:41:13.496751+0000","last_undegraded":"2024-03-18T14:41:13.496751+0000","last_fullsized":"2024-03-18T14:41:13.496751+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.499356+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:41:13.499356+0000","last_peered":"2024-03-18T14:41:13.499356+0000","last_clean":"2024-03-18T14:41:13.499356+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:41:13.499356+0000","last_undegraded":"2024-03-18T14:41:13.499356+0000","last_fullsized":"2024-03-18T14:41:13.499356+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512082+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:41:13.512082+0000","last_peered":"2024-03-18T14:41:13.512082+0000","last_clean":"2024-03-18T14:41:13.512082+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:41:13.512082+0000","last_undegraded":"2024-03-18T14:41:13.512082+0000","last_fullsized":"2024-03-18T14:41:13.512082+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.501675+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:41:13.501675+0000","last_peered":"2024-03-18T14:41:13.501675+0000","last_clean":"2024-03-18T14:41:13.501675+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:41:13.501675+0000","last_undegraded":"2024-03-18T14:41:13.501675+0000","last_fullsized":"2024-03-18T14:41:13.501675+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507403+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:41:13.507403+0000","last_peered":"2024-03-18T14:41:13.507403+0000","last_clean":"2024-03-18T14:41:13.507403+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:41:13.507403+0000","last_undegraded":"2024-03-18T14:41:13.507403+0000","last_fullsized":"2024-03-18T14:41:13.507403+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.516799+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:41:13.516799+0000","last_peered":"2024-03-18T14:41:13.516799+0000","last_clean":"2024-03-18T14:41:13.516799+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:41:13.516799+0000","last_undegraded":"2024-03-18T14:41:13.516799+0000","last_fullsized":"2024-03-18T14:41:13.516799+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.507508+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:41:13.507508+0000","last_peered":"2024-03-18T14:41:13.507508+0000","last_clean":"2024-03-18T14:41:13.507508+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:41:13.507508+0000","last_undegraded":"2024-03-18T14:41:13.507508+0000","last_fullsized":"2024-03-18T14:41:13.507508+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.487107+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:41:13.487107+0000","last_peered":"2024-03-18T14:41:13.487107+0000","last_clean":"2024-03-18T14:41:13.487107+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:41:13.487107+0000","last_undegraded":"2024-03-18T14:41:13.487107+0000","last_fullsized":"2024-03-18T14:41:13.487107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.510682+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:41:13.510682+0000","last_peered":"2024-03-18T14:41:13.510682+0000","last_clean":"2024-03-18T14:41:13.510682+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:41:13.510682+0000","last_undegraded":"2024-03-18T14:41:13.510682+0000","last_fullsized":"2024-03-18T14:41:13.510682+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-03-18T14:41:13.512569+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:41:13.512569+0000","last_peered":"2024-03-18T14:41:13.512569+0000","last_clean":"2024-03-18T14:41:13.512569+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:41:13.512569+0000","last_undegraded":"2024-03-18T14:41:13.512569+0000","last_fullsized":"2024-03-18T14:41:13.512569+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]}]}]}} 2024-03-18T14:41:22.865 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T14:41:22.865 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T14:41:22.865 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T14:41:22.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T14:41:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.006+0000 7fe7ab476700 1 Processor -- start 2024-03-18T14:41:23.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 -- start start 2024-03-18T14:41:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 0x7fe7a40650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 0x7fe7a413e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a4063a70 con 0x7fe7a4137860 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a40649c0 con 0x7fe7a4137c40 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7ab476700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40655b0 con 0x7fe7a413c420 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7a8a11700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 0x7fe7a40650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7a9212700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe7a4137860 0x7fe7a40630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39682/0 (socket says 172.21.15.57:39682) 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7a9a13700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 0x7fe7a413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.007+0000 7fe7a9212700 1 -- 172.21.15.57:0/3398406966 learned_addr learned my addr 172.21.15.57:0/3398406966 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a9a13700 1 -- 172.21.15.57:0/3398406966 >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 msgr2=0x7fe7a40650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a9a13700 1 --2- 172.21.15.57:0/3398406966 >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 0x7fe7a40650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a9a13700 1 -- 172.21.15.57:0/3398406966 >> v1:172.21.15.57:6789/0 conn(0x7fe7a4137860 legacy=0x7fe7a40630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a9a13700 1 -- 172.21.15.57:0/3398406966 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a4064bc0 con 0x7fe7a413c420 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a8a11700 1 --2- 172.21.15.57:0/3398406966 >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 0x7fe7a40650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7a9a13700 1 --2- 172.21.15.57:0/3398406966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 0x7fe7a413e810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe79c0032f0 tx=0x7fe79c0091d0).ready entity=mon.2 client_cookie=57ec5cbcddc8e66b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe797fff700 1 -- 172.21.15.57:0/3398406966 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79c00b6c0 con 0x7fe7a413c420 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe797fff700 1 -- 172.21.15.57:0/3398406966 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79c00b820 con 0x7fe7a413c420 2024-03-18T14:41:23.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe797fff700 1 -- 172.21.15.57:0/3398406966 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe79c00b990 con 0x7fe7a413c420 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7ab476700 1 -- 172.21.15.57:0/3398406966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 msgr2=0x7fe7a413e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3398406966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 0x7fe7a413e810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe79c0032f0 tx=0x7fe79c0091d0).stop 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7ab476700 1 -- 172.21.15.57:0/3398406966 shutdown_connections 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3398406966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a413c420 0x7fe7a413e810 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.008+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3398406966 >> v2:172.21.15.57:3300/0 conn(0x7fe7a4137c40 0x7fe7a40650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.009+0000 7fe7ab476700 1 -- 172.21.15.57:0/3398406966 >> 172.21.15.57:0/3398406966 conn(0x7fe7a405c300 msgr2=0x7fe7a406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.009+0000 7fe7ab476700 1 -- 172.21.15.57:0/3398406966 shutdown_connections 2024-03-18T14:41:23.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.009+0000 7fe7ab476700 1 -- 172.21.15.57:0/3398406966 wait complete. 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.009+0000 7fe7ab476700 1 Processor -- start 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.009+0000 7fe7ab476700 1 -- start start 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a413c420 0x7fe7a41343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a40614d0 con 0x7fe7a413c420 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a413b050 con 0x7fe7a4137860 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7ab476700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a413a7e0 con 0x7fe7a4137c40 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a9212700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:38082/0 (socket says 172.21.15.57:38082) 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 -- 172.21.15.57:0/3160782491 learned_addr learned my addr 172.21.15.57:0/3160782491 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a9212700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46574/0 (socket says 172.21.15.57:46574) 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a9a13700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a413c420 0x7fe7a41343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 -- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 msgr2=0x7fe7a40673d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 -- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a413c420 msgr2=0x7fe7a41343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a413c420 0x7fe7a41343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a8a11700 1 -- 172.21.15.57:0/3160782491 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a000b180 con 0x7fe7a4137c40 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.010+0000 7fe7a9212700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7a8a11700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe7a000c000 tx=0x7fe7a0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a000c7e0 con 0x7fe7a4137c40 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a000c940 con 0x7fe7a4137c40 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c009470 con 0x7fe7a4137c40 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7a000cca0 con 0x7fe7a4137c40 2024-03-18T14:41:23.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.011+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a4139350 con 0x7fe7a4137c40 2024-03-18T14:41:23.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.012+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe7a001c460 con 0x7fe7a4137c40 2024-03-18T14:41:23.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.012+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a4061640 con 0x7fe7a4137c40 2024-03-18T14:41:23.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.012+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe7a004ada0 con 0x7fe7a4137c40 2024-03-18T14:41:23.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.015+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe7a4061640 con 0x7fe7a4137c40 2024-03-18T14:41:23.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.169+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe7a4061640 con 0x7fe7a4137c40 2024-03-18T14:41:23.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.169+0000 7fe7967fc700 1 -- 172.21.15.57:0/3160782491 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fe7a4061640 con 0x7fe7a4137c40 2024-03-18T14:41:23.171 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 >> v1:172.21.15.57:6816/39496 conn(0x7fe784038da0 legacy=0x7fe78403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 msgr2=0x7fe7a413ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fe7a000c000 tx=0x7fe7a0006df0).stop 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 shutdown_connections 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7a413c420 0x7fe7a41343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7a4137860 0x7fe7a40673d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 --2- 172.21.15.57:0/3160782491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7a4137c40 0x7fe7a413ab60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 >> 172.21.15.57:0/3160782491 conn(0x7fe7a405c300 msgr2=0x7fe7a409c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.170+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 shutdown_connections 2024-03-18T14:41:23.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.171+0000 7fe7ab476700 1 -- 172.21.15.57:0/3160782491 wait complete. 2024-03-18T14:41:23.182 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T14:41:23.182 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T14:41:23.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:23.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.287+0000 7f11bcdcf700 1 Processor -- start 2024-03-18T14:41:23.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.287+0000 7f11bcdcf700 1 -- start start 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11b81366f0 0x7f11b809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 0x7f11b8139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b809a380 con 0x7f11b81366f0 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8135fe0 con 0x7f11b8099a00 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11bcdcf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8099e90 con 0x7f11b809b520 2024-03-18T14:41:23.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11b81366f0 0x7f11b809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b6d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 0x7f11b8139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f11b81366f0 0x7f11b809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40738/0 (socket says 172.21.15.57:40738) 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 -- 172.21.15.57:0/3604642647 learned_addr learned my addr 172.21.15.57:0/3604642647 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:38094/0 (socket says 172.21.15.57:38094) 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 -- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 msgr2=0x7f11b8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 -- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 msgr2=0x7f11b8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 0x7f11b8139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b659c700 1 -- 172.21.15.57:0/3604642647 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b809a0c0 con 0x7f11b81366f0 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b6d9d700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 0x7f11b8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.288+0000 7f11b5d9b700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11b659c700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b81366f0 0x7f11b809bbb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f11ac002f70 tx=0x7f11ac006eb0).ready entity=mon.0 client_cookie=b71903823a09943a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11b559a700 1 -- 172.21.15.57:0/3604642647 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11ac00d570 con 0x7f11b81366f0 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11b559a700 1 -- 172.21.15.57:0/3604642647 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac000e90 con 0x7f11b81366f0 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11b559a700 1 -- 172.21.15.57:0/3604642647 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11ac00d900 con 0x7f11b81366f0 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 -- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b81366f0 msgr2=0x7f11b809bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b81366f0 0x7f11b809bbb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f11ac002f70 tx=0x7f11ac006eb0).stop 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 -- 172.21.15.57:0/3604642647 shutdown_connections 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b8099a00 0x7f11b8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b81366f0 0x7f11b809bbb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/3604642647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b809b520 0x7f11b8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 -- 172.21.15.57:0/3604642647 >> 172.21.15.57:0/3604642647 conn(0x7f11b806c0c0 msgr2=0x7f11b806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 -- 172.21.15.57:0/3604642647 shutdown_connections 2024-03-18T14:41:23.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.289+0000 7f11bcdcf700 1 -- 172.21.15.57:0/3604642647 wait complete. 2024-03-18T14:41:23.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.290+0000 7f11bcdcf700 1 Processor -- start 2024-03-18T14:41:23.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.290+0000 7f11bcdcf700 1 -- start start 2024-03-18T14:41:23.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 0x7f11b81313a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8097020 con 0x7f11b8099a00 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b8095130 con 0x7f11b809b520 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11bcdcf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11b80953d0 con 0x7f11b81366f0 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40754/0 (socket says 172.21.15.57:40754) 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 -- 172.21.15.57:0/2947923558 learned_addr learned my addr 172.21.15.57:0/2947923558 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:46590/0 (socket says 172.21.15.57:46590) 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b6d9d700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 0x7f11b81313a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 -- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 msgr2=0x7f11b81313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 0x7f11b81313a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 -- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 msgr2=0x7f11b8130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 -- 172.21.15.57:0/2947923558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0009470 con 0x7f11b8099a00 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b5d9b700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b6d9d700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 0x7f11b81313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.291+0000 7f11b659c700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f11ac002f70 tx=0x7f11ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.292+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11ac00dea0 con 0x7f11b8099a00 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.292+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac006b40 con 0x7f11b8099a00 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.292+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11ac011e20 con 0x7f11b8099a00 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.292+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a800b120 con 0x7f11b8099a00 2024-03-18T14:41:23.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.292+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac00b1e0 con 0x7f11b8099a00 2024-03-18T14:41:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.293+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f11ac025030 con 0x7f11b8099a00 2024-03-18T14:41:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.293+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f11ac04b990 con 0x7f11b8099a00 2024-03-18T14:41:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.293+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b8067cb0 con 0x7f11b8099a00 2024-03-18T14:41:23.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.296+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f11ac023020 con 0x7f11b8099a00 2024-03-18T14:41:23.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.414+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11b8057a60 con 0x7f11b8099a00 2024-03-18T14:41:23.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.414+0000 7f11a77fe700 1 -- 172.21.15.57:0/2947923558 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f11ac023020 con 0x7f11b8099a00 2024-03-18T14:41:23.417 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:23.417 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:23.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 >> v1:172.21.15.57:6816/39496 conn(0x7f1194038e30 legacy=0x7f119403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 msgr2=0x7f11b8097a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f11ac002f70 tx=0x7f11ac015000).stop 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 shutdown_connections 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f11b81366f0 0x7f11b81313a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f11b8099a00 0x7f11b8097a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 --2- 172.21.15.57:0/2947923558 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f11b809b520 0x7f11b8130eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 >> 172.21.15.57:0/2947923558 conn(0x7f11b806c0c0 msgr2=0x7f11b80663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 shutdown_connections 2024-03-18T14:41:23.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.416+0000 7f11bcdcf700 1 -- 172.21.15.57:0/2947923558 wait complete. 2024-03-18T14:41:23.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:41:23.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-18T14:41:23.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.535+0000 7f5a33948700 1 Processor -- start 2024-03-18T14:41:23.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 -- start start 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 0x7f5a2c0a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2c0a1f10 con 0x7f5a2c0a02c0 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2c0a0f60 con 0x7f5a2c05dfb0 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a33948700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0a1200 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a30ee3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a316e4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 0x7f5a2c0a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a30ee3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44354/0 (socket says 172.21.15.57:44354) 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a30ee3700 1 -- 172.21.15.57:0/1531540030 learned_addr learned my addr 172.21.15.57:0/1531540030 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.536+0000 7f5a31ee5700 1 --1- 172.21.15.57:0/1531540030 >> v1:172.21.15.57:6789/0 conn(0x7f5a2c0a02c0 0x7f5a2c0a0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39128/0 (socket says 172.21.15.57:39128) 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a30ee3700 1 -- 172.21.15.57:0/1531540030 >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 msgr2=0x7f5a2c0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/1531540030 >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 0x7f5a2c0a2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a30ee3700 1 -- 172.21.15.57:0/1531540030 >> v1:172.21.15.57:6789/0 conn(0x7f5a2c0a02c0 legacy=0x7f5a2c0a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a30ee3700 1 -- 172.21.15.57:0/1531540030 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c060520 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a316e4700 1 --2- 172.21.15.57:0/1531540030 >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 0x7f5a2c0a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/1531540030 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5a28002f70 tx=0x7f5a28006eb0).ready entity=mon.2 client_cookie=e21ef576b49251d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a1ffff700 1 -- 172.21.15.57:0/1531540030 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800d570 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a1ffff700 1 -- 172.21.15.57:0/1531540030 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28000e90 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a1ffff700 1 -- 172.21.15.57:0/1531540030 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a2800d900 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 -- 172.21.15.57:0/1531540030 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 msgr2=0x7f5a2c09fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 --2- 172.21.15.57:0/1531540030 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f5a28002f70 tx=0x7f5a28006eb0).stop 2024-03-18T14:41:23.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 -- 172.21.15.57:0/1531540030 shutdown_connections 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 --2- 172.21.15.57:0/1531540030 >> v2:172.21.15.57:3300/0 conn(0x7f5a2c05dfb0 0x7f5a2c0a2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 --2- 172.21.15.57:0/1531540030 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c09f5d0 0x7f5a2c09fdd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.537+0000 7f5a33948700 1 -- 172.21.15.57:0/1531540030 >> 172.21.15.57:0/1531540030 conn(0x7f5a2c0a93f0 msgr2=0x7f5a2c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.538+0000 7f5a33948700 1 -- 172.21.15.57:0/1531540030 shutdown_connections 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.538+0000 7f5a33948700 1 -- 172.21.15.57:0/1531540030 wait complete. 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 Processor -- start 2024-03-18T14:41:23.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 -- start start 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 0x7f5a2c092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 0x7f5a2c092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c13e7d0 con 0x7f5a2c05dfb0 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0956a0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.539+0000 7f5a33948700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c0932f0 con 0x7f5a2c0a02c0 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a316e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a316e4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34688/0 (socket says 172.21.15.57:34688) 2024-03-18T14:41:23.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a316e4700 1 -- 172.21.15.57:0/2816489695 learned_addr learned my addr 172.21.15.57:0/2816489695 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 0x7f5a2c092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a31ee5700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 0x7f5a2c092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 -- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 msgr2=0x7f5a2c092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 0x7f5a2c092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 -- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 msgr2=0x7f5a2c094780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 -- 172.21.15.57:0/2816489695 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2000b180 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a31ee5700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 0x7f5a2c092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a316e4700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a30ee3700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 0x7f5a2c092030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5a2c093150 tx=0x7f5a28015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a28006b40 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2800d8f0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2800b1e0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a28011d30 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.540+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c095040 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.541+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5a2801a040 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.542+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c0a62d0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.542+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5a2804b800 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.545+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5a280082b0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.660+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5a2c057a60 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.661+0000 7f5a1e7fc700 1 -- 172.21.15.57:0/2816489695 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5a280080e0 con 0x7f5a2c09f5d0 2024-03-18T14:41:23.663 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 >> v1:172.21.15.57:6816/39496 conn(0x7f5a0c038da0 legacy=0x7f5a0c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 msgr2=0x7f5a2c092030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 0x7f5a2c092030 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5a2c093150 tx=0x7f5a28015000).stop 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 shutdown_connections 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5a2c0a02c0 0x7f5a2c092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c05dfb0 0x7f5a2c094780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 --2- 172.21.15.57:0/2816489695 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5a2c09f5d0 0x7f5a2c092030 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 >> 172.21.15.57:0/2816489695 conn(0x7f5a2c0a93f0 msgr2=0x7f5a2c0a26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 shutdown_connections 2024-03-18T14:41:23.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.662+0000 7f5a33948700 1 -- 172.21.15.57:0/2816489695 wait complete. 2024-03-18T14:41:23.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.782+0000 7f98528dc700 1 Processor -- start 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.782+0000 7f98528dc700 1 -- start start 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f98528dc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 0x7f984c133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f98528dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 0x7f984c139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f98528dc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c067990 con 0x7f984c139d80 2024-03-18T14:41:23.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f98528dc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c0a4c50 con 0x7f984c1337e0 2024-03-18T14:41:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f98528dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0a4f10 con 0x7f984c067570 2024-03-18T14:41:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984bfff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 0x7f984c133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 0x7f984c139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f9850e79700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f984c139d80 0x7f984c13a1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39136/0 (socket says 172.21.15.57:39136) 2024-03-18T14:41:23.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f9850e79700 1 -- 172.21.15.57:0/390897096 learned_addr learned my addr 172.21.15.57:0/390897096 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:23.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 -- 172.21.15.57:0/390897096 >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 msgr2=0x7f984c133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:23.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 --2- 172.21.15.57:0/390897096 >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 0x7f984c133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 -- 172.21.15.57:0/390897096 >> v1:172.21.15.57:6789/0 conn(0x7f984c139d80 legacy=0x7f984c13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 -- 172.21.15.57:0/390897096 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c060520 con 0x7f984c067570 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984bfff700 1 --2- 172.21.15.57:0/390897096 >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 0x7f984c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.783+0000 7f984b7fe700 1 --2- 172.21.15.57:0/390897096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 0x7f984c139890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9840002f70 tx=0x7f9840006df0).ready entity=mon.1 client_cookie=97fde308da93a30d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f984affd700 1 -- 172.21.15.57:0/390897096 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984000d570 con 0x7f984c067570 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f984affd700 1 -- 172.21.15.57:0/390897096 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840000e90 con 0x7f984c067570 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f984affd700 1 -- 172.21.15.57:0/390897096 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984000d8c0 con 0x7f984c067570 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 -- 172.21.15.57:0/390897096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 msgr2=0x7f984c139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 --2- 172.21.15.57:0/390897096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 0x7f984c139890 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f9840002f70 tx=0x7f9840006df0).stop 2024-03-18T14:41:23.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 -- 172.21.15.57:0/390897096 shutdown_connections 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 --2- 172.21.15.57:0/390897096 >> v2:172.21.15.57:3300/0 conn(0x7f984c1337e0 0x7f984c133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 --2- 172.21.15.57:0/390897096 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c067570 0x7f984c139890 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 -- 172.21.15.57:0/390897096 >> 172.21.15.57:0/390897096 conn(0x7f984c0a93f0 msgr2=0x7f984c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 -- 172.21.15.57:0/390897096 shutdown_connections 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.784+0000 7f98528dc700 1 -- 172.21.15.57:0/390897096 wait complete. 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.785+0000 7f98528dc700 1 Processor -- start 2024-03-18T14:41:23.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.785+0000 7f98528dc700 1 -- start start 2024-03-18T14:41:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 0x7f984c1324a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c139d80 0x7f984c132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0a1610 con 0x7f984c067570 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0931a0 con 0x7f984c139d80 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98528dc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f984c09e7d0 con 0x7f984c1337e0 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 0x7f984c1324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34712/0 (socket says 172.21.15.57:34712) 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984bfff700 1 -- 172.21.15.57:0/2477024398 learned_addr learned my addr 172.21.15.57:0/2477024398 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f9850e79700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c139d80 0x7f984c132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 -- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c139d80 msgr2=0x7f984c132990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c139d80 0x7f984c132990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 -- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 msgr2=0x7f984c0a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 -- 172.21.15.57:0/2477024398 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c00b180 con 0x7f984c1337e0 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984bfff700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:23.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f984b7fe700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 0x7f984c1324a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f984c0a1750 tx=0x7f9840014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.786+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9840013da0 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.787+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984001e400 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.787+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984000b180 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.787+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f984001e760 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.787+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c1370d0 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.787+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f984001c070 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.788+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f984004b4b0 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.788+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c065a50 con 0x7f984c1337e0 2024-03-18T14:41:23.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.791+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9840023030 con 0x7f984c1337e0 2024-03-18T14:41:23.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.906+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f984c057a60 con 0x7f984c1337e0 2024-03-18T14:41:23.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.906+0000 7f98497fa700 1 -- 172.21.15.57:0/2477024398 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f98400273f0 con 0x7f984c1337e0 2024-03-18T14:41:23.909 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:41:23.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 >> v1:172.21.15.57:6816/39496 conn(0x7f982c038da0 legacy=0x7f982c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 msgr2=0x7f984c1324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 0x7f984c1324a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f984c0a1750 tx=0x7f9840014000).stop 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 shutdown_connections 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f984c139d80 0x7f984c132990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f984c067570 0x7f984c0a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 --2- 172.21.15.57:0/2477024398 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f984c1337e0 0x7f984c1324a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 >> 172.21.15.57:0/2477024398 conn(0x7f984c0a93f0 msgr2=0x7f984c138e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 shutdown_connections 2024-03-18T14:41:23.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:23.908+0000 7f98528dc700 1 -- 172.21.15.57:0/2477024398 wait complete. 2024-03-18T14:41:23.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:41:24.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.027+0000 7f6f6e750700 1 Processor -- start 2024-03-18T14:41:24.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.027+0000 7f6f6e750700 1 -- start start 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6e750700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 0x7f6f680621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6e750700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 0x7f6f6809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6e750700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6809bc50 con 0x7f6f6809aa10 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6e750700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6809b2e0 con 0x7f6f68136140 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6e750700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681365d0 con 0x7f6f68064700 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6cced700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 0x7f6f6809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f67fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6f6809aa10 0x7f6f68132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39146/0 (socket says 172.21.15.57:39146) 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f67fff700 1 -- 172.21.15.57:0/2663018223 learned_addr learned my addr 172.21.15.57:0/2663018223 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 0x7f6f680621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f677fe700 1 -- 172.21.15.57:0/2663018223 >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 msgr2=0x7f6f6809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f677fe700 1 --2- 172.21.15.57:0/2663018223 >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 0x7f6f6809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f677fe700 1 -- 172.21.15.57:0/2663018223 >> v1:172.21.15.57:6789/0 conn(0x7f6f6809aa10 legacy=0x7f6f68132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f677fe700 1 -- 172.21.15.57:0/2663018223 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f681367e0 con 0x7f6f68064700 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.028+0000 7f6f6cced700 1 --2- 172.21.15.57:0/2663018223 >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 0x7f6f6809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f677fe700 1 --2- 172.21.15.57:0/2663018223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 0x7f6f680621e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6f50002f70 tx=0x7f6f50006d90).ready entity=mon.1 client_cookie=40d2614fe49d1891 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f66ffd700 1 -- 172.21.15.57:0/2663018223 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5000d4a0 con 0x7f6f68064700 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f66ffd700 1 -- 172.21.15.57:0/2663018223 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50000e90 con 0x7f6f68064700 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f66ffd700 1 -- 172.21.15.57:0/2663018223 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f5000d7f0 con 0x7f6f68064700 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 -- 172.21.15.57:0/2663018223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 msgr2=0x7f6f680621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2663018223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 0x7f6f680621e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6f50002f70 tx=0x7f6f50006d90).stop 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 -- 172.21.15.57:0/2663018223 shutdown_connections 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2663018223 >> v2:172.21.15.57:3300/0 conn(0x7f6f68136140 0x7f6f6809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2663018223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f68064700 0x7f6f680621e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 -- 172.21.15.57:0/2663018223 >> 172.21.15.57:0/2663018223 conn(0x7f6f6806c0c0 msgr2=0x7f6f6806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 -- 172.21.15.57:0/2663018223 shutdown_connections 2024-03-18T14:41:24.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.029+0000 7f6f6e750700 1 -- 172.21.15.57:0/2663018223 wait complete. 2024-03-18T14:41:24.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.030+0000 7f6f6e750700 1 Processor -- start 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.030+0000 7f6f6e750700 1 -- start start 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 0x7f6f681459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 0x7f6f68145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68097fa0 con 0x7f6f68064700 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68096e40 con 0x7f6f6809aa10 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6e750700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680935b0 con 0x7f6f68136140 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f677fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 0x7f6f681459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34730/0 (socket says 172.21.15.57:34730) 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 -- 172.21.15.57:0/2435984942 learned_addr learned my addr 172.21.15.57:0/2435984942 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6cced700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 0x7f6f68145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 -- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 msgr2=0x7f6f68145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 0x7f6f68145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 -- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 msgr2=0x7f6f681459e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 0x7f6f681459e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 -- 172.21.15.57:0/2435984942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009470 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f6cced700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 0x7f6f68145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f677fe700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 0x7f6f681459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.031+0000 7f6f67fff700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6f6809b960 tx=0x7f6f58007cd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58005610 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58005770 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f58005ad0 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5000b120 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f68095370 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.032+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6f58005c30 con 0x7f6f68064700 2024-03-18T14:41:24.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.033+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68136aa0 con 0x7f6f68064700 2024-03-18T14:41:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.033+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6f5804cfd0 con 0x7f6f68064700 2024-03-18T14:41:24.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.036+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6f58031dc0 con 0x7f6f68064700 2024-03-18T14:41:24.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.154+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f68057a60 con 0x7f6f68064700 2024-03-18T14:41:24.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.154+0000 7f6f657fa700 1 -- 172.21.15.57:0/2435984942 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f580353e0 con 0x7f6f68064700 2024-03-18T14:41:24.157 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:41:24.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 >> v1:172.21.15.57:6816/39496 conn(0x7f6f4c038da0 legacy=0x7f6f4c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 msgr2=0x7f6f68096470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f6f6809b960 tx=0x7f6f58007cd0).stop 2024-03-18T14:41:24.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 shutdown_connections 2024-03-18T14:41:24.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f68136140 0x7f6f68145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f68064700 0x7f6f68096470 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 --2- 172.21.15.57:0/2435984942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f6809aa10 0x7f6f681459e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.155+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 >> 172.21.15.57:0/2435984942 conn(0x7f6f6806c0c0 msgr2=0x7f6f680a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.156+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 shutdown_connections 2024-03-18T14:41:24.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.156+0000 7f6f6e750700 1 -- 172.21.15.57:0/2435984942 wait complete. 2024-03-18T14:41:24.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:41:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.275+0000 7f7106c86700 1 Processor -- start 2024-03-18T14:41:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.275+0000 7f7106c86700 1 -- start start 2024-03-18T14:41:24.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7106c86700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 0x7f7100067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7106c86700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7100139fa0 0x7f710013a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7106c86700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71000a4c50 con 0x7f71001337e0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7106c86700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7100133fe0 con 0x7f7100139fa0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7106c86700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000a4f10 con 0x7f7100133bc0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7105223700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7100139fa0 0x7f710013a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7104a22700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f71001337e0 0x7f7100139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39158/0 (socket says 172.21.15.57:39158) 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f7104a22700 1 -- 172.21.15.57:0/1274038786 learned_addr learned my addr 172.21.15.57:0/1274038786 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.276+0000 7f70fffff700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 0x7f7100067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7105223700 1 -- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 msgr2=0x7f7100067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7105223700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 0x7f7100067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7105223700 1 -- 172.21.15.57:0/1274038786 >> v1:172.21.15.57:6789/0 conn(0x7f71001337e0 legacy=0x7f7100139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7105223700 1 -- 172.21.15.57:0/1274038786 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7100060520 con 0x7f7100139fa0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f70fffff700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 0x7f7100067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7105223700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100139fa0 0x7f710013a400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f70f0002f70 tx=0x7f70f0006df0).ready entity=mon.0 client_cookie=e27984daa61ff11a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f70ff7fe700 1 -- 172.21.15.57:0/1274038786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000d570 con 0x7f7100139fa0 2024-03-18T14:41:24.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f70ff7fe700 1 -- 172.21.15.57:0/1274038786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f0000e90 con 0x7f7100139fa0 2024-03-18T14:41:24.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f70ff7fe700 1 -- 172.21.15.57:0/1274038786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f000d8c0 con 0x7f7100139fa0 2024-03-18T14:41:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 -- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100139fa0 msgr2=0x7f710013a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100139fa0 0x7f710013a400 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f70f0002f70 tx=0x7f70f0006df0).stop 2024-03-18T14:41:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 -- 172.21.15.57:0/1274038786 shutdown_connections 2024-03-18T14:41:24.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100139fa0 0x7f710013a400 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 --2- 172.21.15.57:0/1274038786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7100133bc0 0x7f7100067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 -- 172.21.15.57:0/1274038786 >> 172.21.15.57:0/1274038786 conn(0x7f71000a93f0 msgr2=0x7f71000a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 -- 172.21.15.57:0/1274038786 shutdown_connections 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.277+0000 7f7106c86700 1 -- 172.21.15.57:0/1274038786 wait complete. 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.278+0000 7f7106c86700 1 Processor -- start 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.278+0000 7f7106c86700 1 -- start start 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7100139fa0 0x7f71001355e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000a2150 con 0x7f7100133bc0 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71000a1c50 con 0x7f71001337e0 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7106c86700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71000a1310 con 0x7f7100139fa0 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f70fffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41014/0 (socket says 172.21.15.57:41014) 2024-03-18T14:41:24.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f70fffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34744/0 (socket says 172.21.15.57:34744) 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 -- 172.21.15.57:0/156423676 learned_addr learned my addr 172.21.15.57:0/156423676 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7105223700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7100139fa0 0x7f71001355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 -- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7100139fa0 msgr2=0x7f71001355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7100139fa0 0x7f71001355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 -- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 msgr2=0x7f71001350f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f7104a22700 1 -- 172.21.15.57:0/156423676 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e800b180 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.279+0000 7f70fffff700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f7104a22700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f71000a14a0 tx=0x7f70f80014a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f8005ba0 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f8005d00 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f000b180 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70f80072c0 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.280+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71000a2380 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.281+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f70f8010070 con 0x7f71001337e0 2024-03-18T14:41:24.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.281+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f70f804a220 con 0x7f71001337e0 2024-03-18T14:41:24.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.281+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7100065a50 con 0x7f71001337e0 2024-03-18T14:41:24.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.284+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f70f802f120 con 0x7f71001337e0 2024-03-18T14:41:24.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.399+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7100057a60 con 0x7f71001337e0 2024-03-18T14:41:24.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.399+0000 7f70fdffb700 1 -- 172.21.15.57:0/156423676 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70f8032740 con 0x7f71001337e0 2024-03-18T14:41:24.401 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 >> v1:172.21.15.57:6816/39496 conn(0x7f70e4038da0 legacy=0x7f70e403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 msgr2=0x7f71000a0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f71000a14a0 tx=0x7f70f80014a0).stop 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 shutdown_connections 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7100139fa0 0x7f71001355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f71001337e0 0x7f71000a0e20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 --2- 172.21.15.57:0/156423676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7100133bc0 0x7f71001350f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 >> 172.21.15.57:0/156423676 conn(0x7f71000a93f0 msgr2=0x7f7100132910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 shutdown_connections 2024-03-18T14:41:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.400+0000 7f7106c86700 1 -- 172.21.15.57:0/156423676 wait complete. 2024-03-18T14:41:24.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:24.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.517+0000 7f1ff9190700 1 Processor -- start 2024-03-18T14:41:24.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.517+0000 7f1ff9190700 1 -- start start 2024-03-18T14:41:24.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff409b2a0 con 0x7f1ff409adf0 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff409bc50 con 0x7f1ff4064700 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff9190700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff41367e0 con 0x7f1ff409aa10 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41022/0 (socket says 172.21.15.57:41022) 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff359e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34746/0 (socket says 172.21.15.57:34746) 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44394/0 (socket says 172.21.15.57:44394) 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 -- 172.21.15.57:0/3020713987 learned_addr learned my addr 172.21.15.57:0/3020713987 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 -- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 msgr2=0x7f1ff40621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 -- 172.21.15.57:0/3020713987 >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 msgr2=0x7f1ff4132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 --2- 172.21.15.57:0/3020713987 >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 -- 172.21.15.57:0/3020713987 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff4136aa0 con 0x7f1ff4064700 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff2d9d700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff359e700 1 --2- 172.21.15.57:0/3020713987 >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff259c700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1fe4002f70 tx=0x7f1fe4006e50).ready entity=mon.1 client_cookie=7bd1f7853c5ca458 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.518+0000 7f1ff1d9b700 1 -- 172.21.15.57:0/3020713987 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe400d570 con 0x7f1ff4064700 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff1d9b700 1 -- 172.21.15.57:0/3020713987 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe4000e90 con 0x7f1ff4064700 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff1d9b700 1 -- 172.21.15.57:0/3020713987 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe400d900 con 0x7f1ff4064700 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 -- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 msgr2=0x7f1ff4136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f1fe4002f70 tx=0x7f1fe4006e50).stop 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 -- 172.21.15.57:0/3020713987 shutdown_connections 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 --2- 172.21.15.57:0/3020713987 >> v2:172.21.15.57:3300/0 conn(0x7f1ff409adf0 0x7f1ff4132c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff40621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 --2- 172.21.15.57:0/3020713987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff4136140 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 -- 172.21.15.57:0/3020713987 >> 172.21.15.57:0/3020713987 conn(0x7f1ff406c0c0 msgr2=0x7f1ff406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 -- 172.21.15.57:0/3020713987 shutdown_connections 2024-03-18T14:41:24.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.519+0000 7f1ff9190700 1 -- 172.21.15.57:0/3020713987 wait complete. 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.520+0000 7f1ff9190700 1 Processor -- start 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.520+0000 7f1ff9190700 1 -- start start 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff405bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff409e220 con 0x7f1ff409adf0 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff4093cf0 con 0x7f1ff4064700 2024-03-18T14:41:24.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff40a6c50 con 0x7f1ff409aa10 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff405bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44402/0 (socket says 172.21.15.57:44402) 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff2d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff405bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41038/0 (socket says 172.21.15.57:41038) 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 -- 172.21.15.57:0/2441514076 learned_addr learned my addr 172.21.15.57:0/2441514076 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff359e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34752/0 (socket says 172.21.15.57:34752) 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 -- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 msgr2=0x7f1ff405bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff405bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 -- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 msgr2=0x7f1ff4145c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 -- 172.21.15.57:0/2441514076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe800b180 con 0x7f1ff409aa10 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff359e700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff259c700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1fe4002f70 tx=0x7f1fe4014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe4013e90 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe400de40 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec009470 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fe401e5f0 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.521+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe400b1e0 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.522+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1fe401c070 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.522+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1fe404b350 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.522+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff4057a60 con 0x7f1ff409aa10 2024-03-18T14:41:24.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.526+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1fe4028540 con 0x7f1ff409aa10 2024-03-18T14:41:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.672+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff4060880 con 0x7f1ff409aa10 2024-03-18T14:41:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.673+0000 7f1fe3fff700 1 -- 172.21.15.57:0/2441514076 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2318 (secure 0 0 0) 0x7f1fe40056f0 con 0x7f1ff409aa10 2024-03-18T14:41:24.675 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:24.676 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:41:17.168864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 >> v1:172.21.15.57:6816/39496 conn(0x7f1fd0038da0 legacy=0x7f1fd003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 msgr2=0x7f1ff4145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f1fe4002f70 tx=0x7f1fe4014000).stop 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 shutdown_connections 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1ff409adf0 0x7f1ff4145c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1ff4064700 0x7f1ff405bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 --2- 172.21.15.57:0/2441514076 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1ff409aa10 0x7f1ff4145720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 >> 172.21.15.57:0/2441514076 conn(0x7f1ff406c0c0 msgr2=0x7f1ff4135db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 shutdown_connections 2024-03-18T14:41:24.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.674+0000 7f1ff9190700 1 -- 172.21.15.57:0/2441514076 wait complete. 2024-03-18T14:41:24.678 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-18T14:41:24.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.791+0000 7f70d59e1700 1 Processor -- start 2024-03-18T14:41:24.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.791+0000 7f70d59e1700 1 -- start start 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 0x7f70d0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d0067990 con 0x7f70d0067570 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d013a6f0 con 0x7f70d01337e0 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70d59e1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00a4c50 con 0x7f70d0139d80 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 0x7f70d0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ce7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ce7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34760/0 (socket says 172.21.15.57:34760) 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 0x7f70d0133bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41054/0 (socket says 172.21.15.57:41054) 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ce7fc700 1 -- 172.21.15.57:0/91388625 learned_addr learned my addr 172.21.15.57:0/91388625 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44412/0 (socket says 172.21.15.57:44412) 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 -- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 msgr2=0x7f70d0133bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 --2- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 0x7f70d0133bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 -- 172.21.15.57:0/91388625 >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 msgr2=0x7f70d0139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 --2- 172.21.15.57:0/91388625 >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70cf7fe700 1 -- 172.21.15.57:0/91388625 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00a4f10 con 0x7f70d0139d80 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.792+0000 7f70ce7fc700 1 --2- 172.21.15.57:0/91388625 >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70cf7fe700 1 --2- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f70c80032f0 tx=0x7f70c80091d0).ready entity=mon.2 client_cookie=7ca52c248d57bb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70cdffb700 1 -- 172.21.15.57:0/91388625 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c800b600 con 0x7f70d0139d80 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70cdffb700 1 -- 172.21.15.57:0/91388625 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800b760 con 0x7f70d0139d80 2024-03-18T14:41:24.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70cdffb700 1 -- 172.21.15.57:0/91388625 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c800b8d0 con 0x7f70d0139d80 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 -- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 msgr2=0x7f70d013a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 --2- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f70c80032f0 tx=0x7f70c80091d0).stop 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 -- 172.21.15.57:0/91388625 shutdown_connections 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 --2- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d0139d80 0x7f70d013a200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 --2- 172.21.15.57:0/91388625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d01337e0 0x7f70d0133bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 --2- 172.21.15.57:0/91388625 >> v2:172.21.15.57:3300/0 conn(0x7f70d0067570 0x7f70d0139890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 -- 172.21.15.57:0/91388625 >> 172.21.15.57:0/91388625 conn(0x7f70d00a93f0 msgr2=0x7f70d00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 -- 172.21.15.57:0/91388625 shutdown_connections 2024-03-18T14:41:24.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.793+0000 7f70d59e1700 1 -- 172.21.15.57:0/91388625 wait complete. 2024-03-18T14:41:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.794+0000 7f70d59e1700 1 Processor -- start 2024-03-18T14:41:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.794+0000 7f70d59e1700 1 -- start start 2024-03-18T14:41:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 0x7f70d0148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d0139d80 0x7f70d0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d009e080 con 0x7f70d0067570 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d009e340 con 0x7f70d0139d80 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70d59e1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70d009bf60 con 0x7f70d01337e0 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 0x7f70d0148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ceffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34766/0 (socket says 172.21.15.57:34766) 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ceffd700 1 -- 172.21.15.57:0/3516801195 learned_addr learned my addr 172.21.15.57:0/3516801195 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70cf7fe700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d0139d80 0x7f70d0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 -- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d0139d80 msgr2=0x7f70d0149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d0139d80 0x7f70d0149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 -- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 msgr2=0x7f70d0092950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 -- 172.21.15.57:0/3516801195 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c000b1e0 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ceffd700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.795+0000 7f70ce7fc700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 0x7f70d0148f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f70c000c000 tx=0x7f70c0006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0012600 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c0012760 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c8009470 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c0012ac0 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d00a1c90 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.796+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f70c0022070 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.797+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f70c004ac80 con 0x7f70d01337e0 2024-03-18T14:41:24.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.797+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d009daa0 con 0x7f70d01337e0 2024-03-18T14:41:24.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.800+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f70d009daa0 con 0x7f70d01337e0 2024-03-18T14:41:24.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.917+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70d009daa0 con 0x7f70d01337e0 2024-03-18T14:41:24.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.918+0000 7f70bffff700 1 -- 172.21.15.57:0/3516801195 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7f70d009daa0 con 0x7f70d01337e0 2024-03-18T14:41:24.920 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:24.920 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 >> v1:172.21.15.57:6816/39496 conn(0x7f70ac038dd0 legacy=0x7f70ac03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 msgr2=0x7f70d0148f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 0x7f70d0148f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f70c000c000 tx=0x7f70c0006eb0).stop 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 shutdown_connections 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70d0139d80 0x7f70d0149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70d0067570 0x7f70d0092950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 --2- 172.21.15.57:0/3516801195 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70d01337e0 0x7f70d0148f50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 >> 172.21.15.57:0/3516801195 conn(0x7f70d00a93f0 msgr2=0x7f70d00a2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:24.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 shutdown_connections 2024-03-18T14:41:24.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:24.919+0000 7f70d59e1700 1 -- 172.21.15.57:0/3516801195 wait complete. 2024-03-18T14:41:24.932 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:41:24.933 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-18T14:41:25.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.039+0000 7f93e7768700 1 Processor -- start 2024-03-18T14:41:25.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 -- start start 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 0x7f93e0133bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 0x7f93e0141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e0067990 con 0x7f93e0067570 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00a4c50 con 0x7f93e0139fa0 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e7768700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00a4f10 con 0x7f93e01337e0 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e5d05700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 0x7f93e0141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e5504700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 0x7f93e0133bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.040+0000 7f93e4d03700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93e0067570 0x7f93e0139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39170/0 (socket says 172.21.15.57:39170) 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e4d03700 1 -- 172.21.15.57:0/1192774313 learned_addr learned my addr 172.21.15.57:0/1192774313 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5504700 1 -- 172.21.15.57:0/1192774313 >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 msgr2=0x7f93e0141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5504700 1 --2- 172.21.15.57:0/1192774313 >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 0x7f93e0141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5504700 1 -- 172.21.15.57:0/1192774313 >> v1:172.21.15.57:6789/0 conn(0x7f93e0067570 legacy=0x7f93e0139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5504700 1 -- 172.21.15.57:0/1192774313 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0060520 con 0x7f93e01337e0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93d3fff700 1 -- 172.21.15.57:0/1192774313 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736441119 0 0) 0x7f93e0067990 con 0x7f93e0067570 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5d05700 1 --2- 172.21.15.57:0/1192774313 >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 0x7f93e0141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93e5504700 1 --2- 172.21.15.57:0/1192774313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 0x7f93e0133bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f93d4002f70 tx=0x7f93d4006df0).ready entity=mon.1 client_cookie=730a883624c0bfdb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93d3fff700 1 -- 172.21.15.57:0/1192774313 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d400d570 con 0x7f93e01337e0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93d3fff700 1 -- 172.21.15.57:0/1192774313 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4000e90 con 0x7f93e01337e0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.041+0000 7f93d3fff700 1 -- 172.21.15.57:0/1192774313 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d400d8c0 con 0x7f93e01337e0 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 -- 172.21.15.57:0/1192774313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 msgr2=0x7f93e0133bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 --2- 172.21.15.57:0/1192774313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 0x7f93e0133bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f93d4002f70 tx=0x7f93d4006df0).stop 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 -- 172.21.15.57:0/1192774313 shutdown_connections 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 --2- 172.21.15.57:0/1192774313 >> v2:172.21.15.57:3300/0 conn(0x7f93e0139fa0 0x7f93e0141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 --2- 172.21.15.57:0/1192774313 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e01337e0 0x7f93e0133bc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 -- 172.21.15.57:0/1192774313 >> 172.21.15.57:0/1192774313 conn(0x7f93e00a93f0 msgr2=0x7f93e00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 -- 172.21.15.57:0/1192774313 shutdown_connections 2024-03-18T14:41:25.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.042+0000 7f93e7768700 1 -- 172.21.15.57:0/1192774313 wait complete. 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 Processor -- start 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 -- start start 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93e01337e0 0x7f93e01497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 0x7f93e009f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00a2620 con 0x7f93e0139fa0 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0145b70 con 0x7f93e0067570 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e7768700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e009f7e0 con 0x7f93e01337e0 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e5504700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e5504700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41082/0 (socket says 172.21.15.57:41082) 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e5504700 1 -- 172.21.15.57:0/1602548039 learned_addr learned my addr 172.21.15.57:0/1602548039 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e5d05700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 0x7f93e009f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.043+0000 7f93e4d03700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93e01337e0 0x7f93e01497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 -- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93e01337e0 msgr2=0x7f93e01497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93e01337e0 0x7f93e01497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 -- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 msgr2=0x7f93e009f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 0x7f93e009f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 -- 172.21.15.57:0/1602548039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009470 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5d05700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 0x7f93e009f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e5504700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f93d4002f70 tx=0x7f93d4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d4013e90 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d401e400 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d400b180 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93d401e760 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.044+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e01491e0 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.045+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f93d4025030 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.045+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e0149620 con 0x7f93e0067570 2024-03-18T14:41:25.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.045+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f93d404b820 con 0x7f93e0067570 2024-03-18T14:41:25.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.048+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f93d4028440 con 0x7f93e0067570 2024-03-18T14:41:25.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.164+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f93e0065a50 con 0x7f93e0067570 2024-03-18T14:41:25.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.165+0000 7f93d27fc700 1 -- 172.21.15.57:0/1602548039 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f93d4028440 con 0x7f93e0067570 2024-03-18T14:41:25.167 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:41:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 >> v1:172.21.15.57:6816/39496 conn(0x7f93c0038da0 legacy=0x7f93c003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 msgr2=0x7f93e009cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f93d4002f70 tx=0x7f93d4014000).stop 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 shutdown_connections 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93e0139fa0 0x7f93e009f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f93e0067570 0x7f93e009cc20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 --2- 172.21.15.57:0/1602548039 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f93e01337e0 0x7f93e01497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 >> 172.21.15.57:0/1602548039 conn(0x7f93e00a93f0 msgr2=0x7f93e005b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 shutdown_connections 2024-03-18T14:41:25.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.166+0000 7f93e7768700 1 -- 172.21.15.57:0/1602548039 wait complete. 2024-03-18T14:41:25.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:41:25.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.287+0000 7f80c982a700 1 Processor -- start 2024-03-18T14:41:25.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.287+0000 7f80c982a700 1 -- start start 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c982a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80c4137860 0x7f80c4137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c982a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c982a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c4063a70 con 0x7f80c4063590 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c982a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40649c0 con 0x7f80c4137860 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c982a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4064bc0 con 0x7f80c40650c0 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80c4137860 0x7f80c4137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41084/0 (socket says 172.21.15.57:41084) 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c27fc700 1 -- 172.21.15.57:0/2821740987 learned_addr learned my addr 172.21.15.57:0/2821740987 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 --2- 172.21.15.57:0/2821740987 >> v2:172.21.15.57:3300/0 conn(0x7f80c4137860 0x7f80c4137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34788/0 (socket says 172.21.15.57:34788) 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 -- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 msgr2=0x7f80c40630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 -- 172.21.15.57:0/2821740987 >> v1:172.21.15.57:6789/0 conn(0x7f80c4063590 legacy=0x7f80c40a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c2ffd700 1 -- 172.21.15.57:0/2821740987 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40ab0d0 con 0x7f80c4137860 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c1ffb700 1 -- 172.21.15.57:0/2821740987 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563583853 0 0) 0x7f80c4063a70 con 0x7f80c4063590 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.288+0000 7f80c27fc700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c2ffd700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c4137860 0x7f80c4137c40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f80b8002f70 tx=0x7f80b8006df0).ready entity=mon.0 client_cookie=67ab5b2f27331b2b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c1ffb700 1 -- 172.21.15.57:0/2821740987 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b800d570 con 0x7f80c4137860 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c1ffb700 1 -- 172.21.15.57:0/2821740987 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8000e90 con 0x7f80c4137860 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c1ffb700 1 -- 172.21.15.57:0/2821740987 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b800d8c0 con 0x7f80c4137860 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 -- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c4137860 msgr2=0x7f80c4137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c4137860 0x7f80c4137c40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f80b8002f70 tx=0x7f80b8006df0).stop 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 -- 172.21.15.57:0/2821740987 shutdown_connections 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c4137860 0x7f80c4137c40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 --2- 172.21.15.57:0/2821740987 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c40650c0 0x7f80c40630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 -- 172.21.15.57:0/2821740987 >> 172.21.15.57:0/2821740987 conn(0x7f80c405c300 msgr2=0x7f80c406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 -- 172.21.15.57:0/2821740987 shutdown_connections 2024-03-18T14:41:25.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.289+0000 7f80c982a700 1 -- 172.21.15.57:0/2821740987 wait complete. 2024-03-18T14:41:25.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.290+0000 7f80c982a700 1 Processor -- start 2024-03-18T14:41:25.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.290+0000 7f80c982a700 1 -- start start 2024-03-18T14:41:25.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80c4063590 0x7f80c40970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 0x7f80c41439f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4096420 con 0x7f80c40650c0 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4096bd0 con 0x7f80c4137860 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c982a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80c41430d0 con 0x7f80c4063590 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80c4063590 0x7f80c40970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34796/0 (socket says 172.21.15.57:34796) 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 -- 172.21.15.57:0/738366760 learned_addr learned my addr 172.21.15.57:0/738366760 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c37fe700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 0x7f80c41439f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 -- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80c4063590 msgr2=0x7f80c40970d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80c4063590 0x7f80c40970d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 -- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 msgr2=0x7f80c41439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 0x7f80c41439f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 -- 172.21.15.57:0/738366760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b400b1e0 con 0x7f80c40650c0 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c37fe700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 0x7f80c41439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.291+0000 7f80c27fc700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80b400c000 tx=0x7f80b4006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.292+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b4012600 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.292+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4012760 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.292+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f80b4012ac0 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.292+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b800b180 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.292+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c40976f0 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.293+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f80b4012c20 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.293+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c4095be0 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.293+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f80b404adc0 con 0x7f80c40650c0 2024-03-18T14:41:25.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.296+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f80b40336f0 con 0x7f80c40650c0 2024-03-18T14:41:25.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.413+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80c40969e0 con 0x7f80c40650c0 2024-03-18T14:41:25.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.413+0000 7f80b3fff700 1 -- 172.21.15.57:0/738366760 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f80b40332e0 con 0x7f80c40650c0 2024-03-18T14:41:25.416 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 >> v1:172.21.15.57:6816/39496 conn(0x7f80a0038da0 legacy=0x7f80a003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 msgr2=0x7f80c4143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80b400c000 tx=0x7f80b4006eb0).stop 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 shutdown_connections 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80c4137860 0x7f80c41439f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80c4063590 0x7f80c40970d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 --2- 172.21.15.57:0/738366760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80c40650c0 0x7f80c4143500 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 >> 172.21.15.57:0/738366760 conn(0x7f80c405c300 msgr2=0x7f80c41365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 shutdown_connections 2024-03-18T14:41:25.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.414+0000 7f80c982a700 1 -- 172.21.15.57:0/738366760 wait complete. 2024-03-18T14:41:25.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:41:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 Processor -- start 2024-03-18T14:41:25.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 -- start start 2024-03-18T14:41:25.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 0x7fe92c09bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c09b520 0x7fe92c136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c09a0c0 con 0x7fe92c099a00 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c09a380 con 0x7fe92c1366f0 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.534+0000 7fe9338bc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c135fe0 con 0x7fe92c09b520 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 0x7fe92c09bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931e59700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe92c099a00 0x7fe92c139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39186/0 (socket says 172.21.15.57:39186) 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931e59700 1 -- 172.21.15.57:0/1550798818 learned_addr learned my addr 172.21.15.57:0/1550798818 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe930e57700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c09b520 0x7fe92c136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe91bfff700 1 -- 172.21.15.57:0/1550798818 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2308088517 0 0) 0x7fe92c09a0c0 con 0x7fe92c099a00 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 -- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c09b520 msgr2=0x7fe92c136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c09b520 0x7fe92c136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 -- 172.21.15.57:0/1550798818 >> v1:172.21.15.57:6789/0 conn(0x7fe92c099a00 legacy=0x7fe92c139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 -- 172.21.15.57:0/1550798818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c067cb0 con 0x7fe92c1366f0 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe931658700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 0x7fe92c09bbb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe92c05c360 tx=0x7fe928006df0).ready entity=mon.1 client_cookie=5f42791a8d313b1e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe91bfff700 1 -- 172.21.15.57:0/1550798818 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92800d570 con 0x7fe92c1366f0 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe91bfff700 1 -- 172.21.15.57:0/1550798818 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928000e90 con 0x7fe92c1366f0 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.535+0000 7fe91bfff700 1 -- 172.21.15.57:0/1550798818 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe92800d8c0 con 0x7fe92c1366f0 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 -- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 msgr2=0x7fe92c09bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 0x7fe92c09bbb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fe92c05c360 tx=0x7fe928006df0).stop 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 -- 172.21.15.57:0/1550798818 shutdown_connections 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c1366f0 0x7fe92c09bbb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 --2- 172.21.15.57:0/1550798818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c09b520 0x7fe92c136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 -- 172.21.15.57:0/1550798818 >> 172.21.15.57:0/1550798818 conn(0x7fe92c06c0c0 msgr2=0x7fe92c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 -- 172.21.15.57:0/1550798818 shutdown_connections 2024-03-18T14:41:25.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.536+0000 7fe9338bc700 1 -- 172.21.15.57:0/1550798818 wait complete. 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 Processor -- start 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 -- start start 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c099a00 0x7fe92c093470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 0x7fe92c12edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c094190 con 0x7fe92c1366f0 2024-03-18T14:41:25.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c094450 con 0x7fe92c09b520 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe9338bc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c095b40 con 0x7fe92c099a00 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe930e57700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe931e59700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 0x7fe92c12edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe930e57700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41116/0 (socket says 172.21.15.57:41116) 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe930e57700 1 -- 172.21.15.57:0/3675842414 learned_addr learned my addr 172.21.15.57:0/3675842414 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.537+0000 7fe931658700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c099a00 0x7fe92c093470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 -- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c099a00 msgr2=0x7fe92c093470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c099a00 0x7fe92c093470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 -- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 msgr2=0x7fe92c12edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 0x7fe92c12edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 -- 172.21.15.57:0/3675842414 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92800b180 con 0x7fe92c09b520 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe931e59700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 0x7fe92c12edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe930e57700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe91c00c000 tx=0x7fe91c006d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00be40 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0104c0 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c010820 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c139e00 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.538+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c0962a0 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.539+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe91c01a030 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.539+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe91c04a600 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.539+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c057a60 con 0x7fe92c09b520 2024-03-18T14:41:25.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.542+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe91c02f240 con 0x7fe92c09b520 2024-03-18T14:41:25.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.658+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe92c0946a0 con 0x7fe92c09b520 2024-03-18T14:41:25.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.658+0000 7fe91a7fc700 1 -- 172.21.15.57:0/3675842414 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe91c032a10 con 0x7fe92c09b520 2024-03-18T14:41:25.661 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:41:25.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 >> v1:172.21.15.57:6816/39496 conn(0x7fe90c038e30 legacy=0x7fe90c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 msgr2=0x7fe92c093b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fe91c00c000 tx=0x7fe91c006d90).stop 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 shutdown_connections 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe92c1366f0 0x7fe92c12edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe92c099a00 0x7fe92c093470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 --2- 172.21.15.57:0/3675842414 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe92c09b520 0x7fe92c093b70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 >> 172.21.15.57:0/3675842414 conn(0x7fe92c06c0c0 msgr2=0x7fe92c131b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 shutdown_connections 2024-03-18T14:41:25.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.660+0000 7fe9338bc700 1 -- 172.21.15.57:0/3675842414 wait complete. 2024-03-18T14:41:25.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:41:25.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.779+0000 7f3ffe1f6700 1 Processor -- start 2024-03-18T14:41:25.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.779+0000 7f3ffe1f6700 1 -- start start 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 0x7f3ff8137810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8134310 con 0x7f3ff8133e30 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8063520 con 0x7f3ff8063c30 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ffe1f6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8063750 con 0x7f3ff8137360 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 0x7f3ff8137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41124/0 (socket says 172.21.15.57:41124) 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34802/0 (socket says 172.21.15.57:34802) 2024-03-18T14:41:25.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff77fe700 1 -- 172.21.15.57:0/2032416950 learned_addr learned my addr 172.21.15.57:0/2032416950 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 -- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 msgr2=0x7f3ff8134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 -- 172.21.15.57:0/2032416950 >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 msgr2=0x7f3ff8064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/2032416950 >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 -- 172.21.15.57:0/2032416950 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8063a10 con 0x7f3ff8137360 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff6ffd700 1 --2- 172.21.15.57:0/2032416950 >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff77fe700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 0x7f3ff8137810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3ff00032f0 tx=0x7f3ff00091d0).ready entity=mon.2 client_cookie=f3f91b2dfeee31b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.780+0000 7f3ff67fc700 1 -- 172.21.15.57:0/2032416950 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff000b600 con 0x7f3ff8137360 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ff67fc700 1 -- 172.21.15.57:0/2032416950 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff000b760 con 0x7f3ff8137360 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ff67fc700 1 -- 172.21.15.57:0/2032416950 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff000b8d0 con 0x7f3ff8137360 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 msgr2=0x7f3ff8137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 0x7f3ff8137810 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f3ff00032f0 tx=0x7f3ff00091d0).stop 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/2032416950 shutdown_connections 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8137360 0x7f3ff8137810 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/2032416950 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8063c30 0x7f3ff8134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/2032416950 >> v2:172.21.15.57:3300/0 conn(0x7f3ff8133e30 0x7f3ff8064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/2032416950 >> 172.21.15.57:0/2032416950 conn(0x7f3ff806c0c0 msgr2=0x7f3ff806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/2032416950 shutdown_connections 2024-03-18T14:41:25.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.781+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/2032416950 wait complete. 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.782+0000 7f3ffe1f6700 1 Processor -- start 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.782+0000 7f3ffe1f6700 1 -- start start 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8063c30 0x7f3ff8096440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ff8133e30 0x7f3ff812ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8130910 con 0x7f3ff8133e30 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8098240 con 0x7f3ff8137360 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ffe1f6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff8096a90 con 0x7f3ff8063c30 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ff8133e30 0x7f3ff812ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41126/0 (socket says 172.21.15.57:41126) 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 -- 172.21.15.57:0/3555443483 learned_addr learned my addr 172.21.15.57:0/3555443483 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:25.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8063c30 0x7f3ff8096440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 -- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8063c30 msgr2=0x7f3ff8096440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8063c30 0x7f3ff8096440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 -- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ff8133e30 msgr2=0x7f3ff812ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ff8133e30 0x7f3ff812ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 -- 172.21.15.57:0/3555443483 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe000b1e0 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff7fff700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3ff00032f0 tx=0x7f3ff0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff000b600 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.783+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff0011e00 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.784+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe800b120 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.784+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ff00205e0 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.784+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff0009470 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.784+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3ff001e070 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.784+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff805c980 con 0x7f3ff8137360 2024-03-18T14:41:25.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.785+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3ff004b740 con 0x7f3ff8137360 2024-03-18T14:41:25.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.788+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3ff0005a70 con 0x7f3ff8137360 2024-03-18T14:41:25.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.903+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3ff8057a60 con 0x7f3ff8137360 2024-03-18T14:41:25.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.903+0000 7f3ff4ff9700 1 -- 172.21.15.57:0/3555443483 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3ff0021e60 con 0x7f3ff8137360 2024-03-18T14:41:25.906 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:41:25.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 >> v1:172.21.15.57:6816/39496 conn(0x7f3fdc038dd0 legacy=0x7f3fdc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 msgr2=0x7f3ff8130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f3ff00032f0 tx=0x7f3ff0016000).stop 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 shutdown_connections 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ff8137360 0x7f3ff8130420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ff8063c30 0x7f3ff8096440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 --2- 172.21.15.57:0/3555443483 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ff8133e30 0x7f3ff812ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 >> 172.21.15.57:0/3555443483 conn(0x7f3ff806c0c0 msgr2=0x7f3ff8131310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 shutdown_connections 2024-03-18T14:41:25.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:25.905+0000 7f3ffe1f6700 1 -- 172.21.15.57:0/3555443483 wait complete. 2024-03-18T14:41:25.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:26.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.021+0000 7ffba56ef700 1 Processor -- start 2024-03-18T14:41:26.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.021+0000 7ffba56ef700 1 -- start start 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffba56ef700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffba56ef700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffba56ef700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba005b970 con 0x7ffba0136bf0 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffba56ef700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba005d590 con 0x7ffba013eb70 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffba56ef700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0136710 con 0x7ffba0136210 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffba0136bf0 0x7ffba005ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39188/0 (socket says 172.21.15.57:39188) 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9f7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34828/0 (socket says 172.21.15.57:34828) 2024-03-18T14:41:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9effd700 1 -- 172.21.15.57:0/3070916532 learned_addr learned my addr 172.21.15.57:0/3070916532 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41128/0 (socket says 172.21.15.57:41128) 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9dffb700 1 -- 172.21.15.57:0/3070916532 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457663533 0 0) 0x7ffba005b970 con 0x7ffba0136bf0 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9dffb700 1 -- 172.21.15.57:0/3070916532 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb84003260 con 0x7ffba0136bf0 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 -- 172.21.15.57:0/3070916532 >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 msgr2=0x7ffba0140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 --2- 172.21.15.57:0/3070916532 >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 -- 172.21.15.57:0/3070916532 >> v1:172.21.15.57:6789/0 conn(0x7ffba0136bf0 legacy=0x7ffba005ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 -- 172.21.15.57:0/3070916532 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba01369d0 con 0x7ffba0136210 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9f7fe700 1 --2- 172.21.15.57:0/3070916532 >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.022+0000 7ffb9e7fc700 1 --2- 172.21.15.57:0/3070916532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90006df0).ready entity=mon.1 client_cookie=2f9dbc087ad16819 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffb9dffb700 1 -- 172.21.15.57:0/3070916532 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000d4a0 con 0x7ffba0136210 2024-03-18T14:41:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffb9dffb700 1 -- 172.21.15.57:0/3070916532 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90000e90 con 0x7ffba0136210 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffb9dffb700 1 -- 172.21.15.57:0/3070916532 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9000d7f0 con 0x7ffba0136210 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 -- 172.21.15.57:0/3070916532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 msgr2=0x7ffba005bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 --2- 172.21.15.57:0/3070916532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7ffb90002f70 tx=0x7ffb90006df0).stop 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 -- 172.21.15.57:0/3070916532 shutdown_connections 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 --2- 172.21.15.57:0/3070916532 >> v2:172.21.15.57:3300/0 conn(0x7ffba013eb70 0x7ffba0140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 --2- 172.21.15.57:0/3070916532 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba005bde0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 -- 172.21.15.57:0/3070916532 >> 172.21.15.57:0/3070916532 conn(0x7ffba0066a50 msgr2=0x7ffba006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 -- 172.21.15.57:0/3070916532 shutdown_connections 2024-03-18T14:41:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.023+0000 7ffba56ef700 1 -- 172.21.15.57:0/3070916532 wait complete. 2024-03-18T14:41:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.024+0000 7ffba56ef700 1 Processor -- start 2024-03-18T14:41:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.024+0000 7ffba56ef700 1 -- start start 2024-03-18T14:41:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffba0136bf0 0x7ffba01493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 0x7ffba012f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0139d70 con 0x7ffba013eb70 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba013dc50 con 0x7ffba0136210 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffba0149d20 con 0x7ffba0136bf0 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 0x7ffba012f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41132/0 (socket says 172.21.15.57:41132) 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 -- 172.21.15.57:0/610434094 learned_addr learned my addr 172.21.15.57:0/610434094 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9e7fc700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffba0136bf0 0x7ffba01493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 -- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffba0136bf0 msgr2=0x7ffba01493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffba0136bf0 0x7ffba01493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 -- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 msgr2=0x7ffba012f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 0x7ffba012f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 -- 172.21.15.57:0/610434094 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb98009470 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9f7fe700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 0x7ffba012f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb9effd700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ffb94001110 tx=0x7ffb94007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb9400ce20 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb940072e0 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9000b180 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffb94005800 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.025+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba0139210 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.026+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ffb94010070 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.026+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba0060150 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.026+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ffb94049fe0 con 0x7ffba0136210 2024-03-18T14:41:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.030+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ffb9402edf0 con 0x7ffba0136210 2024-03-18T14:41:26.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.181+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffba0057a60 con 0x7ffba0136210 2024-03-18T14:41:26.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.181+0000 7ffb8ffff700 1 -- 172.21.15.57:0/610434094 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2318 (secure 0 0 0) 0x7ffb94032410 con 0x7ffba0136210 2024-03-18T14:41:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:26.184 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:41:17.168864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 >> v1:172.21.15.57:6816/39496 conn(0x7ffb7c038dd0 legacy=0x7ffb7c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 msgr2=0x7ffba00a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ffb94001110 tx=0x7ffb94007ad0).stop 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 shutdown_connections 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffba013eb70 0x7ffba012f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffba0136210 0x7ffba00a1090 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 --2- 172.21.15.57:0/610434094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffba0136bf0 0x7ffba01493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 >> 172.21.15.57:0/610434094 conn(0x7ffba0066a50 msgr2=0x7ffba013e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 shutdown_connections 2024-03-18T14:41:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.182+0000 7ffba56ef700 1 -- 172.21.15.57:0/610434094 wait complete. 2024-03-18T14:41:26.186 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-18T14:41:26.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:41:26.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 Processor -- start 2024-03-18T14:41:26.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 -- start start 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5401366f0 0x7fb54009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb540099e50 con 0x7fb540099a00 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54009a380 con 0x7fb5401366f0 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb547026700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb540135fe0 con 0x7fb54009b520 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb53ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.300+0000 7fb544dc2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5401366f0 0x7fb54009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb5401366f0 0x7fb54009bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34846/0 (socket says 172.21.15.57:34846) 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41148/0 (socket says 172.21.15.57:41148) 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 -- 172.21.15.57:0/196284583 learned_addr learned my addr 172.21.15.57:0/196284583 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb5455c3700 1 --1- 172.21.15.57:0/196284583 >> v1:172.21.15.57:6789/0 conn(0x7fb540099a00 0x7fb540139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39194/0 (socket says 172.21.15.57:39194) 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 -- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 msgr2=0x7fb540136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 -- 172.21.15.57:0/196284583 >> v1:172.21.15.57:6789/0 conn(0x7fb540099a00 legacy=0x7fb540139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 -- 172.21.15.57:0/196284583 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54009a0c0 con 0x7fb5401366f0 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53f7fe700 1 -- 172.21.15.57:0/196284583 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357097152 0 0) 0x7fb540099e50 con 0x7fb540099a00 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53ffff700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb544dc2700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5401366f0 0x7fb54009bbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534006eb0).ready entity=mon.0 client_cookie=fb58a33b832a75a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53f7fe700 1 -- 172.21.15.57:0/196284583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53400d570 con 0x7fb5401366f0 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53f7fe700 1 -- 172.21.15.57:0/196284583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534000e90 con 0x7fb5401366f0 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.301+0000 7fb53f7fe700 1 -- 172.21.15.57:0/196284583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb53400d8c0 con 0x7fb5401366f0 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 -- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5401366f0 msgr2=0x7fb54009bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5401366f0 0x7fb54009bbb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534006eb0).stop 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 -- 172.21.15.57:0/196284583 shutdown_connections 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb5401366f0 0x7fb54009bbb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 --2- 172.21.15.57:0/196284583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 -- 172.21.15.57:0/196284583 >> 172.21.15.57:0/196284583 conn(0x7fb54006c0c0 msgr2=0x7fb54006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 -- 172.21.15.57:0/196284583 shutdown_connections 2024-03-18T14:41:26.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.302+0000 7fb547026700 1 -- 172.21.15.57:0/196284583 wait complete. 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 Processor -- start 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 -- start start 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540130ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5401366f0 0x7fb5401313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400951c0 con 0x7fb540099a00 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5400970b0 con 0x7fb54009b520 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb547026700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb540097390 con 0x7fb5401366f0 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb544dc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb544dc2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34858/0 (socket says 172.21.15.57:34858) 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb544dc2700 1 -- 172.21.15.57:0/3772621013 learned_addr learned my addr 172.21.15.57:0/3772621013 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb53ffff700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540130ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.303+0000 7fb5455c3700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5401366f0 0x7fb5401313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 -- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5401366f0 msgr2=0x7fb5401313c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5401366f0 0x7fb5401313c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 -- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 msgr2=0x7fb540130ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540130ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 -- 172.21.15.57:0/3772621013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c00b120 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb53ffff700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540130ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb544dc2700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5340116e0 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb534011840 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53400b1e0 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb534011ba0 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.304+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb540095a80 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.305+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb534025030 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.305+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5400a8e10 con 0x7fb540099a00 2024-03-18T14:41:26.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.305+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb53404bae0 con 0x7fb540099a00 2024-03-18T14:41:26.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.308+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb53401eb90 con 0x7fb540099a00 2024-03-18T14:41:26.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.424+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb540067cb0 con 0x7fb540099a00 2024-03-18T14:41:26.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.424+0000 7fb53dffb700 1 -- 172.21.15.57:0/3772621013 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10532 (secure 0 0 0) 0x7fb534023070 con 0x7fb540099a00 2024-03-18T14:41:26.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:26.427 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:14.459031+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:41:26.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 >> v1:172.21.15.57:6816/39496 conn(0x7fb520038da0 legacy=0x7fb52003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 msgr2=0x7fb540097940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fb534002f70 tx=0x7fb534015000).stop 2024-03-18T14:41:26.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 shutdown_connections 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb5401366f0 0x7fb5401313c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb540099a00 0x7fb540097940 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 --2- 172.21.15.57:0/3772621013 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb54009b520 0x7fb540130ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 >> 172.21.15.57:0/3772621013 conn(0x7fb54006c0c0 msgr2=0x7fb540132390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 shutdown_connections 2024-03-18T14:41:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.426+0000 7fb547026700 1 -- 172.21.15.57:0/3772621013 wait complete. 2024-03-18T14:41:26.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:41:26.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.543+0000 7fc9d6a9a700 1 Processor -- start 2024-03-18T14:41:26.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.543+0000 7fc9d6a9a700 1 -- start start 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d6a9a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9d0133bc0 0x7fc9d0067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d6a9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0141c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d6a9a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d00a4c50 con 0x7fc9d01337e0 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d6a9a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d0133fe0 con 0x7fc9d0133bc0 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d6a9a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d00a4f10 con 0x7fc9d0139fa0 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d5037700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9d0133bc0 0x7fc9d0067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d4836700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9d01337e0 0x7fc9d0139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39196/0 (socket says 172.21.15.57:39196) 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d4836700 1 -- 172.21.15.57:0/747033003 learned_addr learned my addr 172.21.15.57:0/747033003 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 -- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 msgr2=0x7fc9d0141c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0141c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 -- 172.21.15.57:0/747033003 >> v1:172.21.15.57:6789/0 conn(0x7fc9d01337e0 legacy=0x7fc9d0139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cf7fe700 1 -- 172.21.15.57:0/747033003 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209131447 0 0) 0x7fc9d00a4c50 con 0x7fc9d01337e0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 -- 172.21.15.57:0/747033003 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0060520 con 0x7fc9d0133bc0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9d5037700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cffff700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d0133bc0 0x7fc9d0067570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc9bc002f70 tx=0x7fc9bc006df0).ready entity=mon.0 client_cookie=d44d3e72e54c5080 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cf7fe700 1 -- 172.21.15.57:0/747033003 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc00d570 con 0x7fc9d0133bc0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cf7fe700 1 -- 172.21.15.57:0/747033003 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc000e90 con 0x7fc9d0133bc0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.544+0000 7fc9cf7fe700 1 -- 172.21.15.57:0/747033003 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9bc00d8c0 con 0x7fc9d0133bc0 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d0133bc0 msgr2=0x7fc9d0067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d0133bc0 0x7fc9d0067570 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fc9bc002f70 tx=0x7fc9bc006df0).stop 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/747033003 shutdown_connections 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0141c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/747033003 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d0133bc0 0x7fc9d0067570 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/747033003 >> 172.21.15.57:0/747033003 conn(0x7fc9d00a93f0 msgr2=0x7fc9d00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/747033003 shutdown_connections 2024-03-18T14:41:26.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.545+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/747033003 wait complete. 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.546+0000 7fc9d6a9a700 1 Processor -- start 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.546+0000 7fc9d6a9a700 1 -- start start 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9d0133bc0 0x7fc9d0149090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0093140 con 0x7fc9d01337e0 2024-03-18T14:41:26.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d009cb80 con 0x7fc9d0139fa0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d009e390 con 0x7fc9d0133bc0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d5037700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34862/0 (socket says 172.21.15.57:34862) 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 -- 172.21.15.57:0/738012209 learned_addr learned my addr 172.21.15.57:0/738012209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9cffff700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9d0133bc0 0x7fc9d0149090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 -- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9d0133bc0 msgr2=0x7fc9d0149090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9d0133bc0 0x7fc9d0149090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 -- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 msgr2=0x7fc9d0149580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0149580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 -- 172.21.15.57:0/738012209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c8009470 con 0x7fc9d01337e0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d5037700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d4836700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc9d009e9d0 tx=0x7fc9c4007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c40070d0 con 0x7fc9d01337e0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4007230 con 0x7fc9d01337e0 2024-03-18T14:41:26.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc00b180 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c4005610 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.547+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d009e5f0 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.548+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0065a50 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.548+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc9c4010070 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.549+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc9c4049f10 con 0x7fc9d01337e0 2024-03-18T14:41:26.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.552+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc9c402ed70 con 0x7fc9d01337e0 2024-03-18T14:41:26.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.700+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9d0057a60 con 0x7fc9d01337e0 2024-03-18T14:41:26.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.700+0000 7fc9cdffb700 1 -- 172.21.15.57:0/738012209 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+2318 (secure 0 0 0) 0x7fc9c4032390 con 0x7fc9d01337e0 2024-03-18T14:41:26.703 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:41:26.703 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:41:17.168864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:41:26.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 >> v1:172.21.15.57:6816/39496 conn(0x7fc9b0038da0 legacy=0x7fc9b003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 msgr2=0x7fc9d009d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc9d009e9d0 tx=0x7fc9c4007a60).stop 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 shutdown_connections 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc9d0139fa0 0x7fc9d0149580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9d01337e0 0x7fc9d009d9c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 --2- 172.21.15.57:0/738012209 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9d0133bc0 0x7fc9d0149090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 >> 172.21.15.57:0/738012209 conn(0x7fc9d00a93f0 msgr2=0x7fc9d005c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 shutdown_connections 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:26.701+0000 7fc9d6a9a700 1 -- 172.21.15.57:0/738012209 wait complete. 2024-03-18T14:41:26.705 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-18T14:41:27.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:41:17.168864+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:41:27.017 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-03-18T14:41:27.017 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-18T14:41:27.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.128+0000 7f5ff3d58700 1 Processor -- start 2024-03-18T14:41:27.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 -- start start 2024-03-18T14:41:27.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 0x7f5fec0a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec09f800 con 0x7f5fec05e170 2024-03-18T14:41:27.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0a50b0 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff3d58700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0a4190 con 0x7f5fec09d570 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41196/0 (socket says 172.21.15.57:41196) 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44498/0 (socket says 172.21.15.57:44498) 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff22f5700 1 -- 172.21.15.57:0/1315356082 learned_addr learned my addr 172.21.15.57:0/1315356082 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.129+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/1315356082 >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 0x7f5fec0a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 -- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 msgr2=0x7f5fec0a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 -- 172.21.15.57:0/1315356082 >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 msgr2=0x7f5fec0a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/1315356082 >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 0x7f5fec0a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 -- 172.21.15.57:0/1315356082 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec05e550 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/1315356082 >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 0x7f5fec0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5fec09f940 tx=0x7f5fe4009290).ready entity=mon.1 client_cookie=6479a9874cf01ad server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff0af2700 1 -- 172.21.15.57:0/1315356082 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe4009e60 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff0af2700 1 -- 172.21.15.57:0/1315356082 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe400b820 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.130+0000 7f5ff0af2700 1 -- 172.21.15.57:0/1315356082 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe400b990 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 msgr2=0x7f5fec0a24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5fec09f940 tx=0x7f5fe4009290).stop 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1315356082 shutdown_connections 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec0a24d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/1315356082 >> v2:172.21.15.57:3300/0 conn(0x7f5fec05e170 0x7f5fec0a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/1315356082 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec09d570 0x7f5fec0a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1315356082 >> 172.21.15.57:0/1315356082 conn(0x7f5fec0a93f0 msgr2=0x7f5fec0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1315356082 shutdown_connections 2024-03-18T14:41:27.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.131+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1315356082 wait complete. 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 Processor -- start 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 -- start start 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 0x7f5fec144fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0628c0 con 0x7f5fec09d570 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec144b60 con 0x7f5fec0a4ab0 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff3d58700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec145990 con 0x7f5fec05e170 2024-03-18T14:41:27.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44508/0 (socket says 172.21.15.57:44508) 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff1af4700 1 -- 172.21.15.57:0/4024364134 learned_addr learned my addr 172.21.15.57:0/4024364134 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.132+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 0x7f5fec144fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 -- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 msgr2=0x7f5fec1454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec1454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 -- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 msgr2=0x7f5fec144fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 0x7f5fec144fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 -- 172.21.15.57:0/4024364134 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe800b180 con 0x7f5fec05e170 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 0x7f5fec144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5fe800c000 tx=0x7f5fe8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5fdeffd700 1 -- 172.21.15.57:0/4024364134 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe800c7e0 con 0x7f5fec05e170 2024-03-18T14:41:27.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5fdeffd700 1 -- 172.21.15.57:0/4024364134 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800c940 con 0x7f5fec05e170 2024-03-18T14:41:27.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5fdeffd700 1 -- 172.21.15.57:0/4024364134 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe800cca0 con 0x7f5fec05e170 2024-03-18T14:41:27.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe000d590 con 0x7f5fec05e170 2024-03-18T14:41:27.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.133+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe4009530 con 0x7f5fec05e170 2024-03-18T14:41:27.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.134+0000 7f5fdeffd700 1 -- 172.21.15.57:0/4024364134 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5fe801c460 con 0x7f5fec05e170 2024-03-18T14:41:27.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.134+0000 7f5fdeffd700 1 -- 172.21.15.57:0/4024364134 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5fe804ae00 con 0x7f5fec05e170 2024-03-18T14:41:27.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.137+0000 7f60057dfb80 1 Processor -- start 2024-03-18T14:41:27.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.137+0000 7f60057dfb80 1 -- start start 2024-03-18T14:41:27.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc7b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc80a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc1ca10 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fbc1e10 con 0x55dd0fc7b5b0 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fb928b0 con 0x55dd0fc80590 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc80a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34882/0 (socket says 172.21.15.57:34882) 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 -- 172.21.15.57:0/1862026972 learned_addr learned my addr 172.21.15.57:0/1862026972 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc7b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 -- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 msgr2=0x55dd0fc80a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc80a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 -- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 msgr2=0x55dd0fc7b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc7b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff1af4700 1 -- 172.21.15.57:0/1862026972 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd0fc28e20 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.138+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc80a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe8019000).ready entity=mon.0 client_cookie=302e15e3828672fb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1862026972 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe80330a0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1862026972 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe801fe00 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f5ff3d58700 1 -- 172.21.15.57:0/1862026972 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8032b10 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 -- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 msgr2=0x55dd0fc6ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe8019000).stop 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 -- 172.21.15.57:0/1862026972 shutdown_connections 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc80a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc6ea60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 --2- 172.21.15.57:0/1862026972 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc7b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 -- 172.21.15.57:0/1862026972 >> 172.21.15.57:0/1862026972 conn(0x55dd0fc1a970 msgr2=0x55dd0fb74690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 -- 172.21.15.57:0/1862026972 shutdown_connections 2024-03-18T14:41:27.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.139+0000 7f60057dfb80 1 -- 172.21.15.57:0/1862026972 wait complete. 2024-03-18T14:41:27.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.140+0000 7f60057dfb80 1 -- start start 2024-03-18T14:41:27.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.140+0000 7f60057dfb80 1 Processor -- start 2024-03-18T14:41:27.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fba6180 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fb867f0 con 0x55dd0fc7b5b0 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fb76710 con 0x55dd0fc80590 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f60057dfb80 10 client.0 ll_register_callbacks cb 0x55dd0fb9b570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44536/0 (socket says 172.21.15.57:44536) 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41222/0 (socket says 172.21.15.57:41222) 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 -- 172.21.15.57:0/3297305684 learned_addr learned my addr 172.21.15.57:0/3297305684 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 -- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 msgr2=0x55dd0fc73b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 -- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 msgr2=0x55dd0fc727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.141+0000 7f5ff22f5700 1 -- 172.21.15.57:0/3297305684 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec05e550 con 0x55dd0fc80590 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5fe401a000 tx=0x7f5fe4016000).ready entity=mon.2 client_cookie=293af21994edb576 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3302/0 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe40032d0 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mon.2 v2:172.21.15.57:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5fe4009e60 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd0fb1d0c0 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fe4006d40 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 10 client.4475 fetch_fsmap learned FSMap version 9 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f5fe4009530 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mon.2 v2:172.21.15.57:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dd0fb1d0c0 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mon.2 v2:172.21.15.57:3302/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f5fe4023a20 con 0x55dd0fc80590 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 10 client.4475 fetch_fsmap finished waiting for FSMap version 9 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 10 client.4475 resolve_mds: resolved ID 'c' to GID 4193 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 20 client.4475 populate_metadata read hostname 'smithi057' 2024-03-18T14:41:27.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 4 client.4475 mds_command: new command op to 4193 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 --> v1:172.21.15.57:6818/3757846201 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd0fb9c230 con 0x55dd0fc86cb0 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.142+0000 7f5fc8ff9700 10 client.4475 ms_handle_connect on v1:172.21.15.57:6818/3757846201 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f5fc8ff9700 1 -- 172.21.15.57:0/3297305684 <== mds.1 v1:172.21.15.57:6818/3757846201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55dd0fb9c230 con 0x55dd0fc86cb0 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f5fc8ff9700 10 client.4475 handle_command_reply: tid=0 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 client.4475 shutdown 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 msgr2=0x55dd0fc71ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f5fe401a000 tx=0x7f5fe4016000).stop 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 shutdown_connections 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fc71ea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f5fc8ff9700 0 client.4475 ms_handle_reset on v1:172.21.15.57:6818/3757846201 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3297305684 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fc73b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 >> 172.21.15.57:0/3297305684 conn(0x55dd0fc1a970 msgr2=0x55dd0fb6fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 shutdown_connections 2024-03-18T14:41:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 1 -- 172.21.15.57:0/3297305684 wait complete. 2024-03-18T14:41:27.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.143+0000 7f60057dfb80 20 client.4475 trim_cache size 0 max 16384 2024-03-18T14:41:27.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 Processor -- start 2024-03-18T14:41:27.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 -- start start 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 0x55dd0fc83990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc4f1d0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc1a050 con 0x55dd0fc80590 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc713e0 con 0x55dd0fc7b5b0 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.160+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff22f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 0x55dd0fc83990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34898/0 (socket says 172.21.15.57:34898) 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44540/0 (socket says 172.21.15.57:44540) 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 -- 172.21.15.57:0/3531857402 learned_addr learned my addr 172.21.15.57:0/3531857402 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 -- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 msgr2=0x55dd0fc4ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 -- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 msgr2=0x55dd0fc83990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 0x55dd0fc83990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 -- 172.21.15.57:0/3531857402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd0fb95ae0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 0x55dd0fc83990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff12f3700 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe802b040).ready entity=mon.0 client_cookie=bdb4ae454b6ac05f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5fcaffd700 1 -- 172.21.15.57:0/3531857402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8038070 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5fcaffd700 1 -- 172.21.15.57:0/3531857402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80330a0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.161+0000 7f5fcaffd700 1 -- 172.21.15.57:0/3531857402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8032b10 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 msgr2=0x55dd0fc727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe802b040).stop 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- 172.21.15.57:0/3531857402 shutdown_connections 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc80590 0x55dd0fc83990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc727d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 --2- 172.21.15.57:0/3531857402 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc7b5b0 0x55dd0fc4ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- 172.21.15.57:0/3531857402 >> 172.21.15.57:0/3531857402 conn(0x55dd0fc1a970 msgr2=0x55dd0fb6fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- 172.21.15.57:0/3531857402 shutdown_connections 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- 172.21.15.57:0/3531857402 wait complete. 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 -- start start 2024-03-18T14:41:27.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.162+0000 7f60057dfb80 1 Processor -- start 2024-03-18T14:41:27.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fcd5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fcd5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc83230 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc7fa50 con 0x55dd0fc7b5b0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55dd0fc7fcf0 con 0x55dd0fc80590 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f60057dfb80 10 client.0 ll_register_callbacks cb 0x55dd0fc741f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f5ff1af4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34906/0 (socket says 172.21.15.57:34906) 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f5ff1af4700 1 -- 172.21.15.57:0/301249907 learned_addr learned my addr 172.21.15.57:0/301249907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f5ff12f3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fcd5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.163+0000 7f5ff22f5700 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fcd5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 -- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 msgr2=0x55dd0fcd5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fcd5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 -- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 msgr2=0x55dd0fcd5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fcd5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 -- 172.21.15.57:0/301249907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe0015d10 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5ff1af4700 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe8038000).ready entity=mon.0 client_cookie=1ad56f43f9a252d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8033960 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5fe8033ac0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fe801fe00 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fe8033c80 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 10 client.4665 fetch_fsmap learned FSMap version 9 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f5fe4009530 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe801fe00 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f5fe801cca0 con 0x55dd0fc7b1d0 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 10 client.4665 fetch_fsmap finished waiting for FSMap version 9 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 10 client.4665 resolve_mds: resolved ID 'c' to GID 4193 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 20 client.4665 populate_metadata read hostname 'smithi057' 2024-03-18T14:41:27.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 4 client.4665 mds_command: new command op to 4193 tid=0[{"prefix": "status"}] 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 --> v1:172.21.15.57:6818/3757846201 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55dd0fb94570 con 0x55dd0fc7ec80 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.164+0000 7f5fc9ffb700 10 client.4665 ms_handle_connect on v1:172.21.15.57:6818/3757846201 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f5fc9ffb700 1 -- 172.21.15.57:0/301249907 <== mds.1 v1:172.21.15.57:6818/3757846201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+299 (unknown 0 0 3766268553) 0x55dd0fb94570 con 0x55dd0fc7ec80 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f5fc9ffb700 10 client.4665 handle_command_reply: tid=0 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 client.4665 shutdown 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 msgr2=0x55dd0fc7f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5fe801ff90 tx=0x7f5fe8038000).stop 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 shutdown_connections 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55dd0fc80590 0x55dd0fcd5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55dd0fc7b1d0 0x55dd0fc7f400 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 --2- 172.21.15.57:0/301249907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55dd0fc7b5b0 0x55dd0fcd5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f5fc9ffb700 0 client.4665 ms_handle_reset on v1:172.21.15.57:6818/3757846201 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 >> 172.21.15.57:0/301249907 conn(0x55dd0fc1a970 msgr2=0x55dd0fc70770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 shutdown_connections 2024-03-18T14:41:27.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 1 -- 172.21.15.57:0/301249907 wait complete. 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.165+0000 7f60057dfb80 20 client.4665 trim_cache size 0 max 16384 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 1, 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4193, 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 10.993593305999999, 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 9, 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 18, 2024-03-18T14:41:27.174 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 18, 2024-03-18T14:41:27.175 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 22.523066772 2024-03-18T14:41:27.175 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:41:27.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 >> v1:172.21.15.57:6816/39496 conn(0x7f5fcc038da0 legacy=0x7f5fcc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 msgr2=0x7f5fec061ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f5fe800c000 tx=0x7f5fe8006df0).stop 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 shutdown_connections 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5fec0a4ab0 0x7f5fec1454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5fec05e170 0x7f5fec061ef0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 --2- 172.21.15.57:0/4024364134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5fec09d570 0x7f5fec144fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 >> 172.21.15.57:0/4024364134 conn(0x7f5fec0a93f0 msgr2=0x7f5fec09ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 shutdown_connections 2024-03-18T14:41:27.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.166+0000 7f5ff3d58700 1 -- 172.21.15.57:0/4024364134 wait complete. 2024-03-18T14:41:27.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-18T14:41:27.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.283+0000 7f2b53c7b700 1 Processor -- start 2024-03-18T14:41:27.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.283+0000 7f2b53c7b700 1 -- start start 2024-03-18T14:41:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b53c7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b53c7b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 0x7f2b4c1409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b53c7b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b4c0603c0 con 0x7f2b4c0aae90 2024-03-18T14:41:27.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b53c7b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c1338e0 con 0x7f2b4c13e600 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b53c7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c0aa230 con 0x7f2b4c132df0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b52218700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 0x7f2b4c1409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41248/0 (socket says 172.21.15.57:41248) 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 -- 172.21.15.57:0/3098606583 learned_addr learned my addr 172.21.15.57:0/3098606583 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 -- 172.21.15.57:0/3098606583 >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 msgr2=0x7f2b4c1409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 --2- 172.21.15.57:0/3098606583 >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 0x7f2b4c1409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 -- 172.21.15.57:0/3098606583 >> v1:172.21.15.57:6789/0 conn(0x7f2b4c0aae90 legacy=0x7f2b4c1331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 -- 172.21.15.57:0/3098606583 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c0aa4d0 con 0x7f2b4c132df0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b52218700 1 --2- 172.21.15.57:0/3098606583 >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 0x7f2b4c1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b51a17700 1 --2- 172.21.15.57:0/3098606583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2b3c002f70 tx=0x7f2b3c006eb0).ready entity=mon.1 client_cookie=eb8c6176ec77d526 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b50a15700 1 -- 172.21.15.57:0/3098606583 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c00d570 con 0x7f2b4c132df0 2024-03-18T14:41:27.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b50a15700 1 -- 172.21.15.57:0/3098606583 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c000e90 con 0x7f2b4c132df0 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.284+0000 7f2b50a15700 1 -- 172.21.15.57:0/3098606583 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c00d900 con 0x7f2b4c132df0 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3098606583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 msgr2=0x7f2b4c060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/3098606583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f2b3c002f70 tx=0x7f2b3c006eb0).stop 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3098606583 shutdown_connections 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/3098606583 >> v2:172.21.15.57:3300/0 conn(0x7f2b4c13e600 0x7f2b4c1409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/3098606583 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c132df0 0x7f2b4c060dc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3098606583 >> 172.21.15.57:0/3098606583 conn(0x7f2b4c05c300 msgr2=0x7f2b4c06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3098606583 shutdown_connections 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.285+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3098606583 wait complete. 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.286+0000 7f2b53c7b700 1 Processor -- start 2024-03-18T14:41:27.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.286+0000 7f2b53c7b700 1 -- start start 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 0x7f2b4c1370a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 0x7f2b4c137590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c13bca0 con 0x7f2b4c13e600 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c13bf40 con 0x7f2b4c0aae90 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b53c7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c13b0f0 con 0x7f2b4c132df0 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41258/0 (socket says 172.21.15.57:41258) 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 -- 172.21.15.57:0/4229971639 learned_addr learned my addr 172.21.15.57:0/4229971639 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51216700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 0x7f2b4c1370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b52218700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 0x7f2b4c137590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 -- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 msgr2=0x7f2b4c1370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 0x7f2b4c1370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 -- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 msgr2=0x7f2b4c137590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 0x7f2b4c137590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 -- 172.21.15.57:0/4229971639 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b44009470 con 0x7f2b4c0aae90 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51216700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 0x7f2b4c1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b52218700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 0x7f2b4c137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.287+0000 7f2b51a17700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2b3c002f70 tx=0x7f2b3c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.291+0000 7f2b3affd700 1 -- 172.21.15.57:0/4229971639 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c011860 con 0x7f2b4c0aae90 2024-03-18T14:41:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.291+0000 7f2b3affd700 1 -- 172.21.15.57:0/4229971639 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c0119c0 con 0x7f2b4c0aae90 2024-03-18T14:41:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.291+0000 7f2b3affd700 1 -- 172.21.15.57:0/4229971639 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c011d20 con 0x7f2b4c0aae90 2024-03-18T14:41:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.291+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c00b1e0 con 0x7f2b4c0aae90 2024-03-18T14:41:27.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.291+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c1357c0 con 0x7f2b4c0aae90 2024-03-18T14:41:27.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.292+0000 7f2b3affd700 1 -- 172.21.15.57:0/4229971639 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2b3c025030 con 0x7f2b4c0aae90 2024-03-18T14:41:27.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.293+0000 7f2b3affd700 1 -- 172.21.15.57:0/4229971639 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2b3c04bb70 con 0x7f2b4c0aae90 2024-03-18T14:41:27.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.295+0000 7f2b65702b80 1 Processor -- start 2024-03-18T14:41:27.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 -- start start 2024-03-18T14:41:27.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0509a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e051b590 0x5604e051ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e04b7a10 con 0x5604e05161d0 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e045ce10 con 0x5604e051b590 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604e042d8b0 con 0x5604e05165b0 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0509a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44556/0 (socket says 172.21.15.57:44556) 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b51216700 1 -- 172.21.15.57:0/3575940120 learned_addr learned my addr 172.21.15.57:0/3575940120 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b52218700 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e051b590 0x5604e051ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.296+0000 7f2b51216700 1 -- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e051b590 msgr2=0x5604e051ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b51216700 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e051b590 0x5604e051ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b51216700 1 -- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 msgr2=0x5604e0509a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b51216700 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0509a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b51216700 1 -- 172.21.15.57:0/3575940120 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e04c3e20 con 0x5604e05165b0 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b51216700 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b4c09cc20 tx=0x7f2b48007b90).ready entity=mon.2 client_cookie=c91cd0ce613165f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3575940120 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b48011cd0 con 0x5604e05165b0 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3575940120 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48011e30 con 0x5604e05165b0 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b53c7b700 1 -- 172.21.15.57:0/3575940120 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b48015600 con 0x5604e05165b0 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 -- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 msgr2=0x5604e05169b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b4c09cc20 tx=0x7f2b48007b90).stop 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 -- 172.21.15.57:0/3575940120 shutdown_connections 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e051b590 0x5604e051ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0509a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3575940120 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e05169b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.297+0000 7f2b65702b80 1 -- 172.21.15.57:0/3575940120 >> 172.21.15.57:0/3575940120 conn(0x5604e04b5970 msgr2=0x5604e040f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.298+0000 7f2b65702b80 1 -- 172.21.15.57:0/3575940120 shutdown_connections 2024-03-18T14:41:27.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.298+0000 7f2b65702b80 1 -- 172.21.15.57:0/3575940120 wait complete. 2024-03-18T14:41:27.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.298+0000 7f2b65702b80 1 -- start start 2024-03-18T14:41:27.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.298+0000 7f2b65702b80 1 Processor -- start 2024-03-18T14:41:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05161d0 0x5604e050be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e0441180 con 0x5604e051b590 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e04217f0 con 0x5604e05161d0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604e0411710 con 0x5604e05165b0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 10 client.0 ll_register_callbacks cb 0x5604e0436570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b52218700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44562/0 (socket says 172.21.15.57:44562) 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 -- 172.21.15.57:0/3482365924 learned_addr learned my addr 172.21.15.57:0/3482365924 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b52218700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34944/0 (socket says 172.21.15.57:34944) 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51a17700 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05161d0 0x5604e050be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 -- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05161d0 msgr2=0x5604e050be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05161d0 0x5604e050be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 -- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 msgr2=0x5604e0521700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 -- 172.21.15.57:0/3482365924 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c0603c0 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b52218700 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b51216700 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x5604e05213e0 tx=0x7f2b4801a000).ready entity=mon.2 client_cookie=6043398539df5a6e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3302/0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b48001440 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mon.2 v2:172.21.15.57:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2b48016d50 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.299+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604e03b80c0 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b480078c0 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 10 client.4490 fetch_fsmap learned FSMap version 9 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5604e0430ae0 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mon.2 v2:172.21.15.57:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604e03b80c0 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mon.2 v2:172.21.15.57:3302/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f2b48014070 con 0x5604e05165b0 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 10 client.4490 fetch_fsmap finished waiting for FSMap version 9 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 10 client.4490 resolve_mds: resolved ID 'a' to GID 4242 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 20 client.4490 populate_metadata read hostname 'smithi057' 2024-03-18T14:41:27.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 4 client.4490 mds_command: new command op to 4242 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604e0437230 con 0x5604e0524600 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.300+0000 7f2b28ff9700 10 client.4490 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b28ff9700 1 -- 172.21.15.57:0/3482365924 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x5604e0437230 con 0x5604e0524600 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b28ff9700 10 client.4490 handle_command_reply: tid=0 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 client.4490 shutdown 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 msgr2=0x5604e050d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x5604e05213e0 tx=0x7f2b4801a000).stop 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 shutdown_connections 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e051b590 0x5604e0521700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b28ff9700 0 client.4490 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05161d0 0x5604e050be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 --2- 172.21.15.57:0/3482365924 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e05165b0 0x5604e050d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 >> 172.21.15.57:0/3482365924 conn(0x5604e04b5970 msgr2=0x5604e040acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 shutdown_connections 2024-03-18T14:41:27.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 1 -- 172.21.15.57:0/3482365924 wait complete. 2024-03-18T14:41:27.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.301+0000 7f2b65702b80 20 client.4490 trim_cache size 0 max 16384 2024-03-18T14:41:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 Processor -- start 2024-03-18T14:41:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 -- start start 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e04e8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e0516080 con 0x5604e05161d0 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e04e7880 con 0x5604e05165b0 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604e050b3b0 con 0x5604e051b590 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b52218700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e04e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b51a17700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34956/0 (socket says 172.21.15.57:34956) 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b51a17700 1 -- 172.21.15.57:0/1440842901 learned_addr learned my addr 172.21.15.57:0/1440842901 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.318+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41286/0 (socket says 172.21.15.57:41286) 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 -- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 msgr2=0x5604e04e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e04e8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 -- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 msgr2=0x5604e050a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 -- 172.21.15.57:0/1440842901 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e0439410 con 0x5604e05161d0 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51216700 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b52218700 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e04e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b51a17700 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x5604e04e7e10 tx=0x7f2b3c013000).ready entity=mon.0 client_cookie=8b0a85d09386b9ef server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b2affd700 1 -- 172.21.15.57:0/1440842901 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c03a070 con 0x5604e05161d0 2024-03-18T14:41:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b2affd700 1 -- 172.21.15.57:0/1440842901 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c0088c0 con 0x5604e05161d0 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b2affd700 1 -- 172.21.15.57:0/1440842901 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b3c0086e0 con 0x5604e05161d0 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b65702b80 1 -- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 msgr2=0x5604e050c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.319+0000 7f2b65702b80 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x5604e04e7e10 tx=0x7f2b3c013000).stop 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 -- 172.21.15.57:0/1440842901 shutdown_connections 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e04e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e050c710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 --2- 172.21.15.57:0/1440842901 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e050a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 -- 172.21.15.57:0/1440842901 >> 172.21.15.57:0/1440842901 conn(0x5604e04b5970 msgr2=0x5604e0516990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 -- 172.21.15.57:0/1440842901 shutdown_connections 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 -- 172.21.15.57:0/1440842901 wait complete. 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 -- start start 2024-03-18T14:41:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.320+0000 7f2b65702b80 1 Processor -- start 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0511810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e0574a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e0519940 con 0x5604e05161d0 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e0519bc0 con 0x5604e05165b0 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x5604e0512a30 con 0x5604e051b590 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b65702b80 10 client.0 ll_register_callbacks cb 0x5604e04e8f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b51216700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41294/0 (socket says 172.21.15.57:41294) 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b51216700 1 -- 172.21.15.57:0/4147479663 learned_addr learned my addr 172.21.15.57:0/4147479663 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b52218700 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e0574a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.321+0000 7f2b51a17700 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0511810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 -- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 msgr2=0x5604e0574a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e0574a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 -- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 msgr2=0x5604e0511810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0511810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 -- 172.21.15.57:0/4147479663 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604e0430ae0 con 0x5604e05165b0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b51216700 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2b48035000 tx=0x7f2b48021000).ready entity=mon.1 client_cookie=bd97674bc7a28fa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 10 client.0 ms_handle_connect on v2:172.21.15.57:3301/0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b48016440 con 0x5604e05165b0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mon.1 v2:172.21.15.57:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2b48021430 con 0x5604e05165b0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b48011e30 con 0x5604e05165b0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b480215f0 con 0x5604e05165b0 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 10 client.4528 fetch_fsmap learned FSMap version 9 2024-03-18T14:41:27.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f2b44012890 con 0x5604e05165b0 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mon.1 v2:172.21.15.57:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48011e30 con 0x5604e05165b0 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mon.1 v2:172.21.15.57:3301/0 5 ==== fsmap(e 9) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f2b4803e020 con 0x5604e05165b0 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 10 client.4528 fetch_fsmap finished waiting for FSMap version 9 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 10 client.4528 resolve_mds: resolved ID 'a' to GID 4242 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 20 client.4528 populate_metadata read hostname 'smithi057' 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 4 client.4528 mds_command: new command op to 4242 tid=0[{"prefix": "status"}] 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.322+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604e042f570 con 0x5604e0511d00 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b29ffb700 10 client.4528 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b29ffb700 1 -- 172.21.15.57:0/4147479663 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+305 (unknown 0 0 1607358274) 0x5604e042f570 con 0x5604e0511d00 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b29ffb700 10 client.4528 handle_command_reply: tid=0 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 client.4528 shutdown 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 msgr2=0x5604e0574560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2b48035000 tx=0x7f2b48021000).stop 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 shutdown_connections 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x5604e051b590 0x5604e0574a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b29ffb700 0 client.4528 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x5604e05161d0 0x5604e0511810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 --2- 172.21.15.57:0/4147479663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x5604e05165b0 0x5604e0574560 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 >> 172.21.15.57:0/4147479663 conn(0x5604e04b5970 msgr2=0x5604e040acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 shutdown_connections 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 1 -- 172.21.15.57:0/4147479663 wait complete. 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.323+0000 7f2b65702b80 20 client.4528 trim_cache size 0 max 16384 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4242, 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:41:27.332 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 13.865252546000001, 2024-03-18T14:41:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 9, 2024-03-18T14:41:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 18, 2024-03-18T14:41:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 18, 2024-03-18T14:41:27.333 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 22.681064589000002 2024-03-18T14:41:27.333 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 >> v1:172.21.15.57:6816/39496 conn(0x7f2b2c038da0 legacy=0x7f2b2c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 msgr2=0x7f2b4c138360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2b3c002f70 tx=0x7f2b3c015000).stop 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 shutdown_connections 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2b4c13e600 0x7f2b4c137590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2b4c0aae90 0x7f2b4c138360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 --2- 172.21.15.57:0/4229971639 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2b4c132df0 0x7f2b4c1370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 >> 172.21.15.57:0/4229971639 conn(0x7f2b4c05c300 msgr2=0x7f2b4c067c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 shutdown_connections 2024-03-18T14:41:27.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.324+0000 7f2b53c7b700 1 -- 172.21.15.57:0/4229971639 wait complete. 2024-03-18T14:41:27.337 INFO:teuthology.run_tasks:Running task exec... 2024-03-18T14:41:27.347 INFO:teuthology.task.exec:Executing custom commands... 2024-03-18T14:41:27.347 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:41:27.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2024-03-18T14:41:27.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.449+0000 7fb8ea485700 1 Processor -- start 2024-03-18T14:41:27.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.449+0000 7fb8ea485700 1 -- start start 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4066fb0 0x7fb8e41332b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40a47f0 con 0x7fb8e4066fb0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40a4060 con 0x7fb8e4132ed0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8ea485700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40a4300 con 0x7fb8e405baa0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4066fb0 0x7fb8e41332b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e8a22700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb8e4066fb0 0x7fb8e41332b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34962/0 (socket says 172.21.15.57:34962) 2024-03-18T14:41:27.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41298/0 (socket says 172.21.15.57:41298) 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e8a22700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:44586/0 (socket says 172.21.15.57:44586) 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 -- 172.21.15.57:0/796091609 learned_addr learned my addr 172.21.15.57:0/796091609 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 -- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 msgr2=0x7fb8e405bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 -- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 msgr2=0x7fb8e40a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e37fe700 1 -- 172.21.15.57:0/796091609 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e41337a0 con 0x7fb8e4066fb0 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e8a22700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.450+0000 7fb8e3fff700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8e37fe700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4066fb0 0x7fb8e41332b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb8d8002f70 tx=0x7fb8d8006eb0).ready entity=mon.0 client_cookie=d7accd8745232d63 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8e2ffd700 1 -- 172.21.15.57:0/796091609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d800d570 con 0x7fb8e4066fb0 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8e2ffd700 1 -- 172.21.15.57:0/796091609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8000e90 con 0x7fb8e4066fb0 2024-03-18T14:41:27.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8e2ffd700 1 -- 172.21.15.57:0/796091609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d800d8c0 con 0x7fb8e4066fb0 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 -- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4066fb0 msgr2=0x7fb8e41332b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4066fb0 0x7fb8e41332b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fb8d8002f70 tx=0x7fb8d8006eb0).stop 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 -- 172.21.15.57:0/796091609 shutdown_connections 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e405bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4132ed0 0x7fb8e40a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 --2- 172.21.15.57:0/796091609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4066fb0 0x7fb8e41332b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 -- 172.21.15.57:0/796091609 >> 172.21.15.57:0/796091609 conn(0x7fb8e4060aa0 msgr2=0x7fb8e40a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 -- 172.21.15.57:0/796091609 shutdown_connections 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.451+0000 7fb8ea485700 1 -- 172.21.15.57:0/796091609 wait complete. 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.452+0000 7fb8ea485700 1 Processor -- start 2024-03-18T14:41:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.452+0000 7fb8ea485700 1 -- start start 2024-03-18T14:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e4134ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4066fb0 0x7fb8e412bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4134230 con 0x7fb8e4132ed0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e4135ed0 con 0x7fb8e4066fb0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8ea485700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e412cfe0 con 0x7fb8e405baa0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e8a22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e37fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4066fb0 0x7fb8e412bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e8a22700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34970/0 (socket says 172.21.15.57:34970) 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e8a22700 1 -- 172.21.15.57:0/341781035 learned_addr learned my addr 172.21.15.57:0/341781035 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e4134ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 -- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4066fb0 msgr2=0x7fb8e412bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4066fb0 0x7fb8e412bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 -- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 msgr2=0x7fb8e412c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e3fff700 1 -- 172.21.15.57:0/341781035 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc009470 con 0x7fb8e405baa0 2024-03-18T14:41:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.453+0000 7fb8e8a22700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8e3fff700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e4134ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8d400c000 tx=0x7fb8d4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d4010780 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d40108e0 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8d4010c40 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d400b180 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.454+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d800b1e0 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.455+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb8d401c460 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.455+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb8d404abd0 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.455+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e41359f0 con 0x7fb8e405baa0 2024-03-18T14:41:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.458+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb8d4033500 con 0x7fb8e405baa0 2024-03-18T14:41:27.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:27.586+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7fb8e4057a60 con 0x7fb8e405baa0 2024-03-18T14:41:28.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.314+0000 7fb8e17fa700 1 -- 172.21.15.57:0/341781035 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7fb8d40330f0 con 0x7fb8e405baa0 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 >> v1:172.21.15.57:6816/39496 conn(0x7fb8c4038da0 legacy=0x7fb8c403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 msgr2=0x7fb8e4134ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e4134ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fb8d400c000 tx=0x7fb8d4006df0).stop 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 shutdown_connections 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8e4132ed0 0x7fb8e412c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8e405baa0 0x7fb8e4134ac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 --2- 172.21.15.57:0/341781035 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8e4066fb0 0x7fb8e412bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.317+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 >> 172.21.15.57:0/341781035 conn(0x7fb8e4060aa0 msgr2=0x7fb8e412dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.318+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 shutdown_connections 2024-03-18T14:41:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.318+0000 7fb8ea485700 1 -- 172.21.15.57:0/341781035 wait complete. 2024-03-18T14:41:28.321 INFO:teuthology.orchestra.run.smithi057.stderr:set require_min_compat_client to octopus 2024-03-18T14:41:28.333 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:41:28.341 INFO:teuthology.task.print:**** done ceph 2024-03-18T14:41:28.341 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-18T14:41:28.365 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-18T14:41:28.365 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-03-18T14:41:28.365 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-18T14:41:28.365 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T14:41:28.365 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:28.366 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-18T14:41:28.366 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T14:41:28.366 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:28.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:28.366 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-03-18T14:41:28.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:28.389 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-03-18T14:41:28.463 INFO:teuthology.orchestra.run.smithi087.stderr:Cannot find device "ceph-brx" 2024-03-18T14:41:28.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:41:28.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:28.465 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-03-18T14:41:28.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:28.487 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-03-18T14:41:28.562 INFO:teuthology.orchestra.run.smithi129.stderr:Cannot find device "ceph-brx" 2024-03-18T14:41:28.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:41:28.564 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-18T14:41:28.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T14:41:28.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.681+0000 7f1ebf18c700 1 Processor -- start 2024-03-18T14:41:28.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.681+0000 7f1ebf18c700 1 -- start start 2024-03-18T14:41:28.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1eb81366f0 0x7f1eb809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 0x7f1eb8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 0x7f1eb8139530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb809a380 con 0x7f1eb81366f0 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8135fe0 con 0x7f1eb8099a00 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebf18c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8099e90 con 0x7f1eb809b520 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1eb81366f0 0x7f1eb809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1eb7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 0x7f1eb8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebd729700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 0x7f1eb8139530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1eb81366f0 0x7f1eb809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34978/0 (socket says 172.21.15.57:34978) 2024-03-18T14:41:28.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 -- 172.21.15.57:0/2174888966 learned_addr learned my addr 172.21.15.57:0/2174888966 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 -- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 msgr2=0x7f1eb8136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 0x7f1eb8136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 -- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 msgr2=0x7f1eb8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 0x7f1eb8139530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 -- 172.21.15.57:0/2174888966 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb809a0c0 con 0x7f1eb81366f0 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1eb7fff700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 0x7f1eb8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebd729700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 0x7f1eb8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1ebcf28700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81366f0 0x7f1eb809bbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1eac002f70 tx=0x7f1eac006eb0).ready entity=mon.0 client_cookie=b69b1d8228f317b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1eb77fe700 1 -- 172.21.15.57:0/2174888966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d570 con 0x7f1eb81366f0 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1eb77fe700 1 -- 172.21.15.57:0/2174888966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eac000e90 con 0x7f1eb81366f0 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.682+0000 7f1eb77fe700 1 -- 172.21.15.57:0/2174888966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eac00d900 con 0x7f1eb81366f0 2024-03-18T14:41:28.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 -- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81366f0 msgr2=0x7f1eb809bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81366f0 0x7f1eb809bbb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f1eac002f70 tx=0x7f1eac006eb0).stop 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 -- 172.21.15.57:0/2174888966 shutdown_connections 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb8099a00 0x7f1eb8139530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb81366f0 0x7f1eb809bbb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/2174888966 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb809b520 0x7f1eb8136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 -- 172.21.15.57:0/2174888966 >> 172.21.15.57:0/2174888966 conn(0x7f1eb806c0c0 msgr2=0x7f1eb806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 -- 172.21.15.57:0/2174888966 shutdown_connections 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.683+0000 7f1ebf18c700 1 -- 172.21.15.57:0/2174888966 wait complete. 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.684+0000 7f1ebf18c700 1 Processor -- start 2024-03-18T14:41:28.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.684+0000 7f1ebf18c700 1 -- start start 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb8099a00 0x7f1eb8097950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 0x7f1eb8130d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8149090 con 0x7f1eb809b520 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb8149350 con 0x7f1eb81366f0 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebf18c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb809ad70 con 0x7f1eb8099a00 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1eb7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 0x7f1eb8130d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebcf28700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb8099a00 0x7f1eb8097950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41322/0 (socket says 172.21.15.57:41322) 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 -- 172.21.15.57:0/3491887225 learned_addr learned my addr 172.21.15.57:0/3491887225 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:28.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1eb7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 0x7f1eb8130d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34988/0 (socket says 172.21.15.57:34988) 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 -- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb8099a00 msgr2=0x7f1eb8097950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb8099a00 0x7f1eb8097950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 -- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 msgr2=0x7f1eb8130d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 0x7f1eb8130d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 -- 172.21.15.57:0/3491887225 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb0009470 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.685+0000 7f1ebd729700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1eb000c000 tx=0x7f1eb00091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb000c850 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eb000c9b0 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea400b120 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eb000cd10 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac00b1e0 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.686+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1eb0022070 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.687+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb8097650 con 0x7f1eb81366f0 2024-03-18T14:41:28.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.687+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1eb004aff0 con 0x7f1eb81366f0 2024-03-18T14:41:28.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.690+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1eb0033900 con 0x7f1eb81366f0 2024-03-18T14:41:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.842+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1eb8067cb0 con 0x7f1eb81366f0 2024-03-18T14:41:28.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.843+0000 7f1eb5ffb700 1 -- 172.21.15.57:0/3491887225 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1eb00334f0 con 0x7f1eb81366f0 2024-03-18T14:41:28.845 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 >> v1:172.21.15.57:6816/39496 conn(0x7f1e98038e30 legacy=0x7f1e9803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 msgr2=0x7f1eb8131240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f1eb000c000 tx=0x7f1eb00091d0).stop 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 shutdown_connections 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1eb81366f0 0x7f1eb8131240 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1eb8099a00 0x7f1eb8097950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 --2- 172.21.15.57:0/3491887225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1eb809b520 0x7f1eb8130d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 >> 172.21.15.57:0/3491887225 conn(0x7f1eb806c0c0 msgr2=0x7f1eb80663e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 shutdown_connections 2024-03-18T14:41:28.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:28.844+0000 7f1ebf18c700 1 -- 172.21.15.57:0/3491887225 wait complete. 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi087.front.sepia.ceph.com 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:28.857 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T14:41:28.858 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T14:41:28.858 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T14:41:28.858 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T14:41:28.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:28.858 DEBUG:teuthology.orchestra.run.smithi087:> ip addr 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 ::1/128 scope host 2024-03-18T14:41:28.880 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fc brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f0 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:d8:da:fd brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: altname enp7s0f1 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f4 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: link/ether 0c:c4:7a:8f:d5:f5 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: inet 172.21.15.87/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft 42543sec preferred_lft 42543sec 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: inet6 fe80::ec4:7aff:fe8f:d5f5/64 scope link 2024-03-18T14:41:28.881 INFO:teuthology.orchestra.run.smithi087.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:28.882 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add name ceph-brx type bridge 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr flush dev ceph-brx 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set ceph-brx up 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T14:41:28.882 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-03-18T14:41:28.979 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:29.127 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:29.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:29.132 DEBUG:teuthology.orchestra.run.smithi087:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T14:41:29.159 INFO:teuthology.orchestra.run.smithi087.stdout:1 2024-03-18T14:41:29.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:29.161 DEBUG:teuthology.orchestra.run.smithi087:> route 2024-03-18T14:41:29.241 INFO:teuthology.orchestra.run.smithi087.stdout:Kernel IP routing table 2024-03-18T14:41:29.241 INFO:teuthology.orchestra.run.smithi087.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T14:41:29.241 INFO:teuthology.orchestra.run.smithi087.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T14:41:29.241 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T14:41:29.241 INFO:teuthology.orchestra.run.smithi087.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T14:41:29.242 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:29.242 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-03-18T14:41:29.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T14:41:29.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T14:41:29.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T14:41:29.243 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-03-18T14:41:29.330 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:29.587 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:29.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:29.593 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-03-18T14:41:29.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:29.610 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list-id 2024-03-18T14:41:29.668 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:29.668 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-03-18T14:41:29.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:41:29.668 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-18T14:41:29.668 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-03-18T14:41:29.757 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:29.794 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:29.799 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-18T14:41:29.799 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:29.799 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-03-18T14:41:29.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-18T14:41:29.799 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T14:41:29.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-18T14:41:29.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-18T14:41:29.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-18T14:41:29.800 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-03-18T14:41:29.849 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:30.033 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:30.039 DEBUG:teuthology.orchestra.run.smithi087:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:30.039 DEBUG:teuthology.orchestra.run.smithi087:> set -e 2024-03-18T14:41:30.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set brx.0 up 2024-03-18T14:41:30.039 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T14:41:30.039 DEBUG:teuthology.orchestra.run.smithi087:> ') 2024-03-18T14:41:30.089 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:30.168 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:30.173 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-18T14:41:30.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T14:41:30.173 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:30.191 INFO:teuthology.orchestra.run.smithi087.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-18T14:41:30.191 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T14:41:30.191 DEBUG:teuthology.orchestra.run.smithi087:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:30.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-03-18T14:41:30.315 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-03-18T14:41:30.373 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-03-18T14:41:30.373 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/systemd 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/devices 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/cpuset 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/blkio 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/freezer 2024-03-18T14:41:30.374 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/pids 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/rdma 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/memory 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/perf_event 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/hugetlb 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-03-18T14:41:30.375 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-03-18T14:41:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-03-18T14:41:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-03-18T14:41:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:41:30.376 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:41:30.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:30.376 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-03-18T14:41:30.431 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-18T14:41:30.431 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-18T14:41:30.473 DEBUG:teuthology.orchestra.run.smithi087:> sudo modprobe fuse 2024-03-18T14:41:30.499 DEBUG:teuthology.orchestra.run.smithi087:> cat /proc/self/mounts | awk '{print $2}' 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/proc 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/dev 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/security 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/shm 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/pts 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/run 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/systemd 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/pstore 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/bpf 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/devices 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/cpuset 2024-03-18T14:41:30.557 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/blkio 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/freezer 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/pids 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/rdma 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/memory 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/perf_event 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/cgroup/hugetlb 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/tracing 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/config 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/ 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/selinux 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/kernel/debug 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/mqueue 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/dev/hugepages 2024-03-18T14:41:30.558 INFO:teuthology.orchestra.run.smithi087.stdout:/proc/sys/fs/binfmt_misc 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/sys/fs/fuse/connections 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/nfs/rpc_pipefs 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/run/user/1000 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/var/lib/ceph 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run.smithi087.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:41:30.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:30.559 DEBUG:teuthology.orchestra.run.smithi087:> ls /sys/fs/fuse/connections 2024-03-18T14:41:30.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-03-18T14:41:30.601+0000 7f5ea264f200 -1 init, newargv = 0x55d254137100 newargc=9 2024-03-18T14:41:30.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37291]: starting ceph client 2024-03-18T14:41:30.611 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37291]: starting fuse 2024-03-18T14:41:30.616 INFO:teuthology.orchestra.run.smithi087.stdout:46 2024-03-18T14:41:30.616 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-03-18T14:41:30.616 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-03-18T14:41:30.617 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:41:30.618 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:41:30.618 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-03-18T14:41:30.618 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-03-18T14:41:30.738 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:41:30.741 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:41:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:30.748 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:41:30.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:30.748 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37291.asok status 2024-03-18T14:41:30.886 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "metadata": { 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "entity_id": "0", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "hostname": "smithi087", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "pid": "37291", 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "root": "/" 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_count": 0, 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "dentry_pinned_count": 0, 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4514, 2024-03-18T14:41:30.887 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4514 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2493486388 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-03-18T14:41:30.888 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2493486388 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4514 172.21.15.87:0/2493486388", 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "172.21.15.87:0/2493486388", 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "inode_count": 1, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "mds_epoch": 9, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch": 19, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "osd_epoch_barrier": 0, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "blacklisted": false, 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout: "fs_name": "cephfs" 2024-03-18T14:41:30.889 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-03-18T14:41:30.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T14:41:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.012+0000 7efe8ebe2700 1 Processor -- start 2024-03-18T14:41:31.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.012+0000 7efe8ebe2700 1 -- start start 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8ebe2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efe8805dfb0 0x7efe880a2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8ebe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe880a0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8ebe2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe880a1f10 con 0x7efe8809f5d0 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8ebe2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe880a0f60 con 0x7efe8805dfb0 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8ebe2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe880a1200 con 0x7efe880a04e0 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8c97e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efe8805dfb0 0x7efe880a2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8d17f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe880a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8c97e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efe8805dfb0 0x7efe880a2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35000/0 (socket says 172.21.15.57:35000) 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe8c97e700 1 -- 172.21.15.57:0/118237716 learned_addr learned my addr 172.21.15.57:0/118237716 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:31.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.013+0000 7efe87fff700 1 --1- 172.21.15.57:0/118237716 >> v1:172.21.15.57:6789/0 conn(0x7efe8809f5d0 0x7efe8809fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39220/0 (socket says 172.21.15.57:39220) 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8c97e700 1 -- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 msgr2=0x7efe880a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8c97e700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe880a0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8c97e700 1 -- 172.21.15.57:0/118237716 >> v1:172.21.15.57:6789/0 conn(0x7efe8809f5d0 legacy=0x7efe8809fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8c97e700 1 -- 172.21.15.57:0/118237716 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe88060520 con 0x7efe8805dfb0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe877fe700 1 -- 172.21.15.57:0/118237716 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938035359 0 0) 0x7efe880a1f10 con 0x7efe8809f5d0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8d17f700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe880a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8c97e700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe880a2780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efe7c002f70 tx=0x7efe7c006eb0).ready entity=mon.0 client_cookie=6de0a380369b7bf3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe877fe700 1 -- 172.21.15.57:0/118237716 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7c00d570 con 0x7efe8805dfb0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe877fe700 1 -- 172.21.15.57:0/118237716 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c000e90 con 0x7efe8805dfb0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe877fe700 1 -- 172.21.15.57:0/118237716 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe7c00d8c0 con 0x7efe8805dfb0 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 -- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 msgr2=0x7efe880a2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe880a2780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7efe7c002f70 tx=0x7efe7c006eb0).stop 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 -- 172.21.15.57:0/118237716 shutdown_connections 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe880a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/118237716 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe880a2780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.014+0000 7efe8ebe2700 1 -- 172.21.15.57:0/118237716 >> 172.21.15.57:0/118237716 conn(0x7efe880a93f0 msgr2=0x7efe880a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.015+0000 7efe8ebe2700 1 -- 172.21.15.57:0/118237716 shutdown_connections 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.015+0000 7efe8ebe2700 1 -- 172.21.15.57:0/118237716 wait complete. 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.015+0000 7efe8ebe2700 1 Processor -- start 2024-03-18T14:41:31.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.015+0000 7efe8ebe2700 1 -- start start 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe88063aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe8809f5d0 0x7efe88061640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe88061b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88064420 con 0x7efe8805dfb0 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe881347b0 con 0x7efe8809f5d0 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8ebe2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe88135220 con 0x7efe880a04e0 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8c97e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe88063aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8c97e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe88063aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35016/0 (socket says 172.21.15.57:35016) 2024-03-18T14:41:31.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8c97e700 1 -- 172.21.15.57:0/3732712084 learned_addr learned my addr 172.21.15.57:0/3732712084 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe8d17f700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe88061b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.016+0000 7efe87fff700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe8809f5d0 0x7efe88061640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 -- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe8809f5d0 msgr2=0x7efe88061640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe8809f5d0 0x7efe88061640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 -- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 msgr2=0x7efe88063aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe88063aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 -- 172.21.15.57:0/3732712084 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80009470 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8d17f700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe88061b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7efe880631f0 tx=0x7efe800091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8000c670 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8000c7d0 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe7c00b1e0 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe8000cb30 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.017+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe88062d20 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.018+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efe80022070 con 0x7efe880a04e0 2024-03-18T14:41:31.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.018+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe880a62d0 con 0x7efe880a04e0 2024-03-18T14:41:31.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.018+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efe8004ae50 con 0x7efe880a04e0 2024-03-18T14:41:31.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.021+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7efe80033780 con 0x7efe880a04e0 2024-03-18T14:41:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.170+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efe88065570 con 0x7efe880a04e0 2024-03-18T14:41:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.170+0000 7efe85ffb700 1 -- 172.21.15.57:0/3732712084 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+73 (secure 0 0 0) 0x7efe80016020 con 0x7efe880a04e0 2024-03-18T14:41:31.173 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 >> v1:172.21.15.57:6816/39496 conn(0x7efe68038e60 legacy=0x7efe6803b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 msgr2=0x7efe88061b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe88061b30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7efe880631f0 tx=0x7efe800091d0).stop 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 shutdown_connections 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efe880a04e0 0x7efe88061b30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efe8805dfb0 0x7efe88063aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 --2- 172.21.15.57:0/3732712084 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efe8809f5d0 0x7efe88061640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 >> 172.21.15.57:0/3732712084 conn(0x7efe880a93f0 msgr2=0x7efe8809d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 shutdown_connections 2024-03-18T14:41:31.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:41:31.172+0000 7efe8ebe2700 1 -- 172.21.15.57:0/3732712084 wait complete. 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi129.front.sepia.ceph.com 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T14:41:31.185 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-18T14:41:31.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:31.186 DEBUG:teuthology.orchestra.run.smithi129:> ip addr 2024-03-18T14:41:31.208 INFO:teuthology.orchestra.run.smithi129.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T14:41:31.208 INFO:teuthology.orchestra.run.smithi129.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T14:41:31.208 INFO:teuthology.orchestra.run.smithi129.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T14:41:31.208 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 ::1/128 scope host 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:38 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f0 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:d9:19:39 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: altname enp7s0f1 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:60 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: link/ether 0c:c4:7a:88:72:61 brd ff:ff:ff:ff:ff:ff 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: inet 172.21.15.129/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft 42534sec preferred_lft 42534sec 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: inet6 fe80::ec4:7aff:fe88:7261/64 scope link 2024-03-18T14:41:31.209 INFO:teuthology.orchestra.run.smithi129.stdout: valid_lft forever preferred_lft forever 2024-03-18T14:41:31.210 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add name ceph-brx type bridge 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr flush dev ceph-brx 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set ceph-brx up 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T14:41:31.210 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-03-18T14:41:31.306 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:31.419 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:31.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:31.426 DEBUG:teuthology.orchestra.run.smithi129:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T14:41:31.453 INFO:teuthology.orchestra.run.smithi129.stdout:1 2024-03-18T14:41:31.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:31.455 DEBUG:teuthology.orchestra.run.smithi129:> route 2024-03-18T14:41:31.526 INFO:teuthology.orchestra.run.smithi129.stdout:Kernel IP routing table 2024-03-18T14:41:31.526 INFO:teuthology.orchestra.run.smithi129.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T14:41:31.526 INFO:teuthology.orchestra.run.smithi129.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T14:41:31.527 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T14:41:31.527 INFO:teuthology.orchestra.run.smithi129.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T14:41:31.527 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-03-18T14:41:31.616 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:31.849 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:31.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:31.854 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-03-18T14:41:31.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:31.872 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list-id 2024-03-18T14:41:31.929 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:31.929 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-03-18T14:41:31.929 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:41:31.929 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-18T14:41:31.929 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-03-18T14:41:32.018 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:32.055 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:32.061 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-18T14:41:32.061 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-03-18T14:41:32.110 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:32.295 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:32.300 DEBUG:teuthology.orchestra.run.smithi129:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T14:41:32.300 DEBUG:teuthology.orchestra.run.smithi129:> set -e 2024-03-18T14:41:32.300 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set brx.0 up 2024-03-18T14:41:32.300 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T14:41:32.300 DEBUG:teuthology.orchestra.run.smithi129:> ') 2024-03-18T14:41:32.350 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T14:41:32.429 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:32.434 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-18T14:41:32.434 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T14:41:32.434 DEBUG:teuthology.orchestra.run.smithi129:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:32.452 INFO:teuthology.orchestra.run.smithi129.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-18T14:41:32.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T14:41:32.452 DEBUG:teuthology.orchestra.run.smithi129:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:32.509 DEBUG:teuthology.orchestra.run.smithi129:> sudo modprobe fuse 2024-03-18T14:41:32.576 DEBUG:teuthology.orchestra.run.smithi129:> cat /proc/self/mounts | awk '{print $2}' 2024-03-18T14:41:32.634 INFO:teuthology.orchestra.run.smithi129.stdout:/sys 2024-03-18T14:41:32.634 INFO:teuthology.orchestra.run.smithi129.stdout:/proc 2024-03-18T14:41:32.634 INFO:teuthology.orchestra.run.smithi129.stdout:/dev 2024-03-18T14:41:32.634 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/security 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/shm 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/pts 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/run 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/systemd 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/pstore 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/bpf 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/perf_event 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/devices 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/memory 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/cpuset 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/blkio 2024-03-18T14:41:32.635 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/pids 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/rdma 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/freezer 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/hugetlb 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/tracing 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/config 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/ 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/selinux 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/proc/sys/fs/binfmt_misc 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/debug 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/mqueue 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/hugepages 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/fuse/connections 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/var/lib/nfs/rpc_pipefs 2024-03-18T14:41:32.636 INFO:teuthology.orchestra.run.smithi129.stdout:/run/user/1000 2024-03-18T14:41:32.637 INFO:teuthology.orchestra.run.smithi129.stdout:/var/lib/ceph 2024-03-18T14:41:32.637 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns 2024-03-18T14:41:32.637 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:41:32.637 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:41:32.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:32.637 DEBUG:teuthology.orchestra.run.smithi129:> ls /sys/fs/fuse/connections 2024-03-18T14:41:32.691 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-18T14:41:32.691 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-18T14:41:32.733 DEBUG:teuthology.orchestra.run.smithi129:> sudo modprobe fuse 2024-03-18T14:41:32.759 DEBUG:teuthology.orchestra.run.smithi129:> cat /proc/self/mounts | awk '{print $2}' 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/proc 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/dev 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/security 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/shm 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/pts 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/run 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/systemd 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/pstore 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/bpf 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/perf_event 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/devices 2024-03-18T14:41:32.817 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/memory 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/cpuset 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/blkio 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/pids 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/rdma 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/freezer 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/cgroup/hugetlb 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/tracing 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/config 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/ 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/selinux 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/proc/sys/fs/binfmt_misc 2024-03-18T14:41:32.818 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/kernel/debug 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/mqueue 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/dev/hugepages 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/sys/fs/fuse/connections 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/var/lib/nfs/rpc_pipefs 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/run/user/1000 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/var/lib/ceph 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run.smithi129.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:41:32.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:32.819 DEBUG:teuthology.orchestra.run.smithi129:> ls /sys/fs/fuse/connections 2024-03-18T14:41:32.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi129.stderr:2024-03-18T14:41:32.849+0000 7f68291e8200 -1 init, newargv = 0x5642f8d82fc0 newargc=9 2024-03-18T14:41:32.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi129.stderr:ceph-fuse[37344]: starting ceph client 2024-03-18T14:41:32.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi129.stderr:ceph-fuse[37344]: starting fuse 2024-03-18T14:41:32.869 INFO:teuthology.orchestra.run.smithi129.stdout:46 2024-03-18T14:41:32.870 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> import glob 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> import re 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> import os 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> import subprocess 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> def _find_admin_socket(client_name): 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> files = glob.glob(asok_path) 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-18T14:41:32.870 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> # Given a non-glob path, it better be there 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> if "*" not in asok_path: 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> assert(len(files) == 1) 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> return files[0] 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> for f in files: 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> contents = proc_f.read() 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> if mountpoint in contents: 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> return f 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> print(_find_admin_socket("client.1")) 2024-03-18T14:41:32.871 DEBUG:teuthology.orchestra.run.smithi129:> ' 2024-03-18T14:41:32.991 INFO:teuthology.orchestra.run.smithi129.stdout:/var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:41:32.994 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:41:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:41:33.000 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:41:33.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:33.000 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37344.asok status 2024-03-18T14:41:33.138 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-03-18T14:41:33.138 INFO:teuthology.orchestra.run.smithi129.stdout: "metadata": { 2024-03-18T14:41:33.138 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "entity_id": "1", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "hostname": "smithi129", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "pid": "37344", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "root": "/" 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "dentry_count": 0, 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "dentry_pinned_count": 0, 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4555, 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "inst": { 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "name": { 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "client", 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: "num": 4555 2024-03-18T14:41:33.139 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": { 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:0", 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 1814197221 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": { 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:0", 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 1814197221 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "inst_str": "client.4555 172.21.15.129:0/1814197221", 2024-03-18T14:41:33.140 INFO:teuthology.orchestra.run.smithi129.stdout: "addr_str": "172.21.15.129:0/1814197221", 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "inode_count": 1, 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "mds_epoch": 9, 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_epoch": 19, 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "osd_epoch_barrier": 0, 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "blacklisted": false, 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout: "fs_name": "cephfs" 2024-03-18T14:41:33.141 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-03-18T14:41:33.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:33.147 DEBUG:teuthology.orchestra.run.smithi087:> stat --file-system '--printf=%T 2024-03-18T14:41:33.147 DEBUG:teuthology.orchestra.run.smithi087:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:33.170 INFO:teuthology.orchestra.run.smithi087.stdout:fuseblk 2024-03-18T14:41:33.170 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:33.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:33.170 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:33.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:33.243 DEBUG:teuthology.orchestra.run.smithi129:> stat --file-system '--printf=%T 2024-03-18T14:41:33.243 DEBUG:teuthology.orchestra.run.smithi129:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:33.262 INFO:teuthology.orchestra.run.smithi129.stdout:fuseblk 2024-03-18T14:41:33.262 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:33.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:41:33.262 DEBUG:teuthology.orchestra.run.smithi129:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:34.656 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:41:34.665 INFO:teuthology.task.print:**** done octopus client 2024-03-18T14:41:34.665 INFO:teuthology.run_tasks:Running task workunit... 2024-03-18T14:41:34.682 INFO:tasks.workunit:Pulling workunits from ref 4e19f704afd9957ea657ab858f9ecf76401fef6f 2024-03-18T14:41:34.683 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-18T14:41:34.683 INFO:tasks.workunit:timeout=3h 2024-03-18T14:41:34.683 INFO:tasks.workunit:cleanup=True 2024-03-18T14:41:34.683 DEBUG:teuthology.orchestra.run.smithi087:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 2eh/46d Inode: 1 Links: 2 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-18T14:41:34.708 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2024-03-18 14:41:13.459937725 +0000 2024-03-18T14:41:34.709 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2024-03-18 14:41:34.651002731 +0000 2024-03-18T14:41:34.709 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2024-03-18T14:41:34.709 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-18T14:41:34.709 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-18T14:41:34.785 DEBUG:teuthology.orchestra.run.smithi129:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:34.808 INFO:teuthology.orchestra.run.smithi129.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Device: 2eh/46d Inode: 1 Links: 3 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Modify: 2024-03-18 14:41:34.777804387 +0000 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout:Change: 2024-03-18 14:41:34.777804387 +0000 2024-03-18T14:41:34.809 INFO:teuthology.orchestra.run.smithi129.stdout: Birth: - 2024-03-18T14:41:34.809 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-18T14:41:34.809 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-18T14:41:34.886 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4e19f704afd9957ea657ab858f9ecf76401fef6f 2024-03-18T14:41:34.887 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/batrick/ceph /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 4e19f704afd9957ea657ab858f9ecf76401fef6f 2024-03-18T14:41:34.907 INFO:tasks.workunit.client.0.smithi087.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-18T14:41:34.947 INFO:tasks.workunit.client.1.smithi129.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-18T14:42:22.163 INFO:tasks.workunit.client.0.smithi087.stderr:Note: switching to '4e19f704afd9957ea657ab858f9ecf76401fef6f'. 2024-03-18T14:42:22.163 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.163 INFO:tasks.workunit.client.0.smithi087.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-18T14:42:22.163 INFO:tasks.workunit.client.0.smithi087.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:state without impacting any branches by switching back to a branch. 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: git switch -c 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:Or undo this operation with: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: git switch - 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr: 2024-03-18T14:42:22.164 INFO:tasks.workunit.client.0.smithi087.stderr:HEAD is now at 4e19f704afd ignorelist mon down 2024-03-18T14:42:22.167 DEBUG:teuthology.orchestra.run.smithi087:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-18T14:42:22.236 INFO:tasks.workunit.client.0.smithi087.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-18T14:42:22.238 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-18T14:42:22.238 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-18T14:42:22.813 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-18T14:42:22.872 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-18T14:42:22.909 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-18T14:42:22.911 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-18T14:42:22.911 INFO:tasks.workunit.client.0.smithi087.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-18T14:42:22.947 INFO:tasks.workunit.client.0.smithi087.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-18T14:42:22.951 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:42:22.951 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-18T14:42:23.009 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-18T14:42:23.010 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-18T14:42:23.010 DEBUG:teuthology.orchestra.run.smithi087:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e19f704afd9957ea657ab858f9ecf76401fef6f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-18T14:42:23.080 INFO:tasks.workunit.client.0.smithi087.stderr:+ mkdir -p fsstress 2024-03-18T14:42:23.083 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd fsstress 2024-03-18T14:42:23.084 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-18T14:42:23.084 INFO:tasks.workunit.client.0.smithi087.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-18T14:42:25.265 INFO:tasks.workunit.client.0.smithi087.stderr:+ tar xzf ltp-full.tgz 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr:Note: switching to '4e19f704afd9957ea657ab858f9ecf76401fef6f'. 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr:state without impacting any branches by switching back to a branch. 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.488 INFO:tasks.workunit.client.1.smithi129.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: git switch -c 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr:Or undo this operation with: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: git switch - 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr: 2024-03-18T14:42:25.489 INFO:tasks.workunit.client.1.smithi129.stderr:HEAD is now at 4e19f704afd ignorelist mon down 2024-03-18T14:42:25.492 DEBUG:teuthology.orchestra.run.smithi129:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-18T14:42:25.563 INFO:tasks.workunit.client.1.smithi129.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-18T14:42:25.565 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-18T14:42:25.565 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-18T14:42:26.147 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-18T14:42:26.203 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-18T14:42:26.241 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-18T14:42:26.243 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-18T14:42:26.243 INFO:tasks.workunit.client.1.smithi129.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-18T14:42:26.279 INFO:tasks.workunit.client.1.smithi129.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-18T14:42:26.283 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:42:26.283 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-18T14:42:26.341 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-03-18T14:42:26.342 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-18T14:42:26.342 DEBUG:teuthology.orchestra.run.smithi129:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4e19f704afd9957ea657ab858f9ecf76401fef6f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-03-18T14:42:26.421 INFO:tasks.workunit.client.1.smithi129.stderr:+ mkdir -p fsstress 2024-03-18T14:42:26.424 INFO:tasks.workunit.client.1.smithi129.stderr:+ pushd fsstress 2024-03-18T14:42:26.425 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-18T14:42:26.425 INFO:tasks.workunit.client.1.smithi129.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-18T14:42:27.049 INFO:tasks.workunit.client.1.smithi129.stderr:+ tar xzf ltp-full.tgz 2024-03-18T14:43:06.075 INFO:tasks.workunit.client.0.smithi087.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-18T14:43:06.079 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-18T14:43:06.079 INFO:tasks.workunit.client.0.smithi087.stderr:+ make 2024-03-18T14:43:06.347 INFO:tasks.workunit.client.0.smithi087.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-18T14:43:06.787 INFO:tasks.workunit.client.0.smithi087.stderr:++ readlink -f fsstress 2024-03-18T14:43:06.788 INFO:tasks.workunit.client.0.smithi087.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-18T14:43:06.788 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-03-18T14:43:06.789 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-18T14:43:06.789 INFO:tasks.workunit.client.0.smithi087.stderr:+ popd 2024-03-18T14:43:06.790 INFO:tasks.workunit.client.0.smithi087.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-18T14:43:06.790 INFO:tasks.workunit.client.0.smithi087.stderr:++ mktemp -d -p . 2024-03-18T14:43:06.792 INFO:tasks.workunit.client.0.smithi087.stderr:+ T=./tmp.gXbGEdU7ly 2024-03-18T14:43:06.792 INFO:tasks.workunit.client.0.smithi087.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gXbGEdU7ly -l 1 -n 1000 -p 10 -v 2024-03-18T14:43:06.795 INFO:tasks.workunit.client.0.smithi087.stdout:seed = 1710518838 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/0: dwrite - no filename 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/1: write - no filename 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/2: read - no filename 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/3: link - no file 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:0/0: mkdir d0 0 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/4: symlink l0 0 2024-03-18T14:43:06.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/5: dread - no filename 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/6: dwrite - no filename 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/7: rmdir - no directory 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/8: write - no filename 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/9: write - no filename 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:1/10: fsync - no filename 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:0/1: mknod d0/c1 0 2024-03-18T14:43:06.804 INFO:tasks.workunit.client.0.smithi087.stdout:0/2: write - no filename 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/11: mknod c1 0 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/12: chown l0 22642675 1 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/13: read - no filename 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/14: dwrite - no filename 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/15: dwrite - no filename 2024-03-18T14:43:06.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/16: rmdir - no directory 2024-03-18T14:43:06.806 INFO:tasks.workunit.client.0.smithi087.stdout:0/3: mkdir d0/d2 0 2024-03-18T14:43:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/0: creat f0 x:0 0 0 2024-03-18T14:43:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/1: dread - f0 zero size 2024-03-18T14:43:06.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/2: fdatasync f0 0 2024-03-18T14:43:06.808 INFO:tasks.workunit.client.0.smithi087.stdout:1/17: mknod c2 0 2024-03-18T14:43:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:0/4: creat d0/f3 x:0 0 0 2024-03-18T14:43:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:3/0: mkdir d0 0 2024-03-18T14:43:06.810 INFO:tasks.workunit.client.0.smithi087.stdout:3/1: truncate - no filename 2024-03-18T14:43:06.811 INFO:tasks.workunit.client.0.smithi087.stdout:2/3: creat f1 x:0 0 0 2024-03-18T14:43:06.811 INFO:tasks.workunit.client.0.smithi087.stdout:2/4: fdatasync f1 0 2024-03-18T14:43:06.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/18: mkdir d3 0 2024-03-18T14:43:06.813 INFO:tasks.workunit.client.0.smithi087.stdout:4/0: symlink l0 0 2024-03-18T14:43:06.813 INFO:tasks.workunit.client.0.smithi087.stdout:4/1: dwrite - no filename 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/0: dread - no filename 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/1: stat - no entries 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/2: write - no filename 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/3: dwrite - no filename 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/2: creat d0/f1 x:0 0 0 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/3: dread - d0/f1 zero size 2024-03-18T14:43:06.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/4: stat d0 0 2024-03-18T14:43:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:4/2: creat f1 x:0 0 0 2024-03-18T14:43:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:5/0: mkdir d0 0 2024-03-18T14:43:06.817 INFO:tasks.workunit.client.0.smithi087.stdout:5/1: dwrite - no filename 2024-03-18T14:43:06.819 INFO:tasks.workunit.client.0.smithi087.stdout:1/19: symlink d3/l4 0 2024-03-18T14:43:06.820 INFO:tasks.workunit.client.0.smithi087.stdout:6/4: mknod c0 0 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:8/0: truncate - no filename 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:8/1: write - no filename 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:8/2: dwrite - no filename 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:5/2: mknod d0/c1 0 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:5/3: dwrite - no filename 2024-03-18T14:43:06.822 INFO:tasks.workunit.client.0.smithi087.stdout:5/4: dwrite - no filename 2024-03-18T14:43:06.823 INFO:tasks.workunit.client.0.smithi087.stdout:1/20: symlink d3/l5 0 2024-03-18T14:43:06.823 INFO:tasks.workunit.client.0.smithi087.stdout:1/21: dread - no filename 2024-03-18T14:43:06.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/5: creat f1 x:0 0 0 2024-03-18T14:43:06.825 INFO:tasks.workunit.client.0.smithi087.stdout:7/0: creat f0 x:0 0 0 2024-03-18T14:43:06.825 INFO:tasks.workunit.client.0.smithi087.stdout:7/1: readlink - no filename 2024-03-18T14:43:06.825 INFO:tasks.workunit.client.0.smithi087.stdout:7/2: dread - f0 zero size 2024-03-18T14:43:06.827 INFO:tasks.workunit.client.0.smithi087.stdout:3/5: truncate d0/f1 308261 0 2024-03-18T14:43:06.827 INFO:tasks.workunit.client.0.smithi087.stdout:3/6: chown d0 143254 1 2024-03-18T14:43:06.828 INFO:tasks.workunit.client.0.smithi087.stdout:5/5: unlink d0/c1 0 2024-03-18T14:43:06.829 INFO:tasks.workunit.client.0.smithi087.stdout:7/3: mkdir d1 0 2024-03-18T14:43:06.830 INFO:tasks.workunit.client.0.smithi087.stdout:8/3: getdents . 0 2024-03-18T14:43:06.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/7: creat d0/f2 x:0 0 0 2024-03-18T14:43:06.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/0: symlink l0 0 2024-03-18T14:43:06.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/1: dwrite - no filename 2024-03-18T14:43:06.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/2: fdatasync - no filename 2024-03-18T14:43:06.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/22: link l0 d3/l6 0 2024-03-18T14:43:06.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/23: read - no filename 2024-03-18T14:43:06.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/24: fdatasync - no filename 2024-03-18T14:43:06.835 INFO:tasks.workunit.client.0.smithi087.stdout:6/6: link c0 c2 0 2024-03-18T14:43:06.836 INFO:tasks.workunit.client.0.smithi087.stdout:6/7: read - f1 zero size 2024-03-18T14:43:06.836 INFO:tasks.workunit.client.0.smithi087.stdout:8/4: creat f0 x:0 0 0 2024-03-18T14:43:06.837 INFO:tasks.workunit.client.0.smithi087.stdout:7/4: dwrite f0 [0,4194304] 0 2024-03-18T14:43:06.838 INFO:tasks.workunit.client.0.smithi087.stdout:9/3: creat f1 x:0 0 0 2024-03-18T14:43:06.838 INFO:tasks.workunit.client.0.smithi087.stdout:8/5: chown f0 2000 1 2024-03-18T14:43:06.839 INFO:tasks.workunit.client.0.smithi087.stdout:1/25: creat d3/f7 x:0 0 0 2024-03-18T14:43:06.841 INFO:tasks.workunit.client.0.smithi087.stdout:9/4: write f1 [424845,129419] 0 2024-03-18T14:43:06.841 INFO:tasks.workunit.client.0.smithi087.stdout:7/5: getdents d1 0 2024-03-18T14:43:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:7/6: rename d1 to d1/d2 22 2024-03-18T14:43:06.843 INFO:tasks.workunit.client.0.smithi087.stdout:3/8: dwrite d0/f2 [0,4194304] 0 2024-03-18T14:43:06.844 INFO:tasks.workunit.client.0.smithi087.stdout:9/5: chown f1 2558436 1 2024-03-18T14:43:06.852 INFO:tasks.workunit.client.0.smithi087.stdout:6/8: dwrite f1 [0,4194304] 0 2024-03-18T14:43:06.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/6: dwrite f0 [0,4194304] 0 2024-03-18T14:43:06.855 INFO:tasks.workunit.client.0.smithi087.stdout:1/26: dwrite d3/f7 [0,4194304] 0 2024-03-18T14:43:06.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/7: dread f0 [0,4194304] 0 2024-03-18T14:43:06.858 INFO:tasks.workunit.client.0.smithi087.stdout:1/27: dread d3/f7 [0,4194304] 0 2024-03-18T14:43:06.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/8: read f0 [2210094,45158] 0 2024-03-18T14:43:06.861 INFO:tasks.workunit.client.0.smithi087.stdout:3/9: mkdir d0/d3 0 2024-03-18T14:43:06.864 INFO:tasks.workunit.client.0.smithi087.stdout:1/28: dwrite d3/f7 [0,4194304] 0 2024-03-18T14:43:06.868 INFO:tasks.workunit.client.0.smithi087.stdout:9/6: mknod c2 0 2024-03-18T14:43:06.872 INFO:tasks.workunit.client.0.smithi087.stdout:9/7: dread f1 [0,4194304] 0 2024-03-18T14:43:06.876 INFO:tasks.workunit.client.0.smithi087.stdout:6/9: mkdir d3 0 2024-03-18T14:43:06.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/9: mkdir d1 0 2024-03-18T14:43:06.879 INFO:tasks.workunit.client.0.smithi087.stdout:3/10: mknod d0/c4 0 2024-03-18T14:43:06.880 INFO:tasks.workunit.client.0.smithi087.stdout:1/29: creat d3/f8 x:0 0 0 2024-03-18T14:43:06.882 INFO:tasks.workunit.client.0.smithi087.stdout:8/10: dread f0 [0,4194304] 0 2024-03-18T14:43:06.932 INFO:tasks.workunit.client.0.smithi087.stdout:7/7: write f0 [4404855,84850] 0 2024-03-18T14:43:06.933 INFO:tasks.workunit.client.0.smithi087.stdout:7/8: read f0 [2323929,74505] 0 2024-03-18T14:43:06.933 INFO:tasks.workunit.client.0.smithi087.stdout:5/6: getdents d0 0 2024-03-18T14:43:06.934 INFO:tasks.workunit.client.0.smithi087.stdout:7/9: fdatasync f0 0 2024-03-18T14:43:06.937 INFO:tasks.workunit.client.0.smithi087.stdout:7/10: dread f0 [0,4194304] 0 2024-03-18T14:43:06.940 INFO:tasks.workunit.client.0.smithi087.stdout:1/30: mknod d3/c9 0 2024-03-18T14:43:06.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/10: unlink c0 0 2024-03-18T14:43:06.944 INFO:tasks.workunit.client.0.smithi087.stdout:3/11: creat d0/d3/f5 x:0 0 0 2024-03-18T14:43:06.945 INFO:tasks.workunit.client.0.smithi087.stdout:1/31: dwrite d3/f8 [0,4194304] 0 2024-03-18T14:43:06.946 INFO:tasks.workunit.client.0.smithi087.stdout:3/12: chown d0/f2 71450 1 2024-03-18T14:43:06.947 INFO:tasks.workunit.client.0.smithi087.stdout:1/32: write d3/f8 [3987686,29448] 0 2024-03-18T14:43:06.947 INFO:tasks.workunit.client.0.smithi087.stdout:8/11: rename f0 to d1/f2 0 2024-03-18T14:43:06.947 INFO:tasks.workunit.client.0.smithi087.stdout:9/8: truncate f1 263481 0 2024-03-18T14:43:06.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/13: chown d0/d3/f5 1540335 1 2024-03-18T14:43:06.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/11: creat d1/f3 x:0 0 0 2024-03-18T14:43:06.950 INFO:tasks.workunit.client.0.smithi087.stdout:6/11: dwrite f1 [0,4194304] 0 2024-03-18T14:43:06.951 INFO:tasks.workunit.client.0.smithi087.stdout:7/12: dread - d1/f3 zero size 2024-03-18T14:43:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/7: rmdir d0 0 2024-03-18T14:43:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/8: dread - no filename 2024-03-18T14:43:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/9: dread - no filename 2024-03-18T14:43:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:1/33: dread d3/f7 [0,4194304] 0 2024-03-18T14:43:06.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/10: chown . 6 1 2024-03-18T14:43:06.953 INFO:tasks.workunit.client.0.smithi087.stdout:5/11: dread - no filename 2024-03-18T14:43:06.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/9: creat f3 x:0 0 0 2024-03-18T14:43:06.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/10: readlink l0 0 2024-03-18T14:43:06.962 INFO:tasks.workunit.client.0.smithi087.stdout:8/12: mkdir d1/d3 0 2024-03-18T14:43:06.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/14: creat d0/d3/f6 x:0 0 0 2024-03-18T14:43:06.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/15: readlink - no filename 2024-03-18T14:43:06.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/16: dread - d0/d3/f5 zero size 2024-03-18T14:43:06.965 INFO:tasks.workunit.client.0.smithi087.stdout:5/12: symlink l2 0 2024-03-18T14:43:06.965 INFO:tasks.workunit.client.0.smithi087.stdout:5/13: write - no filename 2024-03-18T14:43:06.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/13: dread f0 [0,4194304] 0 2024-03-18T14:43:06.966 INFO:tasks.workunit.client.0.smithi087.stdout:9/11: mknod c4 0 2024-03-18T14:43:06.967 INFO:tasks.workunit.client.0.smithi087.stdout:9/12: chown c4 511598492 1 2024-03-18T14:43:06.971 INFO:tasks.workunit.client.0.smithi087.stdout:3/17: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:06.973 INFO:tasks.workunit.client.0.smithi087.stdout:7/14: symlink d1/l4 0 2024-03-18T14:43:06.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/13: creat d1/d3/f4 x:0 0 0 2024-03-18T14:43:06.975 INFO:tasks.workunit.client.0.smithi087.stdout:8/14: chown d1 14842 1 2024-03-18T14:43:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:1/34: truncate d3/f7 748681 0 2024-03-18T14:43:06.977 INFO:tasks.workunit.client.0.smithi087.stdout:9/13: mknod c5 0 2024-03-18T14:43:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:3/18: rename d0/d3/f5 to d0/d3/f7 0 2024-03-18T14:43:06.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/15: symlink d1/l5 0 2024-03-18T14:43:06.980 INFO:tasks.workunit.client.0.smithi087.stdout:8/15: creat d1/f5 x:0 0 0 2024-03-18T14:43:06.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/16: mkdir d1/d6 0 2024-03-18T14:43:06.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/17: chown d1/d6 47556 1 2024-03-18T14:43:06.987 INFO:tasks.workunit.client.0.smithi087.stdout:3/19: rmdir d0 39 2024-03-18T14:43:06.987 INFO:tasks.workunit.client.0.smithi087.stdout:3/20: readlink - no filename 2024-03-18T14:43:06.990 INFO:tasks.workunit.client.0.smithi087.stdout:5/14: getdents . 0 2024-03-18T14:43:06.990 INFO:tasks.workunit.client.0.smithi087.stdout:5/15: truncate - no filename 2024-03-18T14:43:06.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/21: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:06.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/22: dread - d0/d3/f7 zero size 2024-03-18T14:43:06.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/16: unlink d1/d3/f4 0 2024-03-18T14:43:06.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/16: mknod c3 0 2024-03-18T14:43:06.995 INFO:tasks.workunit.client.0.smithi087.stdout:5/17: read - no filename 2024-03-18T14:43:06.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/18: dwrite f0 [0,4194304] 0 2024-03-18T14:43:06.998 INFO:tasks.workunit.client.0.smithi087.stdout:9/14: getdents . 0 2024-03-18T14:43:06.999 INFO:tasks.workunit.client.0.smithi087.stdout:7/19: stat d1/d6 0 2024-03-18T14:43:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:3/23: dwrite d0/d3/f6 [0,4194304] 0 2024-03-18T14:43:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:1/35: read d3/f7 [236954,83811] 0 2024-03-18T14:43:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:5/18: symlink l4 0 2024-03-18T14:43:07.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/15: dread f1 [0,4194304] 0 2024-03-18T14:43:07.001 INFO:tasks.workunit.client.0.smithi087.stdout:3/24: stat d0/d3/f6 0 2024-03-18T14:43:07.002 INFO:tasks.workunit.client.0.smithi087.stdout:8/17: truncate d1/f5 885448 0 2024-03-18T14:43:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:9/16: mknod c6 0 2024-03-18T14:43:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:9/17: write f3 [383564,125389] 0 2024-03-18T14:43:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:7/20: dwrite d1/f3 [0,4194304] 0 2024-03-18T14:43:07.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/36: creat d3/fa x:0 0 0 2024-03-18T14:43:07.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/37: chown d3/c9 57 1 2024-03-18T14:43:07.007 INFO:tasks.workunit.client.0.smithi087.stdout:3/25: symlink d0/l8 0 2024-03-18T14:43:07.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/38: write d3/f8 [3469547,82382] 0 2024-03-18T14:43:07.008 INFO:tasks.workunit.client.0.smithi087.stdout:1/39: chown d3/l5 30 1 2024-03-18T14:43:07.008 INFO:tasks.workunit.client.0.smithi087.stdout:1/40: stat d3/f7 0 2024-03-18T14:43:07.013 INFO:tasks.workunit.client.0.smithi087.stdout:1/41: dwrite d3/fa [0,4194304] 0 2024-03-18T14:43:07.015 INFO:tasks.workunit.client.0.smithi087.stdout:3/26: rmdir d0 39 2024-03-18T14:43:07.017 INFO:tasks.workunit.client.0.smithi087.stdout:7/21: creat d1/d6/f7 x:0 0 0 2024-03-18T14:43:07.018 INFO:tasks.workunit.client.0.smithi087.stdout:7/22: chown d1 77733090 1 2024-03-18T14:43:07.018 INFO:tasks.workunit.client.0.smithi087.stdout:7/23: write f0 [143686,127348] 0 2024-03-18T14:43:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/42: rename c2 to d3/cb 0 2024-03-18T14:43:07.020 INFO:tasks.workunit.client.0.smithi087.stdout:1/43: write d3/f8 [686468,102774] 0 2024-03-18T14:43:07.021 INFO:tasks.workunit.client.0.smithi087.stdout:1/44: chown c1 346865 1 2024-03-18T14:43:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/19: getdents . 0 2024-03-18T14:43:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/20: truncate - no filename 2024-03-18T14:43:07.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/21: write - no filename 2024-03-18T14:43:07.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/45: dread d3/fa [0,4194304] 0 2024-03-18T14:43:07.025 INFO:tasks.workunit.client.0.smithi087.stdout:3/27: symlink d0/d3/l9 0 2024-03-18T14:43:07.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/28: chown d0/f1 81 1 2024-03-18T14:43:07.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/22: rename c3 to c5 0 2024-03-18T14:43:07.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/23: fsync - no filename 2024-03-18T14:43:07.029 INFO:tasks.workunit.client.0.smithi087.stdout:5/24: readlink l2 0 2024-03-18T14:43:07.030 INFO:tasks.workunit.client.0.smithi087.stdout:9/18: fsync f3 0 2024-03-18T14:43:07.032 INFO:tasks.workunit.client.0.smithi087.stdout:3/29: fsync d0/f1 0 2024-03-18T14:43:07.032 INFO:tasks.workunit.client.0.smithi087.stdout:3/30: chown d0/f1 21 1 2024-03-18T14:43:07.033 INFO:tasks.workunit.client.0.smithi087.stdout:9/19: creat f7 x:0 0 0 2024-03-18T14:43:07.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/31: rename d0/c4 to d0/ca 0 2024-03-18T14:43:07.038 INFO:tasks.workunit.client.0.smithi087.stdout:9/20: unlink c2 0 2024-03-18T14:43:07.039 INFO:tasks.workunit.client.0.smithi087.stdout:8/18: fsync d1/f5 0 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/25: link l4 l6 0 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/26: write - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/27: read - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/28: dwrite - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/29: dread - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/30: truncate - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/31: rmdir - no directory 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/32: dread - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/33: dread - no filename 2024-03-18T14:43:07.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/34: truncate - no filename 2024-03-18T14:43:07.042 INFO:tasks.workunit.client.0.smithi087.stdout:3/32: dwrite d0/d3/f6 [4194304,4194304] 0 2024-03-18T14:43:07.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/46: write d3/f7 [1348860,47953] 0 2024-03-18T14:43:07.047 INFO:tasks.workunit.client.0.smithi087.stdout:7/24: rmdir d1 39 2024-03-18T14:43:07.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/47: fdatasync d3/f8 0 2024-03-18T14:43:07.049 INFO:tasks.workunit.client.0.smithi087.stdout:9/21: creat f8 x:0 0 0 2024-03-18T14:43:07.049 INFO:tasks.workunit.client.0.smithi087.stdout:9/22: chown c4 1397054 1 2024-03-18T14:43:07.053 INFO:tasks.workunit.client.0.smithi087.stdout:3/33: rmdir d0/d3 39 2024-03-18T14:43:07.054 INFO:tasks.workunit.client.0.smithi087.stdout:9/23: dwrite f7 [0,4194304] 0 2024-03-18T14:43:07.059 INFO:tasks.workunit.client.0.smithi087.stdout:9/24: dwrite f7 [0,4194304] 0 2024-03-18T14:43:07.059 INFO:tasks.workunit.client.0.smithi087.stdout:9/25: read - f8 zero size 2024-03-18T14:43:07.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/48: rename d3/fa to d3/fc 0 2024-03-18T14:43:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/49: fsync d3/f8 0 2024-03-18T14:43:07.062 INFO:tasks.workunit.client.0.smithi087.stdout:9/26: dread f7 [0,4194304] 0 2024-03-18T14:43:07.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/27: write f7 [3839430,18092] 0 2024-03-18T14:43:07.064 INFO:tasks.workunit.client.0.smithi087.stdout:9/28: write f7 [602564,62597] 0 2024-03-18T14:43:07.065 INFO:tasks.workunit.client.0.smithi087.stdout:7/25: mkdir d1/d8 0 2024-03-18T14:43:07.065 INFO:tasks.workunit.client.0.smithi087.stdout:7/26: fsync d1/d6/f7 0 2024-03-18T14:43:07.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/19: rmdir d1/d3 0 2024-03-18T14:43:07.073 INFO:tasks.workunit.client.0.smithi087.stdout:1/50: rename d3/l4 to d3/ld 0 2024-03-18T14:43:07.073 INFO:tasks.workunit.client.0.smithi087.stdout:5/35: link l4 l7 0 2024-03-18T14:43:07.073 INFO:tasks.workunit.client.0.smithi087.stdout:9/29: symlink l9 0 2024-03-18T14:43:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:7/27: mkdir d1/d9 0 2024-03-18T14:43:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/51: fsync d3/f8 0 2024-03-18T14:43:07.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/52: fdatasync d3/f7 0 2024-03-18T14:43:07.075 INFO:tasks.workunit.client.0.smithi087.stdout:1/53: write d3/f8 [5077423,74509] 0 2024-03-18T14:43:07.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/54: dread d3/fc [0,4194304] 0 2024-03-18T14:43:07.080 INFO:tasks.workunit.client.0.smithi087.stdout:8/20: mkdir d1/d6 0 2024-03-18T14:43:07.080 INFO:tasks.workunit.client.0.smithi087.stdout:8/21: rename d1 to d1/d7 22 2024-03-18T14:43:07.081 INFO:tasks.workunit.client.0.smithi087.stdout:3/34: creat d0/fb x:0 0 0 2024-03-18T14:43:07.083 INFO:tasks.workunit.client.0.smithi087.stdout:5/36: creat f8 x:0 0 0 2024-03-18T14:43:07.084 INFO:tasks.workunit.client.0.smithi087.stdout:9/30: mknod ca 0 2024-03-18T14:43:07.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/37: mknod c9 0 2024-03-18T14:43:07.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/31: mkdir db 0 2024-03-18T14:43:07.090 INFO:tasks.workunit.client.0.smithi087.stdout:3/35: creat d0/d3/fc x:0 0 0 2024-03-18T14:43:07.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/36: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:07.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/37: chown d0/d3/f7 7599369 1 2024-03-18T14:43:07.091 INFO:tasks.workunit.client.0.smithi087.stdout:3/38: readlink d0/l8 0 2024-03-18T14:43:07.093 INFO:tasks.workunit.client.0.smithi087.stdout:7/28: getdents d1/d6 0 2024-03-18T14:43:07.093 INFO:tasks.workunit.client.0.smithi087.stdout:7/29: read f0 [1515962,84869] 0 2024-03-18T14:43:07.098 INFO:tasks.workunit.client.0.smithi087.stdout:1/55: getdents d3 0 2024-03-18T14:43:07.099 INFO:tasks.workunit.client.0.smithi087.stdout:1/56: stat c1 0 2024-03-18T14:43:07.099 INFO:tasks.workunit.client.0.smithi087.stdout:3/39: creat d0/d3/fd x:0 0 0 2024-03-18T14:43:07.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/38: truncate f8 536797 0 2024-03-18T14:43:07.100 INFO:tasks.workunit.client.0.smithi087.stdout:3/40: readlink d0/d3/l9 0 2024-03-18T14:43:07.101 INFO:tasks.workunit.client.0.smithi087.stdout:7/30: rename d1/d8 to d1/d6/da 0 2024-03-18T14:43:07.102 INFO:tasks.workunit.client.0.smithi087.stdout:9/32: truncate f8 658105 0 2024-03-18T14:43:07.106 INFO:tasks.workunit.client.0.smithi087.stdout:9/33: creat db/fc x:0 0 0 2024-03-18T14:43:07.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/31: truncate d1/d6/f7 79299 0 2024-03-18T14:43:07.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/57: dwrite d3/fc [0,4194304] 0 2024-03-18T14:43:07.109 INFO:tasks.workunit.client.0.smithi087.stdout:5/39: dread f8 [0,4194304] 0 2024-03-18T14:43:07.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/41: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/42: write d0/d3/f7 [370347,22696] 0 2024-03-18T14:43:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/43: chown d0/d3/f6 859344622 1 2024-03-18T14:43:07.111 INFO:tasks.workunit.client.0.smithi087.stdout:3/44: chown d0/l8 1573888 1 2024-03-18T14:43:07.115 INFO:tasks.workunit.client.0.smithi087.stdout:7/32: creat d1/fb x:0 0 0 2024-03-18T14:43:07.116 INFO:tasks.workunit.client.0.smithi087.stdout:1/58: mknod d3/ce 0 2024-03-18T14:43:07.117 INFO:tasks.workunit.client.0.smithi087.stdout:5/40: chown c5 1 1 2024-03-18T14:43:07.122 INFO:tasks.workunit.client.0.smithi087.stdout:1/59: symlink d3/lf 0 2024-03-18T14:43:07.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/41: mknod ca 0 2024-03-18T14:43:07.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/42: rmdir - no directory 2024-03-18T14:43:07.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/43: rmdir - no directory 2024-03-18T14:43:07.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/45: mkdir d0/de 0 2024-03-18T14:43:07.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/46: chown d0/fb 256066860 1 2024-03-18T14:43:07.126 INFO:tasks.workunit.client.0.smithi087.stdout:3/47: dread - d0/fb zero size 2024-03-18T14:43:07.126 INFO:tasks.workunit.client.0.smithi087.stdout:3/48: chown d0 51 1 2024-03-18T14:43:07.129 INFO:tasks.workunit.client.0.smithi087.stdout:1/60: creat d3/f10 x:0 0 0 2024-03-18T14:43:07.129 INFO:tasks.workunit.client.0.smithi087.stdout:5/44: creat fb x:0 0 0 2024-03-18T14:43:07.132 INFO:tasks.workunit.client.0.smithi087.stdout:1/61: symlink d3/l11 0 2024-03-18T14:43:07.132 INFO:tasks.workunit.client.0.smithi087.stdout:3/49: dwrite d0/d3/fc [0,4194304] 0 2024-03-18T14:43:07.132 INFO:tasks.workunit.client.0.smithi087.stdout:5/45: dread f8 [0,4194304] 0 2024-03-18T14:43:07.135 INFO:tasks.workunit.client.0.smithi087.stdout:7/33: dread d1/d6/f7 [0,4194304] 0 2024-03-18T14:43:07.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/34: dwrite f8 [0,4194304] 0 2024-03-18T14:43:07.136 INFO:tasks.workunit.client.0.smithi087.stdout:5/46: creat fc x:0 0 0 2024-03-18T14:43:07.137 INFO:tasks.workunit.client.0.smithi087.stdout:1/62: creat d3/f12 x:0 0 0 2024-03-18T14:43:07.137 INFO:tasks.workunit.client.0.smithi087.stdout:3/50: fdatasync d0/f1 0 2024-03-18T14:43:07.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/63: write d3/f12 [1002211,111637] 0 2024-03-18T14:43:07.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/51: fdatasync d0/d3/fd 0 2024-03-18T14:43:07.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/64: unlink d3/lf 0 2024-03-18T14:43:07.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/65: fdatasync d3/fc 0 2024-03-18T14:43:07.144 INFO:tasks.workunit.client.0.smithi087.stdout:3/52: mkdir d0/d3/df 0 2024-03-18T14:43:07.144 INFO:tasks.workunit.client.0.smithi087.stdout:1/66: write d3/f12 [1184510,20549] 0 2024-03-18T14:43:07.151 INFO:tasks.workunit.client.0.smithi087.stdout:1/67: link d3/cb d3/c13 0 2024-03-18T14:43:07.151 INFO:tasks.workunit.client.0.smithi087.stdout:1/68: read d3/f8 [2222275,71203] 0 2024-03-18T14:43:07.153 INFO:tasks.workunit.client.0.smithi087.stdout:1/69: symlink d3/l14 0 2024-03-18T14:43:07.155 INFO:tasks.workunit.client.0.smithi087.stdout:1/70: creat d3/f15 x:0 0 0 2024-03-18T14:43:07.155 INFO:tasks.workunit.client.0.smithi087.stdout:7/34: write f0 [968008,22435] 0 2024-03-18T14:43:07.156 INFO:tasks.workunit.client.0.smithi087.stdout:9/35: fsync f8 0 2024-03-18T14:43:07.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/71: stat d3/c9 0 2024-03-18T14:43:07.157 INFO:tasks.workunit.client.0.smithi087.stdout:1/72: write d3/f7 [2426223,29575] 0 2024-03-18T14:43:07.157 INFO:tasks.workunit.client.0.smithi087.stdout:5/47: truncate f8 1091109 0 2024-03-18T14:43:07.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/53: truncate d0/d3/fc 1460456 0 2024-03-18T14:43:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:7/35: truncate d1/d6/f7 719381 0 2024-03-18T14:43:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:9/36: dread f7 [0,4194304] 0 2024-03-18T14:43:07.160 INFO:tasks.workunit.client.0.smithi087.stdout:5/48: readlink l4 0 2024-03-18T14:43:07.161 INFO:tasks.workunit.client.0.smithi087.stdout:5/49: stat l4 0 2024-03-18T14:43:07.162 INFO:tasks.workunit.client.0.smithi087.stdout:9/37: dread - db/fc zero size 2024-03-18T14:43:07.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/50: fsync fc 0 2024-03-18T14:43:07.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/36: mkdir d1/d9/dc 0 2024-03-18T14:43:07.163 INFO:tasks.workunit.client.0.smithi087.stdout:9/38: write f8 [4771134,60117] 0 2024-03-18T14:43:07.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/51: read - fb zero size 2024-03-18T14:43:07.164 INFO:tasks.workunit.client.0.smithi087.stdout:1/73: dwrite d3/f7 [0,4194304] 0 2024-03-18T14:43:07.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/39: chown c4 10222269 1 2024-03-18T14:43:07.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/54: truncate d0/fb 857770 0 2024-03-18T14:43:07.170 INFO:tasks.workunit.client.0.smithi087.stdout:1/74: creat d3/f16 x:0 0 0 2024-03-18T14:43:07.171 INFO:tasks.workunit.client.0.smithi087.stdout:1/75: chown d3/f10 5 1 2024-03-18T14:43:07.171 INFO:tasks.workunit.client.0.smithi087.stdout:9/40: creat db/fd x:0 0 0 2024-03-18T14:43:07.175 INFO:tasks.workunit.client.0.smithi087.stdout:1/76: creat d3/f17 x:0 0 0 2024-03-18T14:43:07.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/41: symlink db/le 0 2024-03-18T14:43:07.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/52: getdents . 0 2024-03-18T14:43:07.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/53: readlink l4 0 2024-03-18T14:43:07.179 INFO:tasks.workunit.client.0.smithi087.stdout:5/54: chown l7 2468182 1 2024-03-18T14:43:07.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/77: dwrite d3/f15 [0,4194304] 0 2024-03-18T14:43:07.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/42: link db/fd db/ff 0 2024-03-18T14:43:07.182 INFO:tasks.workunit.client.0.smithi087.stdout:3/55: write d0/fb [307206,27125] 0 2024-03-18T14:43:07.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/55: rename fc to fd 0 2024-03-18T14:43:07.184 INFO:tasks.workunit.client.0.smithi087.stdout:3/56: stat d0/d3/fd 0 2024-03-18T14:43:07.185 INFO:tasks.workunit.client.0.smithi087.stdout:1/78: rename c1 to d3/c18 0 2024-03-18T14:43:07.186 INFO:tasks.workunit.client.0.smithi087.stdout:7/37: dwrite d1/d6/f7 [0,4194304] 0 2024-03-18T14:43:07.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/57: mkdir d0/d3/d10 0 2024-03-18T14:43:07.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/79: creat d3/f19 x:0 0 0 2024-03-18T14:43:07.195 INFO:tasks.workunit.client.0.smithi087.stdout:7/38: creat d1/d9/dc/fd x:0 0 0 2024-03-18T14:43:07.195 INFO:tasks.workunit.client.0.smithi087.stdout:1/80: read d3/f12 [803683,116499] 0 2024-03-18T14:43:07.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/58: symlink d0/l11 0 2024-03-18T14:43:07.196 INFO:tasks.workunit.client.0.smithi087.stdout:3/59: chown d0/de 752 1 2024-03-18T14:43:07.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/39: creat d1/d6/da/fe x:0 0 0 2024-03-18T14:43:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/40: write d1/d6/f7 [3173206,105617] 0 2024-03-18T14:43:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:3/60: creat d0/de/f12 x:0 0 0 2024-03-18T14:43:07.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/41: chown d1/l5 3058758 1 2024-03-18T14:43:07.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/42: chown f0 6001 1 2024-03-18T14:43:07.201 INFO:tasks.workunit.client.0.smithi087.stdout:1/81: dread d3/f12 [0,4194304] 0 2024-03-18T14:43:07.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/43: truncate f7 305891 0 2024-03-18T14:43:07.210 INFO:tasks.workunit.client.0.smithi087.stdout:7/43: creat d1/d6/da/ff x:0 0 0 2024-03-18T14:43:07.210 INFO:tasks.workunit.client.0.smithi087.stdout:5/56: dwrite f8 [0,4194304] 0 2024-03-18T14:43:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:7/44: fdatasync d1/f3 0 2024-03-18T14:43:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:7/45: chown d1/d6 146674 1 2024-03-18T14:43:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:7/46: read - d1/d6/da/ff zero size 2024-03-18T14:43:07.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/61: getdents d0/d3/d10 0 2024-03-18T14:43:07.212 INFO:tasks.workunit.client.0.smithi087.stdout:9/44: creat db/f10 x:0 0 0 2024-03-18T14:43:07.213 INFO:tasks.workunit.client.0.smithi087.stdout:7/47: dwrite d1/d6/f7 [0,4194304] 0 2024-03-18T14:43:07.214 INFO:tasks.workunit.client.0.smithi087.stdout:5/57: fdatasync fd 0 2024-03-18T14:43:07.215 INFO:tasks.workunit.client.0.smithi087.stdout:9/45: fdatasync db/fd 0 2024-03-18T14:43:07.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/48: rename d1/d9/dc/fd to d1/f10 0 2024-03-18T14:43:07.220 INFO:tasks.workunit.client.0.smithi087.stdout:5/58: creat fe x:0 0 0 2024-03-18T14:43:07.221 INFO:tasks.workunit.client.0.smithi087.stdout:3/62: mknod d0/c13 0 2024-03-18T14:43:07.224 INFO:tasks.workunit.client.0.smithi087.stdout:7/49: dwrite d1/d6/da/ff [0,4194304] 0 2024-03-18T14:43:07.224 INFO:tasks.workunit.client.0.smithi087.stdout:1/82: truncate d3/f19 682416 0 2024-03-18T14:43:07.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/83: mknod d3/c1a 0 2024-03-18T14:43:07.234 INFO:tasks.workunit.client.0.smithi087.stdout:5/59: rename f8 to ff 0 2024-03-18T14:43:07.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/63: dwrite d0/d3/fc [0,4194304] 0 2024-03-18T14:43:07.235 INFO:tasks.workunit.client.0.smithi087.stdout:5/60: chown ff 11875192 1 2024-03-18T14:43:07.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/84: mknod d3/c1b 0 2024-03-18T14:43:07.239 INFO:tasks.workunit.client.0.smithi087.stdout:9/46: truncate f3 1397344 0 2024-03-18T14:43:07.240 INFO:tasks.workunit.client.0.smithi087.stdout:5/61: dwrite fb [0,4194304] 0 2024-03-18T14:43:07.246 INFO:tasks.workunit.client.0.smithi087.stdout:7/50: truncate f0 3080001 0 2024-03-18T14:43:07.247 INFO:tasks.workunit.client.0.smithi087.stdout:9/47: creat db/f11 x:0 0 0 2024-03-18T14:43:07.249 INFO:tasks.workunit.client.0.smithi087.stdout:5/62: unlink fd 0 2024-03-18T14:43:07.249 INFO:tasks.workunit.client.0.smithi087.stdout:5/63: stat l2 0 2024-03-18T14:43:07.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/48: mkdir db/d12 0 2024-03-18T14:43:07.255 INFO:tasks.workunit.client.0.smithi087.stdout:5/64: symlink l10 0 2024-03-18T14:43:07.255 INFO:tasks.workunit.client.0.smithi087.stdout:1/85: link d3/l5 d3/l1c 0 2024-03-18T14:43:07.256 INFO:tasks.workunit.client.0.smithi087.stdout:3/64: dwrite d0/f1 [0,4194304] 0 2024-03-18T14:43:07.256 INFO:tasks.workunit.client.0.smithi087.stdout:3/65: chown d0/d3/fc 320 1 2024-03-18T14:43:07.259 INFO:tasks.workunit.client.0.smithi087.stdout:5/65: creat f11 x:0 0 0 2024-03-18T14:43:07.259 INFO:tasks.workunit.client.0.smithi087.stdout:5/66: chown fe 0 1 2024-03-18T14:43:07.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/86: mkdir d3/d1d 0 2024-03-18T14:43:07.260 INFO:tasks.workunit.client.0.smithi087.stdout:5/67: chown fe 1784 1 2024-03-18T14:43:07.260 INFO:tasks.workunit.client.0.smithi087.stdout:5/68: rmdir - no directory 2024-03-18T14:43:07.264 INFO:tasks.workunit.client.0.smithi087.stdout:7/51: link d1/l4 d1/d9/dc/l11 0 2024-03-18T14:43:07.267 INFO:tasks.workunit.client.0.smithi087.stdout:9/49: stat f3 0 2024-03-18T14:43:07.268 INFO:tasks.workunit.client.0.smithi087.stdout:9/50: write db/fc [770508,106356] 0 2024-03-18T14:43:07.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/87: mkdir d3/d1d/d1e 0 2024-03-18T14:43:07.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/88: read d3/f7 [857709,124401] 0 2024-03-18T14:43:07.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/66: truncate d0/d3/f6 1452381 0 2024-03-18T14:43:07.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/51: write f1 [529057,98516] 0 2024-03-18T14:43:07.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/67: write d0/fb [1355548,122816] 0 2024-03-18T14:43:07.276 INFO:tasks.workunit.client.0.smithi087.stdout:5/69: dwrite ff [4194304,4194304] 0 2024-03-18T14:43:07.277 INFO:tasks.workunit.client.0.smithi087.stdout:7/52: fsync f0 0 2024-03-18T14:43:07.280 INFO:tasks.workunit.client.0.smithi087.stdout:5/70: dread ff [0,4194304] 0 2024-03-18T14:43:07.280 INFO:tasks.workunit.client.0.smithi087.stdout:5/71: stat l6 0 2024-03-18T14:43:07.281 INFO:tasks.workunit.client.0.smithi087.stdout:5/72: read - f11 zero size 2024-03-18T14:43:07.281 INFO:tasks.workunit.client.0.smithi087.stdout:3/68: rmdir d0/de 39 2024-03-18T14:43:07.284 INFO:tasks.workunit.client.0.smithi087.stdout:3/69: dread d0/d3/fc [0,4194304] 0 2024-03-18T14:43:07.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/89: truncate d3/f16 468164 0 2024-03-18T14:43:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/73: creat f12 x:0 0 0 2024-03-18T14:43:07.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/74: chown ff 1019429 1 2024-03-18T14:43:07.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/75: dwrite f12 [0,4194304] 0 2024-03-18T14:43:07.291 INFO:tasks.workunit.client.0.smithi087.stdout:5/76: rmdir - no directory 2024-03-18T14:43:07.292 INFO:tasks.workunit.client.0.smithi087.stdout:5/77: write fe [534861,48089] 0 2024-03-18T14:43:07.294 INFO:tasks.workunit.client.0.smithi087.stdout:3/70: creat d0/d3/df/f14 x:0 0 0 2024-03-18T14:43:07.295 INFO:tasks.workunit.client.0.smithi087.stdout:3/71: write d0/d3/fd [480532,111068] 0 2024-03-18T14:43:07.296 INFO:tasks.workunit.client.0.smithi087.stdout:9/52: getdents db 0 2024-03-18T14:43:07.298 INFO:tasks.workunit.client.0.smithi087.stdout:5/78: mkdir d13 0 2024-03-18T14:43:07.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/53: getdents d1 0 2024-03-18T14:43:07.303 INFO:tasks.workunit.client.0.smithi087.stdout:1/90: write d3/f19 [1004649,4353] 0 2024-03-18T14:43:07.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/54: chown d1/d6/da/ff 210225879 1 2024-03-18T14:43:07.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/55: fdatasync d1/fb 0 2024-03-18T14:43:07.305 INFO:tasks.workunit.client.0.smithi087.stdout:7/56: stat d1/d6/da/fe 0 2024-03-18T14:43:07.306 INFO:tasks.workunit.client.0.smithi087.stdout:9/53: rename l0 to db/d12/l13 0 2024-03-18T14:43:07.307 INFO:tasks.workunit.client.0.smithi087.stdout:5/79: unlink fe 0 2024-03-18T14:43:07.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/80: chown ff 3378263 1 2024-03-18T14:43:07.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/91: dwrite d3/f19 [0,4194304] 0 2024-03-18T14:43:07.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/57: dwrite d1/d6/f7 [0,4194304] 0 2024-03-18T14:43:07.312 INFO:tasks.workunit.client.0.smithi087.stdout:3/72: truncate d0/f2 1018172 0 2024-03-18T14:43:07.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/58: dread - d1/fb zero size 2024-03-18T14:43:07.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/73: write d0/f1 [3552932,67384] 0 2024-03-18T14:43:07.314 INFO:tasks.workunit.client.0.smithi087.stdout:9/54: symlink db/d12/l14 0 2024-03-18T14:43:07.314 INFO:tasks.workunit.client.0.smithi087.stdout:9/55: dread - db/f11 zero size 2024-03-18T14:43:07.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/56: mknod db/d12/c15 0 2024-03-18T14:43:07.322 INFO:tasks.workunit.client.0.smithi087.stdout:9/57: chown db/le 18 1 2024-03-18T14:43:07.322 INFO:tasks.workunit.client.0.smithi087.stdout:5/81: link l4 d13/l14 0 2024-03-18T14:43:07.325 INFO:tasks.workunit.client.0.smithi087.stdout:9/58: unlink db/d12/c15 0 2024-03-18T14:43:07.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/59: write f0 [1069163,41738] 0 2024-03-18T14:43:07.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/59: mknod db/c16 0 2024-03-18T14:43:07.331 INFO:tasks.workunit.client.0.smithi087.stdout:5/82: symlink d13/l15 0 2024-03-18T14:43:07.332 INFO:tasks.workunit.client.0.smithi087.stdout:3/74: getdents d0 0 2024-03-18T14:43:07.333 INFO:tasks.workunit.client.0.smithi087.stdout:7/60: creat d1/f12 x:0 0 0 2024-03-18T14:43:07.334 INFO:tasks.workunit.client.0.smithi087.stdout:5/83: rmdir d13 39 2024-03-18T14:43:07.334 INFO:tasks.workunit.client.0.smithi087.stdout:5/84: fsync f11 0 2024-03-18T14:43:07.335 INFO:tasks.workunit.client.0.smithi087.stdout:9/60: fdatasync f3 0 2024-03-18T14:43:07.336 INFO:tasks.workunit.client.0.smithi087.stdout:7/61: rmdir d1/d6/da 39 2024-03-18T14:43:07.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/75: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:07.341 INFO:tasks.workunit.client.0.smithi087.stdout:9/61: truncate db/fd 226086 0 2024-03-18T14:43:07.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/92: truncate d3/f19 4360931 0 2024-03-18T14:43:07.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/62: creat d1/f13 x:0 0 0 2024-03-18T14:43:07.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/63: dread - d1/fb zero size 2024-03-18T14:43:07.344 INFO:tasks.workunit.client.0.smithi087.stdout:3/76: chown d0/d3/f6 796 1 2024-03-18T14:43:07.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/85: creat d13/f16 x:0 0 0 2024-03-18T14:43:07.348 INFO:tasks.workunit.client.0.smithi087.stdout:5/86: dread fb [0,4194304] 0 2024-03-18T14:43:07.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/62: unlink c6 0 2024-03-18T14:43:07.350 INFO:tasks.workunit.client.0.smithi087.stdout:9/63: dread - db/f10 zero size 2024-03-18T14:43:07.350 INFO:tasks.workunit.client.0.smithi087.stdout:9/64: chown db/d12 10 1 2024-03-18T14:43:07.350 INFO:tasks.workunit.client.0.smithi087.stdout:1/93: mkdir d3/d1d/d1f 0 2024-03-18T14:43:07.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/65: rename db/c16 to db/d12/c17 0 2024-03-18T14:43:07.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/77: write d0/d3/fc [1481635,81199] 0 2024-03-18T14:43:07.361 INFO:tasks.workunit.client.0.smithi087.stdout:5/87: link f12 d13/f17 0 2024-03-18T14:43:07.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/64: creat d1/d6/f14 x:0 0 0 2024-03-18T14:43:07.364 INFO:tasks.workunit.client.0.smithi087.stdout:9/66: mkdir db/d18 0 2024-03-18T14:43:07.365 INFO:tasks.workunit.client.0.smithi087.stdout:9/67: fdatasync db/f10 0 2024-03-18T14:43:07.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/94: mkdir d3/d1d/d1e/d20 0 2024-03-18T14:43:07.367 INFO:tasks.workunit.client.0.smithi087.stdout:5/88: dwrite f11 [0,4194304] 0 2024-03-18T14:43:07.370 INFO:tasks.workunit.client.0.smithi087.stdout:1/95: creat d3/d1d/f21 x:0 0 0 2024-03-18T14:43:07.371 INFO:tasks.workunit.client.0.smithi087.stdout:9/68: dread f3 [0,4194304] 0 2024-03-18T14:43:07.372 INFO:tasks.workunit.client.0.smithi087.stdout:1/96: fsync d3/f10 0 2024-03-18T14:43:07.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/89: dread ff [4194304,4194304] 0 2024-03-18T14:43:07.372 INFO:tasks.workunit.client.0.smithi087.stdout:3/78: write d0/d3/f6 [2194555,11782] 0 2024-03-18T14:43:07.373 INFO:tasks.workunit.client.0.smithi087.stdout:3/79: chown d0/d3/df 456 1 2024-03-18T14:43:07.376 INFO:tasks.workunit.client.0.smithi087.stdout:7/65: symlink d1/d6/l15 0 2024-03-18T14:43:07.376 INFO:tasks.workunit.client.0.smithi087.stdout:7/66: readlink d1/d6/l15 0 2024-03-18T14:43:07.377 INFO:tasks.workunit.client.0.smithi087.stdout:1/97: write d3/f7 [4812408,27055] 0 2024-03-18T14:43:07.377 INFO:tasks.workunit.client.0.smithi087.stdout:9/69: dread f7 [0,4194304] 0 2024-03-18T14:43:07.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/90: creat d13/f18 x:0 0 0 2024-03-18T14:43:07.378 INFO:tasks.workunit.client.0.smithi087.stdout:3/80: symlink d0/d3/l15 0 2024-03-18T14:43:07.378 INFO:tasks.workunit.client.0.smithi087.stdout:9/70: write db/fc [1054533,35761] 0 2024-03-18T14:43:07.379 INFO:tasks.workunit.client.0.smithi087.stdout:3/81: chown d0/de 1 1 2024-03-18T14:43:07.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/71: chown db 45460 1 2024-03-18T14:43:07.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/72: chown f1 59885 1 2024-03-18T14:43:07.380 INFO:tasks.workunit.client.0.smithi087.stdout:5/91: fdatasync f12 0 2024-03-18T14:43:07.381 INFO:tasks.workunit.client.0.smithi087.stdout:5/92: stat f12 0 2024-03-18T14:43:07.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/98: creat d3/d1d/f22 x:0 0 0 2024-03-18T14:43:07.382 INFO:tasks.workunit.client.0.smithi087.stdout:9/73: dread f8 [0,4194304] 0 2024-03-18T14:43:07.383 INFO:tasks.workunit.client.0.smithi087.stdout:3/82: creat d0/d3/df/f16 x:0 0 0 2024-03-18T14:43:07.383 INFO:tasks.workunit.client.0.smithi087.stdout:3/83: read d0/f1 [3757621,96649] 0 2024-03-18T14:43:07.384 INFO:tasks.workunit.client.0.smithi087.stdout:3/84: readlink d0/d3/l9 0 2024-03-18T14:43:07.384 INFO:tasks.workunit.client.0.smithi087.stdout:3/85: chown d0/l8 4 1 2024-03-18T14:43:07.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/86: chown d0/d3/d10 715 1 2024-03-18T14:43:07.387 INFO:tasks.workunit.client.0.smithi087.stdout:5/93: symlink d13/l19 0 2024-03-18T14:43:07.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/87: dwrite d0/d3/df/f16 [0,4194304] 0 2024-03-18T14:43:07.390 INFO:tasks.workunit.client.0.smithi087.stdout:7/67: rename d1/d9 to d1/d6/d16 0 2024-03-18T14:43:07.394 INFO:tasks.workunit.client.0.smithi087.stdout:7/68: dwrite d1/f3 [0,4194304] 0 2024-03-18T14:43:07.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/94: write fb [5187760,20240] 0 2024-03-18T14:43:07.398 INFO:tasks.workunit.client.0.smithi087.stdout:1/99: creat d3/d1d/d1e/d20/f23 x:0 0 0 2024-03-18T14:43:07.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/74: getdents db/d18 0 2024-03-18T14:43:07.399 INFO:tasks.workunit.client.0.smithi087.stdout:9/75: fdatasync f1 0 2024-03-18T14:43:07.406 INFO:tasks.workunit.client.0.smithi087.stdout:7/69: unlink d1/d6/da/fe 0 2024-03-18T14:43:07.408 INFO:tasks.workunit.client.0.smithi087.stdout:3/88: getdents d0 0 2024-03-18T14:43:07.409 INFO:tasks.workunit.client.0.smithi087.stdout:1/100: link d3/d1d/d1e/d20/f23 d3/d1d/d1f/f24 0 2024-03-18T14:43:07.410 INFO:tasks.workunit.client.0.smithi087.stdout:3/89: read d0/d3/f6 [1104954,84645] 0 2024-03-18T14:43:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:1/101: stat d3/d1d/f21 0 2024-03-18T14:43:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:3/90: fsync d0/fb 0 2024-03-18T14:43:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/76: dwrite f8 [0,4194304] 0 2024-03-18T14:43:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/70: dwrite d1/fb [0,4194304] 0 2024-03-18T14:43:07.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/71: stat d1/d6/d16 0 2024-03-18T14:43:07.417 INFO:tasks.workunit.client.0.smithi087.stdout:3/91: dread d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:07.418 INFO:tasks.workunit.client.0.smithi087.stdout:9/77: mknod db/c19 0 2024-03-18T14:43:07.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/72: dwrite d1/f3 [4194304,4194304] 0 2024-03-18T14:43:07.420 INFO:tasks.workunit.client.0.smithi087.stdout:7/73: write d1/d6/f7 [5021294,23744] 0 2024-03-18T14:43:07.424 INFO:tasks.workunit.client.0.smithi087.stdout:3/92: mknod d0/d3/d10/c17 0 2024-03-18T14:43:07.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/74: chown d1/d6/d16/dc/l11 2 1 2024-03-18T14:43:07.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/75: write d1/f10 [115104,70325] 0 2024-03-18T14:43:07.429 INFO:tasks.workunit.client.0.smithi087.stdout:3/93: dwrite d0/d3/fc [0,4194304] 0 2024-03-18T14:43:07.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/94: dwrite d0/de/f12 [0,4194304] 0 2024-03-18T14:43:07.437 INFO:tasks.workunit.client.0.smithi087.stdout:3/95: dread d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:07.439 INFO:tasks.workunit.client.0.smithi087.stdout:3/96: mknod d0/d3/df/c18 0 2024-03-18T14:43:07.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/97: creat d0/f19 x:0 0 0 2024-03-18T14:43:07.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/98: creat d0/d3/d10/f1a x:0 0 0 2024-03-18T14:43:07.447 INFO:tasks.workunit.client.0.smithi087.stdout:7/76: truncate d1/d6/da/ff 4384335 0 2024-03-18T14:43:07.448 INFO:tasks.workunit.client.0.smithi087.stdout:7/77: chown d1 3512618 1 2024-03-18T14:43:07.449 INFO:tasks.workunit.client.0.smithi087.stdout:9/78: dwrite db/ff [0,4194304] 0 2024-03-18T14:43:07.452 INFO:tasks.workunit.client.0.smithi087.stdout:7/78: mknod d1/d6/d16/c17 0 2024-03-18T14:43:07.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/99: dread d0/d3/df/f16 [0,4194304] 0 2024-03-18T14:43:07.455 INFO:tasks.workunit.client.0.smithi087.stdout:9/79: dwrite f8 [4194304,4194304] 0 2024-03-18T14:43:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:9/80: write f1 [1529546,4296] 0 2024-03-18T14:43:07.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/100: symlink d0/d3/l1b 0 2024-03-18T14:43:07.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/79: creat d1/d6/f18 x:0 0 0 2024-03-18T14:43:07.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/101: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:07.468 INFO:tasks.workunit.client.0.smithi087.stdout:3/102: chown d0/d3/fc 120600 1 2024-03-18T14:43:07.476 INFO:tasks.workunit.client.0.smithi087.stdout:9/81: dwrite f3 [0,4194304] 0 2024-03-18T14:43:07.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/82: write db/fd [4346412,4152] 0 2024-03-18T14:43:07.484 INFO:tasks.workunit.client.0.smithi087.stdout:3/103: truncate d0/d3/fd 216995 0 2024-03-18T14:43:07.486 INFO:tasks.workunit.client.0.smithi087.stdout:7/80: dwrite d1/d6/da/ff [0,4194304] 0 2024-03-18T14:43:07.487 INFO:tasks.workunit.client.0.smithi087.stdout:9/83: truncate db/fd 348384 0 2024-03-18T14:43:07.487 INFO:tasks.workunit.client.0.smithi087.stdout:7/81: fsync d1/f13 0 2024-03-18T14:43:07.487 INFO:tasks.workunit.client.0.smithi087.stdout:7/82: chown d1/f13 1 1 2024-03-18T14:43:07.490 INFO:tasks.workunit.client.0.smithi087.stdout:9/84: dread f8 [0,4194304] 0 2024-03-18T14:43:07.491 INFO:tasks.workunit.client.0.smithi087.stdout:3/104: getdents d0/de 0 2024-03-18T14:43:07.492 INFO:tasks.workunit.client.0.smithi087.stdout:7/83: symlink d1/d6/d16/dc/l19 0 2024-03-18T14:43:07.498 INFO:tasks.workunit.client.0.smithi087.stdout:9/85: creat db/f1a x:0 0 0 2024-03-18T14:43:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/86: write f1 [970469,87146] 0 2024-03-18T14:43:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/87: read f7 [265738,89560] 0 2024-03-18T14:43:07.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/88: chown f3 393 1 2024-03-18T14:43:07.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/89: dread f8 [0,4194304] 0 2024-03-18T14:43:07.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/90: dread - db/f1a zero size 2024-03-18T14:43:07.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/91: mknod db/d12/c1b 0 2024-03-18T14:43:07.506 INFO:tasks.workunit.client.0.smithi087.stdout:7/84: rmdir d1 39 2024-03-18T14:43:07.507 INFO:tasks.workunit.client.0.smithi087.stdout:3/105: truncate d0/de/f12 2011933 0 2024-03-18T14:43:07.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/85: readlink d1/d6/l15 0 2024-03-18T14:43:07.508 INFO:tasks.workunit.client.0.smithi087.stdout:9/92: dwrite db/f11 [0,4194304] 0 2024-03-18T14:43:07.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/86: link d1/f12 d1/d6/d16/f1a 0 2024-03-18T14:43:07.517 INFO:tasks.workunit.client.0.smithi087.stdout:3/106: getdents d0/d3 0 2024-03-18T14:43:07.518 INFO:tasks.workunit.client.0.smithi087.stdout:3/107: chown d0/d3/l1b 285 1 2024-03-18T14:43:07.519 INFO:tasks.workunit.client.0.smithi087.stdout:7/87: dwrite f0 [0,4194304] 0 2024-03-18T14:43:07.520 INFO:tasks.workunit.client.0.smithi087.stdout:7/88: readlink d1/l5 0 2024-03-18T14:43:07.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/108: mkdir d0/d1c 0 2024-03-18T14:43:07.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/89: rename d1/d6/d16 to d1/d6/d16/d1b 22 2024-03-18T14:43:07.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/90: chown d1 6411664 1 2024-03-18T14:43:07.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/93: truncate db/fc 2126522 0 2024-03-18T14:43:07.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/94: chown db/d12 298 1 2024-03-18T14:43:07.526 INFO:tasks.workunit.client.0.smithi087.stdout:9/95: stat db/d12/l13 0 2024-03-18T14:43:07.528 INFO:tasks.workunit.client.0.smithi087.stdout:7/91: dwrite d1/f10 [0,4194304] 0 2024-03-18T14:43:07.528 INFO:tasks.workunit.client.0.smithi087.stdout:3/109: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:07.533 INFO:tasks.workunit.client.0.smithi087.stdout:7/92: mkdir d1/d6/d16/d1c 0 2024-03-18T14:43:07.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/96: dwrite db/fc [0,4194304] 0 2024-03-18T14:43:07.536 INFO:tasks.workunit.client.0.smithi087.stdout:9/97: dread f7 [0,4194304] 0 2024-03-18T14:43:07.543 INFO:tasks.workunit.client.0.smithi087.stdout:9/98: mkdir db/d18/d1c 0 2024-03-18T14:43:07.544 INFO:tasks.workunit.client.0.smithi087.stdout:9/99: write db/f1a [1006190,124626] 0 2024-03-18T14:43:07.544 INFO:tasks.workunit.client.0.smithi087.stdout:9/100: chown f7 83420 1 2024-03-18T14:43:07.548 INFO:tasks.workunit.client.0.smithi087.stdout:3/110: fdatasync d0/d3/df/f14 0 2024-03-18T14:43:07.549 INFO:tasks.workunit.client.0.smithi087.stdout:7/93: fdatasync d1/f10 0 2024-03-18T14:43:07.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/111: link d0/fb d0/d3/df/f1d 0 2024-03-18T14:43:07.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/101: getdents db/d18 0 2024-03-18T14:43:07.555 INFO:tasks.workunit.client.0.smithi087.stdout:7/94: creat d1/d6/f1d x:0 0 0 2024-03-18T14:43:07.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/102: getdents db/d18 0 2024-03-18T14:43:07.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/112: getdents d0/d3/d10 0 2024-03-18T14:43:07.557 INFO:tasks.workunit.client.0.smithi087.stdout:3/113: readlink d0/l8 0 2024-03-18T14:43:07.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/103: fdatasync f7 0 2024-03-18T14:43:07.561 INFO:tasks.workunit.client.0.smithi087.stdout:9/104: mknod db/c1d 0 2024-03-18T14:43:07.561 INFO:tasks.workunit.client.0.smithi087.stdout:9/105: chown db/f1a 43454001 1 2024-03-18T14:43:07.562 INFO:tasks.workunit.client.0.smithi087.stdout:7/95: truncate d1/f10 3267896 0 2024-03-18T14:43:07.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/114: getdents d0/d3/d10 0 2024-03-18T14:43:07.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/96: write d1/d6/f1d [505304,72642] 0 2024-03-18T14:43:07.564 INFO:tasks.workunit.client.0.smithi087.stdout:9/106: write f7 [1010857,40121] 0 2024-03-18T14:43:07.564 INFO:tasks.workunit.client.0.smithi087.stdout:7/97: fsync d1/d6/f14 0 2024-03-18T14:43:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:7/98: read - d1/f13 zero size 2024-03-18T14:43:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/115: creat d0/d1c/f1e x:0 0 0 2024-03-18T14:43:07.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/107: fsync f8 0 2024-03-18T14:43:07.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/108: write f3 [3279772,24745] 0 2024-03-18T14:43:07.569 INFO:tasks.workunit.client.0.smithi087.stdout:7/99: creat d1/d6/d16/f1e x:0 0 0 2024-03-18T14:43:07.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/109: dread db/f11 [0,4194304] 0 2024-03-18T14:43:07.572 INFO:tasks.workunit.client.0.smithi087.stdout:3/116: fsync d0/d3/df/f16 0 2024-03-18T14:43:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:9/110: mkdir db/d18/d1e 0 2024-03-18T14:43:07.575 INFO:tasks.workunit.client.0.smithi087.stdout:3/117: dread d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:07.576 INFO:tasks.workunit.client.0.smithi087.stdout:7/100: mknod d1/d6/d16/c1f 0 2024-03-18T14:43:07.576 INFO:tasks.workunit.client.0.smithi087.stdout:3/118: read - d0/d3/d10/f1a zero size 2024-03-18T14:43:07.582 INFO:tasks.workunit.client.0.smithi087.stdout:7/101: creat d1/f20 x:0 0 0 2024-03-18T14:43:07.583 INFO:tasks.workunit.client.0.smithi087.stdout:3/119: creat d0/d3/d10/f1f x:0 0 0 2024-03-18T14:43:07.586 INFO:tasks.workunit.client.0.smithi087.stdout:7/102: creat d1/d6/d16/f21 x:0 0 0 2024-03-18T14:43:07.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/111: link db/c19 db/d12/c1f 0 2024-03-18T14:43:07.589 INFO:tasks.workunit.client.0.smithi087.stdout:9/112: creat db/d12/f20 x:0 0 0 2024-03-18T14:43:07.593 INFO:tasks.workunit.client.0.smithi087.stdout:9/113: dwrite db/f1a [0,4194304] 0 2024-03-18T14:43:07.595 INFO:tasks.workunit.client.0.smithi087.stdout:7/103: write d1/d6/d16/f1a [741050,126284] 0 2024-03-18T14:43:07.596 INFO:tasks.workunit.client.0.smithi087.stdout:9/114: write db/ff [1142796,130604] 0 2024-03-18T14:43:07.599 INFO:tasks.workunit.client.0.smithi087.stdout:7/104: link d1/d6/f18 d1/d6/da/f22 0 2024-03-18T14:43:07.600 INFO:tasks.workunit.client.0.smithi087.stdout:7/105: readlink d1/d6/d16/dc/l11 0 2024-03-18T14:43:07.601 INFO:tasks.workunit.client.0.smithi087.stdout:9/115: dwrite db/d12/f20 [0,4194304] 0 2024-03-18T14:43:07.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/106: chown d1/d6/d16/c17 64593953 1 2024-03-18T14:43:07.604 INFO:tasks.workunit.client.0.smithi087.stdout:7/107: symlink d1/d6/d16/dc/l23 0 2024-03-18T14:43:07.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/108: dwrite d1/f3 [0,4194304] 0 2024-03-18T14:43:07.609 INFO:tasks.workunit.client.0.smithi087.stdout:7/109: read - d1/d6/da/f22 zero size 2024-03-18T14:43:07.625 INFO:tasks.workunit.client.0.smithi087.stdout:7/110: mknod d1/d6/da/c24 0 2024-03-18T14:43:07.629 INFO:tasks.workunit.client.0.smithi087.stdout:7/111: dwrite d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:07.838 INFO:tasks.workunit.client.0.smithi087.stdout:7/112: rmdir d1/d6/d16/d1c 0 2024-03-18T14:43:08.578 INFO:tasks.workunit.client.1.smithi129.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-18T14:43:08.587 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-18T14:43:08.587 INFO:tasks.workunit.client.1.smithi129.stderr:+ make 2024-03-18T14:43:08.671 INFO:tasks.workunit.client.1.smithi129.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-18T14:43:09.005 INFO:tasks.workunit.client.1.smithi129.stderr:++ readlink -f fsstress 2024-03-18T14:43:09.007 INFO:tasks.workunit.client.1.smithi129.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-18T14:43:09.007 INFO:tasks.workunit.client.1.smithi129.stderr:+ popd 2024-03-18T14:43:09.008 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-18T14:43:09.008 INFO:tasks.workunit.client.1.smithi129.stderr:+ popd 2024-03-18T14:43:09.008 INFO:tasks.workunit.client.1.smithi129.stdout:~/cephtest/mnt.1/client.1/tmp 2024-03-18T14:43:09.009 INFO:tasks.workunit.client.1.smithi129.stderr:++ mktemp -d -p . 2024-03-18T14:43:09.012 INFO:tasks.workunit.client.1.smithi129.stderr:+ T=./tmp.7ELo3txtyD 2024-03-18T14:43:09.012 INFO:tasks.workunit.client.1.smithi129.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.7ELo3txtyD -l 1 -n 1000 -p 10 -v 2024-03-18T14:43:09.014 INFO:tasks.workunit.client.1.smithi129.stdout:seed = 1710777638 2024-03-18T14:43:09.017 INFO:tasks.workunit.client.1.smithi129.stdout:0/0: dwrite - no filename 2024-03-18T14:43:09.018 INFO:tasks.workunit.client.1.smithi129.stdout:0/1: dwrite - no filename 2024-03-18T14:43:09.018 INFO:tasks.workunit.client.1.smithi129.stdout:0/2: truncate - no filename 2024-03-18T14:43:09.018 INFO:tasks.workunit.client.1.smithi129.stdout:0/3: read - no filename 2024-03-18T14:43:09.019 INFO:tasks.workunit.client.1.smithi129.stdout:1/0: read - no filename 2024-03-18T14:43:09.019 INFO:tasks.workunit.client.1.smithi129.stdout:0/4: mkdir d0 0 2024-03-18T14:43:09.019 INFO:tasks.workunit.client.1.smithi129.stdout:0/5: write - no filename 2024-03-18T14:43:09.021 INFO:tasks.workunit.client.1.smithi129.stdout:1/1: symlink l0 0 2024-03-18T14:43:09.021 INFO:tasks.workunit.client.1.smithi129.stdout:1/2: dread - no filename 2024-03-18T14:43:09.021 INFO:tasks.workunit.client.1.smithi129.stdout:1/3: readlink l0 0 2024-03-18T14:43:09.021 INFO:tasks.workunit.client.1.smithi129.stdout:0/6: symlink d0/l1 0 2024-03-18T14:43:09.022 INFO:tasks.workunit.client.1.smithi129.stdout:0/7: dwrite - no filename 2024-03-18T14:43:09.022 INFO:tasks.workunit.client.1.smithi129.stdout:0/8: chown d0/l1 14858742 1 2024-03-18T14:43:09.022 INFO:tasks.workunit.client.1.smithi129.stdout:3/0: chown . 79314 1 2024-03-18T14:43:09.023 INFO:tasks.workunit.client.1.smithi129.stdout:3/1: truncate - no filename 2024-03-18T14:43:09.023 INFO:tasks.workunit.client.1.smithi129.stdout:3/2: dwrite - no filename 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:0/9: chown d0/l1 3 1 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/3: chown . 0 1 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/4: chown . 572278098 1 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/5: dwrite - no filename 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:1/4: mkdir d1 0 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:1/5: dwrite - no filename 2024-03-18T14:43:09.026 INFO:tasks.workunit.client.1.smithi129.stdout:1/6: dread - no filename 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:1/7: write - no filename 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/6: chown . 5956263 1 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/7: stat - no entries 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/8: dread - no filename 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/9: dwrite - no filename 2024-03-18T14:43:09.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/10: truncate - no filename 2024-03-18T14:43:09.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/0: creat f0 x:0 0 0 2024-03-18T14:43:09.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/1: dread - f0 zero size 2024-03-18T14:43:09.028 INFO:tasks.workunit.client.1.smithi129.stdout:0/10: rmdir d0 39 2024-03-18T14:43:09.028 INFO:tasks.workunit.client.1.smithi129.stdout:0/11: dread - no filename 2024-03-18T14:43:09.028 INFO:tasks.workunit.client.1.smithi129.stdout:4/0: dwrite - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/1: dread - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/2: dread - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/3: link - no file 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/2: write f0 [209076,84055] 0 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/3: chown f0 194 1 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:6/0: dread - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/4: mkdir d0 0 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/5: write - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/6: dwrite - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/7: truncate - no filename 2024-03-18T14:43:09.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/4: mknod c1 0 2024-03-18T14:43:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:6/12: sync 2024-03-18T14:43:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:5/95: sync 2024-03-18T14:43:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/113: sync 2024-03-18T14:43:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:1/102: sync 2024-03-18T14:43:09.032 INFO:tasks.workunit.client.0.smithi087.stdout:9/116: sync 2024-03-18T14:43:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/5: sync 2024-03-18T14:43:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/120: sync 2024-03-18T14:43:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:8/22: sync 2024-03-18T14:43:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:0/5: sync 2024-03-18T14:43:09.033 INFO:tasks.workunit.client.0.smithi087.stdout:4/3: sync 2024-03-18T14:43:09.034 INFO:tasks.workunit.client.0.smithi087.stdout:6/13: chown d3 193855 1 2024-03-18T14:43:09.035 INFO:tasks.workunit.client.0.smithi087.stdout:6/14: chown d3 2062 1 2024-03-18T14:43:09.035 INFO:tasks.workunit.client.0.smithi087.stdout:3/121: chown d0/d3/l1b 873 1 2024-03-18T14:43:09.036 INFO:tasks.workunit.client.1.smithi129.stdout:5/0: mkdir d0 0 2024-03-18T14:43:09.036 INFO:tasks.workunit.client.1.smithi129.stdout:5/1: stat d0 0 2024-03-18T14:43:09.038 INFO:tasks.workunit.client.0.smithi087.stdout:4/4: unlink l0 0 2024-03-18T14:43:09.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/6: unlink f0 0 2024-03-18T14:43:09.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/96: creat d13/f1a x:0 0 0 2024-03-18T14:43:09.040 INFO:tasks.workunit.client.0.smithi087.stdout:8/23: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:09.041 INFO:tasks.workunit.client.0.smithi087.stdout:1/103: creat d3/d1d/d1e/f25 x:0 0 0 2024-03-18T14:43:09.043 INFO:tasks.workunit.client.0.smithi087.stdout:7/114: creat d1/d6/da/f25 x:0 0 0 2024-03-18T14:43:09.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/115: stat d1/d6/d16/dc/l19 0 2024-03-18T14:43:09.047 INFO:tasks.workunit.client.0.smithi087.stdout:8/24: mknod d1/c8 0 2024-03-18T14:43:09.048 INFO:tasks.workunit.client.0.smithi087.stdout:7/116: readlink d1/d6/l15 0 2024-03-18T14:43:09.049 INFO:tasks.workunit.client.0.smithi087.stdout:2/7: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/104: creat d3/f26 x:0 0 0 2024-03-18T14:43:09.054 INFO:tasks.workunit.client.0.smithi087.stdout:6/15: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.056 INFO:tasks.workunit.client.0.smithi087.stdout:5/97: dread d13/f17 [0,4194304] 0 2024-03-18T14:43:09.057 INFO:tasks.workunit.client.0.smithi087.stdout:5/98: chown fb 0 1 2024-03-18T14:43:09.058 INFO:tasks.workunit.client.0.smithi087.stdout:7/117: dwrite d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:09.088 INFO:tasks.workunit.client.1.smithi129.stdout:6/1: creat f0 x:0 0 0 2024-03-18T14:43:09.089 INFO:tasks.workunit.client.1.smithi129.stdout:4/8: mknod d0/c1 0 2024-03-18T14:43:09.089 INFO:tasks.workunit.client.1.smithi129.stdout:4/9: write - no filename 2024-03-18T14:43:09.090 INFO:tasks.workunit.client.1.smithi129.stdout:5/2: creat d0/f1 x:0 0 0 2024-03-18T14:43:09.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/12: mknod d0/c2 0 2024-03-18T14:43:09.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/13: dread - no filename 2024-03-18T14:43:09.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/14: fdatasync - no filename 2024-03-18T14:43:09.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/15: chown d0/l1 3703120 1 2024-03-18T14:43:09.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/0: creat f0 x:0 0 0 2024-03-18T14:43:09.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/1: dread - f0 zero size 2024-03-18T14:43:09.095 INFO:tasks.workunit.client.1.smithi129.stdout:6/2: creat f1 x:0 0 0 2024-03-18T14:43:09.096 INFO:tasks.workunit.client.1.smithi129.stdout:4/10: rmdir d0 39 2024-03-18T14:43:09.096 INFO:tasks.workunit.client.1.smithi129.stdout:4/11: dwrite - no filename 2024-03-18T14:43:09.096 INFO:tasks.workunit.client.1.smithi129.stdout:6/3: chown f1 4080926 1 2024-03-18T14:43:09.097 INFO:tasks.workunit.client.1.smithi129.stdout:5/3: creat d0/f2 x:0 0 0 2024-03-18T14:43:09.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/4: stat f1 0 2024-03-18T14:43:09.098 INFO:tasks.workunit.client.1.smithi129.stdout:0/16: mknod d0/c3 0 2024-03-18T14:43:09.098 INFO:tasks.workunit.client.1.smithi129.stdout:0/17: fdatasync - no filename 2024-03-18T14:43:09.098 INFO:tasks.workunit.client.1.smithi129.stdout:0/18: dread - no filename 2024-03-18T14:43:09.098 INFO:tasks.workunit.client.1.smithi129.stdout:8/0: mknod c0 0 2024-03-18T14:43:09.099 INFO:tasks.workunit.client.1.smithi129.stdout:0/19: chown d0 19 1 2024-03-18T14:43:09.099 INFO:tasks.workunit.client.1.smithi129.stdout:0/20: dwrite - no filename 2024-03-18T14:43:09.100 INFO:tasks.workunit.client.1.smithi129.stdout:7/2: dwrite f0 [0,4194304] 0 2024-03-18T14:43:09.100 INFO:tasks.workunit.client.1.smithi129.stdout:0/21: rename d0 to d0/d4 22 2024-03-18T14:43:09.100 INFO:tasks.workunit.client.1.smithi129.stdout:0/22: write - no filename 2024-03-18T14:43:09.101 INFO:tasks.workunit.client.1.smithi129.stdout:7/3: chown f0 571135 1 2024-03-18T14:43:09.101 INFO:tasks.workunit.client.1.smithi129.stdout:6/5: rename f0 to f2 0 2024-03-18T14:43:09.101 INFO:tasks.workunit.client.1.smithi129.stdout:5/4: creat d0/f3 x:0 0 0 2024-03-18T14:43:09.102 INFO:tasks.workunit.client.1.smithi129.stdout:5/5: chown d0/f1 504875106 1 2024-03-18T14:43:09.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/0: mkdir d0 0 2024-03-18T14:43:09.104 INFO:tasks.workunit.client.1.smithi129.stdout:9/1: chown d0 69119 1 2024-03-18T14:43:09.104 INFO:tasks.workunit.client.1.smithi129.stdout:9/2: read - no filename 2024-03-18T14:43:09.104 INFO:tasks.workunit.client.1.smithi129.stdout:5/6: write d0/f1 [652632,113196] 0 2024-03-18T14:43:09.107 INFO:tasks.workunit.client.1.smithi129.stdout:7/4: dread f0 [0,4194304] 0 2024-03-18T14:43:09.108 INFO:tasks.workunit.client.1.smithi129.stdout:7/5: stat f0 0 2024-03-18T14:43:09.109 INFO:tasks.workunit.client.1.smithi129.stdout:6/6: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.109 INFO:tasks.workunit.client.1.smithi129.stdout:8/1: rename c0 to c1 0 2024-03-18T14:43:09.109 INFO:tasks.workunit.client.1.smithi129.stdout:8/2: write - no filename 2024-03-18T14:43:09.110 INFO:tasks.workunit.client.1.smithi129.stdout:6/7: chown f1 6585 1 2024-03-18T14:43:09.110 INFO:tasks.workunit.client.1.smithi129.stdout:0/23: rename d0/c3 to d0/c5 0 2024-03-18T14:43:09.113 INFO:tasks.workunit.client.1.smithi129.stdout:4/12: rename d0/c1 to d0/c2 0 2024-03-18T14:43:09.113 INFO:tasks.workunit.client.1.smithi129.stdout:6/8: dread f1 [0,4194304] 0 2024-03-18T14:43:09.115 INFO:tasks.workunit.client.1.smithi129.stdout:0/24: mknod d0/c6 0 2024-03-18T14:43:09.115 INFO:tasks.workunit.client.1.smithi129.stdout:7/6: fdatasync f0 0 2024-03-18T14:43:09.116 INFO:tasks.workunit.client.1.smithi129.stdout:0/25: chown d0/l1 381 1 2024-03-18T14:43:09.116 INFO:tasks.workunit.client.1.smithi129.stdout:9/3: mknod d0/c1 0 2024-03-18T14:43:09.116 INFO:tasks.workunit.client.1.smithi129.stdout:9/4: dwrite - no filename 2024-03-18T14:43:09.116 INFO:tasks.workunit.client.1.smithi129.stdout:9/5: dread - no filename 2024-03-18T14:43:09.116 INFO:tasks.workunit.client.1.smithi129.stdout:9/6: write - no filename 2024-03-18T14:43:09.120 INFO:tasks.workunit.client.1.smithi129.stdout:4/13: mknod d0/c3 0 2024-03-18T14:43:09.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/7: symlink d0/l2 0 2024-03-18T14:43:09.126 INFO:tasks.workunit.client.1.smithi129.stdout:8/3: rename c1 to c2 0 2024-03-18T14:43:09.127 INFO:tasks.workunit.client.1.smithi129.stdout:4/14: chown d0/c2 857 1 2024-03-18T14:43:09.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/7: truncate d0/f3 653198 0 2024-03-18T14:43:09.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/8: chown d0/f2 45073 1 2024-03-18T14:43:09.129 INFO:tasks.workunit.client.1.smithi129.stdout:6/9: truncate f1 1314534 0 2024-03-18T14:43:09.129 INFO:tasks.workunit.client.1.smithi129.stdout:6/10: chown f1 6232982 1 2024-03-18T14:43:09.131 INFO:tasks.workunit.client.1.smithi129.stdout:7/7: unlink f0 0 2024-03-18T14:43:09.132 INFO:tasks.workunit.client.1.smithi129.stdout:9/8: rmdir d0 39 2024-03-18T14:43:09.132 INFO:tasks.workunit.client.1.smithi129.stdout:9/9: dwrite - no filename 2024-03-18T14:43:09.132 INFO:tasks.workunit.client.1.smithi129.stdout:5/9: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:09.133 INFO:tasks.workunit.client.1.smithi129.stdout:4/15: mknod d0/c4 0 2024-03-18T14:43:09.133 INFO:tasks.workunit.client.1.smithi129.stdout:4/16: dread - no filename 2024-03-18T14:43:09.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/10: write d0/f1 [1569247,43328] 0 2024-03-18T14:43:09.134 INFO:tasks.workunit.client.1.smithi129.stdout:6/11: write f2 [103526,105075] 0 2024-03-18T14:43:09.135 INFO:tasks.workunit.client.1.smithi129.stdout:7/8: creat f1 x:0 0 0 2024-03-18T14:43:09.135 INFO:tasks.workunit.client.0.smithi087.stdout:7/118: write d1/d6/f14 [530634,76736] 0 2024-03-18T14:43:09.136 INFO:tasks.workunit.client.1.smithi129.stdout:7/9: fdatasync f1 0 2024-03-18T14:43:09.136 INFO:tasks.workunit.client.1.smithi129.stdout:7/10: dread - f1 zero size 2024-03-18T14:43:09.139 INFO:tasks.workunit.client.0.smithi087.stdout:1/105: creat d3/d1d/d1e/f27 x:0 0 0 2024-03-18T14:43:09.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/6: getdents d0 0 2024-03-18T14:43:09.141 INFO:tasks.workunit.client.1.smithi129.stdout:7/11: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/122: truncate d0/d1c/f1e 271034 0 2024-03-18T14:43:09.143 INFO:tasks.workunit.client.1.smithi129.stdout:4/17: creat d0/f5 x:0 0 0 2024-03-18T14:43:09.146 INFO:tasks.workunit.client.1.smithi129.stdout:6/12: dread f1 [0,4194304] 0 2024-03-18T14:43:09.147 INFO:tasks.workunit.client.1.smithi129.stdout:0/26: getdents d0 0 2024-03-18T14:43:09.148 INFO:tasks.workunit.client.1.smithi129.stdout:9/10: mknod d0/c3 0 2024-03-18T14:43:09.148 INFO:tasks.workunit.client.1.smithi129.stdout:9/11: dwrite - no filename 2024-03-18T14:43:09.148 INFO:tasks.workunit.client.1.smithi129.stdout:9/12: chown d0/c3 149315323 1 2024-03-18T14:43:09.151 INFO:tasks.workunit.client.1.smithi129.stdout:4/18: creat d0/f6 x:0 0 0 2024-03-18T14:43:09.151 INFO:tasks.workunit.client.1.smithi129.stdout:6/13: dwrite f2 [0,4194304] 0 2024-03-18T14:43:09.154 INFO:tasks.workunit.client.0.smithi087.stdout:4/5: sync 2024-03-18T14:43:09.156 INFO:tasks.workunit.client.1.smithi129.stdout:0/27: mkdir d0/d7 0 2024-03-18T14:43:09.156 INFO:tasks.workunit.client.1.smithi129.stdout:8/4: getdents . 0 2024-03-18T14:43:09.156 INFO:tasks.workunit.client.1.smithi129.stdout:8/5: dwrite - no filename 2024-03-18T14:43:09.156 INFO:tasks.workunit.client.1.smithi129.stdout:9/13: creat d0/f4 x:0 0 0 2024-03-18T14:43:09.157 INFO:tasks.workunit.client.1.smithi129.stdout:9/14: dread - d0/f4 zero size 2024-03-18T14:43:09.158 INFO:tasks.workunit.client.1.smithi129.stdout:6/14: mkdir d3 0 2024-03-18T14:43:09.160 INFO:tasks.workunit.client.1.smithi129.stdout:4/19: unlink d0/f6 0 2024-03-18T14:43:09.162 INFO:tasks.workunit.client.1.smithi129.stdout:8/6: mknod c3 0 2024-03-18T14:43:09.163 INFO:tasks.workunit.client.1.smithi129.stdout:8/7: chown c2 489671 1 2024-03-18T14:43:09.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/15: creat d0/f5 x:0 0 0 2024-03-18T14:43:09.164 INFO:tasks.workunit.client.1.smithi129.stdout:9/16: write d0/f4 [181283,37179] 0 2024-03-18T14:43:09.164 INFO:tasks.workunit.client.1.smithi129.stdout:9/17: chown d0/l2 28 1 2024-03-18T14:43:09.165 INFO:tasks.workunit.client.1.smithi129.stdout:9/18: write d0/f4 [296230,49042] 0 2024-03-18T14:43:09.165 INFO:tasks.workunit.client.1.smithi129.stdout:9/19: read - d0/f5 zero size 2024-03-18T14:43:09.167 INFO:tasks.workunit.client.1.smithi129.stdout:4/20: creat d0/f7 x:0 0 0 2024-03-18T14:43:09.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/8: unlink c3 0 2024-03-18T14:43:09.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/9: write - no filename 2024-03-18T14:43:09.169 INFO:tasks.workunit.client.1.smithi129.stdout:8/10: rmdir - no directory 2024-03-18T14:43:09.169 INFO:tasks.workunit.client.1.smithi129.stdout:8/11: write - no filename 2024-03-18T14:43:09.169 INFO:tasks.workunit.client.1.smithi129.stdout:7/12: getdents . 0 2024-03-18T14:43:09.170 INFO:tasks.workunit.client.1.smithi129.stdout:9/20: fdatasync d0/f4 0 2024-03-18T14:43:09.170 INFO:tasks.workunit.client.1.smithi129.stdout:6/15: symlink d3/l4 0 2024-03-18T14:43:09.173 INFO:tasks.workunit.client.1.smithi129.stdout:9/21: dread d0/f4 [0,4194304] 0 2024-03-18T14:43:09.175 INFO:tasks.workunit.client.1.smithi129.stdout:0/28: rmdir d0/d7 0 2024-03-18T14:43:09.175 INFO:tasks.workunit.client.1.smithi129.stdout:0/29: truncate - no filename 2024-03-18T14:43:09.175 INFO:tasks.workunit.client.1.smithi129.stdout:9/22: fsync d0/f4 0 2024-03-18T14:43:09.175 INFO:tasks.workunit.client.1.smithi129.stdout:0/30: chown d0/l1 28478 1 2024-03-18T14:43:09.178 INFO:tasks.workunit.client.1.smithi129.stdout:4/21: fsync d0/f7 0 2024-03-18T14:43:09.181 INFO:tasks.workunit.client.0.smithi087.stdout:9/117: truncate db/fc 919862 0 2024-03-18T14:43:09.181 INFO:tasks.workunit.client.1.smithi129.stdout:7/13: creat f2 x:0 0 0 2024-03-18T14:43:09.182 INFO:tasks.workunit.client.1.smithi129.stdout:6/16: mkdir d3/d5 0 2024-03-18T14:43:09.183 INFO:tasks.workunit.client.0.smithi087.stdout:8/25: write d1/f2 [3898800,44838] 0 2024-03-18T14:43:09.183 INFO:tasks.workunit.client.1.smithi129.stdout:5/11: truncate d0/f3 320999 0 2024-03-18T14:43:09.183 INFO:tasks.workunit.client.0.smithi087.stdout:8/26: chown d1/f2 78600251 1 2024-03-18T14:43:09.184 INFO:tasks.workunit.client.1.smithi129.stdout:5/12: write d0/f2 [120674,76509] 0 2024-03-18T14:43:09.184 INFO:tasks.workunit.client.1.smithi129.stdout:9/23: symlink d0/l6 0 2024-03-18T14:43:09.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/119: dread d1/f10 [0,4194304] 0 2024-03-18T14:43:09.185 INFO:tasks.workunit.client.0.smithi087.stdout:7/120: chown d1/d6/da/c24 23784 1 2024-03-18T14:43:09.185 INFO:tasks.workunit.client.0.smithi087.stdout:5/99: write d13/f17 [284133,81026] 0 2024-03-18T14:43:09.185 INFO:tasks.workunit.client.0.smithi087.stdout:1/106: creat d3/d1d/f28 x:0 0 0 2024-03-18T14:43:09.186 INFO:tasks.workunit.client.0.smithi087.stdout:5/100: fsync d13/f18 0 2024-03-18T14:43:09.186 INFO:tasks.workunit.client.1.smithi129.stdout:0/31: mknod d0/c8 0 2024-03-18T14:43:09.186 INFO:tasks.workunit.client.1.smithi129.stdout:0/32: dread - no filename 2024-03-18T14:43:09.186 INFO:tasks.workunit.client.1.smithi129.stdout:4/22: creat d0/f8 x:0 0 0 2024-03-18T14:43:09.188 INFO:tasks.workunit.client.1.smithi129.stdout:4/23: fdatasync d0/f5 0 2024-03-18T14:43:09.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/16: creat d3/f4 x:0 0 0 2024-03-18T14:43:09.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/17: chown d3 1983718 1 2024-03-18T14:43:09.189 INFO:tasks.workunit.client.1.smithi129.stdout:7/14: creat f3 x:0 0 0 2024-03-18T14:43:09.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/24: dwrite d0/f4 [0,4194304] 0 2024-03-18T14:43:09.189 INFO:tasks.workunit.client.0.smithi087.stdout:8/27: rmdir d1 39 2024-03-18T14:43:09.190 INFO:tasks.workunit.client.1.smithi129.stdout:7/15: dread - f2 zero size 2024-03-18T14:43:09.190 INFO:tasks.workunit.client.1.smithi129.stdout:9/25: chown d0 50204663 1 2024-03-18T14:43:09.190 INFO:tasks.workunit.client.1.smithi129.stdout:6/17: mkdir d3/d6 0 2024-03-18T14:43:09.190 INFO:tasks.workunit.client.1.smithi129.stdout:9/26: dread - d0/f5 zero size 2024-03-18T14:43:09.191 INFO:tasks.workunit.client.1.smithi129.stdout:5/13: creat d0/f4 x:0 0 0 2024-03-18T14:43:09.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/7: mkdir d0/d2/d4 0 2024-03-18T14:43:09.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/8: dread - d0/f3 zero size 2024-03-18T14:43:09.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/9: stat d0/f3 0 2024-03-18T14:43:09.193 INFO:tasks.workunit.client.0.smithi087.stdout:1/107: symlink d3/l29 0 2024-03-18T14:43:09.194 INFO:tasks.workunit.client.1.smithi129.stdout:0/33: creat d0/f9 x:0 0 0 2024-03-18T14:43:09.194 INFO:tasks.workunit.client.1.smithi129.stdout:0/34: write d0/f9 [888931,20760] 0 2024-03-18T14:43:09.194 INFO:tasks.workunit.client.1.smithi129.stdout:7/16: mkdir d4 0 2024-03-18T14:43:09.197 INFO:tasks.workunit.client.0.smithi087.stdout:7/121: rename d1/d6/d16/f21 to d1/d6/d16/dc/f26 0 2024-03-18T14:43:09.197 INFO:tasks.workunit.client.0.smithi087.stdout:7/122: stat d1 0 2024-03-18T14:43:09.197 INFO:tasks.workunit.client.0.smithi087.stdout:3/123: dwrite d0/f1 [0,4194304] 0 2024-03-18T14:43:09.198 INFO:tasks.workunit.client.0.smithi087.stdout:3/124: stat d0/d3/df/f1d 0 2024-03-18T14:43:09.198 INFO:tasks.workunit.client.1.smithi129.stdout:6/18: fsync f1 0 2024-03-18T14:43:09.199 INFO:tasks.workunit.client.1.smithi129.stdout:6/19: rename d3 to d3/d5/d7 22 2024-03-18T14:43:09.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/8: sync 2024-03-18T14:43:09.200 INFO:tasks.workunit.client.1.smithi129.stdout:8/12: getdents . 0 2024-03-18T14:43:09.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/118: creat db/d18/d1e/f21 x:0 0 0 2024-03-18T14:43:09.200 INFO:tasks.workunit.client.0.smithi087.stdout:2/9: chown f1 4 1 2024-03-18T14:43:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/10: chown f1 150778650 1 2024-03-18T14:43:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/18: creat d3/f5 x:0 0 0 2024-03-18T14:43:09.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/123: dread d1/d6/da/ff [0,4194304] 0 2024-03-18T14:43:09.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/28: read d1/f5 [719956,73905] 0 2024-03-18T14:43:09.202 INFO:tasks.workunit.client.0.smithi087.stdout:9/119: read db/ff [642453,26599] 0 2024-03-18T14:43:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/10: symlink d0/l5 0 2024-03-18T14:43:09.204 INFO:tasks.workunit.client.1.smithi129.stdout:8/13: creat f4 x:0 0 0 2024-03-18T14:43:09.204 INFO:tasks.workunit.client.0.smithi087.stdout:1/108: mknod d3/d1d/c2a 0 2024-03-18T14:43:09.205 INFO:tasks.workunit.client.1.smithi129.stdout:7/17: getdents d4 0 2024-03-18T14:43:09.205 INFO:tasks.workunit.client.1.smithi129.stdout:7/18: dread - f2 zero size 2024-03-18T14:43:09.205 INFO:tasks.workunit.client.1.smithi129.stdout:9/27: link d0/c3 d0/c7 0 2024-03-18T14:43:09.207 INFO:tasks.workunit.client.1.smithi129.stdout:6/20: creat d3/d6/f8 x:0 0 0 2024-03-18T14:43:09.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/120: dread db/d12/f20 [0,4194304] 0 2024-03-18T14:43:09.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/29: dwrite d1/f2 [0,4194304] 0 2024-03-18T14:43:09.208 INFO:tasks.workunit.client.1.smithi129.stdout:6/21: chown d3/d6/f8 28814 1 2024-03-18T14:43:09.209 INFO:tasks.workunit.client.1.smithi129.stdout:7/19: rename f2 to d4/f5 0 2024-03-18T14:43:09.210 INFO:tasks.workunit.client.0.smithi087.stdout:2/11: mkdir d2 0 2024-03-18T14:43:09.210 INFO:tasks.workunit.client.1.smithi129.stdout:6/22: write f2 [834154,51753] 0 2024-03-18T14:43:09.210 INFO:tasks.workunit.client.1.smithi129.stdout:7/20: fdatasync f3 0 2024-03-18T14:43:09.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/12: write f1 [2786727,60645] 0 2024-03-18T14:43:09.211 INFO:tasks.workunit.client.0.smithi087.stdout:6/19: creat d3/f6 x:0 0 0 2024-03-18T14:43:09.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/13: stat d2 0 2024-03-18T14:43:09.212 INFO:tasks.workunit.client.1.smithi129.stdout:9/28: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:09.213 INFO:tasks.workunit.client.1.smithi129.stdout:9/29: write d0/f5 [1993171,28158] 0 2024-03-18T14:43:09.213 INFO:tasks.workunit.client.1.smithi129.stdout:8/14: link c2 c5 0 2024-03-18T14:43:09.214 INFO:tasks.workunit.client.1.smithi129.stdout:8/15: fdatasync f4 0 2024-03-18T14:43:09.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/124: creat d1/d6/d16/dc/f27 x:0 0 0 2024-03-18T14:43:09.215 INFO:tasks.workunit.client.1.smithi129.stdout:7/21: dread f1 [0,4194304] 0 2024-03-18T14:43:09.216 INFO:tasks.workunit.client.0.smithi087.stdout:7/125: write f0 [3148356,62368] 0 2024-03-18T14:43:09.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/30: creat d0/f8 x:0 0 0 2024-03-18T14:43:09.217 INFO:tasks.workunit.client.0.smithi087.stdout:1/109: rename d3/l29 to d3/d1d/d1f/l2b 0 2024-03-18T14:43:09.218 INFO:tasks.workunit.client.1.smithi129.stdout:9/31: chown d0/l2 349031318 1 2024-03-18T14:43:09.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/16: creat f6 x:0 0 0 2024-03-18T14:43:09.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/20: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.218 INFO:tasks.workunit.client.0.smithi087.stdout:2/14: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.219 INFO:tasks.workunit.client.0.smithi087.stdout:9/121: creat db/f22 x:0 0 0 2024-03-18T14:43:09.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/23: creat d3/d5/f9 x:0 0 0 2024-03-18T14:43:09.219 INFO:tasks.workunit.client.0.smithi087.stdout:2/15: write f1 [1739197,28816] 0 2024-03-18T14:43:09.220 INFO:tasks.workunit.client.1.smithi129.stdout:6/24: write d3/d5/f9 [47625,16510] 0 2024-03-18T14:43:09.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/6: sync 2024-03-18T14:43:09.223 INFO:tasks.workunit.client.0.smithi087.stdout:0/11: getdents d0/d2/d4 0 2024-03-18T14:43:09.224 INFO:tasks.workunit.client.1.smithi129.stdout:0/35: rmdir d0 39 2024-03-18T14:43:09.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/126: dwrite d1/d6/d16/dc/f27 [0,4194304] 0 2024-03-18T14:43:09.227 INFO:tasks.workunit.client.0.smithi087.stdout:2/16: dread f1 [0,4194304] 0 2024-03-18T14:43:09.227 INFO:tasks.workunit.client.0.smithi087.stdout:6/21: mkdir d3/d7 0 2024-03-18T14:43:09.228 INFO:tasks.workunit.client.0.smithi087.stdout:7/127: dread - d1/f20 zero size 2024-03-18T14:43:09.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/110: rename d3/d1d/d1e/f25 to d3/f2c 0 2024-03-18T14:43:09.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/22: dread - d3/f5 zero size 2024-03-18T14:43:09.230 INFO:tasks.workunit.client.1.smithi129.stdout:7/22: link f3 d4/f6 0 2024-03-18T14:43:09.230 INFO:tasks.workunit.client.1.smithi129.stdout:8/17: chown c5 18461 1 2024-03-18T14:43:09.231 INFO:tasks.workunit.client.1.smithi129.stdout:9/32: rename d0/c7 to d0/c9 0 2024-03-18T14:43:09.231 INFO:tasks.workunit.client.1.smithi129.stdout:0/36: chown d0 1980218494 1 2024-03-18T14:43:09.231 INFO:tasks.workunit.client.1.smithi129.stdout:8/18: write f4 [83396,108445] 0 2024-03-18T14:43:09.233 INFO:tasks.workunit.client.0.smithi087.stdout:4/7: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.233 INFO:tasks.workunit.client.1.smithi129.stdout:9/33: dread d0/f4 [0,4194304] 0 2024-03-18T14:43:09.234 INFO:tasks.workunit.client.1.smithi129.stdout:9/34: write d0/f8 [795016,96664] 0 2024-03-18T14:43:09.236 INFO:tasks.workunit.client.0.smithi087.stdout:0/12: dwrite d0/f3 [0,4194304] 0 2024-03-18T14:43:09.236 INFO:tasks.workunit.client.1.smithi129.stdout:7/23: mkdir d4/d7 0 2024-03-18T14:43:09.237 INFO:tasks.workunit.client.1.smithi129.stdout:9/35: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:09.238 INFO:tasks.workunit.client.0.smithi087.stdout:0/13: readlink d0/l5 0 2024-03-18T14:43:09.238 INFO:tasks.workunit.client.1.smithi129.stdout:9/36: stat d0/l2 0 2024-03-18T14:43:09.238 INFO:tasks.workunit.client.1.smithi129.stdout:9/37: stat d0/f5 0 2024-03-18T14:43:09.239 INFO:tasks.workunit.client.1.smithi129.stdout:9/38: fsync d0/f4 0 2024-03-18T14:43:09.242 INFO:tasks.workunit.client.0.smithi087.stdout:0/14: write d0/f3 [2958279,44275] 0 2024-03-18T14:43:09.244 INFO:tasks.workunit.client.0.smithi087.stdout:6/23: dwrite d3/f6 [0,4194304] 0 2024-03-18T14:43:09.244 INFO:tasks.workunit.client.0.smithi087.stdout:1/111: dwrite d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:09.245 INFO:tasks.workunit.client.1.smithi129.stdout:8/19: symlink l7 0 2024-03-18T14:43:09.245 INFO:tasks.workunit.client.0.smithi087.stdout:1/112: chown d3 1217349732 1 2024-03-18T14:43:09.245 INFO:tasks.workunit.client.1.smithi129.stdout:5/14: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:09.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/101: truncate fb 816280 0 2024-03-18T14:43:09.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/8: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/24: chown d3/f5 42238787 1 2024-03-18T14:43:09.246 INFO:tasks.workunit.client.1.smithi129.stdout:7/24: write d4/f6 [547499,75161] 0 2024-03-18T14:43:09.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/125: write d0/d3/df/f1d [1111821,121177] 0 2024-03-18T14:43:09.248 INFO:tasks.workunit.client.0.smithi087.stdout:3/126: readlink d0/d3/l9 0 2024-03-18T14:43:09.250 INFO:tasks.workunit.client.1.smithi129.stdout:8/20: dwrite f6 [0,4194304] 0 2024-03-18T14:43:09.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/25: dwrite d3/f6 [0,4194304] 0 2024-03-18T14:43:09.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/26: fdatasync d3/f4 0 2024-03-18T14:43:09.254 INFO:tasks.workunit.client.0.smithi087.stdout:6/27: fdatasync d3/f4 0 2024-03-18T14:43:09.254 INFO:tasks.workunit.client.1.smithi129.stdout:7/25: mkdir d4/d7/d8 0 2024-03-18T14:43:09.255 INFO:tasks.workunit.client.0.smithi087.stdout:8/30: dwrite d1/f5 [0,4194304] 0 2024-03-18T14:43:09.255 INFO:tasks.workunit.client.0.smithi087.stdout:7/128: rmdir d1/d6 39 2024-03-18T14:43:09.256 INFO:tasks.workunit.client.1.smithi129.stdout:8/21: dwrite f4 [0,4194304] 0 2024-03-18T14:43:09.257 INFO:tasks.workunit.client.1.smithi129.stdout:5/15: getdents d0 0 2024-03-18T14:43:09.258 INFO:tasks.workunit.client.1.smithi129.stdout:5/16: rename d0 to d0/d5 22 2024-03-18T14:43:09.260 INFO:tasks.workunit.client.0.smithi087.stdout:8/31: dwrite d1/f5 [0,4194304] 0 2024-03-18T14:43:09.260 INFO:tasks.workunit.client.1.smithi129.stdout:7/26: dwrite f3 [0,4194304] 0 2024-03-18T14:43:09.261 INFO:tasks.workunit.client.1.smithi129.stdout:5/17: write d0/f1 [1238847,100516] 0 2024-03-18T14:43:09.262 INFO:tasks.workunit.client.1.smithi129.stdout:5/18: fdatasync d0/f2 0 2024-03-18T14:43:09.263 INFO:tasks.workunit.client.0.smithi087.stdout:2/17: getdents d2 0 2024-03-18T14:43:09.263 INFO:tasks.workunit.client.0.smithi087.stdout:9/122: truncate db/f10 273997 0 2024-03-18T14:43:09.263 INFO:tasks.workunit.client.0.smithi087.stdout:0/15: symlink d0/l6 0 2024-03-18T14:43:09.263 INFO:tasks.workunit.client.0.smithi087.stdout:4/9: mkdir d2 0 2024-03-18T14:43:09.263 INFO:tasks.workunit.client.1.smithi129.stdout:5/19: chown d0/f1 656 1 2024-03-18T14:43:09.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/16: read d0/f3 [3765242,6805] 0 2024-03-18T14:43:09.264 INFO:tasks.workunit.client.0.smithi087.stdout:0/17: chown d0/l6 35 1 2024-03-18T14:43:09.264 INFO:tasks.workunit.client.0.smithi087.stdout:5/102: rmdir d13 39 2024-03-18T14:43:09.265 INFO:tasks.workunit.client.1.smithi129.stdout:7/27: creat d4/d7/d8/f9 x:0 0 0 2024-03-18T14:43:09.268 INFO:tasks.workunit.client.1.smithi129.stdout:7/28: creat d4/d7/fa x:0 0 0 2024-03-18T14:43:09.268 INFO:tasks.workunit.client.0.smithi087.stdout:0/18: dwrite d0/f3 [0,4194304] 0 2024-03-18T14:43:09.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/113: symlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:09.271 INFO:tasks.workunit.client.0.smithi087.stdout:3/127: symlink d0/d3/df/l20 0 2024-03-18T14:43:09.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/123: mknod db/c23 0 2024-03-18T14:43:09.276 INFO:tasks.workunit.client.0.smithi087.stdout:9/124: chown db/f11 866296 1 2024-03-18T14:43:09.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/128: dwrite d0/d3/d10/f1f [0,4194304] 0 2024-03-18T14:43:09.280 INFO:tasks.workunit.client.0.smithi087.stdout:0/19: rename d0/c1 to d0/d2/d4/c7 0 2024-03-18T14:43:09.282 INFO:tasks.workunit.client.0.smithi087.stdout:1/114: unlink d3/f15 0 2024-03-18T14:43:09.283 INFO:tasks.workunit.client.0.smithi087.stdout:8/32: mkdir d1/d6/d9 0 2024-03-18T14:43:09.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/33: chown d1/f2 297844 1 2024-03-18T14:43:09.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/34: stat d1/d6/d9 0 2024-03-18T14:43:09.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/115: dread d3/fc [0,4194304] 0 2024-03-18T14:43:09.286 INFO:tasks.workunit.client.0.smithi087.stdout:2/18: mkdir d2/d3 0 2024-03-18T14:43:09.287 INFO:tasks.workunit.client.0.smithi087.stdout:4/10: mknod d2/c3 0 2024-03-18T14:43:09.288 INFO:tasks.workunit.client.0.smithi087.stdout:9/125: creat db/d18/d1e/f24 x:0 0 0 2024-03-18T14:43:09.288 INFO:tasks.workunit.client.0.smithi087.stdout:3/129: creat d0/d3/d10/f21 x:0 0 0 2024-03-18T14:43:09.290 INFO:tasks.workunit.client.0.smithi087.stdout:5/103: mkdir d13/d1b 0 2024-03-18T14:43:09.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/126: chown db/ff 23 1 2024-03-18T14:43:09.291 INFO:tasks.workunit.client.0.smithi087.stdout:9/127: chown db/d18/d1e 110 1 2024-03-18T14:43:09.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/35: dwrite d1/f5 [0,4194304] 0 2024-03-18T14:43:09.291 INFO:tasks.workunit.client.0.smithi087.stdout:0/20: write d0/f3 [149227,34442] 0 2024-03-18T14:43:09.292 INFO:tasks.workunit.client.0.smithi087.stdout:8/36: stat d1/d6 0 2024-03-18T14:43:09.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/28: fsync f1 0 2024-03-18T14:43:09.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/116: rename d3/d1d/d1e/f27 to d3/d1d/d1f/f2e 0 2024-03-18T14:43:09.297 INFO:tasks.workunit.client.0.smithi087.stdout:0/21: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:09.297 INFO:tasks.workunit.client.0.smithi087.stdout:8/37: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:09.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/11: creat d2/f4 x:0 0 0 2024-03-18T14:43:09.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/29: dwrite d3/f4 [0,4194304] 0 2024-03-18T14:43:09.304 INFO:tasks.workunit.client.0.smithi087.stdout:7/129: link d1/d6/da/f22 d1/f28 0 2024-03-18T14:43:09.312 INFO:tasks.workunit.client.1.smithi129.stdout:6/25: fsync d3/d5/f9 0 2024-03-18T14:43:09.312 INFO:tasks.workunit.client.1.smithi129.stdout:6/26: chown d3/l4 2053109223 1 2024-03-18T14:43:09.313 INFO:tasks.workunit.client.1.smithi129.stdout:6/27: dread - d3/d6/f8 zero size 2024-03-18T14:43:09.315 INFO:tasks.workunit.client.1.smithi129.stdout:6/28: unlink d3/l4 0 2024-03-18T14:43:09.315 INFO:tasks.workunit.client.1.smithi129.stdout:6/29: stat f2 0 2024-03-18T14:43:09.316 INFO:tasks.workunit.client.1.smithi129.stdout:6/30: fdatasync f2 0 2024-03-18T14:43:09.316 INFO:tasks.workunit.client.1.smithi129.stdout:6/31: chown d3/d6/f8 116753722 1 2024-03-18T14:43:09.316 INFO:tasks.workunit.client.1.smithi129.stdout:6/32: fdatasync f1 0 2024-03-18T14:43:09.318 INFO:tasks.workunit.client.1.smithi129.stdout:6/33: read d3/d5/f9 [2775,36241] 0 2024-03-18T14:43:09.321 INFO:tasks.workunit.client.1.smithi129.stdout:6/34: rename f2 to d3/d5/fa 0 2024-03-18T14:43:09.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/35: read f1 [954131,64357] 0 2024-03-18T14:43:09.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/36: read d3/d5/f9 [13406,24205] 0 2024-03-18T14:43:09.323 INFO:tasks.workunit.client.1.smithi129.stdout:6/37: chown d3/d5 0 1 2024-03-18T14:43:09.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/104: dwrite ff [8388608,4194304] 0 2024-03-18T14:43:09.325 INFO:tasks.workunit.client.0.smithi087.stdout:4/12: creat d2/f5 x:0 0 0 2024-03-18T14:43:09.325 INFO:tasks.workunit.client.0.smithi087.stdout:1/117: write d3/f19 [3567853,11476] 0 2024-03-18T14:43:09.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/38: creat d1/d6/fa x:0 0 0 2024-03-18T14:43:09.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/118: dread - d3/d1d/d1f/f24 zero size 2024-03-18T14:43:09.328 INFO:tasks.workunit.client.0.smithi087.stdout:1/119: read d3/d1d/f28 [1285074,50293] 0 2024-03-18T14:43:09.333 INFO:tasks.workunit.client.0.smithi087.stdout:6/30: mkdir d3/d7/d8 0 2024-03-18T14:43:09.333 INFO:tasks.workunit.client.1.smithi129.stdout:0/37: truncate d0/f9 866653 0 2024-03-18T14:43:09.334 INFO:tasks.workunit.client.0.smithi087.stdout:6/31: write f1 [2182100,47433] 0 2024-03-18T14:43:09.336 INFO:tasks.workunit.client.1.smithi129.stdout:6/38: getdents d3/d6 0 2024-03-18T14:43:09.337 INFO:tasks.workunit.client.1.smithi129.stdout:6/39: chown d3/d6/f8 1 1 2024-03-18T14:43:09.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/130: mkdir d1/d6/d29 0 2024-03-18T14:43:09.337 INFO:tasks.workunit.client.0.smithi087.stdout:8/39: symlink d1/lb 0 2024-03-18T14:43:09.339 INFO:tasks.workunit.client.1.smithi129.stdout:6/40: dread d3/d5/fa [0,4194304] 0 2024-03-18T14:43:09.341 INFO:tasks.workunit.client.1.smithi129.stdout:6/41: dread d3/d5/f9 [0,4194304] 0 2024-03-18T14:43:09.341 INFO:tasks.workunit.client.1.smithi129.stdout:0/38: mknod d0/ca 0 2024-03-18T14:43:09.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/120: unlink d3/f26 0 2024-03-18T14:43:09.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/121: read - d3/f2c zero size 2024-03-18T14:43:09.346 INFO:tasks.workunit.client.1.smithi129.stdout:6/42: dwrite d3/d5/fa [0,4194304] 0 2024-03-18T14:43:09.348 INFO:tasks.workunit.client.0.smithi087.stdout:6/32: mknod d3/d7/d8/c9 0 2024-03-18T14:43:09.348 INFO:tasks.workunit.client.0.smithi087.stdout:6/33: read f1 [1957192,90145] 0 2024-03-18T14:43:09.349 INFO:tasks.workunit.client.1.smithi129.stdout:6/43: mkdir d3/d5/db 0 2024-03-18T14:43:09.349 INFO:tasks.workunit.client.1.smithi129.stdout:6/44: chown d3 4134905 1 2024-03-18T14:43:09.349 INFO:tasks.workunit.client.1.smithi129.stdout:6/45: chown d3 7255 1 2024-03-18T14:43:09.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/46: fsync d3/d6/f8 0 2024-03-18T14:43:09.350 INFO:tasks.workunit.client.0.smithi087.stdout:6/34: read d3/f6 [2698910,10721] 0 2024-03-18T14:43:09.350 INFO:tasks.workunit.client.0.smithi087.stdout:8/40: creat d1/d6/d9/fc x:0 0 0 2024-03-18T14:43:09.352 INFO:tasks.workunit.client.1.smithi129.stdout:6/47: mknod d3/d5/db/cc 0 2024-03-18T14:43:09.353 INFO:tasks.workunit.client.0.smithi087.stdout:6/35: creat d3/fa x:0 0 0 2024-03-18T14:43:09.354 INFO:tasks.workunit.client.1.smithi129.stdout:6/48: creat d3/d5/db/fd x:0 0 0 2024-03-18T14:43:09.354 INFO:tasks.workunit.client.0.smithi087.stdout:8/41: dwrite d1/f2 [4194304,4194304] 0 2024-03-18T14:43:09.355 INFO:tasks.workunit.client.1.smithi129.stdout:6/49: read d3/d5/fa [3795845,122261] 0 2024-03-18T14:43:09.355 INFO:tasks.workunit.client.1.smithi129.stdout:6/50: dread - d3/d5/db/fd zero size 2024-03-18T14:43:09.356 INFO:tasks.workunit.client.0.smithi087.stdout:6/36: stat c2 0 2024-03-18T14:43:09.358 INFO:tasks.workunit.client.0.smithi087.stdout:8/42: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:09.360 INFO:tasks.workunit.client.1.smithi129.stdout:6/51: dwrite d3/d5/f9 [0,4194304] 0 2024-03-18T14:43:09.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/37: dread f1 [0,4194304] 0 2024-03-18T14:43:09.365 INFO:tasks.workunit.client.1.smithi129.stdout:6/52: dwrite d3/d5/f9 [0,4194304] 0 2024-03-18T14:43:09.366 INFO:tasks.workunit.client.0.smithi087.stdout:2/19: truncate f1 3378228 0 2024-03-18T14:43:09.371 INFO:tasks.workunit.client.1.smithi129.stdout:8/22: truncate f6 1472960 0 2024-03-18T14:43:09.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/105: fdatasync ff 0 2024-03-18T14:43:09.374 INFO:tasks.workunit.client.0.smithi087.stdout:9/128: truncate f1 1345390 0 2024-03-18T14:43:09.375 INFO:tasks.workunit.client.0.smithi087.stdout:9/129: stat db/f1a 0 2024-03-18T14:43:09.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/13: truncate f1 2369278 0 2024-03-18T14:43:09.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/14: stat d2/c3 0 2024-03-18T14:43:09.378 INFO:tasks.workunit.client.0.smithi087.stdout:3/130: dwrite d0/de/f12 [0,4194304] 0 2024-03-18T14:43:09.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/15: rename d2 to d2/d6 22 2024-03-18T14:43:09.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/20: rename d2/d3 to d2/d4 0 2024-03-18T14:43:09.381 INFO:tasks.workunit.client.0.smithi087.stdout:1/122: dwrite d3/d1d/d1f/f24 [0,4194304] 0 2024-03-18T14:43:09.381 INFO:tasks.workunit.client.0.smithi087.stdout:9/130: dread f8 [0,4194304] 0 2024-03-18T14:43:09.383 INFO:tasks.workunit.client.1.smithi129.stdout:0/39: dread d0/f9 [0,4194304] 0 2024-03-18T14:43:09.384 INFO:tasks.workunit.client.1.smithi129.stdout:0/40: chown d0/c2 7409 1 2024-03-18T14:43:09.385 INFO:tasks.workunit.client.0.smithi087.stdout:3/131: mknod d0/c22 0 2024-03-18T14:43:09.386 INFO:tasks.workunit.client.1.smithi129.stdout:0/41: creat d0/fb x:0 0 0 2024-03-18T14:43:09.387 INFO:tasks.workunit.client.1.smithi129.stdout:0/42: dread d0/f9 [0,4194304] 0 2024-03-18T14:43:09.388 INFO:tasks.workunit.client.1.smithi129.stdout:0/43: dread - d0/fb zero size 2024-03-18T14:43:09.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/123: chown d3/c13 94058 1 2024-03-18T14:43:09.390 INFO:tasks.workunit.client.0.smithi087.stdout:9/131: rmdir db/d18 39 2024-03-18T14:43:09.390 INFO:tasks.workunit.client.0.smithi087.stdout:9/132: fsync f8 0 2024-03-18T14:43:09.392 INFO:tasks.workunit.client.1.smithi129.stdout:0/44: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:09.394 INFO:tasks.workunit.client.1.smithi129.stdout:8/23: dwrite f6 [0,4194304] 0 2024-03-18T14:43:09.394 INFO:tasks.workunit.client.0.smithi087.stdout:1/124: truncate d3/f8 1582967 0 2024-03-18T14:43:09.395 INFO:tasks.workunit.client.1.smithi129.stdout:0/45: write d0/f9 [1337523,13475] 0 2024-03-18T14:43:09.395 INFO:tasks.workunit.client.0.smithi087.stdout:1/125: write d3/fc [4582940,51647] 0 2024-03-18T14:43:09.395 INFO:tasks.workunit.client.1.smithi129.stdout:8/24: write f6 [235193,83147] 0 2024-03-18T14:43:09.396 INFO:tasks.workunit.client.0.smithi087.stdout:1/126: write d3/d1d/d1f/f24 [3244428,95956] 0 2024-03-18T14:43:09.396 INFO:tasks.workunit.client.0.smithi087.stdout:3/132: truncate d0/d1c/f1e 913393 0 2024-03-18T14:43:09.397 INFO:tasks.workunit.client.0.smithi087.stdout:1/127: dread - d3/d1d/f22 zero size 2024-03-18T14:43:09.398 INFO:tasks.workunit.client.0.smithi087.stdout:4/16: getdents d2 0 2024-03-18T14:43:09.398 INFO:tasks.workunit.client.1.smithi129.stdout:8/25: creat f8 x:0 0 0 2024-03-18T14:43:09.398 INFO:tasks.workunit.client.1.smithi129.stdout:8/26: rmdir - no directory 2024-03-18T14:43:09.398 INFO:tasks.workunit.client.0.smithi087.stdout:1/128: fdatasync d3/d1d/f21 0 2024-03-18T14:43:09.399 INFO:tasks.workunit.client.1.smithi129.stdout:8/27: write f8 [317088,31063] 0 2024-03-18T14:43:09.399 INFO:tasks.workunit.client.1.smithi129.stdout:0/46: rename d0/ca to d0/cc 0 2024-03-18T14:43:09.400 INFO:tasks.workunit.client.1.smithi129.stdout:8/28: write f6 [2724471,74687] 0 2024-03-18T14:43:09.400 INFO:tasks.workunit.client.1.smithi129.stdout:0/47: read d0/fb [2426287,62904] 0 2024-03-18T14:43:09.400 INFO:tasks.workunit.client.0.smithi087.stdout:9/133: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:09.402 INFO:tasks.workunit.client.0.smithi087.stdout:2/21: fsync f1 0 2024-03-18T14:43:09.403 INFO:tasks.workunit.client.0.smithi087.stdout:1/129: dread d3/fc [0,4194304] 0 2024-03-18T14:43:09.403 INFO:tasks.workunit.client.1.smithi129.stdout:8/29: mkdir d9 0 2024-03-18T14:43:09.404 INFO:tasks.workunit.client.1.smithi129.stdout:0/48: creat d0/fd x:0 0 0 2024-03-18T14:43:09.406 INFO:tasks.workunit.client.1.smithi129.stdout:8/30: dread f4 [0,4194304] 0 2024-03-18T14:43:09.407 INFO:tasks.workunit.client.0.smithi087.stdout:8/43: truncate d1/f2 959920 0 2024-03-18T14:43:09.407 INFO:tasks.workunit.client.0.smithi087.stdout:6/38: truncate d3/f6 3448633 0 2024-03-18T14:43:09.409 INFO:tasks.workunit.client.1.smithi129.stdout:8/31: mknod d9/ca 0 2024-03-18T14:43:09.409 INFO:tasks.workunit.client.1.smithi129.stdout:8/32: chown d9 13261871 1 2024-03-18T14:43:09.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/49: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:09.412 INFO:tasks.workunit.client.1.smithi129.stdout:8/33: mknod d9/cb 0 2024-03-18T14:43:09.416 INFO:tasks.workunit.client.0.smithi087.stdout:1/130: dread d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:09.417 INFO:tasks.workunit.client.1.smithi129.stdout:0/50: mknod d0/ce 0 2024-03-18T14:43:09.418 INFO:tasks.workunit.client.1.smithi129.stdout:8/34: mkdir d9/dc 0 2024-03-18T14:43:09.418 INFO:tasks.workunit.client.1.smithi129.stdout:0/51: dread - d0/fd zero size 2024-03-18T14:43:09.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/133: rename d0/f2 to d0/d3/df/f23 0 2024-03-18T14:43:09.419 INFO:tasks.workunit.client.1.smithi129.stdout:0/52: stat d0/l1 0 2024-03-18T14:43:09.419 INFO:tasks.workunit.client.0.smithi087.stdout:9/134: mknod db/c25 0 2024-03-18T14:43:09.421 INFO:tasks.workunit.client.0.smithi087.stdout:0/22: sync 2024-03-18T14:43:09.421 INFO:tasks.workunit.client.1.smithi129.stdout:0/53: rename d0/f9 to d0/ff 0 2024-03-18T14:43:09.422 INFO:tasks.workunit.client.0.smithi087.stdout:8/44: link d1/d6/d9/fc d1/fd 0 2024-03-18T14:43:09.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/134: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:09.424 INFO:tasks.workunit.client.1.smithi129.stdout:8/35: dwrite f4 [0,4194304] 0 2024-03-18T14:43:09.424 INFO:tasks.workunit.client.0.smithi087.stdout:5/106: write fb [18686,57852] 0 2024-03-18T14:43:09.425 INFO:tasks.workunit.client.0.smithi087.stdout:3/135: chown d0/l8 973047 1 2024-03-18T14:43:09.425 INFO:tasks.workunit.client.0.smithi087.stdout:1/131: rmdir d3/d1d/d1f 39 2024-03-18T14:43:09.425 INFO:tasks.workunit.client.0.smithi087.stdout:9/135: dread db/f1a [0,4194304] 0 2024-03-18T14:43:09.427 INFO:tasks.workunit.client.0.smithi087.stdout:0/23: write d0/f3 [1751313,77991] 0 2024-03-18T14:43:09.428 INFO:tasks.workunit.client.0.smithi087.stdout:5/107: dread d13/f17 [0,4194304] 0 2024-03-18T14:43:09.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/136: symlink d0/de/l24 0 2024-03-18T14:43:09.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/137: readlink d0/d3/l15 0 2024-03-18T14:43:09.434 INFO:tasks.workunit.client.0.smithi087.stdout:9/136: mknod db/d12/c26 0 2024-03-18T14:43:09.436 INFO:tasks.workunit.client.0.smithi087.stdout:1/132: rmdir d3 39 2024-03-18T14:43:09.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/24: creat d0/f8 x:0 0 0 2024-03-18T14:43:09.440 INFO:tasks.workunit.client.0.smithi087.stdout:3/138: mkdir d0/d1c/d25 0 2024-03-18T14:43:09.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/139: fsync d0/d3/d10/f1f 0 2024-03-18T14:43:09.444 INFO:tasks.workunit.client.0.smithi087.stdout:9/137: creat db/d18/d1c/f27 x:0 0 0 2024-03-18T14:43:09.444 INFO:tasks.workunit.client.1.smithi129.stdout:8/36: read f8 [7898,14104] 0 2024-03-18T14:43:09.445 INFO:tasks.workunit.client.0.smithi087.stdout:1/133: mknod d3/d1d/d1e/d20/c2f 0 2024-03-18T14:43:09.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/108: truncate d13/f16 720810 0 2024-03-18T14:43:09.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/109: read f11 [4008894,9759] 0 2024-03-18T14:43:09.447 INFO:tasks.workunit.client.0.smithi087.stdout:9/138: unlink db/d12/l13 0 2024-03-18T14:43:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:3/140: symlink d0/d1c/d25/l26 0 2024-03-18T14:43:09.448 INFO:tasks.workunit.client.0.smithi087.stdout:9/139: write db/d18/d1c/f27 [904336,124618] 0 2024-03-18T14:43:09.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/141: chown d0/d3/df/f16 53752 1 2024-03-18T14:43:09.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/25: getdents d0/d2/d4 0 2024-03-18T14:43:09.454 INFO:tasks.workunit.client.1.smithi129.stdout:8/37: dread f8 [0,4194304] 0 2024-03-18T14:43:09.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/142: creat d0/f27 x:0 0 0 2024-03-18T14:43:09.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/110: creat d13/d1b/f1c x:0 0 0 2024-03-18T14:43:09.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/26: dwrite d0/f3 [0,4194304] 0 2024-03-18T14:43:09.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/45: dread d1/f2 [0,4194304] 0 2024-03-18T14:43:09.456 INFO:tasks.workunit.client.0.smithi087.stdout:8/46: stat d1/f2 0 2024-03-18T14:43:09.456 INFO:tasks.workunit.client.0.smithi087.stdout:0/27: chown d0/f8 1 1 2024-03-18T14:43:09.458 INFO:tasks.workunit.client.0.smithi087.stdout:2/22: truncate f1 2638110 0 2024-03-18T14:43:09.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/111: dwrite d13/f1a [0,4194304] 0 2024-03-18T14:43:09.461 INFO:tasks.workunit.client.1.smithi129.stdout:8/38: fdatasync f6 0 2024-03-18T14:43:09.461 INFO:tasks.workunit.client.1.smithi129.stdout:8/39: write f6 [1833078,45337] 0 2024-03-18T14:43:09.463 INFO:tasks.workunit.client.0.smithi087.stdout:0/28: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:09.463 INFO:tasks.workunit.client.0.smithi087.stdout:8/47: dwrite d1/d6/fa [0,4194304] 0 2024-03-18T14:43:09.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/29: write d0/f3 [3001761,47888] 0 2024-03-18T14:43:09.464 INFO:tasks.workunit.client.1.smithi129.stdout:8/40: mkdir d9/dd 0 2024-03-18T14:43:09.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/39: truncate d3/f4 4499095 0 2024-03-18T14:43:09.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/48: creat d1/d6/d9/fe x:0 0 0 2024-03-18T14:43:09.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/49: stat d1/d6 0 2024-03-18T14:43:09.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/50: chown d1/c8 2 1 2024-03-18T14:43:09.469 INFO:tasks.workunit.client.0.smithi087.stdout:0/30: rename d0/d2/d4/c7 to d0/c9 0 2024-03-18T14:43:09.470 INFO:tasks.workunit.client.0.smithi087.stdout:0/31: read - d0/f8 zero size 2024-03-18T14:43:09.470 INFO:tasks.workunit.client.0.smithi087.stdout:7/131: sync 2024-03-18T14:43:09.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/112: fdatasync d13/f16 0 2024-03-18T14:43:09.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/40: mknod d3/d7/d8/cb 0 2024-03-18T14:43:09.474 INFO:tasks.workunit.client.0.smithi087.stdout:8/51: mkdir d1/df 0 2024-03-18T14:43:09.475 INFO:tasks.workunit.client.1.smithi129.stdout:0/54: getdents d0 0 2024-03-18T14:43:09.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/55: mknod d0/c10 0 2024-03-18T14:43:09.479 INFO:tasks.workunit.client.1.smithi129.stdout:0/56: creat d0/f11 x:0 0 0 2024-03-18T14:43:09.481 INFO:tasks.workunit.client.0.smithi087.stdout:0/32: creat d0/fa x:0 0 0 2024-03-18T14:43:09.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/41: symlink d3/lc 0 2024-03-18T14:43:09.483 INFO:tasks.workunit.client.0.smithi087.stdout:9/140: dwrite db/ff [0,4194304] 0 2024-03-18T14:43:09.483 INFO:tasks.workunit.client.0.smithi087.stdout:0/33: chown d0/f3 442926109 1 2024-03-18T14:43:09.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/57: dwrite d0/ff [0,4194304] 0 2024-03-18T14:43:09.485 INFO:tasks.workunit.client.1.smithi129.stdout:0/58: write d0/fd [485200,124659] 0 2024-03-18T14:43:09.485 INFO:tasks.workunit.client.1.smithi129.stdout:0/59: write d0/fd [1078750,109962] 0 2024-03-18T14:43:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:9/141: mkdir db/d18/d1e/d28 0 2024-03-18T14:43:09.487 INFO:tasks.workunit.client.0.smithi087.stdout:5/113: dread f11 [0,4194304] 0 2024-03-18T14:43:09.488 INFO:tasks.workunit.client.1.smithi129.stdout:0/60: symlink d0/l12 0 2024-03-18T14:43:09.488 INFO:tasks.workunit.client.1.smithi129.stdout:0/61: chown d0/ce 178118 1 2024-03-18T14:43:09.489 INFO:tasks.workunit.client.0.smithi087.stdout:0/34: dwrite d0/fa [0,4194304] 0 2024-03-18T14:43:09.490 INFO:tasks.workunit.client.1.smithi129.stdout:0/62: mknod d0/c13 0 2024-03-18T14:43:09.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/142: dread db/ff [0,4194304] 0 2024-03-18T14:43:09.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/143: readlink l9 0 2024-03-18T14:43:09.492 INFO:tasks.workunit.client.0.smithi087.stdout:5/114: rename c9 to d13/d1b/c1d 0 2024-03-18T14:43:09.493 INFO:tasks.workunit.client.1.smithi129.stdout:0/63: mkdir d0/d14 0 2024-03-18T14:43:09.493 INFO:tasks.workunit.client.0.smithi087.stdout:5/115: write d13/f1a [2881590,36750] 0 2024-03-18T14:43:09.494 INFO:tasks.workunit.client.0.smithi087.stdout:9/144: symlink db/d18/d1c/l29 0 2024-03-18T14:43:09.496 INFO:tasks.workunit.client.0.smithi087.stdout:1/134: sync 2024-03-18T14:43:09.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/35: rename d0/l5 to d0/d2/d4/lb 0 2024-03-18T14:43:09.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/145: dwrite db/f22 [0,4194304] 0 2024-03-18T14:43:09.499 INFO:tasks.workunit.client.0.smithi087.stdout:5/116: rename d13/f18 to d13/f1e 0 2024-03-18T14:43:09.500 INFO:tasks.workunit.client.1.smithi129.stdout:8/41: truncate f8 965058 0 2024-03-18T14:43:09.500 INFO:tasks.workunit.client.1.smithi129.stdout:8/42: chown l7 55393737 1 2024-03-18T14:43:09.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/135: rmdir d3 39 2024-03-18T14:43:09.504 INFO:tasks.workunit.client.1.smithi129.stdout:8/43: dwrite f4 [0,4194304] 0 2024-03-18T14:43:09.504 INFO:tasks.workunit.client.0.smithi087.stdout:2/23: dread f1 [0,4194304] 0 2024-03-18T14:43:09.506 INFO:tasks.workunit.client.0.smithi087.stdout:4/17: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/52: getdents d1/d6/d9 0 2024-03-18T14:43:09.508 INFO:tasks.workunit.client.0.smithi087.stdout:6/42: getdents d3/d7/d8 0 2024-03-18T14:43:09.511 INFO:tasks.workunit.client.0.smithi087.stdout:4/18: dwrite d2/f4 [0,4194304] 0 2024-03-18T14:43:09.512 INFO:tasks.workunit.client.0.smithi087.stdout:0/36: creat d0/fc x:0 0 0 2024-03-18T14:43:09.514 INFO:tasks.workunit.client.0.smithi087.stdout:0/37: readlink d0/l6 0 2024-03-18T14:43:09.514 INFO:tasks.workunit.client.0.smithi087.stdout:9/146: stat f1 0 2024-03-18T14:43:09.515 INFO:tasks.workunit.client.0.smithi087.stdout:0/38: dread - d0/f8 zero size 2024-03-18T14:43:09.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/132: dwrite d1/f10 [0,4194304] 0 2024-03-18T14:43:09.516 INFO:tasks.workunit.client.0.smithi087.stdout:0/39: write d0/fc [733893,98961] 0 2024-03-18T14:43:09.517 INFO:tasks.workunit.client.0.smithi087.stdout:0/40: read d0/fc [746189,90455] 0 2024-03-18T14:43:09.520 INFO:tasks.workunit.client.0.smithi087.stdout:5/117: rename l2 to d13/d1b/l1f 0 2024-03-18T14:43:09.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/43: symlink d3/d7/d8/ld 0 2024-03-18T14:43:09.525 INFO:tasks.workunit.client.0.smithi087.stdout:4/19: symlink d2/l7 0 2024-03-18T14:43:09.529 INFO:tasks.workunit.client.0.smithi087.stdout:3/143: sync 2024-03-18T14:43:09.529 INFO:tasks.workunit.client.0.smithi087.stdout:9/147: creat db/d18/f2a x:0 0 0 2024-03-18T14:43:09.531 INFO:tasks.workunit.client.0.smithi087.stdout:9/148: fdatasync db/d18/d1e/f21 0 2024-03-18T14:43:09.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/53: creat d1/df/f10 x:0 0 0 2024-03-18T14:43:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/24: dwrite f1 [0,4194304] 0 2024-03-18T14:43:09.533 INFO:tasks.workunit.client.0.smithi087.stdout:4/20: mknod d2/c8 0 2024-03-18T14:43:09.534 INFO:tasks.workunit.client.0.smithi087.stdout:1/136: dread d3/f16 [0,4194304] 0 2024-03-18T14:43:09.536 INFO:tasks.workunit.client.0.smithi087.stdout:4/21: dread - d2/f5 zero size 2024-03-18T14:43:09.536 INFO:tasks.workunit.client.0.smithi087.stdout:8/54: unlink d1/c8 0 2024-03-18T14:43:09.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/137: write d3/f17 [632697,98963] 0 2024-03-18T14:43:09.537 INFO:tasks.workunit.client.0.smithi087.stdout:9/149: rmdir db/d18/d1c 39 2024-03-18T14:43:09.538 INFO:tasks.workunit.client.0.smithi087.stdout:5/118: link l10 d13/d1b/l20 0 2024-03-18T14:43:09.539 INFO:tasks.workunit.client.0.smithi087.stdout:6/44: truncate d3/fa 1032051 0 2024-03-18T14:43:09.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/138: readlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:09.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/41: dwrite d0/f3 [0,4194304] 0 2024-03-18T14:43:09.540 INFO:tasks.workunit.client.0.smithi087.stdout:3/144: dread d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:09.541 INFO:tasks.workunit.client.0.smithi087.stdout:2/25: creat d2/d4/f5 x:0 0 0 2024-03-18T14:43:09.542 INFO:tasks.workunit.client.0.smithi087.stdout:7/133: getdents d1/d6/d16/dc 0 2024-03-18T14:43:09.542 INFO:tasks.workunit.client.0.smithi087.stdout:8/55: mknod d1/c11 0 2024-03-18T14:43:09.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/56: dread - d1/df/f10 zero size 2024-03-18T14:43:09.545 INFO:tasks.workunit.client.0.smithi087.stdout:0/42: mkdir d0/dd 0 2024-03-18T14:43:09.546 INFO:tasks.workunit.client.0.smithi087.stdout:4/22: dwrite d2/f5 [0,4194304] 0 2024-03-18T14:43:09.546 INFO:tasks.workunit.client.0.smithi087.stdout:2/26: symlink d2/d4/l6 0 2024-03-18T14:43:09.548 INFO:tasks.workunit.client.0.smithi087.stdout:7/134: fdatasync d1/d6/f18 0 2024-03-18T14:43:09.549 INFO:tasks.workunit.client.0.smithi087.stdout:2/27: write d2/d4/f5 [649145,3381] 0 2024-03-18T14:43:09.550 INFO:tasks.workunit.client.0.smithi087.stdout:5/119: dwrite f12 [0,4194304] 0 2024-03-18T14:43:09.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/28: readlink d2/d4/l6 0 2024-03-18T14:43:09.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/57: mknod d1/c12 0 2024-03-18T14:43:09.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/43: creat d0/fe x:0 0 0 2024-03-18T14:43:09.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/58: stat d1/d6 0 2024-03-18T14:43:09.554 INFO:tasks.workunit.client.0.smithi087.stdout:4/23: unlink d2/f4 0 2024-03-18T14:43:09.555 INFO:tasks.workunit.client.0.smithi087.stdout:7/135: rmdir d1/d6 39 2024-03-18T14:43:09.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/139: dwrite d3/d1d/d1f/f2e [0,4194304] 0 2024-03-18T14:43:09.557 INFO:tasks.workunit.client.0.smithi087.stdout:2/29: symlink d2/l7 0 2024-03-18T14:43:09.558 INFO:tasks.workunit.client.0.smithi087.stdout:8/59: rmdir d1/d6/d9 39 2024-03-18T14:43:09.562 INFO:tasks.workunit.client.0.smithi087.stdout:4/24: creat d2/f9 x:0 0 0 2024-03-18T14:43:09.564 INFO:tasks.workunit.client.0.smithi087.stdout:3/145: getdents d0/de 0 2024-03-18T14:43:09.564 INFO:tasks.workunit.client.0.smithi087.stdout:3/146: write d0/fb [5101307,70128] 0 2024-03-18T14:43:09.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/147: write d0/d3/fc [2613130,101281] 0 2024-03-18T14:43:09.566 INFO:tasks.workunit.client.0.smithi087.stdout:2/30: unlink d2/d4/l6 0 2024-03-18T14:43:09.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/148: stat d0/ca 0 2024-03-18T14:43:09.566 INFO:tasks.workunit.client.0.smithi087.stdout:2/31: chown d2/d4 1448 1 2024-03-18T14:43:09.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/149: stat d0/d1c/d25 0 2024-03-18T14:43:09.567 INFO:tasks.workunit.client.0.smithi087.stdout:2/32: write f1 [834634,76060] 0 2024-03-18T14:43:09.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/25: mknod d2/ca 0 2024-03-18T14:43:09.569 INFO:tasks.workunit.client.0.smithi087.stdout:4/26: write f1 [4590298,47044] 0 2024-03-18T14:43:09.569 INFO:tasks.workunit.client.0.smithi087.stdout:1/140: fdatasync d3/f8 0 2024-03-18T14:43:09.572 INFO:tasks.workunit.client.0.smithi087.stdout:3/150: creat d0/f28 x:0 0 0 2024-03-18T14:43:09.574 INFO:tasks.workunit.client.0.smithi087.stdout:2/33: creat d2/d4/f8 x:0 0 0 2024-03-18T14:43:09.574 INFO:tasks.workunit.client.0.smithi087.stdout:2/34: stat d2/d4 0 2024-03-18T14:43:09.575 INFO:tasks.workunit.client.0.smithi087.stdout:2/35: fdatasync d2/d4/f8 0 2024-03-18T14:43:09.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/44: getdents d0/d2/d4 0 2024-03-18T14:43:09.578 INFO:tasks.workunit.client.0.smithi087.stdout:7/136: creat d1/d6/f2a x:0 0 0 2024-03-18T14:43:09.578 INFO:tasks.workunit.client.0.smithi087.stdout:2/36: symlink d2/d4/l9 0 2024-03-18T14:43:09.578 INFO:tasks.workunit.client.0.smithi087.stdout:7/137: chown d1/d6/d16/c1f 8632 1 2024-03-18T14:43:09.579 INFO:tasks.workunit.client.0.smithi087.stdout:7/138: readlink d1/d6/d16/dc/l23 0 2024-03-18T14:43:09.579 INFO:tasks.workunit.client.0.smithi087.stdout:7/139: readlink d1/d6/d16/dc/l23 0 2024-03-18T14:43:09.582 INFO:tasks.workunit.client.0.smithi087.stdout:7/140: creat d1/f2b x:0 0 0 2024-03-18T14:43:09.585 INFO:tasks.workunit.client.0.smithi087.stdout:7/141: dread d1/d6/d16/f1a [0,4194304] 0 2024-03-18T14:43:09.587 INFO:tasks.workunit.client.0.smithi087.stdout:7/142: unlink d1/f13 0 2024-03-18T14:43:09.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/143: dread d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:09.591 INFO:tasks.workunit.client.0.smithi087.stdout:7/144: write d1/d6/d16/dc/f26 [707575,103490] 0 2024-03-18T14:43:09.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/45: dread d3/f4 [0,4194304] 0 2024-03-18T14:43:09.600 INFO:tasks.workunit.client.0.smithi087.stdout:6/46: readlink d3/d7/d8/ld 0 2024-03-18T14:43:09.601 INFO:tasks.workunit.client.0.smithi087.stdout:5/120: link d13/d1b/l1f d13/d1b/l21 0 2024-03-18T14:43:09.602 INFO:tasks.workunit.client.1.smithi129.stdout:8/44: fdatasync f4 0 2024-03-18T14:43:09.605 INFO:tasks.workunit.client.1.smithi129.stdout:8/45: creat d9/dd/fe x:0 0 0 2024-03-18T14:43:09.606 INFO:tasks.workunit.client.0.smithi087.stdout:1/141: fsync d3/f17 0 2024-03-18T14:43:09.606 INFO:tasks.workunit.client.0.smithi087.stdout:4/27: fsync f1 0 2024-03-18T14:43:09.607 INFO:tasks.workunit.client.0.smithi087.stdout:4/28: dread - d2/f9 zero size 2024-03-18T14:43:09.607 INFO:tasks.workunit.client.0.smithi087.stdout:1/142: write d3/f7 [3957174,76753] 0 2024-03-18T14:43:09.608 INFO:tasks.workunit.client.1.smithi129.stdout:8/46: symlink d9/lf 0 2024-03-18T14:43:09.608 INFO:tasks.workunit.client.0.smithi087.stdout:5/121: stat d13/d1b/l20 0 2024-03-18T14:43:09.609 INFO:tasks.workunit.client.0.smithi087.stdout:3/151: dread d0/d3/df/f1d [4194304,4194304] 0 2024-03-18T14:43:09.610 INFO:tasks.workunit.client.1.smithi129.stdout:8/47: mknod d9/c10 0 2024-03-18T14:43:09.614 INFO:tasks.workunit.client.1.smithi129.stdout:8/48: dread f4 [0,4194304] 0 2024-03-18T14:43:09.614 INFO:tasks.workunit.client.1.smithi129.stdout:8/49: chown f6 13248 1 2024-03-18T14:43:09.616 INFO:tasks.workunit.client.1.smithi129.stdout:8/50: mkdir d9/d11 0 2024-03-18T14:43:09.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/150: truncate db/ff 1982101 0 2024-03-18T14:43:09.621 INFO:tasks.workunit.client.1.smithi129.stdout:8/51: truncate f4 2871898 0 2024-03-18T14:43:09.621 INFO:tasks.workunit.client.1.smithi129.stdout:8/52: chown d9/ca 632 1 2024-03-18T14:43:09.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/29: mkdir d2/db 0 2024-03-18T14:43:09.627 INFO:tasks.workunit.client.0.smithi087.stdout:8/60: dwrite d1/fd [0,4194304] 0 2024-03-18T14:43:09.627 INFO:tasks.workunit.client.1.smithi129.stdout:8/53: truncate f6 2483145 0 2024-03-18T14:43:09.630 INFO:tasks.workunit.client.0.smithi087.stdout:4/30: dread d2/f5 [0,4194304] 0 2024-03-18T14:43:09.630 INFO:tasks.workunit.client.0.smithi087.stdout:3/152: unlink d0/d3/f6 0 2024-03-18T14:43:09.631 INFO:tasks.workunit.client.0.smithi087.stdout:8/61: dread d1/f2 [0,4194304] 0 2024-03-18T14:43:09.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/145: dwrite d1/f28 [0,4194304] 0 2024-03-18T14:43:09.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/54: write f8 [1285855,108447] 0 2024-03-18T14:43:09.632 INFO:tasks.workunit.client.0.smithi087.stdout:1/143: dwrite d3/fc [0,4194304] 0 2024-03-18T14:43:09.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/55: write f8 [493219,58907] 0 2024-03-18T14:43:09.633 INFO:tasks.workunit.client.0.smithi087.stdout:1/144: read - d3/d1d/f22 zero size 2024-03-18T14:43:09.635 INFO:tasks.workunit.client.0.smithi087.stdout:7/146: dread d1/d6/d16/dc/f27 [0,4194304] 0 2024-03-18T14:43:09.639 INFO:tasks.workunit.client.1.smithi129.stdout:8/56: stat f4 0 2024-03-18T14:43:09.642 INFO:tasks.workunit.client.1.smithi129.stdout:8/57: dread f4 [0,4194304] 0 2024-03-18T14:43:09.655 INFO:tasks.workunit.client.0.smithi087.stdout:0/45: sync 2024-03-18T14:43:09.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/37: sync 2024-03-18T14:43:09.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/38: sync 2024-03-18T14:43:09.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/39: write d2/d4/f8 [351873,42573] 0 2024-03-18T14:43:09.731 INFO:tasks.workunit.client.0.smithi087.stdout:2/40: chown d2 65740768 1 2024-03-18T14:43:09.894 INFO:tasks.workunit.client.0.smithi087.stdout:6/47: link d3/d7/d8/ld d3/d7/le 0 2024-03-18T14:43:09.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/153: rmdir d0/d3/d10 39 2024-03-18T14:43:09.944 INFO:tasks.workunit.client.0.smithi087.stdout:5/122: truncate fb 859189 0 2024-03-18T14:43:09.946 INFO:tasks.workunit.client.0.smithi087.stdout:5/123: dread d13/f16 [0,4194304] 0 2024-03-18T14:43:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:5/124: chown d13/d1b 2041408824 1 2024-03-18T14:43:09.947 INFO:tasks.workunit.client.0.smithi087.stdout:0/46: creat d0/d2/d4/ff x:0 0 0 2024-03-18T14:43:09.949 INFO:tasks.workunit.client.0.smithi087.stdout:6/48: unlink d3/d7/d8/c9 0 2024-03-18T14:43:09.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/147: dwrite d1/d6/da/ff [0,4194304] 0 2024-03-18T14:43:09.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/31: mknod d2/db/cc 0 2024-03-18T14:43:09.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/154: fdatasync d0/d3/d10/f21 0 2024-03-18T14:43:09.952 INFO:tasks.workunit.client.0.smithi087.stdout:5/125: mknod d13/c22 0 2024-03-18T14:43:09.953 INFO:tasks.workunit.client.0.smithi087.stdout:0/47: write d0/fc [38088,25049] 0 2024-03-18T14:43:09.955 INFO:tasks.workunit.client.0.smithi087.stdout:6/49: mknod d3/d7/cf 0 2024-03-18T14:43:09.956 INFO:tasks.workunit.client.0.smithi087.stdout:6/50: dread - d3/f5 zero size 2024-03-18T14:43:09.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/48: dread d0/fa [0,4194304] 0 2024-03-18T14:43:09.957 INFO:tasks.workunit.client.0.smithi087.stdout:8/62: link d1/d6/d9/fe d1/d6/d9/f13 0 2024-03-18T14:43:09.957 INFO:tasks.workunit.client.0.smithi087.stdout:0/49: dread - d0/d2/d4/ff zero size 2024-03-18T14:43:09.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/50: write d0/fc [579096,107308] 0 2024-03-18T14:43:09.960 INFO:tasks.workunit.client.0.smithi087.stdout:5/126: creat d13/f23 x:0 0 0 2024-03-18T14:43:09.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/151: link db/d18/d1c/l29 db/d18/d1c/l2b 0 2024-03-18T14:43:09.963 INFO:tasks.workunit.client.0.smithi087.stdout:5/127: dread d13/f17 [0,4194304] 0 2024-03-18T14:43:09.964 INFO:tasks.workunit.client.0.smithi087.stdout:6/51: rename d3/f5 to d3/d7/d8/f10 0 2024-03-18T14:43:09.966 INFO:tasks.workunit.client.0.smithi087.stdout:1/145: getdents d3 0 2024-03-18T14:43:09.968 INFO:tasks.workunit.client.0.smithi087.stdout:4/32: rmdir d2 39 2024-03-18T14:43:09.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/146: dwrite d3/d1d/d1f/f24 [0,4194304] 0 2024-03-18T14:43:09.974 INFO:tasks.workunit.client.0.smithi087.stdout:0/51: unlink d0/l6 0 2024-03-18T14:43:09.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/41: getdents d2 0 2024-03-18T14:43:09.978 INFO:tasks.workunit.client.0.smithi087.stdout:5/128: creat d13/f24 x:0 0 0 2024-03-18T14:43:09.979 INFO:tasks.workunit.client.0.smithi087.stdout:5/129: dread - d13/f1e zero size 2024-03-18T14:43:09.980 INFO:tasks.workunit.client.0.smithi087.stdout:6/52: creat d3/d7/f11 x:0 0 0 2024-03-18T14:43:09.982 INFO:tasks.workunit.client.0.smithi087.stdout:3/155: creat d0/d3/f29 x:0 0 0 2024-03-18T14:43:09.983 INFO:tasks.workunit.client.0.smithi087.stdout:3/156: fdatasync d0/f1 0 2024-03-18T14:43:09.983 INFO:tasks.workunit.client.0.smithi087.stdout:4/33: fdatasync d2/f9 0 2024-03-18T14:43:09.985 INFO:tasks.workunit.client.0.smithi087.stdout:1/147: rename d3/f2c to d3/f30 0 2024-03-18T14:43:09.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/148: link d1/d6/d16/dc/l11 d1/d6/d16/dc/l2c 0 2024-03-18T14:43:09.987 INFO:tasks.workunit.client.0.smithi087.stdout:1/148: stat d3/d1d/d1e/d20/f23 0 2024-03-18T14:43:09.987 INFO:tasks.workunit.client.0.smithi087.stdout:3/157: dread d0/fb [0,4194304] 0 2024-03-18T14:43:09.987 INFO:tasks.workunit.client.0.smithi087.stdout:0/52: creat d0/f10 x:0 0 0 2024-03-18T14:43:09.988 INFO:tasks.workunit.client.0.smithi087.stdout:4/34: dread d2/f5 [0,4194304] 0 2024-03-18T14:43:09.989 INFO:tasks.workunit.client.0.smithi087.stdout:0/53: fdatasync d0/d2/d4/ff 0 2024-03-18T14:43:09.989 INFO:tasks.workunit.client.0.smithi087.stdout:4/35: chown f1 10084 1 2024-03-18T14:43:09.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/149: dread d1/d6/f18 [0,4194304] 0 2024-03-18T14:43:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/36: dread d2/f5 [0,4194304] 0 2024-03-18T14:43:09.993 INFO:tasks.workunit.client.0.smithi087.stdout:4/37: readlink d2/l7 0 2024-03-18T14:43:09.994 INFO:tasks.workunit.client.0.smithi087.stdout:1/149: mknod d3/d1d/d1f/c31 0 2024-03-18T14:43:09.995 INFO:tasks.workunit.client.0.smithi087.stdout:9/152: creat db/d18/f2c x:0 0 0 2024-03-18T14:43:09.997 INFO:tasks.workunit.client.0.smithi087.stdout:7/150: dwrite d1/d6/da/ff [4194304,4194304] 0 2024-03-18T14:43:10.001 INFO:tasks.workunit.client.0.smithi087.stdout:8/63: rename d1/df to d1/d6/d14 0 2024-03-18T14:43:10.001 INFO:tasks.workunit.client.0.smithi087.stdout:2/42: rename d2 to d2/da 22 2024-03-18T14:43:10.004 INFO:tasks.workunit.client.0.smithi087.stdout:0/54: write d0/fa [1067924,22843] 0 2024-03-18T14:43:10.004 INFO:tasks.workunit.client.0.smithi087.stdout:0/55: fdatasync d0/f3 0 2024-03-18T14:43:10.004 INFO:tasks.workunit.client.0.smithi087.stdout:0/56: chown d0/d2/d4 510731687 1 2024-03-18T14:43:10.005 INFO:tasks.workunit.client.0.smithi087.stdout:0/57: write d0/fa [2320709,106055] 0 2024-03-18T14:43:10.006 INFO:tasks.workunit.client.0.smithi087.stdout:4/38: mknod d2/db/cd 0 2024-03-18T14:43:10.007 INFO:tasks.workunit.client.0.smithi087.stdout:9/153: readlink db/d18/d1c/l2b 0 2024-03-18T14:43:10.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/130: truncate d13/f16 311103 0 2024-03-18T14:43:10.009 INFO:tasks.workunit.client.0.smithi087.stdout:8/64: creat d1/d6/d14/f15 x:0 0 0 2024-03-18T14:43:10.010 INFO:tasks.workunit.client.0.smithi087.stdout:8/65: readlink d1/lb 0 2024-03-18T14:43:10.011 INFO:tasks.workunit.client.0.smithi087.stdout:2/43: unlink d2/d4/f5 0 2024-03-18T14:43:10.011 INFO:tasks.workunit.client.0.smithi087.stdout:0/58: dwrite d0/f8 [0,4194304] 0 2024-03-18T14:43:10.012 INFO:tasks.workunit.client.0.smithi087.stdout:2/44: fdatasync d2/d4/f8 0 2024-03-18T14:43:10.012 INFO:tasks.workunit.client.0.smithi087.stdout:0/59: dread - d0/f10 zero size 2024-03-18T14:43:10.013 INFO:tasks.workunit.client.0.smithi087.stdout:4/39: mkdir d2/db/de 0 2024-03-18T14:43:10.013 INFO:tasks.workunit.client.0.smithi087.stdout:4/40: chown d2/ca 340 1 2024-03-18T14:43:10.016 INFO:tasks.workunit.client.0.smithi087.stdout:7/151: symlink d1/l2d 0 2024-03-18T14:43:10.018 INFO:tasks.workunit.client.0.smithi087.stdout:6/53: dwrite d3/fa [0,4194304] 0 2024-03-18T14:43:10.018 INFO:tasks.workunit.client.0.smithi087.stdout:5/131: stat d13/d1b/l21 0 2024-03-18T14:43:10.019 INFO:tasks.workunit.client.0.smithi087.stdout:3/158: link d0/d3/df/l20 d0/d3/df/l2a 0 2024-03-18T14:43:10.019 INFO:tasks.workunit.client.0.smithi087.stdout:1/150: dwrite d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:10.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/60: creat d0/f11 x:0 0 0 2024-03-18T14:43:10.030 INFO:tasks.workunit.client.0.smithi087.stdout:9/154: mknod db/c2d 0 2024-03-18T14:43:10.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/152: unlink d1/fb 0 2024-03-18T14:43:10.031 INFO:tasks.workunit.client.0.smithi087.stdout:9/155: fdatasync db/f22 0 2024-03-18T14:43:10.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/132: creat d13/d1b/f25 x:0 0 0 2024-03-18T14:43:10.034 INFO:tasks.workunit.client.0.smithi087.stdout:1/151: rmdir d3/d1d/d1f 39 2024-03-18T14:43:10.035 INFO:tasks.workunit.client.0.smithi087.stdout:0/61: dwrite d0/f11 [0,4194304] 0 2024-03-18T14:43:10.036 INFO:tasks.workunit.client.0.smithi087.stdout:0/62: chown d0/dd 54918583 1 2024-03-18T14:43:10.038 INFO:tasks.workunit.client.0.smithi087.stdout:3/159: creat d0/d1c/f2b x:0 0 0 2024-03-18T14:43:10.039 INFO:tasks.workunit.client.0.smithi087.stdout:8/66: dwrite d1/d6/d9/f13 [0,4194304] 0 2024-03-18T14:43:10.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/160: write d0/d3/fc [997038,26542] 0 2024-03-18T14:43:10.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/133: creat d13/f26 x:0 0 0 2024-03-18T14:43:10.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/67: write d1/d6/fa [4799976,118897] 0 2024-03-18T14:43:10.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/134: stat d13/l19 0 2024-03-18T14:43:10.042 INFO:tasks.workunit.client.0.smithi087.stdout:3/161: write d0/f1 [5035882,88772] 0 2024-03-18T14:43:10.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/63: dread d0/f8 [0,4194304] 0 2024-03-18T14:43:10.043 INFO:tasks.workunit.client.0.smithi087.stdout:3/162: chown d0/d3/l15 349 1 2024-03-18T14:43:10.043 INFO:tasks.workunit.client.0.smithi087.stdout:3/163: stat d0/d3/df/c18 0 2024-03-18T14:43:10.043 INFO:tasks.workunit.client.0.smithi087.stdout:1/152: symlink d3/d1d/d1e/d20/l32 0 2024-03-18T14:43:10.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/68: dwrite d1/f2 [0,4194304] 0 2024-03-18T14:43:10.054 INFO:tasks.workunit.client.0.smithi087.stdout:2/45: getdents d2/d4 0 2024-03-18T14:43:10.054 INFO:tasks.workunit.client.0.smithi087.stdout:6/54: truncate d3/d7/f11 88249 0 2024-03-18T14:43:10.055 INFO:tasks.workunit.client.0.smithi087.stdout:7/153: creat d1/f2e x:0 0 0 2024-03-18T14:43:10.058 INFO:tasks.workunit.client.0.smithi087.stdout:3/164: rename d0/d3/df/f23 to d0/d3/d10/f2c 0 2024-03-18T14:43:10.064 INFO:tasks.workunit.client.0.smithi087.stdout:1/153: creat d3/d1d/f33 x:0 0 0 2024-03-18T14:43:10.065 INFO:tasks.workunit.client.0.smithi087.stdout:1/154: fsync d3/d1d/f28 0 2024-03-18T14:43:10.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/46: rename d2/d4/f8 to d2/fb 0 2024-03-18T14:43:10.067 INFO:tasks.workunit.client.0.smithi087.stdout:6/55: rmdir d3/d7 39 2024-03-18T14:43:10.068 INFO:tasks.workunit.client.0.smithi087.stdout:5/135: write fb [357737,19148] 0 2024-03-18T14:43:10.070 INFO:tasks.workunit.client.0.smithi087.stdout:2/47: dwrite f1 [4194304,4194304] 0 2024-03-18T14:43:10.070 INFO:tasks.workunit.client.0.smithi087.stdout:3/165: creat d0/d3/d10/f2d x:0 0 0 2024-03-18T14:43:10.071 INFO:tasks.workunit.client.0.smithi087.stdout:7/154: mkdir d1/d6/d29/d2f 0 2024-03-18T14:43:10.074 INFO:tasks.workunit.client.0.smithi087.stdout:5/136: truncate f11 438190 0 2024-03-18T14:43:10.074 INFO:tasks.workunit.client.0.smithi087.stdout:8/69: creat d1/d6/f16 x:0 0 0 2024-03-18T14:43:10.076 INFO:tasks.workunit.client.0.smithi087.stdout:2/48: symlink d2/d4/lc 0 2024-03-18T14:43:10.076 INFO:tasks.workunit.client.0.smithi087.stdout:3/166: dwrite d0/f19 [0,4194304] 0 2024-03-18T14:43:10.078 INFO:tasks.workunit.client.0.smithi087.stdout:5/137: rmdir d13/d1b 39 2024-03-18T14:43:10.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/155: mknod d1/c30 0 2024-03-18T14:43:10.081 INFO:tasks.workunit.client.0.smithi087.stdout:8/70: dwrite d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:10.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/71: write d1/d6/d9/f13 [1699842,70693] 0 2024-03-18T14:43:10.084 INFO:tasks.workunit.client.0.smithi087.stdout:5/138: dread d13/f17 [0,4194304] 0 2024-03-18T14:43:10.088 INFO:tasks.workunit.client.0.smithi087.stdout:8/72: creat d1/d6/d9/f17 x:0 0 0 2024-03-18T14:43:10.092 INFO:tasks.workunit.client.0.smithi087.stdout:5/139: mkdir d13/d1b/d27 0 2024-03-18T14:43:10.092 INFO:tasks.workunit.client.0.smithi087.stdout:5/140: stat d13/l15 0 2024-03-18T14:43:10.092 INFO:tasks.workunit.client.0.smithi087.stdout:2/49: getdents d2 0 2024-03-18T14:43:10.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/156: rename d1/d6/d16/dc/f27 to d1/f31 0 2024-03-18T14:43:10.095 INFO:tasks.workunit.client.0.smithi087.stdout:8/73: rename d1 to d1/d18 22 2024-03-18T14:43:10.095 INFO:tasks.workunit.client.0.smithi087.stdout:2/50: creat d2/d4/fd x:0 0 0 2024-03-18T14:43:10.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/141: dwrite d13/d1b/f1c [0,4194304] 0 2024-03-18T14:43:10.097 INFO:tasks.workunit.client.0.smithi087.stdout:2/51: mknod d2/ce 0 2024-03-18T14:43:10.098 INFO:tasks.workunit.client.0.smithi087.stdout:8/74: mknod d1/d6/c19 0 2024-03-18T14:43:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/142: mkdir d13/d1b/d27/d28 0 2024-03-18T14:43:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/143: dread - d13/f24 zero size 2024-03-18T14:43:10.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/144: stat d13/f1e 0 2024-03-18T14:43:10.102 INFO:tasks.workunit.client.0.smithi087.stdout:8/75: rename d1/d6/d14/f10 to d1/f1a 0 2024-03-18T14:43:10.106 INFO:tasks.workunit.client.0.smithi087.stdout:8/76: rename d1/d6/f16 to d1/f1b 0 2024-03-18T14:43:10.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/52: fsync d2/d4/fd 0 2024-03-18T14:43:10.108 INFO:tasks.workunit.client.0.smithi087.stdout:8/77: fdatasync d1/f1a 0 2024-03-18T14:43:10.112 INFO:tasks.workunit.client.0.smithi087.stdout:2/53: dwrite f1 [4194304,4194304] 0 2024-03-18T14:43:10.116 INFO:tasks.workunit.client.0.smithi087.stdout:2/54: dwrite d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/78: truncate d1/d6/d9/fe 5190146 0 2024-03-18T14:43:10.121 INFO:tasks.workunit.client.0.smithi087.stdout:5/145: dwrite f11 [0,4194304] 0 2024-03-18T14:43:10.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/79: creat d1/d6/d14/f1c x:0 0 0 2024-03-18T14:43:10.122 INFO:tasks.workunit.client.0.smithi087.stdout:2/55: dread d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/146: mknod d13/d1b/c29 0 2024-03-18T14:43:10.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/56: mknod d2/cf 0 2024-03-18T14:43:10.127 INFO:tasks.workunit.client.0.smithi087.stdout:2/57: creat d2/f10 x:0 0 0 2024-03-18T14:43:10.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/80: rename d1/d6/d9/fc to d1/d6/f1d 0 2024-03-18T14:43:10.133 INFO:tasks.workunit.client.0.smithi087.stdout:2/58: write d2/fb [172453,90396] 0 2024-03-18T14:43:10.133 INFO:tasks.workunit.client.0.smithi087.stdout:2/59: stat d2/d4/fd 0 2024-03-18T14:43:10.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/81: creat d1/d6/f1e x:0 0 0 2024-03-18T14:43:10.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/82: creat d1/d6/d14/f1f x:0 0 0 2024-03-18T14:43:10.140 INFO:tasks.workunit.client.0.smithi087.stdout:8/83: creat d1/d6/f20 x:0 0 0 2024-03-18T14:43:10.147 INFO:tasks.workunit.client.0.smithi087.stdout:5/147: write d13/f17 [2542523,27128] 0 2024-03-18T14:43:10.148 INFO:tasks.workunit.client.0.smithi087.stdout:8/84: rmdir d1/d6/d9 39 2024-03-18T14:43:10.151 INFO:tasks.workunit.client.0.smithi087.stdout:5/148: creat d13/d1b/d27/f2a x:0 0 0 2024-03-18T14:43:10.152 INFO:tasks.workunit.client.0.smithi087.stdout:5/149: dread - d13/f24 zero size 2024-03-18T14:43:10.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/150: creat d13/d1b/f2b x:0 0 0 2024-03-18T14:43:10.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/151: dread d13/f16 [0,4194304] 0 2024-03-18T14:43:10.156 INFO:tasks.workunit.client.0.smithi087.stdout:8/85: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:10.156 INFO:tasks.workunit.client.0.smithi087.stdout:5/152: stat d13/d1b/f25 0 2024-03-18T14:43:10.158 INFO:tasks.workunit.client.0.smithi087.stdout:5/153: chown l6 113817158 1 2024-03-18T14:43:10.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/41: sync 2024-03-18T14:43:10.160 INFO:tasks.workunit.client.0.smithi087.stdout:9/156: sync 2024-03-18T14:43:10.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/64: sync 2024-03-18T14:43:10.161 INFO:tasks.workunit.client.0.smithi087.stdout:8/86: link d1/f5 d1/f21 0 2024-03-18T14:43:10.161 INFO:tasks.workunit.client.0.smithi087.stdout:5/154: creat d13/d1b/d27/f2c x:0 0 0 2024-03-18T14:43:10.161 INFO:tasks.workunit.client.0.smithi087.stdout:9/157: stat db/d18/d1c/l2b 0 2024-03-18T14:43:10.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/155: readlink l10 0 2024-03-18T14:43:10.162 INFO:tasks.workunit.client.0.smithi087.stdout:8/87: chown d1/d6/c19 1183716 1 2024-03-18T14:43:10.162 INFO:tasks.workunit.client.0.smithi087.stdout:9/158: dread - db/d18/f2a zero size 2024-03-18T14:43:10.162 INFO:tasks.workunit.client.0.smithi087.stdout:9/159: fsync f8 0 2024-03-18T14:43:10.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/42: mknod d2/db/de/cf 0 2024-03-18T14:43:10.164 INFO:tasks.workunit.client.0.smithi087.stdout:8/88: mknod d1/d6/d14/c22 0 2024-03-18T14:43:10.165 INFO:tasks.workunit.client.0.smithi087.stdout:0/65: link d0/fa d0/d2/d4/f12 0 2024-03-18T14:43:10.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/160: fdatasync db/f11 0 2024-03-18T14:43:10.166 INFO:tasks.workunit.client.0.smithi087.stdout:0/66: write d0/fe [263177,71865] 0 2024-03-18T14:43:10.166 INFO:tasks.workunit.client.0.smithi087.stdout:4/43: fdatasync d2/f5 0 2024-03-18T14:43:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:4/44: chown d2/db/cc 5819697 1 2024-03-18T14:43:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:0/67: write d0/d2/d4/ff [284031,23488] 0 2024-03-18T14:43:10.168 INFO:tasks.workunit.client.0.smithi087.stdout:4/45: fdatasync d2/f5 0 2024-03-18T14:43:10.169 INFO:tasks.workunit.client.0.smithi087.stdout:0/68: chown d0/d2/d4/ff 44803020 1 2024-03-18T14:43:10.169 INFO:tasks.workunit.client.0.smithi087.stdout:8/89: mknod d1/d6/d14/c23 0 2024-03-18T14:43:10.169 INFO:tasks.workunit.client.0.smithi087.stdout:4/46: chown d2/db/de/cf 2786 1 2024-03-18T14:43:10.170 INFO:tasks.workunit.client.0.smithi087.stdout:0/69: chown d0/fa 125 1 2024-03-18T14:43:10.171 INFO:tasks.workunit.client.0.smithi087.stdout:4/47: unlink d2/f5 0 2024-03-18T14:43:10.173 INFO:tasks.workunit.client.0.smithi087.stdout:8/90: dwrite d1/f2 [0,4194304] 0 2024-03-18T14:43:10.174 INFO:tasks.workunit.client.0.smithi087.stdout:0/70: rename d0/fa to d0/d2/f13 0 2024-03-18T14:43:10.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/48: creat d2/f10 x:0 0 0 2024-03-18T14:43:10.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/156: truncate d13/f1e 262580 0 2024-03-18T14:43:10.178 INFO:tasks.workunit.client.0.smithi087.stdout:9/161: dread f1 [0,4194304] 0 2024-03-18T14:43:10.179 INFO:tasks.workunit.client.0.smithi087.stdout:8/91: creat d1/d6/d14/f24 x:0 0 0 2024-03-18T14:43:10.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/71: unlink d0/d2/d4/ff 0 2024-03-18T14:43:10.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/72: dread - d0/f10 zero size 2024-03-18T14:43:10.183 INFO:tasks.workunit.client.0.smithi087.stdout:5/157: creat d13/d1b/d27/f2d x:0 0 0 2024-03-18T14:43:10.184 INFO:tasks.workunit.client.0.smithi087.stdout:8/92: dwrite d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:10.187 INFO:tasks.workunit.client.0.smithi087.stdout:5/158: mknod d13/d1b/c2e 0 2024-03-18T14:43:10.187 INFO:tasks.workunit.client.0.smithi087.stdout:9/162: rename l9 to db/l2e 0 2024-03-18T14:43:10.188 INFO:tasks.workunit.client.0.smithi087.stdout:0/73: dwrite d0/f3 [0,4194304] 0 2024-03-18T14:43:10.189 INFO:tasks.workunit.client.0.smithi087.stdout:4/49: getdents d2/db/de 0 2024-03-18T14:43:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/50: chown f1 118061 1 2024-03-18T14:43:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/93: dread d1/f2 [0,4194304] 0 2024-03-18T14:43:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:0/74: write d0/f3 [2754959,56178] 0 2024-03-18T14:43:10.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/51: dread - d2/f10 zero size 2024-03-18T14:43:10.194 INFO:tasks.workunit.client.0.smithi087.stdout:4/52: dwrite d2/f9 [0,4194304] 0 2024-03-18T14:43:10.198 INFO:tasks.workunit.client.0.smithi087.stdout:6/56: sync 2024-03-18T14:43:10.198 INFO:tasks.workunit.client.0.smithi087.stdout:1/155: sync 2024-03-18T14:43:10.198 INFO:tasks.workunit.client.0.smithi087.stdout:6/57: chown d3/lc 0 1 2024-03-18T14:43:10.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/156: read d3/d1d/d1e/d20/f23 [2630308,80930] 0 2024-03-18T14:43:10.200 INFO:tasks.workunit.client.0.smithi087.stdout:8/94: dread - d1/d6/d9/f17 zero size 2024-03-18T14:43:10.202 INFO:tasks.workunit.client.0.smithi087.stdout:0/75: read d0/f8 [3104245,67522] 0 2024-03-18T14:43:10.202 INFO:tasks.workunit.client.0.smithi087.stdout:0/76: chown d0/f10 1 1 2024-03-18T14:43:10.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/159: mknod d13/d1b/d27/d28/c2f 0 2024-03-18T14:43:10.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/160: write d13/f26 [159367,105113] 0 2024-03-18T14:43:10.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/163: creat db/f2f x:0 0 0 2024-03-18T14:43:10.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/77: symlink d0/l14 0 2024-03-18T14:43:10.209 INFO:tasks.workunit.client.0.smithi087.stdout:1/157: mkdir d3/d1d/d1f/d34 0 2024-03-18T14:43:10.212 INFO:tasks.workunit.client.0.smithi087.stdout:0/78: creat d0/dd/f15 x:0 0 0 2024-03-18T14:43:10.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/58: link d3/d7/le d3/d7/l12 0 2024-03-18T14:43:10.213 INFO:tasks.workunit.client.0.smithi087.stdout:6/59: chown f1 2003533 1 2024-03-18T14:43:10.214 INFO:tasks.workunit.client.0.smithi087.stdout:1/158: creat d3/d1d/d1f/d34/f35 x:0 0 0 2024-03-18T14:43:10.214 INFO:tasks.workunit.client.0.smithi087.stdout:1/159: stat d3/d1d/d1e/d20/l32 0 2024-03-18T14:43:10.215 INFO:tasks.workunit.client.0.smithi087.stdout:1/160: readlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:10.215 INFO:tasks.workunit.client.0.smithi087.stdout:0/79: creat d0/f16 x:0 0 0 2024-03-18T14:43:10.223 INFO:tasks.workunit.client.0.smithi087.stdout:6/60: link d3/d7/d8/ld d3/d7/l13 0 2024-03-18T14:43:10.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/53: truncate d2/f10 398031 0 2024-03-18T14:43:10.228 INFO:tasks.workunit.client.0.smithi087.stdout:1/161: truncate d3/f19 772939 0 2024-03-18T14:43:10.228 INFO:tasks.workunit.client.0.smithi087.stdout:0/80: truncate d0/f16 455089 0 2024-03-18T14:43:10.229 INFO:tasks.workunit.client.0.smithi087.stdout:9/164: dwrite f1 [0,4194304] 0 2024-03-18T14:43:10.230 INFO:tasks.workunit.client.0.smithi087.stdout:6/61: write d3/d7/d8/f10 [550588,125588] 0 2024-03-18T14:43:10.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/95: dwrite d1/d6/d9/f13 [4194304,4194304] 0 2024-03-18T14:43:10.232 INFO:tasks.workunit.client.0.smithi087.stdout:9/165: stat db/d12/c26 0 2024-03-18T14:43:10.236 INFO:tasks.workunit.client.0.smithi087.stdout:0/81: rename d0/f8 to d0/d2/f17 0 2024-03-18T14:43:10.237 INFO:tasks.workunit.client.0.smithi087.stdout:0/82: chown d0/d2/d4/lb 41162203 1 2024-03-18T14:43:10.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/62: dread d3/d7/f11 [0,4194304] 0 2024-03-18T14:43:10.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/162: truncate d3/d1d/d1f/f24 3132202 0 2024-03-18T14:43:10.241 INFO:tasks.workunit.client.0.smithi087.stdout:4/54: truncate d2/f10 1125253 0 2024-03-18T14:43:10.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/55: write d2/f9 [3145683,36449] 0 2024-03-18T14:43:10.243 INFO:tasks.workunit.client.0.smithi087.stdout:6/63: rmdir d3/d7 39 2024-03-18T14:43:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/96: truncate d1/f21 204863 0 2024-03-18T14:43:10.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/97: chown d1 1206 1 2024-03-18T14:43:10.246 INFO:tasks.workunit.client.0.smithi087.stdout:4/56: rmdir d2/db 39 2024-03-18T14:43:10.248 INFO:tasks.workunit.client.0.smithi087.stdout:9/166: creat db/d18/f30 x:0 0 0 2024-03-18T14:43:10.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/98: dread d1/d6/d9/fe [0,4194304] 0 2024-03-18T14:43:10.250 INFO:tasks.workunit.client.0.smithi087.stdout:6/64: creat d3/d7/f14 x:0 0 0 2024-03-18T14:43:10.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/163: truncate d3/d1d/f22 362960 0 2024-03-18T14:43:10.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/99: mknod d1/d6/d9/c25 0 2024-03-18T14:43:10.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/57: mknod d2/db/de/c11 0 2024-03-18T14:43:10.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/65: readlink d3/d7/le 0 2024-03-18T14:43:10.253 INFO:tasks.workunit.client.0.smithi087.stdout:9/167: dwrite db/d18/f2a [0,4194304] 0 2024-03-18T14:43:10.254 INFO:tasks.workunit.client.0.smithi087.stdout:6/66: dread - d3/d7/f14 zero size 2024-03-18T14:43:10.254 INFO:tasks.workunit.client.0.smithi087.stdout:9/168: fsync db/f2f 0 2024-03-18T14:43:10.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/169: fsync db/f1a 0 2024-03-18T14:43:10.258 INFO:tasks.workunit.client.0.smithi087.stdout:4/58: dwrite d2/f9 [0,4194304] 0 2024-03-18T14:43:10.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/59: write d2/f9 [1986453,84066] 0 2024-03-18T14:43:10.262 INFO:tasks.workunit.client.0.smithi087.stdout:6/67: dwrite d3/d7/d8/f10 [0,4194304] 0 2024-03-18T14:43:10.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/170: dwrite db/d18/d1e/f21 [0,4194304] 0 2024-03-18T14:43:10.266 INFO:tasks.workunit.client.0.smithi087.stdout:8/100: unlink d1/f21 0 2024-03-18T14:43:10.267 INFO:tasks.workunit.client.0.smithi087.stdout:8/101: dread - d1/f1a zero size 2024-03-18T14:43:10.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/83: dwrite d0/d2/d4/f12 [0,4194304] 0 2024-03-18T14:43:10.269 INFO:tasks.workunit.client.0.smithi087.stdout:6/68: dread d3/d7/d8/f10 [0,4194304] 0 2024-03-18T14:43:10.270 INFO:tasks.workunit.client.0.smithi087.stdout:0/84: readlink d0/d2/d4/lb 0 2024-03-18T14:43:10.271 INFO:tasks.workunit.client.0.smithi087.stdout:0/85: write d0/fc [1055197,67461] 0 2024-03-18T14:43:10.273 INFO:tasks.workunit.client.0.smithi087.stdout:7/157: sync 2024-03-18T14:43:10.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/167: sync 2024-03-18T14:43:10.274 INFO:tasks.workunit.client.0.smithi087.stdout:2/60: sync 2024-03-18T14:43:10.274 INFO:tasks.workunit.client.0.smithi087.stdout:1/164: dwrite d3/f16 [0,4194304] 0 2024-03-18T14:43:10.277 INFO:tasks.workunit.client.0.smithi087.stdout:7/158: dread d1/f3 [0,4194304] 0 2024-03-18T14:43:10.281 INFO:tasks.workunit.client.0.smithi087.stdout:0/86: creat d0/d2/f18 x:0 0 0 2024-03-18T14:43:10.283 INFO:tasks.workunit.client.0.smithi087.stdout:0/87: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:10.288 INFO:tasks.workunit.client.0.smithi087.stdout:9/171: mkdir db/d31 0 2024-03-18T14:43:10.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/159: rename d1/f12 to d1/d6/d16/dc/f32 0 2024-03-18T14:43:10.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/160: write d1/f10 [661343,120594] 0 2024-03-18T14:43:10.291 INFO:tasks.workunit.client.0.smithi087.stdout:7/161: chown d1/d6/da/ff 312621 1 2024-03-18T14:43:10.291 INFO:tasks.workunit.client.0.smithi087.stdout:3/168: symlink d0/d3/l2e 0 2024-03-18T14:43:10.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/162: fsync d1/f28 0 2024-03-18T14:43:10.300 INFO:tasks.workunit.client.0.smithi087.stdout:3/169: rename d0/d3/l15 to d0/d3/df/l2f 0 2024-03-18T14:43:10.300 INFO:tasks.workunit.client.0.smithi087.stdout:8/102: link d1/c12 d1/d6/c26 0 2024-03-18T14:43:10.300 INFO:tasks.workunit.client.0.smithi087.stdout:8/103: stat d1/fd 0 2024-03-18T14:43:10.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/104: write d1/d6/d14/f15 [1478248,6732] 0 2024-03-18T14:43:10.302 INFO:tasks.workunit.client.0.smithi087.stdout:7/163: fdatasync d1/d6/d16/dc/f32 0 2024-03-18T14:43:10.303 INFO:tasks.workunit.client.0.smithi087.stdout:3/170: mkdir d0/de/d30 0 2024-03-18T14:43:10.306 INFO:tasks.workunit.client.0.smithi087.stdout:8/105: creat d1/d6/d14/f27 x:0 0 0 2024-03-18T14:43:10.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/172: getdents db/d12 0 2024-03-18T14:43:10.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/164: dwrite d1/d6/f7 [0,4194304] 0 2024-03-18T14:43:10.309 INFO:tasks.workunit.client.0.smithi087.stdout:4/60: truncate d2/f9 650034 0 2024-03-18T14:43:10.310 INFO:tasks.workunit.client.0.smithi087.stdout:4/61: chown d2/db/de/c11 257408 1 2024-03-18T14:43:10.312 INFO:tasks.workunit.client.0.smithi087.stdout:8/106: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:10.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/107: stat d1/d6/d14/f1f 0 2024-03-18T14:43:10.316 INFO:tasks.workunit.client.0.smithi087.stdout:8/108: write d1/d6/d14/f1c [519573,29839] 0 2024-03-18T14:43:10.316 INFO:tasks.workunit.client.0.smithi087.stdout:6/69: dwrite d3/f6 [4194304,4194304] 0 2024-03-18T14:43:10.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/88: dwrite d0/d2/f17 [0,4194304] 0 2024-03-18T14:43:10.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/89: readlink d0/l14 0 2024-03-18T14:43:10.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/165: rename f0 to d1/d6/d29/d2f/f33 0 2024-03-18T14:43:10.325 INFO:tasks.workunit.client.0.smithi087.stdout:3/171: creat d0/d3/f31 x:0 0 0 2024-03-18T14:43:10.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/166: dread d1/d6/d16/dc/f32 [0,4194304] 0 2024-03-18T14:43:10.328 INFO:tasks.workunit.client.0.smithi087.stdout:6/70: mknod d3/d7/c15 0 2024-03-18T14:43:10.330 INFO:tasks.workunit.client.0.smithi087.stdout:0/90: mkdir d0/d2/d4/d19 0 2024-03-18T14:43:10.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/173: symlink db/d18/l32 0 2024-03-18T14:43:10.331 INFO:tasks.workunit.client.0.smithi087.stdout:5/161: sync 2024-03-18T14:43:10.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/174: chown ca 19 1 2024-03-18T14:43:10.331 INFO:tasks.workunit.client.0.smithi087.stdout:5/162: write d13/d1b/f25 [608197,15938] 0 2024-03-18T14:43:10.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/167: creat d1/d6/d29/f34 x:0 0 0 2024-03-18T14:43:10.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/91: mkdir d0/d1a 0 2024-03-18T14:43:10.337 INFO:tasks.workunit.client.0.smithi087.stdout:5/163: mkdir d13/d1b/d30 0 2024-03-18T14:43:10.337 INFO:tasks.workunit.client.0.smithi087.stdout:5/164: write ff [6151611,5217] 0 2024-03-18T14:43:10.337 INFO:tasks.workunit.client.0.smithi087.stdout:3/172: creat d0/de/d30/f32 x:0 0 0 2024-03-18T14:43:10.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/168: mkdir d1/d6/d29/d35 0 2024-03-18T14:43:10.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/169: chown d1/l2d 41646 1 2024-03-18T14:43:10.340 INFO:tasks.workunit.client.0.smithi087.stdout:0/92: rmdir d0/dd 39 2024-03-18T14:43:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/165: creat d13/d1b/f31 x:0 0 0 2024-03-18T14:43:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/170: unlink d1/f28 0 2024-03-18T14:43:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:0/93: fsync d0/f11 0 2024-03-18T14:43:10.359 INFO:tasks.workunit.client.0.smithi087.stdout:3/173: rmdir d0/d3 39 2024-03-18T14:43:10.360 INFO:tasks.workunit.client.0.smithi087.stdout:5/166: fdatasync d13/f1a 0 2024-03-18T14:43:10.360 INFO:tasks.workunit.client.0.smithi087.stdout:0/94: fsync d0/f10 0 2024-03-18T14:43:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:8/109: write d1/f5 [132883,59698] 0 2024-03-18T14:43:10.361 INFO:tasks.workunit.client.0.smithi087.stdout:6/71: truncate d3/d7/d8/f10 1917084 0 2024-03-18T14:43:10.362 INFO:tasks.workunit.client.0.smithi087.stdout:4/62: truncate d2/f9 87763 0 2024-03-18T14:43:10.362 INFO:tasks.workunit.client.0.smithi087.stdout:8/110: dread - d1/f1a zero size 2024-03-18T14:43:10.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/95: chown d0/c9 373977 1 2024-03-18T14:43:10.367 INFO:tasks.workunit.client.0.smithi087.stdout:0/96: readlink d0/d2/d4/lb 0 2024-03-18T14:43:10.368 INFO:tasks.workunit.client.0.smithi087.stdout:0/97: fsync d0/f11 0 2024-03-18T14:43:10.368 INFO:tasks.workunit.client.0.smithi087.stdout:6/72: creat d3/d7/d8/f16 x:0 0 0 2024-03-18T14:43:10.369 INFO:tasks.workunit.client.0.smithi087.stdout:8/111: write d1/f2 [1291653,60971] 0 2024-03-18T14:43:10.370 INFO:tasks.workunit.client.0.smithi087.stdout:7/171: creat d1/f36 x:0 0 0 2024-03-18T14:43:10.371 INFO:tasks.workunit.client.0.smithi087.stdout:2/61: sync 2024-03-18T14:43:10.373 INFO:tasks.workunit.client.0.smithi087.stdout:2/62: dread f1 [4194304,4194304] 0 2024-03-18T14:43:10.374 INFO:tasks.workunit.client.0.smithi087.stdout:5/167: rename d13/d1b/l1f to d13/l32 0 2024-03-18T14:43:10.376 INFO:tasks.workunit.client.0.smithi087.stdout:7/172: creat d1/d6/da/f37 x:0 0 0 2024-03-18T14:43:10.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/63: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:10.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/73: mknod d3/c17 0 2024-03-18T14:43:10.380 INFO:tasks.workunit.client.0.smithi087.stdout:0/98: write d0/f16 [1438163,59518] 0 2024-03-18T14:43:10.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/174: rename d0/f27 to d0/d3/df/f33 0 2024-03-18T14:43:10.383 INFO:tasks.workunit.client.0.smithi087.stdout:8/112: symlink d1/d6/l28 0 2024-03-18T14:43:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/74: mknod d3/d7/d8/c18 0 2024-03-18T14:43:10.388 INFO:tasks.workunit.client.0.smithi087.stdout:4/63: getdents d2/db/de 0 2024-03-18T14:43:10.389 INFO:tasks.workunit.client.0.smithi087.stdout:6/75: chown d3/f4 2190561 1 2024-03-18T14:43:10.389 INFO:tasks.workunit.client.0.smithi087.stdout:2/64: dwrite d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.391 INFO:tasks.workunit.client.0.smithi087.stdout:7/173: mknod d1/d6/d29/d35/c38 0 2024-03-18T14:43:10.394 INFO:tasks.workunit.client.0.smithi087.stdout:0/99: mkdir d0/d1b 0 2024-03-18T14:43:10.394 INFO:tasks.workunit.client.0.smithi087.stdout:2/65: dwrite d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.395 INFO:tasks.workunit.client.0.smithi087.stdout:2/66: chown d2/d4/l9 16 1 2024-03-18T14:43:10.396 INFO:tasks.workunit.client.0.smithi087.stdout:7/174: dread d1/f3 [4194304,4194304] 0 2024-03-18T14:43:10.397 INFO:tasks.workunit.client.0.smithi087.stdout:7/175: chown d1/f2e 117 1 2024-03-18T14:43:10.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/67: dread d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.401 INFO:tasks.workunit.client.0.smithi087.stdout:3/175: creat d0/f34 x:0 0 0 2024-03-18T14:43:10.402 INFO:tasks.workunit.client.0.smithi087.stdout:5/168: getdents d13/d1b/d27 0 2024-03-18T14:43:10.403 INFO:tasks.workunit.client.0.smithi087.stdout:7/176: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:10.403 INFO:tasks.workunit.client.0.smithi087.stdout:2/68: dread d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.405 INFO:tasks.workunit.client.0.smithi087.stdout:4/64: write d2/f10 [726074,106943] 0 2024-03-18T14:43:10.406 INFO:tasks.workunit.client.0.smithi087.stdout:0/100: symlink d0/l1c 0 2024-03-18T14:43:10.406 INFO:tasks.workunit.client.0.smithi087.stdout:6/76: creat d3/f19 x:0 0 0 2024-03-18T14:43:10.408 INFO:tasks.workunit.client.0.smithi087.stdout:3/176: write d0/d3/df/f14 [5204358,36224] 0 2024-03-18T14:43:10.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/69: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:10.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/169: mknod d13/d1b/d30/c33 0 2024-03-18T14:43:10.414 INFO:tasks.workunit.client.0.smithi087.stdout:4/65: symlink d2/l12 0 2024-03-18T14:43:10.416 INFO:tasks.workunit.client.0.smithi087.stdout:5/170: dwrite d13/d1b/d27/f2d [0,4194304] 0 2024-03-18T14:43:10.417 INFO:tasks.workunit.client.0.smithi087.stdout:2/70: write f1 [400783,70120] 0 2024-03-18T14:43:10.421 INFO:tasks.workunit.client.0.smithi087.stdout:6/77: mkdir d3/d1a 0 2024-03-18T14:43:10.421 INFO:tasks.workunit.client.0.smithi087.stdout:5/171: dwrite d13/d1b/d27/f2c [0,4194304] 0 2024-03-18T14:43:10.422 INFO:tasks.workunit.client.0.smithi087.stdout:2/71: dread d2/d4/fd [0,4194304] 0 2024-03-18T14:43:10.422 INFO:tasks.workunit.client.0.smithi087.stdout:6/78: write d3/f6 [7350610,16256] 0 2024-03-18T14:43:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/172: dread - d13/d1b/f31 zero size 2024-03-18T14:43:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/79: fsync d3/f19 0 2024-03-18T14:43:10.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/173: chown d13/d1b/d30 4 1 2024-03-18T14:43:10.426 INFO:tasks.workunit.client.0.smithi087.stdout:0/101: getdents d0 0 2024-03-18T14:43:10.426 INFO:tasks.workunit.client.0.smithi087.stdout:0/102: readlink d0/d2/d4/lb 0 2024-03-18T14:43:10.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/177: dread d1/d6/d29/d2f/f33 [0,4194304] 0 2024-03-18T14:43:10.428 INFO:tasks.workunit.client.0.smithi087.stdout:4/66: mkdir d2/d13 0 2024-03-18T14:43:10.429 INFO:tasks.workunit.client.0.smithi087.stdout:4/67: chown d2/l7 14 1 2024-03-18T14:43:10.429 INFO:tasks.workunit.client.0.smithi087.stdout:4/68: fdatasync f1 0 2024-03-18T14:43:10.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/80: rename c2 to d3/d7/d8/c1b 0 2024-03-18T14:43:10.432 INFO:tasks.workunit.client.0.smithi087.stdout:7/178: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:10.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/177: dread d0/d3/d10/f2c [0,4194304] 0 2024-03-18T14:43:10.433 INFO:tasks.workunit.client.0.smithi087.stdout:7/179: dread - d1/f20 zero size 2024-03-18T14:43:10.434 INFO:tasks.workunit.client.0.smithi087.stdout:9/175: sync 2024-03-18T14:43:10.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/165: sync 2024-03-18T14:43:10.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/166: chown d3/f10 225686 1 2024-03-18T14:43:10.438 INFO:tasks.workunit.client.0.smithi087.stdout:6/81: dwrite d3/d7/d8/f16 [0,4194304] 0 2024-03-18T14:43:10.440 INFO:tasks.workunit.client.0.smithi087.stdout:9/176: creat db/d12/f33 x:0 0 0 2024-03-18T14:43:10.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/180: mknod d1/d6/d29/d2f/c39 0 2024-03-18T14:43:10.441 INFO:tasks.workunit.client.0.smithi087.stdout:5/174: link d13/f16 d13/d1b/d27/f34 0 2024-03-18T14:43:10.443 INFO:tasks.workunit.client.0.smithi087.stdout:3/178: write d0/d3/f7 [3547439,122596] 0 2024-03-18T14:43:10.444 INFO:tasks.workunit.client.0.smithi087.stdout:9/177: dwrite db/d18/d1e/f21 [0,4194304] 0 2024-03-18T14:43:10.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/69: link d2/c3 d2/db/c14 0 2024-03-18T14:43:10.447 INFO:tasks.workunit.client.0.smithi087.stdout:6/82: symlink d3/d7/l1c 0 2024-03-18T14:43:10.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/175: chown d13/l32 6 1 2024-03-18T14:43:10.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/181: write d1/d6/d29/d2f/f33 [1491796,101877] 0 2024-03-18T14:43:10.449 INFO:tasks.workunit.client.0.smithi087.stdout:5/176: dread - d13/f23 zero size 2024-03-18T14:43:10.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/83: dread d3/fa [0,4194304] 0 2024-03-18T14:43:10.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/179: mknod d0/d1c/c35 0 2024-03-18T14:43:10.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/177: dwrite fb [0,4194304] 0 2024-03-18T14:43:10.456 INFO:tasks.workunit.client.0.smithi087.stdout:7/182: symlink d1/d6/d16/l3a 0 2024-03-18T14:43:10.456 INFO:tasks.workunit.client.0.smithi087.stdout:6/84: creat d3/d7/d8/f1d x:0 0 0 2024-03-18T14:43:10.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/180: dwrite d0/f19 [0,4194304] 0 2024-03-18T14:43:10.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/70: getdents d2/d13 0 2024-03-18T14:43:10.459 INFO:tasks.workunit.client.0.smithi087.stdout:5/178: mkdir d13/d1b/d27/d35 0 2024-03-18T14:43:10.466 INFO:tasks.workunit.client.0.smithi087.stdout:1/167: truncate d3/f7 1928763 0 2024-03-18T14:43:10.466 INFO:tasks.workunit.client.0.smithi087.stdout:3/181: unlink d0/c22 0 2024-03-18T14:43:10.467 INFO:tasks.workunit.client.0.smithi087.stdout:1/168: chown d3/l14 0 1 2024-03-18T14:43:10.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/182: chown d0/d3/df/f16 0 1 2024-03-18T14:43:10.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/85: rename d3/fa to d3/d1a/f1e 0 2024-03-18T14:43:10.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/183: symlink d1/l3b 0 2024-03-18T14:43:10.470 INFO:tasks.workunit.client.0.smithi087.stdout:9/178: dwrite db/f1a [0,4194304] 0 2024-03-18T14:43:10.470 INFO:tasks.workunit.client.0.smithi087.stdout:1/169: chown d3/d1d/d1f/f24 3817301 1 2024-03-18T14:43:10.471 INFO:tasks.workunit.client.0.smithi087.stdout:4/71: getdents d2/d13 0 2024-03-18T14:43:10.471 INFO:tasks.workunit.client.0.smithi087.stdout:1/170: chown d3/f12 464355551 1 2024-03-18T14:43:10.471 INFO:tasks.workunit.client.0.smithi087.stdout:6/86: symlink d3/d1a/l1f 0 2024-03-18T14:43:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:1/171: readlink d3/ld 0 2024-03-18T14:43:10.472 INFO:tasks.workunit.client.0.smithi087.stdout:6/87: stat d3/d1a 0 2024-03-18T14:43:10.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/179: creat db/d31/f34 x:0 0 0 2024-03-18T14:43:10.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/72: mknod d2/d13/c15 0 2024-03-18T14:43:10.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/180: rename db/d31 to db/d31/d35 22 2024-03-18T14:43:10.475 INFO:tasks.workunit.client.0.smithi087.stdout:1/172: creat d3/d1d/d1e/f36 x:0 0 0 2024-03-18T14:43:10.478 INFO:tasks.workunit.client.0.smithi087.stdout:4/73: chown d2/f9 23221855 1 2024-03-18T14:43:10.480 INFO:tasks.workunit.client.0.smithi087.stdout:9/181: rename db/d18/f30 to db/d31/f36 0 2024-03-18T14:43:10.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/184: getdents d1/d6/d29 0 2024-03-18T14:43:10.482 INFO:tasks.workunit.client.0.smithi087.stdout:6/88: dwrite f1 [0,4194304] 0 2024-03-18T14:43:10.484 INFO:tasks.workunit.client.0.smithi087.stdout:1/173: rename d3/fc to d3/d1d/d1e/f37 0 2024-03-18T14:43:10.485 INFO:tasks.workunit.client.0.smithi087.stdout:4/74: dread d2/f10 [0,4194304] 0 2024-03-18T14:43:10.489 INFO:tasks.workunit.client.0.smithi087.stdout:4/75: dwrite f1 [0,4194304] 0 2024-03-18T14:43:10.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/182: creat db/d18/d1c/f37 x:0 0 0 2024-03-18T14:43:10.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/183: chown db/c2d 0 1 2024-03-18T14:43:10.493 INFO:tasks.workunit.client.0.smithi087.stdout:8/113: sync 2024-03-18T14:43:10.494 INFO:tasks.workunit.client.0.smithi087.stdout:6/89: read d3/d7/d8/f10 [1653044,68951] 0 2024-03-18T14:43:10.495 INFO:tasks.workunit.client.0.smithi087.stdout:1/174: truncate d3/d1d/d1f/f24 1084314 0 2024-03-18T14:43:10.496 INFO:tasks.workunit.client.0.smithi087.stdout:7/185: symlink d1/l3c 0 2024-03-18T14:43:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:9/184: chown db/fd 36500102 1 2024-03-18T14:43:10.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/186: write d1/f2b [512992,75485] 0 2024-03-18T14:43:10.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/114: write d1/d6/f1d [2015299,31535] 0 2024-03-18T14:43:10.499 INFO:tasks.workunit.client.0.smithi087.stdout:6/90: mknod d3/d7/c20 0 2024-03-18T14:43:10.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/115: readlink d1/lb 0 2024-03-18T14:43:10.500 INFO:tasks.workunit.client.0.smithi087.stdout:3/183: dread d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:10.501 INFO:tasks.workunit.client.0.smithi087.stdout:7/187: mknod d1/d6/da/c3d 0 2024-03-18T14:43:10.502 INFO:tasks.workunit.client.0.smithi087.stdout:4/76: creat d2/f16 x:0 0 0 2024-03-18T14:43:10.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/77: chown d2/l12 0 1 2024-03-18T14:43:10.504 INFO:tasks.workunit.client.0.smithi087.stdout:9/185: dwrite f3 [0,4194304] 0 2024-03-18T14:43:10.504 INFO:tasks.workunit.client.0.smithi087.stdout:6/91: unlink d3/d7/d8/f10 0 2024-03-18T14:43:10.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/184: mknod d0/d3/d10/c36 0 2024-03-18T14:43:10.507 INFO:tasks.workunit.client.0.smithi087.stdout:9/186: read db/d12/f20 [2571000,88048] 0 2024-03-18T14:43:10.508 INFO:tasks.workunit.client.0.smithi087.stdout:7/188: rename d1/d6/d29/d2f/c39 to d1/d6/d29/d35/c3e 0 2024-03-18T14:43:10.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/189: chown d1/l3c 1743360938 1 2024-03-18T14:43:10.509 INFO:tasks.workunit.client.0.smithi087.stdout:7/190: fsync d1/f2e 0 2024-03-18T14:43:10.510 INFO:tasks.workunit.client.0.smithi087.stdout:4/78: creat d2/db/de/f17 x:0 0 0 2024-03-18T14:43:10.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/92: dread f1 [0,4194304] 0 2024-03-18T14:43:10.511 INFO:tasks.workunit.client.0.smithi087.stdout:8/116: creat d1/d6/f29 x:0 0 0 2024-03-18T14:43:10.512 INFO:tasks.workunit.client.0.smithi087.stdout:4/79: dread d2/f9 [0,4194304] 0 2024-03-18T14:43:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:3/185: dread d0/f1 [4194304,4194304] 0 2024-03-18T14:43:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:4/80: stat d2/db/c14 0 2024-03-18T14:43:10.513 INFO:tasks.workunit.client.0.smithi087.stdout:6/93: creat d3/d7/f21 x:0 0 0 2024-03-18T14:43:10.514 INFO:tasks.workunit.client.0.smithi087.stdout:8/117: write d1/d6/d9/f17 [1036603,71027] 0 2024-03-18T14:43:10.514 INFO:tasks.workunit.client.0.smithi087.stdout:7/191: mkdir d1/d6/d16/d3f 0 2024-03-18T14:43:10.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/72: sync 2024-03-18T14:43:10.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/192: fdatasync d1/d6/f2a 0 2024-03-18T14:43:10.516 INFO:tasks.workunit.client.0.smithi087.stdout:9/187: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:10.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/188: chown db/d12/c1b 878482 1 2024-03-18T14:43:10.520 INFO:tasks.workunit.client.0.smithi087.stdout:9/189: write db/d31/f34 [199447,192] 0 2024-03-18T14:43:10.521 INFO:tasks.workunit.client.0.smithi087.stdout:6/94: dread d3/d7/d8/f16 [0,4194304] 0 2024-03-18T14:43:10.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/190: read f3 [1726580,86783] 0 2024-03-18T14:43:10.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/73: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:10.523 INFO:tasks.workunit.client.0.smithi087.stdout:4/81: mknod d2/d13/c18 0 2024-03-18T14:43:10.524 INFO:tasks.workunit.client.0.smithi087.stdout:4/82: fdatasync d2/f16 0 2024-03-18T14:43:10.530 INFO:tasks.workunit.client.0.smithi087.stdout:6/95: dwrite d3/d7/f14 [0,4194304] 0 2024-03-18T14:43:10.531 INFO:tasks.workunit.client.0.smithi087.stdout:9/191: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:10.531 INFO:tasks.workunit.client.0.smithi087.stdout:2/74: dwrite f1 [0,4194304] 0 2024-03-18T14:43:10.533 INFO:tasks.workunit.client.0.smithi087.stdout:8/118: rename d1/d6/f1d to d1/d6/d14/f2a 0 2024-03-18T14:43:10.539 INFO:tasks.workunit.client.0.smithi087.stdout:4/83: creat d2/d13/f19 x:0 0 0 2024-03-18T14:43:10.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/175: truncate d3/d1d/d1f/f24 1935425 0 2024-03-18T14:43:10.543 INFO:tasks.workunit.client.0.smithi087.stdout:8/119: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:10.544 INFO:tasks.workunit.client.0.smithi087.stdout:2/75: mkdir d2/d4/d11 0 2024-03-18T14:43:10.545 INFO:tasks.workunit.client.0.smithi087.stdout:2/76: write f1 [883735,114098] 0 2024-03-18T14:43:10.546 INFO:tasks.workunit.client.0.smithi087.stdout:2/77: read d2/f10 [498388,108565] 0 2024-03-18T14:43:10.546 INFO:tasks.workunit.client.0.smithi087.stdout:9/192: unlink db/d18/d1e/f21 0 2024-03-18T14:43:10.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/103: sync 2024-03-18T14:43:10.547 INFO:tasks.workunit.client.0.smithi087.stdout:5/179: sync 2024-03-18T14:43:10.547 INFO:tasks.workunit.client.0.smithi087.stdout:8/120: dread d1/f2 [0,4194304] 0 2024-03-18T14:43:10.549 INFO:tasks.workunit.client.0.smithi087.stdout:3/186: creat d0/f37 x:0 0 0 2024-03-18T14:43:10.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/121: write d1/d6/d14/f24 [34874,33278] 0 2024-03-18T14:43:10.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/122: fdatasync d1/d6/f1e 0 2024-03-18T14:43:10.550 INFO:tasks.workunit.client.0.smithi087.stdout:4/84: mknod d2/d13/c1a 0 2024-03-18T14:43:10.553 INFO:tasks.workunit.client.0.smithi087.stdout:8/123: dread d1/d6/d9/fe [4194304,4194304] 0 2024-03-18T14:43:10.554 INFO:tasks.workunit.client.0.smithi087.stdout:1/176: dwrite d3/d1d/d1e/f37 [0,4194304] 0 2024-03-18T14:43:10.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/104: creat d0/d2/d4/f1d x:0 0 0 2024-03-18T14:43:10.555 INFO:tasks.workunit.client.0.smithi087.stdout:7/193: link d1/d6/d16/c1f d1/d6/d16/dc/c40 0 2024-03-18T14:43:10.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/187: rmdir d0/d3/df 39 2024-03-18T14:43:10.556 INFO:tasks.workunit.client.0.smithi087.stdout:7/194: write d1/f36 [142931,98825] 0 2024-03-18T14:43:10.557 INFO:tasks.workunit.client.0.smithi087.stdout:4/85: mknod d2/d13/c1b 0 2024-03-18T14:43:10.562 INFO:tasks.workunit.client.0.smithi087.stdout:6/96: write d3/d7/f11 [327300,61007] 0 2024-03-18T14:43:10.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/97: dread d3/d7/f11 [0,4194304] 0 2024-03-18T14:43:10.570 INFO:tasks.workunit.client.0.smithi087.stdout:1/177: mkdir d3/d1d/d1f/d34/d38 0 2024-03-18T14:43:10.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/78: truncate d2/f10 2684691 0 2024-03-18T14:43:10.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/105: rename d0/c9 to d0/d1b/c1e 0 2024-03-18T14:43:10.575 INFO:tasks.workunit.client.0.smithi087.stdout:9/193: truncate db/d18/f2a 4601520 0 2024-03-18T14:43:10.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/180: dwrite d13/f16 [0,4194304] 0 2024-03-18T14:43:10.577 INFO:tasks.workunit.client.0.smithi087.stdout:7/195: symlink d1/d6/d16/dc/l41 0 2024-03-18T14:43:10.577 INFO:tasks.workunit.client.0.smithi087.stdout:1/178: dwrite d3/f16 [4194304,4194304] 0 2024-03-18T14:43:10.580 INFO:tasks.workunit.client.0.smithi087.stdout:6/98: mkdir d3/d7/d8/d22 0 2024-03-18T14:43:10.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/86: rename d2/d13/f19 to d2/db/f1c 0 2024-03-18T14:43:10.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/87: dread - d2/f16 zero size 2024-03-18T14:43:10.595 INFO:tasks.workunit.client.0.smithi087.stdout:1/179: creat d3/d1d/d1e/d20/f39 x:0 0 0 2024-03-18T14:43:10.599 INFO:tasks.workunit.client.0.smithi087.stdout:8/124: truncate d1/fd 1530940 0 2024-03-18T14:43:10.599 INFO:tasks.workunit.client.0.smithi087.stdout:8/125: readlink d1/lb 0 2024-03-18T14:43:10.601 INFO:tasks.workunit.client.0.smithi087.stdout:9/194: getdents db/d18/d1e/d28 0 2024-03-18T14:43:10.601 INFO:tasks.workunit.client.0.smithi087.stdout:9/195: chown ca 17331955 1 2024-03-18T14:43:10.602 INFO:tasks.workunit.client.0.smithi087.stdout:4/88: creat d2/db/f1d x:0 0 0 2024-03-18T14:43:10.603 INFO:tasks.workunit.client.0.smithi087.stdout:4/89: chown d2/db/de/f17 362448 1 2024-03-18T14:43:10.605 INFO:tasks.workunit.client.0.smithi087.stdout:2/79: rmdir d2/d4/d11 0 2024-03-18T14:43:10.606 INFO:tasks.workunit.client.0.smithi087.stdout:3/188: getdents d0/d3 0 2024-03-18T14:43:10.608 INFO:tasks.workunit.client.0.smithi087.stdout:8/126: dread d1/f2 [0,4194304] 0 2024-03-18T14:43:10.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/196: creat db/d18/d1e/f38 x:0 0 0 2024-03-18T14:43:10.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/127: fsync d1/f1a 0 2024-03-18T14:43:10.620 INFO:tasks.workunit.client.0.smithi087.stdout:2/80: rename d2/cf to d2/c12 0 2024-03-18T14:43:10.621 INFO:tasks.workunit.client.0.smithi087.stdout:3/189: mknod d0/d3/d10/c38 0 2024-03-18T14:43:10.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/90: write d2/f9 [506507,70821] 0 2024-03-18T14:43:10.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/180: dwrite d3/f8 [0,4194304] 0 2024-03-18T14:43:10.622 INFO:tasks.workunit.client.0.smithi087.stdout:5/181: link d13/c22 d13/c36 0 2024-03-18T14:43:10.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/81: write d2/fb [934755,97558] 0 2024-03-18T14:43:10.623 INFO:tasks.workunit.client.0.smithi087.stdout:6/99: sync 2024-03-18T14:43:10.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/182: readlink d13/l14 0 2024-03-18T14:43:10.625 INFO:tasks.workunit.client.0.smithi087.stdout:6/100: write d3/d7/d8/f1d [94335,40391] 0 2024-03-18T14:43:10.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/181: write d3/d1d/d1f/d34/f35 [312781,78934] 0 2024-03-18T14:43:10.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/82: fsync d2/fb 0 2024-03-18T14:43:10.629 INFO:tasks.workunit.client.0.smithi087.stdout:6/101: dwrite d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:10.632 INFO:tasks.workunit.client.0.smithi087.stdout:6/102: dwrite d3/d7/d8/f1d [0,4194304] 0 2024-03-18T14:43:10.748 INFO:tasks.workunit.client.0.smithi087.stdout:7/196: getdents d1/d6/d29/d2f 0 2024-03-18T14:43:10.748 INFO:tasks.workunit.client.0.smithi087.stdout:7/197: chown d1/f36 104 1 2024-03-18T14:43:10.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/106: creat d0/d1a/f1f x:0 0 0 2024-03-18T14:43:10.750 INFO:tasks.workunit.client.0.smithi087.stdout:9/197: mknod db/d18/c39 0 2024-03-18T14:43:10.751 INFO:tasks.workunit.client.0.smithi087.stdout:8/128: fdatasync d1/d6/d14/f2a 0 2024-03-18T14:43:10.751 INFO:tasks.workunit.client.0.smithi087.stdout:8/129: chown d1/c11 68270829 1 2024-03-18T14:43:10.753 INFO:tasks.workunit.client.0.smithi087.stdout:4/91: mknod d2/db/c1e 0 2024-03-18T14:43:10.754 INFO:tasks.workunit.client.0.smithi087.stdout:3/190: dread d0/d1c/f1e [0,4194304] 0 2024-03-18T14:43:10.755 INFO:tasks.workunit.client.0.smithi087.stdout:9/198: dwrite f1 [4194304,4194304] 0 2024-03-18T14:43:10.759 INFO:tasks.workunit.client.0.smithi087.stdout:9/199: dwrite db/f2f [0,4194304] 0 2024-03-18T14:43:10.764 INFO:tasks.workunit.client.0.smithi087.stdout:1/182: rmdir d3/d1d/d1e 39 2024-03-18T14:43:10.791 INFO:tasks.workunit.client.0.smithi087.stdout:7/198: mkdir d1/d6/da/d42 0 2024-03-18T14:43:10.841 INFO:tasks.workunit.client.0.smithi087.stdout:6/103: write d3/d7/f11 [130948,70460] 0 2024-03-18T14:43:10.848 INFO:tasks.workunit.client.0.smithi087.stdout:2/83: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:10.848 INFO:tasks.workunit.client.0.smithi087.stdout:0/107: rename d0/fe to d0/d1a/f20 0 2024-03-18T14:43:10.849 INFO:tasks.workunit.client.0.smithi087.stdout:2/84: chown d2/ce 13 1 2024-03-18T14:43:10.850 INFO:tasks.workunit.client.0.smithi087.stdout:5/183: creat d13/f37 x:0 0 0 2024-03-18T14:43:10.852 INFO:tasks.workunit.client.0.smithi087.stdout:9/200: mkdir db/d18/d3a 0 2024-03-18T14:43:10.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/130: truncate d1/f1b 1048235 0 2024-03-18T14:43:10.854 INFO:tasks.workunit.client.0.smithi087.stdout:2/85: dread d2/fb [0,4194304] 0 2024-03-18T14:43:10.855 INFO:tasks.workunit.client.0.smithi087.stdout:2/86: chown d2/d4/fd 1001 1 2024-03-18T14:43:10.855 INFO:tasks.workunit.client.0.smithi087.stdout:1/183: rmdir d3/d1d/d1e/d20 39 2024-03-18T14:43:10.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/131: dwrite d1/f1a [0,4194304] 0 2024-03-18T14:43:10.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/191: rename d0/d3/df/f1d to d0/d1c/f39 0 2024-03-18T14:43:10.860 INFO:tasks.workunit.client.0.smithi087.stdout:4/92: creat d2/f1f x:0 0 0 2024-03-18T14:43:10.861 INFO:tasks.workunit.client.0.smithi087.stdout:4/93: stat d2/f9 0 2024-03-18T14:43:10.861 INFO:tasks.workunit.client.0.smithi087.stdout:6/104: mkdir d3/d7/d8/d22/d23 0 2024-03-18T14:43:10.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/184: mknod d13/d1b/d27/d28/c38 0 2024-03-18T14:43:10.862 INFO:tasks.workunit.client.0.smithi087.stdout:2/87: mknod d2/c13 0 2024-03-18T14:43:10.863 INFO:tasks.workunit.client.0.smithi087.stdout:1/184: rmdir d3/d1d/d1e 39 2024-03-18T14:43:10.863 INFO:tasks.workunit.client.0.smithi087.stdout:2/88: chown d2/d4/l9 0 1 2024-03-18T14:43:10.863 INFO:tasks.workunit.client.0.smithi087.stdout:1/185: readlink d3/l11 0 2024-03-18T14:43:10.864 INFO:tasks.workunit.client.0.smithi087.stdout:7/199: rmdir d1/d6/d16/d3f 0 2024-03-18T14:43:10.865 INFO:tasks.workunit.client.0.smithi087.stdout:2/89: dread d2/fb [0,4194304] 0 2024-03-18T14:43:10.867 INFO:tasks.workunit.client.0.smithi087.stdout:1/186: dread d3/f16 [4194304,4194304] 0 2024-03-18T14:43:10.869 INFO:tasks.workunit.client.0.smithi087.stdout:2/90: dwrite d2/fb [0,4194304] 0 2024-03-18T14:43:10.872 INFO:tasks.workunit.client.0.smithi087.stdout:7/200: creat d1/d6/da/f43 x:0 0 0 2024-03-18T14:43:10.872 INFO:tasks.workunit.client.0.smithi087.stdout:1/187: readlink d3/l5 0 2024-03-18T14:43:10.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/91: dread f1 [0,4194304] 0 2024-03-18T14:43:10.873 INFO:tasks.workunit.client.0.smithi087.stdout:7/201: write d1/d6/da/ff [9333484,114127] 0 2024-03-18T14:43:10.874 INFO:tasks.workunit.client.0.smithi087.stdout:1/188: write d3/d1d/d1f/d34/f35 [423909,28349] 0 2024-03-18T14:43:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:4/94: link d2/db/f1c d2/db/f20 0 2024-03-18T14:43:10.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/185: creat d13/d1b/d27/d35/f39 x:0 0 0 2024-03-18T14:43:10.881 INFO:tasks.workunit.client.0.smithi087.stdout:4/95: read - d2/db/f20 zero size 2024-03-18T14:43:10.881 INFO:tasks.workunit.client.0.smithi087.stdout:4/96: chown d2/c8 696944037 1 2024-03-18T14:43:10.883 INFO:tasks.workunit.client.0.smithi087.stdout:4/97: chown d2/db/cc 1426184 1 2024-03-18T14:43:10.884 INFO:tasks.workunit.client.0.smithi087.stdout:1/189: dread d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:10.884 INFO:tasks.workunit.client.0.smithi087.stdout:4/98: fsync d2/db/de/f17 0 2024-03-18T14:43:10.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/186: dwrite d13/f26 [0,4194304] 0 2024-03-18T14:43:10.887 INFO:tasks.workunit.client.0.smithi087.stdout:8/132: creat d1/d6/f2b x:0 0 0 2024-03-18T14:43:10.888 INFO:tasks.workunit.client.0.smithi087.stdout:9/201: truncate db/d31/f34 1238496 0 2024-03-18T14:43:10.890 INFO:tasks.workunit.client.0.smithi087.stdout:9/202: write f1 [7385948,2000] 0 2024-03-18T14:43:10.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/192: dwrite d0/d3/d10/f2c [0,4194304] 0 2024-03-18T14:43:10.892 INFO:tasks.workunit.client.0.smithi087.stdout:6/105: dwrite d3/d7/d8/f1d [4194304,4194304] 0 2024-03-18T14:43:10.894 INFO:tasks.workunit.client.0.smithi087.stdout:3/193: stat d0/d3/l9 0 2024-03-18T14:43:10.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/108: link d0/d2/f13 d0/d2/f21 0 2024-03-18T14:43:10.897 INFO:tasks.workunit.client.0.smithi087.stdout:3/194: write d0/d3/fc [172335,83263] 0 2024-03-18T14:43:10.898 INFO:tasks.workunit.client.0.smithi087.stdout:8/133: dwrite d1/d6/d14/f2a [0,4194304] 0 2024-03-18T14:43:10.899 INFO:tasks.workunit.client.0.smithi087.stdout:0/109: write d0/d2/f18 [31813,41535] 0 2024-03-18T14:43:10.900 INFO:tasks.workunit.client.0.smithi087.stdout:2/92: dwrite d2/d4/fd [4194304,4194304] 0 2024-03-18T14:43:10.900 INFO:tasks.workunit.client.0.smithi087.stdout:1/190: symlink d3/d1d/d1f/d34/l3a 0 2024-03-18T14:43:10.901 INFO:tasks.workunit.client.0.smithi087.stdout:5/187: creat d13/d1b/f3a x:0 0 0 2024-03-18T14:43:10.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/203: symlink db/d12/l3b 0 2024-03-18T14:43:10.907 INFO:tasks.workunit.client.0.smithi087.stdout:6/106: creat d3/d7/f24 x:0 0 0 2024-03-18T14:43:10.909 INFO:tasks.workunit.client.0.smithi087.stdout:3/195: symlink d0/d3/df/l3a 0 2024-03-18T14:43:10.910 INFO:tasks.workunit.client.0.smithi087.stdout:3/196: readlink d0/l11 0 2024-03-18T14:43:10.910 INFO:tasks.workunit.client.0.smithi087.stdout:3/197: stat d0/d3/fd 0 2024-03-18T14:43:10.911 INFO:tasks.workunit.client.0.smithi087.stdout:6/107: dwrite d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:10.914 INFO:tasks.workunit.client.0.smithi087.stdout:8/134: rename d1/d6/d14/f24 to d1/f2c 0 2024-03-18T14:43:10.915 INFO:tasks.workunit.client.0.smithi087.stdout:8/135: dread - d1/d6/d14/f27 zero size 2024-03-18T14:43:10.917 INFO:tasks.workunit.client.0.smithi087.stdout:5/188: mkdir d13/d1b/d27/d35/d3b 0 2024-03-18T14:43:10.918 INFO:tasks.workunit.client.0.smithi087.stdout:7/202: creat d1/d6/f44 x:0 0 0 2024-03-18T14:43:10.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/204: mknod db/d18/d1e/c3c 0 2024-03-18T14:43:10.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/136: dwrite d1/d6/d9/f17 [0,4194304] 0 2024-03-18T14:43:10.922 INFO:tasks.workunit.client.0.smithi087.stdout:7/203: read d1/f31 [713521,14609] 0 2024-03-18T14:43:10.923 INFO:tasks.workunit.client.0.smithi087.stdout:6/108: mkdir d3/d7/d25 0 2024-03-18T14:43:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/99: creat d2/f21 x:0 0 0 2024-03-18T14:43:10.925 INFO:tasks.workunit.client.0.smithi087.stdout:9/205: dwrite db/d18/f2c [0,4194304] 0 2024-03-18T14:43:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:0/110: creat d0/d1b/f22 x:0 0 0 2024-03-18T14:43:10.927 INFO:tasks.workunit.client.0.smithi087.stdout:1/191: fdatasync d3/f7 0 2024-03-18T14:43:10.933 INFO:tasks.workunit.client.0.smithi087.stdout:6/109: write d3/d7/d8/f16 [3582817,28156] 0 2024-03-18T14:43:10.935 INFO:tasks.workunit.client.0.smithi087.stdout:4/100: rename d2/d13/c1b to d2/d13/c22 0 2024-03-18T14:43:10.936 INFO:tasks.workunit.client.0.smithi087.stdout:4/101: readlink d2/l7 0 2024-03-18T14:43:10.936 INFO:tasks.workunit.client.0.smithi087.stdout:7/204: read d1/f36 [127763,30519] 0 2024-03-18T14:43:10.937 INFO:tasks.workunit.client.0.smithi087.stdout:0/111: chown d0/d1a/f20 0 1 2024-03-18T14:43:10.938 INFO:tasks.workunit.client.0.smithi087.stdout:1/192: symlink d3/d1d/d1f/l3b 0 2024-03-18T14:43:10.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/102: unlink d2/d13/c18 0 2024-03-18T14:43:10.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/103: read - d2/f1f zero size 2024-03-18T14:43:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:1/193: mkdir d3/d3c 0 2024-03-18T14:43:10.945 INFO:tasks.workunit.client.0.smithi087.stdout:5/189: truncate d13/f1a 3458528 0 2024-03-18T14:43:10.946 INFO:tasks.workunit.client.0.smithi087.stdout:9/206: creat db/f3d x:0 0 0 2024-03-18T14:43:10.946 INFO:tasks.workunit.client.0.smithi087.stdout:6/110: creat d3/d7/d8/d22/d23/f26 x:0 0 0 2024-03-18T14:43:10.947 INFO:tasks.workunit.client.0.smithi087.stdout:7/205: mknod d1/d6/da/d42/c45 0 2024-03-18T14:43:10.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/206: read d1/d6/f1d [341346,65004] 0 2024-03-18T14:43:10.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/93: fdatasync d2/d4/fd 0 2024-03-18T14:43:10.953 INFO:tasks.workunit.client.0.smithi087.stdout:6/111: rename d3/d7/f11 to d3/d7/d8/f27 0 2024-03-18T14:43:10.953 INFO:tasks.workunit.client.0.smithi087.stdout:2/94: stat f1 0 2024-03-18T14:43:10.953 INFO:tasks.workunit.client.0.smithi087.stdout:6/112: readlink d3/d7/l1c 0 2024-03-18T14:43:10.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/112: truncate d0/dd/f15 790276 0 2024-03-18T14:43:10.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/207: symlink d1/d6/d29/d2f/l46 0 2024-03-18T14:43:10.958 INFO:tasks.workunit.client.0.smithi087.stdout:9/207: read db/d31/f34 [766049,24080] 0 2024-03-18T14:43:10.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/208: readlink db/d18/l32 0 2024-03-18T14:43:10.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/194: creat d3/d1d/f3d x:0 0 0 2024-03-18T14:43:10.968 INFO:tasks.workunit.client.0.smithi087.stdout:3/198: getdents d0/d3/df 0 2024-03-18T14:43:10.977 INFO:tasks.workunit.client.0.smithi087.stdout:2/95: rename d2/d4/lc to d2/l14 0 2024-03-18T14:43:10.984 INFO:tasks.workunit.client.0.smithi087.stdout:5/190: read d13/f1a [108438,126605] 0 2024-03-18T14:43:10.986 INFO:tasks.workunit.client.0.smithi087.stdout:4/104: getdents d2/d13 0 2024-03-18T14:43:10.988 INFO:tasks.workunit.client.0.smithi087.stdout:0/113: fdatasync d0/f16 0 2024-03-18T14:43:10.990 INFO:tasks.workunit.client.0.smithi087.stdout:9/209: write db/d31/f36 [543961,1337] 0 2024-03-18T14:43:10.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/195: fsync d3/f12 0 2024-03-18T14:43:10.993 INFO:tasks.workunit.client.0.smithi087.stdout:6/113: creat d3/d7/d25/f28 x:0 0 0 2024-03-18T14:43:10.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/137: write d1/f1b [1514932,60401] 0 2024-03-18T14:43:10.994 INFO:tasks.workunit.client.0.smithi087.stdout:3/199: write d0/d3/fd [146034,96453] 0 2024-03-18T14:43:10.995 INFO:tasks.workunit.client.0.smithi087.stdout:6/114: read d3/d7/d8/f27 [340223,45384] 0 2024-03-18T14:43:10.996 INFO:tasks.workunit.client.0.smithi087.stdout:5/191: rename d13/l14 to d13/d1b/l3c 0 2024-03-18T14:43:11.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/96: dwrite f1 [4194304,4194304] 0 2024-03-18T14:43:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/192: dread - d13/d1b/d27/f2a zero size 2024-03-18T14:43:11.027 INFO:tasks.workunit.client.0.smithi087.stdout:1/196: unlink d3/f8 0 2024-03-18T14:43:11.031 INFO:tasks.workunit.client.0.smithi087.stdout:2/97: write d2/fb [4799039,56623] 0 2024-03-18T14:43:11.031 INFO:tasks.workunit.client.0.smithi087.stdout:4/105: link d2/c3 d2/db/c23 0 2024-03-18T14:43:11.033 INFO:tasks.workunit.client.0.smithi087.stdout:7/208: getdents d1 0 2024-03-18T14:43:11.033 INFO:tasks.workunit.client.0.smithi087.stdout:6/115: dread d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:11.034 INFO:tasks.workunit.client.0.smithi087.stdout:2/98: fdatasync d2/d4/fd 0 2024-03-18T14:43:11.036 INFO:tasks.workunit.client.0.smithi087.stdout:7/209: chown d1/c30 8543 1 2024-03-18T14:43:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:4/106: write d2/db/de/f17 [812313,32376] 0 2024-03-18T14:43:11.037 INFO:tasks.workunit.client.0.smithi087.stdout:2/99: read d2/f10 [1687614,33754] 0 2024-03-18T14:43:11.038 INFO:tasks.workunit.client.0.smithi087.stdout:0/114: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:11.038 INFO:tasks.workunit.client.0.smithi087.stdout:1/197: rename d3/f30 to d3/d1d/d1f/d34/f3e 0 2024-03-18T14:43:11.041 INFO:tasks.workunit.client.0.smithi087.stdout:3/200: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:11.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/138: dwrite d1/f2c [0,4194304] 0 2024-03-18T14:43:11.042 INFO:tasks.workunit.client.0.smithi087.stdout:8/139: dread - d1/d6/f20 zero size 2024-03-18T14:43:11.042 INFO:tasks.workunit.client.0.smithi087.stdout:4/107: mkdir d2/db/d24 0 2024-03-18T14:43:11.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/108: chown d2/f16 0 1 2024-03-18T14:43:11.046 INFO:tasks.workunit.client.0.smithi087.stdout:6/116: rename d3/d7/d8 to d3/d1a/d29 0 2024-03-18T14:43:11.050 INFO:tasks.workunit.client.0.smithi087.stdout:0/115: write d0/d1a/f20 [45227,38939] 0 2024-03-18T14:43:11.051 INFO:tasks.workunit.client.0.smithi087.stdout:1/198: dread d3/f17 [0,4194304] 0 2024-03-18T14:43:11.052 INFO:tasks.workunit.client.0.smithi087.stdout:3/201: unlink d0/d3/d10/f21 0 2024-03-18T14:43:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/109: fdatasync d2/db/f1c 0 2024-03-18T14:43:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/110: write d2/db/f20 [750861,111585] 0 2024-03-18T14:43:11.054 INFO:tasks.workunit.client.0.smithi087.stdout:6/117: fdatasync d3/f4 0 2024-03-18T14:43:11.059 INFO:tasks.workunit.client.0.smithi087.stdout:5/193: dread d13/f17 [0,4194304] 0 2024-03-18T14:43:11.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/199: creat d3/d1d/d1f/f3f x:0 0 0 2024-03-18T14:43:11.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/116: write d0/f3 [3089045,35610] 0 2024-03-18T14:43:11.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/117: readlink d0/d2/d4/lb 0 2024-03-18T14:43:11.064 INFO:tasks.workunit.client.0.smithi087.stdout:0/118: write d0/f3 [4090913,103299] 0 2024-03-18T14:43:11.066 INFO:tasks.workunit.client.0.smithi087.stdout:6/118: creat d3/d7/d25/f2a x:0 0 0 2024-03-18T14:43:11.067 INFO:tasks.workunit.client.0.smithi087.stdout:2/100: link d2/f10 d2/d4/f15 0 2024-03-18T14:43:11.067 INFO:tasks.workunit.client.0.smithi087.stdout:4/111: write d2/f10 [2160478,34490] 0 2024-03-18T14:43:11.067 INFO:tasks.workunit.client.0.smithi087.stdout:7/210: truncate d1/d6/f2a 708577 0 2024-03-18T14:43:11.068 INFO:tasks.workunit.client.0.smithi087.stdout:8/140: creat d1/d6/f2d x:0 0 0 2024-03-18T14:43:11.069 INFO:tasks.workunit.client.0.smithi087.stdout:0/119: dread d0/d2/d4/f12 [0,4194304] 0 2024-03-18T14:43:11.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/200: truncate d3/f16 8153099 0 2024-03-18T14:43:11.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/119: write d3/d7/d25/f2a [3292,3838] 0 2024-03-18T14:43:11.070 INFO:tasks.workunit.client.0.smithi087.stdout:8/141: write d1/f1a [4742947,116495] 0 2024-03-18T14:43:11.071 INFO:tasks.workunit.client.0.smithi087.stdout:6/120: write d3/d7/d25/f2a [794531,90284] 0 2024-03-18T14:43:11.071 INFO:tasks.workunit.client.0.smithi087.stdout:6/121: chown d3 2411741 1 2024-03-18T14:43:11.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/210: sync 2024-03-18T14:43:11.074 INFO:tasks.workunit.client.0.smithi087.stdout:2/101: creat d2/d4/f16 x:0 0 0 2024-03-18T14:43:11.077 INFO:tasks.workunit.client.0.smithi087.stdout:2/102: dread f1 [4194304,4194304] 0 2024-03-18T14:43:11.077 INFO:tasks.workunit.client.0.smithi087.stdout:3/202: truncate d0/d3/d10/f2c 2044997 0 2024-03-18T14:43:11.080 INFO:tasks.workunit.client.0.smithi087.stdout:5/194: truncate f12 42506 0 2024-03-18T14:43:11.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/203: dread d0/d3/fd [0,4194304] 0 2024-03-18T14:43:11.083 INFO:tasks.workunit.client.0.smithi087.stdout:3/204: write d0/de/f12 [1129188,9872] 0 2024-03-18T14:43:11.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/201: dread - d3/d1d/d1e/f36 zero size 2024-03-18T14:43:11.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/202: fsync d3/f10 0 2024-03-18T14:43:11.085 INFO:tasks.workunit.client.0.smithi087.stdout:1/203: dread - d3/d1d/d1f/f3f zero size 2024-03-18T14:43:11.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/122: rename d3/d7/c20 to d3/d7/c2b 0 2024-03-18T14:43:11.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/211: dread db/f22 [0,4194304] 0 2024-03-18T14:43:11.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/103: mknod d2/d4/c17 0 2024-03-18T14:43:11.090 INFO:tasks.workunit.client.0.smithi087.stdout:9/212: write db/f3d [956732,123778] 0 2024-03-18T14:43:11.091 INFO:tasks.workunit.client.0.smithi087.stdout:0/120: creat d0/d2/d4/d19/f23 x:0 0 0 2024-03-18T14:43:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/213: chown db/d31/f34 2 1 2024-03-18T14:43:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:8/142: dread d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:11.092 INFO:tasks.workunit.client.0.smithi087.stdout:3/205: symlink d0/d1c/l3b 0 2024-03-18T14:43:11.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/123: dwrite d3/d1a/d29/d22/d23/f26 [0,4194304] 0 2024-03-18T14:43:11.094 INFO:tasks.workunit.client.0.smithi087.stdout:3/206: dread - d0/d3/d10/f1a zero size 2024-03-18T14:43:11.095 INFO:tasks.workunit.client.0.smithi087.stdout:6/124: write d3/f19 [163233,75224] 0 2024-03-18T14:43:11.101 INFO:tasks.workunit.client.0.smithi087.stdout:2/104: stat d2/c12 0 2024-03-18T14:43:11.103 INFO:tasks.workunit.client.0.smithi087.stdout:4/112: getdents d2 0 2024-03-18T14:43:11.104 INFO:tasks.workunit.client.0.smithi087.stdout:0/121: mkdir d0/d2/d4/d19/d24 0 2024-03-18T14:43:11.105 INFO:tasks.workunit.client.0.smithi087.stdout:1/204: creat d3/d1d/d1e/d20/f40 x:0 0 0 2024-03-18T14:43:11.105 INFO:tasks.workunit.client.0.smithi087.stdout:8/143: creat d1/d6/d14/f2e x:0 0 0 2024-03-18T14:43:11.107 INFO:tasks.workunit.client.0.smithi087.stdout:6/125: creat d3/d1a/d29/d22/f2c x:0 0 0 2024-03-18T14:43:11.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/211: getdents d1/d6/d16 0 2024-03-18T14:43:11.110 INFO:tasks.workunit.client.0.smithi087.stdout:9/214: mknod db/c3e 0 2024-03-18T14:43:11.110 INFO:tasks.workunit.client.0.smithi087.stdout:4/113: symlink d2/db/l25 0 2024-03-18T14:43:11.111 INFO:tasks.workunit.client.0.smithi087.stdout:8/144: dwrite d1/d6/d14/f2e [0,4194304] 0 2024-03-18T14:43:11.112 INFO:tasks.workunit.client.0.smithi087.stdout:4/114: write d2/f9 [65897,39692] 0 2024-03-18T14:43:11.113 INFO:tasks.workunit.client.0.smithi087.stdout:4/115: chown d2/db/de/c11 2 1 2024-03-18T14:43:11.114 INFO:tasks.workunit.client.0.smithi087.stdout:5/195: getdents d13/d1b/d27/d35 0 2024-03-18T14:43:11.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/126: mknod d3/d7/d25/c2d 0 2024-03-18T14:43:11.118 INFO:tasks.workunit.client.0.smithi087.stdout:2/105: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:11.118 INFO:tasks.workunit.client.0.smithi087.stdout:7/212: dread d1/d6/f2a [0,4194304] 0 2024-03-18T14:43:11.118 INFO:tasks.workunit.client.0.smithi087.stdout:2/106: stat d2/ce 0 2024-03-18T14:43:11.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/145: rmdir d1/d6/d14 39 2024-03-18T14:43:11.122 INFO:tasks.workunit.client.0.smithi087.stdout:3/207: truncate d0/f34 777146 0 2024-03-18T14:43:11.123 INFO:tasks.workunit.client.0.smithi087.stdout:4/116: dread d2/f10 [0,4194304] 0 2024-03-18T14:43:11.128 INFO:tasks.workunit.client.0.smithi087.stdout:2/107: mknod d2/c18 0 2024-03-18T14:43:11.129 INFO:tasks.workunit.client.0.smithi087.stdout:0/122: truncate d0/d2/f18 1040546 0 2024-03-18T14:43:11.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/205: truncate d3/d1d/d1e/d20/f40 245359 0 2024-03-18T14:43:11.133 INFO:tasks.workunit.client.0.smithi087.stdout:6/127: link d3/d1a/d29/f16 d3/d7/f2e 0 2024-03-18T14:43:11.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/123: dwrite d0/d2/d4/d19/f23 [0,4194304] 0 2024-03-18T14:43:11.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/215: dwrite db/d18/f2a [0,4194304] 0 2024-03-18T14:43:11.136 INFO:tasks.workunit.client.0.smithi087.stdout:0/124: write d0/f3 [3048058,78294] 0 2024-03-18T14:43:11.139 INFO:tasks.workunit.client.0.smithi087.stdout:7/213: rename d1/l4 to d1/l47 0 2024-03-18T14:43:11.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/108: creat d2/d4/f19 x:0 0 0 2024-03-18T14:43:11.141 INFO:tasks.workunit.client.0.smithi087.stdout:2/109: readlink d2/l7 0 2024-03-18T14:43:11.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/146: mkdir d1/d6/d2f 0 2024-03-18T14:43:11.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/208: link d0/f19 d0/d1c/d25/f3c 0 2024-03-18T14:43:11.142 INFO:tasks.workunit.client.0.smithi087.stdout:4/117: creat d2/db/d24/f26 x:0 0 0 2024-03-18T14:43:11.142 INFO:tasks.workunit.client.0.smithi087.stdout:5/196: rename d13/d1b/c29 to d13/c3d 0 2024-03-18T14:43:11.144 INFO:tasks.workunit.client.0.smithi087.stdout:8/147: write d1/d6/f2b [705111,22800] 0 2024-03-18T14:43:11.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/128: dread d3/d7/f14 [0,4194304] 0 2024-03-18T14:43:11.145 INFO:tasks.workunit.client.0.smithi087.stdout:9/216: dwrite db/d18/d1c/f27 [0,4194304] 0 2024-03-18T14:43:11.163 INFO:tasks.workunit.client.0.smithi087.stdout:7/214: mkdir d1/d6/d29/d2f/d48 0 2024-03-18T14:43:11.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/197: link d13/d1b/f3a d13/d1b/d27/f3e 0 2024-03-18T14:43:11.165 INFO:tasks.workunit.client.0.smithi087.stdout:8/148: creat d1/d6/d2f/f30 x:0 0 0 2024-03-18T14:43:11.165 INFO:tasks.workunit.client.0.smithi087.stdout:5/198: chown d13/d1b/d27/d28/c38 35554 1 2024-03-18T14:43:11.167 INFO:tasks.workunit.client.0.smithi087.stdout:1/206: rename d3/l6 to d3/d3c/l41 0 2024-03-18T14:43:11.168 INFO:tasks.workunit.client.0.smithi087.stdout:9/217: symlink db/d18/d1e/d28/l3f 0 2024-03-18T14:43:11.169 INFO:tasks.workunit.client.0.smithi087.stdout:7/215: creat d1/d6/d29/f49 x:0 0 0 2024-03-18T14:43:11.171 INFO:tasks.workunit.client.0.smithi087.stdout:8/149: dwrite d1/fd [0,4194304] 0 2024-03-18T14:43:11.173 INFO:tasks.workunit.client.0.smithi087.stdout:3/209: write d0/d3/d10/f2c [877392,47378] 0 2024-03-18T14:43:11.174 INFO:tasks.workunit.client.0.smithi087.stdout:9/218: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:11.175 INFO:tasks.workunit.client.0.smithi087.stdout:9/219: chown db/d12/l14 3 1 2024-03-18T14:43:11.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/125: rename d0/d2/d4/f1d to d0/d2/d4/d19/f25 0 2024-03-18T14:43:11.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/199: write d13/d1b/d27/f3e [455199,44303] 0 2024-03-18T14:43:11.179 INFO:tasks.workunit.client.0.smithi087.stdout:6/129: getdents d3/d1a/d29/d22/d23 0 2024-03-18T14:43:11.181 INFO:tasks.workunit.client.0.smithi087.stdout:9/220: dwrite db/d18/d1e/f38 [0,4194304] 0 2024-03-18T14:43:11.181 INFO:tasks.workunit.client.0.smithi087.stdout:7/216: creat d1/d6/da/d42/f4a x:0 0 0 2024-03-18T14:43:11.183 INFO:tasks.workunit.client.0.smithi087.stdout:3/210: unlink d0/d3/d10/f1a 0 2024-03-18T14:43:11.184 INFO:tasks.workunit.client.0.smithi087.stdout:0/126: dwrite d0/d2/f17 [0,4194304] 0 2024-03-18T14:43:11.186 INFO:tasks.workunit.client.0.smithi087.stdout:2/110: rename f1 to d2/d4/f1a 0 2024-03-18T14:43:11.187 INFO:tasks.workunit.client.0.smithi087.stdout:1/207: mknod d3/d1d/d1f/d34/d38/c42 0 2024-03-18T14:43:11.188 INFO:tasks.workunit.client.0.smithi087.stdout:2/111: dread - d2/d4/f16 zero size 2024-03-18T14:43:11.188 INFO:tasks.workunit.client.0.smithi087.stdout:8/150: dwrite d1/d6/d9/fe [4194304,4194304] 0 2024-03-18T14:43:11.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/221: dread db/f22 [0,4194304] 0 2024-03-18T14:43:11.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/200: rmdir d13/d1b/d30 39 2024-03-18T14:43:11.189 INFO:tasks.workunit.client.0.smithi087.stdout:8/151: dread - d1/d6/f1e zero size 2024-03-18T14:43:11.191 INFO:tasks.workunit.client.0.smithi087.stdout:6/130: mknod d3/d7/d25/c2f 0 2024-03-18T14:43:11.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/217: symlink d1/d6/da/l4b 0 2024-03-18T14:43:11.192 INFO:tasks.workunit.client.0.smithi087.stdout:7/218: rename d1/d6 to d1/d6/d16/d4c 22 2024-03-18T14:43:11.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/219: dread - d1/d6/da/f25 zero size 2024-03-18T14:43:11.193 INFO:tasks.workunit.client.0.smithi087.stdout:9/222: read db/ff [1899066,69156] 0 2024-03-18T14:43:11.194 INFO:tasks.workunit.client.0.smithi087.stdout:9/223: chown db/f2f 49607 1 2024-03-18T14:43:11.194 INFO:tasks.workunit.client.0.smithi087.stdout:2/112: mknod d2/d4/c1b 0 2024-03-18T14:43:11.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/220: write d1/d6/d16/dc/f32 [865844,122142] 0 2024-03-18T14:43:11.197 INFO:tasks.workunit.client.0.smithi087.stdout:2/113: fdatasync d2/d4/f16 0 2024-03-18T14:43:11.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/152: dread - d1/d6/d14/f27 zero size 2024-03-18T14:43:11.198 INFO:tasks.workunit.client.0.smithi087.stdout:1/208: mkdir d3/d1d/d1e/d43 0 2024-03-18T14:43:11.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/201: creat d13/f3f x:0 0 0 2024-03-18T14:43:11.200 INFO:tasks.workunit.client.0.smithi087.stdout:3/211: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:11.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/114: creat d2/f1c x:0 0 0 2024-03-18T14:43:11.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/202: write f11 [5083184,67027] 0 2024-03-18T14:43:11.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/212: readlink d0/d1c/d25/l26 0 2024-03-18T14:43:11.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/115: fsync d2/d4/f19 0 2024-03-18T14:43:11.204 INFO:tasks.workunit.client.0.smithi087.stdout:7/221: creat d1/d6/d29/f4d x:0 0 0 2024-03-18T14:43:11.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/127: dwrite d0/f10 [0,4194304] 0 2024-03-18T14:43:11.205 INFO:tasks.workunit.client.0.smithi087.stdout:8/153: creat d1/d6/d2f/f31 x:0 0 0 2024-03-18T14:43:11.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/203: fsync d13/d1b/f2b 0 2024-03-18T14:43:11.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/222: stat d1/f31 0 2024-03-18T14:43:11.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/213: chown d0/d3/fd 158739148 1 2024-03-18T14:43:11.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/224: getdents db/d18/d1e 0 2024-03-18T14:43:11.207 INFO:tasks.workunit.client.0.smithi087.stdout:6/131: dwrite d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:11.207 INFO:tasks.workunit.client.0.smithi087.stdout:0/128: stat d0/d2/d4/d19/f23 0 2024-03-18T14:43:11.208 INFO:tasks.workunit.client.0.smithi087.stdout:2/116: creat d2/f1d x:0 0 0 2024-03-18T14:43:11.208 INFO:tasks.workunit.client.0.smithi087.stdout:7/223: stat d1/d6/da/l4b 0 2024-03-18T14:43:11.209 INFO:tasks.workunit.client.0.smithi087.stdout:3/214: dread - d0/f28 zero size 2024-03-18T14:43:11.210 INFO:tasks.workunit.client.0.smithi087.stdout:2/117: fsync d2/d4/fd 0 2024-03-18T14:43:11.212 INFO:tasks.workunit.client.0.smithi087.stdout:7/224: write d1/d6/d16/f1a [910442,93331] 0 2024-03-18T14:43:11.212 INFO:tasks.workunit.client.0.smithi087.stdout:2/118: chown d2/f1d 332870 1 2024-03-18T14:43:11.212 INFO:tasks.workunit.client.0.smithi087.stdout:0/129: mkdir d0/d1b/d26 0 2024-03-18T14:43:11.213 INFO:tasks.workunit.client.0.smithi087.stdout:9/225: creat db/d18/d1c/f40 x:0 0 0 2024-03-18T14:43:11.213 INFO:tasks.workunit.client.0.smithi087.stdout:7/225: dread - d1/d6/f44 zero size 2024-03-18T14:43:11.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/226: readlink d1/d6/l15 0 2024-03-18T14:43:11.215 INFO:tasks.workunit.client.0.smithi087.stdout:8/154: dwrite d1/f1a [0,4194304] 0 2024-03-18T14:43:11.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/155: dread - d1/d6/f2d zero size 2024-03-18T14:43:11.218 INFO:tasks.workunit.client.0.smithi087.stdout:2/119: dread d2/d4/f15 [0,4194304] 0 2024-03-18T14:43:11.219 INFO:tasks.workunit.client.0.smithi087.stdout:0/130: mkdir d0/d2/d4/d27 0 2024-03-18T14:43:11.220 INFO:tasks.workunit.client.0.smithi087.stdout:9/226: read db/f11 [630761,111590] 0 2024-03-18T14:43:11.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/227: dwrite d1/d6/da/f37 [0,4194304] 0 2024-03-18T14:43:11.222 INFO:tasks.workunit.client.0.smithi087.stdout:7/228: write d1/d6/f14 [580457,61892] 0 2024-03-18T14:43:11.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/156: creat d1/f32 x:0 0 0 2024-03-18T14:43:11.232 INFO:tasks.workunit.client.0.smithi087.stdout:2/120: creat d2/f1e x:0 0 0 2024-03-18T14:43:11.234 INFO:tasks.workunit.client.0.smithi087.stdout:0/131: mknod d0/dd/c28 0 2024-03-18T14:43:11.235 INFO:tasks.workunit.client.0.smithi087.stdout:0/132: chown d0/d2/f13 1321683 1 2024-03-18T14:43:11.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/229: unlink d1/d6/d16/f1a 0 2024-03-18T14:43:11.237 INFO:tasks.workunit.client.0.smithi087.stdout:2/121: mknod d2/d4/c1f 0 2024-03-18T14:43:11.238 INFO:tasks.workunit.client.0.smithi087.stdout:8/157: unlink d1/d6/d14/c22 0 2024-03-18T14:43:11.241 INFO:tasks.workunit.client.0.smithi087.stdout:8/158: dread d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:11.242 INFO:tasks.workunit.client.0.smithi087.stdout:2/122: mknod d2/c20 0 2024-03-18T14:43:11.243 INFO:tasks.workunit.client.0.smithi087.stdout:2/123: mknod d2/d4/c21 0 2024-03-18T14:43:11.244 INFO:tasks.workunit.client.0.smithi087.stdout:2/124: write d2/d4/f19 [260264,68753] 0 2024-03-18T14:43:11.244 INFO:tasks.workunit.client.0.smithi087.stdout:8/159: dread d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:11.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/125: write d2/fb [3751495,114116] 0 2024-03-18T14:43:11.248 INFO:tasks.workunit.client.0.smithi087.stdout:4/118: sync 2024-03-18T14:43:11.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/133: rename d0/d1b to d0/d2/d4/d27/d29 0 2024-03-18T14:43:11.250 INFO:tasks.workunit.client.0.smithi087.stdout:3/215: write d0/d1c/f1e [1274695,63331] 0 2024-03-18T14:43:11.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/160: unlink d1/d6/f2b 0 2024-03-18T14:43:11.252 INFO:tasks.workunit.client.0.smithi087.stdout:3/216: write d0/de/f12 [4465155,69425] 0 2024-03-18T14:43:11.253 INFO:tasks.workunit.client.0.smithi087.stdout:2/126: mkdir d2/d4/d22 0 2024-03-18T14:43:11.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/132: dwrite d3/d7/f2e [0,4194304] 0 2024-03-18T14:43:11.255 INFO:tasks.workunit.client.0.smithi087.stdout:5/204: truncate d13/d1b/f3a 1279796 0 2024-03-18T14:43:11.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/205: write d13/f26 [3775065,102307] 0 2024-03-18T14:43:11.271 INFO:tasks.workunit.client.0.smithi087.stdout:9/227: write db/fd [2518116,50381] 0 2024-03-18T14:43:11.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/127: dwrite d2/d4/fd [0,4194304] 0 2024-03-18T14:43:11.271 INFO:tasks.workunit.client.0.smithi087.stdout:7/230: rename d1/f10 to d1/d6/d16/f4e 0 2024-03-18T14:43:11.273 INFO:tasks.workunit.client.0.smithi087.stdout:4/119: rename d2/db/f1c to d2/db/f27 0 2024-03-18T14:43:11.273 INFO:tasks.workunit.client.0.smithi087.stdout:3/217: mknod d0/d3/d10/c3d 0 2024-03-18T14:43:11.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/133: unlink d3/c17 0 2024-03-18T14:43:11.275 INFO:tasks.workunit.client.0.smithi087.stdout:3/218: dread - d0/d3/df/f33 zero size 2024-03-18T14:43:11.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/219: write d0/d1c/f2b [500423,114811] 0 2024-03-18T14:43:11.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/134: dwrite d0/d2/d4/f12 [0,4194304] 0 2024-03-18T14:43:11.280 INFO:tasks.workunit.client.0.smithi087.stdout:9/228: mknod db/d18/d1e/d28/c41 0 2024-03-18T14:43:11.282 INFO:tasks.workunit.client.0.smithi087.stdout:4/120: dwrite d2/f1f [0,4194304] 0 2024-03-18T14:43:11.282 INFO:tasks.workunit.client.0.smithi087.stdout:6/134: creat d3/d1a/d29/d22/d23/f30 x:0 0 0 2024-03-18T14:43:11.283 INFO:tasks.workunit.client.0.smithi087.stdout:3/220: read d0/d3/df/f16 [2379216,99321] 0 2024-03-18T14:43:11.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/231: write d1/d6/d16/dc/f32 [1182135,71470] 0 2024-03-18T14:43:11.286 INFO:tasks.workunit.client.0.smithi087.stdout:5/206: rename d13/d1b/d27/f3e to d13/d1b/d30/f40 0 2024-03-18T14:43:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:5/207: chown d13/d1b/d30 102893 1 2024-03-18T14:43:11.288 INFO:tasks.workunit.client.0.smithi087.stdout:7/232: write d1/d6/da/d42/f4a [11616,72462] 0 2024-03-18T14:43:11.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/221: dwrite d0/d3/df/f14 [4194304,4194304] 0 2024-03-18T14:43:11.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/135: dwrite d3/d7/f24 [0,4194304] 0 2024-03-18T14:43:11.295 INFO:tasks.workunit.client.0.smithi087.stdout:5/208: mknod d13/d1b/d27/d28/c41 0 2024-03-18T14:43:11.299 INFO:tasks.workunit.client.0.smithi087.stdout:6/136: write f1 [4110681,111513] 0 2024-03-18T14:43:11.299 INFO:tasks.workunit.client.0.smithi087.stdout:1/209: sync 2024-03-18T14:43:11.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/128: dwrite d2/d4/f1a [4194304,4194304] 0 2024-03-18T14:43:11.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/229: dwrite db/d31/f34 [0,4194304] 0 2024-03-18T14:43:11.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/209: mknod d13/d1b/d27/d35/d3b/c42 0 2024-03-18T14:43:11.305 INFO:tasks.workunit.client.0.smithi087.stdout:7/233: dwrite d1/d6/da/f25 [0,4194304] 0 2024-03-18T14:43:11.307 INFO:tasks.workunit.client.0.smithi087.stdout:0/135: dwrite d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:11.308 INFO:tasks.workunit.client.0.smithi087.stdout:4/121: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:11.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/210: rename d3/f12 to d3/f44 0 2024-03-18T14:43:11.311 INFO:tasks.workunit.client.0.smithi087.stdout:1/211: dread - d3/d1d/d1e/d20/f39 zero size 2024-03-18T14:43:11.311 INFO:tasks.workunit.client.0.smithi087.stdout:2/129: dwrite d2/f1e [0,4194304] 0 2024-03-18T14:43:11.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/137: rmdir d3/d1a/d29/d22 39 2024-03-18T14:43:11.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/212: chown d3/d1d/d1e/d20 380498 1 2024-03-18T14:43:11.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/213: chown d3/d1d/d1f/d34/l3a 24373373 1 2024-03-18T14:43:11.318 INFO:tasks.workunit.client.0.smithi087.stdout:9/230: creat db/d31/f42 x:0 0 0 2024-03-18T14:43:11.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/210: creat d13/d1b/d27/d35/f43 x:0 0 0 2024-03-18T14:43:11.320 INFO:tasks.workunit.client.0.smithi087.stdout:9/231: write db/f1a [1509198,86969] 0 2024-03-18T14:43:11.321 INFO:tasks.workunit.client.0.smithi087.stdout:5/211: write d13/d1b/d27/f2a [886166,94375] 0 2024-03-18T14:43:11.322 INFO:tasks.workunit.client.0.smithi087.stdout:4/122: mkdir d2/d13/d28 0 2024-03-18T14:43:11.322 INFO:tasks.workunit.client.0.smithi087.stdout:0/136: mkdir d0/d2/d4/d27/d29/d2a 0 2024-03-18T14:43:11.324 INFO:tasks.workunit.client.0.smithi087.stdout:6/138: write d3/d1a/d29/f27 [666881,97401] 0 2024-03-18T14:43:11.324 INFO:tasks.workunit.client.0.smithi087.stdout:7/234: dwrite d1/f36 [0,4194304] 0 2024-03-18T14:43:11.325 INFO:tasks.workunit.client.0.smithi087.stdout:7/235: dread - d1/d6/f44 zero size 2024-03-18T14:43:11.329 INFO:tasks.workunit.client.0.smithi087.stdout:2/130: mknod d2/d4/d22/c23 0 2024-03-18T14:43:11.332 INFO:tasks.workunit.client.0.smithi087.stdout:4/123: rename d2/c8 to d2/d13/c29 0 2024-03-18T14:43:11.337 INFO:tasks.workunit.client.0.smithi087.stdout:1/214: mkdir d3/d1d/d45 0 2024-03-18T14:43:11.337 INFO:tasks.workunit.client.0.smithi087.stdout:2/131: mkdir d2/d4/d22/d24 0 2024-03-18T14:43:11.337 INFO:tasks.workunit.client.0.smithi087.stdout:6/139: chown d3/d1a/d29/c1b 324 1 2024-03-18T14:43:11.338 INFO:tasks.workunit.client.0.smithi087.stdout:2/132: dread - d2/f1d zero size 2024-03-18T14:43:11.341 INFO:tasks.workunit.client.0.smithi087.stdout:2/133: mknod d2/d4/c25 0 2024-03-18T14:43:11.341 INFO:tasks.workunit.client.0.smithi087.stdout:2/134: chown d2 12924 1 2024-03-18T14:43:11.341 INFO:tasks.workunit.client.0.smithi087.stdout:7/236: truncate d1/d6/d29/f34 579392 0 2024-03-18T14:43:11.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/215: unlink d3/d3c/l41 0 2024-03-18T14:43:11.344 INFO:tasks.workunit.client.0.smithi087.stdout:6/140: mknod d3/d1a/d29/c31 0 2024-03-18T14:43:11.345 INFO:tasks.workunit.client.0.smithi087.stdout:2/135: mknod d2/c26 0 2024-03-18T14:43:11.345 INFO:tasks.workunit.client.0.smithi087.stdout:7/237: fdatasync d1/f3 0 2024-03-18T14:43:11.346 INFO:tasks.workunit.client.0.smithi087.stdout:2/136: write d2/fb [3678977,10501] 0 2024-03-18T14:43:11.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/141: unlink d3/d1a/d29/c1b 0 2024-03-18T14:43:11.348 INFO:tasks.workunit.client.0.smithi087.stdout:6/142: write d3/d7/f2e [1523698,65266] 0 2024-03-18T14:43:11.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/143: fsync d3/d1a/d29/f1d 0 2024-03-18T14:43:11.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/144: stat f1 0 2024-03-18T14:43:11.349 INFO:tasks.workunit.client.0.smithi087.stdout:1/216: rename d3/d1d/d1e/d20/f23 to d3/d1d/d1e/d43/f46 0 2024-03-18T14:43:11.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/238: mknod d1/d6/d29/c4f 0 2024-03-18T14:43:11.351 INFO:tasks.workunit.client.0.smithi087.stdout:2/137: creat d2/d4/f27 x:0 0 0 2024-03-18T14:43:11.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/217: mknod d3/d1d/d45/c47 0 2024-03-18T14:43:11.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/138: link d2/d4/f16 d2/d4/f28 0 2024-03-18T14:43:11.356 INFO:tasks.workunit.client.0.smithi087.stdout:6/145: dwrite d3/d7/f14 [4194304,4194304] 0 2024-03-18T14:43:11.357 INFO:tasks.workunit.client.0.smithi087.stdout:7/239: link d1/d6/d16/dc/f26 d1/d6/da/f50 0 2024-03-18T14:43:11.357 INFO:tasks.workunit.client.0.smithi087.stdout:8/161: sync 2024-03-18T14:43:11.361 INFO:tasks.workunit.client.0.smithi087.stdout:7/240: rmdir d1/d6/da/d42 39 2024-03-18T14:43:11.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/232: write db/d18/d1c/f27 [5149856,35674] 0 2024-03-18T14:43:11.368 INFO:tasks.workunit.client.0.smithi087.stdout:5/212: write d13/d1b/d30/f40 [1432903,37798] 0 2024-03-18T14:43:11.369 INFO:tasks.workunit.client.0.smithi087.stdout:0/137: write d0/d2/f18 [1833571,101937] 0 2024-03-18T14:43:11.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/241: readlink d1/d6/d16/dc/l2c 0 2024-03-18T14:43:11.387 INFO:tasks.workunit.client.0.smithi087.stdout:0/138: write d0/d2/f18 [1407880,20149] 0 2024-03-18T14:43:11.388 INFO:tasks.workunit.client.0.smithi087.stdout:9/233: rmdir db/d18/d1c 39 2024-03-18T14:43:11.388 INFO:tasks.workunit.client.0.smithi087.stdout:2/139: truncate d2/d4/f15 3763472 0 2024-03-18T14:43:11.389 INFO:tasks.workunit.client.0.smithi087.stdout:7/242: unlink d1/d6/d16/dc/l11 0 2024-03-18T14:43:11.391 INFO:tasks.workunit.client.0.smithi087.stdout:1/218: dwrite d3/d1d/d1f/f24 [0,4194304] 0 2024-03-18T14:43:11.391 INFO:tasks.workunit.client.0.smithi087.stdout:0/139: creat d0/dd/f2b x:0 0 0 2024-03-18T14:43:11.396 INFO:tasks.workunit.client.0.smithi087.stdout:9/234: creat db/d12/f43 x:0 0 0 2024-03-18T14:43:11.398 INFO:tasks.workunit.client.0.smithi087.stdout:8/162: getdents d1/d6 0 2024-03-18T14:43:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:5/213: truncate d13/d1b/f3a 1207108 0 2024-03-18T14:43:11.399 INFO:tasks.workunit.client.0.smithi087.stdout:5/214: write fb [2020210,3094] 0 2024-03-18T14:43:11.402 INFO:tasks.workunit.client.0.smithi087.stdout:5/215: read d13/d1b/d27/f2c [2024000,103224] 0 2024-03-18T14:43:11.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/216: write d13/d1b/f31 [845539,82623] 0 2024-03-18T14:43:11.403 INFO:tasks.workunit.client.0.smithi087.stdout:5/217: stat d13/d1b/l21 0 2024-03-18T14:43:11.404 INFO:tasks.workunit.client.0.smithi087.stdout:4/124: rename d2/l12 to d2/db/l2a 0 2024-03-18T14:43:11.405 INFO:tasks.workunit.client.0.smithi087.stdout:3/222: sync 2024-03-18T14:43:11.410 INFO:tasks.workunit.client.0.smithi087.stdout:8/163: dwrite d1/d6/d14/f15 [0,4194304] 0 2024-03-18T14:43:11.411 INFO:tasks.workunit.client.0.smithi087.stdout:0/140: creat d0/d2/d4/d27/d29/d26/f2c x:0 0 0 2024-03-18T14:43:11.414 INFO:tasks.workunit.client.0.smithi087.stdout:5/218: symlink d13/d1b/d27/d35/l44 0 2024-03-18T14:43:11.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/140: truncate d2/d4/f1a 1112726 0 2024-03-18T14:43:11.418 INFO:tasks.workunit.client.0.smithi087.stdout:0/141: dwrite d0/d1a/f20 [0,4194304] 0 2024-03-18T14:43:11.418 INFO:tasks.workunit.client.0.smithi087.stdout:7/243: dwrite d1/d6/da/f50 [0,4194304] 0 2024-03-18T14:43:11.419 INFO:tasks.workunit.client.0.smithi087.stdout:7/244: write d1/d6/da/f43 [952059,105128] 0 2024-03-18T14:43:11.420 INFO:tasks.workunit.client.0.smithi087.stdout:1/219: truncate d3/d1d/f28 2726863 0 2024-03-18T14:43:11.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/142: dwrite d0/d2/f17 [4194304,4194304] 0 2024-03-18T14:43:11.426 INFO:tasks.workunit.client.0.smithi087.stdout:9/235: truncate db/d31/f36 667748 0 2024-03-18T14:43:11.431 INFO:tasks.workunit.client.0.smithi087.stdout:3/223: rename d0/d3/df/l20 to d0/d3/d10/l3e 0 2024-03-18T14:43:11.436 INFO:tasks.workunit.client.0.smithi087.stdout:4/125: unlink d2/d13/c15 0 2024-03-18T14:43:11.438 INFO:tasks.workunit.client.0.smithi087.stdout:9/236: fsync db/d18/d1c/f40 0 2024-03-18T14:43:11.438 INFO:tasks.workunit.client.0.smithi087.stdout:3/224: rmdir d0/d1c 39 2024-03-18T14:43:11.440 INFO:tasks.workunit.client.0.smithi087.stdout:1/220: truncate d3/f16 7585763 0 2024-03-18T14:43:11.444 INFO:tasks.workunit.client.0.smithi087.stdout:9/237: rename db/d18/c39 to db/d18/d1c/c44 0 2024-03-18T14:43:11.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/141: dwrite d2/d4/f1a [0,4194304] 0 2024-03-18T14:43:11.445 INFO:tasks.workunit.client.0.smithi087.stdout:9/238: fsync db/d31/f34 0 2024-03-18T14:43:11.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/225: creat d0/d3/df/f3f x:0 0 0 2024-03-18T14:43:11.446 INFO:tasks.workunit.client.0.smithi087.stdout:1/221: rmdir d3/d1d/d1e/d43 39 2024-03-18T14:43:11.446 INFO:tasks.workunit.client.0.smithi087.stdout:9/239: chown db 17 1 2024-03-18T14:43:11.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/219: getdents d13/d1b/d27/d28 0 2024-03-18T14:43:11.447 INFO:tasks.workunit.client.0.smithi087.stdout:6/146: sync 2024-03-18T14:43:11.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/126: creat d2/db/d24/f2b x:0 0 0 2024-03-18T14:43:11.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/143: write d0/dd/f15 [1718338,76327] 0 2024-03-18T14:43:11.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/144: write d0/d1a/f20 [3646894,126685] 0 2024-03-18T14:43:11.454 INFO:tasks.workunit.client.0.smithi087.stdout:2/142: rename d2/c13 to d2/c29 0 2024-03-18T14:43:11.456 INFO:tasks.workunit.client.0.smithi087.stdout:3/226: mkdir d0/d3/d40 0 2024-03-18T14:43:11.456 INFO:tasks.workunit.client.0.smithi087.stdout:7/245: dread d1/d6/f18 [0,4194304] 0 2024-03-18T14:43:11.457 INFO:tasks.workunit.client.0.smithi087.stdout:3/227: write d0/d3/f31 [777934,3505] 0 2024-03-18T14:43:11.457 INFO:tasks.workunit.client.0.smithi087.stdout:3/228: fdatasync d0/d3/d10/f2c 0 2024-03-18T14:43:11.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/222: rename d3/ld to d3/d1d/d45/l48 0 2024-03-18T14:43:11.461 INFO:tasks.workunit.client.0.smithi087.stdout:5/220: creat d13/d1b/d27/f45 x:0 0 0 2024-03-18T14:43:11.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/127: creat d2/db/de/f2c x:0 0 0 2024-03-18T14:43:11.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/145: mknod d0/d2/d4/c2d 0 2024-03-18T14:43:11.464 INFO:tasks.workunit.client.0.smithi087.stdout:0/146: stat d0/d2/d4/d19/d24 0 2024-03-18T14:43:11.465 INFO:tasks.workunit.client.0.smithi087.stdout:9/240: mknod db/c45 0 2024-03-18T14:43:11.470 INFO:tasks.workunit.client.0.smithi087.stdout:2/143: write d2/d4/f28 [584945,99188] 0 2024-03-18T14:43:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/144: readlink d2/d4/l9 0 2024-03-18T14:43:11.471 INFO:tasks.workunit.client.0.smithi087.stdout:2/145: stat d2/d4/c17 0 2024-03-18T14:43:11.472 INFO:tasks.workunit.client.0.smithi087.stdout:3/229: creat d0/de/f41 x:0 0 0 2024-03-18T14:43:11.472 INFO:tasks.workunit.client.0.smithi087.stdout:1/223: rmdir d3/d1d/d1e 39 2024-03-18T14:43:11.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/230: stat d0/d3/d10/f2d 0 2024-03-18T14:43:11.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/147: creat d3/d1a/d29/d22/f32 x:0 0 0 2024-03-18T14:43:11.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/148: stat d3/d1a/f1e 0 2024-03-18T14:43:11.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/149: fsync d3/d7/f21 0 2024-03-18T14:43:11.476 INFO:tasks.workunit.client.0.smithi087.stdout:9/241: rename db/f1a to db/d18/d1e/f46 0 2024-03-18T14:43:11.476 INFO:tasks.workunit.client.0.smithi087.stdout:9/242: write f8 [8879477,98766] 0 2024-03-18T14:43:11.479 INFO:tasks.workunit.client.0.smithi087.stdout:1/224: write d3/d1d/d1e/f36 [527204,30805] 0 2024-03-18T14:43:11.481 INFO:tasks.workunit.client.0.smithi087.stdout:9/243: dwrite db/d18/d1c/f27 [0,4194304] 0 2024-03-18T14:43:11.481 INFO:tasks.workunit.client.0.smithi087.stdout:7/246: write d1/d6/d29/f34 [1148821,75399] 0 2024-03-18T14:43:11.482 INFO:tasks.workunit.client.0.smithi087.stdout:3/231: mkdir d0/d3/df/d42 0 2024-03-18T14:43:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/247: read d1/d6/da/f50 [2275908,124901] 0 2024-03-18T14:43:11.483 INFO:tasks.workunit.client.0.smithi087.stdout:9/244: write db/d18/d1e/f24 [2820791,97190] 0 2024-03-18T14:43:11.484 INFO:tasks.workunit.client.0.smithi087.stdout:0/147: link d0/d2/f21 d0/dd/f2e 0 2024-03-18T14:43:11.485 INFO:tasks.workunit.client.0.smithi087.stdout:6/150: creat d3/d1a/d29/d22/d23/f33 x:0 0 0 2024-03-18T14:43:11.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/151: readlink d3/d7/l1c 0 2024-03-18T14:43:11.486 INFO:tasks.workunit.client.0.smithi087.stdout:9/245: dread db/d18/f2c [0,4194304] 0 2024-03-18T14:43:11.487 INFO:tasks.workunit.client.0.smithi087.stdout:9/246: write db/d31/f34 [2372046,8332] 0 2024-03-18T14:43:11.488 INFO:tasks.workunit.client.0.smithi087.stdout:1/225: creat d3/d1d/d45/f49 x:0 0 0 2024-03-18T14:43:11.492 INFO:tasks.workunit.client.0.smithi087.stdout:3/232: unlink d0/de/d30/f32 0 2024-03-18T14:43:11.492 INFO:tasks.workunit.client.0.smithi087.stdout:3/233: chown d0/d3/fd 104834080 1 2024-03-18T14:43:11.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/152: creat d3/d1a/f34 x:0 0 0 2024-03-18T14:43:11.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/146: dwrite d2/f10 [4194304,4194304] 0 2024-03-18T14:43:11.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/247: rmdir db 39 2024-03-18T14:43:11.503 INFO:tasks.workunit.client.0.smithi087.stdout:0/148: dwrite d0/fc [0,4194304] 0 2024-03-18T14:43:11.503 INFO:tasks.workunit.client.0.smithi087.stdout:4/128: getdents d2/db/de 0 2024-03-18T14:43:11.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/153: dread d3/d7/f2e [0,4194304] 0 2024-03-18T14:43:11.508 INFO:tasks.workunit.client.0.smithi087.stdout:8/164: sync 2024-03-18T14:43:11.512 INFO:tasks.workunit.client.0.smithi087.stdout:0/149: creat d0/d2/d4/d19/f2f x:0 0 0 2024-03-18T14:43:11.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/234: rmdir d0/d1c/d25 39 2024-03-18T14:43:11.513 INFO:tasks.workunit.client.0.smithi087.stdout:6/154: mknod d3/d7/c35 0 2024-03-18T14:43:11.515 INFO:tasks.workunit.client.0.smithi087.stdout:8/165: symlink d1/d6/d9/l33 0 2024-03-18T14:43:11.516 INFO:tasks.workunit.client.0.smithi087.stdout:2/147: creat d2/d4/d22/d24/f2a x:0 0 0 2024-03-18T14:43:11.517 INFO:tasks.workunit.client.0.smithi087.stdout:0/150: creat d0/dd/f30 x:0 0 0 2024-03-18T14:43:11.519 INFO:tasks.workunit.client.0.smithi087.stdout:6/155: rename d3/d7/l1c to d3/d7/d25/l36 0 2024-03-18T14:43:11.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/248: creat db/d18/d3a/f47 x:0 0 0 2024-03-18T14:43:11.521 INFO:tasks.workunit.client.0.smithi087.stdout:8/166: dwrite d1/d6/d14/f1c [0,4194304] 0 2024-03-18T14:43:11.522 INFO:tasks.workunit.client.0.smithi087.stdout:2/148: dread d2/f1e [0,4194304] 0 2024-03-18T14:43:11.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/149: chown d2/c20 664800 1 2024-03-18T14:43:11.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/156: fdatasync d3/f4 0 2024-03-18T14:43:11.525 INFO:tasks.workunit.client.0.smithi087.stdout:4/129: getdents d2/db 0 2024-03-18T14:43:11.526 INFO:tasks.workunit.client.0.smithi087.stdout:1/226: dread d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:11.527 INFO:tasks.workunit.client.0.smithi087.stdout:1/227: write d3/d1d/f21 [59437,93210] 0 2024-03-18T14:43:11.527 INFO:tasks.workunit.client.0.smithi087.stdout:8/167: dread d1/d6/d9/f17 [0,4194304] 0 2024-03-18T14:43:11.528 INFO:tasks.workunit.client.0.smithi087.stdout:8/168: read d1/d6/d14/f15 [1918326,102440] 0 2024-03-18T14:43:11.528 INFO:tasks.workunit.client.0.smithi087.stdout:0/151: dread d0/f16 [0,4194304] 0 2024-03-18T14:43:11.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/169: write d1/f2c [1775709,67924] 0 2024-03-18T14:43:11.531 INFO:tasks.workunit.client.0.smithi087.stdout:3/235: truncate d0/d1c/f1e 1048959 0 2024-03-18T14:43:11.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/150: rmdir d2/d4/d22 39 2024-03-18T14:43:11.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/151: chown d2/fb 0 1 2024-03-18T14:43:11.533 INFO:tasks.workunit.client.0.smithi087.stdout:2/152: write d2/d4/f15 [603166,35947] 0 2024-03-18T14:43:11.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/157: mknod d3/d1a/c37 0 2024-03-18T14:43:11.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/158: chown d3/d7 108 1 2024-03-18T14:43:11.534 INFO:tasks.workunit.client.0.smithi087.stdout:2/153: write d2/d4/fd [7768019,130149] 0 2024-03-18T14:43:11.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/249: symlink db/l48 0 2024-03-18T14:43:11.536 INFO:tasks.workunit.client.0.smithi087.stdout:4/130: unlink d2/db/f27 0 2024-03-18T14:43:11.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/228: write d3/d1d/d1e/d43/f46 [2108355,92439] 0 2024-03-18T14:43:11.540 INFO:tasks.workunit.client.0.smithi087.stdout:0/152: symlink d0/d2/d4/d27/d29/d26/l31 0 2024-03-18T14:43:11.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/170: symlink d1/d6/d9/l34 0 2024-03-18T14:43:11.541 INFO:tasks.workunit.client.0.smithi087.stdout:5/221: sync 2024-03-18T14:43:11.541 INFO:tasks.workunit.client.0.smithi087.stdout:7/248: sync 2024-03-18T14:43:11.544 INFO:tasks.workunit.client.0.smithi087.stdout:3/236: symlink d0/d3/d10/l43 0 2024-03-18T14:43:11.545 INFO:tasks.workunit.client.0.smithi087.stdout:3/237: dread - d0/d3/df/f33 zero size 2024-03-18T14:43:11.545 INFO:tasks.workunit.client.0.smithi087.stdout:9/250: dread db/ff [0,4194304] 0 2024-03-18T14:43:11.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/153: readlink d0/l14 0 2024-03-18T14:43:11.553 INFO:tasks.workunit.client.0.smithi087.stdout:0/154: dread - d0/d2/d4/d19/f2f zero size 2024-03-18T14:43:11.554 INFO:tasks.workunit.client.0.smithi087.stdout:0/155: chown d0/d2/d4/d27/d29/d2a 5514 1 2024-03-18T14:43:11.554 INFO:tasks.workunit.client.0.smithi087.stdout:7/249: mknod d1/d6/d29/d35/c51 0 2024-03-18T14:43:11.555 INFO:tasks.workunit.client.0.smithi087.stdout:0/156: write d0/d1a/f20 [4530595,89558] 0 2024-03-18T14:43:11.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/251: mknod db/d18/d3a/c49 0 2024-03-18T14:43:11.556 INFO:tasks.workunit.client.0.smithi087.stdout:9/252: chown db/d31/f42 1086729175 1 2024-03-18T14:43:11.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/253: write db/d18/d1c/f27 [1093548,93373] 0 2024-03-18T14:43:11.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/254: chown db/d12 7245 1 2024-03-18T14:43:11.562 INFO:tasks.workunit.client.0.smithi087.stdout:4/131: creat d2/d13/d28/f2d x:0 0 0 2024-03-18T14:43:11.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/238: mkdir d0/d3/d40/d44 0 2024-03-18T14:43:11.567 INFO:tasks.workunit.client.0.smithi087.stdout:0/157: mkdir d0/d2/d4/d27/d32 0 2024-03-18T14:43:11.568 INFO:tasks.workunit.client.0.smithi087.stdout:9/255: rmdir db/d18/d1c 39 2024-03-18T14:43:11.569 INFO:tasks.workunit.client.0.smithi087.stdout:0/158: dread - d0/dd/f30 zero size 2024-03-18T14:43:11.569 INFO:tasks.workunit.client.0.smithi087.stdout:6/159: rename d3/d7/cf to d3/c38 0 2024-03-18T14:43:11.571 INFO:tasks.workunit.client.0.smithi087.stdout:8/171: link d1/lb d1/d6/d2f/l35 0 2024-03-18T14:43:11.572 INFO:tasks.workunit.client.0.smithi087.stdout:7/250: mknod d1/d6/da/d42/c52 0 2024-03-18T14:43:11.572 INFO:tasks.workunit.client.0.smithi087.stdout:5/222: dwrite f12 [0,4194304] 0 2024-03-18T14:43:11.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/229: dwrite d3/d1d/f22 [0,4194304] 0 2024-03-18T14:43:11.574 INFO:tasks.workunit.client.0.smithi087.stdout:4/132: read d2/f9 [214042,81728] 0 2024-03-18T14:43:11.575 INFO:tasks.workunit.client.0.smithi087.stdout:5/223: fsync d13/f16 0 2024-03-18T14:43:11.576 INFO:tasks.workunit.client.0.smithi087.stdout:9/256: creat db/d18/d1e/d28/f4a x:0 0 0 2024-03-18T14:43:11.577 INFO:tasks.workunit.client.0.smithi087.stdout:3/239: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:11.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/159: dread d0/d2/f21 [0,4194304] 0 2024-03-18T14:43:11.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/240: dwrite d0/d3/fc [0,4194304] 0 2024-03-18T14:43:11.586 INFO:tasks.workunit.client.0.smithi087.stdout:2/154: getdents d2/d4/d22/d24 0 2024-03-18T14:43:11.587 INFO:tasks.workunit.client.0.smithi087.stdout:2/155: write d2/d4/f16 [83380,106163] 0 2024-03-18T14:43:11.590 INFO:tasks.workunit.client.0.smithi087.stdout:4/133: write d2/f21 [277656,111538] 0 2024-03-18T14:43:11.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/230: rename d3/c1b to d3/d1d/d1e/d20/c4a 0 2024-03-18T14:43:11.591 INFO:tasks.workunit.client.0.smithi087.stdout:1/231: chown d3/d1d/d1e/f37 67 1 2024-03-18T14:43:11.596 INFO:tasks.workunit.client.0.smithi087.stdout:3/241: unlink d0/d3/f31 0 2024-03-18T14:43:11.598 INFO:tasks.workunit.client.0.smithi087.stdout:2/156: mknod d2/d4/d22/c2b 0 2024-03-18T14:43:11.600 INFO:tasks.workunit.client.0.smithi087.stdout:3/242: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:11.602 INFO:tasks.workunit.client.0.smithi087.stdout:3/243: chown d0/d3/d10/f2d 57328 1 2024-03-18T14:43:11.603 INFO:tasks.workunit.client.0.smithi087.stdout:8/172: write d1/f2 [3723973,21989] 0 2024-03-18T14:43:11.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/157: dwrite d2/d4/f28 [0,4194304] 0 2024-03-18T14:43:11.605 INFO:tasks.workunit.client.0.smithi087.stdout:6/160: creat d3/d1a/d29/f39 x:0 0 0 2024-03-18T14:43:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:0/160: mknod d0/d2/d4/d27/d29/d2a/c33 0 2024-03-18T14:43:11.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/161: write d3/d7/f21 [4486151,47470] 0 2024-03-18T14:43:11.607 INFO:tasks.workunit.client.0.smithi087.stdout:0/161: fsync d0/dd/f15 0 2024-03-18T14:43:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:0/162: dwrite d0/dd/f2b [0,4194304] 0 2024-03-18T14:43:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:3/244: creat d0/d3/df/f45 x:0 0 0 2024-03-18T14:43:11.616 INFO:tasks.workunit.client.0.smithi087.stdout:8/173: mknod d1/c36 0 2024-03-18T14:43:11.617 INFO:tasks.workunit.client.0.smithi087.stdout:6/162: mknod d3/d7/d25/c3a 0 2024-03-18T14:43:11.617 INFO:tasks.workunit.client.0.smithi087.stdout:3/245: readlink d0/d3/df/l2f 0 2024-03-18T14:43:11.619 INFO:tasks.workunit.client.0.smithi087.stdout:7/251: write d1/d6/f2a [1325757,82542] 0 2024-03-18T14:43:11.622 INFO:tasks.workunit.client.0.smithi087.stdout:3/246: dwrite d0/d3/df/f16 [4194304,4194304] 0 2024-03-18T14:43:11.623 INFO:tasks.workunit.client.0.smithi087.stdout:9/257: write db/f10 [999418,127478] 0 2024-03-18T14:43:11.624 INFO:tasks.workunit.client.0.smithi087.stdout:7/252: dread d1/d6/da/f50 [0,4194304] 0 2024-03-18T14:43:11.625 INFO:tasks.workunit.client.0.smithi087.stdout:5/224: truncate f11 717046 0 2024-03-18T14:43:11.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/225: sync 2024-03-18T14:43:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:1/232: rename d3/f44 to d3/d1d/d1e/f4b 0 2024-03-18T14:43:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:2/158: getdents d2/d4/d22/d24 0 2024-03-18T14:43:11.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/163: mkdir d0/d1a/d34 0 2024-03-18T14:43:11.721 INFO:tasks.workunit.client.0.smithi087.stdout:8/174: mknod d1/d6/c37 0 2024-03-18T14:43:11.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/163: creat d3/d1a/d29/d22/f3b x:0 0 0 2024-03-18T14:43:11.723 INFO:tasks.workunit.client.0.smithi087.stdout:3/247: mkdir d0/de/d30/d46 0 2024-03-18T14:43:11.733 INFO:tasks.workunit.client.0.smithi087.stdout:2/159: mkdir d2/d4/d22/d2c 0 2024-03-18T14:43:11.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/160: dwrite d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:11.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/161: dread d2/f1e [0,4194304] 0 2024-03-18T14:43:11.741 INFO:tasks.workunit.client.0.smithi087.stdout:2/162: write d2/d4/fd [1387483,6051] 0 2024-03-18T14:43:11.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/163: write d2/f1d [816364,86030] 0 2024-03-18T14:43:11.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/233: mknod d3/d1d/d1f/d34/d38/c4c 0 2024-03-18T14:43:11.766 INFO:tasks.workunit.client.0.smithi087.stdout:3/248: symlink d0/d3/d10/l47 0 2024-03-18T14:43:11.768 INFO:tasks.workunit.client.0.smithi087.stdout:7/253: write d1/d6/da/f22 [4829376,21533] 0 2024-03-18T14:43:11.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/164: write d3/d1a/f1e [3339440,102540] 0 2024-03-18T14:43:11.772 INFO:tasks.workunit.client.0.smithi087.stdout:4/134: rename d2/c3 to d2/db/de/c2e 0 2024-03-18T14:43:11.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/164: readlink d2/l14 0 2024-03-18T14:43:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:2/165: write d2/d4/f27 [243574,53452] 0 2024-03-18T14:43:11.774 INFO:tasks.workunit.client.0.smithi087.stdout:0/164: mknod d0/d2/d4/d19/d24/c35 0 2024-03-18T14:43:11.775 INFO:tasks.workunit.client.0.smithi087.stdout:2/166: write d2/f1d [919555,85707] 0 2024-03-18T14:43:11.775 INFO:tasks.workunit.client.0.smithi087.stdout:9/258: creat db/f4b x:0 0 0 2024-03-18T14:43:11.776 INFO:tasks.workunit.client.0.smithi087.stdout:9/259: write f7 [461151,14175] 0 2024-03-18T14:43:11.777 INFO:tasks.workunit.client.0.smithi087.stdout:5/226: creat d13/d1b/f46 x:0 0 0 2024-03-18T14:43:11.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/135: write d2/db/d24/f26 [669289,2197] 0 2024-03-18T14:43:11.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/175: symlink d1/d6/l38 0 2024-03-18T14:43:11.783 INFO:tasks.workunit.client.0.smithi087.stdout:2/167: mknod d2/d4/d22/c2d 0 2024-03-18T14:43:11.785 INFO:tasks.workunit.client.0.smithi087.stdout:1/234: write d3/f19 [1409194,118808] 0 2024-03-18T14:43:11.790 INFO:tasks.workunit.client.0.smithi087.stdout:7/254: link d1/d6/da/f22 d1/d6/d29/f53 0 2024-03-18T14:43:11.791 INFO:tasks.workunit.client.0.smithi087.stdout:6/165: mknod d3/d1a/d29/c3c 0 2024-03-18T14:43:11.793 INFO:tasks.workunit.client.0.smithi087.stdout:1/235: chown d3/d1d/d1f/f2e 68 1 2024-03-18T14:43:11.794 INFO:tasks.workunit.client.0.smithi087.stdout:5/227: rename d13/f26 to d13/d1b/f47 0 2024-03-18T14:43:11.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/168: dwrite d2/d4/f15 [4194304,4194304] 0 2024-03-18T14:43:11.795 INFO:tasks.workunit.client.0.smithi087.stdout:8/176: creat d1/d6/d2f/f39 x:0 0 0 2024-03-18T14:43:11.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/166: symlink d3/d1a/d29/d22/d23/l3d 0 2024-03-18T14:43:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:1/236: write d3/d1d/d1e/d20/f39 [1039150,11347] 0 2024-03-18T14:43:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:0/165: dwrite d0/d2/f13 [0,4194304] 0 2024-03-18T14:43:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:2/169: write d2/f1d [1162024,88495] 0 2024-03-18T14:43:11.798 INFO:tasks.workunit.client.0.smithi087.stdout:7/255: mknod d1/d6/da/c54 0 2024-03-18T14:43:11.800 INFO:tasks.workunit.client.0.smithi087.stdout:7/256: chown d1/d6/f7 10 1 2024-03-18T14:43:11.801 INFO:tasks.workunit.client.0.smithi087.stdout:0/166: dread - d0/d2/d4/d27/d29/f22 zero size 2024-03-18T14:43:11.802 INFO:tasks.workunit.client.0.smithi087.stdout:5/228: dread f12 [0,4194304] 0 2024-03-18T14:43:11.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/170: dread d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:11.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/249: sync 2024-03-18T14:43:11.807 INFO:tasks.workunit.client.0.smithi087.stdout:4/136: rename d2/f1f to d2/db/de/f2f 0 2024-03-18T14:43:11.813 INFO:tasks.workunit.client.0.smithi087.stdout:8/177: creat d1/d6/d9/f3a x:0 0 0 2024-03-18T14:43:11.814 INFO:tasks.workunit.client.0.smithi087.stdout:6/167: rename d3/d7/d25/c3a to d3/d1a/c3e 0 2024-03-18T14:43:11.815 INFO:tasks.workunit.client.0.smithi087.stdout:1/237: dread d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:11.815 INFO:tasks.workunit.client.0.smithi087.stdout:4/137: mkdir d2/db/d24/d30 0 2024-03-18T14:43:11.817 INFO:tasks.workunit.client.0.smithi087.stdout:7/257: symlink d1/d6/d29/d2f/d48/l55 0 2024-03-18T14:43:11.818 INFO:tasks.workunit.client.0.smithi087.stdout:6/168: dwrite d3/d1a/d29/f1d [4194304,4194304] 0 2024-03-18T14:43:11.820 INFO:tasks.workunit.client.0.smithi087.stdout:2/171: creat d2/d4/d22/d2c/f2e x:0 0 0 2024-03-18T14:43:11.822 INFO:tasks.workunit.client.0.smithi087.stdout:8/178: fdatasync d1/d6/fa 0 2024-03-18T14:43:11.823 INFO:tasks.workunit.client.0.smithi087.stdout:8/179: dread - d1/d6/d2f/f30 zero size 2024-03-18T14:43:11.826 INFO:tasks.workunit.client.0.smithi087.stdout:0/167: truncate d0/f3 1032552 0 2024-03-18T14:43:11.828 INFO:tasks.workunit.client.0.smithi087.stdout:5/229: creat d13/f48 x:0 0 0 2024-03-18T14:43:11.829 INFO:tasks.workunit.client.0.smithi087.stdout:6/169: mknod d3/d7/d25/c3f 0 2024-03-18T14:43:11.830 INFO:tasks.workunit.client.0.smithi087.stdout:2/172: rmdir d2/d4/d22 39 2024-03-18T14:43:11.831 INFO:tasks.workunit.client.0.smithi087.stdout:3/250: truncate d0/d3/f29 909955 0 2024-03-18T14:43:11.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/251: stat d0/d1c/l3b 0 2024-03-18T14:43:11.832 INFO:tasks.workunit.client.0.smithi087.stdout:0/168: chown d0/f11 61035 1 2024-03-18T14:43:11.835 INFO:tasks.workunit.client.0.smithi087.stdout:4/138: dread d2/f9 [0,4194304] 0 2024-03-18T14:43:11.835 INFO:tasks.workunit.client.0.smithi087.stdout:1/238: creat d3/d1d/d1e/f4d x:0 0 0 2024-03-18T14:43:11.835 INFO:tasks.workunit.client.0.smithi087.stdout:4/139: rename d2/d13 to d2/d13/d28/d31 22 2024-03-18T14:43:11.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/140: write d2/db/de/f2c [95512,11344] 0 2024-03-18T14:43:11.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/170: write d3/d1a/d29/f16 [3595067,73234] 0 2024-03-18T14:43:11.839 INFO:tasks.workunit.client.0.smithi087.stdout:4/141: write d2/f21 [540791,34088] 0 2024-03-18T14:43:11.839 INFO:tasks.workunit.client.0.smithi087.stdout:9/260: sync 2024-03-18T14:43:11.841 INFO:tasks.workunit.client.0.smithi087.stdout:7/258: dwrite d1/d6/d29/f53 [4194304,4194304] 0 2024-03-18T14:43:11.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/230: write f11 [104267,1980] 0 2024-03-18T14:43:11.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/142: dwrite d2/f21 [0,4194304] 0 2024-03-18T14:43:11.846 INFO:tasks.workunit.client.0.smithi087.stdout:2/173: truncate d2/d4/f28 2176142 0 2024-03-18T14:43:11.849 INFO:tasks.workunit.client.0.smithi087.stdout:0/169: creat d0/d2/d4/d27/d32/f36 x:0 0 0 2024-03-18T14:43:11.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/261: creat db/d18/d1e/f4c x:0 0 0 2024-03-18T14:43:11.851 INFO:tasks.workunit.client.0.smithi087.stdout:7/259: unlink d1/d6/d29/c4f 0 2024-03-18T14:43:11.851 INFO:tasks.workunit.client.0.smithi087.stdout:3/252: dwrite d0/d1c/d25/f3c [4194304,4194304] 0 2024-03-18T14:43:11.852 INFO:tasks.workunit.client.0.smithi087.stdout:8/180: truncate d1/d6/f1e 1677 0 2024-03-18T14:43:11.853 INFO:tasks.workunit.client.0.smithi087.stdout:5/231: stat d13/d1b/d30/f40 0 2024-03-18T14:43:11.853 INFO:tasks.workunit.client.0.smithi087.stdout:2/174: dwrite d2/d4/f1a [0,4194304] 0 2024-03-18T14:43:11.854 INFO:tasks.workunit.client.0.smithi087.stdout:8/181: chown d1/f2c 586463 1 2024-03-18T14:43:11.854 INFO:tasks.workunit.client.0.smithi087.stdout:4/143: symlink d2/d13/d28/l32 0 2024-03-18T14:43:11.856 INFO:tasks.workunit.client.0.smithi087.stdout:3/253: rmdir d0/d3/d40 39 2024-03-18T14:43:11.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/260: symlink d1/d6/d16/dc/l56 0 2024-03-18T14:43:11.860 INFO:tasks.workunit.client.0.smithi087.stdout:7/261: read d1/d6/da/f50 [595691,48523] 0 2024-03-18T14:43:11.860 INFO:tasks.workunit.client.0.smithi087.stdout:2/175: dread d2/f1d [0,4194304] 0 2024-03-18T14:43:11.861 INFO:tasks.workunit.client.0.smithi087.stdout:3/254: dread d0/f19 [4194304,4194304] 0 2024-03-18T14:43:11.861 INFO:tasks.workunit.client.0.smithi087.stdout:5/232: rename d13/f48 to d13/d1b/d30/f49 0 2024-03-18T14:43:11.862 INFO:tasks.workunit.client.0.smithi087.stdout:3/255: fsync d0/d3/df/f14 0 2024-03-18T14:43:11.862 INFO:tasks.workunit.client.0.smithi087.stdout:7/262: dread - d1/d6/d29/f4d zero size 2024-03-18T14:43:11.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/182: symlink d1/d6/d2f/l3b 0 2024-03-18T14:43:11.868 INFO:tasks.workunit.client.0.smithi087.stdout:4/144: creat d2/db/d24/f33 x:0 0 0 2024-03-18T14:43:11.868 INFO:tasks.workunit.client.0.smithi087.stdout:6/171: truncate d3/d1a/d29/d22/d23/f30 796487 0 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:8/58: sync 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:6/53: sync 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:9/39: sync 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:0/64: sync 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:5/20: sync 2024-03-18T14:43:11.873 INFO:tasks.workunit.client.1.smithi129.stdout:7/29: sync 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.1.smithi129.stdout:3/11: sync 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.1.smithi129.stdout:4/24: sync 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.1.smithi129.stdout:2/5: sync 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.1.smithi129.stdout:1/8: sync 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.1.smithi129.stdout:1/9: dread - no filename 2024-03-18T14:43:11.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/262: dread db/fc [0,4194304] 0 2024-03-18T14:43:11.875 INFO:tasks.workunit.client.0.smithi087.stdout:2/176: dwrite d2/d4/d22/d2c/f2e [0,4194304] 0 2024-03-18T14:43:11.878 INFO:tasks.workunit.client.0.smithi087.stdout:4/145: read - d2/db/f1d zero size 2024-03-18T14:43:11.881 INFO:tasks.workunit.client.0.smithi087.stdout:0/170: getdents d0 0 2024-03-18T14:43:11.883 INFO:tasks.workunit.client.0.smithi087.stdout:9/263: symlink db/d12/l4d 0 2024-03-18T14:43:11.884 INFO:tasks.workunit.client.0.smithi087.stdout:8/183: symlink d1/d6/d14/l3c 0 2024-03-18T14:43:11.885 INFO:tasks.workunit.client.0.smithi087.stdout:2/177: rename d2/f1c to d2/f2f 0 2024-03-18T14:43:11.889 INFO:tasks.workunit.client.1.smithi129.stdout:6/54: dwrite f1 [0,4194304] 0 2024-03-18T14:43:11.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/233: truncate fb 3770048 0 2024-03-18T14:43:11.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/234: stat d13/d1b/d27/f2d 0 2024-03-18T14:43:11.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/171: rmdir d0/d2/d4/d27/d29 39 2024-03-18T14:43:11.896 INFO:tasks.workunit.client.0.smithi087.stdout:9/264: rename db/c1d to db/d18/d3a/c4e 0 2024-03-18T14:43:11.897 INFO:tasks.workunit.client.0.smithi087.stdout:8/184: mknod d1/c3d 0 2024-03-18T14:43:11.897 INFO:tasks.workunit.client.0.smithi087.stdout:8/185: stat d1/d6/d9/fe 0 2024-03-18T14:43:11.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/178: unlink d2/d4/d22/c2b 0 2024-03-18T14:43:11.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/256: link d0/d3/d10/l47 d0/d3/df/d42/l48 0 2024-03-18T14:43:11.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/263: truncate d1/d6/d29/f49 936502 0 2024-03-18T14:43:11.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/172: symlink d0/d2/l37 0 2024-03-18T14:43:11.902 INFO:tasks.workunit.client.0.smithi087.stdout:0/173: readlink d0/l1c 0 2024-03-18T14:43:11.906 INFO:tasks.workunit.client.0.smithi087.stdout:4/146: dread d2/db/f20 [0,4194304] 0 2024-03-18T14:43:11.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/174: write d0/d2/f18 [956432,4231] 0 2024-03-18T14:43:11.907 INFO:tasks.workunit.client.0.smithi087.stdout:1/239: sync 2024-03-18T14:43:11.908 INFO:tasks.workunit.client.0.smithi087.stdout:5/235: mknod d13/d1b/c4a 0 2024-03-18T14:43:11.910 INFO:tasks.workunit.client.0.smithi087.stdout:2/179: rmdir d2/d4/d22 39 2024-03-18T14:43:11.913 INFO:tasks.workunit.client.0.smithi087.stdout:6/172: getdents d3/d7 0 2024-03-18T14:43:11.917 INFO:tasks.workunit.client.0.smithi087.stdout:4/147: creat d2/d13/f34 x:0 0 0 2024-03-18T14:43:11.917 INFO:tasks.workunit.client.0.smithi087.stdout:8/186: truncate d1/fd 2671884 0 2024-03-18T14:43:11.918 INFO:tasks.workunit.client.0.smithi087.stdout:0/175: creat d0/dd/f38 x:0 0 0 2024-03-18T14:43:11.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/265: dwrite db/d31/f36 [0,4194304] 0 2024-03-18T14:43:11.919 INFO:tasks.workunit.client.0.smithi087.stdout:1/240: creat d3/f4e x:0 0 0 2024-03-18T14:43:11.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/236: creat d13/d1b/d27/d35/f4b x:0 0 0 2024-03-18T14:43:11.920 INFO:tasks.workunit.client.0.smithi087.stdout:1/241: fsync d3/f17 0 2024-03-18T14:43:11.920 INFO:tasks.workunit.client.0.smithi087.stdout:3/257: mknod d0/c49 0 2024-03-18T14:43:11.922 INFO:tasks.workunit.client.0.smithi087.stdout:8/187: mknod d1/d6/d14/c3e 0 2024-03-18T14:43:11.924 INFO:tasks.workunit.client.0.smithi087.stdout:9/266: creat db/d18/d3a/f4f x:0 0 0 2024-03-18T14:43:11.925 INFO:tasks.workunit.client.0.smithi087.stdout:7/264: truncate d1/d6/d29/f4d 608195 0 2024-03-18T14:43:11.930 INFO:tasks.workunit.client.0.smithi087.stdout:5/237: unlink d13/d1b/l20 0 2024-03-18T14:43:11.932 INFO:tasks.workunit.client.0.smithi087.stdout:3/258: unlink d0/d3/d10/f2d 0 2024-03-18T14:43:11.933 INFO:tasks.workunit.client.0.smithi087.stdout:4/148: mknod d2/c35 0 2024-03-18T14:43:11.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/188: creat d1/d6/d9/f3f x:0 0 0 2024-03-18T14:43:11.937 INFO:tasks.workunit.client.0.smithi087.stdout:5/238: readlink l4 0 2024-03-18T14:43:11.939 INFO:tasks.workunit.client.0.smithi087.stdout:3/259: dread d0/f1 [4194304,4194304] 0 2024-03-18T14:43:11.939 INFO:tasks.workunit.client.0.smithi087.stdout:5/239: rename d13/d1b to d13/d1b/d27/d35/d4c 22 2024-03-18T14:43:11.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/176: creat d0/d2/d4/d27/f39 x:0 0 0 2024-03-18T14:43:11.941 INFO:tasks.workunit.client.0.smithi087.stdout:3/260: write d0/fb [1345074,19319] 0 2024-03-18T14:43:11.941 INFO:tasks.workunit.client.0.smithi087.stdout:8/189: dwrite d1/d6/d2f/f30 [0,4194304] 0 2024-03-18T14:43:11.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/240: rename d13/d1b/d27/d35 to d13/d1b/d27/d35/d3b/d4d 22 2024-03-18T14:43:11.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/173: getdents d3/d1a 0 2024-03-18T14:43:11.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/267: dread db/f11 [0,4194304] 0 2024-03-18T14:43:11.948 INFO:tasks.workunit.client.0.smithi087.stdout:6/174: read d3/d1a/d29/d22/d23/f26 [3265484,1098] 0 2024-03-18T14:43:11.949 INFO:tasks.workunit.client.0.smithi087.stdout:0/177: dread d0/dd/f2b [0,4194304] 0 2024-03-18T14:43:11.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/190: creat d1/d6/d9/f40 x:0 0 0 2024-03-18T14:43:11.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/261: dwrite d0/d3/d10/f1f [4194304,4194304] 0 2024-03-18T14:43:11.952 INFO:tasks.workunit.client.0.smithi087.stdout:6/175: write d3/d1a/d29/f39 [604239,51638] 0 2024-03-18T14:43:11.952 INFO:tasks.workunit.client.0.smithi087.stdout:1/242: dwrite d3/d1d/d1e/d20/f40 [0,4194304] 0 2024-03-18T14:43:11.955 INFO:tasks.workunit.client.0.smithi087.stdout:6/176: write d3/d7/f24 [3628984,58080] 0 2024-03-18T14:43:11.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/149: creat d2/f36 x:0 0 0 2024-03-18T14:43:11.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/265: getdents d1/d6/d16/dc 0 2024-03-18T14:43:11.959 INFO:tasks.workunit.client.0.smithi087.stdout:9/268: dwrite db/d18/d1c/f37 [0,4194304] 0 2024-03-18T14:43:11.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/191: dwrite d1/d6/d2f/f30 [4194304,4194304] 0 2024-03-18T14:43:11.966 INFO:tasks.workunit.client.0.smithi087.stdout:0/178: symlink d0/d2/d4/d27/d32/l3a 0 2024-03-18T14:43:11.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/180: sync 2024-03-18T14:43:11.968 INFO:tasks.workunit.client.0.smithi087.stdout:3/262: rename d0/d1c/d25/l26 to d0/d3/df/d42/l4a 0 2024-03-18T14:43:11.968 INFO:tasks.workunit.client.0.smithi087.stdout:3/263: write d0/fb [1442663,64200] 0 2024-03-18T14:43:11.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/150: stat d2/f10 0 2024-03-18T14:43:11.973 INFO:tasks.workunit.client.0.smithi087.stdout:7/266: mknod d1/d6/d29/d35/c57 0 2024-03-18T14:43:11.973 INFO:tasks.workunit.client.0.smithi087.stdout:7/267: chown d1/l5 3292 1 2024-03-18T14:43:11.973 INFO:tasks.workunit.client.0.smithi087.stdout:9/269: creat db/d18/d1c/f50 x:0 0 0 2024-03-18T14:43:11.974 INFO:tasks.workunit.client.0.smithi087.stdout:8/192: creat d1/d6/d2f/f41 x:0 0 0 2024-03-18T14:43:11.976 INFO:tasks.workunit.client.0.smithi087.stdout:8/193: read d1/d6/d9/f17 [1401344,120727] 0 2024-03-18T14:43:11.978 INFO:tasks.workunit.client.0.smithi087.stdout:9/270: dwrite db/d18/d1e/f38 [0,4194304] 0 2024-03-18T14:43:11.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/268: symlink d1/d6/d29/d2f/l58 0 2024-03-18T14:43:11.982 INFO:tasks.workunit.client.0.smithi087.stdout:7/269: readlink d1/d6/d16/dc/l23 0 2024-03-18T14:43:11.984 INFO:tasks.workunit.client.0.smithi087.stdout:0/179: mknod d0/d2/d4/d27/c3b 0 2024-03-18T14:43:11.986 INFO:tasks.workunit.client.0.smithi087.stdout:2/181: creat d2/d4/d22/d2c/f30 x:0 0 0 2024-03-18T14:43:11.987 INFO:tasks.workunit.client.0.smithi087.stdout:5/241: truncate d13/d1b/d27/f2a 23310 0 2024-03-18T14:43:11.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/177: creat d3/d1a/d29/f40 x:0 0 0 2024-03-18T14:43:11.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/178: stat d3/d7/l13 0 2024-03-18T14:43:11.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/179: chown d3/d1a/c3e 0 1 2024-03-18T14:43:11.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/180: chown d3/f6 1 1 2024-03-18T14:43:11.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/182: dread d2/d4/f1a [0,4194304] 0 2024-03-18T14:43:11.995 INFO:tasks.workunit.client.0.smithi087.stdout:1/243: getdents d3/d1d/d1f/d34 0 2024-03-18T14:43:11.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/180: mkdir d0/d2/d3c 0 2024-03-18T14:43:12.000 INFO:tasks.workunit.client.0.smithi087.stdout:6/181: chown d3/d1a/d29/d22/d23/f30 31698046 1 2024-03-18T14:43:12.000 INFO:tasks.workunit.client.0.smithi087.stdout:6/182: fsync d3/d1a/d29/d22/f3b 0 2024-03-18T14:43:12.004 INFO:tasks.workunit.client.0.smithi087.stdout:9/271: mkdir db/d18/d51 0 2024-03-18T14:43:12.005 INFO:tasks.workunit.client.0.smithi087.stdout:8/194: truncate d1/d6/d14/f1c 4602713 0 2024-03-18T14:43:12.006 INFO:tasks.workunit.client.0.smithi087.stdout:4/151: truncate d2/f36 380748 0 2024-03-18T14:43:12.006 INFO:tasks.workunit.client.0.smithi087.stdout:4/152: write d2/db/f1d [600077,81052] 0 2024-03-18T14:43:12.007 INFO:tasks.workunit.client.0.smithi087.stdout:7/270: mkdir d1/d6/da/d59 0 2024-03-18T14:43:12.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/244: rmdir d3/d1d/d1e/d43 39 2024-03-18T14:43:12.009 INFO:tasks.workunit.client.0.smithi087.stdout:2/183: dread d2/d4/f15 [0,4194304] 0 2024-03-18T14:43:12.010 INFO:tasks.workunit.client.0.smithi087.stdout:5/242: symlink d13/d1b/l4e 0 2024-03-18T14:43:12.010 INFO:tasks.workunit.client.0.smithi087.stdout:5/243: chown d13/d1b 20784 1 2024-03-18T14:43:12.011 INFO:tasks.workunit.client.0.smithi087.stdout:6/183: rename d3/d1a/d29/f39 to d3/d7/d25/f41 0 2024-03-18T14:43:12.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/272: chown db/l2e 80594 1 2024-03-18T14:43:12.013 INFO:tasks.workunit.client.0.smithi087.stdout:8/195: symlink d1/d6/d14/l42 0 2024-03-18T14:43:12.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/181: mkdir d0/d1a/d34/d3d 0 2024-03-18T14:43:12.014 INFO:tasks.workunit.client.0.smithi087.stdout:9/273: dread db/fc [0,4194304] 0 2024-03-18T14:43:12.015 INFO:tasks.workunit.client.0.smithi087.stdout:8/196: chown d1/d6/d14/f1f 51 1 2024-03-18T14:43:12.018 INFO:tasks.workunit.client.0.smithi087.stdout:6/184: dwrite d3/f6 [4194304,4194304] 0 2024-03-18T14:43:12.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/185: chown d3/d1a/d29/ld 1388 1 2024-03-18T14:43:12.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/184: dwrite d2/f2f [0,4194304] 0 2024-03-18T14:43:12.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/153: rename d2/c35 to d2/db/de/c37 0 2024-03-18T14:43:12.022 INFO:tasks.workunit.client.0.smithi087.stdout:1/245: write d3/d1d/d1f/d34/f35 [1268495,12740] 0 2024-03-18T14:43:12.023 INFO:tasks.workunit.client.0.smithi087.stdout:1/246: readlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:12.026 INFO:tasks.workunit.client.0.smithi087.stdout:4/154: dread d2/db/d24/f26 [0,4194304] 0 2024-03-18T14:43:12.026 INFO:tasks.workunit.client.0.smithi087.stdout:4/155: write d2/f21 [1784885,18741] 0 2024-03-18T14:43:12.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/156: readlink d2/d13/d28/l32 0 2024-03-18T14:43:12.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/157: write d2/f10 [546009,83408] 0 2024-03-18T14:43:12.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/244: rename d13/d1b/f1c to d13/d1b/d27/d35/f4f 0 2024-03-18T14:43:12.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/271: truncate d1/d6/da/f50 4926839 0 2024-03-18T14:43:12.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/185: symlink d2/d4/d22/l31 0 2024-03-18T14:43:12.034 INFO:tasks.workunit.client.0.smithi087.stdout:2/186: stat d2/d4/d22/d2c/f2e 0 2024-03-18T14:43:12.035 INFO:tasks.workunit.client.0.smithi087.stdout:1/247: write d3/d1d/d1e/f4b [354784,93621] 0 2024-03-18T14:43:12.036 INFO:tasks.workunit.client.0.smithi087.stdout:0/182: creat d0/d1a/d34/d3d/f3e x:0 0 0 2024-03-18T14:43:12.040 INFO:tasks.workunit.client.0.smithi087.stdout:0/183: dread d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:12.040 INFO:tasks.workunit.client.0.smithi087.stdout:1/248: dread d3/d1d/d1e/f36 [0,4194304] 0 2024-03-18T14:43:12.040 INFO:tasks.workunit.client.0.smithi087.stdout:1/249: read - d3/f4e zero size 2024-03-18T14:43:12.043 INFO:tasks.workunit.client.0.smithi087.stdout:6/186: rename d3/d7/d25/f28 to d3/d1a/f42 0 2024-03-18T14:43:12.043 INFO:tasks.workunit.client.0.smithi087.stdout:5/245: symlink d13/d1b/d27/d28/l50 0 2024-03-18T14:43:12.047 INFO:tasks.workunit.client.0.smithi087.stdout:5/246: dwrite d13/d1b/d27/f2d [0,4194304] 0 2024-03-18T14:43:12.048 INFO:tasks.workunit.client.0.smithi087.stdout:7/272: symlink d1/d6/d29/l5a 0 2024-03-18T14:43:12.049 INFO:tasks.workunit.client.0.smithi087.stdout:9/274: truncate db/f2f 2664195 0 2024-03-18T14:43:12.053 INFO:tasks.workunit.client.0.smithi087.stdout:8/197: truncate d1/d6/d9/f3a 576435 0 2024-03-18T14:43:12.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/184: creat d0/f3f x:0 0 0 2024-03-18T14:43:12.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/250: rmdir d3/d1d/d1e 39 2024-03-18T14:43:12.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/187: creat d3/d7/f43 x:0 0 0 2024-03-18T14:43:12.063 INFO:tasks.workunit.client.0.smithi087.stdout:6/188: dread d3/d1a/d29/f1d [4194304,4194304] 0 2024-03-18T14:43:12.065 INFO:tasks.workunit.client.0.smithi087.stdout:5/247: write d13/d1b/d27/f2c [4648405,97045] 0 2024-03-18T14:43:12.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/264: sync 2024-03-18T14:43:12.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/251: dread d3/f7 [0,4194304] 0 2024-03-18T14:43:12.071 INFO:tasks.workunit.client.0.smithi087.stdout:2/187: truncate d2/f1d 742838 0 2024-03-18T14:43:12.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/158: rename d2/d13/c29 to d2/db/d24/c38 0 2024-03-18T14:43:12.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/189: creat d3/d7/f44 x:0 0 0 2024-03-18T14:43:12.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/188: creat d2/f32 x:0 0 0 2024-03-18T14:43:12.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/273: rename d1/d6/da/d42/c45 to d1/d6/d29/d2f/d48/c5b 0 2024-03-18T14:43:12.080 INFO:tasks.workunit.client.0.smithi087.stdout:7/274: chown d1/d6/d29/d2f/d48/l55 31 1 2024-03-18T14:43:12.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/198: creat d1/d6/f43 x:0 0 0 2024-03-18T14:43:12.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/190: dread d3/d1a/d29/f27 [0,4194304] 0 2024-03-18T14:43:12.087 INFO:tasks.workunit.client.0.smithi087.stdout:5/248: truncate d13/f1e 892115 0 2024-03-18T14:43:12.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/185: dread d0/dd/f15 [0,4194304] 0 2024-03-18T14:43:12.090 INFO:tasks.workunit.client.0.smithi087.stdout:9/275: dread f3 [0,4194304] 0 2024-03-18T14:43:12.091 INFO:tasks.workunit.client.0.smithi087.stdout:1/252: truncate d3/d1d/d1f/f24 2559225 0 2024-03-18T14:43:12.091 INFO:tasks.workunit.client.0.smithi087.stdout:7/275: dread d1/d6/da/f50 [4194304,4194304] 0 2024-03-18T14:43:12.092 INFO:tasks.workunit.client.0.smithi087.stdout:7/276: readlink d1/d6/d16/dc/l23 0 2024-03-18T14:43:12.093 INFO:tasks.workunit.client.0.smithi087.stdout:2/189: symlink d2/d4/l33 0 2024-03-18T14:43:12.094 INFO:tasks.workunit.client.0.smithi087.stdout:2/190: readlink d2/l14 0 2024-03-18T14:43:12.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/249: symlink d13/d1b/d27/d28/l51 0 2024-03-18T14:43:12.097 INFO:tasks.workunit.client.0.smithi087.stdout:9/276: creat db/d18/d1e/d28/f52 x:0 0 0 2024-03-18T14:43:12.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/186: write d0/fc [1845920,3287] 0 2024-03-18T14:43:12.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/6: creat f2 x:0 0 0 2024-03-18T14:43:12.099 INFO:tasks.workunit.client.1.smithi129.stdout:2/7: dread - f2 zero size 2024-03-18T14:43:12.100 INFO:tasks.workunit.client.0.smithi087.stdout:3/265: rename d0/f19 to d0/d1c/f4b 0 2024-03-18T14:43:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:9/277: fsync db/d31/f34 0 2024-03-18T14:43:12.101 INFO:tasks.workunit.client.0.smithi087.stdout:1/253: dwrite d3/d1d/f3d [0,4194304] 0 2024-03-18T14:43:12.102 INFO:tasks.workunit.client.1.smithi129.stdout:5/21: creat d0/f6 x:0 0 0 2024-03-18T14:43:12.102 INFO:tasks.workunit.client.1.smithi129.stdout:0/65: symlink d0/l15 0 2024-03-18T14:43:12.104 INFO:tasks.workunit.client.0.smithi087.stdout:7/277: dwrite d1/d6/da/f22 [4194304,4194304] 0 2024-03-18T14:43:12.105 INFO:tasks.workunit.client.1.smithi129.stdout:8/59: rename l7 to d9/d11/l12 0 2024-03-18T14:43:12.106 INFO:tasks.workunit.client.0.smithi087.stdout:6/191: dwrite d3/d7/d25/f41 [0,4194304] 0 2024-03-18T14:43:12.110 INFO:tasks.workunit.client.1.smithi129.stdout:7/30: mknod d4/d7/d8/cb 0 2024-03-18T14:43:12.110 INFO:tasks.workunit.client.1.smithi129.stdout:8/60: write f8 [1229861,111726] 0 2024-03-18T14:43:12.110 INFO:tasks.workunit.client.1.smithi129.stdout:6/55: mkdir d3/d5/db/de 0 2024-03-18T14:43:12.111 INFO:tasks.workunit.client.1.smithi129.stdout:1/10: mkdir d1/d2 0 2024-03-18T14:43:12.111 INFO:tasks.workunit.client.1.smithi129.stdout:8/61: write f8 [1690654,102100] 0 2024-03-18T14:43:12.111 INFO:tasks.workunit.client.1.smithi129.stdout:5/22: dwrite d0/f2 [0,4194304] 0 2024-03-18T14:43:12.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/199: dread d1/fd [0,4194304] 0 2024-03-18T14:43:12.112 INFO:tasks.workunit.client.0.smithi087.stdout:5/250: dwrite d13/f24 [0,4194304] 0 2024-03-18T14:43:12.112 INFO:tasks.workunit.client.0.smithi087.stdout:6/192: chown d3/d1a/l1f 54 1 2024-03-18T14:43:12.112 INFO:tasks.workunit.client.0.smithi087.stdout:9/278: dread db/fd [0,4194304] 0 2024-03-18T14:43:12.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/266: mknod d0/de/d30/c4c 0 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/12: getdents . 0 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/13: fsync - no filename 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/14: rmdir - no directory 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/15: dwrite - no filename 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/16: write - no filename 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/17: dread - no filename 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/18: chown . 550 1 2024-03-18T14:43:12.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/19: dread - no filename 2024-03-18T14:43:12.114 INFO:tasks.workunit.client.0.smithi087.stdout:0/187: creat d0/d2/d4/d19/d24/f40 x:0 0 0 2024-03-18T14:43:12.118 INFO:tasks.workunit.client.1.smithi129.stdout:7/31: write f1 [1561664,93434] 0 2024-03-18T14:43:12.119 INFO:tasks.workunit.client.0.smithi087.stdout:2/191: creat d2/d4/f34 x:0 0 0 2024-03-18T14:43:12.121 INFO:tasks.workunit.client.1.smithi129.stdout:8/62: unlink d9/lf 0 2024-03-18T14:43:12.122 INFO:tasks.workunit.client.0.smithi087.stdout:7/278: symlink d1/d6/d29/d2f/d48/l5c 0 2024-03-18T14:43:12.122 INFO:tasks.workunit.client.0.smithi087.stdout:8/200: mkdir d1/d6/d2f/d44 0 2024-03-18T14:43:12.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/63: chown d9/dc 5461 1 2024-03-18T14:43:12.122 INFO:tasks.workunit.client.1.smithi129.stdout:5/23: symlink d0/l7 0 2024-03-18T14:43:12.122 INFO:tasks.workunit.client.0.smithi087.stdout:7/279: write d1/d6/f14 [741746,11175] 0 2024-03-18T14:43:12.123 INFO:tasks.workunit.client.0.smithi087.stdout:8/201: fdatasync d1/d6/d9/f40 0 2024-03-18T14:43:12.123 INFO:tasks.workunit.client.1.smithi129.stdout:5/24: write d0/f1 [801156,104476] 0 2024-03-18T14:43:12.124 INFO:tasks.workunit.client.0.smithi087.stdout:5/251: creat d13/d1b/d30/f52 x:0 0 0 2024-03-18T14:43:12.126 INFO:tasks.workunit.client.0.smithi087.stdout:3/267: rename d0/d3/df/f45 to d0/d3/df/f4d 0 2024-03-18T14:43:12.127 INFO:tasks.workunit.client.1.smithi129.stdout:4/25: truncate d0/f5 932691 0 2024-03-18T14:43:12.129 INFO:tasks.workunit.client.1.smithi129.stdout:7/32: unlink f1 0 2024-03-18T14:43:12.129 INFO:tasks.workunit.client.0.smithi087.stdout:2/192: rmdir d2/d4/d22 39 2024-03-18T14:43:12.130 INFO:tasks.workunit.client.1.smithi129.stdout:1/11: creat d1/d2/f3 x:0 0 0 2024-03-18T14:43:12.130 INFO:tasks.workunit.client.1.smithi129.stdout:5/25: dwrite d0/f1 [0,4194304] 0 2024-03-18T14:43:12.130 INFO:tasks.workunit.client.1.smithi129.stdout:8/64: truncate f4 754674 0 2024-03-18T14:43:12.131 INFO:tasks.workunit.client.1.smithi129.stdout:5/26: rename d0 to d0/d8 22 2024-03-18T14:43:12.132 INFO:tasks.workunit.client.1.smithi129.stdout:5/27: chown d0/f4 711404374 1 2024-03-18T14:43:12.132 INFO:tasks.workunit.client.0.smithi087.stdout:8/202: unlink d1/d6/fa 0 2024-03-18T14:43:12.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/203: write d1/d6/f43 [155243,102178] 0 2024-03-18T14:43:12.133 INFO:tasks.workunit.client.1.smithi129.stdout:3/20: creat f0 x:0 0 0 2024-03-18T14:43:12.135 INFO:tasks.workunit.client.1.smithi129.stdout:4/26: mkdir d0/d9 0 2024-03-18T14:43:12.136 INFO:tasks.workunit.client.1.smithi129.stdout:6/56: truncate d3/d6/f8 277313 0 2024-03-18T14:43:12.137 INFO:tasks.workunit.client.1.smithi129.stdout:7/33: dwrite d4/d7/fa [0,4194304] 0 2024-03-18T14:43:12.137 INFO:tasks.workunit.client.0.smithi087.stdout:7/280: rename d1/d6/f7 to d1/d6/da/d59/f5d 0 2024-03-18T14:43:12.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/34: dread - d4/f5 zero size 2024-03-18T14:43:12.138 INFO:tasks.workunit.client.0.smithi087.stdout:5/252: unlink d13/d1b/d27/d28/l51 0 2024-03-18T14:43:12.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/35: chown f3 48100199 1 2024-03-18T14:43:12.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/36: dread - d4/f5 zero size 2024-03-18T14:43:12.139 INFO:tasks.workunit.client.1.smithi129.stdout:1/12: symlink d1/d2/l4 0 2024-03-18T14:43:12.139 INFO:tasks.workunit.client.1.smithi129.stdout:5/28: creat d0/f9 x:0 0 0 2024-03-18T14:43:12.140 INFO:tasks.workunit.client.1.smithi129.stdout:3/21: mknod c1 0 2024-03-18T14:43:12.140 INFO:tasks.workunit.client.1.smithi129.stdout:7/37: dread - d4/d7/d8/f9 zero size 2024-03-18T14:43:12.140 INFO:tasks.workunit.client.1.smithi129.stdout:3/22: read - f0 zero size 2024-03-18T14:43:12.142 INFO:tasks.workunit.client.1.smithi129.stdout:7/38: write d4/d7/fa [769016,39132] 0 2024-03-18T14:43:12.142 INFO:tasks.workunit.client.0.smithi087.stdout:0/188: fsync d0/f3 0 2024-03-18T14:43:12.142 INFO:tasks.workunit.client.0.smithi087.stdout:1/254: link d3/d1d/d1f/d34/d38/c4c d3/d1d/d1f/d34/d38/c4f 0 2024-03-18T14:43:12.143 INFO:tasks.workunit.client.0.smithi087.stdout:0/189: dread - d0/d2/d4/d27/d32/f36 zero size 2024-03-18T14:43:12.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/193: dwrite d3/d1a/d29/d22/d23/f26 [4194304,4194304] 0 2024-03-18T14:43:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/279: creat db/d18/f53 x:0 0 0 2024-03-18T14:43:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:3/268: mkdir d0/d1c/d4e 0 2024-03-18T14:43:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:1/255: fsync d3/d1d/f28 0 2024-03-18T14:43:12.152 INFO:tasks.workunit.client.0.smithi087.stdout:7/281: chown d1/d6/d29/d2f/d48/c5b 945 1 2024-03-18T14:43:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:3/269: stat d0/d3/l2e 0 2024-03-18T14:43:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:7/282: chown d1/d6/d29 20295151 1 2024-03-18T14:43:12.153 INFO:tasks.workunit.client.0.smithi087.stdout:2/193: creat d2/d4/d22/d24/f35 x:0 0 0 2024-03-18T14:43:12.154 INFO:tasks.workunit.client.0.smithi087.stdout:2/194: stat d2/d4/d22/d24/f2a 0 2024-03-18T14:43:12.155 INFO:tasks.workunit.client.0.smithi087.stdout:0/190: creat d0/d2/d4/d19/f41 x:0 0 0 2024-03-18T14:43:12.157 INFO:tasks.workunit.client.0.smithi087.stdout:0/191: readlink d0/d2/d4/d27/d32/l3a 0 2024-03-18T14:43:12.158 INFO:tasks.workunit.client.0.smithi087.stdout:3/270: dwrite d0/de/f41 [0,4194304] 0 2024-03-18T14:43:12.160 INFO:tasks.workunit.client.0.smithi087.stdout:2/195: creat d2/d4/d22/f36 x:0 0 0 2024-03-18T14:43:12.161 INFO:tasks.workunit.client.0.smithi087.stdout:1/256: fdatasync d3/d1d/d1f/f24 0 2024-03-18T14:43:12.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/196: chown d2/d4/fd 448 1 2024-03-18T14:43:12.162 INFO:tasks.workunit.client.0.smithi087.stdout:9/280: dwrite db/d18/f2c [0,4194304] 0 2024-03-18T14:43:12.162 INFO:tasks.workunit.client.0.smithi087.stdout:7/283: mknod d1/d6/c5e 0 2024-03-18T14:43:12.163 INFO:tasks.workunit.client.0.smithi087.stdout:2/197: fsync d2/d4/d22/d2c/f30 0 2024-03-18T14:43:12.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/281: write f1 [9026024,113440] 0 2024-03-18T14:43:12.165 INFO:tasks.workunit.client.0.smithi087.stdout:6/194: creat d3/f45 x:0 0 0 2024-03-18T14:43:12.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/282: chown db/c3e 0 1 2024-03-18T14:43:12.166 INFO:tasks.workunit.client.0.smithi087.stdout:3/271: write d0/d3/df/f33 [206081,78454] 0 2024-03-18T14:43:12.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/283: write db/d31/f34 [3180179,13965] 0 2024-03-18T14:43:12.169 INFO:tasks.workunit.client.0.smithi087.stdout:1/257: dwrite d3/f10 [0,4194304] 0 2024-03-18T14:43:12.169 INFO:tasks.workunit.client.0.smithi087.stdout:9/284: write f1 [6716288,29081] 0 2024-03-18T14:43:12.169 INFO:tasks.workunit.client.0.smithi087.stdout:1/258: chown d3/l5 211544929 1 2024-03-18T14:43:12.173 INFO:tasks.workunit.client.0.smithi087.stdout:4/159: sync 2024-03-18T14:43:12.174 INFO:tasks.workunit.client.0.smithi087.stdout:8/204: write d1/d6/d14/f2a [1694074,69786] 0 2024-03-18T14:43:12.175 INFO:tasks.workunit.client.0.smithi087.stdout:8/205: write d1/d6/d14/f2e [1744988,96305] 0 2024-03-18T14:43:12.179 INFO:tasks.workunit.client.0.smithi087.stdout:7/284: creat d1/d6/d16/dc/f5f x:0 0 0 2024-03-18T14:43:12.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/192: rename d0/l14 to d0/d2/d4/d27/d32/l42 0 2024-03-18T14:43:12.181 INFO:tasks.workunit.client.0.smithi087.stdout:2/198: rename d2 to d2/d4/d22/d2c/d37 22 2024-03-18T14:43:12.182 INFO:tasks.workunit.client.1.smithi129.stdout:1/13: creat d1/d2/f5 x:0 0 0 2024-03-18T14:43:12.184 INFO:tasks.workunit.client.0.smithi087.stdout:9/285: creat db/d18/d1e/f54 x:0 0 0 2024-03-18T14:43:12.185 INFO:tasks.workunit.client.0.smithi087.stdout:9/286: read db/d18/f2c [2833206,96371] 0 2024-03-18T14:43:12.185 INFO:tasks.workunit.client.0.smithi087.stdout:1/259: chown d3/d1d/d1e/d20/c2f 1 1 2024-03-18T14:43:12.185 INFO:tasks.workunit.client.0.smithi087.stdout:9/287: readlink db/d18/l32 0 2024-03-18T14:43:12.189 INFO:tasks.workunit.client.0.smithi087.stdout:4/160: dwrite d2/db/de/f2f [4194304,4194304] 0 2024-03-18T14:43:12.190 INFO:tasks.workunit.client.1.smithi129.stdout:5/29: mkdir d0/da 0 2024-03-18T14:43:12.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/272: mkdir d0/d3/d4f 0 2024-03-18T14:43:12.191 INFO:tasks.workunit.client.0.smithi087.stdout:8/206: mkdir d1/d6/d2f/d44/d45 0 2024-03-18T14:43:12.194 INFO:tasks.workunit.client.0.smithi087.stdout:9/288: creat db/d12/f55 x:0 0 0 2024-03-18T14:43:12.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/285: rmdir d1/d6/d16/dc 39 2024-03-18T14:43:12.199 INFO:tasks.workunit.client.0.smithi087.stdout:1/260: read d3/d1d/d1e/d43/f46 [102515,119984] 0 2024-03-18T14:43:12.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/253: sync 2024-03-18T14:43:12.201 INFO:tasks.workunit.client.0.smithi087.stdout:5/254: dread - d13/d1b/d30/f52 zero size 2024-03-18T14:43:12.203 INFO:tasks.workunit.client.0.smithi087.stdout:4/161: mknod d2/d13/c39 0 2024-03-18T14:43:12.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/255: write d13/d1b/d30/f52 [205703,86036] 0 2024-03-18T14:43:12.204 INFO:tasks.workunit.client.0.smithi087.stdout:7/286: dwrite d1/d6/d29/f53 [4194304,4194304] 0 2024-03-18T14:43:12.205 INFO:tasks.workunit.client.0.smithi087.stdout:8/207: symlink d1/d6/d14/l46 0 2024-03-18T14:43:12.206 INFO:tasks.workunit.client.0.smithi087.stdout:8/208: write d1/f2 [1780071,91976] 0 2024-03-18T14:43:12.207 INFO:tasks.workunit.client.0.smithi087.stdout:8/209: dread - d1/d6/d9/f3f zero size 2024-03-18T14:43:12.208 INFO:tasks.workunit.client.0.smithi087.stdout:8/210: write d1/d6/d2f/f39 [141045,51046] 0 2024-03-18T14:43:12.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/289: mknod db/d31/c56 0 2024-03-18T14:43:12.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/290: chown db/c3e 129791 1 2024-03-18T14:43:12.209 INFO:tasks.workunit.client.0.smithi087.stdout:9/291: chown db/le 219842 1 2024-03-18T14:43:12.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/195: getdents d3/d7/d25 0 2024-03-18T14:43:12.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/273: dread d0/f34 [0,4194304] 0 2024-03-18T14:43:12.211 INFO:tasks.workunit.client.0.smithi087.stdout:3/274: dread - d0/f37 zero size 2024-03-18T14:43:12.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/261: mkdir d3/d1d/d1e/d43/d50 0 2024-03-18T14:43:12.213 INFO:tasks.workunit.client.0.smithi087.stdout:2/199: truncate d2/d4/d22/f36 929352 0 2024-03-18T14:43:12.214 INFO:tasks.workunit.client.0.smithi087.stdout:5/256: unlink l6 0 2024-03-18T14:43:12.216 INFO:tasks.workunit.client.0.smithi087.stdout:7/287: chown d1/d6/d16/dc/f26 11 1 2024-03-18T14:43:12.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/211: symlink d1/d6/d14/l47 0 2024-03-18T14:43:12.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/196: mkdir d3/d1a/d46 0 2024-03-18T14:43:12.219 INFO:tasks.workunit.client.1.smithi129.stdout:4/27: symlink d0/d9/la 0 2024-03-18T14:43:12.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/275: unlink d0/de/f41 0 2024-03-18T14:43:12.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/200: mknod d2/d4/d22/c38 0 2024-03-18T14:43:12.222 INFO:tasks.workunit.client.0.smithi087.stdout:5/257: mknod d13/d1b/d27/d35/c53 0 2024-03-18T14:43:12.225 INFO:tasks.workunit.client.0.smithi087.stdout:4/162: link d2/f10 d2/db/d24/d30/f3a 0 2024-03-18T14:43:12.226 INFO:tasks.workunit.client.0.smithi087.stdout:2/201: dwrite d2/d4/f34 [0,4194304] 0 2024-03-18T14:43:12.226 INFO:tasks.workunit.client.0.smithi087.stdout:7/288: mkdir d1/d6/d29/d35/d60 0 2024-03-18T14:43:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:0/193: mknod d0/d2/d4/d27/c43 0 2024-03-18T14:43:12.227 INFO:tasks.workunit.client.0.smithi087.stdout:4/163: write d2/db/de/f17 [1777864,116833] 0 2024-03-18T14:43:12.230 INFO:tasks.workunit.client.0.smithi087.stdout:5/258: dwrite d13/d1b/d27/f45 [0,4194304] 0 2024-03-18T14:43:12.231 INFO:tasks.workunit.client.0.smithi087.stdout:6/197: mkdir d3/d1a/d29/d22/d47 0 2024-03-18T14:43:12.232 INFO:tasks.workunit.client.0.smithi087.stdout:7/289: dwrite d1/d6/d16/f1e [0,4194304] 0 2024-03-18T14:43:12.236 INFO:tasks.workunit.client.0.smithi087.stdout:2/202: creat d2/d4/d22/f39 x:0 0 0 2024-03-18T14:43:12.237 INFO:tasks.workunit.client.0.smithi087.stdout:6/198: dwrite d3/f19 [0,4194304] 0 2024-03-18T14:43:12.238 INFO:tasks.workunit.client.0.smithi087.stdout:0/194: creat d0/d2/d4/d27/d32/f44 x:0 0 0 2024-03-18T14:43:12.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/290: dwrite d1/f2b [0,4194304] 0 2024-03-18T14:43:12.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/276: dwrite d0/d3/df/f4d [0,4194304] 0 2024-03-18T14:43:12.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/291: stat d1/d6/d29/d35/c57 0 2024-03-18T14:43:12.247 INFO:tasks.workunit.client.0.smithi087.stdout:4/164: mkdir d2/db/d3b 0 2024-03-18T14:43:12.248 INFO:tasks.workunit.client.0.smithi087.stdout:4/165: fsync d2/db/de/f17 0 2024-03-18T14:43:12.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/166: chown d2/d13/f34 0 1 2024-03-18T14:43:12.253 INFO:tasks.workunit.client.0.smithi087.stdout:5/259: rmdir d13/d1b 39 2024-03-18T14:43:12.254 INFO:tasks.workunit.client.1.smithi129.stdout:1/14: creat d1/d2/f6 x:0 0 0 2024-03-18T14:43:12.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/30: creat d0/fb x:0 0 0 2024-03-18T14:43:12.256 INFO:tasks.workunit.client.1.smithi129.stdout:5/31: read d0/f3 [233250,81397] 0 2024-03-18T14:43:12.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/262: truncate d3/d1d/d1e/d20/f40 473698 0 2024-03-18T14:43:12.263 INFO:tasks.workunit.client.0.smithi087.stdout:8/212: write d1/d6/d14/f1c [2987148,36682] 0 2024-03-18T14:43:12.268 INFO:tasks.workunit.client.0.smithi087.stdout:2/203: rmdir d2/d4/d22 39 2024-03-18T14:43:12.269 INFO:tasks.workunit.client.0.smithi087.stdout:2/204: readlink d2/l7 0 2024-03-18T14:43:12.271 INFO:tasks.workunit.client.0.smithi087.stdout:9/292: link db/d12/c26 db/d18/c57 0 2024-03-18T14:43:12.271 INFO:tasks.workunit.client.0.smithi087.stdout:9/293: readlink db/d18/d1e/d28/l3f 0 2024-03-18T14:43:12.272 INFO:tasks.workunit.client.0.smithi087.stdout:9/294: write f1 [9571941,112530] 0 2024-03-18T14:43:12.272 INFO:tasks.workunit.client.0.smithi087.stdout:0/195: read d0/f16 [752086,77622] 0 2024-03-18T14:43:12.274 INFO:tasks.workunit.client.0.smithi087.stdout:3/277: creat d0/d3/df/f50 x:0 0 0 2024-03-18T14:43:12.274 INFO:tasks.workunit.client.0.smithi087.stdout:7/292: mkdir d1/d6/da/d42/d61 0 2024-03-18T14:43:12.275 INFO:tasks.workunit.client.0.smithi087.stdout:4/167: readlink d2/l7 0 2024-03-18T14:43:12.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/205: write d2/f10 [655229,127255] 0 2024-03-18T14:43:12.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/168: dwrite d2/db/de/f2c [0,4194304] 0 2024-03-18T14:43:12.280 INFO:tasks.workunit.client.0.smithi087.stdout:4/169: stat f1 0 2024-03-18T14:43:12.282 INFO:tasks.workunit.client.0.smithi087.stdout:9/295: rmdir db 39 2024-03-18T14:43:12.284 INFO:tasks.workunit.client.0.smithi087.stdout:0/196: dread - d0/d2/d4/d27/d29/d26/f2c zero size 2024-03-18T14:43:12.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/278: mknod d0/d1c/d25/c51 0 2024-03-18T14:43:12.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/293: symlink d1/d6/d29/l62 0 2024-03-18T14:43:12.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/199: link d3/d1a/d29/c3c d3/d1a/d29/d22/d47/c48 0 2024-03-18T14:43:12.294 INFO:tasks.workunit.client.1.smithi129.stdout:6/57: truncate d3/d5/db/fd 895171 0 2024-03-18T14:43:12.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/294: fsync d1/d6/da/f50 0 2024-03-18T14:43:12.296 INFO:tasks.workunit.client.0.smithi087.stdout:1/263: dread d3/f16 [0,4194304] 0 2024-03-18T14:43:12.298 INFO:tasks.workunit.client.0.smithi087.stdout:2/206: mkdir d2/d4/d22/d2c/d3a 0 2024-03-18T14:43:12.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/200: mknod d3/d1a/d29/d22/d23/c49 0 2024-03-18T14:43:12.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/170: mkdir d2/db/d3c 0 2024-03-18T14:43:12.301 INFO:tasks.workunit.client.0.smithi087.stdout:5/260: truncate d13/d1b/f31 540057 0 2024-03-18T14:43:12.303 INFO:tasks.workunit.client.0.smithi087.stdout:4/171: fsync d2/db/de/f2f 0 2024-03-18T14:43:12.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/296: mknod db/d31/c58 0 2024-03-18T14:43:12.303 INFO:tasks.workunit.client.0.smithi087.stdout:2/207: dwrite d2/d4/d22/d2c/f30 [0,4194304] 0 2024-03-18T14:43:12.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/197: rename d0/f3f to d0/d1a/d34/d3d/f45 0 2024-03-18T14:43:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:6/201: dwrite d3/d1a/d29/f16 [0,4194304] 0 2024-03-18T14:43:12.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/295: symlink d1/d6/d29/l63 0 2024-03-18T14:43:12.310 INFO:tasks.workunit.client.0.smithi087.stdout:2/208: dread d2/d4/d22/d2c/f30 [0,4194304] 0 2024-03-18T14:43:12.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/279: creat d0/f52 x:0 0 0 2024-03-18T14:43:12.312 INFO:tasks.workunit.client.0.smithi087.stdout:9/297: creat db/d18/d3a/f59 x:0 0 0 2024-03-18T14:43:12.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/280: dwrite d0/d3/df/f3f [0,4194304] 0 2024-03-18T14:43:12.317 INFO:tasks.workunit.client.0.smithi087.stdout:8/213: sync 2024-03-18T14:43:12.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/202: symlink d3/d7/l4a 0 2024-03-18T14:43:12.321 INFO:tasks.workunit.client.1.smithi129.stdout:5/32: mkdir d0/dc 0 2024-03-18T14:43:12.325 INFO:tasks.workunit.client.0.smithi087.stdout:4/172: truncate d2/f10 4096751 0 2024-03-18T14:43:12.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/173: dwrite d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:12.329 INFO:tasks.workunit.client.1.smithi129.stdout:4/28: fdatasync d0/f5 0 2024-03-18T14:43:12.332 INFO:tasks.workunit.client.0.smithi087.stdout:8/214: creat d1/d6/d9/f48 x:0 0 0 2024-03-18T14:43:12.332 INFO:tasks.workunit.client.0.smithi087.stdout:8/215: fdatasync d1/d6/d14/f27 0 2024-03-18T14:43:12.333 INFO:tasks.workunit.client.0.smithi087.stdout:8/216: write d1/d6/d2f/f39 [940948,36577] 0 2024-03-18T14:43:12.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/209: creat d2/d4/d22/d2c/d3a/f3b x:0 0 0 2024-03-18T14:43:12.340 INFO:tasks.workunit.client.0.smithi087.stdout:5/261: truncate d13/d1b/d27/d35/f4b 297878 0 2024-03-18T14:43:12.341 INFO:tasks.workunit.client.1.smithi129.stdout:1/15: sync 2024-03-18T14:43:12.342 INFO:tasks.workunit.client.0.smithi087.stdout:7/296: truncate d1/d6/d16/f4e 3225810 0 2024-03-18T14:43:12.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/264: getdents d3/d1d/d45 0 2024-03-18T14:43:12.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/265: stat d3/c18 0 2024-03-18T14:43:12.345 INFO:tasks.workunit.client.0.smithi087.stdout:3/281: truncate d0/d3/f7 2849470 0 2024-03-18T14:43:12.346 INFO:tasks.workunit.client.0.smithi087.stdout:8/217: dread d1/d6/d2f/f39 [0,4194304] 0 2024-03-18T14:43:12.346 INFO:tasks.workunit.client.0.smithi087.stdout:2/210: fdatasync d2/d4/d22/d2c/f30 0 2024-03-18T14:43:12.348 INFO:tasks.workunit.client.0.smithi087.stdout:0/198: symlink d0/dd/l46 0 2024-03-18T14:43:12.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/218: read d1/d6/d14/f1c [1120800,37916] 0 2024-03-18T14:43:12.351 INFO:tasks.workunit.client.0.smithi087.stdout:4/174: mknod d2/db/d3c/c3d 0 2024-03-18T14:43:12.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/298: getdents db/d18/d1e 0 2024-03-18T14:43:12.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/299: chown db/d18/d1e 183498006 1 2024-03-18T14:43:12.358 INFO:tasks.workunit.client.0.smithi087.stdout:2/211: rename d2/d4/d22/c38 to d2/d4/d22/c3c 0 2024-03-18T14:43:12.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/219: symlink d1/d6/d14/l49 0 2024-03-18T14:43:12.360 INFO:tasks.workunit.client.0.smithi087.stdout:1/266: dwrite d3/d1d/d1f/f24 [0,4194304] 0 2024-03-18T14:43:12.361 INFO:tasks.workunit.client.0.smithi087.stdout:4/175: chown d2/db/de/c37 11662 1 2024-03-18T14:43:12.363 INFO:tasks.workunit.client.0.smithi087.stdout:3/282: dread d0/de/f12 [0,4194304] 0 2024-03-18T14:43:12.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/300: creat db/d18/d1e/f5a x:0 0 0 2024-03-18T14:43:12.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/212: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:12.365 INFO:tasks.workunit.client.1.smithi129.stdout:4/29: mknod d0/d9/cb 0 2024-03-18T14:43:12.368 INFO:tasks.workunit.client.1.smithi129.stdout:5/33: getdents d0/da 0 2024-03-18T14:43:12.368 INFO:tasks.workunit.client.0.smithi087.stdout:3/283: symlink d0/d3/df/l53 0 2024-03-18T14:43:12.368 INFO:tasks.workunit.client.0.smithi087.stdout:9/301: read db/d12/f20 [2111546,98924] 0 2024-03-18T14:43:12.369 INFO:tasks.workunit.client.1.smithi129.stdout:4/30: symlink d0/lc 0 2024-03-18T14:43:12.369 INFO:tasks.workunit.client.1.smithi129.stdout:5/34: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:12.370 INFO:tasks.workunit.client.0.smithi087.stdout:4/176: dwrite d2/db/f20 [0,4194304] 0 2024-03-18T14:43:12.371 INFO:tasks.workunit.client.0.smithi087.stdout:0/199: write d0/f3 [775283,108096] 0 2024-03-18T14:43:12.371 INFO:tasks.workunit.client.0.smithi087.stdout:1/267: write d3/d1d/f28 [1123571,129837] 0 2024-03-18T14:43:12.373 INFO:tasks.workunit.client.1.smithi129.stdout:5/35: dread d0/f2 [0,4194304] 0 2024-03-18T14:43:12.375 INFO:tasks.workunit.client.0.smithi087.stdout:2/213: creat d2/d4/d22/d2c/f3d x:0 0 0 2024-03-18T14:43:12.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/200: write d0/d2/f17 [851504,99916] 0 2024-03-18T14:43:12.379 INFO:tasks.workunit.client.0.smithi087.stdout:9/302: creat db/d18/d51/f5b x:0 0 0 2024-03-18T14:43:12.380 INFO:tasks.workunit.client.0.smithi087.stdout:3/284: mknod d0/d3/d40/c54 0 2024-03-18T14:43:12.382 INFO:tasks.workunit.client.0.smithi087.stdout:2/214: symlink d2/d4/d22/d2c/l3e 0 2024-03-18T14:43:12.382 INFO:tasks.workunit.client.1.smithi129.stdout:4/31: rename d0/f7 to d0/fd 0 2024-03-18T14:43:12.383 INFO:tasks.workunit.client.1.smithi129.stdout:4/32: dread - d0/f8 zero size 2024-03-18T14:43:12.387 INFO:tasks.workunit.client.1.smithi129.stdout:9/40: truncate d0/f8 1432697 0 2024-03-18T14:43:12.389 INFO:tasks.workunit.client.1.smithi129.stdout:2/8: truncate f0 19867 0 2024-03-18T14:43:12.390 INFO:tasks.workunit.client.0.smithi087.stdout:1/268: rename d3/d1d/d45/l48 to d3/d1d/d1e/l51 0 2024-03-18T14:43:12.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/66: truncate d0/ff 1263848 0 2024-03-18T14:43:12.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/67: readlink d0/l1 0 2024-03-18T14:43:12.391 INFO:tasks.workunit.client.0.smithi087.stdout:1/269: read d3/d1d/d1f/f2e [2435606,35617] 0 2024-03-18T14:43:12.393 INFO:tasks.workunit.client.0.smithi087.stdout:0/201: mknod d0/d1a/c47 0 2024-03-18T14:43:12.393 INFO:tasks.workunit.client.1.smithi129.stdout:1/16: fsync d1/d2/f3 0 2024-03-18T14:43:12.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/177: dwrite d2/f36 [0,4194304] 0 2024-03-18T14:43:12.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/202: dwrite d0/d2/d4/d19/f23 [0,4194304] 0 2024-03-18T14:43:12.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/285: rmdir d0/d1c/d4e 0 2024-03-18T14:43:12.400 INFO:tasks.workunit.client.1.smithi129.stdout:7/39: write f3 [4520823,2215] 0 2024-03-18T14:43:12.400 INFO:tasks.workunit.client.0.smithi087.stdout:3/286: chown d0/d3/fd 3812717 1 2024-03-18T14:43:12.400 INFO:tasks.workunit.client.1.smithi129.stdout:7/40: stat d4/d7/d8 0 2024-03-18T14:43:12.403 INFO:tasks.workunit.client.1.smithi129.stdout:7/41: dread f3 [0,4194304] 0 2024-03-18T14:43:12.404 INFO:tasks.workunit.client.0.smithi087.stdout:9/303: truncate f1 6807678 0 2024-03-18T14:43:12.404 INFO:tasks.workunit.client.1.smithi129.stdout:3/23: getdents . 0 2024-03-18T14:43:12.404 INFO:tasks.workunit.client.0.smithi087.stdout:6/203: sync 2024-03-18T14:43:12.404 INFO:tasks.workunit.client.0.smithi087.stdout:1/270: write d3/d1d/d1e/f36 [137350,69347] 0 2024-03-18T14:43:12.408 INFO:tasks.workunit.client.0.smithi087.stdout:4/178: symlink d2/l3e 0 2024-03-18T14:43:12.408 INFO:tasks.workunit.client.1.smithi129.stdout:9/41: mkdir d0/da 0 2024-03-18T14:43:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/204: dwrite d3/d7/d25/f2a [0,4194304] 0 2024-03-18T14:43:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/179: chown d2/db/f20 0 1 2024-03-18T14:43:12.409 INFO:tasks.workunit.client.0.smithi087.stdout:6/205: readlink d3/d1a/d29/ld 0 2024-03-18T14:43:12.410 INFO:tasks.workunit.client.0.smithi087.stdout:6/206: fdatasync d3/d1a/d29/d22/f2c 0 2024-03-18T14:43:12.414 INFO:tasks.workunit.client.0.smithi087.stdout:4/180: dwrite d2/db/de/f17 [0,4194304] 0 2024-03-18T14:43:12.414 INFO:tasks.workunit.client.1.smithi129.stdout:8/65: write f4 [1341735,68536] 0 2024-03-18T14:43:12.414 INFO:tasks.workunit.client.0.smithi087.stdout:0/203: truncate d0/d2/d4/d19/f41 1016630 0 2024-03-18T14:43:12.416 INFO:tasks.workunit.client.1.smithi129.stdout:3/24: mknod c2 0 2024-03-18T14:43:12.417 INFO:tasks.workunit.client.0.smithi087.stdout:6/207: unlink d3/d7/f14 0 2024-03-18T14:43:12.417 INFO:tasks.workunit.client.1.smithi129.stdout:6/58: dwrite d3/d5/db/fd [0,4194304] 0 2024-03-18T14:43:12.421 INFO:tasks.workunit.client.1.smithi129.stdout:5/36: rmdir d0/da 0 2024-03-18T14:43:12.421 INFO:tasks.workunit.client.0.smithi087.stdout:4/181: chown d2/db/cc 9 1 2024-03-18T14:43:12.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/271: dread d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:12.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/208: creat d3/d1a/d29/d22/d47/f4b x:0 0 0 2024-03-18T14:43:12.423 INFO:tasks.workunit.client.1.smithi129.stdout:9/42: mkdir d0/db 0 2024-03-18T14:43:12.426 INFO:tasks.workunit.client.1.smithi129.stdout:8/66: mknod d9/d11/c13 0 2024-03-18T14:43:12.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/287: write d0/d3/f29 [193296,66283] 0 2024-03-18T14:43:12.432 INFO:tasks.workunit.client.1.smithi129.stdout:6/59: mkdir d3/d5/db/df 0 2024-03-18T14:43:12.432 INFO:tasks.workunit.client.1.smithi129.stdout:6/60: fsync d3/d5/f9 0 2024-03-18T14:43:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/272: creat d3/d1d/d1e/d20/f52 x:0 0 0 2024-03-18T14:43:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:6/209: fsync d3/d1a/d29/f27 0 2024-03-18T14:43:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:5/262: sync 2024-03-18T14:43:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:7/297: sync 2024-03-18T14:43:12.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/288: symlink d0/d3/d40/l55 0 2024-03-18T14:43:12.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/37: unlink d0/f3 0 2024-03-18T14:43:12.435 INFO:tasks.workunit.client.1.smithi129.stdout:5/38: chown d0/l7 1800020 1 2024-03-18T14:43:12.436 INFO:tasks.workunit.client.1.smithi129.stdout:9/43: creat d0/fc x:0 0 0 2024-03-18T14:43:12.436 INFO:tasks.workunit.client.1.smithi129.stdout:2/9: dread f0 [0,4194304] 0 2024-03-18T14:43:12.436 INFO:tasks.workunit.client.1.smithi129.stdout:2/10: dread - f2 zero size 2024-03-18T14:43:12.436 INFO:tasks.workunit.client.0.smithi087.stdout:3/289: chown d0/d1c/l3b 251074430 1 2024-03-18T14:43:12.437 INFO:tasks.workunit.client.0.smithi087.stdout:7/298: write d1/d6/f44 [795004,74688] 0 2024-03-18T14:43:12.437 INFO:tasks.workunit.client.1.smithi129.stdout:0/68: write d0/ff [2215395,29813] 0 2024-03-18T14:43:12.437 INFO:tasks.workunit.client.1.smithi129.stdout:8/67: mkdir d9/dd/d14 0 2024-03-18T14:43:12.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/263: creat d13/d1b/d27/d28/f54 x:0 0 0 2024-03-18T14:43:12.439 INFO:tasks.workunit.client.1.smithi129.stdout:3/25: mknod c3 0 2024-03-18T14:43:12.439 INFO:tasks.workunit.client.0.smithi087.stdout:1/273: dread d3/f16 [4194304,4194304] 0 2024-03-18T14:43:12.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/210: mknod d3/c4c 0 2024-03-18T14:43:12.440 INFO:tasks.workunit.client.0.smithi087.stdout:6/211: readlink d3/d7/d25/l36 0 2024-03-18T14:43:12.441 INFO:tasks.workunit.client.1.smithi129.stdout:4/33: truncate d0/fd 429673 0 2024-03-18T14:43:12.441 INFO:tasks.workunit.client.1.smithi129.stdout:4/34: readlink d0/lc 0 2024-03-18T14:43:12.441 INFO:tasks.workunit.client.0.smithi087.stdout:3/290: creat d0/d3/d40/f56 x:0 0 0 2024-03-18T14:43:12.443 INFO:tasks.workunit.client.0.smithi087.stdout:6/212: creat d3/d7/d25/f4d x:0 0 0 2024-03-18T14:43:12.443 INFO:tasks.workunit.client.1.smithi129.stdout:7/42: truncate d4/d7/d8/f9 401148 0 2024-03-18T14:43:12.444 INFO:tasks.workunit.client.0.smithi087.stdout:0/204: dread d0/d1a/f20 [0,4194304] 0 2024-03-18T14:43:12.444 INFO:tasks.workunit.client.0.smithi087.stdout:0/205: chown d0/d1a 1 1 2024-03-18T14:43:12.444 INFO:tasks.workunit.client.0.smithi087.stdout:7/299: creat d1/d6/d29/d35/d60/f64 x:0 0 0 2024-03-18T14:43:12.445 INFO:tasks.workunit.client.0.smithi087.stdout:7/300: chown d1/d6/d16/dc/f32 2666 1 2024-03-18T14:43:12.446 INFO:tasks.workunit.client.1.smithi129.stdout:4/35: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:12.447 INFO:tasks.workunit.client.1.smithi129.stdout:1/17: truncate d1/d2/f6 577711 0 2024-03-18T14:43:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/291: symlink d0/l57 0 2024-03-18T14:43:12.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/182: dread d2/db/de/f2f [0,4194304] 0 2024-03-18T14:43:12.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/183: chown d2/db/d24/f33 55863 1 2024-03-18T14:43:12.449 INFO:tasks.workunit.client.0.smithi087.stdout:5/264: rename d13/d1b/l4e to d13/l55 0 2024-03-18T14:43:12.449 INFO:tasks.workunit.client.1.smithi129.stdout:6/61: rmdir d3 39 2024-03-18T14:43:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:4/184: chown d2/d13/c39 3985 1 2024-03-18T14:43:12.450 INFO:tasks.workunit.client.0.smithi087.stdout:7/301: dwrite d1/f3 [4194304,4194304] 0 2024-03-18T14:43:12.454 INFO:tasks.workunit.client.0.smithi087.stdout:0/206: creat d0/d1a/f48 x:0 0 0 2024-03-18T14:43:12.455 INFO:tasks.workunit.client.0.smithi087.stdout:6/213: rename d3/d7/d25/c3f to d3/d1a/d29/d22/c4e 0 2024-03-18T14:43:12.456 INFO:tasks.workunit.client.0.smithi087.stdout:0/207: write d0/d1a/f48 [443750,68271] 0 2024-03-18T14:43:12.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/274: truncate d3/d1d/d1f/f2e 1051413 0 2024-03-18T14:43:12.457 INFO:tasks.workunit.client.0.smithi087.stdout:5/265: dwrite d13/d1b/d27/d35/f43 [0,4194304] 0 2024-03-18T14:43:12.457 INFO:tasks.workunit.client.0.smithi087.stdout:1/275: readlink d3/l14 0 2024-03-18T14:43:12.458 INFO:tasks.workunit.client.1.smithi129.stdout:7/43: symlink d4/d7/lc 0 2024-03-18T14:43:12.458 INFO:tasks.workunit.client.0.smithi087.stdout:3/292: symlink d0/d1c/l58 0 2024-03-18T14:43:12.458 INFO:tasks.workunit.client.0.smithi087.stdout:7/302: dwrite d1/d6/d29/f53 [0,4194304] 0 2024-03-18T14:43:12.459 INFO:tasks.workunit.client.0.smithi087.stdout:0/208: write d0/d2/f13 [2402944,120348] 0 2024-03-18T14:43:12.459 INFO:tasks.workunit.client.1.smithi129.stdout:2/11: dwrite f0 [0,4194304] 0 2024-03-18T14:43:12.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/266: symlink d13/d1b/d27/d35/l56 0 2024-03-18T14:43:12.461 INFO:tasks.workunit.client.1.smithi129.stdout:5/39: creat d0/dc/fd x:0 0 0 2024-03-18T14:43:12.462 INFO:tasks.workunit.client.1.smithi129.stdout:1/18: creat d1/f7 x:0 0 0 2024-03-18T14:43:12.462 INFO:tasks.workunit.client.0.smithi087.stdout:0/209: dread d0/dd/f15 [0,4194304] 0 2024-03-18T14:43:12.462 INFO:tasks.workunit.client.1.smithi129.stdout:1/19: readlink d1/d2/l4 0 2024-03-18T14:43:12.464 INFO:tasks.workunit.client.1.smithi129.stdout:5/40: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:12.465 INFO:tasks.workunit.client.1.smithi129.stdout:5/41: write d0/f1 [1332506,88155] 0 2024-03-18T14:43:12.465 INFO:tasks.workunit.client.1.smithi129.stdout:5/42: fsync d0/f4 0 2024-03-18T14:43:12.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/215: sync 2024-03-18T14:43:12.466 INFO:tasks.workunit.client.0.smithi087.stdout:9/304: sync 2024-03-18T14:43:12.466 INFO:tasks.workunit.client.0.smithi087.stdout:8/220: sync 2024-03-18T14:43:12.466 INFO:tasks.workunit.client.0.smithi087.stdout:2/216: readlink d2/d4/l9 0 2024-03-18T14:43:12.486 INFO:tasks.workunit.client.0.smithi087.stdout:4/185: rename d2/f10 to d2/d13/f3f 0 2024-03-18T14:43:12.488 INFO:tasks.workunit.client.0.smithi087.stdout:9/305: chown f1 5325 1 2024-03-18T14:43:12.489 INFO:tasks.workunit.client.1.smithi129.stdout:8/68: truncate f6 1598964 0 2024-03-18T14:43:12.490 INFO:tasks.workunit.client.0.smithi087.stdout:2/217: mknod d2/d4/d22/c3f 0 2024-03-18T14:43:12.495 INFO:tasks.workunit.client.0.smithi087.stdout:0/210: mkdir d0/d49 0 2024-03-18T14:43:12.495 INFO:tasks.workunit.client.1.smithi129.stdout:9/44: rmdir d0/da 0 2024-03-18T14:43:12.495 INFO:tasks.workunit.client.1.smithi129.stdout:9/45: chown d0/l2 15 1 2024-03-18T14:43:12.496 INFO:tasks.workunit.client.1.smithi129.stdout:1/20: mknod d1/d2/c8 0 2024-03-18T14:43:12.498 INFO:tasks.workunit.client.0.smithi087.stdout:3/293: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:12.501 INFO:tasks.workunit.client.1.smithi129.stdout:6/62: rename d3/d5/db/cc to d3/c10 0 2024-03-18T14:43:12.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/221: creat d1/d6/d2f/d44/d45/f4a x:0 0 0 2024-03-18T14:43:12.501 INFO:tasks.workunit.client.0.smithi087.stdout:8/222: readlink d1/d6/d14/l46 0 2024-03-18T14:43:12.501 INFO:tasks.workunit.client.0.smithi087.stdout:9/306: creat db/d18/d51/f5c x:0 0 0 2024-03-18T14:43:12.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/214: truncate d3/d1a/d29/f27 57183 0 2024-03-18T14:43:12.502 INFO:tasks.workunit.client.1.smithi129.stdout:0/69: link d0/cc d0/d14/c16 0 2024-03-18T14:43:12.502 INFO:tasks.workunit.client.1.smithi129.stdout:1/21: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:12.502 INFO:tasks.workunit.client.1.smithi129.stdout:0/70: readlink d0/l1 0 2024-03-18T14:43:12.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/276: link d3/f7 d3/d1d/d1f/d34/f53 0 2024-03-18T14:43:12.504 INFO:tasks.workunit.client.1.smithi129.stdout:2/12: sync 2024-03-18T14:43:12.505 INFO:tasks.workunit.client.0.smithi087.stdout:1/277: chown d3/d1d/d1f/l3b 23635 1 2024-03-18T14:43:12.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/211: fsync d0/dd/f15 0 2024-03-18T14:43:12.506 INFO:tasks.workunit.client.1.smithi129.stdout:3/26: truncate f0 769736 0 2024-03-18T14:43:12.507 INFO:tasks.workunit.client.0.smithi087.stdout:6/215: dwrite d3/d7/f24 [0,4194304] 0 2024-03-18T14:43:12.508 INFO:tasks.workunit.client.0.smithi087.stdout:5/267: rename d13/d1b/f25 to d13/f57 0 2024-03-18T14:43:12.510 INFO:tasks.workunit.client.0.smithi087.stdout:9/307: dwrite db/fd [0,4194304] 0 2024-03-18T14:43:12.510 INFO:tasks.workunit.client.1.smithi129.stdout:4/36: write d0/fd [927515,79131] 0 2024-03-18T14:43:12.511 INFO:tasks.workunit.client.0.smithi087.stdout:0/212: dread - d0/d2/d4/d27/d29/d26/f2c zero size 2024-03-18T14:43:12.511 INFO:tasks.workunit.client.1.smithi129.stdout:0/71: symlink d0/l17 0 2024-03-18T14:43:12.515 INFO:tasks.workunit.client.0.smithi087.stdout:4/186: write d2/f9 [116654,55622] 0 2024-03-18T14:43:12.516 INFO:tasks.workunit.client.1.smithi129.stdout:8/69: unlink c2 0 2024-03-18T14:43:12.516 INFO:tasks.workunit.client.1.smithi129.stdout:2/13: symlink l3 0 2024-03-18T14:43:12.518 INFO:tasks.workunit.client.1.smithi129.stdout:6/63: getdents d3/d6 0 2024-03-18T14:43:12.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/187: write d2/db/de/f2f [4109665,100200] 0 2024-03-18T14:43:12.520 INFO:tasks.workunit.client.0.smithi087.stdout:4/188: chown d2/f36 6867497 1 2024-03-18T14:43:12.521 INFO:tasks.workunit.client.0.smithi087.stdout:4/189: dread - d2/db/d24/f2b zero size 2024-03-18T14:43:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:2/218: dwrite d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:7/303: rename d1/d6/d29/d35 to d1/d6/d29/d2f/d48/d65 0 2024-03-18T14:43:12.523 INFO:tasks.workunit.client.0.smithi087.stdout:3/294: creat d0/d1c/f59 x:0 0 0 2024-03-18T14:43:12.525 INFO:tasks.workunit.client.0.smithi087.stdout:7/304: write d1/d6/da/f43 [101437,34193] 0 2024-03-18T14:43:12.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/305: readlink d1/d6/d29/d2f/d48/l55 0 2024-03-18T14:43:12.526 INFO:tasks.workunit.client.1.smithi129.stdout:4/37: rmdir d0/d9 39 2024-03-18T14:43:12.528 INFO:tasks.workunit.client.0.smithi087.stdout:1/278: mkdir d3/d1d/d1e/d43/d50/d54 0 2024-03-18T14:43:12.528 INFO:tasks.workunit.client.0.smithi087.stdout:2/219: dwrite d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:12.528 INFO:tasks.workunit.client.1.smithi129.stdout:0/72: rename d0/l12 to d0/l18 0 2024-03-18T14:43:12.529 INFO:tasks.workunit.client.1.smithi129.stdout:0/73: write d0/f11 [434531,122998] 0 2024-03-18T14:43:12.529 INFO:tasks.workunit.client.0.smithi087.stdout:1/279: fsync d3/d1d/d1e/f37 0 2024-03-18T14:43:12.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/223: truncate d1/d6/d14/f1f 80225 0 2024-03-18T14:43:12.529 INFO:tasks.workunit.client.0.smithi087.stdout:2/220: dread - d2/d4/d22/f39 zero size 2024-03-18T14:43:12.530 INFO:tasks.workunit.client.0.smithi087.stdout:4/190: dread d2/db/d24/f26 [0,4194304] 0 2024-03-18T14:43:12.530 INFO:tasks.workunit.client.1.smithi129.stdout:1/22: rename d1/d2/f6 to d1/f9 0 2024-03-18T14:43:12.530 INFO:tasks.workunit.client.1.smithi129.stdout:7/44: getdents d4/d7 0 2024-03-18T14:43:12.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/224: read - d1/d6/d2f/f31 zero size 2024-03-18T14:43:12.531 INFO:tasks.workunit.client.1.smithi129.stdout:9/46: truncate d0/fc 1047262 0 2024-03-18T14:43:12.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/213: rename d0/d2/d4/f12 to d0/d2/f4a 0 2024-03-18T14:43:12.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/70: creat d9/f15 x:0 0 0 2024-03-18T14:43:12.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/306: mkdir d1/d6/d29/d2f/d48/d65/d60/d66 0 2024-03-18T14:43:12.536 INFO:tasks.workunit.client.0.smithi087.stdout:7/307: fdatasync d1/d6/d29/d2f/f33 0 2024-03-18T14:43:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:7/308: chown d1/d6/d16/dc/l19 166095580 1 2024-03-18T14:43:12.537 INFO:tasks.workunit.client.0.smithi087.stdout:6/216: truncate d3/d1a/d29/d22/f3b 919077 0 2024-03-18T14:43:12.537 INFO:tasks.workunit.client.1.smithi129.stdout:8/71: dwrite f8 [0,4194304] 0 2024-03-18T14:43:12.539 INFO:tasks.workunit.client.1.smithi129.stdout:5/43: getdents d0 0 2024-03-18T14:43:12.540 INFO:tasks.workunit.client.1.smithi129.stdout:6/64: creat d3/d5/f11 x:0 0 0 2024-03-18T14:43:12.541 INFO:tasks.workunit.client.1.smithi129.stdout:4/38: unlink d0/lc 0 2024-03-18T14:43:12.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/65: write d3/d5/f9 [2540901,34177] 0 2024-03-18T14:43:12.542 INFO:tasks.workunit.client.1.smithi129.stdout:4/39: write d0/f5 [3309783,31299] 0 2024-03-18T14:43:12.543 INFO:tasks.workunit.client.0.smithi087.stdout:4/191: rmdir d2 39 2024-03-18T14:43:12.543 INFO:tasks.workunit.client.1.smithi129.stdout:0/74: mknod d0/c19 0 2024-03-18T14:43:12.544 INFO:tasks.workunit.client.1.smithi129.stdout:1/23: symlink d1/d2/la 0 2024-03-18T14:43:12.545 INFO:tasks.workunit.client.0.smithi087.stdout:8/225: fdatasync d1/d6/f2d 0 2024-03-18T14:43:12.546 INFO:tasks.workunit.client.1.smithi129.stdout:7/45: creat d4/fd x:0 0 0 2024-03-18T14:43:12.546 INFO:tasks.workunit.client.0.smithi087.stdout:8/226: chown d1/f2 1230379 1 2024-03-18T14:43:12.547 INFO:tasks.workunit.client.1.smithi129.stdout:5/44: dwrite d0/dc/fd [0,4194304] 0 2024-03-18T14:43:12.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/72: creat d9/d11/f16 x:0 0 0 2024-03-18T14:43:12.550 INFO:tasks.workunit.client.0.smithi087.stdout:0/214: creat d0/d2/d4/d27/d29/d26/f4b x:0 0 0 2024-03-18T14:43:12.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/215: dread d0/dd/f15 [0,4194304] 0 2024-03-18T14:43:12.555 INFO:tasks.workunit.client.1.smithi129.stdout:3/27: write f0 [1177712,31753] 0 2024-03-18T14:43:12.555 INFO:tasks.workunit.client.1.smithi129.stdout:3/28: stat c2 0 2024-03-18T14:43:12.556 INFO:tasks.workunit.client.1.smithi129.stdout:3/29: chown c3 91 1 2024-03-18T14:43:12.556 INFO:tasks.workunit.client.1.smithi129.stdout:3/30: chown c3 493 1 2024-03-18T14:43:12.556 INFO:tasks.workunit.client.1.smithi129.stdout:3/31: stat c2 0 2024-03-18T14:43:12.557 INFO:tasks.workunit.client.0.smithi087.stdout:9/308: truncate f8 6433981 0 2024-03-18T14:43:12.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/309: chown db/d18/d1c/f37 2245905 1 2024-03-18T14:43:12.561 INFO:tasks.workunit.client.1.smithi129.stdout:0/75: rename d0/l1 to d0/l1a 0 2024-03-18T14:43:12.562 INFO:tasks.workunit.client.1.smithi129.stdout:1/24: mknod d1/cb 0 2024-03-18T14:43:12.563 INFO:tasks.workunit.client.1.smithi129.stdout:9/47: creat d0/db/fd x:0 0 0 2024-03-18T14:43:12.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/217: mkdir d3/d1a/d29/d22/d23/d4f 0 2024-03-18T14:43:12.564 INFO:tasks.workunit.client.0.smithi087.stdout:6/218: write d3/f45 [578950,104985] 0 2024-03-18T14:43:12.564 INFO:tasks.workunit.client.1.smithi129.stdout:7/46: mknod d4/d7/ce 0 2024-03-18T14:43:12.566 INFO:tasks.workunit.client.1.smithi129.stdout:5/45: mknod d0/ce 0 2024-03-18T14:43:12.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/227: mkdir d1/d6/d2f/d44/d4b 0 2024-03-18T14:43:12.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/192: dwrite d2/d13/f34 [0,4194304] 0 2024-03-18T14:43:12.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/216: fsync d0/d2/d4/d19/f25 0 2024-03-18T14:43:12.569 INFO:tasks.workunit.client.1.smithi129.stdout:5/46: read - d0/f6 zero size 2024-03-18T14:43:12.569 INFO:tasks.workunit.client.1.smithi129.stdout:0/76: dread d0/fd [0,4194304] 0 2024-03-18T14:43:12.569 INFO:tasks.workunit.client.1.smithi129.stdout:3/32: dread f0 [0,4194304] 0 2024-03-18T14:43:12.569 INFO:tasks.workunit.client.0.smithi087.stdout:4/193: chown d2/db/d24 24190238 1 2024-03-18T14:43:12.570 INFO:tasks.workunit.client.1.smithi129.stdout:8/73: write d9/f15 [1028014,67538] 0 2024-03-18T14:43:12.570 INFO:tasks.workunit.client.1.smithi129.stdout:2/14: truncate f0 1105733 0 2024-03-18T14:43:12.571 INFO:tasks.workunit.client.1.smithi129.stdout:1/25: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:12.572 INFO:tasks.workunit.client.1.smithi129.stdout:0/77: dread d0/fd [0,4194304] 0 2024-03-18T14:43:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:9/310: symlink db/d31/l5d 0 2024-03-18T14:43:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:2/221: dread d2/d4/d22/d2c/f2e [0,4194304] 0 2024-03-18T14:43:12.573 INFO:tasks.workunit.client.0.smithi087.stdout:7/309: fsync d1/d6/d16/f4e 0 2024-03-18T14:43:12.576 INFO:tasks.workunit.client.0.smithi087.stdout:3/295: getdents d0/d3/df/d42 0 2024-03-18T14:43:12.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/40: symlink d0/d9/le 0 2024-03-18T14:43:12.576 INFO:tasks.workunit.client.1.smithi129.stdout:6/66: mknod d3/d5/db/de/c12 0 2024-03-18T14:43:12.577 INFO:tasks.workunit.client.0.smithi087.stdout:7/310: dread d1/d6/d16/f1e [0,4194304] 0 2024-03-18T14:43:12.579 INFO:tasks.workunit.client.0.smithi087.stdout:8/228: rename d1/d6/d14/f2e to d1/d6/d2f/d44/d4b/f4c 0 2024-03-18T14:43:12.579 INFO:tasks.workunit.client.1.smithi129.stdout:9/48: mkdir d0/db/de 0 2024-03-18T14:43:12.579 INFO:tasks.workunit.client.1.smithi129.stdout:9/49: read - d0/db/fd zero size 2024-03-18T14:43:12.581 INFO:tasks.workunit.client.1.smithi129.stdout:7/47: creat d4/d7/ff x:0 0 0 2024-03-18T14:43:12.581 INFO:tasks.workunit.client.0.smithi087.stdout:1/280: write d3/d1d/d1f/f2e [1296259,2395] 0 2024-03-18T14:43:12.582 INFO:tasks.workunit.client.1.smithi129.stdout:3/33: write f0 [360011,1719] 0 2024-03-18T14:43:12.583 INFO:tasks.workunit.client.1.smithi129.stdout:5/47: rmdir d0/dc 39 2024-03-18T14:43:12.584 INFO:tasks.workunit.client.1.smithi129.stdout:5/48: dread - d0/f6 zero size 2024-03-18T14:43:12.585 INFO:tasks.workunit.client.1.smithi129.stdout:5/49: dread - d0/f4 zero size 2024-03-18T14:43:12.585 INFO:tasks.workunit.client.1.smithi129.stdout:8/74: creat d9/d11/f17 x:0 0 0 2024-03-18T14:43:12.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/311: creat db/d12/f5e x:0 0 0 2024-03-18T14:43:12.587 INFO:tasks.workunit.client.1.smithi129.stdout:3/34: dwrite f0 [0,4194304] 0 2024-03-18T14:43:12.587 INFO:tasks.workunit.client.0.smithi087.stdout:2/222: chown d2/d4/f16 405 1 2024-03-18T14:43:12.588 INFO:tasks.workunit.client.1.smithi129.stdout:2/15: creat f4 x:0 0 0 2024-03-18T14:43:12.589 INFO:tasks.workunit.client.0.smithi087.stdout:6/219: getdents d3/d1a/d29/d22/d23/d4f 0 2024-03-18T14:43:12.589 INFO:tasks.workunit.client.1.smithi129.stdout:2/16: dread - f2 zero size 2024-03-18T14:43:12.589 INFO:tasks.workunit.client.1.smithi129.stdout:2/17: dread - f2 zero size 2024-03-18T14:43:12.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/18: chown f4 28 1 2024-03-18T14:43:12.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/19: write f4 [344319,43497] 0 2024-03-18T14:43:12.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/268: sync 2024-03-18T14:43:12.592 INFO:tasks.workunit.client.1.smithi129.stdout:9/50: mkdir d0/db/df 0 2024-03-18T14:43:12.592 INFO:tasks.workunit.client.1.smithi129.stdout:9/51: chown d0/f4 44174 1 2024-03-18T14:43:12.592 INFO:tasks.workunit.client.1.smithi129.stdout:7/48: creat d4/f10 x:0 0 0 2024-03-18T14:43:12.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/49: chown d4/f6 13335 1 2024-03-18T14:43:12.593 INFO:tasks.workunit.client.0.smithi087.stdout:7/311: mkdir d1/d6/da/d42/d67 0 2024-03-18T14:43:12.595 INFO:tasks.workunit.client.0.smithi087.stdout:0/217: dwrite d0/d1a/f20 [0,4194304] 0 2024-03-18T14:43:12.596 INFO:tasks.workunit.client.1.smithi129.stdout:5/50: fdatasync d0/f2 0 2024-03-18T14:43:12.597 INFO:tasks.workunit.client.1.smithi129.stdout:5/51: dread - d0/fb zero size 2024-03-18T14:43:12.600 INFO:tasks.workunit.client.0.smithi087.stdout:9/312: unlink db/d18/c57 0 2024-03-18T14:43:12.601 INFO:tasks.workunit.client.0.smithi087.stdout:2/223: mkdir d2/d4/d22/d2c/d3a/d40 0 2024-03-18T14:43:12.601 INFO:tasks.workunit.client.0.smithi087.stdout:2/224: fdatasync d2/f10 0 2024-03-18T14:43:12.602 INFO:tasks.workunit.client.1.smithi129.stdout:2/20: creat f5 x:0 0 0 2024-03-18T14:43:12.604 INFO:tasks.workunit.client.0.smithi087.stdout:6/220: rmdir d3/d1a/d29 39 2024-03-18T14:43:12.607 INFO:tasks.workunit.client.0.smithi087.stdout:8/229: dread d1/f2c [0,4194304] 0 2024-03-18T14:43:12.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/312: rename d1/d6/d29/d2f/d48 to d1/d6/d29/d2f/d68 0 2024-03-18T14:43:12.610 INFO:tasks.workunit.client.0.smithi087.stdout:3/296: dread d0/d1c/f1e [0,4194304] 0 2024-03-18T14:43:12.610 INFO:tasks.workunit.client.0.smithi087.stdout:0/218: creat d0/d2/d4/f4c x:0 0 0 2024-03-18T14:43:12.615 INFO:tasks.workunit.client.1.smithi129.stdout:0/78: truncate d0/fd 1447816 0 2024-03-18T14:43:12.615 INFO:tasks.workunit.client.1.smithi129.stdout:6/67: truncate d3/d5/fa 906982 0 2024-03-18T14:43:12.617 INFO:tasks.workunit.client.1.smithi129.stdout:7/50: creat d4/d7/d8/f11 x:0 0 0 2024-03-18T14:43:12.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/194: truncate d2/db/de/f2c 3209361 0 2024-03-18T14:43:12.618 INFO:tasks.workunit.client.1.smithi129.stdout:3/35: mkdir d4 0 2024-03-18T14:43:12.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/26: link l0 d1/d2/lc 0 2024-03-18T14:43:12.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/27: chown d1 2684 1 2024-03-18T14:43:12.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/313: symlink db/d18/d51/l5f 0 2024-03-18T14:43:12.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/195: dwrite d2/db/de/f2f [4194304,4194304] 0 2024-03-18T14:43:12.622 INFO:tasks.workunit.client.1.smithi129.stdout:3/36: dread f0 [0,4194304] 0 2024-03-18T14:43:12.622 INFO:tasks.workunit.client.1.smithi129.stdout:8/75: write f6 [686300,66939] 0 2024-03-18T14:43:12.624 INFO:tasks.workunit.client.0.smithi087.stdout:1/281: truncate d3/d1d/d1f/d34/f3e 228537 0 2024-03-18T14:43:12.624 INFO:tasks.workunit.client.0.smithi087.stdout:1/282: fsync d3/d1d/d1e/f4d 0 2024-03-18T14:43:12.625 INFO:tasks.workunit.client.0.smithi087.stdout:2/225: mknod d2/d4/d22/d2c/c41 0 2024-03-18T14:43:12.626 INFO:tasks.workunit.client.1.smithi129.stdout:9/52: truncate d0/fc 1219108 0 2024-03-18T14:43:12.627 INFO:tasks.workunit.client.0.smithi087.stdout:0/219: symlink d0/dd/l4d 0 2024-03-18T14:43:12.627 INFO:tasks.workunit.client.1.smithi129.stdout:7/51: truncate d4/f6 4675224 0 2024-03-18T14:43:12.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/314: mknod db/d12/c60 0 2024-03-18T14:43:12.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/53: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:12.629 INFO:tasks.workunit.client.1.smithi129.stdout:5/52: mkdir d0/df 0 2024-03-18T14:43:12.630 INFO:tasks.workunit.client.1.smithi129.stdout:5/53: read - d0/f9 zero size 2024-03-18T14:43:12.631 INFO:tasks.workunit.client.1.smithi129.stdout:3/37: rename c3 to d4/c5 0 2024-03-18T14:43:12.632 INFO:tasks.workunit.client.0.smithi087.stdout:2/226: rmdir d2/d4/d22/d24 39 2024-03-18T14:43:12.632 INFO:tasks.workunit.client.0.smithi087.stdout:7/313: symlink d1/d6/l69 0 2024-03-18T14:43:12.632 INFO:tasks.workunit.client.1.smithi129.stdout:0/79: mknod d0/d14/c1b 0 2024-03-18T14:43:12.633 INFO:tasks.workunit.client.1.smithi129.stdout:8/76: mkdir d9/d11/d18 0 2024-03-18T14:43:12.634 INFO:tasks.workunit.client.1.smithi129.stdout:2/21: chown f0 215242 1 2024-03-18T14:43:12.635 INFO:tasks.workunit.client.1.smithi129.stdout:4/41: link d0/d9/cb d0/cf 0 2024-03-18T14:43:12.635 INFO:tasks.workunit.client.0.smithi087.stdout:8/230: rename d1/c12 to d1/d6/d2f/d44/c4d 0 2024-03-18T14:43:12.636 INFO:tasks.workunit.client.0.smithi087.stdout:8/231: dread - d1/f32 zero size 2024-03-18T14:43:12.636 INFO:tasks.workunit.client.0.smithi087.stdout:8/232: write d1/d6/d2f/f31 [613031,37247] 0 2024-03-18T14:43:12.638 INFO:tasks.workunit.client.0.smithi087.stdout:0/220: mknod d0/d2/d4/d19/d24/c4e 0 2024-03-18T14:43:12.639 INFO:tasks.workunit.client.0.smithi087.stdout:9/315: mknod db/d18/d51/c61 0 2024-03-18T14:43:12.641 INFO:tasks.workunit.client.0.smithi087.stdout:2/227: creat d2/d4/d22/d2c/f42 x:0 0 0 2024-03-18T14:43:12.645 INFO:tasks.workunit.client.1.smithi129.stdout:5/54: fdatasync d0/f1 0 2024-03-18T14:43:12.646 INFO:tasks.workunit.client.1.smithi129.stdout:1/28: truncate d1/d2/f3 1900348 0 2024-03-18T14:43:12.646 INFO:tasks.workunit.client.1.smithi129.stdout:3/38: rmdir d4 39 2024-03-18T14:43:12.646 INFO:tasks.workunit.client.1.smithi129.stdout:0/80: symlink d0/d14/l1c 0 2024-03-18T14:43:12.647 INFO:tasks.workunit.client.1.smithi129.stdout:2/22: mknod c6 0 2024-03-18T14:43:12.647 INFO:tasks.workunit.client.0.smithi087.stdout:4/196: write d2/db/d24/d30/f3a [2351209,19388] 0 2024-03-18T14:43:12.648 INFO:tasks.workunit.client.1.smithi129.stdout:5/55: write d0/fb [516795,62604] 0 2024-03-18T14:43:12.648 INFO:tasks.workunit.client.1.smithi129.stdout:8/77: chown f4 856 1 2024-03-18T14:43:12.649 INFO:tasks.workunit.client.1.smithi129.stdout:2/23: chown f4 823478 1 2024-03-18T14:43:12.649 INFO:tasks.workunit.client.0.smithi087.stdout:3/297: link d0/d3/df/l2f d0/d3/d4f/l5a 0 2024-03-18T14:43:12.650 INFO:tasks.workunit.client.0.smithi087.stdout:3/298: chown d0/d3/df/d42 4159920 1 2024-03-18T14:43:12.650 INFO:tasks.workunit.client.1.smithi129.stdout:8/78: chown d9/ca 112051488 1 2024-03-18T14:43:12.650 INFO:tasks.workunit.client.1.smithi129.stdout:4/42: dwrite d0/f8 [0,4194304] 0 2024-03-18T14:43:12.650 INFO:tasks.workunit.client.1.smithi129.stdout:5/56: read - d0/f4 zero size 2024-03-18T14:43:12.651 INFO:tasks.workunit.client.1.smithi129.stdout:9/54: rmdir d0/db/df 0 2024-03-18T14:43:12.651 INFO:tasks.workunit.client.0.smithi087.stdout:3/299: read d0/f1 [2365356,63211] 0 2024-03-18T14:43:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:8/233: dread d1/d6/f1e [0,4194304] 0 2024-03-18T14:43:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/221: chown d0/f3 1028524 1 2024-03-18T14:43:12.652 INFO:tasks.workunit.client.1.smithi129.stdout:4/43: write d0/f8 [4055059,95044] 0 2024-03-18T14:43:12.652 INFO:tasks.workunit.client.0.smithi087.stdout:9/316: chown db/d12/c1f 18416267 1 2024-03-18T14:43:12.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/314: dwrite d1/d6/da/d59/f5d [4194304,4194304] 0 2024-03-18T14:43:12.653 INFO:tasks.workunit.client.0.smithi087.stdout:1/283: creat d3/d1d/d1e/f55 x:0 0 0 2024-03-18T14:43:12.654 INFO:tasks.workunit.client.0.smithi087.stdout:8/234: stat d1/d6/d9/f13 0 2024-03-18T14:43:12.654 INFO:tasks.workunit.client.1.smithi129.stdout:4/44: write d0/f5 [1907252,89152] 0 2024-03-18T14:43:12.654 INFO:tasks.workunit.client.1.smithi129.stdout:0/81: dread d0/f11 [0,4194304] 0 2024-03-18T14:43:12.655 INFO:tasks.workunit.client.0.smithi087.stdout:2/228: unlink d2/c26 0 2024-03-18T14:43:12.655 INFO:tasks.workunit.client.0.smithi087.stdout:8/235: fsync d1/d6/d2f/f30 0 2024-03-18T14:43:12.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/39: dread f0 [0,4194304] 0 2024-03-18T14:43:12.657 INFO:tasks.workunit.client.1.smithi129.stdout:6/68: dread d3/d5/fa [0,4194304] 0 2024-03-18T14:43:12.658 INFO:tasks.workunit.client.0.smithi087.stdout:6/221: rmdir d3/d1a/d29/d22/d23/d4f 0 2024-03-18T14:43:12.658 INFO:tasks.workunit.client.0.smithi087.stdout:5/269: sync 2024-03-18T14:43:12.659 INFO:tasks.workunit.client.0.smithi087.stdout:6/222: write d3/f6 [3284356,64731] 0 2024-03-18T14:43:12.659 INFO:tasks.workunit.client.0.smithi087.stdout:8/236: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:12.660 INFO:tasks.workunit.client.1.smithi129.stdout:8/79: dwrite f6 [0,4194304] 0 2024-03-18T14:43:12.660 INFO:tasks.workunit.client.1.smithi129.stdout:9/55: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:12.661 INFO:tasks.workunit.client.0.smithi087.stdout:0/222: symlink d0/d2/d4/d19/d24/l4f 0 2024-03-18T14:43:12.662 INFO:tasks.workunit.client.1.smithi129.stdout:4/45: mknod d0/d9/c10 0 2024-03-18T14:43:12.663 INFO:tasks.workunit.client.1.smithi129.stdout:0/82: dwrite d0/ff [0,4194304] 0 2024-03-18T14:43:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:7/315: mknod d1/d6/da/d59/c6a 0 2024-03-18T14:43:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:8/237: dwrite d1/d6/d9/f48 [0,4194304] 0 2024-03-18T14:43:12.664 INFO:tasks.workunit.client.0.smithi087.stdout:1/284: creat d3/d1d/d1e/d20/f56 x:0 0 0 2024-03-18T14:43:12.665 INFO:tasks.workunit.client.0.smithi087.stdout:2/229: creat d2/f43 x:0 0 0 2024-03-18T14:43:12.666 INFO:tasks.workunit.client.1.smithi129.stdout:8/80: creat d9/dd/f19 x:0 0 0 2024-03-18T14:43:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/230: dread - d2/f32 zero size 2024-03-18T14:43:12.667 INFO:tasks.workunit.client.1.smithi129.stdout:2/24: truncate f2 107193 0 2024-03-18T14:43:12.667 INFO:tasks.workunit.client.0.smithi087.stdout:6/223: dread d3/d1a/d29/d22/d23/f30 [0,4194304] 0 2024-03-18T14:43:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:2/231: chown d2/d4/d22/d2c/c41 29 1 2024-03-18T14:43:12.668 INFO:tasks.workunit.client.0.smithi087.stdout:5/270: mknod d13/d1b/d30/c58 0 2024-03-18T14:43:12.669 INFO:tasks.workunit.client.0.smithi087.stdout:9/317: mknod db/c62 0 2024-03-18T14:43:12.670 INFO:tasks.workunit.client.0.smithi087.stdout:9/318: dread - db/d18/d1c/f40 zero size 2024-03-18T14:43:12.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/40: rename f0 to d4/f6 0 2024-03-18T14:43:12.672 INFO:tasks.workunit.client.1.smithi129.stdout:4/46: mknod d0/d9/c11 0 2024-03-18T14:43:12.674 INFO:tasks.workunit.client.0.smithi087.stdout:9/319: dwrite db/d18/d3a/f59 [0,4194304] 0 2024-03-18T14:43:12.674 INFO:tasks.workunit.client.0.smithi087.stdout:8/238: truncate d1/d6/d14/f15 601132 0 2024-03-18T14:43:12.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/271: chown l7 15798446 1 2024-03-18T14:43:12.676 INFO:tasks.workunit.client.1.smithi129.stdout:3/41: dread d4/f6 [0,4194304] 0 2024-03-18T14:43:12.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/232: mkdir d2/d44 0 2024-03-18T14:43:12.677 INFO:tasks.workunit.client.1.smithi129.stdout:2/25: mkdir d7 0 2024-03-18T14:43:12.677 INFO:tasks.workunit.client.1.smithi129.stdout:2/26: dread - f5 zero size 2024-03-18T14:43:12.680 INFO:tasks.workunit.client.1.smithi129.stdout:6/69: truncate d3/d5/f11 489343 0 2024-03-18T14:43:12.681 INFO:tasks.workunit.client.0.smithi087.stdout:9/320: fdatasync db/d18/d1e/f46 0 2024-03-18T14:43:12.682 INFO:tasks.workunit.client.0.smithi087.stdout:5/272: write d13/d1b/d27/d35/f4f [777740,82242] 0 2024-03-18T14:43:12.683 INFO:tasks.workunit.client.1.smithi129.stdout:9/56: dread d0/fc [0,4194304] 0 2024-03-18T14:43:12.685 INFO:tasks.workunit.client.0.smithi087.stdout:0/223: creat d0/f50 x:0 0 0 2024-03-18T14:43:12.685 INFO:tasks.workunit.client.0.smithi087.stdout:5/273: fsync f12 0 2024-03-18T14:43:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:6/224: link d3/d1a/c37 d3/d1a/d29/d22/d47/c50 0 2024-03-18T14:43:12.686 INFO:tasks.workunit.client.0.smithi087.stdout:6/225: readlink d3/d1a/d29/ld 0 2024-03-18T14:43:12.689 INFO:tasks.workunit.client.0.smithi087.stdout:5/274: dread d13/d1b/d27/f2d [0,4194304] 0 2024-03-18T14:43:12.690 INFO:tasks.workunit.client.0.smithi087.stdout:6/226: dwrite d3/d1a/f1e [0,4194304] 0 2024-03-18T14:43:12.691 INFO:tasks.workunit.client.1.smithi129.stdout:4/47: symlink d0/l12 0 2024-03-18T14:43:12.691 INFO:tasks.workunit.client.1.smithi129.stdout:2/27: getdents d7 0 2024-03-18T14:43:12.692 INFO:tasks.workunit.client.0.smithi087.stdout:8/239: fsync d1/f1b 0 2024-03-18T14:43:12.694 INFO:tasks.workunit.client.1.smithi129.stdout:6/70: link d3/d5/f9 d3/d5/f13 0 2024-03-18T14:43:12.695 INFO:tasks.workunit.client.1.smithi129.stdout:4/48: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:12.695 INFO:tasks.workunit.client.0.smithi087.stdout:0/224: rmdir d0/d2/d4/d27 39 2024-03-18T14:43:12.695 INFO:tasks.workunit.client.0.smithi087.stdout:6/227: dwrite d3/d1a/d29/d22/d47/f4b [0,4194304] 0 2024-03-18T14:43:12.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/197: dread f1 [0,4194304] 0 2024-03-18T14:43:12.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/198: stat d2/db/d24/f33 0 2024-03-18T14:43:12.700 INFO:tasks.workunit.client.1.smithi129.stdout:4/49: dwrite d0/f8 [4194304,4194304] 0 2024-03-18T14:43:12.700 INFO:tasks.workunit.client.1.smithi129.stdout:3/42: link d4/c5 d4/c7 0 2024-03-18T14:43:12.702 INFO:tasks.workunit.client.1.smithi129.stdout:2/28: symlink d7/l8 0 2024-03-18T14:43:12.703 INFO:tasks.workunit.client.1.smithi129.stdout:7/52: sync 2024-03-18T14:43:12.704 INFO:tasks.workunit.client.1.smithi129.stdout:6/71: creat d3/d5/db/df/f14 x:0 0 0 2024-03-18T14:43:12.704 INFO:tasks.workunit.client.0.smithi087.stdout:8/240: dread d1/d6/d2f/f31 [0,4194304] 0 2024-03-18T14:43:12.706 INFO:tasks.workunit.client.0.smithi087.stdout:8/241: chown d1/d6/d9/f17 60112643 1 2024-03-18T14:43:12.706 INFO:tasks.workunit.client.0.smithi087.stdout:4/199: dread d2/db/de/f2c [0,4194304] 0 2024-03-18T14:43:12.707 INFO:tasks.workunit.client.0.smithi087.stdout:4/200: write d2/d13/f3f [4662015,4698] 0 2024-03-18T14:43:12.712 INFO:tasks.workunit.client.0.smithi087.stdout:3/300: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:12.712 INFO:tasks.workunit.client.1.smithi129.stdout:0/83: write d0/fd [1548695,24634] 0 2024-03-18T14:43:12.712 INFO:tasks.workunit.client.1.smithi129.stdout:4/50: rmdir d0 39 2024-03-18T14:43:12.712 INFO:tasks.workunit.client.1.smithi129.stdout:9/57: write d0/fc [29088,35061] 0 2024-03-18T14:43:12.715 INFO:tasks.workunit.client.0.smithi087.stdout:1/285: truncate d3/d1d/d1f/f2e 20203 0 2024-03-18T14:43:12.715 INFO:tasks.workunit.client.0.smithi087.stdout:2/233: write d2/d4/f1a [3082144,20353] 0 2024-03-18T14:43:12.716 INFO:tasks.workunit.client.0.smithi087.stdout:1/286: fsync d3/d1d/d1f/d34/f35 0 2024-03-18T14:43:12.717 INFO:tasks.workunit.client.1.smithi129.stdout:3/43: mknod d4/c8 0 2024-03-18T14:43:12.717 INFO:tasks.workunit.client.1.smithi129.stdout:0/84: dwrite d0/ff [4194304,4194304] 0 2024-03-18T14:43:12.717 INFO:tasks.workunit.client.1.smithi129.stdout:8/81: rename d9/dd to d9/d11/d1a 0 2024-03-18T14:43:12.718 INFO:tasks.workunit.client.1.smithi129.stdout:6/72: mknod d3/d6/c15 0 2024-03-18T14:43:12.718 INFO:tasks.workunit.client.1.smithi129.stdout:8/82: dread - d9/d11/d1a/fe zero size 2024-03-18T14:43:12.719 INFO:tasks.workunit.client.0.smithi087.stdout:5/275: creat d13/d1b/f59 x:0 0 0 2024-03-18T14:43:12.719 INFO:tasks.workunit.client.1.smithi129.stdout:8/83: write d9/d11/d1a/f19 [382969,39229] 0 2024-03-18T14:43:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:5/276: dwrite d13/d1b/d30/f52 [0,4194304] 0 2024-03-18T14:43:12.722 INFO:tasks.workunit.client.0.smithi087.stdout:8/242: rmdir d1/d6/d14 39 2024-03-18T14:43:12.723 INFO:tasks.workunit.client.0.smithi087.stdout:8/243: fsync d1/d6/d9/f40 0 2024-03-18T14:43:12.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/201: creat d2/d13/d28/f40 x:0 0 0 2024-03-18T14:43:12.726 INFO:tasks.workunit.client.0.smithi087.stdout:0/225: sync 2024-03-18T14:43:12.726 INFO:tasks.workunit.client.0.smithi087.stdout:9/321: sync 2024-03-18T14:43:12.727 INFO:tasks.workunit.client.1.smithi129.stdout:3/44: creat d4/f9 x:0 0 0 2024-03-18T14:43:12.727 INFO:tasks.workunit.client.1.smithi129.stdout:6/73: mknod d3/d5/c16 0 2024-03-18T14:43:12.727 INFO:tasks.workunit.client.1.smithi129.stdout:9/58: getdents d0/db/de 0 2024-03-18T14:43:12.727 INFO:tasks.workunit.client.1.smithi129.stdout:3/45: stat d4/c8 0 2024-03-18T14:43:12.727 INFO:tasks.workunit.client.0.smithi087.stdout:4/202: write d2/d13/d28/f2d [4606844,120560] 0 2024-03-18T14:43:12.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/84: creat d9/f1b x:0 0 0 2024-03-18T14:43:12.728 INFO:tasks.workunit.client.1.smithi129.stdout:7/53: truncate d4/fd 573503 0 2024-03-18T14:43:12.728 INFO:tasks.workunit.client.1.smithi129.stdout:7/54: dread - d4/f5 zero size 2024-03-18T14:43:12.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/203: chown d2/db/de/f2f 29 1 2024-03-18T14:43:12.729 INFO:tasks.workunit.client.0.smithi087.stdout:7/316: dread d1/d6/da/f25 [0,4194304] 0 2024-03-18T14:43:12.729 INFO:tasks.workunit.client.1.smithi129.stdout:1/29: sync 2024-03-18T14:43:12.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/277: creat d13/d1b/d27/d28/f5a x:0 0 0 2024-03-18T14:43:12.731 INFO:tasks.workunit.client.1.smithi129.stdout:9/59: creat d0/f10 x:0 0 0 2024-03-18T14:43:12.731 INFO:tasks.workunit.client.0.smithi087.stdout:5/278: chown d13/d1b/d27/d35/l56 1991 1 2024-03-18T14:43:12.732 INFO:tasks.workunit.client.1.smithi129.stdout:9/60: write d0/fc [624800,105224] 0 2024-03-18T14:43:12.732 INFO:tasks.workunit.client.0.smithi087.stdout:0/226: dwrite d0/d1a/d34/d3d/f3e [0,4194304] 0 2024-03-18T14:43:12.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/74: mknod d3/d5/db/de/c17 0 2024-03-18T14:43:12.733 INFO:tasks.workunit.client.1.smithi129.stdout:3/46: creat d4/fa x:0 0 0 2024-03-18T14:43:12.736 INFO:tasks.workunit.client.0.smithi087.stdout:2/234: creat d2/d44/f45 x:0 0 0 2024-03-18T14:43:12.737 INFO:tasks.workunit.client.1.smithi129.stdout:1/30: mknod d1/d2/cd 0 2024-03-18T14:43:12.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/322: creat db/d18/d3a/f63 x:0 0 0 2024-03-18T14:43:12.737 INFO:tasks.workunit.client.1.smithi129.stdout:9/61: dwrite d0/db/fd [0,4194304] 0 2024-03-18T14:43:12.739 INFO:tasks.workunit.client.1.smithi129.stdout:8/85: symlink d9/d11/d18/l1c 0 2024-03-18T14:43:12.739 INFO:tasks.workunit.client.0.smithi087.stdout:1/287: unlink d3/d1d/d1e/d20/f40 0 2024-03-18T14:43:12.740 INFO:tasks.workunit.client.1.smithi129.stdout:8/86: read - d9/d11/d1a/fe zero size 2024-03-18T14:43:12.740 INFO:tasks.workunit.client.1.smithi129.stdout:7/55: dread d4/f6 [0,4194304] 0 2024-03-18T14:43:12.741 INFO:tasks.workunit.client.1.smithi129.stdout:0/85: getdents d0 0 2024-03-18T14:43:12.742 INFO:tasks.workunit.client.1.smithi129.stdout:3/47: write d4/f6 [4857072,68454] 0 2024-03-18T14:43:12.744 INFO:tasks.workunit.client.0.smithi087.stdout:7/317: mkdir d1/d6/d29/d2f/d6b 0 2024-03-18T14:43:12.744 INFO:tasks.workunit.client.1.smithi129.stdout:9/62: mkdir d0/db/d11 0 2024-03-18T14:43:12.747 INFO:tasks.workunit.client.0.smithi087.stdout:5/279: creat d13/d1b/d30/f5b x:0 0 0 2024-03-18T14:43:12.747 INFO:tasks.workunit.client.0.smithi087.stdout:9/323: dread db/fc [0,4194304] 0 2024-03-18T14:43:12.747 INFO:tasks.workunit.client.1.smithi129.stdout:8/87: creat d9/f1d x:0 0 0 2024-03-18T14:43:12.747 INFO:tasks.workunit.client.1.smithi129.stdout:3/48: dwrite d4/f6 [0,4194304] 0 2024-03-18T14:43:12.748 INFO:tasks.workunit.client.1.smithi129.stdout:0/86: symlink d0/d14/l1d 0 2024-03-18T14:43:12.748 INFO:tasks.workunit.client.0.smithi087.stdout:5/280: write d13/d1b/d27/d28/f54 [101325,20761] 0 2024-03-18T14:43:12.748 INFO:tasks.workunit.client.1.smithi129.stdout:0/87: write d0/fb [4810647,79181] 0 2024-03-18T14:43:12.749 INFO:tasks.workunit.client.0.smithi087.stdout:3/301: truncate d0/f52 523185 0 2024-03-18T14:43:12.749 INFO:tasks.workunit.client.1.smithi129.stdout:0/88: write d0/fb [617875,122332] 0 2024-03-18T14:43:12.749 INFO:tasks.workunit.client.1.smithi129.stdout:0/89: stat d0/l17 0 2024-03-18T14:43:12.750 INFO:tasks.workunit.client.0.smithi087.stdout:3/302: write d0/d1c/f59 [511897,115307] 0 2024-03-18T14:43:12.751 INFO:tasks.workunit.client.1.smithi129.stdout:6/75: link d3/d5/fa d3/d6/f18 0 2024-03-18T14:43:12.751 INFO:tasks.workunit.client.1.smithi129.stdout:6/76: rename d3 to d3/d19 22 2024-03-18T14:43:12.754 INFO:tasks.workunit.client.0.smithi087.stdout:4/204: fdatasync d2/d13/d28/f2d 0 2024-03-18T14:43:12.754 INFO:tasks.workunit.client.0.smithi087.stdout:1/288: symlink d3/d1d/d1f/l57 0 2024-03-18T14:43:12.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/289: readlink d3/d1d/d1f/l3b 0 2024-03-18T14:43:12.759 INFO:tasks.workunit.client.0.smithi087.stdout:9/324: creat db/d18/d51/f64 x:0 0 0 2024-03-18T14:43:12.759 INFO:tasks.workunit.client.1.smithi129.stdout:8/88: symlink d9/l1e 0 2024-03-18T14:43:12.759 INFO:tasks.workunit.client.1.smithi129.stdout:3/49: creat d4/fb x:0 0 0 2024-03-18T14:43:12.759 INFO:tasks.workunit.client.1.smithi129.stdout:0/90: rename d0/ff to d0/f1e 0 2024-03-18T14:43:12.760 INFO:tasks.workunit.client.1.smithi129.stdout:3/50: dread - d4/fb zero size 2024-03-18T14:43:12.760 INFO:tasks.workunit.client.1.smithi129.stdout:6/77: fdatasync d3/d5/f13 0 2024-03-18T14:43:12.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/244: dread d1/d6/d14/f2a [0,4194304] 0 2024-03-18T14:43:12.761 INFO:tasks.workunit.client.1.smithi129.stdout:3/51: chown d4/fb 39 1 2024-03-18T14:43:12.761 INFO:tasks.workunit.client.1.smithi129.stdout:7/56: truncate d4/d7/d8/f11 758197 0 2024-03-18T14:43:12.762 INFO:tasks.workunit.client.1.smithi129.stdout:7/57: write d4/f10 [446221,96083] 0 2024-03-18T14:43:12.764 INFO:tasks.workunit.client.1.smithi129.stdout:8/89: readlink d9/d11/l12 0 2024-03-18T14:43:12.764 INFO:tasks.workunit.client.0.smithi087.stdout:4/205: mknod d2/db/de/c41 0 2024-03-18T14:43:12.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/228: write d3/d1a/d29/d22/f3b [1558505,14007] 0 2024-03-18T14:43:12.766 INFO:tasks.workunit.client.1.smithi129.stdout:8/90: dread - d9/d11/d1a/fe zero size 2024-03-18T14:43:12.767 INFO:tasks.workunit.client.1.smithi129.stdout:0/91: dwrite d0/fb [4194304,4194304] 0 2024-03-18T14:43:12.767 INFO:tasks.workunit.client.0.smithi087.stdout:0/227: link d0/d2/d4/c2d d0/dd/c51 0 2024-03-18T14:43:12.768 INFO:tasks.workunit.client.1.smithi129.stdout:0/92: chown d0/c6 3 1 2024-03-18T14:43:12.769 INFO:tasks.workunit.client.1.smithi129.stdout:8/91: write d9/d11/f17 [18890,117484] 0 2024-03-18T14:43:12.770 INFO:tasks.workunit.client.1.smithi129.stdout:7/58: dwrite d4/f10 [0,4194304] 0 2024-03-18T14:43:12.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/325: creat db/d31/f65 x:0 0 0 2024-03-18T14:43:12.771 INFO:tasks.workunit.client.1.smithi129.stdout:8/92: write d9/d11/d1a/fe [993889,125305] 0 2024-03-18T14:43:12.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/235: creat d2/d4/f46 x:0 0 0 2024-03-18T14:43:12.775 INFO:tasks.workunit.client.0.smithi087.stdout:1/290: link d3/d1d/f21 d3/d1d/d1e/d43/d50/f58 0 2024-03-18T14:43:12.776 INFO:tasks.workunit.client.1.smithi129.stdout:4/51: truncate d0/fd 1883192 0 2024-03-18T14:43:12.777 INFO:tasks.workunit.client.1.smithi129.stdout:8/93: dwrite d9/f15 [0,4194304] 0 2024-03-18T14:43:12.778 INFO:tasks.workunit.client.0.smithi087.stdout:2/236: dwrite d2/d44/f45 [0,4194304] 0 2024-03-18T14:43:12.778 INFO:tasks.workunit.client.1.smithi129.stdout:5/57: sync 2024-03-18T14:43:12.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/281: creat d13/d1b/f5c x:0 0 0 2024-03-18T14:43:12.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/237: chown d2/d4/f34 1 1 2024-03-18T14:43:12.779 INFO:tasks.workunit.client.1.smithi129.stdout:5/58: dread - d0/f4 zero size 2024-03-18T14:43:12.779 INFO:tasks.workunit.client.0.smithi087.stdout:9/326: creat db/d31/f66 x:0 0 0 2024-03-18T14:43:12.780 INFO:tasks.workunit.client.1.smithi129.stdout:5/59: chown d0/fb 2364 1 2024-03-18T14:43:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/327: chown db/d18/d1e/d28/f52 0 1 2024-03-18T14:43:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/245: symlink d1/d6/l4e 0 2024-03-18T14:43:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/328: chown db/d18 904572450 1 2024-03-18T14:43:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:5/282: read d13/d1b/d27/d35/f4f [3466057,461] 0 2024-03-18T14:43:12.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/329: fsync db/d18/d1e/d28/f52 0 2024-03-18T14:43:12.782 INFO:tasks.workunit.client.0.smithi087.stdout:3/303: creat d0/d1c/f5b x:0 0 0 2024-03-18T14:43:12.782 INFO:tasks.workunit.client.1.smithi129.stdout:1/31: write d1/d2/f3 [894905,126918] 0 2024-03-18T14:43:12.782 INFO:tasks.workunit.client.0.smithi087.stdout:7/318: rmdir d1/d6/d29 39 2024-03-18T14:43:12.783 INFO:tasks.workunit.client.1.smithi129.stdout:8/94: dwrite d9/f1b [0,4194304] 0 2024-03-18T14:43:12.784 INFO:tasks.workunit.client.1.smithi129.stdout:1/32: fdatasync d1/d2/f5 0 2024-03-18T14:43:12.784 INFO:tasks.workunit.client.1.smithi129.stdout:8/95: chown d9/d11/f17 60498 1 2024-03-18T14:43:12.785 INFO:tasks.workunit.client.1.smithi129.stdout:1/33: write d1/d2/f5 [287066,61049] 0 2024-03-18T14:43:12.786 INFO:tasks.workunit.client.1.smithi129.stdout:2/29: read f2 [100825,20289] 0 2024-03-18T14:43:12.786 INFO:tasks.workunit.client.1.smithi129.stdout:1/34: write d1/d2/f3 [1963766,111739] 0 2024-03-18T14:43:12.787 INFO:tasks.workunit.client.1.smithi129.stdout:2/30: chown f5 61254 1 2024-03-18T14:43:12.787 INFO:tasks.workunit.client.1.smithi129.stdout:1/35: dread - d1/f7 zero size 2024-03-18T14:43:12.787 INFO:tasks.workunit.client.1.smithi129.stdout:0/93: fsync d0/f11 0 2024-03-18T14:43:12.787 INFO:tasks.workunit.client.1.smithi129.stdout:2/31: chown c1 516 1 2024-03-18T14:43:12.788 INFO:tasks.workunit.client.1.smithi129.stdout:7/59: fdatasync d4/f5 0 2024-03-18T14:43:12.788 INFO:tasks.workunit.client.1.smithi129.stdout:0/94: readlink d0/l1a 0 2024-03-18T14:43:12.789 INFO:tasks.workunit.client.0.smithi087.stdout:6/229: mknod d3/d1a/d29/c51 0 2024-03-18T14:43:12.789 INFO:tasks.workunit.client.0.smithi087.stdout:6/230: chown d3/d7/le 2808 1 2024-03-18T14:43:12.792 INFO:tasks.workunit.client.0.smithi087.stdout:2/238: mknod d2/d4/d22/d2c/c47 0 2024-03-18T14:43:12.793 INFO:tasks.workunit.client.1.smithi129.stdout:2/32: dwrite f4 [0,4194304] 0 2024-03-18T14:43:12.796 INFO:tasks.workunit.client.1.smithi129.stdout:3/52: truncate d4/fa 16048 0 2024-03-18T14:43:12.802 INFO:tasks.workunit.client.1.smithi129.stdout:7/60: mkdir d4/d7/d8/d12 0 2024-03-18T14:43:12.805 INFO:tasks.workunit.client.1.smithi129.stdout:9/63: sync 2024-03-18T14:43:12.806 INFO:tasks.workunit.client.1.smithi129.stdout:5/60: symlink d0/df/l10 0 2024-03-18T14:43:12.806 INFO:tasks.workunit.client.1.smithi129.stdout:5/61: chown d0/f1 250 1 2024-03-18T14:43:12.808 INFO:tasks.workunit.client.1.smithi129.stdout:8/96: link f4 d9/f1f 0 2024-03-18T14:43:12.809 INFO:tasks.workunit.client.1.smithi129.stdout:3/53: creat d4/fc x:0 0 0 2024-03-18T14:43:12.810 INFO:tasks.workunit.client.1.smithi129.stdout:1/36: truncate d1/f9 1187089 0 2024-03-18T14:43:12.810 INFO:tasks.workunit.client.1.smithi129.stdout:1/37: write d1/f7 [625093,115203] 0 2024-03-18T14:43:12.811 INFO:tasks.workunit.client.1.smithi129.stdout:1/38: chown d1 61327 1 2024-03-18T14:43:12.813 INFO:tasks.workunit.client.1.smithi129.stdout:7/61: symlink d4/d7/l13 0 2024-03-18T14:43:12.813 INFO:tasks.workunit.client.1.smithi129.stdout:9/64: read d0/f4 [729883,42807] 0 2024-03-18T14:43:12.816 INFO:tasks.workunit.client.1.smithi129.stdout:5/62: write d0/dc/fd [4013760,88162] 0 2024-03-18T14:43:12.818 INFO:tasks.workunit.client.1.smithi129.stdout:1/39: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:12.820 INFO:tasks.workunit.client.1.smithi129.stdout:0/95: link d0/l1a d0/d14/l1f 0 2024-03-18T14:43:12.821 INFO:tasks.workunit.client.1.smithi129.stdout:2/33: write f0 [1030648,54136] 0 2024-03-18T14:43:12.821 INFO:tasks.workunit.client.1.smithi129.stdout:4/52: truncate d0/f5 1599744 0 2024-03-18T14:43:12.822 INFO:tasks.workunit.client.1.smithi129.stdout:7/62: truncate f3 4784493 0 2024-03-18T14:43:12.823 INFO:tasks.workunit.client.1.smithi129.stdout:5/63: dwrite d0/f9 [0,4194304] 0 2024-03-18T14:43:12.825 INFO:tasks.workunit.client.0.smithi087.stdout:1/291: link d3/d1d/d1e/f36 d3/d1d/d45/f59 0 2024-03-18T14:43:12.825 INFO:tasks.workunit.client.0.smithi087.stdout:2/239: unlink d2/d4/d22/d2c/f42 0 2024-03-18T14:43:12.826 INFO:tasks.workunit.client.0.smithi087.stdout:8/246: unlink d1/d6/d2f/l35 0 2024-03-18T14:43:12.826 INFO:tasks.workunit.client.1.smithi129.stdout:9/65: creat d0/db/f12 x:0 0 0 2024-03-18T14:43:12.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/231: mknod d3/c52 0 2024-03-18T14:43:12.830 INFO:tasks.workunit.client.1.smithi129.stdout:5/64: dread d0/fb [0,4194304] 0 2024-03-18T14:43:12.831 INFO:tasks.workunit.client.1.smithi129.stdout:5/65: readlink d0/df/l10 0 2024-03-18T14:43:12.832 INFO:tasks.workunit.client.0.smithi087.stdout:6/232: dwrite d3/d7/f2e [0,4194304] 0 2024-03-18T14:43:12.832 INFO:tasks.workunit.client.0.smithi087.stdout:8/247: dread d1/d6/d14/f1f [0,4194304] 0 2024-03-18T14:43:12.834 INFO:tasks.workunit.client.0.smithi087.stdout:9/330: getdents db/d31 0 2024-03-18T14:43:12.836 INFO:tasks.workunit.client.1.smithi129.stdout:8/97: creat d9/dc/f20 x:0 0 0 2024-03-18T14:43:12.836 INFO:tasks.workunit.client.1.smithi129.stdout:6/78: truncate d3/d5/f11 848538 0 2024-03-18T14:43:12.837 INFO:tasks.workunit.client.0.smithi087.stdout:6/233: dwrite d3/d1a/f1e [0,4194304] 0 2024-03-18T14:43:12.840 INFO:tasks.workunit.client.1.smithi129.stdout:0/96: creat d0/d14/f20 x:0 0 0 2024-03-18T14:43:12.841 INFO:tasks.workunit.client.1.smithi129.stdout:2/34: symlink d7/l9 0 2024-03-18T14:43:12.841 INFO:tasks.workunit.client.1.smithi129.stdout:0/97: write d0/d14/f20 [330629,62541] 0 2024-03-18T14:43:12.842 INFO:tasks.workunit.client.0.smithi087.stdout:2/240: write d2/d4/f16 [3119001,87157] 0 2024-03-18T14:43:12.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/228: sync 2024-03-18T14:43:12.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/206: sync 2024-03-18T14:43:12.842 INFO:tasks.workunit.client.1.smithi129.stdout:4/53: rmdir d0/d9 39 2024-03-18T14:43:12.842 INFO:tasks.workunit.client.1.smithi129.stdout:2/35: dread - f5 zero size 2024-03-18T14:43:12.843 INFO:tasks.workunit.client.1.smithi129.stdout:4/54: chown d0 235 1 2024-03-18T14:43:12.843 INFO:tasks.workunit.client.0.smithi087.stdout:7/319: link d1/d6/d29/l5a d1/d6/d29/d2f/d68/d65/d60/d66/l6c 0 2024-03-18T14:43:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:1/292: link d3/d1d/d1f/l57 d3/l5a 0 2024-03-18T14:43:12.844 INFO:tasks.workunit.client.0.smithi087.stdout:4/207: read d2/d13/d28/f2d [4488907,36924] 0 2024-03-18T14:43:12.844 INFO:tasks.workunit.client.1.smithi129.stdout:9/66: creat d0/f13 x:0 0 0 2024-03-18T14:43:12.846 INFO:tasks.workunit.client.1.smithi129.stdout:8/98: mknod d9/c21 0 2024-03-18T14:43:12.846 INFO:tasks.workunit.client.0.smithi087.stdout:6/234: mkdir d3/d1a/d29/d22/d53 0 2024-03-18T14:43:12.847 INFO:tasks.workunit.client.1.smithi129.stdout:0/98: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:12.848 INFO:tasks.workunit.client.1.smithi129.stdout:3/54: dread d4/fa [0,4194304] 0 2024-03-18T14:43:12.849 INFO:tasks.workunit.client.1.smithi129.stdout:3/55: chown d4/c8 8402576 1 2024-03-18T14:43:12.850 INFO:tasks.workunit.client.1.smithi129.stdout:7/63: creat d4/d7/d8/d12/f14 x:0 0 0 2024-03-18T14:43:12.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/208: unlink d2/db/de/f17 0 2024-03-18T14:43:12.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/209: fdatasync d2/f21 0 2024-03-18T14:43:12.852 INFO:tasks.workunit.client.0.smithi087.stdout:1/293: rename d3/d1d/d1f/d34/d38/c42 to d3/d1d/d1f/d34/c5b 0 2024-03-18T14:43:12.853 INFO:tasks.workunit.client.1.smithi129.stdout:2/36: rename f4 to d7/fa 0 2024-03-18T14:43:12.853 INFO:tasks.workunit.client.1.smithi129.stdout:2/37: chown c1 2774 1 2024-03-18T14:43:12.854 INFO:tasks.workunit.client.0.smithi087.stdout:3/304: dread d0/f52 [0,4194304] 0 2024-03-18T14:43:12.854 INFO:tasks.workunit.client.1.smithi129.stdout:8/99: dwrite d9/f15 [0,4194304] 0 2024-03-18T14:43:12.855 INFO:tasks.workunit.client.0.smithi087.stdout:3/305: fdatasync d0/d3/f29 0 2024-03-18T14:43:12.855 INFO:tasks.workunit.client.1.smithi129.stdout:0/99: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:12.858 INFO:tasks.workunit.client.0.smithi087.stdout:7/320: write d1/d6/d16/f1e [1916318,11020] 0 2024-03-18T14:43:12.858 INFO:tasks.workunit.client.1.smithi129.stdout:0/100: dread d0/fb [4194304,4194304] 0 2024-03-18T14:43:12.858 INFO:tasks.workunit.client.1.smithi129.stdout:1/40: truncate d1/f7 1511910 0 2024-03-18T14:43:12.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/241: symlink d2/d4/d22/l48 0 2024-03-18T14:43:12.859 INFO:tasks.workunit.client.1.smithi129.stdout:0/101: read d0/d14/f20 [2495263,57302] 0 2024-03-18T14:43:12.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/248: dread d1/d6/d9/f13 [4194304,4194304] 0 2024-03-18T14:43:12.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/249: fsync d1/f2 0 2024-03-18T14:43:12.863 INFO:tasks.workunit.client.0.smithi087.stdout:8/250: dread - d1/d6/d9/f3f zero size 2024-03-18T14:43:12.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/210: creat d2/d13/d28/f42 x:0 0 0 2024-03-18T14:43:12.864 INFO:tasks.workunit.client.0.smithi087.stdout:8/251: write d1/d6/d9/f48 [3023448,61723] 0 2024-03-18T14:43:12.865 INFO:tasks.workunit.client.0.smithi087.stdout:8/252: chown d1/d6/f1e 62226 1 2024-03-18T14:43:12.866 INFO:tasks.workunit.client.1.smithi129.stdout:3/56: mkdir d4/dd 0 2024-03-18T14:43:12.867 INFO:tasks.workunit.client.0.smithi087.stdout:7/321: symlink d1/d6/d29/d2f/d68/d65/l6d 0 2024-03-18T14:43:12.867 INFO:tasks.workunit.client.1.smithi129.stdout:7/64: chown d4/d7/d8/f9 30 1 2024-03-18T14:43:12.867 INFO:tasks.workunit.client.0.smithi087.stdout:7/322: write d1/f2b [2129870,32214] 0 2024-03-18T14:43:12.868 INFO:tasks.workunit.client.0.smithi087.stdout:0/229: truncate d0/dd/f38 835597 0 2024-03-18T14:43:12.871 INFO:tasks.workunit.client.0.smithi087.stdout:3/306: symlink d0/d1c/l5c 0 2024-03-18T14:43:12.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/38: dwrite d7/fa [0,4194304] 0 2024-03-18T14:43:12.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/39: read - f5 zero size 2024-03-18T14:43:12.872 INFO:tasks.workunit.client.0.smithi087.stdout:9/331: dread db/d18/f2c [0,4194304] 0 2024-03-18T14:43:12.872 INFO:tasks.workunit.client.1.smithi129.stdout:1/41: dread d1/d2/f5 [0,4194304] 0 2024-03-18T14:43:12.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/283: sync 2024-03-18T14:43:12.875 INFO:tasks.workunit.client.0.smithi087.stdout:8/253: symlink d1/d6/d2f/d44/l4f 0 2024-03-18T14:43:12.876 INFO:tasks.workunit.client.0.smithi087.stdout:5/284: dread - d13/d1b/f59 zero size 2024-03-18T14:43:12.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/332: dwrite db/d18/d1c/f50 [0,4194304] 0 2024-03-18T14:43:12.879 INFO:tasks.workunit.client.0.smithi087.stdout:0/230: unlink d0/dd/l4d 0 2024-03-18T14:43:12.881 INFO:tasks.workunit.client.0.smithi087.stdout:3/307: chown d0/d3/df/d42/l48 245330 1 2024-03-18T14:43:12.882 INFO:tasks.workunit.client.1.smithi129.stdout:8/100: fsync d9/f15 0 2024-03-18T14:43:12.883 INFO:tasks.workunit.client.0.smithi087.stdout:9/333: dwrite db/d18/d1e/f54 [0,4194304] 0 2024-03-18T14:43:12.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/254: mkdir d1/d6/d2f/d44/d45/d50 0 2024-03-18T14:43:12.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/323: creat d1/d6/d29/d2f/d68/d65/d60/d66/f6e x:0 0 0 2024-03-18T14:43:12.888 INFO:tasks.workunit.client.1.smithi129.stdout:5/66: sync 2024-03-18T14:43:12.888 INFO:tasks.workunit.client.1.smithi129.stdout:6/79: sync 2024-03-18T14:43:12.888 INFO:tasks.workunit.client.1.smithi129.stdout:6/80: fsync d3/d5/f9 0 2024-03-18T14:43:12.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/235: dread d3/d1a/d29/f1d [0,4194304] 0 2024-03-18T14:43:12.890 INFO:tasks.workunit.client.0.smithi087.stdout:6/236: write d3/d1a/f1e [2846269,93492] 0 2024-03-18T14:43:12.890 INFO:tasks.workunit.client.0.smithi087.stdout:6/237: readlink d3/d7/l13 0 2024-03-18T14:43:12.891 INFO:tasks.workunit.client.1.smithi129.stdout:6/81: dread d3/d5/f13 [0,4194304] 0 2024-03-18T14:43:12.891 INFO:tasks.workunit.client.1.smithi129.stdout:6/82: chown d3/d6 481027322 1 2024-03-18T14:43:12.892 INFO:tasks.workunit.client.0.smithi087.stdout:1/294: sync 2024-03-18T14:43:12.895 INFO:tasks.workunit.client.0.smithi087.stdout:4/211: creat d2/db/f43 x:0 0 0 2024-03-18T14:43:12.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/308: write d0/f1 [4653766,37632] 0 2024-03-18T14:43:12.901 INFO:tasks.workunit.client.0.smithi087.stdout:2/242: getdents d2/d4 0 2024-03-18T14:43:12.902 INFO:tasks.workunit.client.0.smithi087.stdout:9/334: mknod db/d31/c67 0 2024-03-18T14:43:12.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/255: creat d1/d6/d9/f51 x:0 0 0 2024-03-18T14:43:12.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/256: fdatasync d1/f1a 0 2024-03-18T14:43:12.905 INFO:tasks.workunit.client.0.smithi087.stdout:7/324: rename d1/l3b to d1/d6/d29/d2f/d68/d65/l6f 0 2024-03-18T14:43:12.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/295: rename d3/d1d/d1e/d20/f39 to d3/d1d/d1e/d20/f5c 0 2024-03-18T14:43:12.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/212: readlink d2/db/l25 0 2024-03-18T14:43:12.913 INFO:tasks.workunit.client.0.smithi087.stdout:0/231: unlink d0/d2/d4/d27/f39 0 2024-03-18T14:43:12.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/296: dwrite d3/d1d/d1e/f4b [0,4194304] 0 2024-03-18T14:43:12.914 INFO:tasks.workunit.client.0.smithi087.stdout:1/297: readlink d3/l14 0 2024-03-18T14:43:12.914 INFO:tasks.workunit.client.0.smithi087.stdout:0/232: chown d0/d2/d4/d19/d24/c4e 98 1 2024-03-18T14:43:12.915 INFO:tasks.workunit.client.0.smithi087.stdout:2/243: mkdir d2/d4/d22/d2c/d3a/d49 0 2024-03-18T14:43:12.918 INFO:tasks.workunit.client.0.smithi087.stdout:8/257: creat d1/d6/d2f/d44/f52 x:0 0 0 2024-03-18T14:43:12.919 INFO:tasks.workunit.client.0.smithi087.stdout:8/258: write d1/f2 [2650289,88470] 0 2024-03-18T14:43:12.926 INFO:tasks.workunit.client.0.smithi087.stdout:1/298: creat d3/d1d/d1f/f5d x:0 0 0 2024-03-18T14:43:12.927 INFO:tasks.workunit.client.0.smithi087.stdout:1/299: write d3/f4e [807790,84780] 0 2024-03-18T14:43:12.928 INFO:tasks.workunit.client.0.smithi087.stdout:0/233: creat d0/d2/d4/d27/d29/d2a/f52 x:0 0 0 2024-03-18T14:43:12.928 INFO:tasks.workunit.client.0.smithi087.stdout:7/325: dread d1/f3 [0,4194304] 0 2024-03-18T14:43:12.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/326: write d1/d6/f18 [7792336,129133] 0 2024-03-18T14:43:12.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/327: fsync d1/d6/f2a 0 2024-03-18T14:43:12.933 INFO:tasks.workunit.client.0.smithi087.stdout:6/238: truncate d3/f6 3859871 0 2024-03-18T14:43:12.934 INFO:tasks.workunit.client.0.smithi087.stdout:5/285: getdents d13/d1b/d27/d35/d3b 0 2024-03-18T14:43:12.936 INFO:tasks.workunit.client.0.smithi087.stdout:3/309: dread d0/d1c/f4b [0,4194304] 0 2024-03-18T14:43:12.940 INFO:tasks.workunit.client.0.smithi087.stdout:9/335: rename db/d31/f65 to db/f68 0 2024-03-18T14:43:12.940 INFO:tasks.workunit.client.0.smithi087.stdout:5/286: creat d13/d1b/d30/f5d x:0 0 0 2024-03-18T14:43:12.943 INFO:tasks.workunit.client.0.smithi087.stdout:8/259: write d1/d6/d14/f1f [813682,93665] 0 2024-03-18T14:43:12.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/213: rmdir d2/db/d3b 0 2024-03-18T14:43:12.946 INFO:tasks.workunit.client.0.smithi087.stdout:2/244: dwrite d2/d4/d22/f36 [0,4194304] 0 2024-03-18T14:43:12.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/214: read d2/f9 [572069,80392] 0 2024-03-18T14:43:12.951 INFO:tasks.workunit.client.0.smithi087.stdout:1/300: rename d3/d1d/d1e/d20/c2f to d3/d1d/d45/c5e 0 2024-03-18T14:43:12.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/260: creat d1/d6/d2f/d44/d4b/f53 x:0 0 0 2024-03-18T14:43:12.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/215: creat d2/db/de/f44 x:0 0 0 2024-03-18T14:43:12.956 INFO:tasks.workunit.client.0.smithi087.stdout:4/216: dread - d2/db/d24/f33 zero size 2024-03-18T14:43:12.957 INFO:tasks.workunit.client.0.smithi087.stdout:3/310: dwrite d0/d1c/f4b [4194304,4194304] 0 2024-03-18T14:43:12.957 INFO:tasks.workunit.client.0.smithi087.stdout:0/234: rename d0/dd/c28 to d0/d2/d4/d27/d29/d2a/c53 0 2024-03-18T14:43:12.958 INFO:tasks.workunit.client.0.smithi087.stdout:7/328: rename d1/d6 to d1/d6/d29/d2f/d68/d65/d60/d70 22 2024-03-18T14:43:12.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/311: fsync d0/d3/df/f14 0 2024-03-18T14:43:12.961 INFO:tasks.workunit.client.0.smithi087.stdout:6/239: dread d3/f4 [0,4194304] 0 2024-03-18T14:43:12.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/312: dwrite d0/d3/fc [4194304,4194304] 0 2024-03-18T14:43:12.967 INFO:tasks.workunit.client.0.smithi087.stdout:2/245: mkdir d2/d4/d22/d2c/d3a/d40/d4a 0 2024-03-18T14:43:12.967 INFO:tasks.workunit.client.0.smithi087.stdout:4/217: creat d2/db/de/f45 x:0 0 0 2024-03-18T14:43:12.967 INFO:tasks.workunit.client.0.smithi087.stdout:8/261: rename d1/d6/d9/f13 to d1/d6/d2f/d44/d4b/f54 0 2024-03-18T14:43:12.968 INFO:tasks.workunit.client.0.smithi087.stdout:2/246: write d2/d4/f46 [716618,10071] 0 2024-03-18T14:43:12.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/247: fdatasync d2/d4/f19 0 2024-03-18T14:43:12.970 INFO:tasks.workunit.client.0.smithi087.stdout:5/287: creat d13/f5e x:0 0 0 2024-03-18T14:43:12.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/248: readlink d2/l14 0 2024-03-18T14:43:12.972 INFO:tasks.workunit.client.0.smithi087.stdout:0/235: dwrite d0/d2/f21 [0,4194304] 0 2024-03-18T14:43:12.973 INFO:tasks.workunit.client.0.smithi087.stdout:3/313: creat d0/de/d30/f5d x:0 0 0 2024-03-18T14:43:12.974 INFO:tasks.workunit.client.0.smithi087.stdout:7/329: mknod d1/d6/da/c71 0 2024-03-18T14:43:12.975 INFO:tasks.workunit.client.0.smithi087.stdout:7/330: dread - d1/d6/d29/d2f/d68/d65/d60/d66/f6e zero size 2024-03-18T14:43:12.976 INFO:tasks.workunit.client.0.smithi087.stdout:4/218: mknod d2/db/d3c/c46 0 2024-03-18T14:43:12.977 INFO:tasks.workunit.client.0.smithi087.stdout:4/219: fsync d2/db/de/f2f 0 2024-03-18T14:43:12.979 INFO:tasks.workunit.client.0.smithi087.stdout:7/331: dwrite d1/d6/da/d42/f4a [0,4194304] 0 2024-03-18T14:43:12.981 INFO:tasks.workunit.client.0.smithi087.stdout:8/262: mknod d1/d6/d2f/d44/c55 0 2024-03-18T14:43:12.981 INFO:tasks.workunit.client.0.smithi087.stdout:6/240: symlink d3/d1a/d46/l54 0 2024-03-18T14:43:12.982 INFO:tasks.workunit.client.0.smithi087.stdout:2/249: chown d2/d4/d22/d24 2 1 2024-03-18T14:43:12.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/236: unlink d0/d2/f21 0 2024-03-18T14:43:12.983 INFO:tasks.workunit.client.0.smithi087.stdout:5/288: dread d13/d1b/d27/d35/f4b [0,4194304] 0 2024-03-18T14:43:12.983 INFO:tasks.workunit.client.0.smithi087.stdout:2/250: chown d2/f10 453 1 2024-03-18T14:43:12.984 INFO:tasks.workunit.client.0.smithi087.stdout:0/237: stat d0/d1a/c47 0 2024-03-18T14:43:12.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/332: dwrite d1/d6/d29/f34 [0,4194304] 0 2024-03-18T14:43:12.987 INFO:tasks.workunit.client.0.smithi087.stdout:5/289: write d13/d1b/d27/d28/f54 [79345,61760] 0 2024-03-18T14:43:12.987 INFO:tasks.workunit.client.0.smithi087.stdout:8/263: dread d1/d6/d14/f2a [0,4194304] 0 2024-03-18T14:43:12.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/333: stat d1/d6/d29 0 2024-03-18T14:43:12.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/290: chown d13/d1b/c4a 12 1 2024-03-18T14:43:12.989 INFO:tasks.workunit.client.0.smithi087.stdout:5/291: readlink d13/l32 0 2024-03-18T14:43:12.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/301: truncate d3/d1d/f22 4880040 0 2024-03-18T14:43:12.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/251: dwrite d2/d4/f1a [0,4194304] 0 2024-03-18T14:43:12.995 INFO:tasks.workunit.client.0.smithi087.stdout:0/238: unlink d0/d1a/f1f 0 2024-03-18T14:43:12.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/334: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/f6e [0,4194304] 0 2024-03-18T14:43:13.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/336: sync 2024-03-18T14:43:13.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/337: write db/f10 [706899,31707] 0 2024-03-18T14:43:13.002 INFO:tasks.workunit.client.0.smithi087.stdout:9/338: write db/d18/d1c/f27 [1329629,33350] 0 2024-03-18T14:43:13.002 INFO:tasks.workunit.client.0.smithi087.stdout:1/302: dread d3/d1d/d1e/d43/d50/f58 [0,4194304] 0 2024-03-18T14:43:13.003 INFO:tasks.workunit.client.0.smithi087.stdout:7/335: mkdir d1/d6/d29/d2f/d68/d65/d72 0 2024-03-18T14:43:13.009 INFO:tasks.workunit.client.0.smithi087.stdout:1/303: dread d3/f4e [0,4194304] 0 2024-03-18T14:43:13.010 INFO:tasks.workunit.client.0.smithi087.stdout:0/239: link d0/d2/d4/f4c d0/d2/d4/d19/f54 0 2024-03-18T14:43:13.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/339: mkdir db/d18/d1c/d69 0 2024-03-18T14:43:13.016 INFO:tasks.workunit.client.0.smithi087.stdout:9/340: dwrite db/f4b [0,4194304] 0 2024-03-18T14:43:13.016 INFO:tasks.workunit.client.0.smithi087.stdout:3/314: truncate d0/d3/f7 2216592 0 2024-03-18T14:43:13.017 INFO:tasks.workunit.client.0.smithi087.stdout:7/336: unlink d1/d6/c5e 0 2024-03-18T14:43:13.019 INFO:tasks.workunit.client.1.smithi129.stdout:4/55: creat d0/f13 x:0 0 0 2024-03-18T14:43:13.020 INFO:tasks.workunit.client.1.smithi129.stdout:3/57: mknod d4/ce 0 2024-03-18T14:43:13.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/337: dwrite d1/d6/da/d59/f5d [0,4194304] 0 2024-03-18T14:43:13.021 INFO:tasks.workunit.client.1.smithi129.stdout:3/58: fdatasync d4/fc 0 2024-03-18T14:43:13.023 INFO:tasks.workunit.client.1.smithi129.stdout:0/102: dwrite d0/f1e [8388608,4194304] 0 2024-03-18T14:43:13.023 INFO:tasks.workunit.client.0.smithi087.stdout:2/252: truncate d2/d4/f1a 2110499 0 2024-03-18T14:43:13.023 INFO:tasks.workunit.client.1.smithi129.stdout:0/103: write d0/f11 [417357,79139] 0 2024-03-18T14:43:13.024 INFO:tasks.workunit.client.0.smithi087.stdout:4/220: link d2/l3e d2/l47 0 2024-03-18T14:43:13.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/40: symlink d7/lb 0 2024-03-18T14:43:13.027 INFO:tasks.workunit.client.1.smithi129.stdout:1/42: read d1/f9 [837199,81845] 0 2024-03-18T14:43:13.027 INFO:tasks.workunit.client.0.smithi087.stdout:2/253: dwrite d2/f10 [4194304,4194304] 0 2024-03-18T14:43:13.027 INFO:tasks.workunit.client.0.smithi087.stdout:5/292: link d13/d1b/f59 d13/f5f 0 2024-03-18T14:43:13.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/41: dread d7/fa [0,4194304] 0 2024-03-18T14:43:13.028 INFO:tasks.workunit.client.1.smithi129.stdout:8/101: unlink d9/l1e 0 2024-03-18T14:43:13.028 INFO:tasks.workunit.client.1.smithi129.stdout:1/43: dread d1/d2/f5 [0,4194304] 0 2024-03-18T14:43:13.028 INFO:tasks.workunit.client.1.smithi129.stdout:2/42: chown f2 162874656 1 2024-03-18T14:43:13.029 INFO:tasks.workunit.client.0.smithi087.stdout:1/304: creat d3/d1d/d1e/d20/f5f x:0 0 0 2024-03-18T14:43:13.030 INFO:tasks.workunit.client.1.smithi129.stdout:2/43: dread f2 [0,4194304] 0 2024-03-18T14:43:13.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/83: unlink d3/d5/c16 0 2024-03-18T14:43:13.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/240: chown d0/d2/d4/d27/d29/c1e 1162 1 2024-03-18T14:43:13.030 INFO:tasks.workunit.client.0.smithi087.stdout:4/221: dwrite d2/db/de/f45 [0,4194304] 0 2024-03-18T14:43:13.031 INFO:tasks.workunit.client.1.smithi129.stdout:2/44: dread - f5 zero size 2024-03-18T14:43:13.031 INFO:tasks.workunit.client.1.smithi129.stdout:8/102: dread d9/d11/f17 [0,4194304] 0 2024-03-18T14:43:13.032 INFO:tasks.workunit.client.1.smithi129.stdout:9/67: getdents d0 0 2024-03-18T14:43:13.033 INFO:tasks.workunit.client.1.smithi129.stdout:3/59: write d4/fa [1012636,83767] 0 2024-03-18T14:43:13.033 INFO:tasks.workunit.client.0.smithi087.stdout:9/341: rename db/l48 to db/d31/l6a 0 2024-03-18T14:43:13.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/342: fdatasync db/f3d 0 2024-03-18T14:43:13.037 INFO:tasks.workunit.client.1.smithi129.stdout:0/104: mknod d0/c21 0 2024-03-18T14:43:13.037 INFO:tasks.workunit.client.1.smithi129.stdout:1/44: mknod d1/ce 0 2024-03-18T14:43:13.038 INFO:tasks.workunit.client.0.smithi087.stdout:7/338: symlink d1/d6/d16/dc/l73 0 2024-03-18T14:43:13.038 INFO:tasks.workunit.client.0.smithi087.stdout:9/343: dwrite db/f22 [0,4194304] 0 2024-03-18T14:43:13.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/293: mknod d13/d1b/d30/c60 0 2024-03-18T14:43:13.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/56: symlink d0/l14 0 2024-03-18T14:43:13.040 INFO:tasks.workunit.client.0.smithi087.stdout:2/254: unlink d2/d4/d22/d2c/d3a/f3b 0 2024-03-18T14:43:13.042 INFO:tasks.workunit.client.0.smithi087.stdout:6/241: sync 2024-03-18T14:43:13.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/344: dwrite db/d18/d1c/f37 [0,4194304] 0 2024-03-18T14:43:13.043 INFO:tasks.workunit.client.0.smithi087.stdout:0/241: unlink d0/d1a/d34/d3d/f45 0 2024-03-18T14:43:13.044 INFO:tasks.workunit.client.1.smithi129.stdout:2/45: rename f2 to d7/fc 0 2024-03-18T14:43:13.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/294: dwrite d13/d1b/d27/d35/f39 [0,4194304] 0 2024-03-18T14:43:13.048 INFO:tasks.workunit.client.0.smithi087.stdout:0/242: write d0/d2/d4/d19/f23 [685354,16890] 0 2024-03-18T14:43:13.049 INFO:tasks.workunit.client.1.smithi129.stdout:0/105: write d0/fb [4700583,78677] 0 2024-03-18T14:43:13.050 INFO:tasks.workunit.client.0.smithi087.stdout:4/222: symlink d2/db/l48 0 2024-03-18T14:43:13.050 INFO:tasks.workunit.client.0.smithi087.stdout:5/295: dread - d13/f37 zero size 2024-03-18T14:43:13.051 INFO:tasks.workunit.client.0.smithi087.stdout:6/242: dwrite d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:13.052 INFO:tasks.workunit.client.0.smithi087.stdout:1/305: rename l0 to d3/l60 0 2024-03-18T14:43:13.052 INFO:tasks.workunit.client.0.smithi087.stdout:6/243: write d3/d1a/d29/d22/f3b [2045780,9338] 0 2024-03-18T14:43:13.053 INFO:tasks.workunit.client.0.smithi087.stdout:6/244: readlink d3/d1a/d46/l54 0 2024-03-18T14:43:13.053 INFO:tasks.workunit.client.0.smithi087.stdout:6/245: readlink d3/lc 0 2024-03-18T14:43:13.057 INFO:tasks.workunit.client.1.smithi129.stdout:6/84: fsync d3/d6/f8 0 2024-03-18T14:43:13.063 INFO:tasks.workunit.client.0.smithi087.stdout:5/296: symlink d13/d1b/d30/l61 0 2024-03-18T14:43:13.063 INFO:tasks.workunit.client.0.smithi087.stdout:9/345: rename db/fc to db/d18/d3a/f6b 0 2024-03-18T14:43:13.064 INFO:tasks.workunit.client.0.smithi087.stdout:0/243: write d0/d2/d4/f4c [870511,100169] 0 2024-03-18T14:43:13.064 INFO:tasks.workunit.client.0.smithi087.stdout:6/246: creat d3/d1a/d29/d22/f55 x:0 0 0 2024-03-18T14:43:13.064 INFO:tasks.workunit.client.0.smithi087.stdout:4/223: write d2/f16 [476283,15695] 0 2024-03-18T14:43:13.065 INFO:tasks.workunit.client.0.smithi087.stdout:6/247: readlink d3/d7/l13 0 2024-03-18T14:43:13.065 INFO:tasks.workunit.client.0.smithi087.stdout:9/346: readlink db/d18/d1e/d28/l3f 0 2024-03-18T14:43:13.067 INFO:tasks.workunit.client.0.smithi087.stdout:4/224: write d2/d13/d28/f2d [5359334,117199] 0 2024-03-18T14:43:13.067 INFO:tasks.workunit.client.0.smithi087.stdout:9/347: write db/d18/d3a/f59 [2652304,30465] 0 2024-03-18T14:43:13.068 INFO:tasks.workunit.client.0.smithi087.stdout:9/348: fsync db/d18/d51/f5c 0 2024-03-18T14:43:13.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/248: dwrite d3/f19 [0,4194304] 0 2024-03-18T14:43:13.079 INFO:tasks.workunit.client.0.smithi087.stdout:2/255: link d2/d4/d22/c3f d2/d4/d22/d2c/d3a/d40/c4b 0 2024-03-18T14:43:13.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/45: sync 2024-03-18T14:43:13.081 INFO:tasks.workunit.client.0.smithi087.stdout:5/297: symlink d13/d1b/d30/l62 0 2024-03-18T14:43:13.083 INFO:tasks.workunit.client.0.smithi087.stdout:7/339: write d1/d6/d16/f4e [3855793,126624] 0 2024-03-18T14:43:13.087 INFO:tasks.workunit.client.1.smithi129.stdout:8/103: unlink d9/d11/f17 0 2024-03-18T14:43:13.089 INFO:tasks.workunit.client.0.smithi087.stdout:2/256: mknod d2/d4/d22/d2c/d3a/d40/d4a/c4c 0 2024-03-18T14:43:13.089 INFO:tasks.workunit.client.0.smithi087.stdout:7/340: dwrite d1/d6/d29/d2f/d68/d65/d60/f64 [0,4194304] 0 2024-03-18T14:43:13.090 INFO:tasks.workunit.client.0.smithi087.stdout:5/298: symlink d13/d1b/l63 0 2024-03-18T14:43:13.093 INFO:tasks.workunit.client.0.smithi087.stdout:8/264: sync 2024-03-18T14:43:13.093 INFO:tasks.workunit.client.0.smithi087.stdout:3/315: sync 2024-03-18T14:43:13.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/341: dwrite d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:13.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/249: creat d3/d1a/d29/f56 x:0 0 0 2024-03-18T14:43:13.096 INFO:tasks.workunit.client.0.smithi087.stdout:6/250: chown d3/d1a/d29/cb 49 1 2024-03-18T14:43:13.096 INFO:tasks.workunit.client.0.smithi087.stdout:5/299: fsync d13/d1b/d27/d35/f4f 0 2024-03-18T14:43:13.096 INFO:tasks.workunit.client.0.smithi087.stdout:7/342: chown d1/d6/da/d59/f5d 0 1 2024-03-18T14:43:13.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/244: dread d0/d2/f17 [4194304,4194304] 0 2024-03-18T14:43:13.100 INFO:tasks.workunit.client.0.smithi087.stdout:1/306: dread d3/d1d/d1f/f24 [0,4194304] 0 2024-03-18T14:43:13.102 INFO:tasks.workunit.client.0.smithi087.stdout:8/265: symlink d1/d6/d2f/d44/d4b/l56 0 2024-03-18T14:43:13.102 INFO:tasks.workunit.client.0.smithi087.stdout:3/316: creat d0/d3/d10/f5e x:0 0 0 2024-03-18T14:43:13.103 INFO:tasks.workunit.client.1.smithi129.stdout:2/46: mkdir d7/dd 0 2024-03-18T14:43:13.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/68: symlink d0/db/d11/l14 0 2024-03-18T14:43:13.106 INFO:tasks.workunit.client.0.smithi087.stdout:3/317: dwrite d0/d3/d10/f1f [0,4194304] 0 2024-03-18T14:43:13.116 INFO:tasks.workunit.client.0.smithi087.stdout:4/225: dwrite d2/f9 [0,4194304] 0 2024-03-18T14:43:13.116 INFO:tasks.workunit.client.0.smithi087.stdout:9/349: dwrite db/f11 [0,4194304] 0 2024-03-18T14:43:13.117 INFO:tasks.workunit.client.0.smithi087.stdout:9/350: fdatasync db/d18/d3a/f63 0 2024-03-18T14:43:13.118 INFO:tasks.workunit.client.0.smithi087.stdout:9/351: read db/f11 [3985040,9933] 0 2024-03-18T14:43:13.119 INFO:tasks.workunit.client.0.smithi087.stdout:6/251: creat d3/d7/f57 x:0 0 0 2024-03-18T14:43:13.121 INFO:tasks.workunit.client.1.smithi129.stdout:4/57: creat d0/d9/f15 x:0 0 0 2024-03-18T14:43:13.121 INFO:tasks.workunit.client.0.smithi087.stdout:6/252: dread - d3/d1a/f34 zero size 2024-03-18T14:43:13.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/266: unlink d1/d6/d2f/d44/d4b/f53 0 2024-03-18T14:43:13.123 INFO:tasks.workunit.client.0.smithi087.stdout:2/257: dread d2/f10 [0,4194304] 0 2024-03-18T14:43:13.123 INFO:tasks.workunit.client.0.smithi087.stdout:3/318: write d0/de/f12 [2129533,55517] 0 2024-03-18T14:43:13.124 INFO:tasks.workunit.client.0.smithi087.stdout:6/253: write d3/d7/d25/f4d [623432,108990] 0 2024-03-18T14:43:13.126 INFO:tasks.workunit.client.0.smithi087.stdout:9/352: dwrite db/d31/f66 [0,4194304] 0 2024-03-18T14:43:13.131 INFO:tasks.workunit.client.0.smithi087.stdout:5/300: creat d13/d1b/f64 x:0 0 0 2024-03-18T14:43:13.131 INFO:tasks.workunit.client.1.smithi129.stdout:5/67: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:13.132 INFO:tasks.workunit.client.1.smithi129.stdout:7/65: dwrite d4/d7/d8/f11 [0,4194304] 0 2024-03-18T14:43:13.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/68: fsync d0/f2 0 2024-03-18T14:43:13.133 INFO:tasks.workunit.client.0.smithi087.stdout:4/226: mkdir d2/db/d24/d30/d49 0 2024-03-18T14:43:13.134 INFO:tasks.workunit.client.1.smithi129.stdout:1/46: fsync d1/d2/f5 0 2024-03-18T14:43:13.134 INFO:tasks.workunit.client.1.smithi129.stdout:5/69: chown d0/f6 858896 1 2024-03-18T14:43:13.134 INFO:tasks.workunit.client.0.smithi087.stdout:6/254: write d3/d1a/f42 [866717,37357] 0 2024-03-18T14:43:13.135 INFO:tasks.workunit.client.1.smithi129.stdout:3/60: truncate d4/fc 783954 0 2024-03-18T14:43:13.136 INFO:tasks.workunit.client.0.smithi087.stdout:5/301: dwrite d13/d1b/d27/f45 [4194304,4194304] 0 2024-03-18T14:43:13.137 INFO:tasks.workunit.client.0.smithi087.stdout:9/353: rmdir db/d12 39 2024-03-18T14:43:13.139 INFO:tasks.workunit.client.0.smithi087.stdout:8/267: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:13.139 INFO:tasks.workunit.client.0.smithi087.stdout:0/245: creat d0/d2/d4/d27/f55 x:0 0 0 2024-03-18T14:43:13.139 INFO:tasks.workunit.client.0.smithi087.stdout:3/319: symlink d0/d3/l5f 0 2024-03-18T14:43:13.140 INFO:tasks.workunit.client.1.smithi129.stdout:1/47: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:13.141 INFO:tasks.workunit.client.1.smithi129.stdout:2/47: symlink d7/le 0 2024-03-18T14:43:13.141 INFO:tasks.workunit.client.1.smithi129.stdout:5/70: dwrite d0/dc/fd [4194304,4194304] 0 2024-03-18T14:43:13.141 INFO:tasks.workunit.client.1.smithi129.stdout:9/69: mkdir d0/d15 0 2024-03-18T14:43:13.142 INFO:tasks.workunit.client.1.smithi129.stdout:4/58: stat d0/fd 0 2024-03-18T14:43:13.142 INFO:tasks.workunit.client.1.smithi129.stdout:2/48: chown c1 506330 1 2024-03-18T14:43:13.143 INFO:tasks.workunit.client.1.smithi129.stdout:2/49: chown c1 12718 1 2024-03-18T14:43:13.143 INFO:tasks.workunit.client.0.smithi087.stdout:5/302: mknod d13/d1b/d27/c65 0 2024-03-18T14:43:13.144 INFO:tasks.workunit.client.1.smithi129.stdout:6/85: link d3/d5/db/fd d3/f1a 0 2024-03-18T14:43:13.145 INFO:tasks.workunit.client.1.smithi129.stdout:8/104: mknod d9/d11/d1a/d14/c22 0 2024-03-18T14:43:13.146 INFO:tasks.workunit.client.0.smithi087.stdout:5/303: dwrite d13/f16 [0,4194304] 0 2024-03-18T14:43:13.147 INFO:tasks.workunit.client.1.smithi129.stdout:8/105: read d9/f1b [228073,10046] 0 2024-03-18T14:43:13.148 INFO:tasks.workunit.client.1.smithi129.stdout:5/71: dwrite d0/f2 [0,4194304] 0 2024-03-18T14:43:13.149 INFO:tasks.workunit.client.1.smithi129.stdout:5/72: write d0/dc/fd [1109432,70054] 0 2024-03-18T14:43:13.149 INFO:tasks.workunit.client.0.smithi087.stdout:0/246: creat d0/d49/f56 x:0 0 0 2024-03-18T14:43:13.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/86: dread d3/d5/f9 [0,4194304] 0 2024-03-18T14:43:13.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/87: readlink - no filename 2024-03-18T14:43:13.150 INFO:tasks.workunit.client.1.smithi129.stdout:5/73: chown d0/f1 448 1 2024-03-18T14:43:13.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/88: chown d3/f1a 5 1 2024-03-18T14:43:13.150 INFO:tasks.workunit.client.1.smithi129.stdout:5/74: chown d0/l7 666610557 1 2024-03-18T14:43:13.152 INFO:tasks.workunit.client.0.smithi087.stdout:5/304: dwrite f11 [0,4194304] 0 2024-03-18T14:43:13.154 INFO:tasks.workunit.client.1.smithi129.stdout:5/75: dwrite d0/f9 [0,4194304] 0 2024-03-18T14:43:13.155 INFO:tasks.workunit.client.0.smithi087.stdout:5/305: creat d13/d1b/d27/d28/f66 x:0 0 0 2024-03-18T14:43:13.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/76: dread d0/f2 [0,4194304] 0 2024-03-18T14:43:13.159 INFO:tasks.workunit.client.1.smithi129.stdout:1/48: mknod d1/cf 0 2024-03-18T14:43:13.159 INFO:tasks.workunit.client.1.smithi129.stdout:0/106: link d0/c2 d0/d14/c22 0 2024-03-18T14:43:13.162 INFO:tasks.workunit.client.1.smithi129.stdout:9/70: creat d0/f16 x:0 0 0 2024-03-18T14:43:13.163 INFO:tasks.workunit.client.1.smithi129.stdout:2/50: rename d7/lb to d7/lf 0 2024-03-18T14:43:13.164 INFO:tasks.workunit.client.1.smithi129.stdout:0/107: dwrite d0/f11 [0,4194304] 0 2024-03-18T14:43:13.167 INFO:tasks.workunit.client.0.smithi087.stdout:1/307: dread d3/d1d/f22 [0,4194304] 0 2024-03-18T14:43:13.168 INFO:tasks.workunit.client.1.smithi129.stdout:9/71: dread d0/db/fd [0,4194304] 0 2024-03-18T14:43:13.169 INFO:tasks.workunit.client.0.smithi087.stdout:4/227: dread d2/d13/f3f [4194304,4194304] 0 2024-03-18T14:43:13.169 INFO:tasks.workunit.client.0.smithi087.stdout:7/343: truncate d1/d6/d16/f4e 1106815 0 2024-03-18T14:43:13.170 INFO:tasks.workunit.client.1.smithi129.stdout:0/108: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:13.170 INFO:tasks.workunit.client.1.smithi129.stdout:3/61: creat d4/dd/ff x:0 0 0 2024-03-18T14:43:13.171 INFO:tasks.workunit.client.1.smithi129.stdout:3/62: read d4/f6 [849809,97178] 0 2024-03-18T14:43:13.172 INFO:tasks.workunit.client.0.smithi087.stdout:1/308: dwrite d3/d1d/d45/f49 [0,4194304] 0 2024-03-18T14:43:13.176 INFO:tasks.workunit.client.0.smithi087.stdout:1/309: dread d3/d1d/d45/f49 [0,4194304] 0 2024-03-18T14:43:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:8/268: dwrite d1/d6/f1e [0,4194304] 0 2024-03-18T14:43:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:1/310: write d3/d1d/d1f/f3f [328791,62768] 0 2024-03-18T14:43:13.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/258: dread d2/d4/f16 [0,4194304] 0 2024-03-18T14:43:13.183 INFO:tasks.workunit.client.0.smithi087.stdout:2/259: dwrite d2/d4/d22/d24/f2a [0,4194304] 0 2024-03-18T14:43:13.186 INFO:tasks.workunit.client.1.smithi129.stdout:1/49: truncate d1/f9 2230041 0 2024-03-18T14:43:13.187 INFO:tasks.workunit.client.0.smithi087.stdout:2/260: dwrite d2/f2f [0,4194304] 0 2024-03-18T14:43:13.187 INFO:tasks.workunit.client.1.smithi129.stdout:1/50: fdatasync d1/d2/f5 0 2024-03-18T14:43:13.188 INFO:tasks.workunit.client.1.smithi129.stdout:1/51: write d1/d2/f3 [2305774,81015] 0 2024-03-18T14:43:13.188 INFO:tasks.workunit.client.0.smithi087.stdout:7/344: mkdir d1/d6/da/d42/d61/d74 0 2024-03-18T14:43:13.189 INFO:tasks.workunit.client.1.smithi129.stdout:6/89: sync 2024-03-18T14:43:13.189 INFO:tasks.workunit.client.1.smithi129.stdout:6/90: stat d3/d5/db/de 0 2024-03-18T14:43:13.190 INFO:tasks.workunit.client.1.smithi129.stdout:2/51: dread d7/fa [0,4194304] 0 2024-03-18T14:43:13.191 INFO:tasks.workunit.client.0.smithi087.stdout:4/228: truncate d2/db/de/f44 938805 0 2024-03-18T14:43:13.192 INFO:tasks.workunit.client.1.smithi129.stdout:9/72: symlink d0/db/l17 0 2024-03-18T14:43:13.196 INFO:tasks.workunit.client.0.smithi087.stdout:7/345: dwrite d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:13.197 INFO:tasks.workunit.client.1.smithi129.stdout:9/73: dwrite d0/f16 [0,4194304] 0 2024-03-18T14:43:13.197 INFO:tasks.workunit.client.1.smithi129.stdout:9/74: stat d0/f8 0 2024-03-18T14:43:13.198 INFO:tasks.workunit.client.1.smithi129.stdout:0/109: mkdir d0/d23 0 2024-03-18T14:43:13.198 INFO:tasks.workunit.client.1.smithi129.stdout:3/63: stat d4/c5 0 2024-03-18T14:43:13.198 INFO:tasks.workunit.client.1.smithi129.stdout:9/75: dread - d0/f13 zero size 2024-03-18T14:43:13.198 INFO:tasks.workunit.client.1.smithi129.stdout:0/110: chown d0/d23 1369 1 2024-03-18T14:43:13.199 INFO:tasks.workunit.client.1.smithi129.stdout:0/111: fdatasync d0/f1e 0 2024-03-18T14:43:13.200 INFO:tasks.workunit.client.0.smithi087.stdout:4/229: creat d2/db/d24/d30/f4a x:0 0 0 2024-03-18T14:43:13.201 INFO:tasks.workunit.client.0.smithi087.stdout:4/230: dread - d2/d13/d28/f42 zero size 2024-03-18T14:43:13.201 INFO:tasks.workunit.client.0.smithi087.stdout:8/269: truncate d1/f32 445343 0 2024-03-18T14:43:13.203 INFO:tasks.workunit.client.1.smithi129.stdout:6/91: creat d3/d5/db/df/f1b x:0 0 0 2024-03-18T14:43:13.203 INFO:tasks.workunit.client.1.smithi129.stdout:2/52: write d7/fc [545636,10441] 0 2024-03-18T14:43:13.206 INFO:tasks.workunit.client.1.smithi129.stdout:6/92: dread d3/d5/db/fd [0,4194304] 0 2024-03-18T14:43:13.207 INFO:tasks.workunit.client.0.smithi087.stdout:3/320: truncate d0/d3/fc 2353334 0 2024-03-18T14:43:13.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/231: write d2/d13/f3f [1273685,91648] 0 2024-03-18T14:43:13.210 INFO:tasks.workunit.client.0.smithi087.stdout:4/232: write d2/db/d24/f33 [681653,127092] 0 2024-03-18T14:43:13.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/270: mknod d1/d6/d2f/d44/d4b/c57 0 2024-03-18T14:43:13.212 INFO:tasks.workunit.client.0.smithi087.stdout:3/321: mkdir d0/de/d30/d60 0 2024-03-18T14:43:13.214 INFO:tasks.workunit.client.1.smithi129.stdout:5/77: creat d0/f11 x:0 0 0 2024-03-18T14:43:13.214 INFO:tasks.workunit.client.1.smithi129.stdout:3/64: symlink d4/dd/l10 0 2024-03-18T14:43:13.214 INFO:tasks.workunit.client.1.smithi129.stdout:0/112: creat d0/d14/f24 x:0 0 0 2024-03-18T14:43:13.215 INFO:tasks.workunit.client.1.smithi129.stdout:5/78: fsync d0/f4 0 2024-03-18T14:43:13.215 INFO:tasks.workunit.client.1.smithi129.stdout:9/76: write d0/db/fd [2369841,113558] 0 2024-03-18T14:43:13.215 INFO:tasks.workunit.client.1.smithi129.stdout:0/113: readlink d0/l18 0 2024-03-18T14:43:13.216 INFO:tasks.workunit.client.1.smithi129.stdout:0/114: write d0/d14/f24 [84510,95759] 0 2024-03-18T14:43:13.217 INFO:tasks.workunit.client.1.smithi129.stdout:8/106: getdents d9/d11/d1a/d14 0 2024-03-18T14:43:13.217 INFO:tasks.workunit.client.0.smithi087.stdout:4/233: creat d2/db/d24/f4b x:0 0 0 2024-03-18T14:43:13.217 INFO:tasks.workunit.client.0.smithi087.stdout:4/234: stat f1 0 2024-03-18T14:43:13.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/346: link d1/d6/d29/d2f/d68/d65/l6f d1/d6/d29/d2f/d68/d65/d60/l75 0 2024-03-18T14:43:13.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/347: chown d1/d6/l69 30537 1 2024-03-18T14:43:13.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/255: dread d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:13.223 INFO:tasks.workunit.client.0.smithi087.stdout:6/256: dread d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:13.225 INFO:tasks.workunit.client.0.smithi087.stdout:7/348: fdatasync d1/d6/d16/f4e 0 2024-03-18T14:43:13.227 INFO:tasks.workunit.client.0.smithi087.stdout:6/257: rename d3/d1a/d29/d22/d23/c49 to d3/d1a/d46/c58 0 2024-03-18T14:43:13.228 INFO:tasks.workunit.client.1.smithi129.stdout:3/65: mkdir d4/d11 0 2024-03-18T14:43:13.229 INFO:tasks.workunit.client.1.smithi129.stdout:0/115: symlink d0/d14/l25 0 2024-03-18T14:43:13.229 INFO:tasks.workunit.client.1.smithi129.stdout:1/52: link d1/cf d1/d2/c10 0 2024-03-18T14:43:13.229 INFO:tasks.workunit.client.1.smithi129.stdout:8/107: creat d9/d11/f23 x:0 0 0 2024-03-18T14:43:13.230 INFO:tasks.workunit.client.1.smithi129.stdout:8/108: readlink d9/d11/l12 0 2024-03-18T14:43:13.231 INFO:tasks.workunit.client.1.smithi129.stdout:6/93: truncate d3/d5/f11 235483 0 2024-03-18T14:43:13.232 INFO:tasks.workunit.client.0.smithi087.stdout:6/258: fsync d3/f6 0 2024-03-18T14:43:13.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/247: dread d0/d1a/f20 [0,4194304] 0 2024-03-18T14:43:13.234 INFO:tasks.workunit.client.0.smithi087.stdout:9/354: dread db/d31/f36 [0,4194304] 0 2024-03-18T14:43:13.235 INFO:tasks.workunit.client.1.smithi129.stdout:8/109: dwrite d9/f1d [0,4194304] 0 2024-03-18T14:43:13.236 INFO:tasks.workunit.client.1.smithi129.stdout:6/94: dread d3/d5/f13 [0,4194304] 0 2024-03-18T14:43:13.236 INFO:tasks.workunit.client.1.smithi129.stdout:0/116: rename d0/d14/l1d to d0/l26 0 2024-03-18T14:43:13.236 INFO:tasks.workunit.client.0.smithi087.stdout:0/248: mknod d0/d2/d4/d27/d32/c57 0 2024-03-18T14:43:13.237 INFO:tasks.workunit.client.1.smithi129.stdout:1/53: rename d1/d2/cd to d1/d2/c11 0 2024-03-18T14:43:13.238 INFO:tasks.workunit.client.1.smithi129.stdout:5/79: link d0/ce d0/df/c12 0 2024-03-18T14:43:13.239 INFO:tasks.workunit.client.0.smithi087.stdout:0/249: creat d0/d2/d3c/f58 x:0 0 0 2024-03-18T14:43:13.240 INFO:tasks.workunit.client.1.smithi129.stdout:6/95: creat d3/d5/f1c x:0 0 0 2024-03-18T14:43:13.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/250: mknod d0/d2/d4/d19/c59 0 2024-03-18T14:43:13.241 INFO:tasks.workunit.client.0.smithi087.stdout:1/311: dread d3/d1d/d1f/f3f [0,4194304] 0 2024-03-18T14:43:13.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/251: stat d0/d2/d4/d19/d24/l4f 0 2024-03-18T14:43:13.241 INFO:tasks.workunit.client.1.smithi129.stdout:6/96: chown d3/d5/f13 0 1 2024-03-18T14:43:13.245 INFO:tasks.workunit.client.1.smithi129.stdout:9/77: getdents d0/db/d11 0 2024-03-18T14:43:13.246 INFO:tasks.workunit.client.1.smithi129.stdout:0/117: creat d0/d23/f27 x:0 0 0 2024-03-18T14:43:13.249 INFO:tasks.workunit.client.0.smithi087.stdout:1/312: fsync d3/d1d/d1e/d20/f56 0 2024-03-18T14:43:13.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/313: fdatasync d3/d1d/d1e/d20/f56 0 2024-03-18T14:43:13.251 INFO:tasks.workunit.client.1.smithi129.stdout:2/53: getdents d7 0 2024-03-18T14:43:13.251 INFO:tasks.workunit.client.1.smithi129.stdout:1/54: dread d1/f7 [0,4194304] 0 2024-03-18T14:43:13.252 INFO:tasks.workunit.client.1.smithi129.stdout:7/66: truncate d4/d7/d8/f11 1747910 0 2024-03-18T14:43:13.253 INFO:tasks.workunit.client.1.smithi129.stdout:0/118: dwrite d0/f1e [0,4194304] 0 2024-03-18T14:43:13.253 INFO:tasks.workunit.client.1.smithi129.stdout:0/119: dread - d0/d23/f27 zero size 2024-03-18T14:43:13.254 INFO:tasks.workunit.client.0.smithi087.stdout:0/252: getdents d0/d1a/d34 0 2024-03-18T14:43:13.255 INFO:tasks.workunit.client.1.smithi129.stdout:9/78: creat d0/db/f18 x:0 0 0 2024-03-18T14:43:13.255 INFO:tasks.workunit.client.0.smithi087.stdout:0/253: mkdir d0/d2/d4/d19/d5a 0 2024-03-18T14:43:13.255 INFO:tasks.workunit.client.1.smithi129.stdout:9/79: stat d0/l6 0 2024-03-18T14:43:13.256 INFO:tasks.workunit.client.0.smithi087.stdout:0/254: chown d0/d2/d4/d19/d24/c35 3 1 2024-03-18T14:43:13.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/314: read d3/d1d/d1e/f36 [323362,78580] 0 2024-03-18T14:43:13.258 INFO:tasks.workunit.client.1.smithi129.stdout:5/80: truncate d0/f6 127821 0 2024-03-18T14:43:13.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/315: dread - d3/d1d/d1e/d20/f5f zero size 2024-03-18T14:43:13.260 INFO:tasks.workunit.client.0.smithi087.stdout:0/255: creat d0/d2/d4/d19/d5a/f5b x:0 0 0 2024-03-18T14:43:13.261 INFO:tasks.workunit.client.1.smithi129.stdout:0/120: unlink d0/d23/f27 0 2024-03-18T14:43:13.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/316: getdents d3/d1d/d1f/d34 0 2024-03-18T14:43:13.265 INFO:tasks.workunit.client.1.smithi129.stdout:4/59: write d0/f5 [1510438,9092] 0 2024-03-18T14:43:13.266 INFO:tasks.workunit.client.0.smithi087.stdout:5/306: rmdir d13/d1b/d27/d28 39 2024-03-18T14:43:13.266 INFO:tasks.workunit.client.0.smithi087.stdout:1/317: chown d3/d1d/d1e/d20/f52 0 1 2024-03-18T14:43:13.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/261: sync 2024-03-18T14:43:13.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/66: rmdir d4/dd 39 2024-03-18T14:43:13.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/307: read - d13/d1b/f64 zero size 2024-03-18T14:43:13.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/256: dwrite d0/d2/f4a [0,4194304] 0 2024-03-18T14:43:13.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/318: read d3/d1d/f28 [1854223,97414] 0 2024-03-18T14:43:13.270 INFO:tasks.workunit.client.0.smithi087.stdout:7/349: dread d1/d6/d16/f1e [0,4194304] 0 2024-03-18T14:43:13.271 INFO:tasks.workunit.client.1.smithi129.stdout:2/54: creat d7/dd/f10 x:0 0 0 2024-03-18T14:43:13.271 INFO:tasks.workunit.client.1.smithi129.stdout:2/55: stat d7/lf 0 2024-03-18T14:43:13.272 INFO:tasks.workunit.client.0.smithi087.stdout:1/319: write d3/d1d/d1e/f37 [4556708,8007] 0 2024-03-18T14:43:13.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/235: dread d2/db/de/f44 [0,4194304] 0 2024-03-18T14:43:13.272 INFO:tasks.workunit.client.0.smithi087.stdout:8/271: truncate d1/d6/d2f/f31 794460 0 2024-03-18T14:43:13.275 INFO:tasks.workunit.client.0.smithi087.stdout:8/272: read d1/f2 [2420145,6626] 0 2024-03-18T14:43:13.276 INFO:tasks.workunit.client.0.smithi087.stdout:3/322: dwrite d0/f52 [0,4194304] 0 2024-03-18T14:43:13.278 INFO:tasks.workunit.client.0.smithi087.stdout:8/273: read d1/d6/d2f/f39 [694364,54934] 0 2024-03-18T14:43:13.279 INFO:tasks.workunit.client.1.smithi129.stdout:4/60: truncate d0/fd 2845570 0 2024-03-18T14:43:13.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/262: rmdir d2/d4/d22/d2c 39 2024-03-18T14:43:13.282 INFO:tasks.workunit.client.0.smithi087.stdout:3/323: dwrite d0/d3/d40/f56 [0,4194304] 0 2024-03-18T14:43:13.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/350: creat d1/f76 x:0 0 0 2024-03-18T14:43:13.287 INFO:tasks.workunit.client.1.smithi129.stdout:4/61: dwrite d0/f8 [8388608,4194304] 0 2024-03-18T14:43:13.289 INFO:tasks.workunit.client.0.smithi087.stdout:1/320: rmdir d3/d1d/d1e/d20 39 2024-03-18T14:43:13.289 INFO:tasks.workunit.client.1.smithi129.stdout:8/110: truncate d9/d11/d1a/fe 720409 0 2024-03-18T14:43:13.289 INFO:tasks.workunit.client.1.smithi129.stdout:6/97: dread d3/d5/f11 [0,4194304] 0 2024-03-18T14:43:13.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/355: dread db/d18/f2a [0,4194304] 0 2024-03-18T14:43:13.290 INFO:tasks.workunit.client.1.smithi129.stdout:9/80: write d0/f4 [364024,124177] 0 2024-03-18T14:43:13.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/324: dread d0/d3/f29 [0,4194304] 0 2024-03-18T14:43:13.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/259: sync 2024-03-18T14:43:13.293 INFO:tasks.workunit.client.1.smithi129.stdout:2/56: mknod d7/dd/c11 0 2024-03-18T14:43:13.293 INFO:tasks.workunit.client.1.smithi129.stdout:4/62: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:13.293 INFO:tasks.workunit.client.1.smithi129.stdout:5/81: mknod d0/c13 0 2024-03-18T14:43:13.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/325: dwrite d0/d3/df/f33 [0,4194304] 0 2024-03-18T14:43:13.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/260: dwrite d3/d7/f44 [0,4194304] 0 2024-03-18T14:43:13.298 INFO:tasks.workunit.client.1.smithi129.stdout:5/82: dwrite d0/f1 [4194304,4194304] 0 2024-03-18T14:43:13.298 INFO:tasks.workunit.client.0.smithi087.stdout:3/326: stat d0/d3/d10/f5e 0 2024-03-18T14:43:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:5/308: rename d13/d1b/f31 to d13/d1b/d30/f67 0 2024-03-18T14:43:13.300 INFO:tasks.workunit.client.0.smithi087.stdout:7/351: mknod d1/d6/d29/d2f/c77 0 2024-03-18T14:43:13.300 INFO:tasks.workunit.client.1.smithi129.stdout:8/111: read f8 [1040656,72237] 0 2024-03-18T14:43:13.300 INFO:tasks.workunit.client.1.smithi129.stdout:2/57: rename d7/dd/f10 to d7/dd/f12 0 2024-03-18T14:43:13.301 INFO:tasks.workunit.client.0.smithi087.stdout:5/309: fdatasync d13/f3f 0 2024-03-18T14:43:13.301 INFO:tasks.workunit.client.1.smithi129.stdout:6/98: dread d3/d5/fa [0,4194304] 0 2024-03-18T14:43:13.301 INFO:tasks.workunit.client.1.smithi129.stdout:2/58: write d7/fc [1161037,67912] 0 2024-03-18T14:43:13.302 INFO:tasks.workunit.client.1.smithi129.stdout:2/59: dread - f5 zero size 2024-03-18T14:43:13.302 INFO:tasks.workunit.client.0.smithi087.stdout:8/274: mkdir d1/d6/d2f/d44/d45/d50/d58 0 2024-03-18T14:43:13.303 INFO:tasks.workunit.client.1.smithi129.stdout:3/67: link d4/c5 d4/d11/c12 0 2024-03-18T14:43:13.303 INFO:tasks.workunit.client.0.smithi087.stdout:8/275: stat d1/d6/d9/l33 0 2024-03-18T14:43:13.304 INFO:tasks.workunit.client.1.smithi129.stdout:3/68: chown d4/fb 143 1 2024-03-18T14:43:13.305 INFO:tasks.workunit.client.1.smithi129.stdout:0/121: sync 2024-03-18T14:43:13.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/257: write d0/dd/f38 [1562346,63433] 0 2024-03-18T14:43:13.311 INFO:tasks.workunit.client.1.smithi129.stdout:1/55: dwrite d1/f9 [0,4194304] 0 2024-03-18T14:43:13.311 INFO:tasks.workunit.client.1.smithi129.stdout:9/81: mkdir d0/db/de/d19 0 2024-03-18T14:43:13.314 INFO:tasks.workunit.client.0.smithi087.stdout:1/321: mknod d3/d1d/d1e/d43/d50/d54/c61 0 2024-03-18T14:43:13.314 INFO:tasks.workunit.client.0.smithi087.stdout:4/236: rename d2/db/d24/d30/f3a to d2/db/d24/f4c 0 2024-03-18T14:43:13.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/327: chown d0/d3/f7 151334228 1 2024-03-18T14:43:13.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/263: creat d2/d4/d22/f4d x:0 0 0 2024-03-18T14:43:13.315 INFO:tasks.workunit.client.1.smithi129.stdout:1/56: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:13.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/328: chown d0/d1c/f4b 0 1 2024-03-18T14:43:13.316 INFO:tasks.workunit.client.1.smithi129.stdout:1/57: read d1/f7 [1397189,24028] 0 2024-03-18T14:43:13.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/264: dread - d2/d4/d22/f39 zero size 2024-03-18T14:43:13.317 INFO:tasks.workunit.client.0.smithi087.stdout:3/329: chown d0/fb 455057 1 2024-03-18T14:43:13.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/276: symlink d1/d6/d2f/d44/d4b/l59 0 2024-03-18T14:43:13.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/99: symlink d3/d6/l1d 0 2024-03-18T14:43:13.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/100: chown d3/d6/f8 764 1 2024-03-18T14:43:13.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/277: chown d1/c11 6 1 2024-03-18T14:43:13.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/265: dread d2/d4/d22/f36 [0,4194304] 0 2024-03-18T14:43:13.322 INFO:tasks.workunit.client.0.smithi087.stdout:3/330: dwrite d0/d3/f29 [0,4194304] 0 2024-03-18T14:43:13.322 INFO:tasks.workunit.client.0.smithi087.stdout:9/356: dread db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:13.325 INFO:tasks.workunit.client.1.smithi129.stdout:2/60: rename d7/le to d7/dd/l13 0 2024-03-18T14:43:13.326 INFO:tasks.workunit.client.1.smithi129.stdout:8/112: write d9/f1b [5018318,40683] 0 2024-03-18T14:43:13.326 INFO:tasks.workunit.client.1.smithi129.stdout:7/67: truncate d4/d7/d8/f11 680122 0 2024-03-18T14:43:13.328 INFO:tasks.workunit.client.1.smithi129.stdout:0/122: mkdir d0/d14/d28 0 2024-03-18T14:43:13.329 INFO:tasks.workunit.client.0.smithi087.stdout:1/322: write d3/d1d/d1e/d20/f5f [640482,34943] 0 2024-03-18T14:43:13.330 INFO:tasks.workunit.client.1.smithi129.stdout:0/123: write d0/d14/f24 [31868,102092] 0 2024-03-18T14:43:13.331 INFO:tasks.workunit.client.0.smithi087.stdout:4/237: mkdir d2/db/d24/d30/d4d 0 2024-03-18T14:43:13.331 INFO:tasks.workunit.client.0.smithi087.stdout:4/238: dread - d2/db/d24/f4b zero size 2024-03-18T14:43:13.331 INFO:tasks.workunit.client.1.smithi129.stdout:4/63: creat d0/f16 x:0 0 0 2024-03-18T14:43:13.332 INFO:tasks.workunit.client.1.smithi129.stdout:7/68: dwrite d4/d7/d8/d12/f14 [0,4194304] 0 2024-03-18T14:43:13.333 INFO:tasks.workunit.client.1.smithi129.stdout:4/64: fdatasync d0/f8 0 2024-03-18T14:43:13.334 INFO:tasks.workunit.client.1.smithi129.stdout:1/58: stat d1/d2/c11 0 2024-03-18T14:43:13.334 INFO:tasks.workunit.client.1.smithi129.stdout:1/59: chown d1 2189382 1 2024-03-18T14:43:13.335 INFO:tasks.workunit.client.1.smithi129.stdout:6/101: creat d3/d5/db/f1e x:0 0 0 2024-03-18T14:43:13.337 INFO:tasks.workunit.client.1.smithi129.stdout:2/61: rename c1 to d7/dd/c14 0 2024-03-18T14:43:13.337 INFO:tasks.workunit.client.1.smithi129.stdout:0/124: dread d0/fb [0,4194304] 0 2024-03-18T14:43:13.339 INFO:tasks.workunit.client.1.smithi129.stdout:8/113: creat d9/d11/d18/f24 x:0 0 0 2024-03-18T14:43:13.340 INFO:tasks.workunit.client.0.smithi087.stdout:0/258: symlink d0/l5c 0 2024-03-18T14:43:13.340 INFO:tasks.workunit.client.1.smithi129.stdout:0/125: write d0/fb [1410589,102307] 0 2024-03-18T14:43:13.341 INFO:tasks.workunit.client.1.smithi129.stdout:5/83: creat d0/f14 x:0 0 0 2024-03-18T14:43:13.342 INFO:tasks.workunit.client.1.smithi129.stdout:9/82: getdents d0/d15 0 2024-03-18T14:43:13.342 INFO:tasks.workunit.client.1.smithi129.stdout:4/65: dwrite d0/f8 [4194304,4194304] 0 2024-03-18T14:43:13.343 INFO:tasks.workunit.client.0.smithi087.stdout:3/331: truncate d0/d3/fc 117601 0 2024-03-18T14:43:13.344 INFO:tasks.workunit.client.1.smithi129.stdout:4/66: fdatasync d0/f13 0 2024-03-18T14:43:13.344 INFO:tasks.workunit.client.0.smithi087.stdout:0/259: dwrite d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:13.345 INFO:tasks.workunit.client.1.smithi129.stdout:1/60: creat d1/d2/f12 x:0 0 0 2024-03-18T14:43:13.345 INFO:tasks.workunit.client.1.smithi129.stdout:6/102: dwrite d3/d5/f9 [0,4194304] 0 2024-03-18T14:43:13.346 INFO:tasks.workunit.client.1.smithi129.stdout:2/62: creat d7/dd/f15 x:0 0 0 2024-03-18T14:43:13.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/261: link d3/c38 d3/d1a/d46/c59 0 2024-03-18T14:43:13.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/69: rename d4/c8 to d4/c13 0 2024-03-18T14:43:13.348 INFO:tasks.workunit.client.1.smithi129.stdout:8/114: symlink d9/l25 0 2024-03-18T14:43:13.348 INFO:tasks.workunit.client.1.smithi129.stdout:4/67: write d0/f13 [265120,20120] 0 2024-03-18T14:43:13.349 INFO:tasks.workunit.client.0.smithi087.stdout:7/352: getdents d1/d6/da/d42 0 2024-03-18T14:43:13.349 INFO:tasks.workunit.client.0.smithi087.stdout:7/353: chown d1/d6/da/f37 495295992 1 2024-03-18T14:43:13.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/103: read - d3/d5/db/df/f14 zero size 2024-03-18T14:43:13.350 INFO:tasks.workunit.client.0.smithi087.stdout:5/310: getdents d13/d1b/d27/d35 0 2024-03-18T14:43:13.352 INFO:tasks.workunit.client.1.smithi129.stdout:0/126: dread d0/f1e [0,4194304] 0 2024-03-18T14:43:13.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/323: dread d3/d1d/d1e/d20/f5f [0,4194304] 0 2024-03-18T14:43:13.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/278: rmdir d1/d6/d2f/d44/d4b 39 2024-03-18T14:43:13.354 INFO:tasks.workunit.client.1.smithi129.stdout:9/83: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:13.354 INFO:tasks.workunit.client.1.smithi129.stdout:5/84: dwrite d0/f9 [0,4194304] 0 2024-03-18T14:43:13.354 INFO:tasks.workunit.client.1.smithi129.stdout:7/69: link d4/d7/fa d4/d7/d8/f15 0 2024-03-18T14:43:13.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/266: creat d2/d4/d22/f4e x:0 0 0 2024-03-18T14:43:13.357 INFO:tasks.workunit.client.1.smithi129.stdout:0/127: write d0/d14/f24 [354826,12106] 0 2024-03-18T14:43:13.358 INFO:tasks.workunit.client.1.smithi129.stdout:2/63: dread d7/fa [0,4194304] 0 2024-03-18T14:43:13.360 INFO:tasks.workunit.client.1.smithi129.stdout:2/64: write f0 [412565,79584] 0 2024-03-18T14:43:13.360 INFO:tasks.workunit.client.1.smithi129.stdout:4/68: dwrite d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:13.362 INFO:tasks.workunit.client.0.smithi087.stdout:0/260: mkdir d0/d2/d4/d19/d24/d5d 0 2024-03-18T14:43:13.363 INFO:tasks.workunit.client.0.smithi087.stdout:9/357: link db/d18/d1e/c3c db/d18/d1e/d28/c6c 0 2024-03-18T14:43:13.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/85: dread d0/f1 [4194304,4194304] 0 2024-03-18T14:43:13.364 INFO:tasks.workunit.client.1.smithi129.stdout:1/61: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:13.364 INFO:tasks.workunit.client.0.smithi087.stdout:5/311: mknod d13/d1b/d27/d35/d3b/c68 0 2024-03-18T14:43:13.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/324: creat d3/d1d/d1f/d34/f62 x:0 0 0 2024-03-18T14:43:13.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/86: fsync d0/f14 0 2024-03-18T14:43:13.365 INFO:tasks.workunit.client.0.smithi087.stdout:5/312: readlink d13/d1b/d30/l61 0 2024-03-18T14:43:13.365 INFO:tasks.workunit.client.0.smithi087.stdout:5/313: chown d13/l15 1526404733 1 2024-03-18T14:43:13.365 INFO:tasks.workunit.client.1.smithi129.stdout:8/115: symlink d9/d11/l26 0 2024-03-18T14:43:13.366 INFO:tasks.workunit.client.0.smithi087.stdout:8/279: symlink d1/d6/d2f/d44/d45/d50/l5a 0 2024-03-18T14:43:13.366 INFO:tasks.workunit.client.1.smithi129.stdout:1/62: write d1/d2/f5 [1393624,18734] 0 2024-03-18T14:43:13.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/280: chown d1/d6/d2f 2 1 2024-03-18T14:43:13.367 INFO:tasks.workunit.client.0.smithi087.stdout:8/281: readlink d1/d6/d14/l49 0 2024-03-18T14:43:13.367 INFO:tasks.workunit.client.1.smithi129.stdout:1/63: stat d1/f9 0 2024-03-18T14:43:13.368 INFO:tasks.workunit.client.0.smithi087.stdout:9/358: creat db/d31/f6d x:0 0 0 2024-03-18T14:43:13.368 INFO:tasks.workunit.client.1.smithi129.stdout:4/69: dwrite d0/f8 [8388608,4194304] 0 2024-03-18T14:43:13.369 INFO:tasks.workunit.client.0.smithi087.stdout:0/261: creat d0/d2/d4/d19/f5e x:0 0 0 2024-03-18T14:43:13.369 INFO:tasks.workunit.client.1.smithi129.stdout:4/70: readlink d0/l12 0 2024-03-18T14:43:13.370 INFO:tasks.workunit.client.1.smithi129.stdout:6/104: rename d3/d5/f9 to d3/d5/db/de/f1f 0 2024-03-18T14:43:13.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/87: dread d0/dc/fd [4194304,4194304] 0 2024-03-18T14:43:13.372 INFO:tasks.workunit.client.1.smithi129.stdout:9/84: creat d0/db/d11/f1a x:0 0 0 2024-03-18T14:43:13.373 INFO:tasks.workunit.client.1.smithi129.stdout:0/128: fdatasync d0/f1e 0 2024-03-18T14:43:13.377 INFO:tasks.workunit.client.1.smithi129.stdout:0/129: dread d0/fd [0,4194304] 0 2024-03-18T14:43:13.380 INFO:tasks.workunit.client.1.smithi129.stdout:2/65: dwrite d7/dd/f12 [0,4194304] 0 2024-03-18T14:43:13.380 INFO:tasks.workunit.client.1.smithi129.stdout:2/66: read - d7/dd/f15 zero size 2024-03-18T14:43:13.382 INFO:tasks.workunit.client.1.smithi129.stdout:6/105: creat d3/d5/db/f20 x:0 0 0 2024-03-18T14:43:13.383 INFO:tasks.workunit.client.1.smithi129.stdout:9/85: stat d0/c9 0 2024-03-18T14:43:13.389 INFO:tasks.workunit.client.1.smithi129.stdout:9/86: dwrite d0/fc [0,4194304] 0 2024-03-18T14:43:13.389 INFO:tasks.workunit.client.1.smithi129.stdout:0/130: mkdir d0/d23/d29 0 2024-03-18T14:43:13.390 INFO:tasks.workunit.client.1.smithi129.stdout:0/131: fdatasync d0/f11 0 2024-03-18T14:43:13.391 INFO:tasks.workunit.client.0.smithi087.stdout:7/354: truncate d1/d6/f2a 1334528 0 2024-03-18T14:43:13.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/267: symlink d2/d4/d22/l4f 0 2024-03-18T14:43:13.391 INFO:tasks.workunit.client.0.smithi087.stdout:8/282: creat d1/d6/d14/f5b x:0 0 0 2024-03-18T14:43:13.392 INFO:tasks.workunit.client.1.smithi129.stdout:3/70: rename d4/d11/c12 to d4/dd/c14 0 2024-03-18T14:43:13.392 INFO:tasks.workunit.client.0.smithi087.stdout:9/359: mkdir db/d31/d6e 0 2024-03-18T14:43:13.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/332: dread d0/d3/d10/f2c [0,4194304] 0 2024-03-18T14:43:13.392 INFO:tasks.workunit.client.0.smithi087.stdout:0/262: rename d0/d1a/f48 to d0/d1a/d34/f5f 0 2024-03-18T14:43:13.393 INFO:tasks.workunit.client.1.smithi129.stdout:5/88: mknod d0/c15 0 2024-03-18T14:43:13.393 INFO:tasks.workunit.client.0.smithi087.stdout:6/262: getdents d3/d1a/d29 0 2024-03-18T14:43:13.393 INFO:tasks.workunit.client.0.smithi087.stdout:2/268: stat d2/d4/d22/l48 0 2024-03-18T14:43:13.394 INFO:tasks.workunit.client.1.smithi129.stdout:0/132: dread d0/fb [0,4194304] 0 2024-03-18T14:43:13.394 INFO:tasks.workunit.client.1.smithi129.stdout:0/133: chown d0/d14/d28 225 1 2024-03-18T14:43:13.394 INFO:tasks.workunit.client.0.smithi087.stdout:7/355: write d1/d6/d16/dc/f32 [1255648,1055] 0 2024-03-18T14:43:13.395 INFO:tasks.workunit.client.0.smithi087.stdout:0/263: fsync d0/d2/d4/f4c 0 2024-03-18T14:43:13.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/314: rename d13/l19 to d13/d1b/d27/d28/l69 0 2024-03-18T14:43:13.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/315: fsync d13/d1b/d30/f5d 0 2024-03-18T14:43:13.397 INFO:tasks.workunit.client.0.smithi087.stdout:8/283: creat d1/d6/d14/f5c x:0 0 0 2024-03-18T14:43:13.398 INFO:tasks.workunit.client.1.smithi129.stdout:3/71: mkdir d4/dd/d15 0 2024-03-18T14:43:13.401 INFO:tasks.workunit.client.0.smithi087.stdout:7/356: symlink d1/d6/da/d42/d61/l78 0 2024-03-18T14:43:13.403 INFO:tasks.workunit.client.0.smithi087.stdout:9/360: mkdir db/d18/d1c/d69/d6f 0 2024-03-18T14:43:13.403 INFO:tasks.workunit.client.0.smithi087.stdout:8/284: mkdir d1/d6/d9/d5d 0 2024-03-18T14:43:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/285: chown d1/d6 678078122 1 2024-03-18T14:43:13.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/286: chown d1/d6/d14/f1c 0 1 2024-03-18T14:43:13.405 INFO:tasks.workunit.client.0.smithi087.stdout:5/316: creat d13/d1b/d27/d35/d3b/f6a x:0 0 0 2024-03-18T14:43:13.406 INFO:tasks.workunit.client.1.smithi129.stdout:2/67: fsync f0 0 2024-03-18T14:43:13.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/134: creat d0/d14/d28/f2a x:0 0 0 2024-03-18T14:43:13.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/333: creat d0/de/d30/d46/f61 x:0 0 0 2024-03-18T14:43:13.407 INFO:tasks.workunit.client.1.smithi129.stdout:2/68: chown d7/l9 2641 1 2024-03-18T14:43:13.408 INFO:tasks.workunit.client.0.smithi087.stdout:3/334: chown d0/d3/d10/f2c 0 1 2024-03-18T14:43:13.410 INFO:tasks.workunit.client.1.smithi129.stdout:1/64: rmdir d1 39 2024-03-18T14:43:13.411 INFO:tasks.workunit.client.0.smithi087.stdout:4/239: sync 2024-03-18T14:43:13.412 INFO:tasks.workunit.client.1.smithi129.stdout:3/72: mkdir d4/dd/d15/d16 0 2024-03-18T14:43:13.413 INFO:tasks.workunit.client.0.smithi087.stdout:9/361: creat db/d18/d1e/d28/f70 x:0 0 0 2024-03-18T14:43:13.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/362: fdatasync db/d18/d3a/f63 0 2024-03-18T14:43:13.418 INFO:tasks.workunit.client.0.smithi087.stdout:8/287: write d1/d6/d9/fe [8809778,83664] 0 2024-03-18T14:43:13.418 INFO:tasks.workunit.client.0.smithi087.stdout:8/288: dread - d1/d6/d2f/d44/d45/f4a zero size 2024-03-18T14:43:13.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/269: link d2/fb d2/d4/d22/f50 0 2024-03-18T14:43:13.419 INFO:tasks.workunit.client.0.smithi087.stdout:8/289: write d1/d6/f43 [214929,13088] 0 2024-03-18T14:43:13.420 INFO:tasks.workunit.client.0.smithi087.stdout:2/270: chown d2/d4/fd 367513 1 2024-03-18T14:43:13.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/264: truncate d0/d2/d4/d27/d32/f44 338477 0 2024-03-18T14:43:13.420 INFO:tasks.workunit.client.0.smithi087.stdout:2/271: fsync d2/f43 0 2024-03-18T14:43:13.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/116: truncate f6 4916735 0 2024-03-18T14:43:13.423 INFO:tasks.workunit.client.1.smithi129.stdout:4/71: sync 2024-03-18T14:43:13.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/263: write d3/d1a/d29/d22/d23/f30 [973868,85853] 0 2024-03-18T14:43:13.424 INFO:tasks.workunit.client.1.smithi129.stdout:6/106: write d3/d5/db/fd [1914754,28398] 0 2024-03-18T14:43:13.424 INFO:tasks.workunit.client.0.smithi087.stdout:6/264: readlink d3/d7/l4a 0 2024-03-18T14:43:13.425 INFO:tasks.workunit.client.1.smithi129.stdout:5/89: getdents d0/df 0 2024-03-18T14:43:13.426 INFO:tasks.workunit.client.1.smithi129.stdout:3/73: truncate d4/f6 4381250 0 2024-03-18T14:43:13.427 INFO:tasks.workunit.client.1.smithi129.stdout:7/70: dwrite d4/d7/d8/f9 [0,4194304] 0 2024-03-18T14:43:13.428 INFO:tasks.workunit.client.1.smithi129.stdout:7/71: chown d4/d7/d8/f15 69864160 1 2024-03-18T14:43:13.429 INFO:tasks.workunit.client.1.smithi129.stdout:4/72: creat d0/d9/f17 x:0 0 0 2024-03-18T14:43:13.429 INFO:tasks.workunit.client.1.smithi129.stdout:4/73: symlink d0/d9/l18 2 2024-03-18T14:43:13.429 INFO:tasks.workunit.client.1.smithi129.stdout:1/65: stat d1/cf 0 2024-03-18T14:43:13.430 INFO:tasks.workunit.client.1.smithi129.stdout:4/74: chown d0/d9/la 17312 1 2024-03-18T14:43:13.430 INFO:tasks.workunit.client.0.smithi087.stdout:4/240: rmdir d2 39 2024-03-18T14:43:13.431 INFO:tasks.workunit.client.0.smithi087.stdout:9/363: unlink c5 0 2024-03-18T14:43:13.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/335: dwrite d0/d3/fd [0,4194304] 0 2024-03-18T14:43:13.433 INFO:tasks.workunit.client.1.smithi129.stdout:2/69: truncate d7/fc 1747323 0 2024-03-18T14:43:13.434 INFO:tasks.workunit.client.0.smithi087.stdout:8/290: rename d1/d6/f2d to d1/d6/d2f/d44/d45/d50/f5e 0 2024-03-18T14:43:13.434 INFO:tasks.workunit.client.0.smithi087.stdout:1/325: sync 2024-03-18T14:43:13.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/265: symlink d0/dd/l60 0 2024-03-18T14:43:13.437 INFO:tasks.workunit.client.1.smithi129.stdout:8/117: dwrite f4 [0,4194304] 0 2024-03-18T14:43:13.438 INFO:tasks.workunit.client.1.smithi129.stdout:1/66: mknod d1/c13 0 2024-03-18T14:43:13.439 INFO:tasks.workunit.client.0.smithi087.stdout:8/291: dwrite d1/d6/d9/f3f [0,4194304] 0 2024-03-18T14:43:13.440 INFO:tasks.workunit.client.1.smithi129.stdout:0/135: getdents d0/d23 0 2024-03-18T14:43:13.441 INFO:tasks.workunit.client.0.smithi087.stdout:9/364: chown db/d12/f5e 2055583 1 2024-03-18T14:43:13.441 INFO:tasks.workunit.client.1.smithi129.stdout:3/74: symlink d4/dd/d15/d16/l17 0 2024-03-18T14:43:13.441 INFO:tasks.workunit.client.1.smithi129.stdout:0/136: dread - d0/d14/d28/f2a zero size 2024-03-18T14:43:13.442 INFO:tasks.workunit.client.1.smithi129.stdout:2/70: dwrite d7/dd/f15 [0,4194304] 0 2024-03-18T14:43:13.442 INFO:tasks.workunit.client.1.smithi129.stdout:8/118: mknod d9/c27 0 2024-03-18T14:43:13.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/292: dread d1/d6/d14/f2a [0,4194304] 0 2024-03-18T14:43:13.443 INFO:tasks.workunit.client.0.smithi087.stdout:2/272: creat d2/d4/d22/d2c/d3a/f51 x:0 0 0 2024-03-18T14:43:13.443 INFO:tasks.workunit.client.0.smithi087.stdout:8/293: fsync d1/d6/f43 0 2024-03-18T14:43:13.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/273: write d2/f43 [7854,46116] 0 2024-03-18T14:43:13.444 INFO:tasks.workunit.client.1.smithi129.stdout:6/107: write d3/d5/fa [1355928,51332] 0 2024-03-18T14:43:13.445 INFO:tasks.workunit.client.1.smithi129.stdout:5/90: truncate d0/f4 160806 0 2024-03-18T14:43:13.445 INFO:tasks.workunit.client.1.smithi129.stdout:5/91: stat d0/fb 0 2024-03-18T14:43:13.445 INFO:tasks.workunit.client.1.smithi129.stdout:7/72: dread f3 [0,4194304] 0 2024-03-18T14:43:13.446 INFO:tasks.workunit.client.1.smithi129.stdout:7/73: dread - d4/f5 zero size 2024-03-18T14:43:13.447 INFO:tasks.workunit.client.1.smithi129.stdout:1/67: rename d1/d2/lc to d1/d2/l14 0 2024-03-18T14:43:13.448 INFO:tasks.workunit.client.0.smithi087.stdout:0/266: creat d0/d2/d3c/f61 x:0 0 0 2024-03-18T14:43:13.448 INFO:tasks.workunit.client.0.smithi087.stdout:4/241: write d2/db/d24/f4c [3070927,30715] 0 2024-03-18T14:43:13.449 INFO:tasks.workunit.client.0.smithi087.stdout:0/267: write d0/d2/d4/d19/f2f [184266,118773] 0 2024-03-18T14:43:13.450 INFO:tasks.workunit.client.0.smithi087.stdout:0/268: dread - d0/d2/d4/d27/d29/d26/f4b zero size 2024-03-18T14:43:13.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/294: dread d1/d6/d14/f1f [0,4194304] 0 2024-03-18T14:43:13.452 INFO:tasks.workunit.client.0.smithi087.stdout:9/365: rename db/d18/d1e/f38 to db/d18/d1c/f71 0 2024-03-18T14:43:13.452 INFO:tasks.workunit.client.1.smithi129.stdout:6/108: mknod d3/c21 0 2024-03-18T14:43:13.452 INFO:tasks.workunit.client.0.smithi087.stdout:8/295: write d1/d6/d9/f51 [62444,43661] 0 2024-03-18T14:43:13.453 INFO:tasks.workunit.client.1.smithi129.stdout:0/137: dread d0/fd [0,4194304] 0 2024-03-18T14:43:13.453 INFO:tasks.workunit.client.1.smithi129.stdout:3/75: dread d4/fc [0,4194304] 0 2024-03-18T14:43:13.454 INFO:tasks.workunit.client.1.smithi129.stdout:1/68: dwrite d1/d2/f5 [0,4194304] 0 2024-03-18T14:43:13.455 INFO:tasks.workunit.client.0.smithi087.stdout:8/296: dread d1/d6/d14/f2a [0,4194304] 0 2024-03-18T14:43:13.456 INFO:tasks.workunit.client.0.smithi087.stdout:8/297: write d1/d6/d2f/f41 [912950,128367] 0 2024-03-18T14:43:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:4/242: stat d2/ca 0 2024-03-18T14:43:13.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/298: fdatasync d1/d6/d14/f27 0 2024-03-18T14:43:13.459 INFO:tasks.workunit.client.0.smithi087.stdout:5/317: sync 2024-03-18T14:43:13.459 INFO:tasks.workunit.client.0.smithi087.stdout:7/357: sync 2024-03-18T14:43:13.459 INFO:tasks.workunit.client.1.smithi129.stdout:5/92: truncate d0/f11 90922 0 2024-03-18T14:43:13.460 INFO:tasks.workunit.client.1.smithi129.stdout:9/87: sync 2024-03-18T14:43:13.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/243: write d2/db/d24/f4b [746319,98237] 0 2024-03-18T14:43:13.461 INFO:tasks.workunit.client.0.smithi087.stdout:8/299: chown d1/d6/d14/l46 386 1 2024-03-18T14:43:13.461 INFO:tasks.workunit.client.0.smithi087.stdout:0/269: mkdir d0/d2/d4/d19/d62 0 2024-03-18T14:43:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:2/274: dwrite d2/d4/f16 [0,4194304] 0 2024-03-18T14:43:13.462 INFO:tasks.workunit.client.0.smithi087.stdout:9/366: mknod db/d18/d1c/c72 0 2024-03-18T14:43:13.462 INFO:tasks.workunit.client.1.smithi129.stdout:1/69: unlink d1/d2/c11 0 2024-03-18T14:43:13.462 INFO:tasks.workunit.client.1.smithi129.stdout:3/76: mknod d4/c18 0 2024-03-18T14:43:13.463 INFO:tasks.workunit.client.0.smithi087.stdout:6/265: getdents d3/d1a/d46 0 2024-03-18T14:43:13.463 INFO:tasks.workunit.client.1.smithi129.stdout:3/77: fdatasync d4/fb 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.1.smithi129.stdout:3/78: fsync d4/fa 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.1.smithi129.stdout:0/138: mknod d0/d23/d29/c2b 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.1.smithi129.stdout:0/139: readlink d0/l17 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.1.smithi129.stdout:8/119: getdents d9/d11/d1a 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.0.smithi087.stdout:1/326: dread d3/f10 [0,4194304] 0 2024-03-18T14:43:13.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/266: write d3/d1a/f34 [344173,66834] 0 2024-03-18T14:43:13.465 INFO:tasks.workunit.client.1.smithi129.stdout:5/93: mkdir d0/dc/d16 0 2024-03-18T14:43:13.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/267: write d3/f45 [1503298,128895] 0 2024-03-18T14:43:13.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/268: stat d3/d1a/f1e 0 2024-03-18T14:43:13.466 INFO:tasks.workunit.client.0.smithi087.stdout:0/270: dread d0/d2/f4a [0,4194304] 0 2024-03-18T14:43:13.467 INFO:tasks.workunit.client.0.smithi087.stdout:7/358: creat d1/d6/d29/f79 x:0 0 0 2024-03-18T14:43:13.469 INFO:tasks.workunit.client.1.smithi129.stdout:9/88: creat d0/f1b x:0 0 0 2024-03-18T14:43:13.469 INFO:tasks.workunit.client.0.smithi087.stdout:4/244: chown d2/db/c14 1 1 2024-03-18T14:43:13.469 INFO:tasks.workunit.client.1.smithi129.stdout:9/89: chown d0/db/de/d19 191 1 2024-03-18T14:43:13.469 INFO:tasks.workunit.client.1.smithi129.stdout:3/79: mkdir d4/dd/d15/d19 0 2024-03-18T14:43:13.472 INFO:tasks.workunit.client.1.smithi129.stdout:1/70: chown d1/d2/l14 1631504 1 2024-03-18T14:43:13.473 INFO:tasks.workunit.client.1.smithi129.stdout:1/71: fsync d1/d2/f12 0 2024-03-18T14:43:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/245: dwrite d2/db/de/f2f [0,4194304] 0 2024-03-18T14:43:13.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/246: stat d2 0 2024-03-18T14:43:13.473 INFO:tasks.workunit.client.1.smithi129.stdout:9/90: dread d0/db/fd [0,4194304] 0 2024-03-18T14:43:13.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/336: truncate d0/d1c/f39 660528 0 2024-03-18T14:43:13.474 INFO:tasks.workunit.client.1.smithi129.stdout:9/91: readlink d0/db/l17 0 2024-03-18T14:43:13.476 INFO:tasks.workunit.client.0.smithi087.stdout:2/275: mkdir d2/d4/d22/d2c/d3a/d40/d52 0 2024-03-18T14:43:13.476 INFO:tasks.workunit.client.0.smithi087.stdout:5/318: mkdir d13/d6b 0 2024-03-18T14:43:13.477 INFO:tasks.workunit.client.0.smithi087.stdout:5/319: chown ca 499866753 1 2024-03-18T14:43:13.477 INFO:tasks.workunit.client.1.smithi129.stdout:6/109: write d3/d6/f8 [1095525,71465] 0 2024-03-18T14:43:13.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/140: mkdir d0/d23/d2c 0 2024-03-18T14:43:13.477 INFO:tasks.workunit.client.1.smithi129.stdout:8/120: creat d9/d11/d1a/d14/f28 x:0 0 0 2024-03-18T14:43:13.479 INFO:tasks.workunit.client.0.smithi087.stdout:1/327: mkdir d3/d1d/d1f/d63 0 2024-03-18T14:43:13.481 INFO:tasks.workunit.client.0.smithi087.stdout:6/269: creat d3/d1a/d29/f5a x:0 0 0 2024-03-18T14:43:13.481 INFO:tasks.workunit.client.1.smithi129.stdout:7/74: dwrite d4/fd [0,4194304] 0 2024-03-18T14:43:13.484 INFO:tasks.workunit.client.0.smithi087.stdout:6/270: dwrite d3/d7/f44 [4194304,4194304] 0 2024-03-18T14:43:13.485 INFO:tasks.workunit.client.0.smithi087.stdout:7/359: creat d1/d6/d29/d2f/d68/d65/d60/f7a x:0 0 0 2024-03-18T14:43:13.485 INFO:tasks.workunit.client.1.smithi129.stdout:0/141: creat d0/d14/f2d x:0 0 0 2024-03-18T14:43:13.486 INFO:tasks.workunit.client.1.smithi129.stdout:8/121: creat d9/dc/f29 x:0 0 0 2024-03-18T14:43:13.488 INFO:tasks.workunit.client.0.smithi087.stdout:2/276: symlink d2/d4/d22/d2c/d3a/d40/d4a/l53 0 2024-03-18T14:43:13.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/320: symlink d13/d1b/d27/d28/l6c 0 2024-03-18T14:43:13.490 INFO:tasks.workunit.client.1.smithi129.stdout:4/75: sync 2024-03-18T14:43:13.490 INFO:tasks.workunit.client.1.smithi129.stdout:6/110: rename d3/d5/fa to d3/d5/db/de/f22 0 2024-03-18T14:43:13.491 INFO:tasks.workunit.client.1.smithi129.stdout:4/76: write d0/f8 [5535370,125305] 0 2024-03-18T14:43:13.491 INFO:tasks.workunit.client.1.smithi129.stdout:4/77: fdatasync d0/d9/f17 0 2024-03-18T14:43:13.493 INFO:tasks.workunit.client.0.smithi087.stdout:0/271: getdents d0/d2/d4/d19/d62 0 2024-03-18T14:43:13.493 INFO:tasks.workunit.client.0.smithi087.stdout:6/271: symlink d3/d7/d25/l5b 0 2024-03-18T14:43:13.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/360: creat d1/d6/da/d42/f7b x:0 0 0 2024-03-18T14:43:13.498 INFO:tasks.workunit.client.1.smithi129.stdout:3/80: unlink d4/f6 0 2024-03-18T14:43:13.498 INFO:tasks.workunit.client.1.smithi129.stdout:0/142: symlink d0/l2e 0 2024-03-18T14:43:13.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/367: creat db/f73 x:0 0 0 2024-03-18T14:43:13.499 INFO:tasks.workunit.client.0.smithi087.stdout:8/300: rename d1/d6/d14/f1f to d1/d6/d2f/d44/f5f 0 2024-03-18T14:43:13.499 INFO:tasks.workunit.client.1.smithi129.stdout:8/122: write f8 [64341,121669] 0 2024-03-18T14:43:13.500 INFO:tasks.workunit.client.0.smithi087.stdout:9/368: stat db/d18/d1c/f40 0 2024-03-18T14:43:13.500 INFO:tasks.workunit.client.0.smithi087.stdout:9/369: readlink db/d18/d1c/l2b 0 2024-03-18T14:43:13.500 INFO:tasks.workunit.client.1.smithi129.stdout:0/143: chown d0/d14/l1c 15 1 2024-03-18T14:43:13.502 INFO:tasks.workunit.client.0.smithi087.stdout:2/277: mknod d2/d4/d22/c54 0 2024-03-18T14:43:13.503 INFO:tasks.workunit.client.1.smithi129.stdout:7/75: rename d4/d7/d8/f15 to d4/f16 0 2024-03-18T14:43:13.504 INFO:tasks.workunit.client.0.smithi087.stdout:7/361: creat d1/d6/d29/d2f/d6b/f7c x:0 0 0 2024-03-18T14:43:13.504 INFO:tasks.workunit.client.1.smithi129.stdout:5/94: dwrite d0/f4 [0,4194304] 0 2024-03-18T14:43:13.505 INFO:tasks.workunit.client.1.smithi129.stdout:6/111: symlink d3/d5/l23 0 2024-03-18T14:43:13.506 INFO:tasks.workunit.client.0.smithi087.stdout:8/301: creat d1/d6/d9/f60 x:0 0 0 2024-03-18T14:43:13.506 INFO:tasks.workunit.client.1.smithi129.stdout:9/92: truncate d0/db/d11/f1a 909546 0 2024-03-18T14:43:13.508 INFO:tasks.workunit.client.0.smithi087.stdout:9/370: rename db/d31/f34 to db/d31/f74 0 2024-03-18T14:43:13.508 INFO:tasks.workunit.client.1.smithi129.stdout:8/123: mknod d9/d11/d18/c2a 0 2024-03-18T14:43:13.509 INFO:tasks.workunit.client.0.smithi087.stdout:9/371: chown db/d18/d1e/f24 138 1 2024-03-18T14:43:13.510 INFO:tasks.workunit.client.0.smithi087.stdout:8/302: dwrite d1/d6/d14/f5b [0,4194304] 0 2024-03-18T14:43:13.511 INFO:tasks.workunit.client.0.smithi087.stdout:9/372: write db/d18/d1c/f50 [4462479,127673] 0 2024-03-18T14:43:13.511 INFO:tasks.workunit.client.1.smithi129.stdout:0/144: rename d0/d14/l25 to d0/d23/d2c/l2f 0 2024-03-18T14:43:13.513 INFO:tasks.workunit.client.1.smithi129.stdout:8/124: dread d9/d11/d1a/f19 [0,4194304] 0 2024-03-18T14:43:13.513 INFO:tasks.workunit.client.1.smithi129.stdout:7/76: dread d4/d7/d8/f11 [0,4194304] 0 2024-03-18T14:43:13.515 INFO:tasks.workunit.client.1.smithi129.stdout:8/125: write d9/dc/f29 [282251,15970] 0 2024-03-18T14:43:13.516 INFO:tasks.workunit.client.0.smithi087.stdout:9/373: dwrite db/d18/d51/f64 [0,4194304] 0 2024-03-18T14:43:13.516 INFO:tasks.workunit.client.0.smithi087.stdout:9/374: write db/d18/d1c/f50 [2896667,105205] 0 2024-03-18T14:43:13.517 INFO:tasks.workunit.client.0.smithi087.stdout:9/375: stat db/d12/c60 0 2024-03-18T14:43:13.517 INFO:tasks.workunit.client.0.smithi087.stdout:4/247: write d2/db/d24/f26 [1436910,90902] 0 2024-03-18T14:43:13.518 INFO:tasks.workunit.client.1.smithi129.stdout:1/72: dwrite d1/f7 [0,4194304] 0 2024-03-18T14:43:13.518 INFO:tasks.workunit.client.0.smithi087.stdout:1/328: write d3/d1d/d45/f59 [401114,51829] 0 2024-03-18T14:43:13.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/248: write d2/db/de/f45 [4139922,60928] 0 2024-03-18T14:43:13.519 INFO:tasks.workunit.client.1.smithi129.stdout:8/126: dread f8 [0,4194304] 0 2024-03-18T14:43:13.520 INFO:tasks.workunit.client.1.smithi129.stdout:3/81: write d4/fc [1237833,45602] 0 2024-03-18T14:43:13.521 INFO:tasks.workunit.client.1.smithi129.stdout:2/71: sync 2024-03-18T14:43:13.523 INFO:tasks.workunit.client.0.smithi087.stdout:5/321: truncate d13/f24 1264947 0 2024-03-18T14:43:13.525 INFO:tasks.workunit.client.1.smithi129.stdout:4/78: mkdir d0/d19 0 2024-03-18T14:43:13.525 INFO:tasks.workunit.client.1.smithi129.stdout:4/79: chown d0/d9/f17 17 1 2024-03-18T14:43:13.525 INFO:tasks.workunit.client.1.smithi129.stdout:4/80: chown d0/f13 197842929 1 2024-03-18T14:43:13.526 INFO:tasks.workunit.client.1.smithi129.stdout:4/81: chown d0/f8 15073656 1 2024-03-18T14:43:13.526 INFO:tasks.workunit.client.1.smithi129.stdout:4/82: chown d0 3 1 2024-03-18T14:43:13.526 INFO:tasks.workunit.client.0.smithi087.stdout:0/272: truncate d0/d2/d4/d27/d29/d2a/f52 612576 0 2024-03-18T14:43:13.527 INFO:tasks.workunit.client.1.smithi129.stdout:5/95: mkdir d0/df/d17 0 2024-03-18T14:43:13.527 INFO:tasks.workunit.client.0.smithi087.stdout:0/273: dread - d0/d2/d4/d19/d5a/f5b zero size 2024-03-18T14:43:13.528 INFO:tasks.workunit.client.1.smithi129.stdout:0/145: chown d0/l1a 33328 1 2024-03-18T14:43:13.529 INFO:tasks.workunit.client.0.smithi087.stdout:7/362: symlink d1/l7d 0 2024-03-18T14:43:13.534 INFO:tasks.workunit.client.1.smithi129.stdout:1/73: rename d1/d2/la to d1/d2/l15 0 2024-03-18T14:43:13.535 INFO:tasks.workunit.client.0.smithi087.stdout:8/303: creat d1/d6/d9/f61 x:0 0 0 2024-03-18T14:43:13.536 INFO:tasks.workunit.client.1.smithi129.stdout:1/74: write d1/d2/f12 [786163,98740] 0 2024-03-18T14:43:13.536 INFO:tasks.workunit.client.1.smithi129.stdout:3/82: symlink d4/dd/l1a 0 2024-03-18T14:43:13.537 INFO:tasks.workunit.client.1.smithi129.stdout:3/83: write d4/fa [998269,125916] 0 2024-03-18T14:43:13.537 INFO:tasks.workunit.client.1.smithi129.stdout:2/72: symlink d7/dd/l16 0 2024-03-18T14:43:13.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/329: symlink d3/d1d/d1f/l64 0 2024-03-18T14:43:13.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/330: chown d3/d1d/d1e/f37 211924 1 2024-03-18T14:43:13.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/331: read - d3/d1d/d1e/f4d zero size 2024-03-18T14:43:13.540 INFO:tasks.workunit.client.0.smithi087.stdout:3/337: rename d0/d3/df/d42/l48 to d0/l62 0 2024-03-18T14:43:13.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/93: mknod d0/d15/c1c 0 2024-03-18T14:43:13.541 INFO:tasks.workunit.client.1.smithi129.stdout:5/96: mkdir d0/dc/d18 0 2024-03-18T14:43:13.541 INFO:tasks.workunit.client.1.smithi129.stdout:5/97: read d0/f2 [3929320,35228] 0 2024-03-18T14:43:13.542 INFO:tasks.workunit.client.0.smithi087.stdout:1/332: dwrite d3/d1d/d45/f59 [0,4194304] 0 2024-03-18T14:43:13.543 INFO:tasks.workunit.client.1.smithi129.stdout:0/146: creat d0/d14/d28/f30 x:0 0 0 2024-03-18T14:43:13.544 INFO:tasks.workunit.client.0.smithi087.stdout:0/274: creat d0/d2/d4/d19/d24/f63 x:0 0 0 2024-03-18T14:43:13.545 INFO:tasks.workunit.client.0.smithi087.stdout:0/275: write d0/d2/d4/d27/d29/d26/f4b [740921,81895] 0 2024-03-18T14:43:13.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/276: dread - d0/d2/d4/d27/d32/f36 zero size 2024-03-18T14:43:13.546 INFO:tasks.workunit.client.1.smithi129.stdout:0/147: dread d0/f1e [0,4194304] 0 2024-03-18T14:43:13.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/277: write d0/dd/f30 [182730,111659] 0 2024-03-18T14:43:13.551 INFO:tasks.workunit.client.1.smithi129.stdout:0/148: dwrite d0/d14/f2d [0,4194304] 0 2024-03-18T14:43:13.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/304: symlink d1/d6/d2f/l62 0 2024-03-18T14:43:13.552 INFO:tasks.workunit.client.1.smithi129.stdout:4/83: write d0/f5 [4681450,43247] 0 2024-03-18T14:43:13.552 INFO:tasks.workunit.client.0.smithi087.stdout:8/305: chown d1/d6/l4e 1020503370 1 2024-03-18T14:43:13.553 INFO:tasks.workunit.client.1.smithi129.stdout:6/112: truncate d3/d5/db/fd 1094707 0 2024-03-18T14:43:13.553 INFO:tasks.workunit.client.1.smithi129.stdout:4/84: stat d0/d9 0 2024-03-18T14:43:13.553 INFO:tasks.workunit.client.0.smithi087.stdout:4/249: symlink d2/l4e 0 2024-03-18T14:43:13.556 INFO:tasks.workunit.client.1.smithi129.stdout:7/77: truncate d4/fd 907096 0 2024-03-18T14:43:13.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/306: dread d1/d6/f43 [0,4194304] 0 2024-03-18T14:43:13.558 INFO:tasks.workunit.client.1.smithi129.stdout:1/75: creat d1/f16 x:0 0 0 2024-03-18T14:43:13.558 INFO:tasks.workunit.client.0.smithi087.stdout:9/376: truncate db/d31/f74 3917095 0 2024-03-18T14:43:13.560 INFO:tasks.workunit.client.1.smithi129.stdout:3/84: rename d4/dd/ff to d4/dd/d15/d16/f1b 0 2024-03-18T14:43:13.561 INFO:tasks.workunit.client.0.smithi087.stdout:3/338: unlink d0/d3/d10/f1f 0 2024-03-18T14:43:13.561 INFO:tasks.workunit.client.1.smithi129.stdout:3/85: readlink d4/dd/l10 0 2024-03-18T14:43:13.561 INFO:tasks.workunit.client.1.smithi129.stdout:1/76: dread d1/d2/f5 [0,4194304] 0 2024-03-18T14:43:13.563 INFO:tasks.workunit.client.0.smithi087.stdout:1/333: symlink d3/d1d/d1f/d34/d38/l65 0 2024-03-18T14:43:13.564 INFO:tasks.workunit.client.1.smithi129.stdout:0/149: unlink d0/d14/d28/f2a 0 2024-03-18T14:43:13.565 INFO:tasks.workunit.client.0.smithi087.stdout:0/278: creat d0/dd/f64 x:0 0 0 2024-03-18T14:43:13.565 INFO:tasks.workunit.client.1.smithi129.stdout:6/113: mknod d3/d5/c24 0 2024-03-18T14:43:13.565 INFO:tasks.workunit.client.1.smithi129.stdout:6/114: chown d3/d6/f18 78045 1 2024-03-18T14:43:13.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/279: write d0/d2/d4/d19/f23 [2056182,86148] 0 2024-03-18T14:43:13.567 INFO:tasks.workunit.client.0.smithi087.stdout:0/280: write d0/d2/d4/d19/d5a/f5b [84392,64101] 0 2024-03-18T14:43:13.567 INFO:tasks.workunit.client.1.smithi129.stdout:7/78: fsync d4/d7/fa 0 2024-03-18T14:43:13.568 INFO:tasks.workunit.client.0.smithi087.stdout:6/272: rename d3/d1a/d46/c59 to d3/d7/d25/c5c 0 2024-03-18T14:43:13.568 INFO:tasks.workunit.client.0.smithi087.stdout:3/339: rename d0/d3 to d0/d3/df/d42/d63 22 2024-03-18T14:43:13.568 INFO:tasks.workunit.client.0.smithi087.stdout:0/281: dread - d0/d2/d4/d19/d24/f63 zero size 2024-03-18T14:43:13.568 INFO:tasks.workunit.client.0.smithi087.stdout:3/340: chown d0/d3/d10 226298215 1 2024-03-18T14:43:13.570 INFO:tasks.workunit.client.0.smithi087.stdout:5/322: rmdir d13/d6b 0 2024-03-18T14:43:13.571 INFO:tasks.workunit.client.1.smithi129.stdout:9/94: link d0/db/f18 d0/db/f1d 0 2024-03-18T14:43:13.572 INFO:tasks.workunit.client.1.smithi129.stdout:9/95: dread - d0/db/f18 zero size 2024-03-18T14:43:13.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/278: link d2/d4/d22/c3c d2/d44/c55 0 2024-03-18T14:43:13.572 INFO:tasks.workunit.client.0.smithi087.stdout:2/279: write d2/f32 [186834,122645] 0 2024-03-18T14:43:13.573 INFO:tasks.workunit.client.0.smithi087.stdout:2/280: readlink d2/d4/d22/l31 0 2024-03-18T14:43:13.574 INFO:tasks.workunit.client.0.smithi087.stdout:7/363: dread d1/d6/da/f50 [0,4194304] 0 2024-03-18T14:43:13.574 INFO:tasks.workunit.client.1.smithi129.stdout:1/77: unlink d1/f7 0 2024-03-18T14:43:13.574 INFO:tasks.workunit.client.0.smithi087.stdout:4/250: mkdir d2/db/d24/d30/d49/d4f 0 2024-03-18T14:43:13.574 INFO:tasks.workunit.client.0.smithi087.stdout:7/364: fdatasync d1/f2b 0 2024-03-18T14:43:13.575 INFO:tasks.workunit.client.1.smithi129.stdout:1/78: fsync d1/d2/f12 0 2024-03-18T14:43:13.576 INFO:tasks.workunit.client.1.smithi129.stdout:0/150: stat d0/d23/d2c/l2f 0 2024-03-18T14:43:13.578 INFO:tasks.workunit.client.1.smithi129.stdout:6/115: symlink d3/d5/db/df/l25 0 2024-03-18T14:43:13.579 INFO:tasks.workunit.client.1.smithi129.stdout:1/79: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:13.580 INFO:tasks.workunit.client.1.smithi129.stdout:3/86: dwrite d4/dd/d15/d16/f1b [0,4194304] 0 2024-03-18T14:43:13.584 INFO:tasks.workunit.client.1.smithi129.stdout:2/73: truncate d7/dd/f12 1015866 0 2024-03-18T14:43:13.585 INFO:tasks.workunit.client.1.smithi129.stdout:1/80: dwrite d1/f16 [0,4194304] 0 2024-03-18T14:43:13.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/74: dread - f5 zero size 2024-03-18T14:43:13.586 INFO:tasks.workunit.client.1.smithi129.stdout:8/127: link f6 d9/d11/d18/f2b 0 2024-03-18T14:43:13.586 INFO:tasks.workunit.client.1.smithi129.stdout:8/128: readlink d9/d11/l12 0 2024-03-18T14:43:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:0/282: rmdir d0/d49 39 2024-03-18T14:43:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:3/341: rmdir d0/d1c/d25 39 2024-03-18T14:43:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:5/323: symlink d13/d1b/d30/l6d 0 2024-03-18T14:43:13.589 INFO:tasks.workunit.client.0.smithi087.stdout:1/334: mknod d3/d1d/c66 0 2024-03-18T14:43:13.590 INFO:tasks.workunit.client.0.smithi087.stdout:2/281: rmdir d2/d4/d22 39 2024-03-18T14:43:13.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/342: fsync d0/d3/df/f50 0 2024-03-18T14:43:13.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/343: write d0/d3/d40/f56 [2203555,11770] 0 2024-03-18T14:43:13.592 INFO:tasks.workunit.client.1.smithi129.stdout:9/96: creat d0/f1e x:0 0 0 2024-03-18T14:43:13.594 INFO:tasks.workunit.client.1.smithi129.stdout:0/151: mknod d0/d23/c31 0 2024-03-18T14:43:13.597 INFO:tasks.workunit.client.1.smithi129.stdout:3/87: creat d4/dd/d15/d16/f1c x:0 0 0 2024-03-18T14:43:13.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/377: rmdir db/d31/d6e 0 2024-03-18T14:43:13.598 INFO:tasks.workunit.client.1.smithi129.stdout:0/152: dwrite d0/f11 [0,4194304] 0 2024-03-18T14:43:13.600 INFO:tasks.workunit.client.1.smithi129.stdout:2/75: symlink d7/l17 0 2024-03-18T14:43:13.601 INFO:tasks.workunit.client.1.smithi129.stdout:0/153: dread d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:13.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/324: mkdir d13/d1b/d30/d6e 0 2024-03-18T14:43:13.608 INFO:tasks.workunit.client.0.smithi087.stdout:8/307: getdents d1/d6/d9 0 2024-03-18T14:43:13.609 INFO:tasks.workunit.client.1.smithi129.stdout:4/85: truncate d0/f5 3946315 0 2024-03-18T14:43:13.613 INFO:tasks.workunit.client.1.smithi129.stdout:8/129: rmdir d9/d11/d1a 39 2024-03-18T14:43:13.615 INFO:tasks.workunit.client.0.smithi087.stdout:4/251: link d2/d13/f3f d2/db/d3c/f50 0 2024-03-18T14:43:13.615 INFO:tasks.workunit.client.0.smithi087.stdout:4/252: dread - d2/d13/d28/f40 zero size 2024-03-18T14:43:13.616 INFO:tasks.workunit.client.0.smithi087.stdout:1/335: mkdir d3/d1d/d67 0 2024-03-18T14:43:13.617 INFO:tasks.workunit.client.0.smithi087.stdout:2/282: read - d2/d4/d22/d2c/d3a/f51 zero size 2024-03-18T14:43:13.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/325: creat d13/d1b/d27/d28/f6f x:0 0 0 2024-03-18T14:43:13.618 INFO:tasks.workunit.client.1.smithi129.stdout:3/88: mkdir d4/d11/d1d 0 2024-03-18T14:43:13.618 INFO:tasks.workunit.client.0.smithi087.stdout:2/283: chown d2/f2f 15668312 1 2024-03-18T14:43:13.618 INFO:tasks.workunit.client.0.smithi087.stdout:5/326: readlink d13/d1b/d27/d28/l50 0 2024-03-18T14:43:13.619 INFO:tasks.workunit.client.1.smithi129.stdout:2/76: creat d7/dd/f18 x:0 0 0 2024-03-18T14:43:13.619 INFO:tasks.workunit.client.0.smithi087.stdout:9/378: symlink db/d18/l75 0 2024-03-18T14:43:13.620 INFO:tasks.workunit.client.0.smithi087.stdout:9/379: write db/f3d [2075127,116210] 0 2024-03-18T14:43:13.620 INFO:tasks.workunit.client.1.smithi129.stdout:0/154: write d0/d14/f20 [4263730,85660] 0 2024-03-18T14:43:13.621 INFO:tasks.workunit.client.1.smithi129.stdout:9/97: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:13.621 INFO:tasks.workunit.client.1.smithi129.stdout:0/155: write d0/f11 [2086735,129658] 0 2024-03-18T14:43:13.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/344: rename d0/d3/d10/l43 to d0/d1c/l64 0 2024-03-18T14:43:13.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/345: chown d0/d3/df/d42 1014 1 2024-03-18T14:43:13.624 INFO:tasks.workunit.client.0.smithi087.stdout:8/308: symlink d1/d6/l63 0 2024-03-18T14:43:13.624 INFO:tasks.workunit.client.1.smithi129.stdout:7/79: link d4/d7/l13 d4/d7/d8/l17 0 2024-03-18T14:43:13.624 INFO:tasks.workunit.client.1.smithi129.stdout:5/98: link d0/df/c12 d0/c19 0 2024-03-18T14:43:13.625 INFO:tasks.workunit.client.1.smithi129.stdout:5/99: write d0/f14 [459895,59420] 0 2024-03-18T14:43:13.625 INFO:tasks.workunit.client.0.smithi087.stdout:8/309: write d1/d6/d2f/d44/f52 [576503,69408] 0 2024-03-18T14:43:13.630 INFO:tasks.workunit.client.1.smithi129.stdout:1/81: truncate d1/d2/f5 2293326 0 2024-03-18T14:43:13.630 INFO:tasks.workunit.client.1.smithi129.stdout:1/82: readlink d1/d2/l4 0 2024-03-18T14:43:13.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/89: symlink d4/d11/l1e 0 2024-03-18T14:43:13.633 INFO:tasks.workunit.client.1.smithi129.stdout:2/77: symlink d7/l19 0 2024-03-18T14:43:13.635 INFO:tasks.workunit.client.1.smithi129.stdout:0/156: symlink d0/l32 0 2024-03-18T14:43:13.636 INFO:tasks.workunit.client.1.smithi129.stdout:4/86: mkdir d0/d1a 0 2024-03-18T14:43:13.639 INFO:tasks.workunit.client.1.smithi129.stdout:9/98: write d0/fc [4966820,126399] 0 2024-03-18T14:43:13.640 INFO:tasks.workunit.client.1.smithi129.stdout:8/130: rename d9/d11/d1a/fe to d9/d11/d1a/d14/f2c 0 2024-03-18T14:43:13.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/80: creat d4/d7/d8/d12/f18 x:0 0 0 2024-03-18T14:43:13.642 INFO:tasks.workunit.client.1.smithi129.stdout:6/116: getdents d3/d5/db/de 0 2024-03-18T14:43:13.644 INFO:tasks.workunit.client.1.smithi129.stdout:1/83: unlink d1/f16 0 2024-03-18T14:43:13.645 INFO:tasks.workunit.client.1.smithi129.stdout:0/157: creat d0/d23/d2c/f33 x:0 0 0 2024-03-18T14:43:13.647 INFO:tasks.workunit.client.1.smithi129.stdout:3/90: rename d4/dd/d15/d19 to d4/dd/d1f 0 2024-03-18T14:43:13.648 INFO:tasks.workunit.client.1.smithi129.stdout:7/81: creat d4/d7/f19 x:0 0 0 2024-03-18T14:43:13.649 INFO:tasks.workunit.client.1.smithi129.stdout:6/117: creat d3/d5/db/f26 x:0 0 0 2024-03-18T14:43:13.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/82: fsync d4/d7/d8/d12/f18 0 2024-03-18T14:43:13.651 INFO:tasks.workunit.client.1.smithi129.stdout:7/83: dread - d4/d7/f19 zero size 2024-03-18T14:43:13.652 INFO:tasks.workunit.client.1.smithi129.stdout:7/84: dread d4/d7/d8/f11 [0,4194304] 0 2024-03-18T14:43:13.653 INFO:tasks.workunit.client.0.smithi087.stdout:7/365: link d1/d6/d16/dc/l73 d1/d6/d16/l7e 0 2024-03-18T14:43:13.653 INFO:tasks.workunit.client.1.smithi129.stdout:1/84: mknod d1/c17 0 2024-03-18T14:43:13.654 INFO:tasks.workunit.client.0.smithi087.stdout:9/380: unlink db/f11 0 2024-03-18T14:43:13.654 INFO:tasks.workunit.client.0.smithi087.stdout:4/253: rename d2/db/de/cf to d2/db/d3c/c51 0 2024-03-18T14:43:13.655 INFO:tasks.workunit.client.1.smithi129.stdout:5/100: truncate d0/f9 2540279 0 2024-03-18T14:43:13.655 INFO:tasks.workunit.client.0.smithi087.stdout:7/366: fdatasync d1/d6/da/d42/f4a 0 2024-03-18T14:43:13.656 INFO:tasks.workunit.client.1.smithi129.stdout:1/85: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:13.657 INFO:tasks.workunit.client.1.smithi129.stdout:1/86: readlink l0 0 2024-03-18T14:43:13.657 INFO:tasks.workunit.client.0.smithi087.stdout:4/254: read - d2/db/d24/d30/f4a zero size 2024-03-18T14:43:13.657 INFO:tasks.workunit.client.0.smithi087.stdout:7/367: write d1/d6/da/f37 [1114580,119931] 0 2024-03-18T14:43:13.658 INFO:tasks.workunit.client.1.smithi129.stdout:0/158: symlink d0/d23/l34 0 2024-03-18T14:43:13.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/368: write d1/d6/da/d42/f4a [786503,91310] 0 2024-03-18T14:43:13.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/336: dread d3/d1d/d1e/f4b [0,4194304] 0 2024-03-18T14:43:13.660 INFO:tasks.workunit.client.0.smithi087.stdout:9/381: mkdir db/d18/d1e/d28/d76 0 2024-03-18T14:43:13.660 INFO:tasks.workunit.client.1.smithi129.stdout:3/91: rename d4/dd/d15/d16/l17 to d4/d11/l20 0 2024-03-18T14:43:13.661 INFO:tasks.workunit.client.0.smithi087.stdout:5/327: getdents d13/d1b/d30 0 2024-03-18T14:43:13.661 INFO:tasks.workunit.client.1.smithi129.stdout:3/92: fsync d4/dd/d15/d16/f1c 0 2024-03-18T14:43:13.662 INFO:tasks.workunit.client.1.smithi129.stdout:2/78: write d7/dd/f12 [1162664,67751] 0 2024-03-18T14:43:13.663 INFO:tasks.workunit.client.1.smithi129.stdout:4/87: truncate d0/f13 1226932 0 2024-03-18T14:43:13.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/255: mknod d2/db/de/c52 0 2024-03-18T14:43:13.666 INFO:tasks.workunit.client.1.smithi129.stdout:6/118: unlink d3/d6/f8 0 2024-03-18T14:43:13.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/346: dread d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:13.667 INFO:tasks.workunit.client.1.smithi129.stdout:7/85: symlink d4/d7/l1a 0 2024-03-18T14:43:13.668 INFO:tasks.workunit.client.1.smithi129.stdout:5/101: mkdir d0/dc/d1a 0 2024-03-18T14:43:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:1/337: symlink d3/d1d/d1e/d43/l68 0 2024-03-18T14:43:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:6/273: sync 2024-03-18T14:43:13.669 INFO:tasks.workunit.client.0.smithi087.stdout:9/382: dwrite db/f22 [4194304,4194304] 0 2024-03-18T14:43:13.670 INFO:tasks.workunit.client.0.smithi087.stdout:7/369: dwrite d1/d6/da/f43 [0,4194304] 0 2024-03-18T14:43:13.670 INFO:tasks.workunit.client.0.smithi087.stdout:1/338: fsync d3/f19 0 2024-03-18T14:43:13.671 INFO:tasks.workunit.client.0.smithi087.stdout:4/256: read d2/d13/d28/f2d [4823842,55447] 0 2024-03-18T14:43:13.672 INFO:tasks.workunit.client.0.smithi087.stdout:5/328: dwrite d13/d1b/d27/d28/f66 [0,4194304] 0 2024-03-18T14:43:13.673 INFO:tasks.workunit.client.1.smithi129.stdout:1/87: mkdir d1/d18 0 2024-03-18T14:43:13.673 INFO:tasks.workunit.client.0.smithi087.stdout:9/383: write db/d18/d3a/f63 [412711,51937] 0 2024-03-18T14:43:13.674 INFO:tasks.workunit.client.0.smithi087.stdout:3/347: mknod d0/d1c/c65 0 2024-03-18T14:43:13.674 INFO:tasks.workunit.client.0.smithi087.stdout:1/339: write d3/d1d/d45/f59 [1359990,126677] 0 2024-03-18T14:43:13.675 INFO:tasks.workunit.client.0.smithi087.stdout:9/384: read - db/d31/f6d zero size 2024-03-18T14:43:13.675 INFO:tasks.workunit.client.0.smithi087.stdout:1/340: chown d3/d1d/d1f/c31 912815 1 2024-03-18T14:43:13.677 INFO:tasks.workunit.client.0.smithi087.stdout:1/341: dread d3/d1d/d1e/d20/f5f [0,4194304] 0 2024-03-18T14:43:13.677 INFO:tasks.workunit.client.1.smithi129.stdout:0/159: mkdir d0/d23/d35 0 2024-03-18T14:43:13.678 INFO:tasks.workunit.client.0.smithi087.stdout:7/370: mknod d1/d6/d16/dc/c7f 0 2024-03-18T14:43:13.678 INFO:tasks.workunit.client.1.smithi129.stdout:2/79: creat d7/dd/f1a x:0 0 0 2024-03-18T14:43:13.678 INFO:tasks.workunit.client.1.smithi129.stdout:4/88: rename d0/d9/c11 to d0/d9/c1b 0 2024-03-18T14:43:13.678 INFO:tasks.workunit.client.1.smithi129.stdout:4/89: chown d0/d9/f15 105 1 2024-03-18T14:43:13.679 INFO:tasks.workunit.client.0.smithi087.stdout:7/371: write d1/d6/d29/d2f/d68/d65/d60/f7a [120302,66058] 0 2024-03-18T14:43:13.679 INFO:tasks.workunit.client.1.smithi129.stdout:4/90: readlink d0/d9/le 0 2024-03-18T14:43:13.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/257: symlink d2/db/de/l53 0 2024-03-18T14:43:13.680 INFO:tasks.workunit.client.1.smithi129.stdout:7/86: mknod d4/d7/d8/c1b 0 2024-03-18T14:43:13.681 INFO:tasks.workunit.client.0.smithi087.stdout:4/258: chown d2/db/de/f2f 49195679 1 2024-03-18T14:43:13.681 INFO:tasks.workunit.client.1.smithi129.stdout:7/87: chown d4/d7/ce 7384 1 2024-03-18T14:43:13.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/274: unlink d3/d7/d25/c5c 0 2024-03-18T14:43:13.683 INFO:tasks.workunit.client.0.smithi087.stdout:6/275: fdatasync d3/d1a/f1e 0 2024-03-18T14:43:13.683 INFO:tasks.workunit.client.0.smithi087.stdout:8/310: dread d1/d6/d2f/d44/d4b/f54 [0,4194304] 0 2024-03-18T14:43:13.684 INFO:tasks.workunit.client.0.smithi087.stdout:3/348: creat d0/de/d30/f66 x:0 0 0 2024-03-18T14:43:13.685 INFO:tasks.workunit.client.1.smithi129.stdout:9/99: getdents d0 0 2024-03-18T14:43:13.685 INFO:tasks.workunit.client.0.smithi087.stdout:9/385: mknod db/d18/d3a/c77 0 2024-03-18T14:43:13.685 INFO:tasks.workunit.client.1.smithi129.stdout:8/131: getdents d9/d11 0 2024-03-18T14:43:13.689 INFO:tasks.workunit.client.1.smithi129.stdout:2/80: mknod d7/c1b 0 2024-03-18T14:43:13.689 INFO:tasks.workunit.client.1.smithi129.stdout:2/81: chown d7/l19 1462 1 2024-03-18T14:43:13.690 INFO:tasks.workunit.client.1.smithi129.stdout:5/102: mknod d0/dc/d1a/c1b 0 2024-03-18T14:43:13.691 INFO:tasks.workunit.client.1.smithi129.stdout:7/88: chown d4/fd 50020 1 2024-03-18T14:43:13.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/342: dwrite d3/d1d/d45/f59 [4194304,4194304] 0 2024-03-18T14:43:13.692 INFO:tasks.workunit.client.1.smithi129.stdout:1/88: mkdir d1/d18/d19 0 2024-03-18T14:43:13.692 INFO:tasks.workunit.client.1.smithi129.stdout:1/89: fsync d1/f9 0 2024-03-18T14:43:13.693 INFO:tasks.workunit.client.0.smithi087.stdout:5/329: mkdir d13/d1b/d70 0 2024-03-18T14:43:13.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/132: truncate d9/d11/d1a/f19 882934 0 2024-03-18T14:43:13.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/283: sync 2024-03-18T14:43:13.700 INFO:tasks.workunit.client.0.smithi087.stdout:9/386: symlink db/d18/d3a/l78 0 2024-03-18T14:43:13.700 INFO:tasks.workunit.client.0.smithi087.stdout:7/372: creat d1/d6/d29/d2f/d68/d65/d72/f80 x:0 0 0 2024-03-18T14:43:13.700 INFO:tasks.workunit.client.0.smithi087.stdout:1/343: mknod d3/d1d/d1f/c69 0 2024-03-18T14:43:13.701 INFO:tasks.workunit.client.0.smithi087.stdout:5/330: creat d13/d1b/d27/d28/f71 x:0 0 0 2024-03-18T14:43:13.702 INFO:tasks.workunit.client.0.smithi087.stdout:8/311: creat d1/d6/d9/d5d/f64 x:0 0 0 2024-03-18T14:43:13.702 INFO:tasks.workunit.client.0.smithi087.stdout:5/331: chown d13/d1b/d27/f2c 23 1 2024-03-18T14:43:13.706 INFO:tasks.workunit.client.0.smithi087.stdout:7/373: dwrite d1/d6/d29/d2f/d6b/f7c [0,4194304] 0 2024-03-18T14:43:13.708 INFO:tasks.workunit.client.0.smithi087.stdout:1/344: chown d3/f7 45975 1 2024-03-18T14:43:13.708 INFO:tasks.workunit.client.0.smithi087.stdout:4/259: link d2/db/de/c37 d2/d13/d28/c54 0 2024-03-18T14:43:13.709 INFO:tasks.workunit.client.0.smithi087.stdout:4/260: chown d2/db/f20 168 1 2024-03-18T14:43:13.711 INFO:tasks.workunit.client.1.smithi129.stdout:0/160: creat d0/d23/d35/f36 x:0 0 0 2024-03-18T14:43:13.711 INFO:tasks.workunit.client.1.smithi129.stdout:8/133: write d9/f1d [24572,96932] 0 2024-03-18T14:43:13.712 INFO:tasks.workunit.client.1.smithi129.stdout:3/93: getdents d4/dd/d15 0 2024-03-18T14:43:13.712 INFO:tasks.workunit.client.0.smithi087.stdout:3/349: truncate d0/de/f12 1350760 0 2024-03-18T14:43:13.712 INFO:tasks.workunit.client.1.smithi129.stdout:1/90: write d1/d2/f3 [856291,19952] 0 2024-03-18T14:43:13.713 INFO:tasks.workunit.client.1.smithi129.stdout:1/91: fsync d1/f9 0 2024-03-18T14:43:13.715 INFO:tasks.workunit.client.1.smithi129.stdout:6/119: getdents d3 0 2024-03-18T14:43:13.715 INFO:tasks.workunit.client.0.smithi087.stdout:8/312: rmdir d1/d6/d2f/d44/d4b 39 2024-03-18T14:43:13.718 INFO:tasks.workunit.client.1.smithi129.stdout:0/161: creat d0/d23/f37 x:0 0 0 2024-03-18T14:43:13.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/276: creat d3/d1a/d29/d22/f5d x:0 0 0 2024-03-18T14:43:13.718 INFO:tasks.workunit.client.1.smithi129.stdout:7/89: dwrite f3 [4194304,4194304] 0 2024-03-18T14:43:13.719 INFO:tasks.workunit.client.0.smithi087.stdout:6/277: dread - d3/d7/f57 zero size 2024-03-18T14:43:13.719 INFO:tasks.workunit.client.1.smithi129.stdout:8/134: unlink d9/d11/f23 0 2024-03-18T14:43:13.719 INFO:tasks.workunit.client.1.smithi129.stdout:4/91: fdatasync d0/f13 0 2024-03-18T14:43:13.720 INFO:tasks.workunit.client.1.smithi129.stdout:2/82: truncate d7/dd/f1a 774416 0 2024-03-18T14:43:13.720 INFO:tasks.workunit.client.0.smithi087.stdout:8/313: dwrite d1/d6/d9/d5d/f64 [0,4194304] 0 2024-03-18T14:43:13.721 INFO:tasks.workunit.client.1.smithi129.stdout:1/92: dwrite d1/f9 [0,4194304] 0 2024-03-18T14:43:13.721 INFO:tasks.workunit.client.1.smithi129.stdout:5/103: rmdir d0/dc/d16 0 2024-03-18T14:43:13.724 INFO:tasks.workunit.client.0.smithi087.stdout:0/284: truncate d0/d2/d4/d27/d29/d26/f4b 765588 0 2024-03-18T14:43:13.724 INFO:tasks.workunit.client.1.smithi129.stdout:6/120: rmdir d3/d5/db 39 2024-03-18T14:43:13.724 INFO:tasks.workunit.client.1.smithi129.stdout:6/121: chown d3/d6/l1d 36877 1 2024-03-18T14:43:13.727 INFO:tasks.workunit.client.1.smithi129.stdout:0/162: creat d0/d23/d29/f38 x:0 0 0 2024-03-18T14:43:13.727 INFO:tasks.workunit.client.0.smithi087.stdout:1/345: write d3/f7 [2506121,38633] 0 2024-03-18T14:43:13.727 INFO:tasks.workunit.client.0.smithi087.stdout:4/261: write d2/d13/f3f [1871198,46373] 0 2024-03-18T14:43:13.727 INFO:tasks.workunit.client.0.smithi087.stdout:1/346: readlink d3/l1c 0 2024-03-18T14:43:13.729 INFO:tasks.workunit.client.0.smithi087.stdout:0/285: dwrite d0/d2/d4/d19/f54 [0,4194304] 0 2024-03-18T14:43:13.729 INFO:tasks.workunit.client.0.smithi087.stdout:4/262: read d2/db/f1d [472632,90085] 0 2024-03-18T14:43:13.731 INFO:tasks.workunit.client.1.smithi129.stdout:0/163: dwrite d0/d23/d35/f36 [0,4194304] 0 2024-03-18T14:43:13.734 INFO:tasks.workunit.client.0.smithi087.stdout:9/387: link db/d18/d1e/d28/l3f db/d18/d3a/l79 0 2024-03-18T14:43:13.734 INFO:tasks.workunit.client.0.smithi087.stdout:5/332: truncate d13/f17 6161 0 2024-03-18T14:43:13.734 INFO:tasks.workunit.client.0.smithi087.stdout:8/314: creat d1/d6/d9/d5d/f65 x:0 0 0 2024-03-18T14:43:13.735 INFO:tasks.workunit.client.1.smithi129.stdout:2/83: stat d7/dd/l13 0 2024-03-18T14:43:13.735 INFO:tasks.workunit.client.1.smithi129.stdout:2/84: fdatasync d7/dd/f15 0 2024-03-18T14:43:13.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/374: link d1/d6/d29/d2f/c77 d1/d6/d29/d2f/d68/d65/d72/c81 0 2024-03-18T14:43:13.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/375: write d1/f2e [645441,11803] 0 2024-03-18T14:43:13.736 INFO:tasks.workunit.client.1.smithi129.stdout:2/85: write f0 [1094181,42377] 0 2024-03-18T14:43:13.738 INFO:tasks.workunit.client.1.smithi129.stdout:5/104: chown d0/df/c12 2 1 2024-03-18T14:43:13.740 INFO:tasks.workunit.client.1.smithi129.stdout:3/94: truncate d4/fb 357351 0 2024-03-18T14:43:13.741 INFO:tasks.workunit.client.1.smithi129.stdout:3/95: write d4/dd/d15/d16/f1b [5195667,103767] 0 2024-03-18T14:43:13.743 INFO:tasks.workunit.client.1.smithi129.stdout:2/86: rmdir d7/dd 39 2024-03-18T14:43:13.745 INFO:tasks.workunit.client.1.smithi129.stdout:1/93: fdatasync d1/d2/f5 0 2024-03-18T14:43:13.745 INFO:tasks.workunit.client.1.smithi129.stdout:1/94: write d1/d2/f12 [341454,10575] 0 2024-03-18T14:43:13.746 INFO:tasks.workunit.client.1.smithi129.stdout:1/95: readlink d1/d2/l4 0 2024-03-18T14:43:13.747 INFO:tasks.workunit.client.1.smithi129.stdout:5/105: mknod d0/df/c1c 0 2024-03-18T14:43:13.749 INFO:tasks.workunit.client.1.smithi129.stdout:6/122: dwrite d3/d5/db/de/f1f [0,4194304] 0 2024-03-18T14:43:13.751 INFO:tasks.workunit.client.0.smithi087.stdout:2/284: sync 2024-03-18T14:43:13.751 INFO:tasks.workunit.client.1.smithi129.stdout:4/92: rename d0/f8 to d0/f1c 0 2024-03-18T14:43:13.752 INFO:tasks.workunit.client.0.smithi087.stdout:7/376: mknod d1/d6/d29/d2f/d68/c82 0 2024-03-18T14:43:13.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/347: mknod d3/d1d/d1e/c6a 0 2024-03-18T14:43:13.753 INFO:tasks.workunit.client.0.smithi087.stdout:5/333: symlink d13/l72 0 2024-03-18T14:43:13.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/388: mknod db/d18/d1c/d69/d6f/c7a 0 2024-03-18T14:43:13.754 INFO:tasks.workunit.client.1.smithi129.stdout:1/96: rename d1/cb to d1/c1a 0 2024-03-18T14:43:13.754 INFO:tasks.workunit.client.1.smithi129.stdout:1/97: stat d1/d2/f12 0 2024-03-18T14:43:13.754 INFO:tasks.workunit.client.1.smithi129.stdout:1/98: chown l0 26789768 1 2024-03-18T14:43:13.755 INFO:tasks.workunit.client.0.smithi087.stdout:0/286: creat d0/d2/d4/f65 x:0 0 0 2024-03-18T14:43:13.756 INFO:tasks.workunit.client.1.smithi129.stdout:7/90: getdents d4/d7/d8/d12 0 2024-03-18T14:43:13.756 INFO:tasks.workunit.client.1.smithi129.stdout:9/100: sync 2024-03-18T14:43:13.757 INFO:tasks.workunit.client.1.smithi129.stdout:9/101: write d0/f4 [1910731,84822] 0 2024-03-18T14:43:13.759 INFO:tasks.workunit.client.0.smithi087.stdout:2/285: read d2/d4/d22/d2c/f30 [211614,64337] 0 2024-03-18T14:43:13.759 INFO:tasks.workunit.client.1.smithi129.stdout:4/93: read d0/f5 [175132,9537] 0 2024-03-18T14:43:13.760 INFO:tasks.workunit.client.1.smithi129.stdout:2/87: mkdir d7/d1c 0 2024-03-18T14:43:13.761 INFO:tasks.workunit.client.1.smithi129.stdout:1/99: read d1/d2/f12 [777348,8358] 0 2024-03-18T14:43:13.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/278: truncate d3/d1a/d29/f56 668242 0 2024-03-18T14:43:13.764 INFO:tasks.workunit.client.0.smithi087.stdout:1/348: rmdir d3/d1d/d1e/d43/d50 39 2024-03-18T14:43:13.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/349: read d3/f16 [4419241,5762] 0 2024-03-18T14:43:13.766 INFO:tasks.workunit.client.1.smithi129.stdout:7/91: unlink d4/d7/d8/f11 0 2024-03-18T14:43:13.767 INFO:tasks.workunit.client.1.smithi129.stdout:7/92: stat d4/d7/ce 0 2024-03-18T14:43:13.767 INFO:tasks.workunit.client.1.smithi129.stdout:8/135: rename d9/d11/d1a/d14/c22 to d9/d11/c2d 0 2024-03-18T14:43:13.767 INFO:tasks.workunit.client.1.smithi129.stdout:7/93: write d4/f5 [212444,62842] 0 2024-03-18T14:43:13.767 INFO:tasks.workunit.client.1.smithi129.stdout:0/164: write d0/fd [499081,67204] 0 2024-03-18T14:43:13.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/350: dread d3/d1d/d1e/d20/f5f [0,4194304] 0 2024-03-18T14:43:13.768 INFO:tasks.workunit.client.0.smithi087.stdout:8/315: dread d1/d6/d9/f48 [0,4194304] 0 2024-03-18T14:43:13.768 INFO:tasks.workunit.client.0.smithi087.stdout:1/351: dread - d3/d1d/d1e/d20/f52 zero size 2024-03-18T14:43:13.769 INFO:tasks.workunit.client.1.smithi129.stdout:0/165: readlink d0/d14/l1c 0 2024-03-18T14:43:13.770 INFO:tasks.workunit.client.1.smithi129.stdout:9/102: dread d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:13.770 INFO:tasks.workunit.client.1.smithi129.stdout:9/103: stat d0/db/f12 0 2024-03-18T14:43:13.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/287: write d0/d49/f56 [256036,104186] 0 2024-03-18T14:43:13.772 INFO:tasks.workunit.client.0.smithi087.stdout:0/288: dread - d0/d2/d4/d19/d24/f63 zero size 2024-03-18T14:43:13.774 INFO:tasks.workunit.client.0.smithi087.stdout:6/279: unlink d3/d1a/d29/d22/d47/f4b 0 2024-03-18T14:43:13.775 INFO:tasks.workunit.client.1.smithi129.stdout:4/94: unlink d0/d9/cb 0 2024-03-18T14:43:13.775 INFO:tasks.workunit.client.1.smithi129.stdout:4/95: readlink d0/d9/la 0 2024-03-18T14:43:13.775 INFO:tasks.workunit.client.0.smithi087.stdout:5/334: mknod d13/d1b/d70/c73 0 2024-03-18T14:43:13.777 INFO:tasks.workunit.client.0.smithi087.stdout:3/350: sync 2024-03-18T14:43:13.777 INFO:tasks.workunit.client.1.smithi129.stdout:3/96: write d4/fb [728524,39968] 0 2024-03-18T14:43:13.777 INFO:tasks.workunit.client.1.smithi129.stdout:3/97: chown d4/fb 111322 1 2024-03-18T14:43:13.778 INFO:tasks.workunit.client.0.smithi087.stdout:3/351: fdatasync d0/de/d30/d46/f61 0 2024-03-18T14:43:13.778 INFO:tasks.workunit.client.0.smithi087.stdout:8/316: rmdir d1/d6/d2f 39 2024-03-18T14:43:13.778 INFO:tasks.workunit.client.0.smithi087.stdout:3/352: read d0/d3/d40/f56 [3698414,39053] 0 2024-03-18T14:43:13.779 INFO:tasks.workunit.client.1.smithi129.stdout:6/123: creat d3/d5/f27 x:0 0 0 2024-03-18T14:43:13.779 INFO:tasks.workunit.client.0.smithi087.stdout:1/352: truncate d3/d1d/f21 937526 0 2024-03-18T14:43:13.780 INFO:tasks.workunit.client.1.smithi129.stdout:3/98: read d4/fb [287909,12238] 0 2024-03-18T14:43:13.780 INFO:tasks.workunit.client.0.smithi087.stdout:1/353: chown d3/d1d/f33 2577 1 2024-03-18T14:43:13.782 INFO:tasks.workunit.client.0.smithi087.stdout:1/354: fsync d3/d1d/d1e/f37 0 2024-03-18T14:43:13.782 INFO:tasks.workunit.client.1.smithi129.stdout:5/106: rename d0/dc/fd to d0/dc/d18/f1d 0 2024-03-18T14:43:13.783 INFO:tasks.workunit.client.0.smithi087.stdout:7/377: write d1/d6/d29/f4d [776569,92882] 0 2024-03-18T14:43:13.783 INFO:tasks.workunit.client.0.smithi087.stdout:8/317: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:13.784 INFO:tasks.workunit.client.1.smithi129.stdout:9/104: fdatasync d0/f8 0 2024-03-18T14:43:13.784 INFO:tasks.workunit.client.1.smithi129.stdout:2/88: dwrite d7/fa [0,4194304] 0 2024-03-18T14:43:13.786 INFO:tasks.workunit.client.0.smithi087.stdout:2/286: dwrite d2/d4/d22/f50 [4194304,4194304] 0 2024-03-18T14:43:13.788 INFO:tasks.workunit.client.1.smithi129.stdout:6/124: mkdir d3/d5/db/df/d28 0 2024-03-18T14:43:13.789 INFO:tasks.workunit.client.0.smithi087.stdout:2/287: chown d2/d4/d22/d2c/f30 24081277 1 2024-03-18T14:43:13.790 INFO:tasks.workunit.client.1.smithi129.stdout:4/96: dwrite d0/f1c [8388608,4194304] 0 2024-03-18T14:43:13.790 INFO:tasks.workunit.client.0.smithi087.stdout:5/335: symlink d13/d1b/d70/l74 0 2024-03-18T14:43:13.791 INFO:tasks.workunit.client.0.smithi087.stdout:3/353: mkdir d0/de/d30/d67 0 2024-03-18T14:43:13.793 INFO:tasks.workunit.client.0.smithi087.stdout:8/318: dwrite d1/d6/d9/f3f [4194304,4194304] 0 2024-03-18T14:43:13.793 INFO:tasks.workunit.client.0.smithi087.stdout:7/378: dwrite d1/d6/da/d42/f7b [0,4194304] 0 2024-03-18T14:43:13.793 INFO:tasks.workunit.client.1.smithi129.stdout:6/125: dwrite d3/d5/db/f26 [0,4194304] 0 2024-03-18T14:43:13.795 INFO:tasks.workunit.client.0.smithi087.stdout:9/389: getdents db/d18/d3a 0 2024-03-18T14:43:13.796 INFO:tasks.workunit.client.1.smithi129.stdout:1/100: rename d1/d2/f12 to d1/f1b 0 2024-03-18T14:43:13.796 INFO:tasks.workunit.client.1.smithi129.stdout:9/105: mkdir d0/db/d1f 0 2024-03-18T14:43:13.796 INFO:tasks.workunit.client.1.smithi129.stdout:2/89: rmdir d7 39 2024-03-18T14:43:13.797 INFO:tasks.workunit.client.1.smithi129.stdout:1/101: chown d1/d2 29 1 2024-03-18T14:43:13.798 INFO:tasks.workunit.client.0.smithi087.stdout:2/288: mknod d2/d4/d22/d2c/c56 0 2024-03-18T14:43:13.798 INFO:tasks.workunit.client.0.smithi087.stdout:2/289: dread - d2/d4/d22/f4d zero size 2024-03-18T14:43:13.799 INFO:tasks.workunit.client.1.smithi129.stdout:8/136: unlink d9/d11/d1a/f19 0 2024-03-18T14:43:13.800 INFO:tasks.workunit.client.1.smithi129.stdout:8/137: chown d9/dc/f29 7768 1 2024-03-18T14:43:13.802 INFO:tasks.workunit.client.0.smithi087.stdout:2/290: dwrite d2/d4/d22/d2c/d3a/f51 [0,4194304] 0 2024-03-18T14:43:13.805 INFO:tasks.workunit.client.0.smithi087.stdout:5/336: mknod d13/d1b/d27/d35/c75 0 2024-03-18T14:43:13.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/355: mknod d3/d1d/d1e/d43/c6b 0 2024-03-18T14:43:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:0/289: creat d0/d2/d4/f66 x:0 0 0 2024-03-18T14:43:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:7/379: mknod d1/c83 0 2024-03-18T14:43:13.806 INFO:tasks.workunit.client.0.smithi087.stdout:8/319: dread - d1/d6/f20 zero size 2024-03-18T14:43:13.808 INFO:tasks.workunit.client.0.smithi087.stdout:2/291: stat d2/d4/f15 0 2024-03-18T14:43:13.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/263: sync 2024-03-18T14:43:13.810 INFO:tasks.workunit.client.0.smithi087.stdout:5/337: fsync d13/d1b/d30/f40 0 2024-03-18T14:43:13.811 INFO:tasks.workunit.client.0.smithi087.stdout:0/290: unlink d0/d2/f18 0 2024-03-18T14:43:13.812 INFO:tasks.workunit.client.1.smithi129.stdout:6/126: unlink d3/d5/db/de/c17 0 2024-03-18T14:43:13.817 INFO:tasks.workunit.client.1.smithi129.stdout:5/107: creat d0/df/d17/f1e x:0 0 0 2024-03-18T14:43:13.822 INFO:tasks.workunit.client.1.smithi129.stdout:7/94: rename d4/d7/d8/d12/f14 to d4/d7/d8/f1c 0 2024-03-18T14:43:13.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/380: creat d1/d6/d29/d2f/d68/d65/d60/f84 x:0 0 0 2024-03-18T14:43:13.826 INFO:tasks.workunit.client.0.smithi087.stdout:2/292: fdatasync d2/d4/f16 0 2024-03-18T14:43:13.827 INFO:tasks.workunit.client.0.smithi087.stdout:0/291: mknod d0/d1a/d34/d3d/c67 0 2024-03-18T14:43:13.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/280: dread d3/d1a/d29/d22/d23/f26 [0,4194304] 0 2024-03-18T14:43:13.828 INFO:tasks.workunit.client.0.smithi087.stdout:1/356: symlink d3/d1d/d1f/d63/l6c 0 2024-03-18T14:43:13.828 INFO:tasks.workunit.client.1.smithi129.stdout:1/102: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:13.829 INFO:tasks.workunit.client.1.smithi129.stdout:1/103: read d1/f9 [3327407,13720] 0 2024-03-18T14:43:13.829 INFO:tasks.workunit.client.0.smithi087.stdout:2/293: write d2/d4/d22/f39 [51864,80446] 0 2024-03-18T14:43:13.830 INFO:tasks.workunit.client.1.smithi129.stdout:3/99: creat d4/f21 x:0 0 0 2024-03-18T14:43:13.830 INFO:tasks.workunit.client.1.smithi129.stdout:6/127: symlink d3/d5/db/df/l29 0 2024-03-18T14:43:13.830 INFO:tasks.workunit.client.1.smithi129.stdout:0/166: sync 2024-03-18T14:43:13.831 INFO:tasks.workunit.client.1.smithi129.stdout:6/128: readlink d3/d6/l1d 0 2024-03-18T14:43:13.831 INFO:tasks.workunit.client.1.smithi129.stdout:5/108: mknod d0/df/d17/c1f 0 2024-03-18T14:43:13.832 INFO:tasks.workunit.client.1.smithi129.stdout:0/167: fdatasync d0/d23/d2c/f33 0 2024-03-18T14:43:13.832 INFO:tasks.workunit.client.1.smithi129.stdout:0/168: fdatasync d0/fd 0 2024-03-18T14:43:13.832 INFO:tasks.workunit.client.0.smithi087.stdout:7/381: dread d1/d6/da/f43 [0,4194304] 0 2024-03-18T14:43:13.832 INFO:tasks.workunit.client.0.smithi087.stdout:8/320: rename d1/d6/d14/f2a to d1/d6/d2f/d44/d45/d50/f66 0 2024-03-18T14:43:13.833 INFO:tasks.workunit.client.1.smithi129.stdout:0/169: fdatasync d0/d23/d35/f36 0 2024-03-18T14:43:13.833 INFO:tasks.workunit.client.0.smithi087.stdout:1/357: dwrite d3/d1d/f3d [4194304,4194304] 0 2024-03-18T14:43:13.838 INFO:tasks.workunit.client.0.smithi087.stdout:5/338: truncate d13/d1b/d27/d35/d3b/f6a 169237 0 2024-03-18T14:43:13.840 INFO:tasks.workunit.client.1.smithi129.stdout:9/106: mkdir d0/db/d1f/d20 0 2024-03-18T14:43:13.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/358: write d3/d1d/d1f/f3f [221817,117195] 0 2024-03-18T14:43:13.841 INFO:tasks.workunit.client.0.smithi087.stdout:2/294: dwrite d2/f1e [0,4194304] 0 2024-03-18T14:43:13.841 INFO:tasks.workunit.client.1.smithi129.stdout:2/90: dread d7/dd/f15 [0,4194304] 0 2024-03-18T14:43:13.842 INFO:tasks.workunit.client.1.smithi129.stdout:7/95: dread d4/d7/fa [0,4194304] 0 2024-03-18T14:43:13.842 INFO:tasks.workunit.client.1.smithi129.stdout:7/96: rename d4 to d4/d7/d8/d1d 22 2024-03-18T14:43:13.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/292: link d0/dd/f64 d0/d2/d4/d27/d29/d2a/f68 0 2024-03-18T14:43:13.843 INFO:tasks.workunit.client.1.smithi129.stdout:8/138: mknod d9/d11/d18/c2e 0 2024-03-18T14:43:13.846 INFO:tasks.workunit.client.1.smithi129.stdout:1/104: mknod d1/d2/c1c 0 2024-03-18T14:43:13.847 INFO:tasks.workunit.client.0.smithi087.stdout:6/281: creat d3/f5e x:0 0 0 2024-03-18T14:43:13.847 INFO:tasks.workunit.client.1.smithi129.stdout:3/100: readlink d4/d11/l20 0 2024-03-18T14:43:13.848 INFO:tasks.workunit.client.0.smithi087.stdout:5/339: creat d13/d1b/d27/d35/f76 x:0 0 0 2024-03-18T14:43:13.848 INFO:tasks.workunit.client.1.smithi129.stdout:5/109: creat d0/dc/f20 x:0 0 0 2024-03-18T14:43:13.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/390: dread db/d18/d1c/f71 [0,4194304] 0 2024-03-18T14:43:13.850 INFO:tasks.workunit.client.1.smithi129.stdout:6/129: mknod d3/d5/db/c2a 0 2024-03-18T14:43:13.852 INFO:tasks.workunit.client.0.smithi087.stdout:0/293: creat d0/d2/d3c/f69 x:0 0 0 2024-03-18T14:43:13.852 INFO:tasks.workunit.client.0.smithi087.stdout:6/282: dwrite d3/d1a/f1e [0,4194304] 0 2024-03-18T14:43:13.856 INFO:tasks.workunit.client.0.smithi087.stdout:8/321: creat d1/d6/f67 x:0 0 0 2024-03-18T14:43:13.856 INFO:tasks.workunit.client.1.smithi129.stdout:8/139: truncate d9/d11/d18/f2b 3261118 0 2024-03-18T14:43:13.857 INFO:tasks.workunit.client.0.smithi087.stdout:7/382: dread d1/d6/d29/d2f/f33 [0,4194304] 0 2024-03-18T14:43:13.858 INFO:tasks.workunit.client.0.smithi087.stdout:2/295: creat d2/d4/d22/d2c/d3a/d49/f57 x:0 0 0 2024-03-18T14:43:13.858 INFO:tasks.workunit.client.0.smithi087.stdout:6/283: read d3/f4 [1053347,52277] 0 2024-03-18T14:43:13.859 INFO:tasks.workunit.client.1.smithi129.stdout:1/105: creat d1/f1d x:0 0 0 2024-03-18T14:43:13.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/296: fdatasync d2/d4/d22/d2c/f3d 0 2024-03-18T14:43:13.860 INFO:tasks.workunit.client.1.smithi129.stdout:3/101: symlink d4/d11/l22 0 2024-03-18T14:43:13.860 INFO:tasks.workunit.client.1.smithi129.stdout:1/106: write d1/d2/f3 [3509906,89404] 0 2024-03-18T14:43:13.861 INFO:tasks.workunit.client.0.smithi087.stdout:9/391: mkdir db/d18/d51/d7b 0 2024-03-18T14:43:13.862 INFO:tasks.workunit.client.0.smithi087.stdout:9/392: write db/d18/d51/f5b [515205,292] 0 2024-03-18T14:43:13.863 INFO:tasks.workunit.client.0.smithi087.stdout:0/294: mknod d0/dd/c6a 0 2024-03-18T14:43:13.868 INFO:tasks.workunit.client.1.smithi129.stdout:9/107: creat d0/db/de/d19/f21 x:0 0 0 2024-03-18T14:43:13.868 INFO:tasks.workunit.client.1.smithi129.stdout:5/110: chown d0/f11 34836 1 2024-03-18T14:43:13.868 INFO:tasks.workunit.client.1.smithi129.stdout:8/140: mknod d9/d11/d18/c2f 0 2024-03-18T14:43:13.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/383: dread d1/f3 [0,4194304] 0 2024-03-18T14:43:13.871 INFO:tasks.workunit.client.0.smithi087.stdout:3/354: dread d0/d1c/d25/f3c [4194304,4194304] 0 2024-03-18T14:43:13.872 INFO:tasks.workunit.client.0.smithi087.stdout:3/355: fdatasync d0/f28 0 2024-03-18T14:43:13.872 INFO:tasks.workunit.client.1.smithi129.stdout:7/97: rmdir d4 39 2024-03-18T14:43:13.875 INFO:tasks.workunit.client.0.smithi087.stdout:4/264: sync 2024-03-18T14:43:13.875 INFO:tasks.workunit.client.0.smithi087.stdout:7/384: dwrite d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:13.876 INFO:tasks.workunit.client.0.smithi087.stdout:8/322: mknod d1/d6/d14/c68 0 2024-03-18T14:43:13.878 INFO:tasks.workunit.client.0.smithi087.stdout:4/265: write d2/db/d24/f2b [366837,29624] 0 2024-03-18T14:43:13.878 INFO:tasks.workunit.client.0.smithi087.stdout:1/359: truncate d3/d1d/d1e/f55 366596 0 2024-03-18T14:43:13.880 INFO:tasks.workunit.client.0.smithi087.stdout:6/284: creat d3/d1a/d29/d22/f5f x:0 0 0 2024-03-18T14:43:13.880 INFO:tasks.workunit.client.0.smithi087.stdout:5/340: dwrite d13/d1b/d27/d35/f4f [0,4194304] 0 2024-03-18T14:43:13.880 INFO:tasks.workunit.client.1.smithi129.stdout:0/170: sync 2024-03-18T14:43:13.881 INFO:tasks.workunit.client.0.smithi087.stdout:2/297: mkdir d2/d4/d22/d2c/d3a/d49/d58 0 2024-03-18T14:43:13.883 INFO:tasks.workunit.client.0.smithi087.stdout:2/298: fsync d2/d4/d22/d2c/f3d 0 2024-03-18T14:43:13.883 INFO:tasks.workunit.client.0.smithi087.stdout:0/295: mkdir d0/d2/d6b 0 2024-03-18T14:43:13.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/385: dwrite d1/d6/d29/f53 [0,4194304] 0 2024-03-18T14:43:13.886 INFO:tasks.workunit.client.0.smithi087.stdout:8/323: write d1/d6/d2f/d44/d45/d50/f5e [969880,56163] 0 2024-03-18T14:43:13.886 INFO:tasks.workunit.client.0.smithi087.stdout:4/266: mknod d2/db/d24/d30/d49/c55 0 2024-03-18T14:43:13.889 INFO:tasks.workunit.client.0.smithi087.stdout:4/267: chown d2/db/de/f2f 3126 1 2024-03-18T14:43:13.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/285: dwrite d3/d1a/d29/d22/f55 [0,4194304] 0 2024-03-18T14:43:13.890 INFO:tasks.workunit.client.0.smithi087.stdout:4/268: fdatasync d2/f36 0 2024-03-18T14:43:13.891 INFO:tasks.workunit.client.0.smithi087.stdout:8/324: dread d1/fd [0,4194304] 0 2024-03-18T14:43:13.893 INFO:tasks.workunit.client.0.smithi087.stdout:8/325: dread - d1/d6/d9/d5d/f65 zero size 2024-03-18T14:43:13.893 INFO:tasks.workunit.client.0.smithi087.stdout:1/360: link d3/d1d/f3d d3/d1d/d1f/d63/f6d 0 2024-03-18T14:43:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:8/326: write d1/d6/d2f/f30 [5456788,20433] 0 2024-03-18T14:43:13.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/356: truncate d0/f37 937635 0 2024-03-18T14:43:13.896 INFO:tasks.workunit.client.0.smithi087.stdout:4/269: dwrite d2/db/d24/f4c [0,4194304] 0 2024-03-18T14:43:13.896 INFO:tasks.workunit.client.0.smithi087.stdout:7/386: fsync d1/d6/d16/f4e 0 2024-03-18T14:43:13.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/357: dread d0/f34 [0,4194304] 0 2024-03-18T14:43:13.902 INFO:tasks.workunit.client.0.smithi087.stdout:8/327: stat d1/d6/d2f/d44/c4d 0 2024-03-18T14:43:13.902 INFO:tasks.workunit.client.0.smithi087.stdout:8/328: readlink d1/d6/d9/l34 0 2024-03-18T14:43:13.903 INFO:tasks.workunit.client.0.smithi087.stdout:0/296: creat d0/f6c x:0 0 0 2024-03-18T14:43:13.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/297: fsync d0/dd/f38 0 2024-03-18T14:43:13.905 INFO:tasks.workunit.client.0.smithi087.stdout:4/270: mkdir d2/db/d24/d30/d56 0 2024-03-18T14:43:13.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/358: rmdir d0/d3/df/d42 39 2024-03-18T14:43:13.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/341: getdents d13/d1b 0 2024-03-18T14:43:13.907 INFO:tasks.workunit.client.0.smithi087.stdout:5/342: dread - d13/f37 zero size 2024-03-18T14:43:13.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/393: dread db/fd [0,4194304] 0 2024-03-18T14:43:13.912 INFO:tasks.workunit.client.0.smithi087.stdout:1/361: mkdir d3/d1d/d6e 0 2024-03-18T14:43:13.912 INFO:tasks.workunit.client.0.smithi087.stdout:5/343: dread d13/d1b/d27/d35/f4b [0,4194304] 0 2024-03-18T14:43:13.913 INFO:tasks.workunit.client.0.smithi087.stdout:1/362: write d3/f17 [224355,88272] 0 2024-03-18T14:43:13.913 INFO:tasks.workunit.client.0.smithi087.stdout:5/344: chown d13/d1b/d30/c60 98 1 2024-03-18T14:43:13.914 INFO:tasks.workunit.client.0.smithi087.stdout:5/345: fdatasync d13/d1b/d27/d28/f66 0 2024-03-18T14:43:13.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/346: dread - d13/d1b/f2b zero size 2024-03-18T14:43:13.917 INFO:tasks.workunit.client.0.smithi087.stdout:6/286: write d3/d7/f43 [3917388,81228] 0 2024-03-18T14:43:13.917 INFO:tasks.workunit.client.0.smithi087.stdout:2/299: dwrite d2/d4/d22/f36 [4194304,4194304] 0 2024-03-18T14:43:13.918 INFO:tasks.workunit.client.0.smithi087.stdout:2/300: dread - d2/d4/d22/d2c/f3d zero size 2024-03-18T14:43:13.923 INFO:tasks.workunit.client.0.smithi087.stdout:0/298: rename d0/dd/c6a to d0/d2/d4/d19/d24/c6d 0 2024-03-18T14:43:13.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/271: unlink d2/db/l25 0 2024-03-18T14:43:13.926 INFO:tasks.workunit.client.0.smithi087.stdout:9/394: mkdir db/d18/d1e/d28/d7c 0 2024-03-18T14:43:13.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/329: symlink d1/d6/l69 0 2024-03-18T14:43:13.928 INFO:tasks.workunit.client.0.smithi087.stdout:7/387: truncate d1/d6/da/f37 3113508 0 2024-03-18T14:43:13.931 INFO:tasks.workunit.client.0.smithi087.stdout:1/363: write d3/d1d/d45/f49 [4107692,53283] 0 2024-03-18T14:43:13.931 INFO:tasks.workunit.client.0.smithi087.stdout:1/364: write d3/d1d/d1f/d34/f53 [1354462,86019] 0 2024-03-18T14:43:13.931 INFO:tasks.workunit.client.0.smithi087.stdout:5/347: creat d13/d1b/d27/d28/f77 x:0 0 0 2024-03-18T14:43:13.932 INFO:tasks.workunit.client.0.smithi087.stdout:5/348: write d13/f3f [311657,77688] 0 2024-03-18T14:43:13.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/299: mkdir d0/d2/d4/d27/d32/d6e 0 2024-03-18T14:43:13.945 INFO:tasks.workunit.client.0.smithi087.stdout:3/359: dwrite d0/de/f12 [0,4194304] 0 2024-03-18T14:43:13.950 INFO:tasks.workunit.client.0.smithi087.stdout:3/360: dwrite d0/de/d30/f66 [0,4194304] 0 2024-03-18T14:43:13.952 INFO:tasks.workunit.client.0.smithi087.stdout:7/388: mknod d1/d6/da/d42/d61/d74/c85 0 2024-03-18T14:43:13.954 INFO:tasks.workunit.client.0.smithi087.stdout:6/287: link d3/d7/le d3/d7/d25/l60 0 2024-03-18T14:43:13.954 INFO:tasks.workunit.client.0.smithi087.stdout:6/288: chown d3/d7/d25/c2d 3073366 1 2024-03-18T14:43:13.956 INFO:tasks.workunit.client.0.smithi087.stdout:2/301: link d2/d44/f45 d2/d4/f59 0 2024-03-18T14:43:13.956 INFO:tasks.workunit.client.0.smithi087.stdout:2/302: write d2/f43 [977165,40484] 0 2024-03-18T14:43:13.957 INFO:tasks.workunit.client.0.smithi087.stdout:9/395: dread db/f2f [0,4194304] 0 2024-03-18T14:43:13.958 INFO:tasks.workunit.client.0.smithi087.stdout:4/272: truncate d2/d13/d28/f40 272055 0 2024-03-18T14:43:13.961 INFO:tasks.workunit.client.0.smithi087.stdout:3/361: rmdir d0/de/d30 39 2024-03-18T14:43:13.962 INFO:tasks.workunit.client.0.smithi087.stdout:3/362: write d0/d3/df/f4d [2134482,6206] 0 2024-03-18T14:43:13.963 INFO:tasks.workunit.client.0.smithi087.stdout:3/363: read d0/f34 [592215,41627] 0 2024-03-18T14:43:13.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/389: rename d1/f3 to d1/d6/d29/d2f/d68/d65/f86 0 2024-03-18T14:43:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/390: write d1/f76 [741317,17665] 0 2024-03-18T14:43:13.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/391: write d1/d6/da/ff [136250,26026] 0 2024-03-18T14:43:13.966 INFO:tasks.workunit.client.0.smithi087.stdout:6/289: mkdir d3/d1a/d29/d22/d61 0 2024-03-18T14:43:13.968 INFO:tasks.workunit.client.0.smithi087.stdout:8/330: link d1/d6/c37 d1/d6/c6a 0 2024-03-18T14:43:13.973 INFO:tasks.workunit.client.0.smithi087.stdout:0/300: truncate d0/d2/f17 805189 0 2024-03-18T14:43:13.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/349: getdents d13/d1b/d27/d35 0 2024-03-18T14:43:13.984 INFO:tasks.workunit.client.0.smithi087.stdout:2/303: mkdir d2/d4/d5a 0 2024-03-18T14:43:13.984 INFO:tasks.workunit.client.0.smithi087.stdout:6/290: rmdir d3/d1a/d29/d22/d47 39 2024-03-18T14:43:13.986 INFO:tasks.workunit.client.0.smithi087.stdout:9/396: creat db/d18/d1e/d28/d7c/f7d x:0 0 0 2024-03-18T14:43:13.986 INFO:tasks.workunit.client.0.smithi087.stdout:4/273: creat d2/db/d24/d30/d4d/f57 x:0 0 0 2024-03-18T14:43:13.988 INFO:tasks.workunit.client.0.smithi087.stdout:8/331: mknod d1/d6/d2f/d44/d45/c6b 0 2024-03-18T14:43:13.988 INFO:tasks.workunit.client.0.smithi087.stdout:1/365: getdents d3/d1d/d1e/d43/d50 0 2024-03-18T14:43:13.990 INFO:tasks.workunit.client.0.smithi087.stdout:3/364: creat d0/de/d30/d46/f68 x:0 0 0 2024-03-18T14:43:13.991 INFO:tasks.workunit.client.0.smithi087.stdout:6/291: dwrite d3/d1a/f1e [0,4194304] 0 2024-03-18T14:43:13.991 INFO:tasks.workunit.client.0.smithi087.stdout:7/392: creat d1/d6/da/d42/d67/f87 x:0 0 0 2024-03-18T14:43:13.994 INFO:tasks.workunit.client.0.smithi087.stdout:0/301: mknod d0/d2/d4/d19/d62/c6f 0 2024-03-18T14:43:13.995 INFO:tasks.workunit.client.0.smithi087.stdout:4/274: dwrite d2/f9 [0,4194304] 0 2024-03-18T14:43:13.998 INFO:tasks.workunit.client.0.smithi087.stdout:7/393: dwrite d1/d6/f14 [0,4194304] 0 2024-03-18T14:43:14.000 INFO:tasks.workunit.client.0.smithi087.stdout:2/304: symlink d2/d4/d22/d2c/d3a/d49/d58/l5b 0 2024-03-18T14:43:14.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/350: truncate d13/d1b/d30/f52 1647568 0 2024-03-18T14:43:14.006 INFO:tasks.workunit.client.0.smithi087.stdout:0/302: rename d0/d2/d4/d19/f54 to d0/d2/d4/d19/d62/f70 0 2024-03-18T14:43:14.007 INFO:tasks.workunit.client.0.smithi087.stdout:7/394: symlink d1/d6/da/d59/l88 0 2024-03-18T14:43:14.010 INFO:tasks.workunit.client.0.smithi087.stdout:0/303: dwrite d0/d1a/d34/d3d/f3e [0,4194304] 0 2024-03-18T14:43:14.011 INFO:tasks.workunit.client.0.smithi087.stdout:7/395: dread d1/d6/f18 [0,4194304] 0 2024-03-18T14:43:14.012 INFO:tasks.workunit.client.0.smithi087.stdout:9/397: truncate db/d18/d1e/f46 1150789 0 2024-03-18T14:43:14.013 INFO:tasks.workunit.client.0.smithi087.stdout:5/351: creat d13/d1b/d27/d28/f78 x:0 0 0 2024-03-18T14:43:14.014 INFO:tasks.workunit.client.0.smithi087.stdout:6/292: getdents d3/d1a/d29/d22/d53 0 2024-03-18T14:43:14.015 INFO:tasks.workunit.client.0.smithi087.stdout:6/293: fdatasync d3/d7/f2e 0 2024-03-18T14:43:14.023 INFO:tasks.workunit.client.0.smithi087.stdout:0/304: creat d0/d2/d4/d19/d24/f71 x:0 0 0 2024-03-18T14:43:14.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/396: mknod d1/c89 0 2024-03-18T14:43:14.023 INFO:tasks.workunit.client.0.smithi087.stdout:2/305: creat d2/d4/d22/d2c/d3a/d40/d52/f5c x:0 0 0 2024-03-18T14:43:14.028 INFO:tasks.workunit.client.0.smithi087.stdout:9/398: dwrite db/ff [0,4194304] 0 2024-03-18T14:43:14.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/294: rmdir d3/d1a/d29/d22 39 2024-03-18T14:43:14.032 INFO:tasks.workunit.client.0.smithi087.stdout:1/366: truncate d3/d1d/f28 1202763 0 2024-03-18T14:43:14.033 INFO:tasks.workunit.client.0.smithi087.stdout:1/367: dread - d3/d1d/d1e/d20/f52 zero size 2024-03-18T14:43:14.034 INFO:tasks.workunit.client.1.smithi129.stdout:4/97: getdents d0 0 2024-03-18T14:43:14.035 INFO:tasks.workunit.client.1.smithi129.stdout:6/130: mkdir d3/d5/d2b 0 2024-03-18T14:43:14.035 INFO:tasks.workunit.client.0.smithi087.stdout:3/365: getdents d0/de/d30/d46 0 2024-03-18T14:43:14.036 INFO:tasks.workunit.client.1.smithi129.stdout:6/131: fdatasync d3/d5/f1c 0 2024-03-18T14:43:14.036 INFO:tasks.workunit.client.1.smithi129.stdout:3/102: mknod d4/dd/d1f/c23 0 2024-03-18T14:43:14.036 INFO:tasks.workunit.client.0.smithi087.stdout:8/332: truncate d1/d6/d2f/d44/d45/d50/f5e 119126 0 2024-03-18T14:43:14.036 INFO:tasks.workunit.client.0.smithi087.stdout:3/366: fdatasync d0/de/d30/d46/f68 0 2024-03-18T14:43:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/367: readlink d0/d3/l5f 0 2024-03-18T14:43:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:8/333: chown d1/d6/d14/f1c 42 1 2024-03-18T14:43:14.037 INFO:tasks.workunit.client.1.smithi129.stdout:2/91: creat d7/f1d x:0 0 0 2024-03-18T14:43:14.037 INFO:tasks.workunit.client.0.smithi087.stdout:3/368: write d0/de/d30/f5d [347103,2069] 0 2024-03-18T14:43:14.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/306: write d2/d4/f19 [360273,50795] 0 2024-03-18T14:43:14.038 INFO:tasks.workunit.client.1.smithi129.stdout:1/107: mknod d1/c1e 0 2024-03-18T14:43:14.039 INFO:tasks.workunit.client.0.smithi087.stdout:0/305: creat d0/d2/d4/d19/f72 x:0 0 0 2024-03-18T14:43:14.040 INFO:tasks.workunit.client.1.smithi129.stdout:5/111: fdatasync d0/f1 0 2024-03-18T14:43:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:0/306: write d0/d2/d4/d27/d29/d26/f2c [143373,4173] 0 2024-03-18T14:43:14.040 INFO:tasks.workunit.client.0.smithi087.stdout:4/275: truncate d2/db/f20 264466 0 2024-03-18T14:43:14.041 INFO:tasks.workunit.client.1.smithi129.stdout:9/108: symlink d0/db/de/d19/l22 0 2024-03-18T14:43:14.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/307: dread - d0/d2/d4/d19/f5e zero size 2024-03-18T14:43:14.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/92: dwrite f5 [0,4194304] 0 2024-03-18T14:43:14.044 INFO:tasks.workunit.client.1.smithi129.stdout:7/98: chown d4/d7/d8/d12/f18 858057 1 2024-03-18T14:43:14.044 INFO:tasks.workunit.client.1.smithi129.stdout:6/132: truncate d3/d5/f11 1209258 0 2024-03-18T14:43:14.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/352: fsync d13/d1b/d27/d35/d3b/f6a 0 2024-03-18T14:43:14.045 INFO:tasks.workunit.client.0.smithi087.stdout:0/308: dwrite d0/d2/d3c/f69 [0,4194304] 0 2024-03-18T14:43:14.046 INFO:tasks.workunit.client.0.smithi087.stdout:5/353: fdatasync d13/d1b/f2b 0 2024-03-18T14:43:14.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/399: mkdir db/d18/d1e/d7e 0 2024-03-18T14:43:14.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/368: write d3/d1d/d1f/f24 [4179359,65323] 0 2024-03-18T14:43:14.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/334: creat d1/d6/d9/f6c x:0 0 0 2024-03-18T14:43:14.057 INFO:tasks.workunit.client.0.smithi087.stdout:2/307: dwrite d2/f10 [0,4194304] 0 2024-03-18T14:43:14.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/276: creat d2/db/d24/f58 x:0 0 0 2024-03-18T14:43:14.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/277: write d2/f36 [2547679,56903] 0 2024-03-18T14:43:14.059 INFO:tasks.workunit.client.0.smithi087.stdout:0/309: mkdir d0/d2/d3c/d73 0 2024-03-18T14:43:14.060 INFO:tasks.workunit.client.0.smithi087.stdout:2/308: write d2/d4/d22/d24/f2a [3349664,3019] 0 2024-03-18T14:43:14.060 INFO:tasks.workunit.client.0.smithi087.stdout:0/310: fsync d0/d2/d4/f66 0 2024-03-18T14:43:14.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/278: dread - d2/d13/d28/f42 zero size 2024-03-18T14:43:14.061 INFO:tasks.workunit.client.0.smithi087.stdout:1/369: fsync d3/f4e 0 2024-03-18T14:43:14.062 INFO:tasks.workunit.client.1.smithi129.stdout:1/108: rename d1/d2/f5 to d1/d2/f1f 0 2024-03-18T14:43:14.064 INFO:tasks.workunit.client.1.smithi129.stdout:5/112: mknod d0/df/c21 0 2024-03-18T14:43:14.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/335: rename d1/d6/d2f/d44/d45/f4a to d1/f6d 0 2024-03-18T14:43:14.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/369: getdents d0/d3/d40/d44 0 2024-03-18T14:43:14.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/370: fsync d0/d3/df/f14 0 2024-03-18T14:43:14.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/371: fsync d0/f1 0 2024-03-18T14:43:14.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/372: chown d0/d1c/d25 63306417 1 2024-03-18T14:43:14.066 INFO:tasks.workunit.client.1.smithi129.stdout:8/141: rename d9/d11/d18/f2b to d9/d11/d1a/f30 0 2024-03-18T14:43:14.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/373: write d0/f1 [42531,64939] 0 2024-03-18T14:43:14.067 INFO:tasks.workunit.client.1.smithi129.stdout:8/142: dread - d9/d11/d1a/d14/f28 zero size 2024-03-18T14:43:14.069 INFO:tasks.workunit.client.0.smithi087.stdout:0/311: mknod d0/d1a/d34/c74 0 2024-03-18T14:43:14.070 INFO:tasks.workunit.client.0.smithi087.stdout:0/312: chown d0/d2/d4/d19/d5a/f5b 139 1 2024-03-18T14:43:14.070 INFO:tasks.workunit.client.0.smithi087.stdout:4/279: symlink d2/d13/l59 0 2024-03-18T14:43:14.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/280: write d2/db/d24/f33 [801006,95904] 0 2024-03-18T14:43:14.072 INFO:tasks.workunit.client.0.smithi087.stdout:4/281: chown d2/db/c14 1023319 1 2024-03-18T14:43:14.073 INFO:tasks.workunit.client.0.smithi087.stdout:2/309: rmdir d2/d4/d22/d2c/d3a/d49/d58 39 2024-03-18T14:43:14.074 INFO:tasks.workunit.client.0.smithi087.stdout:0/313: dread d0/d2/d3c/f69 [0,4194304] 0 2024-03-18T14:43:14.077 INFO:tasks.workunit.client.0.smithi087.stdout:8/336: creat d1/d6/d9/f6e x:0 0 0 2024-03-18T14:43:14.077 INFO:tasks.workunit.client.0.smithi087.stdout:2/310: dwrite d2/f2f [0,4194304] 0 2024-03-18T14:43:14.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/397: link d1/d6/d29/d2f/c77 d1/d6/d16/dc/c8a 0 2024-03-18T14:43:14.080 INFO:tasks.workunit.client.0.smithi087.stdout:5/354: write fb [3847696,101199] 0 2024-03-18T14:43:14.080 INFO:tasks.workunit.client.1.smithi129.stdout:3/103: sync 2024-03-18T14:43:14.080 INFO:tasks.workunit.client.1.smithi129.stdout:3/104: fsync d4/fc 0 2024-03-18T14:43:14.081 INFO:tasks.workunit.client.0.smithi087.stdout:3/374: chown d0/d3/d10/l47 1417284 1 2024-03-18T14:43:14.083 INFO:tasks.workunit.client.0.smithi087.stdout:3/375: dread - d0/de/d30/d46/f61 zero size 2024-03-18T14:43:14.083 INFO:tasks.workunit.client.0.smithi087.stdout:6/295: dwrite d3/d1a/d29/f1d [4194304,4194304] 0 2024-03-18T14:43:14.085 INFO:tasks.workunit.client.1.smithi129.stdout:3/105: dwrite d4/dd/d15/d16/f1b [0,4194304] 0 2024-03-18T14:43:14.087 INFO:tasks.workunit.client.0.smithi087.stdout:1/370: symlink d3/d1d/d1e/l6f 0 2024-03-18T14:43:14.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/311: mknod d2/d4/d22/d24/c5d 0 2024-03-18T14:43:14.090 INFO:tasks.workunit.client.0.smithi087.stdout:7/398: unlink d1/f2b 0 2024-03-18T14:43:14.091 INFO:tasks.workunit.client.0.smithi087.stdout:5/355: readlink d13/d1b/d27/d28/l69 0 2024-03-18T14:43:14.095 INFO:tasks.workunit.client.0.smithi087.stdout:9/400: write db/d18/d1e/f46 [1668327,92736] 0 2024-03-18T14:43:14.098 INFO:tasks.workunit.client.0.smithi087.stdout:6/296: mkdir d3/d7/d25/d62 0 2024-03-18T14:43:14.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/314: fsync d0/d2/d4/d27/d32/f44 0 2024-03-18T14:43:14.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/315: read d0/d1a/f20 [303837,42301] 0 2024-03-18T14:43:14.103 INFO:tasks.workunit.client.0.smithi087.stdout:5/356: mkdir d13/d1b/d27/d28/d79 0 2024-03-18T14:43:14.105 INFO:tasks.workunit.client.1.smithi129.stdout:4/98: mkdir d0/d19/d1d 0 2024-03-18T14:43:14.106 INFO:tasks.workunit.client.1.smithi129.stdout:2/93: sync 2024-03-18T14:43:14.107 INFO:tasks.workunit.client.0.smithi087.stdout:9/401: mknod db/d18/d1c/d69/d6f/c7f 0 2024-03-18T14:43:14.108 INFO:tasks.workunit.client.1.smithi129.stdout:4/99: dread d0/f1c [4194304,4194304] 0 2024-03-18T14:43:14.109 INFO:tasks.workunit.client.0.smithi087.stdout:8/337: creat d1/d6/d2f/d44/f6f x:0 0 0 2024-03-18T14:43:14.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/100: fsync d0/d9/f15 0 2024-03-18T14:43:14.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/312: mknod d2/d4/d22/d2c/d3a/d49/d58/c5e 0 2024-03-18T14:43:14.111 INFO:tasks.workunit.client.0.smithi087.stdout:9/402: dwrite db/f73 [0,4194304] 0 2024-03-18T14:43:14.112 INFO:tasks.workunit.client.1.smithi129.stdout:4/101: dread d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:14.112 INFO:tasks.workunit.client.0.smithi087.stdout:9/403: write db/d18/d1e/f54 [2792651,80616] 0 2024-03-18T14:43:14.113 INFO:tasks.workunit.client.0.smithi087.stdout:9/404: write db/d18/d51/f5c [163492,53409] 0 2024-03-18T14:43:14.115 INFO:tasks.workunit.client.1.smithi129.stdout:7/99: symlink d4/d7/l1e 0 2024-03-18T14:43:14.116 INFO:tasks.workunit.client.0.smithi087.stdout:5/357: mknod d13/d1b/d27/d35/d3b/c7a 0 2024-03-18T14:43:14.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/100: dread - d4/d7/d8/d12/f18 zero size 2024-03-18T14:43:14.117 INFO:tasks.workunit.client.0.smithi087.stdout:3/376: creat d0/d1c/f69 x:0 0 0 2024-03-18T14:43:14.117 INFO:tasks.workunit.client.0.smithi087.stdout:1/371: dwrite d3/d1d/d1f/d34/f3e [0,4194304] 0 2024-03-18T14:43:14.120 INFO:tasks.workunit.client.0.smithi087.stdout:7/399: truncate d1/d6/d29/d2f/d68/d65/d60/f64 2888071 0 2024-03-18T14:43:14.122 INFO:tasks.workunit.client.0.smithi087.stdout:4/282: getdents d2/db/d24 0 2024-03-18T14:43:14.123 INFO:tasks.workunit.client.0.smithi087.stdout:6/297: symlink d3/d1a/l63 0 2024-03-18T14:43:14.124 INFO:tasks.workunit.client.0.smithi087.stdout:0/316: symlink d0/d2/d4/d19/d24/d5d/l75 0 2024-03-18T14:43:14.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/338: chown d1/lb 138553641 1 2024-03-18T14:43:14.126 INFO:tasks.workunit.client.0.smithi087.stdout:0/317: dread - d0/d2/d4/d27/d29/d2a/f68 zero size 2024-03-18T14:43:14.128 INFO:tasks.workunit.client.0.smithi087.stdout:2/313: creat d2/d4/d22/d2c/d3a/d40/f5f x:0 0 0 2024-03-18T14:43:14.129 INFO:tasks.workunit.client.0.smithi087.stdout:2/314: chown d2 70 1 2024-03-18T14:43:14.131 INFO:tasks.workunit.client.0.smithi087.stdout:3/377: dread d0/d1c/f4b [0,4194304] 0 2024-03-18T14:43:14.132 INFO:tasks.workunit.client.0.smithi087.stdout:1/372: creat d3/d1d/d1f/f70 x:0 0 0 2024-03-18T14:43:14.132 INFO:tasks.workunit.client.0.smithi087.stdout:7/400: mkdir d1/d6/d29/d2f/d68/d65/d60/d66/d8b 0 2024-03-18T14:43:14.133 INFO:tasks.workunit.client.0.smithi087.stdout:2/315: dwrite d2/d4/d22/d24/f2a [0,4194304] 0 2024-03-18T14:43:14.134 INFO:tasks.workunit.client.0.smithi087.stdout:6/298: chown d3/d1a/d29/f16 953 1 2024-03-18T14:43:14.137 INFO:tasks.workunit.client.1.smithi129.stdout:0/171: truncate d0/f11 1057291 0 2024-03-18T14:43:14.138 INFO:tasks.workunit.client.1.smithi129.stdout:0/172: read d0/fb [2132257,34252] 0 2024-03-18T14:43:14.138 INFO:tasks.workunit.client.0.smithi087.stdout:2/316: dwrite d2/d4/d22/d24/f35 [0,4194304] 0 2024-03-18T14:43:14.139 INFO:tasks.workunit.client.1.smithi129.stdout:0/173: chown d0 18 1 2024-03-18T14:43:14.139 INFO:tasks.workunit.client.0.smithi087.stdout:2/317: readlink d2/d4/d22/d2c/l3e 0 2024-03-18T14:43:14.139 INFO:tasks.workunit.client.1.smithi129.stdout:0/174: write d0/d23/d35/f36 [1032907,84355] 0 2024-03-18T14:43:14.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/318: chown d2/d4/d22/l4f 1 1 2024-03-18T14:43:14.140 INFO:tasks.workunit.client.0.smithi087.stdout:2/319: fdatasync d2/d4/d22/d2c/f3d 0 2024-03-18T14:43:14.140 INFO:tasks.workunit.client.1.smithi129.stdout:5/113: dread d0/f6 [0,4194304] 0 2024-03-18T14:43:14.141 INFO:tasks.workunit.client.1.smithi129.stdout:5/114: write d0/df/d17/f1e [653525,48141] 0 2024-03-18T14:43:14.141 INFO:tasks.workunit.client.0.smithi087.stdout:2/320: write d2/d4/d22/f36 [4197301,364] 0 2024-03-18T14:43:14.142 INFO:tasks.workunit.client.0.smithi087.stdout:0/318: symlink d0/d2/d4/d27/d29/d2a/l76 0 2024-03-18T14:43:14.143 INFO:tasks.workunit.client.1.smithi129.stdout:9/109: rename d0/fc to d0/db/d1f/f23 0 2024-03-18T14:43:14.143 INFO:tasks.workunit.client.0.smithi087.stdout:9/405: dwrite db/d12/f20 [0,4194304] 0 2024-03-18T14:43:14.147 INFO:tasks.workunit.client.1.smithi129.stdout:3/106: creat d4/dd/d15/d16/f24 x:0 0 0 2024-03-18T14:43:14.147 INFO:tasks.workunit.client.1.smithi129.stdout:1/109: dwrite d1/f9 [0,4194304] 0 2024-03-18T14:43:14.148 INFO:tasks.workunit.client.0.smithi087.stdout:9/406: dwrite db/f22 [4194304,4194304] 0 2024-03-18T14:43:14.148 INFO:tasks.workunit.client.0.smithi087.stdout:1/373: rmdir d3/d1d/d1f/d34 39 2024-03-18T14:43:14.148 INFO:tasks.workunit.client.1.smithi129.stdout:1/110: write d1/f1b [79925,16327] 0 2024-03-18T14:43:14.149 INFO:tasks.workunit.client.0.smithi087.stdout:4/283: symlink d2/db/d24/d30/d49/d4f/l5a 0 2024-03-18T14:43:14.153 INFO:tasks.workunit.client.1.smithi129.stdout:4/102: mkdir d0/d9/d1e 0 2024-03-18T14:43:14.158 INFO:tasks.workunit.client.1.smithi129.stdout:5/115: rename d0/df/d17 to d0/dc/d22 0 2024-03-18T14:43:14.162 INFO:tasks.workunit.client.1.smithi129.stdout:1/111: mknod d1/d18/c20 0 2024-03-18T14:43:14.167 INFO:tasks.workunit.client.1.smithi129.stdout:6/133: truncate d3/d6/f18 1349651 0 2024-03-18T14:43:14.168 INFO:tasks.workunit.client.1.smithi129.stdout:7/101: write d4/d7/fa [5068390,70083] 0 2024-03-18T14:43:14.168 INFO:tasks.workunit.client.1.smithi129.stdout:6/134: dread - d3/d5/f27 zero size 2024-03-18T14:43:14.169 INFO:tasks.workunit.client.1.smithi129.stdout:6/135: readlink d3/d6/l1d 0 2024-03-18T14:43:14.170 INFO:tasks.workunit.client.1.smithi129.stdout:0/175: rename d0/cc to d0/c39 0 2024-03-18T14:43:14.171 INFO:tasks.workunit.client.1.smithi129.stdout:9/110: mknod d0/db/d1f/d20/c24 0 2024-03-18T14:43:14.172 INFO:tasks.workunit.client.1.smithi129.stdout:2/94: truncate d7/dd/f15 3610293 0 2024-03-18T14:43:14.173 INFO:tasks.workunit.client.1.smithi129.stdout:9/111: chown d0/db/d1f/f23 13 1 2024-03-18T14:43:14.173 INFO:tasks.workunit.client.1.smithi129.stdout:3/107: sync 2024-03-18T14:43:14.174 INFO:tasks.workunit.client.1.smithi129.stdout:9/112: chown d0/f8 0 1 2024-03-18T14:43:14.175 INFO:tasks.workunit.client.1.smithi129.stdout:6/136: dwrite d3/d5/db/f26 [0,4194304] 0 2024-03-18T14:43:14.175 INFO:tasks.workunit.client.1.smithi129.stdout:3/108: write d4/fc [1068770,65642] 0 2024-03-18T14:43:14.175 INFO:tasks.workunit.client.1.smithi129.stdout:1/112: creat d1/d18/f21 x:0 0 0 2024-03-18T14:43:14.178 INFO:tasks.workunit.client.1.smithi129.stdout:0/176: mkdir d0/d14/d3a 0 2024-03-18T14:43:14.178 INFO:tasks.workunit.client.1.smithi129.stdout:6/137: write d3/d5/db/de/f1f [4812337,112781] 0 2024-03-18T14:43:14.179 INFO:tasks.workunit.client.0.smithi087.stdout:0/319: unlink d0/d2/d4/d27/d29/d2a/c33 0 2024-03-18T14:43:14.179 INFO:tasks.workunit.client.1.smithi129.stdout:0/177: fsync d0/fb 0 2024-03-18T14:43:14.180 INFO:tasks.workunit.client.0.smithi087.stdout:5/358: write f12 [785433,75507] 0 2024-03-18T14:43:14.180 INFO:tasks.workunit.client.1.smithi129.stdout:4/103: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:14.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/339: truncate d1/fd 3542531 0 2024-03-18T14:43:14.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/320: read - d0/d2/d4/d27/d32/f36 zero size 2024-03-18T14:43:14.182 INFO:tasks.workunit.client.0.smithi087.stdout:7/401: creat d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f8c x:0 0 0 2024-03-18T14:43:14.182 INFO:tasks.workunit.client.0.smithi087.stdout:1/374: rename d3/d1d/d1e/d43/d50/d54 to d3/d1d/d1e/d43/d50/d71 0 2024-03-18T14:43:14.183 INFO:tasks.workunit.client.0.smithi087.stdout:8/340: chown d1/d6/d14/f1c 490 1 2024-03-18T14:43:14.185 INFO:tasks.workunit.client.0.smithi087.stdout:4/284: creat d2/f5b x:0 0 0 2024-03-18T14:43:14.186 INFO:tasks.workunit.client.0.smithi087.stdout:0/321: chown d0/d2/d4/d27/d29 26817 1 2024-03-18T14:43:14.187 INFO:tasks.workunit.client.0.smithi087.stdout:3/378: dwrite d0/d3/d40/f56 [0,4194304] 0 2024-03-18T14:43:14.187 INFO:tasks.workunit.client.0.smithi087.stdout:6/299: rename d3/d1a/c37 to d3/d1a/d29/d22/d61/c64 0 2024-03-18T14:43:14.188 INFO:tasks.workunit.client.1.smithi129.stdout:0/178: dread d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:14.189 INFO:tasks.workunit.client.0.smithi087.stdout:3/379: write d0/d3/d10/f5e [323246,99525] 0 2024-03-18T14:43:14.189 INFO:tasks.workunit.client.0.smithi087.stdout:7/402: creat d1/d6/da/d42/d61/d74/f8d x:0 0 0 2024-03-18T14:43:14.191 INFO:tasks.workunit.client.1.smithi129.stdout:7/102: rename d4/d7/l13 to d4/d7/d8/l1f 0 2024-03-18T14:43:14.191 INFO:tasks.workunit.client.1.smithi129.stdout:3/109: creat d4/dd/d15/f25 x:0 0 0 2024-03-18T14:43:14.192 INFO:tasks.workunit.client.1.smithi129.stdout:5/116: link d0/c15 d0/dc/d22/c23 0 2024-03-18T14:43:14.192 INFO:tasks.workunit.client.1.smithi129.stdout:5/117: readlink d0/df/l10 0 2024-03-18T14:43:14.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/322: unlink d0/dd/f30 0 2024-03-18T14:43:14.193 INFO:tasks.workunit.client.1.smithi129.stdout:8/143: dread f6 [0,4194304] 0 2024-03-18T14:43:14.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/144: write d9/dc/f20 [961340,22843] 0 2024-03-18T14:43:14.194 INFO:tasks.workunit.client.0.smithi087.stdout:8/341: rename d1/d6/d9/f3f to d1/d6/d2f/d44/d45/f70 0 2024-03-18T14:43:14.195 INFO:tasks.workunit.client.1.smithi129.stdout:4/104: creat d0/d19/f1f x:0 0 0 2024-03-18T14:43:14.196 INFO:tasks.workunit.client.1.smithi129.stdout:4/105: write d0/f16 [413882,115179] 0 2024-03-18T14:43:14.196 INFO:tasks.workunit.client.0.smithi087.stdout:6/300: symlink d3/d1a/d46/l65 0 2024-03-18T14:43:14.196 INFO:tasks.workunit.client.1.smithi129.stdout:4/106: write d0/f16 [188990,25320] 0 2024-03-18T14:43:14.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/407: dread db/d18/f2c [0,4194304] 0 2024-03-18T14:43:14.198 INFO:tasks.workunit.client.0.smithi087.stdout:7/403: mkdir d1/d8e 0 2024-03-18T14:43:14.198 INFO:tasks.workunit.client.0.smithi087.stdout:5/359: dread d13/d1b/d30/f40 [0,4194304] 0 2024-03-18T14:43:14.205 INFO:tasks.workunit.client.1.smithi129.stdout:0/179: rename d0/d23/d2c to d0/d23/d35/d3b 0 2024-03-18T14:43:14.205 INFO:tasks.workunit.client.1.smithi129.stdout:5/118: mknod d0/df/c24 0 2024-03-18T14:43:14.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/404: creat d1/d6/d29/d2f/d68/d65/d72/f8f x:0 0 0 2024-03-18T14:43:14.206 INFO:tasks.workunit.client.1.smithi129.stdout:8/145: chown d9/d11/d1a/d14/f2c 32036502 1 2024-03-18T14:43:14.207 INFO:tasks.workunit.client.0.smithi087.stdout:6/301: symlink d3/d1a/l66 0 2024-03-18T14:43:14.207 INFO:tasks.workunit.client.1.smithi129.stdout:2/95: creat d7/f1e x:0 0 0 2024-03-18T14:43:14.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/146: chown f4 15708081 1 2024-03-18T14:43:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/408: mkdir db/d18/d1e/d28/d76/d80 0 2024-03-18T14:43:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/375: dread d3/f19 [0,4194304] 0 2024-03-18T14:43:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/409: dread - db/d12/f55 zero size 2024-03-18T14:43:14.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/323: truncate d0/d2/d4/f66 244429 0 2024-03-18T14:43:14.209 INFO:tasks.workunit.client.1.smithi129.stdout:5/119: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:14.210 INFO:tasks.workunit.client.0.smithi087.stdout:4/285: getdents d2/db/d24/d30/d49/d4f 0 2024-03-18T14:43:14.210 INFO:tasks.workunit.client.1.smithi129.stdout:5/120: chown d0/f6 1760 1 2024-03-18T14:43:14.211 INFO:tasks.workunit.client.1.smithi129.stdout:3/110: rename d4/fc to d4/dd/d1f/f26 0 2024-03-18T14:43:14.211 INFO:tasks.workunit.client.1.smithi129.stdout:3/111: chown d4/dd/d1f/c23 63120422 1 2024-03-18T14:43:14.214 INFO:tasks.workunit.client.0.smithi087.stdout:9/410: dwrite db/d18/d1c/f27 [4194304,4194304] 0 2024-03-18T14:43:14.214 INFO:tasks.workunit.client.0.smithi087.stdout:8/342: rmdir d1 39 2024-03-18T14:43:14.215 INFO:tasks.workunit.client.1.smithi129.stdout:9/113: dwrite d0/f8 [0,4194304] 0 2024-03-18T14:43:14.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/360: dread d13/f1a [0,4194304] 0 2024-03-18T14:43:14.219 INFO:tasks.workunit.client.0.smithi087.stdout:1/376: mkdir d3/d1d/d1e/d43/d50/d72 0 2024-03-18T14:43:14.219 INFO:tasks.workunit.client.1.smithi129.stdout:0/180: rmdir d0/d23 39 2024-03-18T14:43:14.225 INFO:tasks.workunit.client.0.smithi087.stdout:0/324: symlink d0/d2/d4/d27/d32/d6e/l77 0 2024-03-18T14:43:14.225 INFO:tasks.workunit.client.1.smithi129.stdout:2/96: unlink d7/dd/f12 0 2024-03-18T14:43:14.226 INFO:tasks.workunit.client.0.smithi087.stdout:8/343: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:14.226 INFO:tasks.workunit.client.1.smithi129.stdout:1/113: getdents d1/d2 0 2024-03-18T14:43:14.226 INFO:tasks.workunit.client.1.smithi129.stdout:1/114: chown d1/cf 6910 1 2024-03-18T14:43:14.227 INFO:tasks.workunit.client.1.smithi129.stdout:4/107: unlink d0/d9/c1b 0 2024-03-18T14:43:14.228 INFO:tasks.workunit.client.1.smithi129.stdout:6/138: getdents d3/d5/db 0 2024-03-18T14:43:14.230 INFO:tasks.workunit.client.0.smithi087.stdout:9/411: rename db/ff to db/d18/f81 0 2024-03-18T14:43:14.235 INFO:tasks.workunit.client.1.smithi129.stdout:8/147: unlink d9/d11/c13 0 2024-03-18T14:43:14.237 INFO:tasks.workunit.client.1.smithi129.stdout:1/115: rmdir d1 39 2024-03-18T14:43:14.239 INFO:tasks.workunit.client.1.smithi129.stdout:5/121: mknod d0/c25 0 2024-03-18T14:43:14.239 INFO:tasks.workunit.client.1.smithi129.stdout:5/122: readlink d0/l7 0 2024-03-18T14:43:14.244 INFO:tasks.workunit.client.1.smithi129.stdout:5/123: dwrite d0/f14 [0,4194304] 0 2024-03-18T14:43:14.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/325: mkdir d0/d2/d4/d19/d24/d5d/d78 0 2024-03-18T14:43:14.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/124: readlink d0/df/l10 0 2024-03-18T14:43:14.246 INFO:tasks.workunit.client.1.smithi129.stdout:3/112: truncate d4/dd/d15/f25 798945 0 2024-03-18T14:43:14.247 INFO:tasks.workunit.client.0.smithi087.stdout:7/405: write d1/d6/d29/f49 [438738,129756] 0 2024-03-18T14:43:14.247 INFO:tasks.workunit.client.1.smithi129.stdout:0/181: dwrite d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:14.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/114: truncate d0/f4 5022817 0 2024-03-18T14:43:14.247 INFO:tasks.workunit.client.1.smithi129.stdout:5/125: fdatasync d0/dc/f20 0 2024-03-18T14:43:14.248 INFO:tasks.workunit.client.1.smithi129.stdout:2/97: mkdir d7/d1f 0 2024-03-18T14:43:14.248 INFO:tasks.workunit.client.1.smithi129.stdout:9/115: dread - d0/f1e zero size 2024-03-18T14:43:14.249 INFO:tasks.workunit.client.1.smithi129.stdout:8/148: truncate f8 2646043 0 2024-03-18T14:43:14.250 INFO:tasks.workunit.client.1.smithi129.stdout:7/103: sync 2024-03-18T14:43:14.250 INFO:tasks.workunit.client.1.smithi129.stdout:9/116: write d0/f13 [835774,94726] 0 2024-03-18T14:43:14.251 INFO:tasks.workunit.client.1.smithi129.stdout:1/116: fdatasync d1/f1b 0 2024-03-18T14:43:14.251 INFO:tasks.workunit.client.0.smithi087.stdout:5/361: rename d13/d1b/d27/d35/f76 to d13/d1b/d27/f7b 0 2024-03-18T14:43:14.252 INFO:tasks.workunit.client.1.smithi129.stdout:7/104: write d4/f16 [3235421,78430] 0 2024-03-18T14:43:14.252 INFO:tasks.workunit.client.1.smithi129.stdout:1/117: write d1/f9 [593646,69432] 0 2024-03-18T14:43:14.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/105: fsync d4/f6 0 2024-03-18T14:43:14.253 INFO:tasks.workunit.client.0.smithi087.stdout:4/286: dwrite d2/db/f1d [0,4194304] 0 2024-03-18T14:43:14.254 INFO:tasks.workunit.client.1.smithi129.stdout:1/118: chown d1/c17 59645 1 2024-03-18T14:43:14.254 INFO:tasks.workunit.client.1.smithi129.stdout:7/106: dread - d4/d7/ff zero size 2024-03-18T14:43:14.255 INFO:tasks.workunit.client.0.smithi087.stdout:6/302: dwrite d3/d1a/d29/f27 [0,4194304] 0 2024-03-18T14:43:14.255 INFO:tasks.workunit.client.1.smithi129.stdout:1/119: chown d1/d18/d19 2742402 1 2024-03-18T14:43:14.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/412: dwrite db/d12/f55 [0,4194304] 0 2024-03-18T14:43:14.256 INFO:tasks.workunit.client.0.smithi087.stdout:4/287: read d2/d13/f3f [2161370,6622] 0 2024-03-18T14:43:14.256 INFO:tasks.workunit.client.1.smithi129.stdout:5/126: mkdir d0/dc/d22/d26 0 2024-03-18T14:43:14.257 INFO:tasks.workunit.client.1.smithi129.stdout:8/149: dwrite d9/f1f [0,4194304] 0 2024-03-18T14:43:14.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/120: chown d1/d2/l14 11 1 2024-03-18T14:43:14.257 INFO:tasks.workunit.client.0.smithi087.stdout:6/303: write d3/d1a/d29/d22/f5d [996269,106102] 0 2024-03-18T14:43:14.258 INFO:tasks.workunit.client.1.smithi129.stdout:4/108: link d0/f13 d0/d9/f20 0 2024-03-18T14:43:14.260 INFO:tasks.workunit.client.0.smithi087.stdout:2/321: sync 2024-03-18T14:43:14.261 INFO:tasks.workunit.client.0.smithi087.stdout:8/344: truncate d1/d6/d2f/d44/d45/d50/f66 888780 0 2024-03-18T14:43:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/345: chown d1/d6/l4e 116 1 2024-03-18T14:43:14.262 INFO:tasks.workunit.client.1.smithi129.stdout:8/150: dwrite d9/f1f [0,4194304] 0 2024-03-18T14:43:14.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/346: chown d1/d6/l4e 8043 1 2024-03-18T14:43:14.263 INFO:tasks.workunit.client.1.smithi129.stdout:9/117: mkdir d0/db/d1f/d20/d25 0 2024-03-18T14:43:14.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/118: write d0/db/f12 [755724,39083] 0 2024-03-18T14:43:14.264 INFO:tasks.workunit.client.0.smithi087.stdout:2/322: dread d2/f1e [0,4194304] 0 2024-03-18T14:43:14.264 INFO:tasks.workunit.client.0.smithi087.stdout:4/288: creat d2/db/d24/d30/f5c x:0 0 0 2024-03-18T14:43:14.265 INFO:tasks.workunit.client.0.smithi087.stdout:9/413: symlink db/d18/d1c/d69/d6f/l82 0 2024-03-18T14:43:14.266 INFO:tasks.workunit.client.0.smithi087.stdout:4/289: dread - d2/db/d24/d30/d4d/f57 zero size 2024-03-18T14:43:14.266 INFO:tasks.workunit.client.0.smithi087.stdout:9/414: dread - db/d31/f42 zero size 2024-03-18T14:43:14.266 INFO:tasks.workunit.client.0.smithi087.stdout:6/304: mknod d3/d1a/d29/d22/d61/c67 0 2024-03-18T14:43:14.267 INFO:tasks.workunit.client.0.smithi087.stdout:2/323: read d2/d4/d22/d2c/f2e [1005811,61152] 0 2024-03-18T14:43:14.267 INFO:tasks.workunit.client.0.smithi087.stdout:4/290: write d2/db/d24/f33 [450067,59489] 0 2024-03-18T14:43:14.267 INFO:tasks.workunit.client.1.smithi129.stdout:0/182: creat d0/d23/d35/d3b/f3c x:0 0 0 2024-03-18T14:43:14.267 INFO:tasks.workunit.client.1.smithi129.stdout:2/98: mkdir d7/d1f/d20 0 2024-03-18T14:43:14.269 INFO:tasks.workunit.client.1.smithi129.stdout:7/107: rename d4/d7/d8/f9 to d4/d7/d8/f20 0 2024-03-18T14:43:14.269 INFO:tasks.workunit.client.1.smithi129.stdout:9/119: dwrite d0/f13 [0,4194304] 0 2024-03-18T14:43:14.270 INFO:tasks.workunit.client.1.smithi129.stdout:9/120: chown d0/db/l17 333 1 2024-03-18T14:43:14.271 INFO:tasks.workunit.client.1.smithi129.stdout:9/121: readlink d0/db/de/d19/l22 0 2024-03-18T14:43:14.273 INFO:tasks.workunit.client.0.smithi087.stdout:5/362: symlink d13/d1b/d30/d6e/l7c 0 2024-03-18T14:43:14.273 INFO:tasks.workunit.client.1.smithi129.stdout:4/109: unlink d0/f16 0 2024-03-18T14:43:14.274 INFO:tasks.workunit.client.1.smithi129.stdout:6/139: getdents d3/d5/db/df 0 2024-03-18T14:43:14.275 INFO:tasks.workunit.client.0.smithi087.stdout:8/347: mkdir d1/d6/d2f/d44/d45/d71 0 2024-03-18T14:43:14.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/415: symlink db/d18/d1c/l83 0 2024-03-18T14:43:14.277 INFO:tasks.workunit.client.1.smithi129.stdout:3/113: truncate d4/dd/d15/d16/f1c 674964 0 2024-03-18T14:43:14.278 INFO:tasks.workunit.client.0.smithi087.stdout:7/406: getdents d1/d6 0 2024-03-18T14:43:14.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/363: creat d13/d1b/d30/f7d x:0 0 0 2024-03-18T14:43:14.280 INFO:tasks.workunit.client.1.smithi129.stdout:0/183: creat d0/d14/d28/f3d x:0 0 0 2024-03-18T14:43:14.281 INFO:tasks.workunit.client.0.smithi087.stdout:8/348: dwrite d1/d6/d2f/d44/f6f [0,4194304] 0 2024-03-18T14:43:14.285 INFO:tasks.workunit.client.0.smithi087.stdout:8/349: dwrite d1/d6/d9/f60 [0,4194304] 0 2024-03-18T14:43:14.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/377: sync 2024-03-18T14:43:14.286 INFO:tasks.workunit.client.0.smithi087.stdout:3/380: sync 2024-03-18T14:43:14.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/122: unlink d0/l2 0 2024-03-18T14:43:14.286 INFO:tasks.workunit.client.0.smithi087.stdout:1/378: chown d3/c9 2951 1 2024-03-18T14:43:14.287 INFO:tasks.workunit.client.0.smithi087.stdout:2/324: truncate d2/d4/f16 1714659 0 2024-03-18T14:43:14.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/364: mkdir d13/d1b/d7e 0 2024-03-18T14:43:14.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/365: fdatasync d13/f3f 0 2024-03-18T14:43:14.291 INFO:tasks.workunit.client.0.smithi087.stdout:4/291: getdents d2/db/de 0 2024-03-18T14:43:14.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/292: dread - d2/d13/d28/f42 zero size 2024-03-18T14:43:14.299 INFO:tasks.workunit.client.0.smithi087.stdout:8/350: mkdir d1/d6/d2f/d44/d45/d72 0 2024-03-18T14:43:14.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/416: truncate db/d18/d1e/f5a 531316 0 2024-03-18T14:43:14.304 INFO:tasks.workunit.client.1.smithi129.stdout:0/184: creat d0/d23/d29/f3e x:0 0 0 2024-03-18T14:43:14.304 INFO:tasks.workunit.client.1.smithi129.stdout:5/127: link d0/df/c24 d0/dc/d22/c27 0 2024-03-18T14:43:14.305 INFO:tasks.workunit.client.0.smithi087.stdout:3/381: rename d0/d1c/f4b to d0/d1c/d25/f6a 0 2024-03-18T14:43:14.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/417: dwrite db/d31/f66 [0,4194304] 0 2024-03-18T14:43:14.307 INFO:tasks.workunit.client.1.smithi129.stdout:6/140: symlink d3/d5/db/df/d28/l2c 0 2024-03-18T14:43:14.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/114: mkdir d4/d11/d1d/d27 0 2024-03-18T14:43:14.308 INFO:tasks.workunit.client.0.smithi087.stdout:6/305: link d3/d1a/d29/cb d3/d1a/c68 0 2024-03-18T14:43:14.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/379: truncate d3/d1d/f21 392436 0 2024-03-18T14:43:14.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/306: write d3/d1a/d29/f5a [304107,79456] 0 2024-03-18T14:43:14.310 INFO:tasks.workunit.client.1.smithi129.stdout:0/185: creat d0/d23/f3f x:0 0 0 2024-03-18T14:43:14.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/325: rename d2/c12 to d2/d4/d22/d2c/c60 0 2024-03-18T14:43:14.312 INFO:tasks.workunit.client.0.smithi087.stdout:3/382: fdatasync d0/d1c/d25/f6a 0 2024-03-18T14:43:14.312 INFO:tasks.workunit.client.1.smithi129.stdout:0/186: dread d0/fd [0,4194304] 0 2024-03-18T14:43:14.312 INFO:tasks.workunit.client.0.smithi087.stdout:4/293: dread d2/d13/f3f [0,4194304] 0 2024-03-18T14:43:14.314 INFO:tasks.workunit.client.1.smithi129.stdout:6/141: creat d3/d6/f2d x:0 0 0 2024-03-18T14:43:14.315 INFO:tasks.workunit.client.1.smithi129.stdout:7/108: getdents d4 0 2024-03-18T14:43:14.316 INFO:tasks.workunit.client.1.smithi129.stdout:3/115: symlink d4/dd/d1f/l28 0 2024-03-18T14:43:14.317 INFO:tasks.workunit.client.0.smithi087.stdout:1/380: dread d3/f4e [0,4194304] 0 2024-03-18T14:43:14.318 INFO:tasks.workunit.client.1.smithi129.stdout:6/142: creat d3/d5/db/de/f2e x:0 0 0 2024-03-18T14:43:14.319 INFO:tasks.workunit.client.0.smithi087.stdout:6/307: creat d3/d1a/d29/d22/d23/f69 x:0 0 0 2024-03-18T14:43:14.319 INFO:tasks.workunit.client.0.smithi087.stdout:2/326: creat d2/d4/d22/d2c/d3a/f61 x:0 0 0 2024-03-18T14:43:14.319 INFO:tasks.workunit.client.0.smithi087.stdout:9/418: symlink db/d18/d1e/d28/d76/d80/l84 0 2024-03-18T14:43:14.320 INFO:tasks.workunit.client.0.smithi087.stdout:1/381: write d3/d1d/d1e/d20/f5c [1219360,80270] 0 2024-03-18T14:43:14.320 INFO:tasks.workunit.client.0.smithi087.stdout:4/294: dread d2/f16 [0,4194304] 0 2024-03-18T14:43:14.321 INFO:tasks.workunit.client.1.smithi129.stdout:3/116: unlink d4/c18 0 2024-03-18T14:43:14.322 INFO:tasks.workunit.client.1.smithi129.stdout:3/117: write d4/dd/d15/d16/f1b [5470019,99389] 0 2024-03-18T14:43:14.323 INFO:tasks.workunit.client.1.smithi129.stdout:0/187: truncate d0/d23/d35/d3b/f3c 665488 0 2024-03-18T14:43:14.325 INFO:tasks.workunit.client.1.smithi129.stdout:7/109: link d4/d7/lc d4/d7/l21 0 2024-03-18T14:43:14.329 INFO:tasks.workunit.client.1.smithi129.stdout:3/118: mknod d4/dd/d1f/c29 0 2024-03-18T14:43:14.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/419: mknod db/d18/d3a/c85 0 2024-03-18T14:43:14.331 INFO:tasks.workunit.client.0.smithi087.stdout:0/326: dread d0/d2/d4/d19/f23 [0,4194304] 0 2024-03-18T14:43:14.332 INFO:tasks.workunit.client.1.smithi129.stdout:7/110: rename d4/f5 to d4/d7/d8/f22 0 2024-03-18T14:43:14.334 INFO:tasks.workunit.client.0.smithi087.stdout:7/407: truncate d1/d6/d16/dc/f5f 90551 0 2024-03-18T14:43:14.335 INFO:tasks.workunit.client.0.smithi087.stdout:7/408: write d1/f2e [1621009,124935] 0 2024-03-18T14:43:14.336 INFO:tasks.workunit.client.1.smithi129.stdout:3/119: rename c2 to d4/dd/c2a 0 2024-03-18T14:43:14.336 INFO:tasks.workunit.client.0.smithi087.stdout:7/409: write d1/d6/da/d42/d61/d74/f8d [216868,74389] 0 2024-03-18T14:43:14.337 INFO:tasks.workunit.client.1.smithi129.stdout:0/188: truncate d0/d23/f3f 113906 0 2024-03-18T14:43:14.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/410: fsync d1/d6/da/d42/f7b 0 2024-03-18T14:43:14.338 INFO:tasks.workunit.client.0.smithi087.stdout:8/351: truncate d1/f1b 2075973 0 2024-03-18T14:43:14.338 INFO:tasks.workunit.client.1.smithi129.stdout:3/120: creat d4/d11/d1d/d27/f2b x:0 0 0 2024-03-18T14:43:14.344 INFO:tasks.workunit.client.1.smithi129.stdout:1/121: dwrite d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:14.346 INFO:tasks.workunit.client.0.smithi087.stdout:6/308: creat d3/d7/d25/d62/f6a x:0 0 0 2024-03-18T14:43:14.349 INFO:tasks.workunit.client.1.smithi129.stdout:5/128: sync 2024-03-18T14:43:14.349 INFO:tasks.workunit.client.1.smithi129.stdout:8/151: dread f8 [0,4194304] 0 2024-03-18T14:43:14.350 INFO:tasks.workunit.client.0.smithi087.stdout:4/295: dwrite d2/db/d24/f4c [0,4194304] 0 2024-03-18T14:43:14.350 INFO:tasks.workunit.client.0.smithi087.stdout:4/296: readlink d2/l7 0 2024-03-18T14:43:14.351 INFO:tasks.workunit.client.1.smithi129.stdout:9/123: truncate d0/f16 162281 0 2024-03-18T14:43:14.351 INFO:tasks.workunit.client.1.smithi129.stdout:5/129: chown d0/l7 1434226211 1 2024-03-18T14:43:14.351 INFO:tasks.workunit.client.0.smithi087.stdout:4/297: dread - d2/d13/d28/f42 zero size 2024-03-18T14:43:14.351 INFO:tasks.workunit.client.0.smithi087.stdout:8/352: creat d1/d6/d2f/d44/d45/d50/f73 x:0 0 0 2024-03-18T14:43:14.351 INFO:tasks.workunit.client.0.smithi087.stdout:4/298: fdatasync d2/db/d24/f33 0 2024-03-18T14:43:14.352 INFO:tasks.workunit.client.0.smithi087.stdout:1/382: creat d3/d1d/d1f/d34/f73 x:0 0 0 2024-03-18T14:43:14.352 INFO:tasks.workunit.client.1.smithi129.stdout:2/99: dwrite d7/dd/f1a [0,4194304] 0 2024-03-18T14:43:14.353 INFO:tasks.workunit.client.1.smithi129.stdout:6/143: write d3/d5/db/de/f22 [2070824,24326] 0 2024-03-18T14:43:14.353 INFO:tasks.workunit.client.1.smithi129.stdout:2/100: write d7/fa [262569,93962] 0 2024-03-18T14:43:14.354 INFO:tasks.workunit.client.1.smithi129.stdout:2/101: chown c6 116934 1 2024-03-18T14:43:14.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/327: creat d2/d4/d22/f62 x:0 0 0 2024-03-18T14:43:14.358 INFO:tasks.workunit.client.0.smithi087.stdout:8/353: dread d1/d6/d2f/f39 [0,4194304] 0 2024-03-18T14:43:14.358 INFO:tasks.workunit.client.1.smithi129.stdout:2/102: dwrite d7/dd/f18 [0,4194304] 0 2024-03-18T14:43:14.358 INFO:tasks.workunit.client.0.smithi087.stdout:8/354: write d1/d6/d2f/f41 [1122490,71069] 0 2024-03-18T14:43:14.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/355: fdatasync d1/d6/d2f/d44/f6f 0 2024-03-18T14:43:14.360 INFO:tasks.workunit.client.0.smithi087.stdout:8/356: fsync d1/d6/d14/f5b 0 2024-03-18T14:43:14.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/383: sync 2024-03-18T14:43:14.362 INFO:tasks.workunit.client.1.smithi129.stdout:2/103: dwrite d7/dd/f18 [0,4194304] 0 2024-03-18T14:43:14.364 INFO:tasks.workunit.client.1.smithi129.stdout:0/189: rmdir d0/d23/d35/d3b 39 2024-03-18T14:43:14.366 INFO:tasks.workunit.client.1.smithi129.stdout:7/111: truncate d4/d7/ff 898399 0 2024-03-18T14:43:14.369 INFO:tasks.workunit.client.1.smithi129.stdout:1/122: unlink d1/c17 0 2024-03-18T14:43:14.370 INFO:tasks.workunit.client.0.smithi087.stdout:4/299: mknod d2/db/d24/d30/d49/d4f/c5d 0 2024-03-18T14:43:14.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/130: mknod d0/dc/d1a/c28 0 2024-03-18T14:43:14.372 INFO:tasks.workunit.client.0.smithi087.stdout:1/383: symlink d3/d1d/d1e/d43/d50/d71/l74 0 2024-03-18T14:43:14.374 INFO:tasks.workunit.client.1.smithi129.stdout:9/124: truncate d0/db/d11/f1a 1888003 0 2024-03-18T14:43:14.374 INFO:tasks.workunit.client.0.smithi087.stdout:5/366: rename d13/d1b/f64 to d13/d1b/d27/d28/f7f 0 2024-03-18T14:43:14.375 INFO:tasks.workunit.client.1.smithi129.stdout:4/110: stat d0/d9/la 0 2024-03-18T14:43:14.377 INFO:tasks.workunit.client.0.smithi087.stdout:2/328: creat d2/d4/d22/d2c/d3a/d49/d58/f63 x:0 0 0 2024-03-18T14:43:14.380 INFO:tasks.workunit.client.1.smithi129.stdout:7/112: mknod d4/c23 0 2024-03-18T14:43:14.381 INFO:tasks.workunit.client.0.smithi087.stdout:2/329: dwrite d2/d4/d22/d24/f35 [0,4194304] 0 2024-03-18T14:43:14.384 INFO:tasks.workunit.client.1.smithi129.stdout:1/123: rename d1/f1b to d1/d18/d19/f22 0 2024-03-18T14:43:14.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/411: truncate d1/d6/d29/f4d 1281687 0 2024-03-18T14:43:14.385 INFO:tasks.workunit.client.0.smithi087.stdout:7/412: chown d1/d6 68 1 2024-03-18T14:43:14.388 INFO:tasks.workunit.client.0.smithi087.stdout:9/420: link db/d18/l75 db/d18/d3a/l86 0 2024-03-18T14:43:14.389 INFO:tasks.workunit.client.1.smithi129.stdout:1/124: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:14.389 INFO:tasks.workunit.client.1.smithi129.stdout:3/121: dread d4/fb [0,4194304] 0 2024-03-18T14:43:14.389 INFO:tasks.workunit.client.0.smithi087.stdout:9/421: fsync db/d12/f5e 0 2024-03-18T14:43:14.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/309: getdents d3/d1a/d29/d22/d53 0 2024-03-18T14:43:14.390 INFO:tasks.workunit.client.1.smithi129.stdout:3/122: write d4/dd/d15/d16/f24 [11713,61115] 0 2024-03-18T14:43:14.393 INFO:tasks.workunit.client.0.smithi087.stdout:9/422: dwrite db/f22 [4194304,4194304] 0 2024-03-18T14:43:14.394 INFO:tasks.workunit.client.0.smithi087.stdout:6/310: dread d3/d1a/d29/d22/d23/f26 [0,4194304] 0 2024-03-18T14:43:14.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/104: mknod d7/c21 0 2024-03-18T14:43:14.394 INFO:tasks.workunit.client.1.smithi129.stdout:2/105: readlink d7/l19 0 2024-03-18T14:43:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:9/423: stat db/d18/d1e/d7e 0 2024-03-18T14:43:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:2/330: mknod d2/d4/d22/d2c/c64 0 2024-03-18T14:43:14.395 INFO:tasks.workunit.client.1.smithi129.stdout:2/106: write f5 [2017626,54481] 0 2024-03-18T14:43:14.395 INFO:tasks.workunit.client.0.smithi087.stdout:2/331: chown d2/d4/d22/l31 1110287104 1 2024-03-18T14:43:14.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/111: dwrite d0/d19/f1f [0,4194304] 0 2024-03-18T14:43:14.398 INFO:tasks.workunit.client.0.smithi087.stdout:9/424: dwrite db/d18/d3a/f63 [0,4194304] 0 2024-03-18T14:43:14.400 INFO:tasks.workunit.client.1.smithi129.stdout:2/107: dwrite f0 [0,4194304] 0 2024-03-18T14:43:14.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/300: mknod d2/db/d24/d30/d56/c5e 0 2024-03-18T14:43:14.401 INFO:tasks.workunit.client.1.smithi129.stdout:8/152: truncate d9/d11/d1a/d14/f28 151835 0 2024-03-18T14:43:14.401 INFO:tasks.workunit.client.1.smithi129.stdout:7/113: creat d4/d7/f24 x:0 0 0 2024-03-18T14:43:14.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/301: write d2/db/f1d [4944992,69200] 0 2024-03-18T14:43:14.404 INFO:tasks.workunit.client.1.smithi129.stdout:9/125: rename d0/db/de to d0/db/d1f/d20/d26 0 2024-03-18T14:43:14.405 INFO:tasks.workunit.client.0.smithi087.stdout:1/384: fsync d3/d1d/d1f/f2e 0 2024-03-18T14:43:14.405 INFO:tasks.workunit.client.1.smithi129.stdout:2/108: dwrite f5 [0,4194304] 0 2024-03-18T14:43:14.405 INFO:tasks.workunit.client.1.smithi129.stdout:5/131: truncate d0/f9 1328714 0 2024-03-18T14:43:14.406 INFO:tasks.workunit.client.1.smithi129.stdout:5/132: stat d0/ce 0 2024-03-18T14:43:14.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/332: chown d2/d4/c25 37081 1 2024-03-18T14:43:14.408 INFO:tasks.workunit.client.0.smithi087.stdout:2/333: dread - d2/d4/d22/d2c/d3a/f61 zero size 2024-03-18T14:43:14.411 INFO:tasks.workunit.client.0.smithi087.stdout:3/384: rmdir d0/d3/d40/d44 0 2024-03-18T14:43:14.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/385: write d0/d1c/f69 [679030,66422] 0 2024-03-18T14:43:14.413 INFO:tasks.workunit.client.1.smithi129.stdout:0/190: truncate d0/d14/f2d 3548395 0 2024-03-18T14:43:14.414 INFO:tasks.workunit.client.1.smithi129.stdout:0/191: fdatasync d0/d23/d29/f3e 0 2024-03-18T14:43:14.416 INFO:tasks.workunit.client.0.smithi087.stdout:9/425: dwrite db/d18/f2a [0,4194304] 0 2024-03-18T14:43:14.417 INFO:tasks.workunit.client.0.smithi087.stdout:9/426: chown db/d18/d1e 989870526 1 2024-03-18T14:43:14.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/302: dwrite d2/f16 [0,4194304] 0 2024-03-18T14:43:14.418 INFO:tasks.workunit.client.0.smithi087.stdout:9/427: fdatasync db/d31/f6d 0 2024-03-18T14:43:14.418 INFO:tasks.workunit.client.0.smithi087.stdout:9/428: fsync db/d18/d3a/f4f 0 2024-03-18T14:43:14.419 INFO:tasks.workunit.client.0.smithi087.stdout:9/429: fdatasync db/d12/f5e 0 2024-03-18T14:43:14.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/334: unlink d2/l7 0 2024-03-18T14:43:14.421 INFO:tasks.workunit.client.0.smithi087.stdout:5/367: creat d13/d1b/d30/d6e/f80 x:0 0 0 2024-03-18T14:43:14.422 INFO:tasks.workunit.client.0.smithi087.stdout:5/368: write d13/d1b/d30/f5d [950103,40564] 0 2024-03-18T14:43:14.422 INFO:tasks.workunit.client.0.smithi087.stdout:0/327: sync 2024-03-18T14:43:14.422 INFO:tasks.workunit.client.0.smithi087.stdout:5/369: chown fb 3815326 1 2024-03-18T14:43:14.423 INFO:tasks.workunit.client.0.smithi087.stdout:6/311: rename d3/d1a/d29/d22/d47/c50 to d3/d1a/d29/d22/d61/c6b 0 2024-03-18T14:43:14.426 INFO:tasks.workunit.client.0.smithi087.stdout:2/335: mkdir d2/d4/d22/d24/d65 0 2024-03-18T14:43:14.427 INFO:tasks.workunit.client.0.smithi087.stdout:4/303: dwrite d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:14.428 INFO:tasks.workunit.client.1.smithi129.stdout:6/144: getdents d3/d5/db/de 0 2024-03-18T14:43:14.428 INFO:tasks.workunit.client.1.smithi129.stdout:7/114: write d4/d7/d8/f22 [435518,3110] 0 2024-03-18T14:43:14.431 INFO:tasks.workunit.client.1.smithi129.stdout:8/153: symlink d9/d11/d1a/d14/l31 0 2024-03-18T14:43:14.432 INFO:tasks.workunit.client.1.smithi129.stdout:5/133: symlink d0/dc/l29 0 2024-03-18T14:43:14.435 INFO:tasks.workunit.client.0.smithi087.stdout:0/328: rename d0/d2/d4/d27/d32 to d0/d2/d4/d27/d29/d26/d79 0 2024-03-18T14:43:14.438 INFO:tasks.workunit.client.0.smithi087.stdout:1/385: getdents d3/d1d/d1f/d34/d38 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:0/192: readlink d0/l26 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:6/145: mknod d3/d5/db/de/c2f 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:7/115: readlink d4/d7/lc 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:9/126: dread d0/db/f12 [0,4194304] 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:2/109: creat d7/d1c/f22 x:0 0 0 2024-03-18T14:43:14.439 INFO:tasks.workunit.client.1.smithi129.stdout:1/125: truncate d1/f1d 276851 0 2024-03-18T14:43:14.440 INFO:tasks.workunit.client.1.smithi129.stdout:5/134: symlink d0/dc/d18/l2a 0 2024-03-18T14:43:14.440 INFO:tasks.workunit.client.0.smithi087.stdout:1/386: chown d3/d1d/f33 207 1 2024-03-18T14:43:14.442 INFO:tasks.workunit.client.1.smithi129.stdout:1/126: write d1/f9 [4535362,1538] 0 2024-03-18T14:43:14.442 INFO:tasks.workunit.client.1.smithi129.stdout:0/193: rmdir d0/d23/d35 39 2024-03-18T14:43:14.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/357: dwrite d1/d6/d2f/d44/d45/d50/f66 [0,4194304] 0 2024-03-18T14:43:14.442 INFO:tasks.workunit.client.0.smithi087.stdout:5/370: symlink d13/d1b/d27/d28/l81 0 2024-03-18T14:43:14.442 INFO:tasks.workunit.client.1.smithi129.stdout:4/112: getdents d0/d19 0 2024-03-18T14:43:14.444 INFO:tasks.workunit.client.0.smithi087.stdout:4/304: symlink d2/db/d24/d30/d56/l5f 0 2024-03-18T14:43:14.445 INFO:tasks.workunit.client.1.smithi129.stdout:8/154: dwrite d9/d11/f16 [0,4194304] 0 2024-03-18T14:43:14.445 INFO:tasks.workunit.client.0.smithi087.stdout:0/329: chown d0/d2/d4/d27/d29/d2a/c53 2 1 2024-03-18T14:43:14.446 INFO:tasks.workunit.client.1.smithi129.stdout:2/110: unlink d7/d1c/f22 0 2024-03-18T14:43:14.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/371: symlink d13/d1b/d30/l82 0 2024-03-18T14:43:14.451 INFO:tasks.workunit.client.1.smithi129.stdout:7/116: rename d4/d7/fa to d4/d7/f25 0 2024-03-18T14:43:14.451 INFO:tasks.workunit.client.1.smithi129.stdout:2/111: dwrite f0 [0,4194304] 0 2024-03-18T14:43:14.452 INFO:tasks.workunit.client.1.smithi129.stdout:7/117: write d4/f6 [3852166,33758] 0 2024-03-18T14:43:14.452 INFO:tasks.workunit.client.0.smithi087.stdout:6/312: creat d3/f6c x:0 0 0 2024-03-18T14:43:14.452 INFO:tasks.workunit.client.0.smithi087.stdout:0/330: mknod d0/d2/d4/d19/c7a 0 2024-03-18T14:43:14.452 INFO:tasks.workunit.client.0.smithi087.stdout:4/305: chown d2/db/f20 0 1 2024-03-18T14:43:14.456 INFO:tasks.workunit.client.0.smithi087.stdout:5/372: write d13/d1b/f2b [171306,93550] 0 2024-03-18T14:43:14.457 INFO:tasks.workunit.client.1.smithi129.stdout:5/135: stat d0/dc/d22/c23 0 2024-03-18T14:43:14.457 INFO:tasks.workunit.client.1.smithi129.stdout:9/127: creat d0/db/d11/f27 x:0 0 0 2024-03-18T14:43:14.457 INFO:tasks.workunit.client.1.smithi129.stdout:8/155: mkdir d9/d11/d1a/d32 0 2024-03-18T14:43:14.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/387: rename d3/d1d/d1e/f4d to d3/d1d/d1f/f75 0 2024-03-18T14:43:14.459 INFO:tasks.workunit.client.0.smithi087.stdout:6/313: creat d3/d1a/d46/f6d x:0 0 0 2024-03-18T14:43:14.460 INFO:tasks.workunit.client.0.smithi087.stdout:4/306: symlink d2/db/d24/d30/d4d/l60 0 2024-03-18T14:43:14.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/307: write d2/db/d24/f4c [2716810,91729] 0 2024-03-18T14:43:14.462 INFO:tasks.workunit.client.1.smithi129.stdout:7/118: symlink d4/d7/d8/l26 0 2024-03-18T14:43:14.462 INFO:tasks.workunit.client.1.smithi129.stdout:4/113: mkdir d0/d9/d1e/d21 0 2024-03-18T14:43:14.462 INFO:tasks.workunit.client.1.smithi129.stdout:7/119: chown d4/f10 0 1 2024-03-18T14:43:14.463 INFO:tasks.workunit.client.1.smithi129.stdout:8/156: readlink d9/d11/l26 0 2024-03-18T14:43:14.463 INFO:tasks.workunit.client.1.smithi129.stdout:8/157: write f4 [2813,5331] 0 2024-03-18T14:43:14.464 INFO:tasks.workunit.client.0.smithi087.stdout:5/373: dwrite d13/d1b/f5c [0,4194304] 0 2024-03-18T14:43:14.464 INFO:tasks.workunit.client.0.smithi087.stdout:1/388: creat d3/d1d/d1f/d34/f76 x:0 0 0 2024-03-18T14:43:14.468 INFO:tasks.workunit.client.0.smithi087.stdout:6/314: mknod d3/d1a/d29/c6e 0 2024-03-18T14:43:14.469 INFO:tasks.workunit.client.0.smithi087.stdout:6/315: chown d3/d1a/d29/d22/f32 57096 1 2024-03-18T14:43:14.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/316: dwrite d3/d1a/d29/d22/f32 [0,4194304] 0 2024-03-18T14:43:14.474 INFO:tasks.workunit.client.0.smithi087.stdout:1/389: creat d3/d1d/d67/f77 x:0 0 0 2024-03-18T14:43:14.477 INFO:tasks.workunit.client.0.smithi087.stdout:4/308: getdents d2/db/d24/d30 0 2024-03-18T14:43:14.477 INFO:tasks.workunit.client.0.smithi087.stdout:7/413: dwrite d1/d6/d29/d2f/d68/d65/d60/f64 [0,4194304] 0 2024-03-18T14:43:14.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/317: write d3/d1a/d29/d22/d23/f33 [755147,121588] 0 2024-03-18T14:43:14.480 INFO:tasks.workunit.client.0.smithi087.stdout:3/386: dwrite d0/f34 [0,4194304] 0 2024-03-18T14:43:14.481 INFO:tasks.workunit.client.0.smithi087.stdout:1/390: mknod d3/d1d/d1e/c78 0 2024-03-18T14:43:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/309: write d2/db/d24/d30/d4d/f57 [963865,14417] 0 2024-03-18T14:43:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:3/387: fsync d0/d1c/d25/f3c 0 2024-03-18T14:43:14.482 INFO:tasks.workunit.client.0.smithi087.stdout:7/414: write d1/d6/d16/f1e [213019,17347] 0 2024-03-18T14:43:14.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/415: write d1/d6/f1d [4140609,94749] 0 2024-03-18T14:43:14.485 INFO:tasks.workunit.client.0.smithi087.stdout:7/416: readlink d1/l2d 0 2024-03-18T14:43:14.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/391: write d3/d1d/d1f/f5d [419001,68107] 0 2024-03-18T14:43:14.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/388: fdatasync d0/d1c/f1e 0 2024-03-18T14:43:14.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/417: creat d1/d6/d29/d2f/d68/d65/d60/d66/f90 x:0 0 0 2024-03-18T14:43:14.497 INFO:tasks.workunit.client.0.smithi087.stdout:1/392: mkdir d3/d1d/d79 0 2024-03-18T14:43:14.498 INFO:tasks.workunit.client.0.smithi087.stdout:1/393: readlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:14.499 INFO:tasks.workunit.client.0.smithi087.stdout:7/418: write d1/d6/d29/d2f/d68/d65/d60/f64 [2809689,109956] 0 2024-03-18T14:43:14.499 INFO:tasks.workunit.client.0.smithi087.stdout:4/310: truncate d2/db/d24/f33 1527909 0 2024-03-18T14:43:14.499 INFO:tasks.workunit.client.1.smithi129.stdout:0/194: dread d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:14.500 INFO:tasks.workunit.client.1.smithi129.stdout:2/112: mknod d7/d1f/d20/c23 0 2024-03-18T14:43:14.500 INFO:tasks.workunit.client.1.smithi129.stdout:8/158: mkdir d9/d33 0 2024-03-18T14:43:14.500 INFO:tasks.workunit.client.0.smithi087.stdout:1/394: rmdir d3/d1d/d45 39 2024-03-18T14:43:14.501 INFO:tasks.workunit.client.1.smithi129.stdout:0/195: fsync d0/fb 0 2024-03-18T14:43:14.502 INFO:tasks.workunit.client.1.smithi129.stdout:4/114: dread d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:14.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/419: creat d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f91 x:0 0 0 2024-03-18T14:43:14.503 INFO:tasks.workunit.client.0.smithi087.stdout:8/358: sync 2024-03-18T14:43:14.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/395: mkdir d3/d1d/d1e/d20/d7a 0 2024-03-18T14:43:14.504 INFO:tasks.workunit.client.1.smithi129.stdout:7/120: dwrite d4/d7/f24 [0,4194304] 0 2024-03-18T14:43:14.504 INFO:tasks.workunit.client.0.smithi087.stdout:4/311: dwrite d2/db/d24/f4b [0,4194304] 0 2024-03-18T14:43:14.505 INFO:tasks.workunit.client.0.smithi087.stdout:7/420: write d1/d6/d29/d2f/d68/d65/d60/f64 [250938,117624] 0 2024-03-18T14:43:14.506 INFO:tasks.workunit.client.0.smithi087.stdout:4/312: chown d2/db/c14 54727 1 2024-03-18T14:43:14.506 INFO:tasks.workunit.client.0.smithi087.stdout:4/313: read - d2/db/d24/f58 zero size 2024-03-18T14:43:14.507 INFO:tasks.workunit.client.1.smithi129.stdout:3/123: dwrite d4/fb [0,4194304] 0 2024-03-18T14:43:14.507 INFO:tasks.workunit.client.1.smithi129.stdout:6/146: rename d3/d5/db to d3/d30 0 2024-03-18T14:43:14.507 INFO:tasks.workunit.client.0.smithi087.stdout:7/421: dread - d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f91 zero size 2024-03-18T14:43:14.507 INFO:tasks.workunit.client.1.smithi129.stdout:2/113: dread d7/dd/f15 [0,4194304] 0 2024-03-18T14:43:14.508 INFO:tasks.workunit.client.0.smithi087.stdout:0/331: rename d0/d2/d4/d27/d29 to d0/d1a/d7b 0 2024-03-18T14:43:14.509 INFO:tasks.workunit.client.0.smithi087.stdout:9/430: truncate db/f4b 1497984 0 2024-03-18T14:43:14.510 INFO:tasks.workunit.client.0.smithi087.stdout:9/431: chown db/c23 56534 1 2024-03-18T14:43:14.510 INFO:tasks.workunit.client.1.smithi129.stdout:9/128: getdents d0/db/d1f/d20 0 2024-03-18T14:43:14.511 INFO:tasks.workunit.client.1.smithi129.stdout:9/129: read d0/f5 [888977,96343] 0 2024-03-18T14:43:14.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/389: dread d0/d1c/f39 [0,4194304] 0 2024-03-18T14:43:14.514 INFO:tasks.workunit.client.1.smithi129.stdout:1/127: sync 2024-03-18T14:43:14.514 INFO:tasks.workunit.client.1.smithi129.stdout:1/128: stat d1/d2 0 2024-03-18T14:43:14.514 INFO:tasks.workunit.client.0.smithi087.stdout:2/336: dwrite d2/d4/f16 [0,4194304] 0 2024-03-18T14:43:14.514 INFO:tasks.workunit.client.0.smithi087.stdout:3/390: write d0/d3/df/f50 [11180,36545] 0 2024-03-18T14:43:14.516 INFO:tasks.workunit.client.1.smithi129.stdout:7/121: mkdir d4/d27 0 2024-03-18T14:43:14.518 INFO:tasks.workunit.client.0.smithi087.stdout:5/374: truncate d13/d1b/d27/d28/f7f 47057 0 2024-03-18T14:43:14.518 INFO:tasks.workunit.client.0.smithi087.stdout:2/337: dwrite d2/d4/d22/d2c/d3a/d40/f5f [0,4194304] 0 2024-03-18T14:43:14.519 INFO:tasks.workunit.client.1.smithi129.stdout:2/114: mknod d7/d1c/c24 0 2024-03-18T14:43:14.523 INFO:tasks.workunit.client.1.smithi129.stdout:9/130: symlink d0/db/d11/l28 0 2024-03-18T14:43:14.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/115: creat d0/d19/d1d/f22 x:0 0 0 2024-03-18T14:43:14.523 INFO:tasks.workunit.client.0.smithi087.stdout:8/359: fdatasync d1/d6/d9/f17 0 2024-03-18T14:43:14.524 INFO:tasks.workunit.client.0.smithi087.stdout:6/318: getdents d3/d1a/d46 0 2024-03-18T14:43:14.525 INFO:tasks.workunit.client.1.smithi129.stdout:6/147: creat d3/d5/d2b/f31 x:0 0 0 2024-03-18T14:43:14.526 INFO:tasks.workunit.client.1.smithi129.stdout:2/115: rename c6 to d7/d1f/d20/c25 0 2024-03-18T14:43:14.527 INFO:tasks.workunit.client.1.smithi129.stdout:2/116: write f5 [2247286,114526] 0 2024-03-18T14:43:14.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/432: mkdir db/d18/d3a/d87 0 2024-03-18T14:43:14.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/433: stat db/d12/l4d 0 2024-03-18T14:43:14.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/391: symlink d0/d1c/d25/l6b 0 2024-03-18T14:43:14.530 INFO:tasks.workunit.client.1.smithi129.stdout:9/131: mkdir d0/db/d1f/d20/d26/d19/d29 0 2024-03-18T14:43:14.531 INFO:tasks.workunit.client.0.smithi087.stdout:3/392: dread - d0/f28 zero size 2024-03-18T14:43:14.532 INFO:tasks.workunit.client.1.smithi129.stdout:0/196: link d0/c5 d0/d23/d29/c40 0 2024-03-18T14:43:14.535 INFO:tasks.workunit.client.1.smithi129.stdout:4/116: dread d0/f13 [0,4194304] 0 2024-03-18T14:43:14.536 INFO:tasks.workunit.client.0.smithi087.stdout:1/396: symlink d3/d1d/d1e/d43/d50/d72/l7b 0 2024-03-18T14:43:14.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/375: dwrite d13/d1b/d27/f7b [0,4194304] 0 2024-03-18T14:43:14.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/319: chown d3/d7/le 6234 1 2024-03-18T14:43:14.538 INFO:tasks.workunit.client.0.smithi087.stdout:0/332: mkdir d0/d2/d6b/d7c 0 2024-03-18T14:43:14.538 INFO:tasks.workunit.client.0.smithi087.stdout:0/333: chown d0 38299 1 2024-03-18T14:43:14.538 INFO:tasks.workunit.client.0.smithi087.stdout:0/334: dread - d0/dd/f64 zero size 2024-03-18T14:43:14.539 INFO:tasks.workunit.client.1.smithi129.stdout:5/136: sync 2024-03-18T14:43:14.539 INFO:tasks.workunit.client.0.smithi087.stdout:9/434: rmdir db/d18/d1e/d28 39 2024-03-18T14:43:14.539 INFO:tasks.workunit.client.1.smithi129.stdout:5/137: fsync d0/f14 0 2024-03-18T14:43:14.540 INFO:tasks.workunit.client.0.smithi087.stdout:9/435: dread - db/d12/f43 zero size 2024-03-18T14:43:14.541 INFO:tasks.workunit.client.1.smithi129.stdout:2/117: creat d7/d1c/f26 x:0 0 0 2024-03-18T14:43:14.541 INFO:tasks.workunit.client.1.smithi129.stdout:1/129: link l0 d1/d18/d19/l23 0 2024-03-18T14:43:14.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/132: creat d0/db/d1f/d20/d26/f2a x:0 0 0 2024-03-18T14:43:14.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/360: mknod d1/d6/c74 0 2024-03-18T14:43:14.544 INFO:tasks.workunit.client.0.smithi087.stdout:4/314: creat d2/f61 x:0 0 0 2024-03-18T14:43:14.545 INFO:tasks.workunit.client.1.smithi129.stdout:2/118: dwrite d7/dd/f1a [4194304,4194304] 0 2024-03-18T14:43:14.547 INFO:tasks.workunit.client.1.smithi129.stdout:4/117: fdatasync d0/f5 0 2024-03-18T14:43:14.548 INFO:tasks.workunit.client.0.smithi087.stdout:1/397: dread d3/d1d/d1e/d43/d50/f58 [0,4194304] 0 2024-03-18T14:43:14.549 INFO:tasks.workunit.client.1.smithi129.stdout:4/118: chown d0/d9 0 1 2024-03-18T14:43:14.549 INFO:tasks.workunit.client.1.smithi129.stdout:5/138: rename d0/dc/d22/d26 to d0/dc/d18/d2b 0 2024-03-18T14:43:14.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/398: dread - d3/d1d/d1f/d34/f76 zero size 2024-03-18T14:43:14.550 INFO:tasks.workunit.client.0.smithi087.stdout:6/320: mknod d3/d1a/d29/d22/d61/c6f 0 2024-03-18T14:43:14.551 INFO:tasks.workunit.client.0.smithi087.stdout:5/376: creat d13/d1b/d27/d35/d3b/f83 x:0 0 0 2024-03-18T14:43:14.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/335: creat d0/d2/d4/d19/d5a/f7d x:0 0 0 2024-03-18T14:43:14.551 INFO:tasks.workunit.client.0.smithi087.stdout:3/393: link d0/d3/df/f4d d0/de/d30/d60/f6c 0 2024-03-18T14:43:14.552 INFO:tasks.workunit.client.1.smithi129.stdout:9/133: write d0/db/f12 [497951,103968] 0 2024-03-18T14:43:14.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/436: mknod db/d18/d1c/d69/d6f/c88 0 2024-03-18T14:43:14.553 INFO:tasks.workunit.client.1.smithi129.stdout:0/197: fsync d0/d14/f2d 0 2024-03-18T14:43:14.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/437: write db/d31/f42 [221081,30829] 0 2024-03-18T14:43:14.554 INFO:tasks.workunit.client.1.smithi129.stdout:2/119: symlink d7/d1f/l27 0 2024-03-18T14:43:14.555 INFO:tasks.workunit.client.1.smithi129.stdout:2/120: dread - d7/f1d zero size 2024-03-18T14:43:14.555 INFO:tasks.workunit.client.1.smithi129.stdout:6/148: truncate d3/d30/df/f1b 138864 0 2024-03-18T14:43:14.558 INFO:tasks.workunit.client.1.smithi129.stdout:5/139: creat d0/dc/d22/f2c x:0 0 0 2024-03-18T14:43:14.560 INFO:tasks.workunit.client.0.smithi087.stdout:6/321: chown d3/d1a/d29/c3c 220857576 1 2024-03-18T14:43:14.562 INFO:tasks.workunit.client.0.smithi087.stdout:0/336: creat d0/d1a/d7b/d26/d79/d6e/f7e x:0 0 0 2024-03-18T14:43:14.562 INFO:tasks.workunit.client.0.smithi087.stdout:0/337: stat d0/d1a/d7b/f22 0 2024-03-18T14:43:14.565 INFO:tasks.workunit.client.0.smithi087.stdout:7/422: truncate d1/d6/d16/f1e 2741946 0 2024-03-18T14:43:14.569 INFO:tasks.workunit.client.1.smithi129.stdout:7/122: write d4/d7/ff [1844134,4319] 0 2024-03-18T14:43:14.569 INFO:tasks.workunit.client.1.smithi129.stdout:3/124: sync 2024-03-18T14:43:14.569 INFO:tasks.workunit.client.1.smithi129.stdout:8/159: sync 2024-03-18T14:43:14.570 INFO:tasks.workunit.client.0.smithi087.stdout:5/377: symlink d13/d1b/d27/l84 0 2024-03-18T14:43:14.571 INFO:tasks.workunit.client.1.smithi129.stdout:6/149: mknod d3/c32 0 2024-03-18T14:43:14.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/361: truncate d1/d6/f1e 1413796 0 2024-03-18T14:43:14.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/123: mknod d4/c28 0 2024-03-18T14:43:14.577 INFO:tasks.workunit.client.0.smithi087.stdout:0/338: rmdir d0/d2/d4/d27 39 2024-03-18T14:43:14.578 INFO:tasks.workunit.client.1.smithi129.stdout:3/125: creat d4/dd/d15/d16/f2c x:0 0 0 2024-03-18T14:43:14.578 INFO:tasks.workunit.client.1.smithi129.stdout:4/119: getdents d0/d1a 0 2024-03-18T14:43:14.578 INFO:tasks.workunit.client.0.smithi087.stdout:7/423: creat d1/d6/d29/f92 x:0 0 0 2024-03-18T14:43:14.580 INFO:tasks.workunit.client.0.smithi087.stdout:8/362: dwrite d1/d6/f20 [0,4194304] 0 2024-03-18T14:43:14.580 INFO:tasks.workunit.client.1.smithi129.stdout:7/124: creat d4/d7/d8/f29 x:0 0 0 2024-03-18T14:43:14.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/363: write d1/d6/d9/f51 [945356,23000] 0 2024-03-18T14:43:14.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/120: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:14.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/121: chown d0/d9/f15 4571 1 2024-03-18T14:43:14.582 INFO:tasks.workunit.client.1.smithi129.stdout:4/122: dread - d0/d9/f17 zero size 2024-03-18T14:43:14.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/394: creat d0/f6d x:0 0 0 2024-03-18T14:43:14.583 INFO:tasks.workunit.client.1.smithi129.stdout:0/198: rename d0/c2 to d0/d23/d35/d3b/c41 0 2024-03-18T14:43:14.583 INFO:tasks.workunit.client.1.smithi129.stdout:2/121: getdents d7/d1c 0 2024-03-18T14:43:14.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/438: truncate db/d18/d1c/f40 778698 0 2024-03-18T14:43:14.584 INFO:tasks.workunit.client.0.smithi087.stdout:5/378: symlink d13/d1b/d27/d28/l85 0 2024-03-18T14:43:14.584 INFO:tasks.workunit.client.0.smithi087.stdout:9/439: chown db 123646 1 2024-03-18T14:43:14.584 INFO:tasks.workunit.client.1.smithi129.stdout:9/134: truncate d0/db/d1f/f23 3014908 0 2024-03-18T14:43:14.585 INFO:tasks.workunit.client.0.smithi087.stdout:5/379: readlink l4 0 2024-03-18T14:43:14.585 INFO:tasks.workunit.client.0.smithi087.stdout:8/364: write d1/d6/d2f/d44/d45/d50/f73 [403964,130093] 0 2024-03-18T14:43:14.585 INFO:tasks.workunit.client.0.smithi087.stdout:3/395: write d0/d1c/f5b [685751,8443] 0 2024-03-18T14:43:14.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/338: sync 2024-03-18T14:43:14.585 INFO:tasks.workunit.client.1.smithi129.stdout:3/126: symlink d4/d11/d1d/d27/l2d 0 2024-03-18T14:43:14.586 INFO:tasks.workunit.client.0.smithi087.stdout:9/440: readlink db/d18/d1c/l83 0 2024-03-18T14:43:14.586 INFO:tasks.workunit.client.1.smithi129.stdout:8/160: dread d9/f1d [0,4194304] 0 2024-03-18T14:43:14.586 INFO:tasks.workunit.client.0.smithi087.stdout:7/424: dwrite d1/d6/da/d42/f4a [0,4194304] 0 2024-03-18T14:43:14.587 INFO:tasks.workunit.client.0.smithi087.stdout:9/441: readlink db/d12/l14 0 2024-03-18T14:43:14.587 INFO:tasks.workunit.client.0.smithi087.stdout:5/380: write d13/d1b/d30/f5b [970585,9635] 0 2024-03-18T14:43:14.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/442: dread - db/d18/d1e/f4c zero size 2024-03-18T14:43:14.588 INFO:tasks.workunit.client.0.smithi087.stdout:5/381: dread - d13/d1b/d27/d28/f77 zero size 2024-03-18T14:43:14.590 INFO:tasks.workunit.client.0.smithi087.stdout:1/399: getdents d3/d3c 0 2024-03-18T14:43:14.590 INFO:tasks.workunit.client.0.smithi087.stdout:4/315: getdents d2/db/d24/d30 0 2024-03-18T14:43:14.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/396: readlink d0/d1c/l64 0 2024-03-18T14:43:14.592 INFO:tasks.workunit.client.0.smithi087.stdout:4/316: write d2/f21 [955247,75049] 0 2024-03-18T14:43:14.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/125: rename d4/d7/f24 to d4/d7/d8/d12/f2a 0 2024-03-18T14:43:14.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/199: mkdir d0/d23/d35/d3b/d42 0 2024-03-18T14:43:14.594 INFO:tasks.workunit.client.0.smithi087.stdout:7/425: dwrite d1/d6/da/d42/d67/f87 [0,4194304] 0 2024-03-18T14:43:14.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/122: creat d7/d1c/f28 x:0 0 0 2024-03-18T14:43:14.595 INFO:tasks.workunit.client.1.smithi129.stdout:8/161: creat d9/d11/d18/f34 x:0 0 0 2024-03-18T14:43:14.597 INFO:tasks.workunit.client.0.smithi087.stdout:9/443: unlink db/d18/d51/f5b 0 2024-03-18T14:43:14.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/130: sync 2024-03-18T14:43:14.598 INFO:tasks.workunit.client.1.smithi129.stdout:9/135: mkdir d0/db/d1f/d20/d25/d2b 0 2024-03-18T14:43:14.599 INFO:tasks.workunit.client.1.smithi129.stdout:7/126: dread d4/f16 [0,4194304] 0 2024-03-18T14:43:14.599 INFO:tasks.workunit.client.1.smithi129.stdout:1/131: readlink d1/d2/l4 0 2024-03-18T14:43:14.600 INFO:tasks.workunit.client.1.smithi129.stdout:0/200: dwrite d0/d14/d28/f3d [0,4194304] 0 2024-03-18T14:43:14.600 INFO:tasks.workunit.client.1.smithi129.stdout:1/132: stat d1/d2/f1f 0 2024-03-18T14:43:14.600 INFO:tasks.workunit.client.1.smithi129.stdout:9/136: chown d0/db/d1f/d20/d26/d19 0 1 2024-03-18T14:43:14.601 INFO:tasks.workunit.client.1.smithi129.stdout:8/162: dread d9/f1d [0,4194304] 0 2024-03-18T14:43:14.601 INFO:tasks.workunit.client.1.smithi129.stdout:0/201: fsync d0/d23/d35/f36 0 2024-03-18T14:43:14.602 INFO:tasks.workunit.client.1.smithi129.stdout:1/133: write d1/d2/f3 [2268629,128095] 0 2024-03-18T14:43:14.603 INFO:tasks.workunit.client.0.smithi087.stdout:0/339: truncate d0/d1a/d7b/d26/d79/f36 422990 0 2024-03-18T14:43:14.603 INFO:tasks.workunit.client.0.smithi087.stdout:6/322: sync 2024-03-18T14:43:14.603 INFO:tasks.workunit.client.1.smithi129.stdout:9/137: read - d0/db/d1f/d20/d26/d19/f21 zero size 2024-03-18T14:43:14.603 INFO:tasks.workunit.client.0.smithi087.stdout:2/339: truncate d2/d4/f59 5120942 0 2024-03-18T14:43:14.605 INFO:tasks.workunit.client.1.smithi129.stdout:8/163: creat d9/d11/d18/f35 x:0 0 0 2024-03-18T14:43:14.606 INFO:tasks.workunit.client.1.smithi129.stdout:7/127: dwrite d4/d7/d8/f1c [0,4194304] 0 2024-03-18T14:43:14.606 INFO:tasks.workunit.client.1.smithi129.stdout:0/202: mkdir d0/d23/d35/d3b/d43 0 2024-03-18T14:43:14.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/426: creat d1/d6/d29/d2f/d68/d65/d60/f93 x:0 0 0 2024-03-18T14:43:14.608 INFO:tasks.workunit.client.1.smithi129.stdout:1/134: creat d1/d18/d19/f24 x:0 0 0 2024-03-18T14:43:14.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/397: mkdir d0/d3/d4f/d6e 0 2024-03-18T14:43:14.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/398: write d0/de/d30/f5d [850250,3686] 0 2024-03-18T14:43:14.613 INFO:tasks.workunit.client.0.smithi087.stdout:8/365: creat d1/d6/d2f/d44/f75 x:0 0 0 2024-03-18T14:43:14.613 INFO:tasks.workunit.client.0.smithi087.stdout:7/427: dwrite d1/d6/d29/d2f/d68/d65/d60/f93 [0,4194304] 0 2024-03-18T14:43:14.615 INFO:tasks.workunit.client.0.smithi087.stdout:7/428: chown d1/d6/d29/d2f/d68/c5b 399 1 2024-03-18T14:43:14.619 INFO:tasks.workunit.client.0.smithi087.stdout:0/340: getdents d0/d2/d3c/d73 0 2024-03-18T14:43:14.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/317: link d2/d13/d28/l32 d2/db/d3c/l62 0 2024-03-18T14:43:14.623 INFO:tasks.workunit.client.0.smithi087.stdout:3/399: dread d0/d1c/f2b [0,4194304] 0 2024-03-18T14:43:14.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/400: read d0/de/d30/f66 [4136097,91770] 0 2024-03-18T14:43:14.626 INFO:tasks.workunit.client.1.smithi129.stdout:4/123: write d0/d9/f20 [1630583,24288] 0 2024-03-18T14:43:14.626 INFO:tasks.workunit.client.1.smithi129.stdout:1/135: link d1/c13 d1/d18/d19/c25 0 2024-03-18T14:43:14.626 INFO:tasks.workunit.client.0.smithi087.stdout:7/429: creat d1/d6/d29/d2f/d68/d65/d60/f94 x:0 0 0 2024-03-18T14:43:14.629 INFO:tasks.workunit.client.0.smithi087.stdout:2/340: truncate d2/d4/d22/d2c/d3a/d40/d52/f5c 382320 0 2024-03-18T14:43:14.630 INFO:tasks.workunit.client.0.smithi087.stdout:8/366: creat d1/d6/d2f/d44/d45/d50/d58/f76 x:0 0 0 2024-03-18T14:43:14.632 INFO:tasks.workunit.client.0.smithi087.stdout:9/444: link db/f4b db/d18/d1e/d7e/f89 0 2024-03-18T14:43:14.632 INFO:tasks.workunit.client.1.smithi129.stdout:1/136: dwrite d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:14.632 INFO:tasks.workunit.client.1.smithi129.stdout:6/150: sync 2024-03-18T14:43:14.632 INFO:tasks.workunit.client.1.smithi129.stdout:5/140: sync 2024-03-18T14:43:14.632 INFO:tasks.workunit.client.1.smithi129.stdout:4/124: dwrite d0/d19/d1d/f22 [0,4194304] 0 2024-03-18T14:43:14.633 INFO:tasks.workunit.client.0.smithi087.stdout:9/445: chown db/d18/d3a/c85 1150 1 2024-03-18T14:43:14.633 INFO:tasks.workunit.client.1.smithi129.stdout:1/137: fdatasync d1/f9 0 2024-03-18T14:43:14.634 INFO:tasks.workunit.client.0.smithi087.stdout:5/382: dread ff [0,4194304] 0 2024-03-18T14:43:14.634 INFO:tasks.workunit.client.1.smithi129.stdout:1/138: stat d1/d18/f21 0 2024-03-18T14:43:14.634 INFO:tasks.workunit.client.1.smithi129.stdout:3/127: truncate d4/dd/d15/d16/f24 566205 0 2024-03-18T14:43:14.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/341: mkdir d0/d7f 0 2024-03-18T14:43:14.635 INFO:tasks.workunit.client.0.smithi087.stdout:5/383: fdatasync d13/d1b/d30/d6e/f80 0 2024-03-18T14:43:14.637 INFO:tasks.workunit.client.0.smithi087.stdout:8/367: rmdir d1 39 2024-03-18T14:43:14.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/128: dread d4/dd/d15/d16/f1b [0,4194304] 0 2024-03-18T14:43:14.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/384: dwrite d13/d1b/d27/d28/f78 [0,4194304] 0 2024-03-18T14:43:14.641 INFO:tasks.workunit.client.1.smithi129.stdout:5/141: rename d0/c13 to d0/dc/c2d 0 2024-03-18T14:43:14.643 INFO:tasks.workunit.client.1.smithi129.stdout:1/139: mkdir d1/d26 0 2024-03-18T14:43:14.644 INFO:tasks.workunit.client.0.smithi087.stdout:1/400: dread d3/d1d/d45/f49 [0,4194304] 0 2024-03-18T14:43:14.645 INFO:tasks.workunit.client.1.smithi129.stdout:3/129: mknod d4/d11/d1d/d27/c2e 0 2024-03-18T14:43:14.646 INFO:tasks.workunit.client.1.smithi129.stdout:6/151: symlink d3/d5/l33 0 2024-03-18T14:43:14.646 INFO:tasks.workunit.client.0.smithi087.stdout:0/342: mkdir d0/d1a/d80 0 2024-03-18T14:43:14.647 INFO:tasks.workunit.client.0.smithi087.stdout:9/446: write db/d18/d1e/d28/d7c/f7d [955289,35519] 0 2024-03-18T14:43:14.648 INFO:tasks.workunit.client.0.smithi087.stdout:0/343: write d0/d2/d4/d19/f72 [376989,93127] 0 2024-03-18T14:43:14.648 INFO:tasks.workunit.client.0.smithi087.stdout:4/318: creat d2/f63 x:0 0 0 2024-03-18T14:43:14.648 INFO:tasks.workunit.client.0.smithi087.stdout:7/430: truncate d1/d6/da/f37 1971353 0 2024-03-18T14:43:14.649 INFO:tasks.workunit.client.1.smithi129.stdout:4/125: link d0/d19/f1f d0/d1a/f23 0 2024-03-18T14:43:14.650 INFO:tasks.workunit.client.1.smithi129.stdout:4/126: write d0/d9/f17 [898871,44313] 0 2024-03-18T14:43:14.651 INFO:tasks.workunit.client.1.smithi129.stdout:4/127: chown d0/d1a 331289 1 2024-03-18T14:43:14.651 INFO:tasks.workunit.client.1.smithi129.stdout:3/130: mkdir d4/dd/d1f/d2f 0 2024-03-18T14:43:14.654 INFO:tasks.workunit.client.0.smithi087.stdout:9/447: dwrite db/d18/d1e/f54 [0,4194304] 0 2024-03-18T14:43:14.655 INFO:tasks.workunit.client.0.smithi087.stdout:4/319: dwrite d2/db/d24/d30/f5c [0,4194304] 0 2024-03-18T14:43:14.657 INFO:tasks.workunit.client.0.smithi087.stdout:7/431: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/f6e [0,4194304] 0 2024-03-18T14:43:14.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/140: link d1/c13 d1/d2/c27 0 2024-03-18T14:43:14.659 INFO:tasks.workunit.client.1.smithi129.stdout:5/142: creat d0/f2e x:0 0 0 2024-03-18T14:43:14.661 INFO:tasks.workunit.client.1.smithi129.stdout:6/152: creat d3/d5/f34 x:0 0 0 2024-03-18T14:43:14.665 INFO:tasks.workunit.client.1.smithi129.stdout:2/123: sync 2024-03-18T14:43:14.665 INFO:tasks.workunit.client.1.smithi129.stdout:5/143: symlink d0/dc/d22/l2f 0 2024-03-18T14:43:14.666 INFO:tasks.workunit.client.1.smithi129.stdout:5/144: read d0/f2 [1290320,99885] 0 2024-03-18T14:43:14.666 INFO:tasks.workunit.client.1.smithi129.stdout:6/153: chown d3/f1a 1491 1 2024-03-18T14:43:14.666 INFO:tasks.workunit.client.0.smithi087.stdout:3/401: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:14.666 INFO:tasks.workunit.client.1.smithi129.stdout:5/145: chown d0/df/c12 0 1 2024-03-18T14:43:14.668 INFO:tasks.workunit.client.0.smithi087.stdout:8/368: creat d1/d6/d9/f77 x:0 0 0 2024-03-18T14:43:14.668 INFO:tasks.workunit.client.0.smithi087.stdout:6/323: dread d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:14.669 INFO:tasks.workunit.client.1.smithi129.stdout:2/124: mknod d7/d1f/d20/c29 0 2024-03-18T14:43:14.671 INFO:tasks.workunit.client.1.smithi129.stdout:6/154: dwrite d3/d5/d2b/f31 [0,4194304] 0 2024-03-18T14:43:14.671 INFO:tasks.workunit.client.1.smithi129.stdout:6/155: write d3/d30/f20 [1035497,97752] 0 2024-03-18T14:43:14.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/324: dwrite d3/f45 [0,4194304] 0 2024-03-18T14:43:14.674 INFO:tasks.workunit.client.1.smithi129.stdout:9/138: write d0/db/f18 [1028847,40102] 0 2024-03-18T14:43:14.674 INFO:tasks.workunit.client.1.smithi129.stdout:8/164: write f8 [2916228,52229] 0 2024-03-18T14:43:14.674 INFO:tasks.workunit.client.1.smithi129.stdout:7/128: write d4/fd [1918033,53239] 0 2024-03-18T14:43:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:5/385: mknod d13/d1b/d7e/c86 0 2024-03-18T14:43:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/341: link d2/d4/d22/l31 d2/d4/d22/d2c/d3a/d49/l66 0 2024-03-18T14:43:14.677 INFO:tasks.workunit.client.0.smithi087.stdout:3/402: creat d0/d3/d4f/f6f x:0 0 0 2024-03-18T14:43:14.678 INFO:tasks.workunit.client.1.smithi129.stdout:0/203: dwrite d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:14.678 INFO:tasks.workunit.client.0.smithi087.stdout:5/386: write d13/f37 [972961,106877] 0 2024-03-18T14:43:14.681 INFO:tasks.workunit.client.0.smithi087.stdout:8/369: chown d1/d6/d2f/d44/d4b/f4c 5 1 2024-03-18T14:43:14.682 INFO:tasks.workunit.client.0.smithi087.stdout:8/370: write d1/d6/d2f/d44/f52 [40918,105467] 0 2024-03-18T14:43:14.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/325: rename d3/d1a/d29/d22/d23/f26 to d3/d1a/d29/d22/d61/f70 0 2024-03-18T14:43:14.687 INFO:tasks.workunit.client.1.smithi129.stdout:6/156: unlink d3/d30/de/c2f 0 2024-03-18T14:43:14.687 INFO:tasks.workunit.client.1.smithi129.stdout:7/129: fdatasync d4/f16 0 2024-03-18T14:43:14.687 INFO:tasks.workunit.client.1.smithi129.stdout:8/165: rename d9/l25 to d9/dc/l36 0 2024-03-18T14:43:14.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/146: truncate d0/f2e 322846 0 2024-03-18T14:43:14.688 INFO:tasks.workunit.client.1.smithi129.stdout:8/166: readlink d9/d11/l26 0 2024-03-18T14:43:14.692 INFO:tasks.workunit.client.1.smithi129.stdout:8/167: dread d9/d11/d1a/f30 [0,4194304] 0 2024-03-18T14:43:14.692 INFO:tasks.workunit.client.1.smithi129.stdout:6/157: dwrite d3/d30/de/f2e [0,4194304] 0 2024-03-18T14:43:14.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/168: dread - d9/d11/d18/f24 zero size 2024-03-18T14:43:14.707 INFO:tasks.workunit.client.1.smithi129.stdout:3/131: dread d4/dd/d15/d16/f24 [0,4194304] 0 2024-03-18T14:43:14.715 INFO:tasks.workunit.client.1.smithi129.stdout:4/128: truncate d0/d19/d1d/f22 657105 0 2024-03-18T14:43:14.716 INFO:tasks.workunit.client.0.smithi087.stdout:7/432: mkdir d1/d8e/d95 0 2024-03-18T14:43:14.736 INFO:tasks.workunit.client.0.smithi087.stdout:9/448: sync 2024-03-18T14:43:14.737 INFO:tasks.workunit.client.0.smithi087.stdout:9/449: read - db/d12/f5e zero size 2024-03-18T14:43:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/401: truncate d3/d1d/d1e/d43/f46 4727256 0 2024-03-18T14:43:14.740 INFO:tasks.workunit.client.0.smithi087.stdout:0/344: dwrite d0/d1a/d7b/d2a/f68 [0,4194304] 0 2024-03-18T14:43:14.741 INFO:tasks.workunit.client.1.smithi129.stdout:2/125: write d7/dd/f15 [4045323,44098] 0 2024-03-18T14:43:14.744 INFO:tasks.workunit.client.1.smithi129.stdout:1/141: dwrite d1/f1d [0,4194304] 0 2024-03-18T14:43:14.746 INFO:tasks.workunit.client.0.smithi087.stdout:4/320: truncate d2/db/de/f2f 2417910 0 2024-03-18T14:43:14.748 INFO:tasks.workunit.client.1.smithi129.stdout:1/142: dwrite d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:14.748 INFO:tasks.workunit.client.1.smithi129.stdout:1/143: dread - d1/d18/d19/f24 zero size 2024-03-18T14:43:14.760 INFO:tasks.workunit.client.0.smithi087.stdout:3/403: rmdir d0/de/d30 39 2024-03-18T14:43:14.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/342: rmdir d2/d4/d22/d2c/d3a/d49/d58 39 2024-03-18T14:43:14.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/343: write d2/d4/d22/d2c/d3a/d49/f57 [319194,96544] 0 2024-03-18T14:43:14.764 INFO:tasks.workunit.client.1.smithi129.stdout:9/139: rename d0/c9 to d0/db/d11/c2c 0 2024-03-18T14:43:14.764 INFO:tasks.workunit.client.1.smithi129.stdout:5/147: creat d0/dc/d18/d2b/f30 x:0 0 0 2024-03-18T14:43:14.769 INFO:tasks.workunit.client.1.smithi129.stdout:6/158: creat d3/d30/de/f35 x:0 0 0 2024-03-18T14:43:14.769 INFO:tasks.workunit.client.0.smithi087.stdout:9/450: creat db/d31/f8a x:0 0 0 2024-03-18T14:43:14.770 INFO:tasks.workunit.client.0.smithi087.stdout:9/451: dread - db/d18/d1e/d28/f4a zero size 2024-03-18T14:43:14.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/345: symlink d0/d1a/d7b/d26/d79/d6e/l81 0 2024-03-18T14:43:14.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/346: write d0/d2/d3c/f61 [536390,11976] 0 2024-03-18T14:43:14.779 INFO:tasks.workunit.client.0.smithi087.stdout:8/371: symlink d1/d6/d2f/d44/d45/d71/l78 0 2024-03-18T14:43:14.780 INFO:tasks.workunit.client.0.smithi087.stdout:8/372: chown d1/d6/d14/f5b 202 1 2024-03-18T14:43:14.780 INFO:tasks.workunit.client.0.smithi087.stdout:8/373: fsync d1/d6/d9/d5d/f65 0 2024-03-18T14:43:14.781 INFO:tasks.workunit.client.0.smithi087.stdout:8/374: write d1/d6/d14/f5b [2460580,47833] 0 2024-03-18T14:43:14.782 INFO:tasks.workunit.client.0.smithi087.stdout:8/375: write d1/d6/d14/f5c [74924,93712] 0 2024-03-18T14:43:14.785 INFO:tasks.workunit.client.1.smithi129.stdout:3/132: fsync d4/dd/d15/d16/f1b 0 2024-03-18T14:43:14.785 INFO:tasks.workunit.client.1.smithi129.stdout:0/204: truncate d0/f1e 3744477 0 2024-03-18T14:43:14.786 INFO:tasks.workunit.client.1.smithi129.stdout:0/205: readlink d0/l15 0 2024-03-18T14:43:14.791 INFO:tasks.workunit.client.1.smithi129.stdout:2/126: mkdir d7/d1f/d20/d2a 0 2024-03-18T14:43:14.798 INFO:tasks.workunit.client.1.smithi129.stdout:8/169: truncate d9/d11/d1a/d14/f28 654382 0 2024-03-18T14:43:14.798 INFO:tasks.workunit.client.1.smithi129.stdout:8/170: fsync d9/dc/f29 0 2024-03-18T14:43:14.800 INFO:tasks.workunit.client.1.smithi129.stdout:6/159: dread d3/d30/df/f1b [0,4194304] 0 2024-03-18T14:43:14.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/402: creat d3/f7c x:0 0 0 2024-03-18T14:43:14.814 INFO:tasks.workunit.client.0.smithi087.stdout:1/403: chown d3/f10 28631 1 2024-03-18T14:43:14.817 INFO:tasks.workunit.client.1.smithi129.stdout:2/127: rmdir d7/d1f/d20 39 2024-03-18T14:43:14.818 INFO:tasks.workunit.client.1.smithi129.stdout:2/128: write d7/d1c/f26 [754545,88420] 0 2024-03-18T14:43:14.818 INFO:tasks.workunit.client.0.smithi087.stdout:0/347: unlink d0/d2/d4/d19/f23 0 2024-03-18T14:43:14.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/348: chown d0/dd/l46 61158 1 2024-03-18T14:43:14.819 INFO:tasks.workunit.client.0.smithi087.stdout:0/349: write d0/d1a/d7b/d2a/f68 [603421,96160] 0 2024-03-18T14:43:14.820 INFO:tasks.workunit.client.0.smithi087.stdout:0/350: chown d0/d1a/d34/d3d/f3e 81492 1 2024-03-18T14:43:14.820 INFO:tasks.workunit.client.1.smithi129.stdout:4/129: rename d0/fd to d0/d1a/f24 0 2024-03-18T14:43:14.821 INFO:tasks.workunit.client.1.smithi129.stdout:2/129: dread d7/dd/f18 [0,4194304] 0 2024-03-18T14:43:14.822 INFO:tasks.workunit.client.0.smithi087.stdout:2/344: unlink d2/d4/f27 0 2024-03-18T14:43:14.822 INFO:tasks.workunit.client.1.smithi129.stdout:2/130: write d7/d1c/f26 [1804372,120682] 0 2024-03-18T14:43:14.823 INFO:tasks.workunit.client.1.smithi129.stdout:1/144: truncate d1/d2/f3 2622823 0 2024-03-18T14:43:14.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/131: write d7/dd/f15 [1882549,95342] 0 2024-03-18T14:43:14.824 INFO:tasks.workunit.client.1.smithi129.stdout:1/145: write d1/f9 [3220303,22773] 0 2024-03-18T14:43:14.824 INFO:tasks.workunit.client.1.smithi129.stdout:2/132: dread - d7/f1e zero size 2024-03-18T14:43:14.824 INFO:tasks.workunit.client.1.smithi129.stdout:8/171: fsync d9/d11/d1a/f30 0 2024-03-18T14:43:14.825 INFO:tasks.workunit.client.0.smithi087.stdout:6/326: rmdir d3/d1a/d29/d22/d53 0 2024-03-18T14:43:14.826 INFO:tasks.workunit.client.0.smithi087.stdout:6/327: fdatasync d3/d7/f2e 0 2024-03-18T14:43:14.827 INFO:tasks.workunit.client.0.smithi087.stdout:6/328: read d3/d1a/d29/d22/f32 [3055904,53347] 0 2024-03-18T14:43:14.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/387: getdents d13/d1b/d7e 0 2024-03-18T14:43:14.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/388: dread - d13/d1b/d30/f49 zero size 2024-03-18T14:43:14.835 INFO:tasks.workunit.client.0.smithi087.stdout:9/452: truncate db/fd 1783241 0 2024-03-18T14:43:14.835 INFO:tasks.workunit.client.1.smithi129.stdout:5/148: link d0/dc/d1a/c1b d0/df/c31 0 2024-03-18T14:43:14.836 INFO:tasks.workunit.client.1.smithi129.stdout:9/140: truncate d0/db/d1f/d20/d26/d19/f21 836857 0 2024-03-18T14:43:14.838 INFO:tasks.workunit.client.1.smithi129.stdout:5/149: dread d0/f4 [0,4194304] 0 2024-03-18T14:43:14.839 INFO:tasks.workunit.client.1.smithi129.stdout:1/146: mkdir d1/d2/d28 0 2024-03-18T14:43:14.840 INFO:tasks.workunit.client.1.smithi129.stdout:7/130: rmdir d4/d27 0 2024-03-18T14:43:14.840 INFO:tasks.workunit.client.1.smithi129.stdout:7/131: chown f3 161109123 1 2024-03-18T14:43:14.841 INFO:tasks.workunit.client.1.smithi129.stdout:7/132: fdatasync d4/d7/d8/f1c 0 2024-03-18T14:43:14.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/433: getdents d1 0 2024-03-18T14:43:14.842 INFO:tasks.workunit.client.0.smithi087.stdout:6/329: write d3/d7/f21 [1388146,76351] 0 2024-03-18T14:43:14.843 INFO:tasks.workunit.client.0.smithi087.stdout:4/321: getdents d2/db/d24/d30/d49 0 2024-03-18T14:43:14.844 INFO:tasks.workunit.client.0.smithi087.stdout:3/404: link d0/d3/d4f/l5a d0/de/d30/d60/l70 0 2024-03-18T14:43:14.844 INFO:tasks.workunit.client.1.smithi129.stdout:4/130: write d0/f13 [2365705,17506] 0 2024-03-18T14:43:14.844 INFO:tasks.workunit.client.1.smithi129.stdout:9/141: rmdir d0/db/d1f 39 2024-03-18T14:43:14.846 INFO:tasks.workunit.client.1.smithi129.stdout:2/133: dread d7/fc [0,4194304] 0 2024-03-18T14:43:14.846 INFO:tasks.workunit.client.0.smithi087.stdout:9/453: mknod db/d18/d1c/d69/c8b 0 2024-03-18T14:43:14.847 INFO:tasks.workunit.client.0.smithi087.stdout:0/351: symlink d0/d2/d6b/d7c/l82 0 2024-03-18T14:43:14.847 INFO:tasks.workunit.client.1.smithi129.stdout:2/134: chown d7/d1c/f28 158599 1 2024-03-18T14:43:14.847 INFO:tasks.workunit.client.1.smithi129.stdout:7/133: dwrite d4/d7/ff [0,4194304] 0 2024-03-18T14:43:14.847 INFO:tasks.workunit.client.0.smithi087.stdout:9/454: stat db/d18/d3a/f47 0 2024-03-18T14:43:14.848 INFO:tasks.workunit.client.1.smithi129.stdout:2/135: fsync d7/d1c/f26 0 2024-03-18T14:43:14.849 INFO:tasks.workunit.client.0.smithi087.stdout:6/330: dwrite d3/d1a/f42 [0,4194304] 0 2024-03-18T14:43:14.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/455: chown db/d12/l4d 7821892 1 2024-03-18T14:43:14.850 INFO:tasks.workunit.client.0.smithi087.stdout:5/389: dwrite ff [0,4194304] 0 2024-03-18T14:43:14.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/160: rename d3/d30/df/l29 to d3/d5/l36 0 2024-03-18T14:43:14.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/161: rename d3/d30 to d3/d30/de/d37 22 2024-03-18T14:43:14.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/434: mkdir d1/d6/d29/d2f/d68/d65/d96 0 2024-03-18T14:43:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:4/322: truncate d2/db/de/f2c 817520 0 2024-03-18T14:43:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:8/376: link d1/d6/f1e d1/d6/d14/f79 0 2024-03-18T14:43:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:6/331: read f1 [2196478,107969] 0 2024-03-18T14:43:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:4/323: chown d2/db/d24 7 1 2024-03-18T14:43:14.853 INFO:tasks.workunit.client.0.smithi087.stdout:0/352: symlink d0/d2/d4/d19/d5a/l83 0 2024-03-18T14:43:14.854 INFO:tasks.workunit.client.1.smithi129.stdout:5/150: fdatasync d0/f9 0 2024-03-18T14:43:14.854 INFO:tasks.workunit.client.1.smithi129.stdout:9/142: write d0/db/d1f/d20/d26/f2a [987149,126921] 0 2024-03-18T14:43:14.856 INFO:tasks.workunit.client.1.smithi129.stdout:3/133: sync 2024-03-18T14:43:14.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/435: mkdir d1/d97 0 2024-03-18T14:43:14.860 INFO:tasks.workunit.client.0.smithi087.stdout:6/332: symlink d3/d7/d25/l71 0 2024-03-18T14:43:14.862 INFO:tasks.workunit.client.0.smithi087.stdout:1/404: sync 2024-03-18T14:43:14.862 INFO:tasks.workunit.client.1.smithi129.stdout:4/131: creat d0/d1a/f25 x:0 0 0 2024-03-18T14:43:14.862 INFO:tasks.workunit.client.1.smithi129.stdout:4/132: fsync d0/f13 0 2024-03-18T14:43:14.866 INFO:tasks.workunit.client.1.smithi129.stdout:0/206: read d0/f1e [2278562,45117] 0 2024-03-18T14:43:14.867 INFO:tasks.workunit.client.0.smithi087.stdout:5/390: creat d13/d1b/d70/f87 x:0 0 0 2024-03-18T14:43:14.867 INFO:tasks.workunit.client.0.smithi087.stdout:2/345: link d2/d4/c17 d2/d4/c67 0 2024-03-18T14:43:14.867 INFO:tasks.workunit.client.0.smithi087.stdout:7/436: mknod d1/d6/da/d59/c98 0 2024-03-18T14:43:14.870 INFO:tasks.workunit.client.1.smithi129.stdout:1/147: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:14.871 INFO:tasks.workunit.client.1.smithi129.stdout:5/151: dread d0/f2e [0,4194304] 0 2024-03-18T14:43:14.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/333: mkdir d3/d7/d25/d62/d72 0 2024-03-18T14:43:14.872 INFO:tasks.workunit.client.0.smithi087.stdout:6/334: dread - d3/d1a/d46/f6d zero size 2024-03-18T14:43:14.872 INFO:tasks.workunit.client.1.smithi129.stdout:0/207: dwrite d0/d14/f20 [4194304,4194304] 0 2024-03-18T14:43:14.872 INFO:tasks.workunit.client.1.smithi129.stdout:2/136: mkdir d7/d1f/d20/d2b 0 2024-03-18T14:43:14.872 INFO:tasks.workunit.client.1.smithi129.stdout:3/134: rmdir d4/d11 39 2024-03-18T14:43:14.874 INFO:tasks.workunit.client.0.smithi087.stdout:5/391: rmdir d13 39 2024-03-18T14:43:14.874 INFO:tasks.workunit.client.0.smithi087.stdout:4/324: dread d2/db/d24/f33 [0,4194304] 0 2024-03-18T14:43:14.874 INFO:tasks.workunit.client.0.smithi087.stdout:6/335: read d3/d1a/d29/f1d [5604017,47519] 0 2024-03-18T14:43:14.876 INFO:tasks.workunit.client.1.smithi129.stdout:7/134: dread f3 [0,4194304] 0 2024-03-18T14:43:14.877 INFO:tasks.workunit.client.1.smithi129.stdout:5/152: dwrite d0/dc/f20 [0,4194304] 0 2024-03-18T14:43:14.878 INFO:tasks.workunit.client.1.smithi129.stdout:5/153: chown d0/dc/d1a/c28 7543476 1 2024-03-18T14:43:14.879 INFO:tasks.workunit.client.1.smithi129.stdout:6/162: write d3/d30/fd [947568,71804] 0 2024-03-18T14:43:14.879 INFO:tasks.workunit.client.1.smithi129.stdout:5/154: dread d0/f2e [0,4194304] 0 2024-03-18T14:43:14.880 INFO:tasks.workunit.client.0.smithi087.stdout:3/405: truncate d0/de/f12 2459396 0 2024-03-18T14:43:14.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/377: dread d1/d6/d9/d5d/f64 [0,4194304] 0 2024-03-18T14:43:14.881 INFO:tasks.workunit.client.1.smithi129.stdout:9/143: creat d0/db/d1f/d20/d26/d19/d29/f2d x:0 0 0 2024-03-18T14:43:14.882 INFO:tasks.workunit.client.1.smithi129.stdout:2/137: symlink d7/dd/l2c 0 2024-03-18T14:43:14.883 INFO:tasks.workunit.client.0.smithi087.stdout:3/406: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:14.884 INFO:tasks.workunit.client.0.smithi087.stdout:2/346: mkdir d2/d4/d22/d2c/d3a/d68 0 2024-03-18T14:43:14.884 INFO:tasks.workunit.client.0.smithi087.stdout:7/437: rmdir d1/d6/d29/d2f 39 2024-03-18T14:43:14.886 INFO:tasks.workunit.client.0.smithi087.stdout:0/353: truncate d0/f50 161253 0 2024-03-18T14:43:14.888 INFO:tasks.workunit.client.0.smithi087.stdout:9/456: getdents db/d18/d1e 0 2024-03-18T14:43:14.888 INFO:tasks.workunit.client.1.smithi129.stdout:6/163: mkdir d3/d38 0 2024-03-18T14:43:14.888 INFO:tasks.workunit.client.1.smithi129.stdout:5/155: truncate d0/f4 578620 0 2024-03-18T14:43:14.889 INFO:tasks.workunit.client.1.smithi129.stdout:6/164: write d3/d30/de/f2e [3695856,94358] 0 2024-03-18T14:43:14.890 INFO:tasks.workunit.client.1.smithi129.stdout:5/156: write d0/dc/d18/d2b/f30 [285597,33820] 0 2024-03-18T14:43:14.892 INFO:tasks.workunit.client.1.smithi129.stdout:2/138: unlink d7/d1c/c24 0 2024-03-18T14:43:14.892 INFO:tasks.workunit.client.1.smithi129.stdout:0/208: getdents d0/d23/d35/d3b/d43 0 2024-03-18T14:43:14.893 INFO:tasks.workunit.client.1.smithi129.stdout:0/209: stat d0/d14/d3a 0 2024-03-18T14:43:14.893 INFO:tasks.workunit.client.0.smithi087.stdout:1/405: write d3/d1d/f3d [9099256,106914] 0 2024-03-18T14:43:14.895 INFO:tasks.workunit.client.0.smithi087.stdout:0/354: dread d0/d2/d4/d19/f2f [0,4194304] 0 2024-03-18T14:43:14.895 INFO:tasks.workunit.client.1.smithi129.stdout:7/135: unlink d4/d7/d8/l17 0 2024-03-18T14:43:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:8/378: rename d1/f1a to d1/d6/d9/f7a 0 2024-03-18T14:43:14.896 INFO:tasks.workunit.client.1.smithi129.stdout:2/139: dwrite d7/dd/f15 [0,4194304] 0 2024-03-18T14:43:14.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/355: write d0/d2/d4/d19/d5a/f7d [153315,19805] 0 2024-03-18T14:43:14.897 INFO:tasks.workunit.client.0.smithi087.stdout:8/379: write d1/d6/d9/f17 [868435,4933] 0 2024-03-18T14:43:14.898 INFO:tasks.workunit.client.0.smithi087.stdout:0/356: write d0/d2/d4/d19/d24/f71 [581047,99244] 0 2024-03-18T14:43:14.898 INFO:tasks.workunit.client.0.smithi087.stdout:2/347: stat d2/d4/d22/d2c/d3a/d49/l66 0 2024-03-18T14:43:14.898 INFO:tasks.workunit.client.1.smithi129.stdout:5/157: chown d0/dc/d18/f1d 264372828 1 2024-03-18T14:43:14.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/348: readlink d2/d4/d22/d2c/l3e 0 2024-03-18T14:43:14.900 INFO:tasks.workunit.client.0.smithi087.stdout:7/438: write d1/d6/d29/d2f/d68/d65/d60/f94 [813011,11990] 0 2024-03-18T14:43:14.901 INFO:tasks.workunit.client.0.smithi087.stdout:7/439: chown d1/d6/d29/d2f/d68/d65/d60/d66/f6e 121415424 1 2024-03-18T14:43:14.902 INFO:tasks.workunit.client.0.smithi087.stdout:7/440: stat d1/d6/da/d59 0 2024-03-18T14:43:14.902 INFO:tasks.workunit.client.1.smithi129.stdout:7/136: mknod d4/d7/c2b 0 2024-03-18T14:43:14.902 INFO:tasks.workunit.client.1.smithi129.stdout:4/133: link d0/d9/la d0/d1a/l26 0 2024-03-18T14:43:14.902 INFO:tasks.workunit.client.1.smithi129.stdout:6/165: mknod d3/d38/c39 0 2024-03-18T14:43:14.903 INFO:tasks.workunit.client.0.smithi087.stdout:5/392: mkdir d13/d1b/d30/d6e/d88 0 2024-03-18T14:43:14.903 INFO:tasks.workunit.client.1.smithi129.stdout:6/166: chown d3/d5/f13 24059464 1 2024-03-18T14:43:14.904 INFO:tasks.workunit.client.1.smithi129.stdout:6/167: write d3/d30/fd [1146788,110530] 0 2024-03-18T14:43:14.905 INFO:tasks.workunit.client.1.smithi129.stdout:2/140: dread d7/dd/f18 [0,4194304] 0 2024-03-18T14:43:14.908 INFO:tasks.workunit.client.0.smithi087.stdout:6/336: mknod d3/c73 0 2024-03-18T14:43:14.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/407: fdatasync d0/de/f12 0 2024-03-18T14:43:14.910 INFO:tasks.workunit.client.0.smithi087.stdout:0/357: creat d0/d2/f84 x:0 0 0 2024-03-18T14:43:14.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/358: chown d0/d2/f84 223056811 1 2024-03-18T14:43:14.916 INFO:tasks.workunit.client.0.smithi087.stdout:1/406: dread d3/d1d/d1f/d63/f6d [0,4194304] 0 2024-03-18T14:43:14.917 INFO:tasks.workunit.client.0.smithi087.stdout:1/407: dread d3/d1d/d1e/d43/d50/f58 [0,4194304] 0 2024-03-18T14:43:14.923 INFO:tasks.workunit.client.0.smithi087.stdout:6/337: fdatasync d3/d1a/d29/d22/d61/f70 0 2024-03-18T14:43:14.923 INFO:tasks.workunit.client.1.smithi129.stdout:8/172: sync 2024-03-18T14:43:14.923 INFO:tasks.workunit.client.0.smithi087.stdout:2/349: symlink d2/d4/d22/l69 0 2024-03-18T14:43:14.924 INFO:tasks.workunit.client.1.smithi129.stdout:3/135: truncate d4/dd/d1f/f26 52899 0 2024-03-18T14:43:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:6/338: chown d3/d7/le 48012 1 2024-03-18T14:43:14.924 INFO:tasks.workunit.client.0.smithi087.stdout:5/393: symlink d13/d1b/d27/l89 0 2024-03-18T14:43:14.925 INFO:tasks.workunit.client.1.smithi129.stdout:6/168: dwrite d3/d30/de/f22 [0,4194304] 0 2024-03-18T14:43:14.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/325: getdents d2 0 2024-03-18T14:43:14.926 INFO:tasks.workunit.client.1.smithi129.stdout:2/141: mkdir d7/d1f/d20/d2d 0 2024-03-18T14:43:14.926 INFO:tasks.workunit.client.0.smithi087.stdout:7/441: dwrite d1/d6/da/f50 [0,4194304] 0 2024-03-18T14:43:14.926 INFO:tasks.workunit.client.0.smithi087.stdout:6/339: chown d3/d7/c35 24 1 2024-03-18T14:43:14.927 INFO:tasks.workunit.client.1.smithi129.stdout:4/134: rename d0/d19 to d0/d19/d1d/d27 22 2024-03-18T14:43:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:8/380: rename d1/d6/d9/d5d/f65 to d1/d6/f7b 0 2024-03-18T14:43:14.927 INFO:tasks.workunit.client.0.smithi087.stdout:4/326: write d2/f5b [1031449,122760] 0 2024-03-18T14:43:14.927 INFO:tasks.workunit.client.1.smithi129.stdout:5/158: write d0/f2e [68077,34939] 0 2024-03-18T14:43:14.927 INFO:tasks.workunit.client.1.smithi129.stdout:2/142: readlink d7/d1f/l27 0 2024-03-18T14:43:14.928 INFO:tasks.workunit.client.1.smithi129.stdout:0/210: truncate d0/fb 6616299 0 2024-03-18T14:43:14.928 INFO:tasks.workunit.client.1.smithi129.stdout:8/173: dread d9/dc/f29 [0,4194304] 0 2024-03-18T14:43:14.928 INFO:tasks.workunit.client.1.smithi129.stdout:4/135: read d0/d19/f1f [3638916,111278] 0 2024-03-18T14:43:14.929 INFO:tasks.workunit.client.0.smithi087.stdout:9/457: sync 2024-03-18T14:43:14.930 INFO:tasks.workunit.client.1.smithi129.stdout:7/137: unlink d4/d7/d8/l1f 0 2024-03-18T14:43:14.930 INFO:tasks.workunit.client.0.smithi087.stdout:1/408: truncate d3/d1d/d1e/d20/f56 466303 0 2024-03-18T14:43:14.932 INFO:tasks.workunit.client.0.smithi087.stdout:4/327: dread d2/d13/f3f [0,4194304] 0 2024-03-18T14:43:14.933 INFO:tasks.workunit.client.0.smithi087.stdout:3/408: rename d0/c13 to d0/d3/d10/c71 0 2024-03-18T14:43:14.933 INFO:tasks.workunit.client.1.smithi129.stdout:6/169: dwrite d3/f1a [0,4194304] 0 2024-03-18T14:43:14.934 INFO:tasks.workunit.client.1.smithi129.stdout:3/136: rename d4/ce to d4/d11/d1d/c30 0 2024-03-18T14:43:14.935 INFO:tasks.workunit.client.0.smithi087.stdout:8/381: symlink d1/d6/d14/l7c 0 2024-03-18T14:43:14.935 INFO:tasks.workunit.client.0.smithi087.stdout:3/409: dread d0/d1c/f39 [0,4194304] 0 2024-03-18T14:43:14.935 INFO:tasks.workunit.client.1.smithi129.stdout:2/143: dwrite d7/d1c/f26 [0,4194304] 0 2024-03-18T14:43:14.936 INFO:tasks.workunit.client.0.smithi087.stdout:7/442: symlink d1/d97/l99 0 2024-03-18T14:43:14.937 INFO:tasks.workunit.client.1.smithi129.stdout:5/159: mkdir d0/d32 0 2024-03-18T14:43:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:2/350: creat d2/d4/f6a x:0 0 0 2024-03-18T14:43:14.940 INFO:tasks.workunit.client.0.smithi087.stdout:4/328: symlink d2/db/d24/d30/d56/l64 0 2024-03-18T14:43:14.942 INFO:tasks.workunit.client.0.smithi087.stdout:6/340: creat d3/f74 x:0 0 0 2024-03-18T14:43:14.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/329: read d2/db/de/f45 [1795307,38763] 0 2024-03-18T14:43:14.942 INFO:tasks.workunit.client.1.smithi129.stdout:8/174: mknod d9/d11/d1a/d32/c37 0 2024-03-18T14:43:14.943 INFO:tasks.workunit.client.0.smithi087.stdout:6/341: read d3/d1a/d29/d22/d61/f70 [7930340,108185] 0 2024-03-18T14:43:14.944 INFO:tasks.workunit.client.1.smithi129.stdout:7/138: rename d4/d7/lc to d4/l2c 0 2024-03-18T14:43:14.944 INFO:tasks.workunit.client.0.smithi087.stdout:0/359: rename d0/d1a/d7b/d26/d79/d6e to d0/d1a/d7b/d2a/d85 0 2024-03-18T14:43:14.945 INFO:tasks.workunit.client.1.smithi129.stdout:3/137: mkdir d4/dd/d15/d31 0 2024-03-18T14:43:14.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/443: chown d1/d6/d29/l5a 7 1 2024-03-18T14:43:14.948 INFO:tasks.workunit.client.0.smithi087.stdout:9/458: getdents db/d18/d3a/d87 0 2024-03-18T14:43:14.948 INFO:tasks.workunit.client.1.smithi129.stdout:6/170: mknod d3/d5/c3a 0 2024-03-18T14:43:14.950 INFO:tasks.workunit.client.0.smithi087.stdout:5/394: getdents d13/d1b/d30 0 2024-03-18T14:43:14.950 INFO:tasks.workunit.client.1.smithi129.stdout:7/139: write f3 [5082607,88958] 0 2024-03-18T14:43:14.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/330: creat d2/d13/d28/f65 x:0 0 0 2024-03-18T14:43:14.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/331: readlink d2/d13/l59 0 2024-03-18T14:43:14.952 INFO:tasks.workunit.client.0.smithi087.stdout:9/459: dread db/d18/d3a/f63 [0,4194304] 0 2024-03-18T14:43:14.952 INFO:tasks.workunit.client.0.smithi087.stdout:4/332: chown d2/db/l48 130055 1 2024-03-18T14:43:14.954 INFO:tasks.workunit.client.0.smithi087.stdout:3/410: mkdir d0/d72 0 2024-03-18T14:43:14.954 INFO:tasks.workunit.client.1.smithi129.stdout:5/160: rename d0/dc/d22/c1f to d0/dc/d18/c33 0 2024-03-18T14:43:14.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/161: chown d0/f6 19 1 2024-03-18T14:43:14.955 INFO:tasks.workunit.client.1.smithi129.stdout:2/144: creat d7/d1f/d20/d2d/f2e x:0 0 0 2024-03-18T14:43:14.955 INFO:tasks.workunit.client.0.smithi087.stdout:0/360: creat d0/d1a/d34/f86 x:0 0 0 2024-03-18T14:43:14.959 INFO:tasks.workunit.client.0.smithi087.stdout:3/411: dwrite d0/d1c/d25/f6a [0,4194304] 0 2024-03-18T14:43:14.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/382: dread d1/d6/d9/f17 [0,4194304] 0 2024-03-18T14:43:14.960 INFO:tasks.workunit.client.1.smithi129.stdout:7/140: rename d4/d7/d8/d12 to d4/d2d 0 2024-03-18T14:43:14.960 INFO:tasks.workunit.client.1.smithi129.stdout:5/162: rmdir d0/dc/d18 39 2024-03-18T14:43:14.960 INFO:tasks.workunit.client.1.smithi129.stdout:1/148: sync 2024-03-18T14:43:14.960 INFO:tasks.workunit.client.0.smithi087.stdout:8/383: chown d1/d6/d2f/d44/d45/d71/l78 92 1 2024-03-18T14:43:14.960 INFO:tasks.workunit.client.1.smithi129.stdout:2/145: symlink d7/d1c/l2f 0 2024-03-18T14:43:14.961 INFO:tasks.workunit.client.1.smithi129.stdout:2/146: write f5 [2702694,32135] 0 2024-03-18T14:43:14.962 INFO:tasks.workunit.client.1.smithi129.stdout:2/147: chown d7/d1f/d20/d2d/f2e 17 1 2024-03-18T14:43:14.962 INFO:tasks.workunit.client.1.smithi129.stdout:2/148: chown d7/d1c 862 1 2024-03-18T14:43:14.962 INFO:tasks.workunit.client.1.smithi129.stdout:4/136: truncate d0/d1a/f23 3047598 0 2024-03-18T14:43:14.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/137: chown d0/d9/d1e 222543 1 2024-03-18T14:43:14.964 INFO:tasks.workunit.client.0.smithi087.stdout:7/444: dread d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:14.971 INFO:tasks.workunit.client.1.smithi129.stdout:3/138: write d4/dd/d15/d16/f1c [1487647,41303] 0 2024-03-18T14:43:14.972 INFO:tasks.workunit.client.1.smithi129.stdout:6/171: fsync d3/d5/f11 0 2024-03-18T14:43:14.973 INFO:tasks.workunit.client.0.smithi087.stdout:0/361: creat d0/d1a/d7b/d2a/d85/f87 x:0 0 0 2024-03-18T14:43:14.974 INFO:tasks.workunit.client.0.smithi087.stdout:8/384: creat d1/f7d x:0 0 0 2024-03-18T14:43:14.974 INFO:tasks.workunit.client.1.smithi129.stdout:5/163: unlink d0/f1 0 2024-03-18T14:43:14.976 INFO:tasks.workunit.client.1.smithi129.stdout:6/172: dwrite d3/d5/f27 [0,4194304] 0 2024-03-18T14:43:14.977 INFO:tasks.workunit.client.0.smithi087.stdout:6/342: rmdir d3/d7/d25/d62/d72 0 2024-03-18T14:43:14.978 INFO:tasks.workunit.client.1.smithi129.stdout:1/149: mknod d1/d18/c29 0 2024-03-18T14:43:14.978 INFO:tasks.workunit.client.1.smithi129.stdout:1/150: readlink d1/d2/l15 0 2024-03-18T14:43:14.978 INFO:tasks.workunit.client.0.smithi087.stdout:4/333: dread d2/f9 [0,4194304] 0 2024-03-18T14:43:14.980 INFO:tasks.workunit.client.0.smithi087.stdout:1/409: rename d3/d1d/d67/f77 to d3/d1d/d1f/f7d 0 2024-03-18T14:43:14.980 INFO:tasks.workunit.client.1.smithi129.stdout:9/144: sync 2024-03-18T14:43:14.982 INFO:tasks.workunit.client.0.smithi087.stdout:4/334: dread d2/f16 [0,4194304] 0 2024-03-18T14:43:14.982 INFO:tasks.workunit.client.1.smithi129.stdout:3/139: creat d4/dd/f32 x:0 0 0 2024-03-18T14:43:14.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/362: chown d0/d2/d4/d27/c43 471300 1 2024-03-18T14:43:14.983 INFO:tasks.workunit.client.1.smithi129.stdout:8/175: link d9/d11/d1a/d14/f28 d9/d11/d1a/d32/f38 0 2024-03-18T14:43:14.984 INFO:tasks.workunit.client.0.smithi087.stdout:8/385: unlink d1/d6/d2f/d44/d4b/c57 0 2024-03-18T14:43:14.987 INFO:tasks.workunit.client.1.smithi129.stdout:6/173: mknod d3/d30/de/c3b 0 2024-03-18T14:43:14.987 INFO:tasks.workunit.client.0.smithi087.stdout:5/395: getdents d13/d1b 0 2024-03-18T14:43:14.988 INFO:tasks.workunit.client.1.smithi129.stdout:4/138: truncate d0/f1c 3422435 0 2024-03-18T14:43:14.989 INFO:tasks.workunit.client.0.smithi087.stdout:9/460: write db/d18/f81 [1492681,102483] 0 2024-03-18T14:43:14.991 INFO:tasks.workunit.client.1.smithi129.stdout:8/176: creat d9/d11/d1a/d14/f39 x:0 0 0 2024-03-18T14:43:14.991 INFO:tasks.workunit.client.1.smithi129.stdout:8/177: write f8 [535012,92598] 0 2024-03-18T14:43:14.991 INFO:tasks.workunit.client.1.smithi129.stdout:5/164: mkdir d0/d32/d34 0 2024-03-18T14:43:14.992 INFO:tasks.workunit.client.1.smithi129.stdout:1/151: symlink d1/d2/d28/l2a 0 2024-03-18T14:43:14.992 INFO:tasks.workunit.client.1.smithi129.stdout:8/178: read d9/dc/f29 [286435,71893] 0 2024-03-18T14:43:14.993 INFO:tasks.workunit.client.0.smithi087.stdout:1/410: creat d3/d1d/d1f/d63/f7e x:0 0 0 2024-03-18T14:43:14.993 INFO:tasks.workunit.client.0.smithi087.stdout:1/411: stat d3 0 2024-03-18T14:43:14.993 INFO:tasks.workunit.client.0.smithi087.stdout:7/445: dread d1/d6/da/f43 [0,4194304] 0 2024-03-18T14:43:14.994 INFO:tasks.workunit.client.0.smithi087.stdout:3/412: creat d0/d3/f73 x:0 0 0 2024-03-18T14:43:14.995 INFO:tasks.workunit.client.1.smithi129.stdout:9/145: mkdir d0/db/d2e 0 2024-03-18T14:43:14.996 INFO:tasks.workunit.client.1.smithi129.stdout:7/141: truncate d4/d7/ff 319143 0 2024-03-18T14:43:14.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/363: write d0/fc [1483515,104298] 0 2024-03-18T14:43:14.997 INFO:tasks.workunit.client.0.smithi087.stdout:8/386: fsync d1/d6/d2f/d44/d4b/f54 0 2024-03-18T14:43:14.997 INFO:tasks.workunit.client.1.smithi129.stdout:4/139: mknod d0/d19/d1d/c28 0 2024-03-18T14:43:14.998 INFO:tasks.workunit.client.1.smithi129.stdout:1/152: dwrite d1/d18/f21 [0,4194304] 0 2024-03-18T14:43:14.998 INFO:tasks.workunit.client.1.smithi129.stdout:3/140: symlink d4/l33 0 2024-03-18T14:43:15.000 INFO:tasks.workunit.client.1.smithi129.stdout:2/149: sync 2024-03-18T14:43:15.000 INFO:tasks.workunit.client.1.smithi129.stdout:0/211: sync 2024-03-18T14:43:15.001 INFO:tasks.workunit.client.1.smithi129.stdout:2/150: dread - d7/f1e zero size 2024-03-18T14:43:15.002 INFO:tasks.workunit.client.1.smithi129.stdout:5/165: rename d0/dc/d22/f2c to d0/dc/d22/f35 0 2024-03-18T14:43:15.003 INFO:tasks.workunit.client.1.smithi129.stdout:2/151: write d7/fa [421081,67807] 0 2024-03-18T14:43:15.003 INFO:tasks.workunit.client.1.smithi129.stdout:9/146: fsync d0/db/fd 0 2024-03-18T14:43:15.004 INFO:tasks.workunit.client.1.smithi129.stdout:0/212: dread d0/fd [0,4194304] 0 2024-03-18T14:43:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:2/351: rename d2/d4/f28 to d2/d4/d22/d24/d65/f6b 0 2024-03-18T14:43:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:4/335: dread d2/db/d24/f4c [0,4194304] 0 2024-03-18T14:43:15.004 INFO:tasks.workunit.client.0.smithi087.stdout:7/446: rmdir d1/d6/da/d59 39 2024-03-18T14:43:15.004 INFO:tasks.workunit.client.1.smithi129.stdout:1/153: dwrite d1/d18/f21 [0,4194304] 0 2024-03-18T14:43:15.007 INFO:tasks.workunit.client.1.smithi129.stdout:7/142: mkdir d4/d2d/d2e 0 2024-03-18T14:43:15.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/140: creat d0/d9/d1e/f29 x:0 0 0 2024-03-18T14:43:15.008 INFO:tasks.workunit.client.1.smithi129.stdout:3/141: fsync d4/dd/d15/d16/f1b 0 2024-03-18T14:43:15.008 INFO:tasks.workunit.client.0.smithi087.stdout:5/396: dwrite d13/f5f [0,4194304] 0 2024-03-18T14:43:15.009 INFO:tasks.workunit.client.0.smithi087.stdout:1/412: rename d3/d1d/d1e/f4b to d3/d1d/d79/f7f 0 2024-03-18T14:43:15.009 INFO:tasks.workunit.client.1.smithi129.stdout:3/142: fdatasync d4/f21 0 2024-03-18T14:43:15.010 INFO:tasks.workunit.client.1.smithi129.stdout:3/143: chown d4/d11/d1d/d27/f2b 0 1 2024-03-18T14:43:15.011 INFO:tasks.workunit.client.1.smithi129.stdout:7/143: dread f3 [0,4194304] 0 2024-03-18T14:43:15.011 INFO:tasks.workunit.client.0.smithi087.stdout:6/343: getdents d3/d1a 0 2024-03-18T14:43:15.012 INFO:tasks.workunit.client.0.smithi087.stdout:4/336: mknod d2/c66 0 2024-03-18T14:43:15.013 INFO:tasks.workunit.client.1.smithi129.stdout:1/154: write d1/d18/d19/f22 [746148,99376] 0 2024-03-18T14:43:15.014 INFO:tasks.workunit.client.0.smithi087.stdout:2/352: mknod d2/d4/d22/d2c/d3a/c6c 0 2024-03-18T14:43:15.014 INFO:tasks.workunit.client.1.smithi129.stdout:4/141: dread d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:15.015 INFO:tasks.workunit.client.1.smithi129.stdout:4/142: write d0/d9/f17 [646413,119184] 0 2024-03-18T14:43:15.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/144: dread d4/d7/f25 [0,4194304] 0 2024-03-18T14:43:15.018 INFO:tasks.workunit.client.0.smithi087.stdout:7/447: symlink d1/d6/d29/d2f/d68/d65/l9a 0 2024-03-18T14:43:15.019 INFO:tasks.workunit.client.1.smithi129.stdout:1/155: dwrite d1/d18/f21 [0,4194304] 0 2024-03-18T14:43:15.022 INFO:tasks.workunit.client.1.smithi129.stdout:6/174: getdents d3/d30 0 2024-03-18T14:43:15.022 INFO:tasks.workunit.client.0.smithi087.stdout:0/364: rename d0/dd to d0/d1a/d80/d88 0 2024-03-18T14:43:15.022 INFO:tasks.workunit.client.0.smithi087.stdout:0/365: chown d0/d1a/d80 1 1 2024-03-18T14:43:15.023 INFO:tasks.workunit.client.1.smithi129.stdout:8/179: truncate d9/d11/d18/f35 473776 0 2024-03-18T14:43:15.023 INFO:tasks.workunit.client.1.smithi129.stdout:1/156: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:15.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/344: stat d3/d1a/d29/f56 0 2024-03-18T14:43:15.024 INFO:tasks.workunit.client.0.smithi087.stdout:6/345: chown d3/d7/f57 113444455 1 2024-03-18T14:43:15.024 INFO:tasks.workunit.client.1.smithi129.stdout:3/144: dread d4/dd/d15/d16/f1c [0,4194304] 0 2024-03-18T14:43:15.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/145: stat d4/d11/d1d/d27/l2d 0 2024-03-18T14:43:15.026 INFO:tasks.workunit.client.0.smithi087.stdout:2/353: symlink d2/d44/l6d 0 2024-03-18T14:43:15.027 INFO:tasks.workunit.client.1.smithi129.stdout:9/147: dwrite d0/db/fd [0,4194304] 0 2024-03-18T14:43:15.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/146: write d4/f21 [958576,15858] 0 2024-03-18T14:43:15.028 INFO:tasks.workunit.client.0.smithi087.stdout:3/413: write d0/d3/df/f4d [1966318,130312] 0 2024-03-18T14:43:15.031 INFO:tasks.workunit.client.0.smithi087.stdout:7/448: symlink d1/d6/d29/d2f/d68/d65/d60/d66/l9b 0 2024-03-18T14:43:15.032 INFO:tasks.workunit.client.1.smithi129.stdout:6/175: creat d3/f3c x:0 0 0 2024-03-18T14:43:15.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/397: symlink d13/d1b/d30/d6e/d88/l8a 0 2024-03-18T14:43:15.033 INFO:tasks.workunit.client.1.smithi129.stdout:5/166: creat d0/f36 x:0 0 0 2024-03-18T14:43:15.033 INFO:tasks.workunit.client.1.smithi129.stdout:6/176: chown d3/d30/de/f1f 65 1 2024-03-18T14:43:15.035 INFO:tasks.workunit.client.0.smithi087.stdout:7/449: dwrite d1/d6/d29/d2f/d68/d65/d72/f80 [0,4194304] 0 2024-03-18T14:43:15.037 INFO:tasks.workunit.client.0.smithi087.stdout:7/450: chown d1/d6/d29/d2f/d68/d65/d60/d66/f6e 119224 1 2024-03-18T14:43:15.038 INFO:tasks.workunit.client.1.smithi129.stdout:9/148: symlink d0/db/d1f/l2f 0 2024-03-18T14:43:15.038 INFO:tasks.workunit.client.1.smithi129.stdout:5/167: dread d0/dc/d22/f1e [0,4194304] 0 2024-03-18T14:43:15.039 INFO:tasks.workunit.client.1.smithi129.stdout:6/177: dwrite d3/d30/df/f14 [0,4194304] 0 2024-03-18T14:43:15.039 INFO:tasks.workunit.client.0.smithi087.stdout:6/346: mkdir d3/d1a/d29/d22/d75 0 2024-03-18T14:43:15.039 INFO:tasks.workunit.client.1.smithi129.stdout:0/213: rename d0/d23/l34 to d0/l44 0 2024-03-18T14:43:15.040 INFO:tasks.workunit.client.1.smithi129.stdout:3/147: dread d4/dd/d15/f25 [0,4194304] 0 2024-03-18T14:43:15.040 INFO:tasks.workunit.client.1.smithi129.stdout:4/143: fsync d0/d1a/f23 0 2024-03-18T14:43:15.041 INFO:tasks.workunit.client.1.smithi129.stdout:7/145: symlink d4/d2d/d2e/l2f 0 2024-03-18T14:43:15.042 INFO:tasks.workunit.client.1.smithi129.stdout:3/148: dread - d4/f9 zero size 2024-03-18T14:43:15.042 INFO:tasks.workunit.client.1.smithi129.stdout:7/146: read - d4/d7/d8/f29 zero size 2024-03-18T14:43:15.043 INFO:tasks.workunit.client.1.smithi129.stdout:5/168: fdatasync d0/f9 0 2024-03-18T14:43:15.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/149: dread - d4/dd/d15/d16/f2c zero size 2024-03-18T14:43:15.046 INFO:tasks.workunit.client.1.smithi129.stdout:0/214: dread d0/d14/d28/f3d [0,4194304] 0 2024-03-18T14:43:15.046 INFO:tasks.workunit.client.1.smithi129.stdout:8/180: rename d9/dc to d9/d11/d1a/d32/d3a 0 2024-03-18T14:43:15.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/398: mknod d13/c8b 0 2024-03-18T14:43:15.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/413: getdents d3/d1d/d1f/d34 0 2024-03-18T14:43:15.049 INFO:tasks.workunit.client.1.smithi129.stdout:1/157: truncate d1/d18/d19/f24 382797 0 2024-03-18T14:43:15.049 INFO:tasks.workunit.client.0.smithi087.stdout:1/414: chown d3/d1d/f22 312658 1 2024-03-18T14:43:15.049 INFO:tasks.workunit.client.0.smithi087.stdout:7/451: creat d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f9c x:0 0 0 2024-03-18T14:43:15.049 INFO:tasks.workunit.client.0.smithi087.stdout:5/399: read d13/d1b/d30/f40 [29231,116553] 0 2024-03-18T14:43:15.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/152: sync 2024-03-18T14:43:15.050 INFO:tasks.workunit.client.0.smithi087.stdout:6/347: mknod d3/d1a/d29/d22/d23/c76 0 2024-03-18T14:43:15.050 INFO:tasks.workunit.client.0.smithi087.stdout:5/400: chown d13/d1b/d30/f67 20 1 2024-03-18T14:43:15.051 INFO:tasks.workunit.client.0.smithi087.stdout:6/348: rename d3/d1a/d29/d22 to d3/d1a/d29/d22/d75/d77 22 2024-03-18T14:43:15.052 INFO:tasks.workunit.client.0.smithi087.stdout:6/349: write d3/d1a/d29/f16 [2662513,80828] 0 2024-03-18T14:43:15.052 INFO:tasks.workunit.client.0.smithi087.stdout:4/337: fdatasync d2/db/d24/f4b 0 2024-03-18T14:43:15.053 INFO:tasks.workunit.client.0.smithi087.stdout:6/350: readlink d3/d7/l4a 0 2024-03-18T14:43:15.054 INFO:tasks.workunit.client.0.smithi087.stdout:0/366: write d0/d2/f4a [3412900,28279] 0 2024-03-18T14:43:15.055 INFO:tasks.workunit.client.1.smithi129.stdout:7/147: creat d4/d2d/d2e/f30 x:0 0 0 2024-03-18T14:43:15.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/367: chown d0/d2/d4/d19/d5a/l83 611186 1 2024-03-18T14:43:15.055 INFO:tasks.workunit.client.1.smithi129.stdout:5/169: chown d0/dc/d18/l2a 46302229 1 2024-03-18T14:43:15.056 INFO:tasks.workunit.client.0.smithi087.stdout:9/461: sync 2024-03-18T14:43:15.057 INFO:tasks.workunit.client.0.smithi087.stdout:7/452: symlink d1/d8e/l9d 0 2024-03-18T14:43:15.060 INFO:tasks.workunit.client.0.smithi087.stdout:6/351: dread d3/d1a/d29/d22/f5d [0,4194304] 0 2024-03-18T14:43:15.060 INFO:tasks.workunit.client.0.smithi087.stdout:1/415: creat d3/d1d/d1e/d20/f80 x:0 0 0 2024-03-18T14:43:15.061 INFO:tasks.workunit.client.1.smithi129.stdout:0/215: rmdir d0/d23/d35/d3b 39 2024-03-18T14:43:15.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/352: read d3/f6 [1265935,123411] 0 2024-03-18T14:43:15.065 INFO:tasks.workunit.client.1.smithi129.stdout:4/144: mknod d0/c2a 0 2024-03-18T14:43:15.065 INFO:tasks.workunit.client.1.smithi129.stdout:0/216: dread d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:15.065 INFO:tasks.workunit.client.1.smithi129.stdout:0/217: chown d0/fd 10118 1 2024-03-18T14:43:15.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/354: getdents d2/d4/d22/d2c 0 2024-03-18T14:43:15.066 INFO:tasks.workunit.client.0.smithi087.stdout:6/353: dread d3/d1a/f34 [0,4194304] 0 2024-03-18T14:43:15.066 INFO:tasks.workunit.client.0.smithi087.stdout:3/414: getdents d0/de 0 2024-03-18T14:43:15.067 INFO:tasks.workunit.client.0.smithi087.stdout:9/462: dread db/d31/f36 [0,4194304] 0 2024-03-18T14:43:15.068 INFO:tasks.workunit.client.1.smithi129.stdout:1/158: stat d1/d2/l14 0 2024-03-18T14:43:15.068 INFO:tasks.workunit.client.0.smithi087.stdout:5/401: mknod d13/d1b/d27/c8c 0 2024-03-18T14:43:15.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/416: mknod d3/d3c/c81 0 2024-03-18T14:43:15.070 INFO:tasks.workunit.client.1.smithi129.stdout:2/153: creat d7/dd/f30 x:0 0 0 2024-03-18T14:43:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:3/415: dwrite d0/f34 [0,4194304] 0 2024-03-18T14:43:15.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/338: mkdir d2/db/d67 0 2024-03-18T14:43:15.071 INFO:tasks.workunit.client.1.smithi129.stdout:2/154: write d7/dd/f15 [2721196,51339] 0 2024-03-18T14:43:15.072 INFO:tasks.workunit.client.0.smithi087.stdout:4/339: chown d2/db/l48 380 1 2024-03-18T14:43:15.072 INFO:tasks.workunit.client.1.smithi129.stdout:6/178: truncate d3/d6/f18 4372730 0 2024-03-18T14:43:15.074 INFO:tasks.workunit.client.1.smithi129.stdout:7/148: creat d4/d7/f31 x:0 0 0 2024-03-18T14:43:15.074 INFO:tasks.workunit.client.1.smithi129.stdout:3/150: write d4/dd/d1f/f26 [1082177,1362] 0 2024-03-18T14:43:15.075 INFO:tasks.workunit.client.0.smithi087.stdout:2/355: chown d2/d4/f34 24010424 1 2024-03-18T14:43:15.076 INFO:tasks.workunit.client.0.smithi087.stdout:6/354: fdatasync d3/d1a/d29/f56 0 2024-03-18T14:43:15.078 INFO:tasks.workunit.client.0.smithi087.stdout:7/453: rename d1/d6/d29/d2f/d68/d65/l6f to d1/d6/d29/d2f/d68/d65/d60/d66/l9e 0 2024-03-18T14:43:15.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/387: sync 2024-03-18T14:43:15.078 INFO:tasks.workunit.client.1.smithi129.stdout:3/151: dwrite d4/d11/d1d/d27/f2b [0,4194304] 0 2024-03-18T14:43:15.079 INFO:tasks.workunit.client.0.smithi087.stdout:8/388: write d1/fd [603707,6104] 0 2024-03-18T14:43:15.079 INFO:tasks.workunit.client.0.smithi087.stdout:5/402: creat d13/d1b/d30/f8d x:0 0 0 2024-03-18T14:43:15.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/149: truncate d0/db/d1f/d20/d26/d19/d29/f2d 154976 0 2024-03-18T14:43:15.080 INFO:tasks.workunit.client.1.smithi129.stdout:0/218: fdatasync d0/d23/d35/d3b/f33 0 2024-03-18T14:43:15.082 INFO:tasks.workunit.client.1.smithi129.stdout:6/179: mknod d3/d5/d2b/c3d 0 2024-03-18T14:43:15.083 INFO:tasks.workunit.client.0.smithi087.stdout:0/368: link d0/d2/d4/d19/d24/c4e d0/d1a/d7b/d26/d79/c89 0 2024-03-18T14:43:15.083 INFO:tasks.workunit.client.1.smithi129.stdout:7/149: readlink d4/d7/l21 0 2024-03-18T14:43:15.083 INFO:tasks.workunit.client.1.smithi129.stdout:6/180: read d3/d30/df/f1b [69201,52123] 0 2024-03-18T14:43:15.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/356: mkdir d2/d4/d22/d2c/d3a/d40/d6e 0 2024-03-18T14:43:15.084 INFO:tasks.workunit.client.1.smithi129.stdout:6/181: chown d3/d30/df/f14 139 1 2024-03-18T14:43:15.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/357: chown d2/c20 3 1 2024-03-18T14:43:15.085 INFO:tasks.workunit.client.0.smithi087.stdout:2/358: dread - d2/d4/d22/f4d zero size 2024-03-18T14:43:15.087 INFO:tasks.workunit.client.1.smithi129.stdout:9/150: dread d0/db/d1f/d20/d26/f2a [0,4194304] 0 2024-03-18T14:43:15.089 INFO:tasks.workunit.client.1.smithi129.stdout:8/181: creat d9/d11/f3b x:0 0 0 2024-03-18T14:43:15.090 INFO:tasks.workunit.client.1.smithi129.stdout:3/152: truncate d4/dd/d15/f25 1819499 0 2024-03-18T14:43:15.091 INFO:tasks.workunit.client.0.smithi087.stdout:9/463: rename f1 to db/d18/d1c/d69/f8c 0 2024-03-18T14:43:15.092 INFO:tasks.workunit.client.1.smithi129.stdout:3/153: read d4/fa [892179,54490] 0 2024-03-18T14:43:15.093 INFO:tasks.workunit.client.1.smithi129.stdout:5/170: truncate d0/f36 371896 0 2024-03-18T14:43:15.094 INFO:tasks.workunit.client.0.smithi087.stdout:5/403: creat d13/d1b/d7e/f8e x:0 0 0 2024-03-18T14:43:15.095 INFO:tasks.workunit.client.0.smithi087.stdout:3/416: symlink d0/d1c/l74 0 2024-03-18T14:43:15.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/182: symlink d3/d30/l3e 0 2024-03-18T14:43:15.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/369: symlink d0/d1a/d7b/l8a 0 2024-03-18T14:43:15.098 INFO:tasks.workunit.client.1.smithi129.stdout:6/183: write d3/d30/f20 [288928,5448] 0 2024-03-18T14:43:15.098 INFO:tasks.workunit.client.0.smithi087.stdout:5/404: dwrite d13/d1b/d27/d28/f71 [0,4194304] 0 2024-03-18T14:43:15.101 INFO:tasks.workunit.client.1.smithi129.stdout:2/155: truncate d7/dd/f15 389423 0 2024-03-18T14:43:15.101 INFO:tasks.workunit.client.1.smithi129.stdout:9/151: dread d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:15.101 INFO:tasks.workunit.client.1.smithi129.stdout:7/150: write f3 [1760763,8296] 0 2024-03-18T14:43:15.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/417: write d3/d1d/f28 [1025119,64786] 0 2024-03-18T14:43:15.102 INFO:tasks.workunit.client.1.smithi129.stdout:9/152: chown d0/f10 1244 1 2024-03-18T14:43:15.102 INFO:tasks.workunit.client.1.smithi129.stdout:8/182: mknod d9/d11/d18/c3c 0 2024-03-18T14:43:15.102 INFO:tasks.workunit.client.1.smithi129.stdout:7/151: fsync d4/fd 0 2024-03-18T14:43:15.102 INFO:tasks.workunit.client.1.smithi129.stdout:4/145: getdents d0/d19 0 2024-03-18T14:43:15.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/153: write d0/db/d11/f27 [86974,47432] 0 2024-03-18T14:43:15.103 INFO:tasks.workunit.client.1.smithi129.stdout:4/146: write d0/d1a/f25 [796182,130896] 0 2024-03-18T14:43:15.104 INFO:tasks.workunit.client.1.smithi129.stdout:1/159: rmdir d1/d26 0 2024-03-18T14:43:15.105 INFO:tasks.workunit.client.1.smithi129.stdout:9/154: write d0/f8 [2780974,90961] 0 2024-03-18T14:43:15.105 INFO:tasks.workunit.client.1.smithi129.stdout:1/160: chown d1/d2 45 1 2024-03-18T14:43:15.105 INFO:tasks.workunit.client.0.smithi087.stdout:6/355: rename d3/d1a/l66 to d3/d7/l78 0 2024-03-18T14:43:15.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/418: dwrite d3/d1d/d45/f59 [0,4194304] 0 2024-03-18T14:43:15.110 INFO:tasks.workunit.client.1.smithi129.stdout:5/171: creat d0/df/f37 x:0 0 0 2024-03-18T14:43:15.111 INFO:tasks.workunit.client.1.smithi129.stdout:0/219: symlink d0/d14/d3a/l45 0 2024-03-18T14:43:15.113 INFO:tasks.workunit.client.1.smithi129.stdout:6/184: unlink d3/d30/df/f1b 0 2024-03-18T14:43:15.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/185: chown d3/d30/df 1023576092 1 2024-03-18T14:43:15.114 INFO:tasks.workunit.client.0.smithi087.stdout:8/389: rename d1/d6/d9/fe to d1/d6/d2f/d44/d45/d71/f7e 0 2024-03-18T14:43:15.115 INFO:tasks.workunit.client.1.smithi129.stdout:2/156: mknod d7/d1f/d20/c31 0 2024-03-18T14:43:15.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/419: creat d3/d1d/d1e/d43/d50/d72/f82 x:0 0 0 2024-03-18T14:43:15.115 INFO:tasks.workunit.client.1.smithi129.stdout:2/157: stat d7/d1c/f28 0 2024-03-18T14:43:15.116 INFO:tasks.workunit.client.1.smithi129.stdout:6/186: write d3/d30/df/f14 [2556205,118817] 0 2024-03-18T14:43:15.116 INFO:tasks.workunit.client.1.smithi129.stdout:0/220: dwrite d0/d23/d35/f36 [4194304,4194304] 0 2024-03-18T14:43:15.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/390: chown d1/d6/d2f/d44/d45/d50/f73 199106216 1 2024-03-18T14:43:15.116 INFO:tasks.workunit.client.1.smithi129.stdout:2/158: chown d7/l19 12800200 1 2024-03-18T14:43:15.117 INFO:tasks.workunit.client.1.smithi129.stdout:6/187: write d3/d30/de/f35 [726885,73610] 0 2024-03-18T14:43:15.118 INFO:tasks.workunit.client.0.smithi087.stdout:7/454: creat d1/d6/da/f9f x:0 0 0 2024-03-18T14:43:15.118 INFO:tasks.workunit.client.0.smithi087.stdout:4/340: link d2/d13/f3f d2/db/d24/d30/d4d/f68 0 2024-03-18T14:43:15.118 INFO:tasks.workunit.client.0.smithi087.stdout:0/370: mkdir d0/d2/d4/d8b 0 2024-03-18T14:43:15.118 INFO:tasks.workunit.client.0.smithi087.stdout:0/371: chown d0/d2/d4/lb 0 1 2024-03-18T14:43:15.120 INFO:tasks.workunit.client.1.smithi129.stdout:6/188: read d3/d5/f13 [2121255,54490] 0 2024-03-18T14:43:15.120 INFO:tasks.workunit.client.0.smithi087.stdout:2/359: dread d2/d4/fd [0,4194304] 0 2024-03-18T14:43:15.120 INFO:tasks.workunit.client.0.smithi087.stdout:9/464: rename db/d18/d1c/f37 to db/d31/f8d 0 2024-03-18T14:43:15.121 INFO:tasks.workunit.client.1.smithi129.stdout:8/183: symlink d9/d11/d18/l3d 0 2024-03-18T14:43:15.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/341: write d2/f61 [147650,77932] 0 2024-03-18T14:43:15.122 INFO:tasks.workunit.client.1.smithi129.stdout:7/152: creat d4/d7/d8/f32 x:0 0 0 2024-03-18T14:43:15.122 INFO:tasks.workunit.client.1.smithi129.stdout:4/147: creat d0/d19/f2b x:0 0 0 2024-03-18T14:43:15.122 INFO:tasks.workunit.client.1.smithi129.stdout:1/161: mknod d1/c2b 0 2024-03-18T14:43:15.123 INFO:tasks.workunit.client.1.smithi129.stdout:5/172: truncate d0/dc/d18/f1d 8879748 0 2024-03-18T14:43:15.123 INFO:tasks.workunit.client.1.smithi129.stdout:8/184: chown d9/ca 64066 1 2024-03-18T14:43:15.123 INFO:tasks.workunit.client.0.smithi087.stdout:4/342: chown d2/db/d24/d30/d56/l64 2831659 1 2024-03-18T14:43:15.123 INFO:tasks.workunit.client.1.smithi129.stdout:7/153: write d4/d7/f19 [73695,76936] 0 2024-03-18T14:43:15.123 INFO:tasks.workunit.client.1.smithi129.stdout:8/185: stat d9/d11/f3b 0 2024-03-18T14:43:15.124 INFO:tasks.workunit.client.0.smithi087.stdout:0/372: mkdir d0/d1a/d8c 0 2024-03-18T14:43:15.124 INFO:tasks.workunit.client.1.smithi129.stdout:0/221: mknod d0/d14/c46 0 2024-03-18T14:43:15.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/420: creat d3/d1d/d1e/d20/d7a/f83 x:0 0 0 2024-03-18T14:43:15.126 INFO:tasks.workunit.client.1.smithi129.stdout:2/159: mkdir d7/d1c/d32 0 2024-03-18T14:43:15.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/421: stat d3/d1d/d1e/d43/d50/d71/c61 0 2024-03-18T14:43:15.127 INFO:tasks.workunit.client.1.smithi129.stdout:2/160: chown d7/dd/l13 2 1 2024-03-18T14:43:15.127 INFO:tasks.workunit.client.1.smithi129.stdout:6/189: truncate d3/d5/f11 913155 0 2024-03-18T14:43:15.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/173: dread d0/f2 [0,4194304] 0 2024-03-18T14:43:15.128 INFO:tasks.workunit.client.1.smithi129.stdout:4/148: creat d0/d1a/f2c x:0 0 0 2024-03-18T14:43:15.129 INFO:tasks.workunit.client.1.smithi129.stdout:1/162: symlink d1/d18/d19/l2c 0 2024-03-18T14:43:15.130 INFO:tasks.workunit.client.1.smithi129.stdout:8/186: dwrite f4 [0,4194304] 0 2024-03-18T14:43:15.131 INFO:tasks.workunit.client.1.smithi129.stdout:7/154: mknod d4/d2d/c33 0 2024-03-18T14:43:15.133 INFO:tasks.workunit.client.0.smithi087.stdout:5/405: write d13/d1b/d30/f40 [1982339,33957] 0 2024-03-18T14:43:15.134 INFO:tasks.workunit.client.0.smithi087.stdout:5/406: chown d13/d1b/d70 4969836 1 2024-03-18T14:43:15.134 INFO:tasks.workunit.client.1.smithi129.stdout:4/149: mkdir d0/d19/d2d 0 2024-03-18T14:43:15.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/391: mkdir d1/d6/d2f/d44/d45/d72/d7f 0 2024-03-18T14:43:15.135 INFO:tasks.workunit.client.0.smithi087.stdout:8/392: chown d1/d6/d2f/d44/d45/d50/f66 8541366 1 2024-03-18T14:43:15.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/155: creat d4/d2d/f34 x:0 0 0 2024-03-18T14:43:15.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/417: rename d0/fb to d0/d3/d10/f75 0 2024-03-18T14:43:15.141 INFO:tasks.workunit.client.0.smithi087.stdout:7/455: symlink d1/d6/d16/la0 0 2024-03-18T14:43:15.142 INFO:tasks.workunit.client.0.smithi087.stdout:3/418: dwrite d0/d3/fd [0,4194304] 0 2024-03-18T14:43:15.143 INFO:tasks.workunit.client.1.smithi129.stdout:7/156: dwrite d4/d7/f31 [0,4194304] 0 2024-03-18T14:43:15.143 INFO:tasks.workunit.client.0.smithi087.stdout:1/422: creat d3/d1d/d1e/d43/d50/d72/f84 x:0 0 0 2024-03-18T14:43:15.145 INFO:tasks.workunit.client.1.smithi129.stdout:3/154: dwrite d4/dd/d15/d16/f1c [0,4194304] 0 2024-03-18T14:43:15.146 INFO:tasks.workunit.client.1.smithi129.stdout:3/155: stat d4/l33 0 2024-03-18T14:43:15.146 INFO:tasks.workunit.client.1.smithi129.stdout:3/156: stat d4/d11/d1d/d27/c2e 0 2024-03-18T14:43:15.147 INFO:tasks.workunit.client.1.smithi129.stdout:3/157: write d4/dd/d1f/f26 [203828,65629] 0 2024-03-18T14:43:15.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/343: dwrite d2/f36 [0,4194304] 0 2024-03-18T14:43:15.148 INFO:tasks.workunit.client.1.smithi129.stdout:3/158: dread - d4/dd/d15/d16/f2c zero size 2024-03-18T14:43:15.149 INFO:tasks.workunit.client.1.smithi129.stdout:3/159: write d4/dd/d15/d16/f2c [254857,107786] 0 2024-03-18T14:43:15.149 INFO:tasks.workunit.client.1.smithi129.stdout:8/187: fdatasync d9/f1f 0 2024-03-18T14:43:15.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/356: dwrite d3/d1a/d29/f16 [0,4194304] 0 2024-03-18T14:43:15.150 INFO:tasks.workunit.client.0.smithi087.stdout:7/456: creat d1/d6/fa1 x:0 0 0 2024-03-18T14:43:15.151 INFO:tasks.workunit.client.1.smithi129.stdout:3/160: chown d4/d11/d1d/d27/f2b 26 1 2024-03-18T14:43:15.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/150: rmdir d0/d19/d1d 39 2024-03-18T14:43:15.155 INFO:tasks.workunit.client.1.smithi129.stdout:9/155: dwrite d0/f16 [0,4194304] 0 2024-03-18T14:43:15.157 INFO:tasks.workunit.client.1.smithi129.stdout:1/163: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:15.158 INFO:tasks.workunit.client.1.smithi129.stdout:0/222: truncate d0/d14/d28/f30 833543 0 2024-03-18T14:43:15.160 INFO:tasks.workunit.client.0.smithi087.stdout:9/465: truncate db/d12/f20 12719 0 2024-03-18T14:43:15.162 INFO:tasks.workunit.client.0.smithi087.stdout:2/360: dwrite d2/f1d [0,4194304] 0 2024-03-18T14:43:15.164 INFO:tasks.workunit.client.1.smithi129.stdout:8/188: truncate d9/d11/d1a/d14/f2c 247226 0 2024-03-18T14:43:15.164 INFO:tasks.workunit.client.1.smithi129.stdout:4/151: stat d0/c4 0 2024-03-18T14:43:15.165 INFO:tasks.workunit.client.1.smithi129.stdout:2/161: truncate d7/d1c/f28 800467 0 2024-03-18T14:43:15.166 INFO:tasks.workunit.client.1.smithi129.stdout:9/156: creat d0/db/d1f/f30 x:0 0 0 2024-03-18T14:43:15.166 INFO:tasks.workunit.client.1.smithi129.stdout:2/162: stat d7/d1f/d20/d2a 0 2024-03-18T14:43:15.167 INFO:tasks.workunit.client.1.smithi129.stdout:1/164: chown d1/d2/c27 389 1 2024-03-18T14:43:15.169 INFO:tasks.workunit.client.0.smithi087.stdout:0/373: creat d0/d2/d4/f8d x:0 0 0 2024-03-18T14:43:15.170 INFO:tasks.workunit.client.0.smithi087.stdout:0/374: chown d0/d2/d4/d19/d24/f71 400315650 1 2024-03-18T14:43:15.173 INFO:tasks.workunit.client.1.smithi129.stdout:5/174: getdents d0 0 2024-03-18T14:43:15.177 INFO:tasks.workunit.client.1.smithi129.stdout:5/175: write d0/f2 [939562,45044] 0 2024-03-18T14:43:15.178 INFO:tasks.workunit.client.1.smithi129.stdout:5/176: chown d0/c25 7 1 2024-03-18T14:43:15.178 INFO:tasks.workunit.client.0.smithi087.stdout:8/393: rename d1/c3d to d1/d6/c80 0 2024-03-18T14:43:15.178 INFO:tasks.workunit.client.0.smithi087.stdout:4/344: truncate d2/db/d24/d30/d4d/f68 3601323 0 2024-03-18T14:43:15.179 INFO:tasks.workunit.client.0.smithi087.stdout:0/375: chown d0/d1a/d7b/d26/d79/l42 12 1 2024-03-18T14:43:15.180 INFO:tasks.workunit.client.0.smithi087.stdout:4/345: write d2/db/d24/d30/d4d/f57 [77015,96953] 0 2024-03-18T14:43:15.182 INFO:tasks.workunit.client.0.smithi087.stdout:5/407: getdents d13 0 2024-03-18T14:43:15.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/466: symlink db/d18/l8e 0 2024-03-18T14:43:15.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/357: truncate d3/f5e 886699 0 2024-03-18T14:43:15.182 INFO:tasks.workunit.client.0.smithi087.stdout:4/346: write d2/d13/d28/f42 [932663,44091] 0 2024-03-18T14:43:15.182 INFO:tasks.workunit.client.1.smithi129.stdout:5/177: dwrite d0/dc/f20 [4194304,4194304] 0 2024-03-18T14:43:15.183 INFO:tasks.workunit.client.0.smithi087.stdout:5/408: dread - d13/d1b/f46 zero size 2024-03-18T14:43:15.183 INFO:tasks.workunit.client.1.smithi129.stdout:8/189: truncate d9/f1f 4186186 0 2024-03-18T14:43:15.184 INFO:tasks.workunit.client.1.smithi129.stdout:6/190: truncate d3/d30/df/f14 4807448 0 2024-03-18T14:43:15.184 INFO:tasks.workunit.client.0.smithi087.stdout:5/409: stat d13/d1b/d27/d28/f6f 0 2024-03-18T14:43:15.185 INFO:tasks.workunit.client.0.smithi087.stdout:7/457: rename d1/d6/da/f22 to d1/d6/da/d42/d61/fa2 0 2024-03-18T14:43:15.186 INFO:tasks.workunit.client.1.smithi129.stdout:4/152: truncate d0/d19/f2b 197139 0 2024-03-18T14:43:15.187 INFO:tasks.workunit.client.1.smithi129.stdout:8/190: creat d9/d11/d1a/f3e x:0 0 0 2024-03-18T14:43:15.188 INFO:tasks.workunit.client.1.smithi129.stdout:5/178: dwrite d0/f14 [0,4194304] 0 2024-03-18T14:43:15.189 INFO:tasks.workunit.client.0.smithi087.stdout:9/467: mkdir db/d18/d51/d8f 0 2024-03-18T14:43:15.190 INFO:tasks.workunit.client.1.smithi129.stdout:6/191: dwrite d3/d6/f2d [0,4194304] 0 2024-03-18T14:43:15.191 INFO:tasks.workunit.client.1.smithi129.stdout:8/191: creat d9/d11/d18/f3f x:0 0 0 2024-03-18T14:43:15.194 INFO:tasks.workunit.client.0.smithi087.stdout:4/347: mknod d2/db/de/c69 0 2024-03-18T14:43:15.194 INFO:tasks.workunit.client.0.smithi087.stdout:5/410: fdatasync d13/d1b/d30/f52 0 2024-03-18T14:43:15.194 INFO:tasks.workunit.client.1.smithi129.stdout:4/153: unlink d0/c2 0 2024-03-18T14:43:15.195 INFO:tasks.workunit.client.0.smithi087.stdout:5/411: readlink d13/l55 0 2024-03-18T14:43:15.195 INFO:tasks.workunit.client.1.smithi129.stdout:4/154: write d0/d1a/f25 [172487,77516] 0 2024-03-18T14:43:15.195 INFO:tasks.workunit.client.0.smithi087.stdout:0/376: symlink d0/d7f/l8e 0 2024-03-18T14:43:15.196 INFO:tasks.workunit.client.1.smithi129.stdout:4/155: write d0/d1a/f25 [1001657,6685] 0 2024-03-18T14:43:15.197 INFO:tasks.workunit.client.0.smithi087.stdout:5/412: read d13/d1b/f3a [819148,15486] 0 2024-03-18T14:43:15.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/468: mknod db/d12/c90 0 2024-03-18T14:43:15.197 INFO:tasks.workunit.client.1.smithi129.stdout:6/192: symlink d3/l3f 0 2024-03-18T14:43:15.197 INFO:tasks.workunit.client.1.smithi129.stdout:4/156: dread - d0/d1a/f2c zero size 2024-03-18T14:43:15.197 INFO:tasks.workunit.client.1.smithi129.stdout:8/192: rmdir d9/d11/d1a/d32/d3a 39 2024-03-18T14:43:15.198 INFO:tasks.workunit.client.1.smithi129.stdout:4/157: chown d0/d9/f15 0 1 2024-03-18T14:43:15.198 INFO:tasks.workunit.client.1.smithi129.stdout:8/193: read d9/d11/f16 [1522416,106255] 0 2024-03-18T14:43:15.200 INFO:tasks.workunit.client.0.smithi087.stdout:8/394: creat d1/d6/d2f/d44/f81 x:0 0 0 2024-03-18T14:43:15.203 INFO:tasks.workunit.client.0.smithi087.stdout:0/377: mknod d0/d1a/d34/c8f 0 2024-03-18T14:43:15.203 INFO:tasks.workunit.client.1.smithi129.stdout:8/194: dwrite d9/f1b [0,4194304] 0 2024-03-18T14:43:15.204 INFO:tasks.workunit.client.1.smithi129.stdout:8/195: stat d9/d11/d1a/d14/l31 0 2024-03-18T14:43:15.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/361: dread d2/d44/f45 [0,4194304] 0 2024-03-18T14:43:15.204 INFO:tasks.workunit.client.0.smithi087.stdout:0/378: chown d0/d1a/d7b/d26 3224620 1 2024-03-18T14:43:15.205 INFO:tasks.workunit.client.1.smithi129.stdout:8/196: write d9/d11/d18/f24 [600405,107309] 0 2024-03-18T14:43:15.208 INFO:tasks.workunit.client.1.smithi129.stdout:6/193: link d3/d5/l33 d3/d5/l40 0 2024-03-18T14:43:15.211 INFO:tasks.workunit.client.1.smithi129.stdout:8/197: mknod d9/d33/c40 0 2024-03-18T14:43:15.213 INFO:tasks.workunit.client.1.smithi129.stdout:6/194: dwrite d3/f1a [0,4194304] 0 2024-03-18T14:43:15.214 INFO:tasks.workunit.client.1.smithi129.stdout:7/157: truncate d4/d7/d8/f22 1273822 0 2024-03-18T14:43:15.214 INFO:tasks.workunit.client.1.smithi129.stdout:7/158: readlink d4/d7/l21 0 2024-03-18T14:43:15.215 INFO:tasks.workunit.client.0.smithi087.stdout:6/358: link d3/d1a/d29/ld d3/d1a/d29/d22/d23/l79 0 2024-03-18T14:43:15.215 INFO:tasks.workunit.client.0.smithi087.stdout:2/362: write d2/d4/d22/d24/d65/f6b [4643235,85096] 0 2024-03-18T14:43:15.216 INFO:tasks.workunit.client.1.smithi129.stdout:3/161: write d4/dd/d15/f25 [1047679,64263] 0 2024-03-18T14:43:15.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/157: write d0/db/d1f/d20/d26/f2a [2123147,89591] 0 2024-03-18T14:43:15.217 INFO:tasks.workunit.client.0.smithi087.stdout:7/458: getdents d1 0 2024-03-18T14:43:15.218 INFO:tasks.workunit.client.0.smithi087.stdout:7/459: dread - d1/d6/da/f9f zero size 2024-03-18T14:43:15.219 INFO:tasks.workunit.client.1.smithi129.stdout:0/223: truncate d0/d23/f3f 5083235 0 2024-03-18T14:43:15.222 INFO:tasks.workunit.client.0.smithi087.stdout:3/419: dread d0/d3/df/f16 [0,4194304] 0 2024-03-18T14:43:15.223 INFO:tasks.workunit.client.1.smithi129.stdout:2/163: dwrite d7/dd/f18 [0,4194304] 0 2024-03-18T14:43:15.223 INFO:tasks.workunit.client.1.smithi129.stdout:0/224: write d0/d23/d29/f38 [411849,60816] 0 2024-03-18T14:43:15.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/379: mknod d0/c90 0 2024-03-18T14:43:15.225 INFO:tasks.workunit.client.0.smithi087.stdout:1/423: dwrite d3/d1d/f21 [0,4194304] 0 2024-03-18T14:43:15.226 INFO:tasks.workunit.client.0.smithi087.stdout:1/424: fsync d3/d1d/d45/f59 0 2024-03-18T14:43:15.228 INFO:tasks.workunit.client.1.smithi129.stdout:3/162: dread d4/dd/d15/d16/f1c [0,4194304] 0 2024-03-18T14:43:15.228 INFO:tasks.workunit.client.1.smithi129.stdout:1/165: dwrite d1/d18/d19/f24 [0,4194304] 0 2024-03-18T14:43:15.229 INFO:tasks.workunit.client.1.smithi129.stdout:9/158: dwrite d0/db/f12 [0,4194304] 0 2024-03-18T14:43:15.230 INFO:tasks.workunit.client.1.smithi129.stdout:5/179: write d0/dc/d18/f1d [1546151,475] 0 2024-03-18T14:43:15.230 INFO:tasks.workunit.client.0.smithi087.stdout:1/425: dwrite d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:15.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/159: unlink d4/f10 0 2024-03-18T14:43:15.233 INFO:tasks.workunit.client.1.smithi129.stdout:4/158: dread d0/d19/f2b [0,4194304] 0 2024-03-18T14:43:15.234 INFO:tasks.workunit.client.1.smithi129.stdout:0/225: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:15.234 INFO:tasks.workunit.client.0.smithi087.stdout:3/420: unlink d0/d1c/l58 0 2024-03-18T14:43:15.235 INFO:tasks.workunit.client.0.smithi087.stdout:0/380: symlink d0/d1a/d7b/d26/d79/l91 0 2024-03-18T14:43:15.236 INFO:tasks.workunit.client.1.smithi129.stdout:3/163: dread d4/fb [0,4194304] 0 2024-03-18T14:43:15.236 INFO:tasks.workunit.client.1.smithi129.stdout:4/159: chown d0/d9/d1e/f29 1 1 2024-03-18T14:43:15.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/426: creat d3/d1d/d1e/d20/f85 x:0 0 0 2024-03-18T14:43:15.238 INFO:tasks.workunit.client.0.smithi087.stdout:4/348: getdents d2/db/d24/d30 0 2024-03-18T14:43:15.238 INFO:tasks.workunit.client.1.smithi129.stdout:7/160: dwrite d4/d7/f31 [0,4194304] 0 2024-03-18T14:43:15.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/349: stat d2/d13/f34 0 2024-03-18T14:43:15.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/161: write d4/f6 [4114193,64052] 0 2024-03-18T14:43:15.239 INFO:tasks.workunit.client.0.smithi087.stdout:4/350: stat d2/db/d24/c38 0 2024-03-18T14:43:15.243 INFO:tasks.workunit.client.0.smithi087.stdout:5/413: dread d13/d1b/d27/f34 [0,4194304] 0 2024-03-18T14:43:15.244 INFO:tasks.workunit.client.0.smithi087.stdout:5/414: chown d13/d1b/d70/l74 390678 1 2024-03-18T14:43:15.244 INFO:tasks.workunit.client.0.smithi087.stdout:5/415: chown d13/d1b/d30/d6e/d88/l8a 6863031 1 2024-03-18T14:43:15.248 INFO:tasks.workunit.client.1.smithi129.stdout:1/166: symlink d1/l2d 0 2024-03-18T14:43:15.251 INFO:tasks.workunit.client.1.smithi129.stdout:9/159: mknod d0/db/d1f/d20/d26/c31 0 2024-03-18T14:43:15.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/381: creat d0/d1a/d80/f92 x:0 0 0 2024-03-18T14:43:15.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/180: symlink d0/dc/d18/l38 0 2024-03-18T14:43:15.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/469: truncate db/d18/d1e/f54 4386560 0 2024-03-18T14:43:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:6/359: truncate d3/d1a/d29/d22/d23/f69 232061 0 2024-03-18T14:43:15.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/470: dread db/d18/d1e/f5a [0,4194304] 0 2024-03-18T14:43:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:9/471: chown db/d18/l32 14128 1 2024-03-18T14:43:15.259 INFO:tasks.workunit.client.0.smithi087.stdout:2/363: truncate d2/d4/f15 6681397 0 2024-03-18T14:43:15.260 INFO:tasks.workunit.client.1.smithi129.stdout:0/226: rmdir d0/d14/d28 39 2024-03-18T14:43:15.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/472: fdatasync db/d18/f2a 0 2024-03-18T14:43:15.262 INFO:tasks.workunit.client.0.smithi087.stdout:7/460: link d1/d6/da/d42/f4a d1/d6/d16/fa3 0 2024-03-18T14:43:15.262 INFO:tasks.workunit.client.0.smithi087.stdout:1/427: dwrite d3/d1d/d1f/f75 [0,4194304] 0 2024-03-18T14:43:15.263 INFO:tasks.workunit.client.1.smithi129.stdout:7/162: rename d4/d7/l21 to d4/d7/d8/l35 0 2024-03-18T14:43:15.263 INFO:tasks.workunit.client.1.smithi129.stdout:9/160: rename d0/db/d2e to d0/db/d2e/d32 22 2024-03-18T14:43:15.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/461: chown d1/d6/d29/d2f/d68/d65/d60 779291 1 2024-03-18T14:43:15.263 INFO:tasks.workunit.client.0.smithi087.stdout:8/395: rename d1/d6/c80 to d1/c82 0 2024-03-18T14:43:15.264 INFO:tasks.workunit.client.1.smithi129.stdout:7/163: write d4/f16 [1717200,105568] 0 2024-03-18T14:43:15.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/161: readlink d0/db/d11/l14 0 2024-03-18T14:43:15.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/162: readlink d0/db/d11/l14 0 2024-03-18T14:43:15.264 INFO:tasks.workunit.client.0.smithi087.stdout:8/396: chown d1/d6/d2f/d44/c55 464190123 1 2024-03-18T14:43:15.267 INFO:tasks.workunit.client.1.smithi129.stdout:1/167: creat d1/f2e x:0 0 0 2024-03-18T14:43:15.268 INFO:tasks.workunit.client.1.smithi129.stdout:7/164: dwrite d4/f6 [4194304,4194304] 0 2024-03-18T14:43:15.268 INFO:tasks.workunit.client.1.smithi129.stdout:1/168: rename d1/d18/d19 to d1/d18/d19/d2f 22 2024-03-18T14:43:15.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/169: fdatasync d1/f9 0 2024-03-18T14:43:15.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/170: chown d1/d2/d28 7107033 1 2024-03-18T14:43:15.269 INFO:tasks.workunit.client.1.smithi129.stdout:9/163: read d0/f8 [979918,53883] 0 2024-03-18T14:43:15.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/364: rmdir d2/d4/d22/d2c 39 2024-03-18T14:43:15.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/365: chown d2/d44/l6d 19573735 1 2024-03-18T14:43:15.272 INFO:tasks.workunit.client.1.smithi129.stdout:8/198: chown d9/f1f 339827 1 2024-03-18T14:43:15.272 INFO:tasks.workunit.client.1.smithi129.stdout:8/199: fsync d9/d11/d1a/f3e 0 2024-03-18T14:43:15.273 INFO:tasks.workunit.client.1.smithi129.stdout:4/160: write d0/d19/f2b [1244192,59812] 0 2024-03-18T14:43:15.276 INFO:tasks.workunit.client.1.smithi129.stdout:7/165: mkdir d4/d36 0 2024-03-18T14:43:15.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/428: unlink d3/d1d/d1f/l3b 0 2024-03-18T14:43:15.277 INFO:tasks.workunit.client.1.smithi129.stdout:1/171: creat d1/d18/f30 x:0 0 0 2024-03-18T14:43:15.278 INFO:tasks.workunit.client.1.smithi129.stdout:9/164: chown d0/db/d1f/d20/d26/d19/d29/f2d 50 1 2024-03-18T14:43:15.278 INFO:tasks.workunit.client.0.smithi087.stdout:0/382: unlink d0/d1a/d7b/d26/d79/f36 0 2024-03-18T14:43:15.280 INFO:tasks.workunit.client.1.smithi129.stdout:7/166: symlink d4/d7/l37 0 2024-03-18T14:43:15.281 INFO:tasks.workunit.client.0.smithi087.stdout:8/397: mkdir d1/d6/d2f/d44/d45/d72/d7f/d83 0 2024-03-18T14:43:15.282 INFO:tasks.workunit.client.0.smithi087.stdout:7/462: dwrite d1/d6/da/d42/d61/fa2 [4194304,4194304] 0 2024-03-18T14:43:15.282 INFO:tasks.workunit.client.1.smithi129.stdout:1/172: rename d1/d18/d19/l23 to d1/d2/l31 0 2024-03-18T14:43:15.282 INFO:tasks.workunit.client.1.smithi129.stdout:9/165: fsync d0/f8 0 2024-03-18T14:43:15.283 INFO:tasks.workunit.client.1.smithi129.stdout:8/200: mkdir d9/d11/d1a/d32/d41 0 2024-03-18T14:43:15.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/429: dread d3/d1d/d1f/f75 [0,4194304] 0 2024-03-18T14:43:15.283 INFO:tasks.workunit.client.0.smithi087.stdout:4/351: rename d2/f9 to d2/db/d67/f6a 0 2024-03-18T14:43:15.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/398: write d1/d6/d2f/d44/d45/d50/f66 [4239338,29747] 0 2024-03-18T14:43:15.286 INFO:tasks.workunit.client.0.smithi087.stdout:8/399: fsync d1/d6/d2f/f41 0 2024-03-18T14:43:15.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/360: creat d3/d1a/d29/d22/f7a x:0 0 0 2024-03-18T14:43:15.286 INFO:tasks.workunit.client.0.smithi087.stdout:6/361: stat d3/d7/f44 0 2024-03-18T14:43:15.288 INFO:tasks.workunit.client.0.smithi087.stdout:7/463: dwrite d1/d6/da/d42/d61/d74/f8d [0,4194304] 0 2024-03-18T14:43:15.290 INFO:tasks.workunit.client.0.smithi087.stdout:1/430: read d3/f4e [81828,22595] 0 2024-03-18T14:43:15.293 INFO:tasks.workunit.client.0.smithi087.stdout:9/473: getdents db/d18 0 2024-03-18T14:43:15.294 INFO:tasks.workunit.client.0.smithi087.stdout:7/464: symlink d1/la4 0 2024-03-18T14:43:15.295 INFO:tasks.workunit.client.0.smithi087.stdout:7/465: write d1/d6/da/ff [319498,97944] 0 2024-03-18T14:43:15.302 INFO:tasks.workunit.client.1.smithi129.stdout:5/181: dread d0/f6 [0,4194304] 0 2024-03-18T14:43:15.304 INFO:tasks.workunit.client.1.smithi129.stdout:6/195: write d3/d30/de/f22 [2818673,60714] 0 2024-03-18T14:43:15.304 INFO:tasks.workunit.client.1.smithi129.stdout:0/227: dread d0/d23/f3f [4194304,4194304] 0 2024-03-18T14:43:15.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/421: truncate d0/d1c/f2b 1580852 0 2024-03-18T14:43:15.308 INFO:tasks.workunit.client.1.smithi129.stdout:1/173: dwrite d1/f2e [0,4194304] 0 2024-03-18T14:43:15.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/416: rename d13/d1b/d27/d28/d79 to d13/d1b/d27/d8f 0 2024-03-18T14:43:15.310 INFO:tasks.workunit.client.1.smithi129.stdout:9/166: fdatasync d0/db/d1f/d20/d26/d19/f21 0 2024-03-18T14:43:15.310 INFO:tasks.workunit.client.0.smithi087.stdout:1/431: getdents d3/d1d/d6e 0 2024-03-18T14:43:15.311 INFO:tasks.workunit.client.1.smithi129.stdout:5/182: creat d0/dc/d22/f39 x:0 0 0 2024-03-18T14:43:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:7/466: mknod d1/d6/d29/d2f/d68/d65/ca5 0 2024-03-18T14:43:15.312 INFO:tasks.workunit.client.0.smithi087.stdout:1/432: write d3/d1d/d1e/d20/d7a/f83 [996258,53041] 0 2024-03-18T14:43:15.312 INFO:tasks.workunit.client.1.smithi129.stdout:0/228: dread d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:15.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/433: dread - d3/d1d/d1f/f70 zero size 2024-03-18T14:43:15.313 INFO:tasks.workunit.client.1.smithi129.stdout:3/164: dread d4/fa [0,4194304] 0 2024-03-18T14:43:15.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/229: chown d0/d23/d29/f38 109 1 2024-03-18T14:43:15.313 INFO:tasks.workunit.client.0.smithi087.stdout:1/434: chown d3/d1d/d1e/f36 98 1 2024-03-18T14:43:15.314 INFO:tasks.workunit.client.1.smithi129.stdout:1/174: symlink d1/d18/d19/l32 0 2024-03-18T14:43:15.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/422: mkdir d0/de/d30/d46/d76 0 2024-03-18T14:43:15.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/366: rename d2/d4/d22/f50 to d2/d4/d22/d2c/d3a/d68/f6f 0 2024-03-18T14:43:15.317 INFO:tasks.workunit.client.0.smithi087.stdout:9/474: truncate db/d18/d1e/d28/f70 319889 0 2024-03-18T14:43:15.319 INFO:tasks.workunit.client.0.smithi087.stdout:0/383: dread d0/d1a/d80/d88/f2b [0,4194304] 0 2024-03-18T14:43:15.320 INFO:tasks.workunit.client.1.smithi129.stdout:9/167: mkdir d0/db/d1f/d33 0 2024-03-18T14:43:15.320 INFO:tasks.workunit.client.1.smithi129.stdout:9/168: dread - d0/f1b zero size 2024-03-18T14:43:15.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/367: symlink d2/d44/l70 0 2024-03-18T14:43:15.323 INFO:tasks.workunit.client.0.smithi087.stdout:9/475: dwrite db/d12/f5e [0,4194304] 0 2024-03-18T14:43:15.323 INFO:tasks.workunit.client.1.smithi129.stdout:6/196: link d3/d6/f18 d3/f41 0 2024-03-18T14:43:15.323 INFO:tasks.workunit.client.1.smithi129.stdout:6/197: dread - d3/d30/f1e zero size 2024-03-18T14:43:15.324 INFO:tasks.workunit.client.0.smithi087.stdout:3/423: symlink d0/de/d30/d67/l77 0 2024-03-18T14:43:15.324 INFO:tasks.workunit.client.0.smithi087.stdout:3/424: chown d0/l8 28 1 2024-03-18T14:43:15.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/164: truncate f5 2418195 0 2024-03-18T14:43:15.325 INFO:tasks.workunit.client.0.smithi087.stdout:0/384: creat d0/d49/f93 x:0 0 0 2024-03-18T14:43:15.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/368: symlink d2/d4/d22/d2c/d3a/d68/l71 0 2024-03-18T14:43:15.327 INFO:tasks.workunit.client.0.smithi087.stdout:9/476: mkdir db/d18/d1e/d28/d76/d80/d91 0 2024-03-18T14:43:15.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/435: truncate d3/d1d/d1e/d20/f52 19513 0 2024-03-18T14:43:15.328 INFO:tasks.workunit.client.0.smithi087.stdout:3/425: creat d0/d3/d40/f78 x:0 0 0 2024-03-18T14:43:15.331 INFO:tasks.workunit.client.0.smithi087.stdout:0/385: creat d0/d2/d6b/f94 x:0 0 0 2024-03-18T14:43:15.331 INFO:tasks.workunit.client.1.smithi129.stdout:1/175: creat d1/d2/f33 x:0 0 0 2024-03-18T14:43:15.332 INFO:tasks.workunit.client.0.smithi087.stdout:9/477: dwrite db/d18/d1e/d28/d7c/f7d [0,4194304] 0 2024-03-18T14:43:15.332 INFO:tasks.workunit.client.0.smithi087.stdout:0/386: chown d0/d2/d4/d27/c43 18851051 1 2024-03-18T14:43:15.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/478: write db/d18/f2a [2171999,94997] 0 2024-03-18T14:43:15.334 INFO:tasks.workunit.client.1.smithi129.stdout:6/198: creat d3/d30/df/f42 x:0 0 0 2024-03-18T14:43:15.334 INFO:tasks.workunit.client.1.smithi129.stdout:5/183: dread d0/fb [0,4194304] 0 2024-03-18T14:43:15.334 INFO:tasks.workunit.client.0.smithi087.stdout:9/479: dread - db/d31/f8a zero size 2024-03-18T14:43:15.335 INFO:tasks.workunit.client.1.smithi129.stdout:3/165: dread d4/dd/d15/d16/f1c [0,4194304] 0 2024-03-18T14:43:15.335 INFO:tasks.workunit.client.1.smithi129.stdout:7/167: truncate d4/f16 664812 0 2024-03-18T14:43:15.335 INFO:tasks.workunit.client.0.smithi087.stdout:2/369: mkdir d2/d44/d72 0 2024-03-18T14:43:15.337 INFO:tasks.workunit.client.1.smithi129.stdout:7/168: write d4/fd [843706,128370] 0 2024-03-18T14:43:15.337 INFO:tasks.workunit.client.0.smithi087.stdout:6/362: write d3/d1a/d29/d22/f5d [1455000,103829] 0 2024-03-18T14:43:15.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/426: rename d0/d3/d40/f56 to d0/de/d30/d67/f79 0 2024-03-18T14:43:15.340 INFO:tasks.workunit.client.1.smithi129.stdout:8/201: dwrite f6 [0,4194304] 0 2024-03-18T14:43:15.340 INFO:tasks.workunit.client.0.smithi087.stdout:3/427: readlink d0/d3/l2e 0 2024-03-18T14:43:15.341 INFO:tasks.workunit.client.1.smithi129.stdout:3/166: dwrite d4/dd/d1f/f26 [0,4194304] 0 2024-03-18T14:43:15.342 INFO:tasks.workunit.client.0.smithi087.stdout:6/363: dwrite d3/d1a/d29/d22/f7a [0,4194304] 0 2024-03-18T14:43:15.343 INFO:tasks.workunit.client.0.smithi087.stdout:1/436: rename d3/d1d/d1e/d43/d50/d72/f82 to d3/d1d/d1e/d43/d50/d72/f86 0 2024-03-18T14:43:15.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/387: creat d0/d1a/d80/f95 x:0 0 0 2024-03-18T14:43:15.344 INFO:tasks.workunit.client.1.smithi129.stdout:0/230: unlink d0/d23/d29/c40 0 2024-03-18T14:43:15.344 INFO:tasks.workunit.client.0.smithi087.stdout:8/400: truncate d1/d6/d14/f5c 156467 0 2024-03-18T14:43:15.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/437: stat d3/d1d/d1f/d34/f76 0 2024-03-18T14:43:15.345 INFO:tasks.workunit.client.1.smithi129.stdout:9/169: symlink d0/db/l34 0 2024-03-18T14:43:15.346 INFO:tasks.workunit.client.0.smithi087.stdout:0/388: write d0/d1a/d7b/d2a/f68 [5115298,61901] 0 2024-03-18T14:43:15.346 INFO:tasks.workunit.client.0.smithi087.stdout:8/401: fsync d1/d6/d14/f27 0 2024-03-18T14:43:15.347 INFO:tasks.workunit.client.0.smithi087.stdout:1/438: write d3/f7 [1481701,60331] 0 2024-03-18T14:43:15.347 INFO:tasks.workunit.client.1.smithi129.stdout:9/170: readlink d0/db/d11/l28 0 2024-03-18T14:43:15.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/176: creat d1/d2/f34 x:0 0 0 2024-03-18T14:43:15.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/167: dwrite d4/dd/d1f/f26 [0,4194304] 0 2024-03-18T14:43:15.348 INFO:tasks.workunit.client.1.smithi129.stdout:3/168: readlink d4/dd/l10 0 2024-03-18T14:43:15.348 INFO:tasks.workunit.client.1.smithi129.stdout:6/199: mknod d3/d30/c43 0 2024-03-18T14:43:15.350 INFO:tasks.workunit.client.1.smithi129.stdout:5/184: chown d0/dc/c2d 2850833 1 2024-03-18T14:43:15.350 INFO:tasks.workunit.client.1.smithi129.stdout:4/161: sync 2024-03-18T14:43:15.355 INFO:tasks.workunit.client.0.smithi087.stdout:5/417: truncate d13/d1b/d27/d28/f78 5005288 0 2024-03-18T14:43:15.355 INFO:tasks.workunit.client.1.smithi129.stdout:7/169: mkdir d4/d7/d38 0 2024-03-18T14:43:15.356 INFO:tasks.workunit.client.0.smithi087.stdout:7/467: truncate d1/d6/d29/d2f/d68/d65/d60/f64 3738521 0 2024-03-18T14:43:15.362 INFO:tasks.workunit.client.1.smithi129.stdout:1/177: chown l0 506 1 2024-03-18T14:43:15.363 INFO:tasks.workunit.client.1.smithi129.stdout:1/178: write d1/d2/f33 [590221,22506] 0 2024-03-18T14:43:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/352: rename d2/db/d3c/c3d to d2/db/d3c/c6b 0 2024-03-18T14:43:15.363 INFO:tasks.workunit.client.0.smithi087.stdout:7/468: read d1/f31 [2103538,12218] 0 2024-03-18T14:43:15.364 INFO:tasks.workunit.client.0.smithi087.stdout:7/469: fdatasync d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f91 0 2024-03-18T14:43:15.364 INFO:tasks.workunit.client.1.smithi129.stdout:9/171: rename d0/f16 to d0/f35 0 2024-03-18T14:43:15.365 INFO:tasks.workunit.client.1.smithi129.stdout:3/169: mkdir d4/d11/d34 0 2024-03-18T14:43:15.365 INFO:tasks.workunit.client.1.smithi129.stdout:9/172: stat d0/db/d1f/d20/d26/d19/d29 0 2024-03-18T14:43:15.366 INFO:tasks.workunit.client.0.smithi087.stdout:7/470: write d1/d6/d29/d2f/d68/d65/d60/f94 [1819630,68985] 0 2024-03-18T14:43:15.366 INFO:tasks.workunit.client.0.smithi087.stdout:2/370: dread d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:15.366 INFO:tasks.workunit.client.0.smithi087.stdout:3/428: rmdir d0/d3/df/d42 39 2024-03-18T14:43:15.367 INFO:tasks.workunit.client.1.smithi129.stdout:6/200: mkdir d3/d30/d44 0 2024-03-18T14:43:15.367 INFO:tasks.workunit.client.1.smithi129.stdout:9/173: chown d0/db/d1f/l2f 50319600 1 2024-03-18T14:43:15.367 INFO:tasks.workunit.client.1.smithi129.stdout:5/185: fsync d0/f6 0 2024-03-18T14:43:15.367 INFO:tasks.workunit.client.1.smithi129.stdout:6/201: dread - d3/d5/f34 zero size 2024-03-18T14:43:15.368 INFO:tasks.workunit.client.1.smithi129.stdout:1/179: dwrite d1/d18/f21 [0,4194304] 0 2024-03-18T14:43:15.368 INFO:tasks.workunit.client.1.smithi129.stdout:2/165: truncate d7/f1e 951797 0 2024-03-18T14:43:15.369 INFO:tasks.workunit.client.1.smithi129.stdout:9/174: stat d0/db/d1f/d20/d26/d19/l22 0 2024-03-18T14:43:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:2/371: mknod d2/c73 0 2024-03-18T14:43:15.370 INFO:tasks.workunit.client.1.smithi129.stdout:2/166: write d7/f1d [312380,108112] 0 2024-03-18T14:43:15.370 INFO:tasks.workunit.client.0.smithi087.stdout:2/372: chown d2/f1d 1 1 2024-03-18T14:43:15.372 INFO:tasks.workunit.client.0.smithi087.stdout:0/389: truncate d0/d2/d3c/f58 64548 0 2024-03-18T14:43:15.374 INFO:tasks.workunit.client.0.smithi087.stdout:3/429: mkdir d0/d3/d7a 0 2024-03-18T14:43:15.375 INFO:tasks.workunit.client.1.smithi129.stdout:3/170: stat d4/dd/c14 0 2024-03-18T14:43:15.375 INFO:tasks.workunit.client.1.smithi129.stdout:6/202: dread d3/d30/de/f35 [0,4194304] 0 2024-03-18T14:43:15.376 INFO:tasks.workunit.client.1.smithi129.stdout:5/186: mkdir d0/d32/d3a 0 2024-03-18T14:43:15.378 INFO:tasks.workunit.client.1.smithi129.stdout:4/162: rename d0/d19/d2d to d0/d19/d1d/d2e 0 2024-03-18T14:43:15.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/180: mkdir d1/d35 0 2024-03-18T14:43:15.380 INFO:tasks.workunit.client.1.smithi129.stdout:6/203: dwrite d3/d30/f20 [0,4194304] 0 2024-03-18T14:43:15.386 INFO:tasks.workunit.client.0.smithi087.stdout:8/402: getdents d1/d6/d9/d5d 0 2024-03-18T14:43:15.387 INFO:tasks.workunit.client.0.smithi087.stdout:8/403: chown d1/d6/d2f/d44/d45/c6b 65536 1 2024-03-18T14:43:15.390 INFO:tasks.workunit.client.0.smithi087.stdout:3/430: creat d0/d1c/d25/f7b x:0 0 0 2024-03-18T14:43:15.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/231: dwrite d0/f1e [4194304,4194304] 0 2024-03-18T14:43:15.392 INFO:tasks.workunit.client.0.smithi087.stdout:2/373: unlink d2/d4/d22/c3c 0 2024-03-18T14:43:15.396 INFO:tasks.workunit.client.1.smithi129.stdout:8/202: getdents d9 0 2024-03-18T14:43:15.398 INFO:tasks.workunit.client.1.smithi129.stdout:9/175: rename d0/db/d1f/d20/d25/d2b to d0/db/d1f/d20/d26/d19/d29/d36 0 2024-03-18T14:43:15.400 INFO:tasks.workunit.client.0.smithi087.stdout:9/480: rename db/d18/d1e/d28/f70 to db/d18/d1c/d69/f92 0 2024-03-18T14:43:15.401 INFO:tasks.workunit.client.0.smithi087.stdout:4/353: rename d2/ca to d2/c6c 0 2024-03-18T14:43:15.401 INFO:tasks.workunit.client.1.smithi129.stdout:1/181: creat d1/d18/f36 x:0 0 0 2024-03-18T14:43:15.404 INFO:tasks.workunit.client.0.smithi087.stdout:3/431: creat d0/de/d30/f7c x:0 0 0 2024-03-18T14:43:15.405 INFO:tasks.workunit.client.1.smithi129.stdout:6/204: symlink d3/d6/l45 0 2024-03-18T14:43:15.409 INFO:tasks.workunit.client.1.smithi129.stdout:5/187: creat d0/d32/d34/f3b x:0 0 0 2024-03-18T14:43:15.409 INFO:tasks.workunit.client.0.smithi087.stdout:3/432: dread d0/d1c/f5b [0,4194304] 0 2024-03-18T14:43:15.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/418: truncate f12 1529505 0 2024-03-18T14:43:15.411 INFO:tasks.workunit.client.1.smithi129.stdout:8/203: unlink d9/d11/f16 0 2024-03-18T14:43:15.411 INFO:tasks.workunit.client.1.smithi129.stdout:9/176: fsync d0/db/d11/f1a 0 2024-03-18T14:43:15.413 INFO:tasks.workunit.client.0.smithi087.stdout:7/471: truncate d1/d6/d29/d2f/d68/d65/d60/f94 534851 0 2024-03-18T14:43:15.414 INFO:tasks.workunit.client.1.smithi129.stdout:1/182: creat d1/d18/d19/f37 x:0 0 0 2024-03-18T14:43:15.414 INFO:tasks.workunit.client.0.smithi087.stdout:9/481: dread db/d18/f2c [0,4194304] 0 2024-03-18T14:43:15.414 INFO:tasks.workunit.client.0.smithi087.stdout:7/472: dread - d1/d6/d29/f79 zero size 2024-03-18T14:43:15.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/364: rename d3/d1a/f34 to d3/d7/d25/f7b 0 2024-03-18T14:43:15.416 INFO:tasks.workunit.client.0.smithi087.stdout:6/365: write d3/d7/f44 [4908412,97742] 0 2024-03-18T14:43:15.419 INFO:tasks.workunit.client.1.smithi129.stdout:7/170: write d4/d7/d8/f22 [477751,61033] 0 2024-03-18T14:43:15.419 INFO:tasks.workunit.client.1.smithi129.stdout:7/171: chown d4/c23 2349 1 2024-03-18T14:43:15.421 INFO:tasks.workunit.client.0.smithi087.stdout:7/473: dwrite d1/d6/d29/f79 [0,4194304] 0 2024-03-18T14:43:15.421 INFO:tasks.workunit.client.1.smithi129.stdout:6/205: rmdir d3/d30/df/d28 39 2024-03-18T14:43:15.422 INFO:tasks.workunit.client.0.smithi087.stdout:7/474: chown d1/d6/da/d42/d61/d74 201549 1 2024-03-18T14:43:15.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/374: dread d2/f2f [0,4194304] 0 2024-03-18T14:43:15.426 INFO:tasks.workunit.client.1.smithi129.stdout:6/206: dwrite d3/d5/f27 [4194304,4194304] 0 2024-03-18T14:43:15.426 INFO:tasks.workunit.client.1.smithi129.stdout:0/232: mknod d0/c47 0 2024-03-18T14:43:15.427 INFO:tasks.workunit.client.0.smithi087.stdout:5/419: dwrite d13/f16 [0,4194304] 0 2024-03-18T14:43:15.427 INFO:tasks.workunit.client.1.smithi129.stdout:3/171: truncate d4/dd/f32 1002547 0 2024-03-18T14:43:15.429 INFO:tasks.workunit.client.1.smithi129.stdout:4/163: link d0/d9/c10 d0/d19/d1d/c2f 0 2024-03-18T14:43:15.430 INFO:tasks.workunit.client.0.smithi087.stdout:1/439: rename d3/d1d/d1f/l64 to d3/d1d/d1e/d43/d50/l87 0 2024-03-18T14:43:15.432 INFO:tasks.workunit.client.1.smithi129.stdout:0/233: stat d0/d14/c16 0 2024-03-18T14:43:15.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/433: dread d0/d3/f29 [0,4194304] 0 2024-03-18T14:43:15.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/434: fdatasync d0/d3/fd 0 2024-03-18T14:43:15.435 INFO:tasks.workunit.client.1.smithi129.stdout:2/167: getdents d7/d1f 0 2024-03-18T14:43:15.437 INFO:tasks.workunit.client.1.smithi129.stdout:9/177: mkdir d0/db/d2e/d37 0 2024-03-18T14:43:15.440 INFO:tasks.workunit.client.1.smithi129.stdout:7/172: dread d4/d2d/f2a [0,4194304] 0 2024-03-18T14:43:15.440 INFO:tasks.workunit.client.1.smithi129.stdout:6/207: mkdir d3/d5/d46 0 2024-03-18T14:43:15.441 INFO:tasks.workunit.client.0.smithi087.stdout:5/420: symlink d13/d1b/d30/l90 0 2024-03-18T14:43:15.441 INFO:tasks.workunit.client.1.smithi129.stdout:7/173: write d4/d7/f31 [1746680,115000] 0 2024-03-18T14:43:15.443 INFO:tasks.workunit.client.1.smithi129.stdout:4/164: symlink d0/l30 0 2024-03-18T14:43:15.444 INFO:tasks.workunit.client.1.smithi129.stdout:1/183: link d1/d2/c10 d1/d35/c38 0 2024-03-18T14:43:15.444 INFO:tasks.workunit.client.1.smithi129.stdout:4/165: write d0/d9/f20 [2258090,20786] 0 2024-03-18T14:43:15.445 INFO:tasks.workunit.client.1.smithi129.stdout:4/166: dread d0/d19/d1d/f22 [0,4194304] 0 2024-03-18T14:43:15.447 INFO:tasks.workunit.client.0.smithi087.stdout:5/421: read d13/d1b/d27/f7b [3343459,109594] 0 2024-03-18T14:43:15.447 INFO:tasks.workunit.client.0.smithi087.stdout:0/390: rename d0/d1a/d34/d3d/f3e to d0/d2/d4/d19/d24/f96 0 2024-03-18T14:43:15.448 INFO:tasks.workunit.client.0.smithi087.stdout:1/440: write d3/d1d/d1f/f7d [172908,59220] 0 2024-03-18T14:43:15.448 INFO:tasks.workunit.client.1.smithi129.stdout:4/167: dread d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:15.448 INFO:tasks.workunit.client.1.smithi129.stdout:0/234: unlink d0/f11 0 2024-03-18T14:43:15.448 INFO:tasks.workunit.client.1.smithi129.stdout:4/168: fsync d0/d1a/f25 0 2024-03-18T14:43:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:4/354: dread d2/d13/d28/f2d [4194304,4194304] 0 2024-03-18T14:43:15.451 INFO:tasks.workunit.client.0.smithi087.stdout:7/475: mkdir d1/d6/d16/da6 0 2024-03-18T14:43:15.452 INFO:tasks.workunit.client.0.smithi087.stdout:7/476: write d1/d6/d29/f49 [287355,89077] 0 2024-03-18T14:43:15.454 INFO:tasks.workunit.client.1.smithi129.stdout:7/174: rename d4/d7/l1e to d4/d7/l39 0 2024-03-18T14:43:15.454 INFO:tasks.workunit.client.0.smithi087.stdout:6/366: fsync d3/d1a/d29/d22/d23/f33 0 2024-03-18T14:43:15.455 INFO:tasks.workunit.client.1.smithi129.stdout:5/188: dwrite d0/f6 [0,4194304] 0 2024-03-18T14:43:15.455 INFO:tasks.workunit.client.0.smithi087.stdout:2/375: dwrite d2/f1e [0,4194304] 0 2024-03-18T14:43:15.456 INFO:tasks.workunit.client.1.smithi129.stdout:5/189: readlink d0/dc/d18/l38 0 2024-03-18T14:43:15.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/482: truncate db/d18/d1e/d28/d7c/f7d 977334 0 2024-03-18T14:43:15.458 INFO:tasks.workunit.client.1.smithi129.stdout:3/172: dwrite d4/fb [0,4194304] 0 2024-03-18T14:43:15.458 INFO:tasks.workunit.client.1.smithi129.stdout:2/168: truncate d7/dd/f15 1130595 0 2024-03-18T14:43:15.459 INFO:tasks.workunit.client.1.smithi129.stdout:2/169: dread - d7/d1f/d20/d2d/f2e zero size 2024-03-18T14:43:15.460 INFO:tasks.workunit.client.1.smithi129.stdout:1/184: symlink d1/d18/l39 0 2024-03-18T14:43:15.462 INFO:tasks.workunit.client.1.smithi129.stdout:9/178: write d0/f4 [1343992,184] 0 2024-03-18T14:43:15.464 INFO:tasks.workunit.client.0.smithi087.stdout:8/404: rename d1/d6/d2f/d44/l4f to d1/d6/d2f/d44/d45/d71/l84 0 2024-03-18T14:43:15.465 INFO:tasks.workunit.client.0.smithi087.stdout:0/391: mknod d0/d1a/d34/c97 0 2024-03-18T14:43:15.466 INFO:tasks.workunit.client.1.smithi129.stdout:7/175: chown d4/f16 99902 1 2024-03-18T14:43:15.466 INFO:tasks.workunit.client.0.smithi087.stdout:5/422: mknod d13/d1b/d30/d6e/d88/c91 0 2024-03-18T14:43:15.468 INFO:tasks.workunit.client.0.smithi087.stdout:1/441: creat d3/d1d/d67/f88 x:0 0 0 2024-03-18T14:43:15.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/405: dwrite d1/d6/d2f/d44/d45/d50/d58/f76 [0,4194304] 0 2024-03-18T14:43:15.469 INFO:tasks.workunit.client.1.smithi129.stdout:5/190: rename d0/dc/f20 to d0/df/f3c 0 2024-03-18T14:43:15.469 INFO:tasks.workunit.client.1.smithi129.stdout:5/191: chown d0/d32 44315044 1 2024-03-18T14:43:15.470 INFO:tasks.workunit.client.1.smithi129.stdout:8/204: sync 2024-03-18T14:43:15.470 INFO:tasks.workunit.client.1.smithi129.stdout:2/170: symlink d7/d1c/l33 0 2024-03-18T14:43:15.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/423: dwrite d13/d1b/d30/f5d [0,4194304] 0 2024-03-18T14:43:15.474 INFO:tasks.workunit.client.1.smithi129.stdout:9/179: truncate d0/db/d1f/d20/d26/d19/f21 494780 0 2024-03-18T14:43:15.474 INFO:tasks.workunit.client.1.smithi129.stdout:9/180: readlink d0/db/l34 0 2024-03-18T14:43:15.474 INFO:tasks.workunit.client.0.smithi087.stdout:1/442: dread d3/d1d/d1e/f36 [0,4194304] 0 2024-03-18T14:43:15.474 INFO:tasks.workunit.client.0.smithi087.stdout:5/424: fdatasync d13/d1b/d7e/f8e 0 2024-03-18T14:43:15.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/355: symlink d2/db/de/l6d 0 2024-03-18T14:43:15.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/356: stat d2/db/f20 0 2024-03-18T14:43:15.479 INFO:tasks.workunit.client.1.smithi129.stdout:7/176: rmdir d4 39 2024-03-18T14:43:15.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/192: mknod d0/d32/d34/c3d 0 2024-03-18T14:43:15.481 INFO:tasks.workunit.client.1.smithi129.stdout:5/193: read d0/f9 [165596,26930] 0 2024-03-18T14:43:15.485 INFO:tasks.workunit.client.0.smithi087.stdout:5/425: rmdir d13/d1b/d27/d35 39 2024-03-18T14:43:15.488 INFO:tasks.workunit.client.1.smithi129.stdout:8/205: symlink d9/d11/d18/l42 0 2024-03-18T14:43:15.490 INFO:tasks.workunit.client.0.smithi087.stdout:3/435: rename d0/de/d30/f66 to d0/d3/df/f7d 0 2024-03-18T14:43:15.491 INFO:tasks.workunit.client.0.smithi087.stdout:3/436: chown d0/d3 30903 1 2024-03-18T14:43:15.493 INFO:tasks.workunit.client.0.smithi087.stdout:1/443: symlink d3/d1d/d1f/l89 0 2024-03-18T14:43:15.494 INFO:tasks.workunit.client.1.smithi129.stdout:9/181: write d0/f35 [990252,85680] 0 2024-03-18T14:43:15.495 INFO:tasks.workunit.client.0.smithi087.stdout:8/406: creat d1/d6/f85 x:0 0 0 2024-03-18T14:43:15.495 INFO:tasks.workunit.client.1.smithi129.stdout:5/194: mkdir d0/dc/d1a/d3e 0 2024-03-18T14:43:15.497 INFO:tasks.workunit.client.0.smithi087.stdout:5/426: creat d13/d1b/d7e/f92 x:0 0 0 2024-03-18T14:43:15.497 INFO:tasks.workunit.client.1.smithi129.stdout:3/173: fdatasync d4/dd/f32 0 2024-03-18T14:43:15.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/477: link d1/d6/d16/dc/l2c d1/d8e/la7 0 2024-03-18T14:43:15.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/478: chown d1/d8e 80007471 1 2024-03-18T14:43:15.498 INFO:tasks.workunit.client.1.smithi129.stdout:4/169: getdents d0/d19/d1d 0 2024-03-18T14:43:15.499 INFO:tasks.workunit.client.0.smithi087.stdout:7/479: chown d1/d6/d29/d2f/d68/d65/l6d 0 1 2024-03-18T14:43:15.499 INFO:tasks.workunit.client.1.smithi129.stdout:7/177: mkdir d4/d2d/d3a 0 2024-03-18T14:43:15.500 INFO:tasks.workunit.client.1.smithi129.stdout:0/235: truncate d0/d14/d28/f3d 2063361 0 2024-03-18T14:43:15.501 INFO:tasks.workunit.client.1.smithi129.stdout:7/178: readlink d4/d7/l1a 0 2024-03-18T14:43:15.501 INFO:tasks.workunit.client.0.smithi087.stdout:6/367: rename d3/d1a to d3/d7/d25/d62/d7c 0 2024-03-18T14:43:15.501 INFO:tasks.workunit.client.1.smithi129.stdout:1/185: getdents d1/d2/d28 0 2024-03-18T14:43:15.502 INFO:tasks.workunit.client.1.smithi129.stdout:2/171: dread f5 [0,4194304] 0 2024-03-18T14:43:15.502 INFO:tasks.workunit.client.1.smithi129.stdout:9/182: dwrite d0/f1e [0,4194304] 0 2024-03-18T14:43:15.503 INFO:tasks.workunit.client.0.smithi087.stdout:7/480: dwrite d1/d6/d29/f34 [0,4194304] 0 2024-03-18T14:43:15.503 INFO:tasks.workunit.client.1.smithi129.stdout:1/186: fdatasync d1/d2/f34 0 2024-03-18T14:43:15.504 INFO:tasks.workunit.client.0.smithi087.stdout:7/481: chown d1/d6/da/d42/d61/l78 65519 1 2024-03-18T14:43:15.504 INFO:tasks.workunit.client.1.smithi129.stdout:9/183: write d0/f10 [438155,54605] 0 2024-03-18T14:43:15.504 INFO:tasks.workunit.client.1.smithi129.stdout:8/206: dread f4 [0,4194304] 0 2024-03-18T14:43:15.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/483: link db/d18/d1e/f54 db/d18/d1c/f93 0 2024-03-18T14:43:15.506 INFO:tasks.workunit.client.1.smithi129.stdout:8/207: chown f6 771 1 2024-03-18T14:43:15.507 INFO:tasks.workunit.client.0.smithi087.stdout:4/357: truncate d2/db/d67/f6a 4909529 0 2024-03-18T14:43:15.507 INFO:tasks.workunit.client.0.smithi087.stdout:3/437: dread d0/f37 [0,4194304] 0 2024-03-18T14:43:15.508 INFO:tasks.workunit.client.0.smithi087.stdout:3/438: read d0/f37 [837293,70952] 0 2024-03-18T14:43:15.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/439: dread - d0/d1c/d25/f7b zero size 2024-03-18T14:43:15.509 INFO:tasks.workunit.client.1.smithi129.stdout:3/174: dwrite d4/dd/d15/d16/f24 [0,4194304] 0 2024-03-18T14:43:15.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/368: dread d3/d7/d25/d62/d7c/d29/f5a [0,4194304] 0 2024-03-18T14:43:15.510 INFO:tasks.workunit.client.0.smithi087.stdout:5/427: symlink d13/d1b/d7e/l93 0 2024-03-18T14:43:15.510 INFO:tasks.workunit.client.1.smithi129.stdout:3/175: chown d4/l33 58622 1 2024-03-18T14:43:15.511 INFO:tasks.workunit.client.0.smithi087.stdout:5/428: write d13/f16 [2977871,110924] 0 2024-03-18T14:43:15.514 INFO:tasks.workunit.client.0.smithi087.stdout:5/429: dread d13/d1b/d27/f34 [0,4194304] 0 2024-03-18T14:43:15.515 INFO:tasks.workunit.client.1.smithi129.stdout:3/176: dwrite d4/dd/d15/d16/f2c [0,4194304] 0 2024-03-18T14:43:15.516 INFO:tasks.workunit.client.0.smithi087.stdout:2/376: rename d2/d4/d22/f4e to d2/d4/d22/d2c/f74 0 2024-03-18T14:43:15.517 INFO:tasks.workunit.client.1.smithi129.stdout:1/187: mknod d1/d18/d19/c3a 0 2024-03-18T14:43:15.518 INFO:tasks.workunit.client.1.smithi129.stdout:2/172: unlink d7/d1c/f28 0 2024-03-18T14:43:15.518 INFO:tasks.workunit.client.1.smithi129.stdout:5/195: getdents d0/dc/d18/d2b 0 2024-03-18T14:43:15.518 INFO:tasks.workunit.client.1.smithi129.stdout:1/188: fsync d1/f1d 0 2024-03-18T14:43:15.519 INFO:tasks.workunit.client.1.smithi129.stdout:2/173: dread - d7/dd/f30 zero size 2024-03-18T14:43:15.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/440: symlink d0/de/d30/d67/l7e 0 2024-03-18T14:43:15.522 INFO:tasks.workunit.client.1.smithi129.stdout:5/196: dread d0/f14 [0,4194304] 0 2024-03-18T14:43:15.523 INFO:tasks.workunit.client.1.smithi129.stdout:1/189: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:15.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/170: getdents d0/d1a 0 2024-03-18T14:43:15.523 INFO:tasks.workunit.client.1.smithi129.stdout:6/208: sync 2024-03-18T14:43:15.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/171: chown d0/f13 347357 1 2024-03-18T14:43:15.525 INFO:tasks.workunit.client.1.smithi129.stdout:8/208: truncate d9/d11/d18/f3f 845130 0 2024-03-18T14:43:15.528 INFO:tasks.workunit.client.1.smithi129.stdout:4/172: dread d0/d19/f1f [0,4194304] 0 2024-03-18T14:43:15.529 INFO:tasks.workunit.client.0.smithi087.stdout:9/484: dread db/d18/d1c/f71 [0,4194304] 0 2024-03-18T14:43:15.529 INFO:tasks.workunit.client.0.smithi087.stdout:4/358: symlink d2/db/l6e 0 2024-03-18T14:43:15.529 INFO:tasks.workunit.client.1.smithi129.stdout:6/209: dwrite d3/f1a [0,4194304] 0 2024-03-18T14:43:15.529 INFO:tasks.workunit.client.1.smithi129.stdout:2/174: rename d7/dd to d7/d1f/d34 0 2024-03-18T14:43:15.531 INFO:tasks.workunit.client.1.smithi129.stdout:6/210: dread - d3/d30/df/f42 zero size 2024-03-18T14:43:15.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/209: dwrite d9/d11/d18/f24 [0,4194304] 0 2024-03-18T14:43:15.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/369: mkdir d3/d7/d25/d62/d7c/d29/d7d 0 2024-03-18T14:43:15.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/441: unlink d0/d3/d10/l47 0 2024-03-18T14:43:15.540 INFO:tasks.workunit.client.0.smithi087.stdout:7/482: truncate d1/d6/da/f25 2640446 0 2024-03-18T14:43:15.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/444: dwrite d3/d1d/d1e/d43/f46 [4194304,4194304] 0 2024-03-18T14:43:15.542 INFO:tasks.workunit.client.0.smithi087.stdout:4/359: write d2/f36 [418517,28291] 0 2024-03-18T14:43:15.542 INFO:tasks.workunit.client.0.smithi087.stdout:6/370: dread - d3/d7/d25/d62/d7c/d29/f40 zero size 2024-03-18T14:43:15.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/445: write d3/d1d/d1e/d20/d7a/f83 [1264285,31368] 0 2024-03-18T14:43:15.543 INFO:tasks.workunit.client.0.smithi087.stdout:3/442: mkdir d0/d3/d10/d7f 0 2024-03-18T14:43:15.543 INFO:tasks.workunit.client.0.smithi087.stdout:5/430: dwrite d13/f24 [0,4194304] 0 2024-03-18T14:43:15.545 INFO:tasks.workunit.client.0.smithi087.stdout:3/443: chown d0/d3/d40 0 1 2024-03-18T14:43:15.546 INFO:tasks.workunit.client.1.smithi129.stdout:3/177: truncate d4/dd/d15/d16/f24 2612754 0 2024-03-18T14:43:15.546 INFO:tasks.workunit.client.0.smithi087.stdout:0/392: rename d0/d2/d6b/f94 to d0/d2/d4/f98 0 2024-03-18T14:43:15.547 INFO:tasks.workunit.client.0.smithi087.stdout:7/483: creat d1/d6/da/d42/fa8 x:0 0 0 2024-03-18T14:43:15.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/393: chown d0/d1a/d34/c8f 45325226 1 2024-03-18T14:43:15.548 INFO:tasks.workunit.client.1.smithi129.stdout:0/236: link d0/d23/d35/d3b/c41 d0/d23/c48 0 2024-03-18T14:43:15.548 INFO:tasks.workunit.client.1.smithi129.stdout:5/197: symlink d0/dc/l3f 0 2024-03-18T14:43:15.548 INFO:tasks.workunit.client.1.smithi129.stdout:7/179: dwrite d4/d7/f25 [0,4194304] 0 2024-03-18T14:43:15.548 INFO:tasks.workunit.client.1.smithi129.stdout:6/211: truncate d3/d6/f18 1034914 0 2024-03-18T14:43:15.548 INFO:tasks.workunit.client.1.smithi129.stdout:8/210: symlink d9/d11/d18/l43 0 2024-03-18T14:43:15.550 INFO:tasks.workunit.client.1.smithi129.stdout:1/190: truncate d1/d2/f34 469002 0 2024-03-18T14:43:15.550 INFO:tasks.workunit.client.1.smithi129.stdout:5/198: dread - d0/dc/d22/f35 zero size 2024-03-18T14:43:15.550 INFO:tasks.workunit.client.1.smithi129.stdout:7/180: dread - d4/d7/d8/f29 zero size 2024-03-18T14:43:15.550 INFO:tasks.workunit.client.1.smithi129.stdout:6/212: dread - d3/d30/f1e zero size 2024-03-18T14:43:15.550 INFO:tasks.workunit.client.0.smithi087.stdout:2/377: creat d2/d44/f75 x:0 0 0 2024-03-18T14:43:15.551 INFO:tasks.workunit.client.0.smithi087.stdout:6/371: stat d3/d7/d25/d62/d7c/f1e 0 2024-03-18T14:43:15.551 INFO:tasks.workunit.client.1.smithi129.stdout:4/173: truncate d0/d1a/f2c 364113 0 2024-03-18T14:43:15.552 INFO:tasks.workunit.client.1.smithi129.stdout:3/178: symlink d4/dd/d15/d31/l35 0 2024-03-18T14:43:15.553 INFO:tasks.workunit.client.0.smithi087.stdout:2/378: dwrite d2/d4/d22/f36 [4194304,4194304] 0 2024-03-18T14:43:15.554 INFO:tasks.workunit.client.1.smithi129.stdout:8/211: mknod d9/d11/d1a/d14/c44 0 2024-03-18T14:43:15.555 INFO:tasks.workunit.client.1.smithi129.stdout:0/237: dwrite d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:15.557 INFO:tasks.workunit.client.0.smithi087.stdout:8/407: rename d1/d6/f85 to d1/d6/d2f/d44/d4b/f86 0 2024-03-18T14:43:15.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/394: mkdir d0/d1a/d99 0 2024-03-18T14:43:15.559 INFO:tasks.workunit.client.1.smithi129.stdout:1/191: creat d1/d2/f3b x:0 0 0 2024-03-18T14:43:15.559 INFO:tasks.workunit.client.1.smithi129.stdout:1/192: stat d1/f1d 0 2024-03-18T14:43:15.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/181: write d4/d2d/f2a [4491555,97057] 0 2024-03-18T14:43:15.561 INFO:tasks.workunit.client.0.smithi087.stdout:2/379: mkdir d2/d4/d22/d2c/d3a/d76 0 2024-03-18T14:43:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/380: readlink d2/d4/d22/d2c/d3a/d49/l66 0 2024-03-18T14:43:15.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/381: stat d2/d4/d22/d2c/f74 0 2024-03-18T14:43:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/485: rename db/d12/f43 to db/d18/d1e/d28/f94 0 2024-03-18T14:43:15.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/486: stat db/d18/d1c/c72 0 2024-03-18T14:43:15.569 INFO:tasks.workunit.client.1.smithi129.stdout:6/213: mknod d3/d30/c47 0 2024-03-18T14:43:15.570 INFO:tasks.workunit.client.1.smithi129.stdout:5/199: creat d0/dc/d22/f40 x:0 0 0 2024-03-18T14:43:15.570 INFO:tasks.workunit.client.1.smithi129.stdout:1/193: symlink d1/d2/d28/l3c 0 2024-03-18T14:43:15.574 INFO:tasks.workunit.client.1.smithi129.stdout:7/182: rename d4/d36 to d4/d7/d8/d3b 0 2024-03-18T14:43:15.575 INFO:tasks.workunit.client.1.smithi129.stdout:1/194: dread d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:15.576 INFO:tasks.workunit.client.1.smithi129.stdout:9/184: write d0/db/d1f/d20/d26/d19/f21 [1251196,119328] 0 2024-03-18T14:43:15.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/183: dwrite d4/d7/f19 [0,4194304] 0 2024-03-18T14:43:15.581 INFO:tasks.workunit.client.1.smithi129.stdout:7/184: chown d4/d7/l1a 3165266 1 2024-03-18T14:43:15.581 INFO:tasks.workunit.client.1.smithi129.stdout:7/185: fdatasync d4/d7/d8/f1c 0 2024-03-18T14:43:15.581 INFO:tasks.workunit.client.1.smithi129.stdout:7/186: chown d4/d7/d8/f32 292230796 1 2024-03-18T14:43:15.581 INFO:tasks.workunit.client.1.smithi129.stdout:5/200: symlink d0/dc/d1a/l41 0 2024-03-18T14:43:15.582 INFO:tasks.workunit.client.1.smithi129.stdout:5/201: write d0/f6 [2474402,109066] 0 2024-03-18T14:43:15.585 INFO:tasks.workunit.client.1.smithi129.stdout:1/195: creat d1/d2/f3d x:0 0 0 2024-03-18T14:43:15.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/196: read d1/d18/f21 [787404,31509] 0 2024-03-18T14:43:15.586 INFO:tasks.workunit.client.1.smithi129.stdout:0/238: creat d0/d14/f49 x:0 0 0 2024-03-18T14:43:15.587 INFO:tasks.workunit.client.1.smithi129.stdout:9/185: rmdir d0/d15 39 2024-03-18T14:43:15.587 INFO:tasks.workunit.client.1.smithi129.stdout:5/202: read d0/dc/d18/f1d [6463238,100187] 0 2024-03-18T14:43:15.594 INFO:tasks.workunit.client.1.smithi129.stdout:9/186: dread d0/db/f1d [0,4194304] 0 2024-03-18T14:43:15.595 INFO:tasks.workunit.client.1.smithi129.stdout:4/174: dwrite d0/f1c [0,4194304] 0 2024-03-18T14:43:15.598 INFO:tasks.workunit.client.1.smithi129.stdout:7/187: symlink d4/d7/d8/d3b/l3c 0 2024-03-18T14:43:15.599 INFO:tasks.workunit.client.1.smithi129.stdout:7/188: write d4/d7/d8/f29 [179638,61460] 0 2024-03-18T14:43:15.599 INFO:tasks.workunit.client.1.smithi129.stdout:3/179: getdents d4/dd 0 2024-03-18T14:43:15.601 INFO:tasks.workunit.client.1.smithi129.stdout:8/212: getdents d9/d11/d18 0 2024-03-18T14:43:15.601 INFO:tasks.workunit.client.1.smithi129.stdout:8/213: dread - d9/d11/d1a/d14/f39 zero size 2024-03-18T14:43:15.606 INFO:tasks.workunit.client.1.smithi129.stdout:5/203: fdatasync d0/dc/d22/f1e 0 2024-03-18T14:43:15.606 INFO:tasks.workunit.client.1.smithi129.stdout:5/204: chown d0/df/c31 418050234 1 2024-03-18T14:43:15.609 INFO:tasks.workunit.client.1.smithi129.stdout:6/214: rename d3/d5/f1c to d3/d5/f48 0 2024-03-18T14:43:15.610 INFO:tasks.workunit.client.1.smithi129.stdout:4/175: rmdir d0/d19 39 2024-03-18T14:43:15.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/189: creat d4/d7/d8/f3d x:0 0 0 2024-03-18T14:43:15.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/190: chown d4/c23 3750674 1 2024-03-18T14:43:15.614 INFO:tasks.workunit.client.1.smithi129.stdout:3/180: mkdir d4/d11/d1d/d36 0 2024-03-18T14:43:15.615 INFO:tasks.workunit.client.1.smithi129.stdout:8/214: symlink d9/d11/d1a/d14/l45 0 2024-03-18T14:43:15.617 INFO:tasks.workunit.client.1.smithi129.stdout:5/205: fdatasync d0/f11 0 2024-03-18T14:43:15.618 INFO:tasks.workunit.client.1.smithi129.stdout:5/206: readlink d0/dc/d18/l38 0 2024-03-18T14:43:15.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/360: getdents d2/d13 0 2024-03-18T14:43:15.619 INFO:tasks.workunit.client.0.smithi087.stdout:1/446: rename d3/f16 to d3/d1d/d67/f8a 0 2024-03-18T14:43:15.619 INFO:tasks.workunit.client.1.smithi129.stdout:6/215: mkdir d3/d30/de/d49 0 2024-03-18T14:43:15.620 INFO:tasks.workunit.client.0.smithi087.stdout:8/408: truncate d1/fd 4154618 0 2024-03-18T14:43:15.621 INFO:tasks.workunit.client.0.smithi087.stdout:5/431: dread d13/d1b/d27/d28/f78 [0,4194304] 0 2024-03-18T14:43:15.621 INFO:tasks.workunit.client.0.smithi087.stdout:1/447: chown d3/d1d/d45/f49 93 1 2024-03-18T14:43:15.621 INFO:tasks.workunit.client.1.smithi129.stdout:0/239: write d0/fb [7067416,97673] 0 2024-03-18T14:43:15.621 INFO:tasks.workunit.client.1.smithi129.stdout:2/175: sync 2024-03-18T14:43:15.625 INFO:tasks.workunit.client.1.smithi129.stdout:0/240: dread d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:15.625 INFO:tasks.workunit.client.1.smithi129.stdout:8/215: rename d9/d11/d1a/d14/l45 to d9/d11/d1a/l46 0 2024-03-18T14:43:15.625 INFO:tasks.workunit.client.1.smithi129.stdout:0/241: chown d0/d23/d35/d3b/d42 106 1 2024-03-18T14:43:15.626 INFO:tasks.workunit.client.0.smithi087.stdout:8/409: dwrite d1/d6/d2f/d44/f81 [0,4194304] 0 2024-03-18T14:43:15.626 INFO:tasks.workunit.client.0.smithi087.stdout:2/382: creat d2/d4/d22/d2c/d3a/d49/f77 x:0 0 0 2024-03-18T14:43:15.626 INFO:tasks.workunit.client.0.smithi087.stdout:1/448: dwrite d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:15.627 INFO:tasks.workunit.client.1.smithi129.stdout:9/187: truncate d0/db/d1f/f30 256179 0 2024-03-18T14:43:15.627 INFO:tasks.workunit.client.0.smithi087.stdout:1/449: readlink d3/d1d/d1e/d43/d50/d72/l7b 0 2024-03-18T14:43:15.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/207: symlink d0/dc/d22/l42 0 2024-03-18T14:43:15.629 INFO:tasks.workunit.client.1.smithi129.stdout:5/208: dread - d0/df/f37 zero size 2024-03-18T14:43:15.629 INFO:tasks.workunit.client.1.smithi129.stdout:4/176: write d0/d19/d1d/f22 [86935,53280] 0 2024-03-18T14:43:15.633 INFO:tasks.workunit.client.1.smithi129.stdout:7/191: link d4/d7/f25 d4/d2d/f3e 0 2024-03-18T14:43:15.633 INFO:tasks.workunit.client.1.smithi129.stdout:7/192: chown d4/d7/d8/f3d 31588339 1 2024-03-18T14:43:15.634 INFO:tasks.workunit.client.1.smithi129.stdout:7/193: chown d4/d7/d8/f29 28019980 1 2024-03-18T14:43:15.637 INFO:tasks.workunit.client.0.smithi087.stdout:4/361: creat d2/db/d24/d30/f6f x:0 0 0 2024-03-18T14:43:15.637 INFO:tasks.workunit.client.1.smithi129.stdout:1/197: getdents d1/d2 0 2024-03-18T14:43:15.638 INFO:tasks.workunit.client.1.smithi129.stdout:0/242: mkdir d0/d14/d3a/d4a 0 2024-03-18T14:43:15.638 INFO:tasks.workunit.client.1.smithi129.stdout:7/194: dread d4/f16 [0,4194304] 0 2024-03-18T14:43:15.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/432: creat d13/d1b/f94 x:0 0 0 2024-03-18T14:43:15.639 INFO:tasks.workunit.client.1.smithi129.stdout:1/198: readlink d1/d2/l31 0 2024-03-18T14:43:15.639 INFO:tasks.workunit.client.1.smithi129.stdout:2/176: dread f0 [0,4194304] 0 2024-03-18T14:43:15.640 INFO:tasks.workunit.client.1.smithi129.stdout:4/177: symlink d0/d19/d1d/d2e/l31 0 2024-03-18T14:43:15.641 INFO:tasks.workunit.client.1.smithi129.stdout:5/209: rename d0/df/c1c to d0/dc/d18/d2b/c43 0 2024-03-18T14:43:15.641 INFO:tasks.workunit.client.1.smithi129.stdout:5/210: fsync d0/d32/d34/f3b 0 2024-03-18T14:43:15.645 INFO:tasks.workunit.client.0.smithi087.stdout:3/444: rename d0/d3/df/l2a to d0/d3/d4f/l80 0 2024-03-18T14:43:15.649 INFO:tasks.workunit.client.0.smithi087.stdout:1/450: dread d3/d1d/d1f/d34/f53 [0,4194304] 0 2024-03-18T14:43:15.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/195: readlink d4/l2c 0 2024-03-18T14:43:15.650 INFO:tasks.workunit.client.1.smithi129.stdout:7/196: fsync d4/d7/d8/f29 0 2024-03-18T14:43:15.651 INFO:tasks.workunit.client.0.smithi087.stdout:2/383: mkdir d2/d4/d22/d2c/d3a/d49/d58/d78 0 2024-03-18T14:43:15.651 INFO:tasks.workunit.client.1.smithi129.stdout:7/197: chown d4/d7/f25 0 1 2024-03-18T14:43:15.653 INFO:tasks.workunit.client.0.smithi087.stdout:8/410: write d1/f1b [1352131,38884] 0 2024-03-18T14:43:15.655 INFO:tasks.workunit.client.1.smithi129.stdout:7/198: creat d4/d7/d8/f3f x:0 0 0 2024-03-18T14:43:15.655 INFO:tasks.workunit.client.1.smithi129.stdout:8/216: dwrite d9/d11/d1a/d14/f2c [0,4194304] 0 2024-03-18T14:43:15.655 INFO:tasks.workunit.client.1.smithi129.stdout:0/243: dread d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:15.656 INFO:tasks.workunit.client.0.smithi087.stdout:9/487: rename db/d18/d1e/d28/d76/d80/l84 to db/d18/d51/d7b/l95 0 2024-03-18T14:43:15.656 INFO:tasks.workunit.client.1.smithi129.stdout:9/188: truncate d0/f1e 802391 0 2024-03-18T14:43:15.657 INFO:tasks.workunit.client.0.smithi087.stdout:9/488: read db/d18/d3a/f6b [36894,12347] 0 2024-03-18T14:43:15.657 INFO:tasks.workunit.client.1.smithi129.stdout:0/244: readlink d0/d14/d3a/l45 0 2024-03-18T14:43:15.658 INFO:tasks.workunit.client.0.smithi087.stdout:1/451: rmdir d3/d1d/d1f 39 2024-03-18T14:43:15.658 INFO:tasks.workunit.client.1.smithi129.stdout:8/217: read d9/d11/d1a/f30 [3129477,66893] 0 2024-03-18T14:43:15.659 INFO:tasks.workunit.client.1.smithi129.stdout:4/178: truncate d0/d9/f15 2567300 0 2024-03-18T14:43:15.660 INFO:tasks.workunit.client.1.smithi129.stdout:4/179: chown d0/d1a/f23 633 1 2024-03-18T14:43:15.662 INFO:tasks.workunit.client.0.smithi087.stdout:8/411: unlink d1/d6/l69 0 2024-03-18T14:43:15.662 INFO:tasks.workunit.client.1.smithi129.stdout:1/199: dwrite d1/d18/f21 [4194304,4194304] 0 2024-03-18T14:43:15.662 INFO:tasks.workunit.client.1.smithi129.stdout:2/177: creat d7/d1f/d20/d2d/f35 x:0 0 0 2024-03-18T14:43:15.663 INFO:tasks.workunit.client.0.smithi087.stdout:3/445: stat d0/d3/d40/f78 0 2024-03-18T14:43:15.664 INFO:tasks.workunit.client.1.smithi129.stdout:4/180: dread d0/d19/d1d/f22 [0,4194304] 0 2024-03-18T14:43:15.665 INFO:tasks.workunit.client.1.smithi129.stdout:1/200: write d1/d2/f1f [2678110,15201] 0 2024-03-18T14:43:15.665 INFO:tasks.workunit.client.1.smithi129.stdout:9/189: rename d0/db/d11/c2c to d0/db/d1f/c38 0 2024-03-18T14:43:15.666 INFO:tasks.workunit.client.0.smithi087.stdout:5/433: rename d13/d1b/d27/c65 to d13/d1b/d27/d35/c95 0 2024-03-18T14:43:15.667 INFO:tasks.workunit.client.1.smithi129.stdout:8/218: dwrite d9/d11/d1a/f3e [0,4194304] 0 2024-03-18T14:43:15.668 INFO:tasks.workunit.client.1.smithi129.stdout:0/245: symlink d0/d23/l4b 0 2024-03-18T14:43:15.669 INFO:tasks.workunit.client.1.smithi129.stdout:0/246: stat d0/ce 0 2024-03-18T14:43:15.669 INFO:tasks.workunit.client.0.smithi087.stdout:9/489: dread db/d18/d1c/f40 [0,4194304] 0 2024-03-18T14:43:15.671 INFO:tasks.workunit.client.0.smithi087.stdout:7/484: sync 2024-03-18T14:43:15.671 INFO:tasks.workunit.client.1.smithi129.stdout:1/201: dwrite d1/d18/f30 [0,4194304] 0 2024-03-18T14:43:15.674 INFO:tasks.workunit.client.0.smithi087.stdout:3/446: dread d0/f37 [0,4194304] 0 2024-03-18T14:43:15.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/434: mknod d13/d1b/d27/d28/c96 0 2024-03-18T14:43:15.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/362: link d2/db/de/f2c d2/d13/d28/f70 0 2024-03-18T14:43:15.678 INFO:tasks.workunit.client.1.smithi129.stdout:7/199: truncate d4/d7/d8/f3d 1025446 0 2024-03-18T14:43:15.680 INFO:tasks.workunit.client.0.smithi087.stdout:9/490: dread db/f2f [0,4194304] 0 2024-03-18T14:43:15.683 INFO:tasks.workunit.client.1.smithi129.stdout:1/202: stat d1/d35/c38 0 2024-03-18T14:43:15.684 INFO:tasks.workunit.client.1.smithi129.stdout:1/203: write d1/d2/f3d [234,2255] 0 2024-03-18T14:43:15.685 INFO:tasks.workunit.client.1.smithi129.stdout:1/204: write d1/d18/f30 [2387756,71078] 0 2024-03-18T14:43:15.685 INFO:tasks.workunit.client.1.smithi129.stdout:4/181: getdents d0/d9/d1e/d21 0 2024-03-18T14:43:15.686 INFO:tasks.workunit.client.1.smithi129.stdout:7/200: read d4/fd [1047732,84217] 0 2024-03-18T14:43:15.687 INFO:tasks.workunit.client.0.smithi087.stdout:5/435: mknod d13/d1b/d27/d35/d3b/c97 0 2024-03-18T14:43:15.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/384: mkdir d2/d44/d72/d79 0 2024-03-18T14:43:15.687 INFO:tasks.workunit.client.0.smithi087.stdout:3/447: creat d0/de/f81 x:0 0 0 2024-03-18T14:43:15.688 INFO:tasks.workunit.client.1.smithi129.stdout:9/190: rmdir d0 39 2024-03-18T14:43:15.691 INFO:tasks.workunit.client.1.smithi129.stdout:0/247: unlink d0/d14/d28/f3d 0 2024-03-18T14:43:15.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/491: symlink db/d18/d51/l96 0 2024-03-18T14:43:15.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/485: link d1/d6/d16/dc/l56 d1/d6/d29/d2f/d68/d65/d96/la9 0 2024-03-18T14:43:15.693 INFO:tasks.workunit.client.0.smithi087.stdout:1/452: dwrite d3/d1d/d1e/d20/f52 [0,4194304] 0 2024-03-18T14:43:15.693 INFO:tasks.workunit.client.1.smithi129.stdout:1/205: creat d1/d2/f3e x:0 0 0 2024-03-18T14:43:15.694 INFO:tasks.workunit.client.0.smithi087.stdout:7/486: write d1/d6/d29/f49 [754259,77699] 0 2024-03-18T14:43:15.694 INFO:tasks.workunit.client.1.smithi129.stdout:2/178: truncate d7/d1f/d20/d2d/f2e 305075 0 2024-03-18T14:43:15.694 INFO:tasks.workunit.client.1.smithi129.stdout:1/206: dread - d1/d18/f36 zero size 2024-03-18T14:43:15.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/363: creat d2/db/f71 x:0 0 0 2024-03-18T14:43:15.696 INFO:tasks.workunit.client.1.smithi129.stdout:0/248: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:15.697 INFO:tasks.workunit.client.0.smithi087.stdout:2/385: mknod d2/d4/d22/d2c/c7a 0 2024-03-18T14:43:15.697 INFO:tasks.workunit.client.1.smithi129.stdout:0/249: chown d0/l26 6 1 2024-03-18T14:43:15.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/364: dwrite d2/d13/d28/f65 [0,4194304] 0 2024-03-18T14:43:15.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/365: write d2/db/f71 [998345,8778] 0 2024-03-18T14:43:15.703 INFO:tasks.workunit.client.1.smithi129.stdout:7/201: creat d4/d7/d8/d3b/f40 x:0 0 0 2024-03-18T14:43:15.703 INFO:tasks.workunit.client.0.smithi087.stdout:5/436: mkdir d13/d1b/d27/d98 0 2024-03-18T14:43:15.704 INFO:tasks.workunit.client.1.smithi129.stdout:2/179: mkdir d7/d1f/d20/d36 0 2024-03-18T14:43:15.704 INFO:tasks.workunit.client.0.smithi087.stdout:5/437: write d13/f5e [26864,39792] 0 2024-03-18T14:43:15.704 INFO:tasks.workunit.client.0.smithi087.stdout:3/448: creat d0/d3/d10/d7f/f82 x:0 0 0 2024-03-18T14:43:15.704 INFO:tasks.workunit.client.0.smithi087.stdout:2/386: rmdir d2 39 2024-03-18T14:43:15.705 INFO:tasks.workunit.client.1.smithi129.stdout:7/202: chown d4/d2d/c33 112968167 1 2024-03-18T14:43:15.705 INFO:tasks.workunit.client.1.smithi129.stdout:7/203: fdatasync d4/d7/d8/f3f 0 2024-03-18T14:43:15.705 INFO:tasks.workunit.client.1.smithi129.stdout:0/250: rmdir d0/d23/d29 39 2024-03-18T14:43:15.707 INFO:tasks.workunit.client.0.smithi087.stdout:1/453: chown d3/d1d/d1f/l2b 79368 1 2024-03-18T14:43:15.708 INFO:tasks.workunit.client.0.smithi087.stdout:1/454: read - d3/d1d/d1e/d20/f80 zero size 2024-03-18T14:43:15.709 INFO:tasks.workunit.client.1.smithi129.stdout:3/181: sync 2024-03-18T14:43:15.709 INFO:tasks.workunit.client.1.smithi129.stdout:6/216: sync 2024-03-18T14:43:15.709 INFO:tasks.workunit.client.0.smithi087.stdout:5/438: creat d13/d1b/d30/d6e/d88/f99 x:0 0 0 2024-03-18T14:43:15.710 INFO:tasks.workunit.client.1.smithi129.stdout:0/251: dwrite d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:15.710 INFO:tasks.workunit.client.1.smithi129.stdout:8/219: getdents d9/d11/d1a 0 2024-03-18T14:43:15.712 INFO:tasks.workunit.client.1.smithi129.stdout:1/207: creat d1/d35/f3f x:0 0 0 2024-03-18T14:43:15.713 INFO:tasks.workunit.client.0.smithi087.stdout:7/487: truncate d1/d6/da/d42/fa8 850295 0 2024-03-18T14:43:15.716 INFO:tasks.workunit.client.1.smithi129.stdout:4/182: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:15.718 INFO:tasks.workunit.client.1.smithi129.stdout:0/252: creat d0/d14/d3a/f4c x:0 0 0 2024-03-18T14:43:15.718 INFO:tasks.workunit.client.0.smithi087.stdout:9/492: rmdir db/d18/d51 39 2024-03-18T14:43:15.720 INFO:tasks.workunit.client.1.smithi129.stdout:1/208: unlink d1/f2e 0 2024-03-18T14:43:15.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/217: dwrite d3/d5/d2b/f31 [0,4194304] 0 2024-03-18T14:43:15.720 INFO:tasks.workunit.client.1.smithi129.stdout:3/182: dread d4/dd/d15/d16/f1c [0,4194304] 0 2024-03-18T14:43:15.721 INFO:tasks.workunit.client.0.smithi087.stdout:3/449: mknod d0/c83 0 2024-03-18T14:43:15.721 INFO:tasks.workunit.client.1.smithi129.stdout:8/220: symlink d9/d11/d1a/d14/l47 0 2024-03-18T14:43:15.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/450: write d0/d3/d4f/f6f [406715,128309] 0 2024-03-18T14:43:15.722 INFO:tasks.workunit.client.1.smithi129.stdout:7/204: dwrite d4/fd [0,4194304] 0 2024-03-18T14:43:15.727 INFO:tasks.workunit.client.0.smithi087.stdout:7/488: creat d1/d6/d29/d2f/d68/faa x:0 0 0 2024-03-18T14:43:15.727 INFO:tasks.workunit.client.1.smithi129.stdout:1/209: unlink d1/d2/l14 0 2024-03-18T14:43:15.727 INFO:tasks.workunit.client.0.smithi087.stdout:7/489: chown d1/d6/da/c24 11991 1 2024-03-18T14:43:15.728 INFO:tasks.workunit.client.1.smithi129.stdout:1/210: chown d1/d18/d19 10302489 1 2024-03-18T14:43:15.729 INFO:tasks.workunit.client.1.smithi129.stdout:3/183: creat d4/dd/d15/d16/f37 x:0 0 0 2024-03-18T14:43:15.729 INFO:tasks.workunit.client.0.smithi087.stdout:2/387: symlink d2/d4/l7b 0 2024-03-18T14:43:15.729 INFO:tasks.workunit.client.1.smithi129.stdout:8/221: mknod d9/d11/d18/c48 0 2024-03-18T14:43:15.730 INFO:tasks.workunit.client.0.smithi087.stdout:2/388: chown d2/d4/d22/d2c/d3a/d40/d6e 77 1 2024-03-18T14:43:15.731 INFO:tasks.workunit.client.0.smithi087.stdout:6/372: sync 2024-03-18T14:43:15.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/455: rename d3/l5a to d3/d1d/d1e/d20/d7a/l8b 0 2024-03-18T14:43:15.732 INFO:tasks.workunit.client.1.smithi129.stdout:1/211: dread d1/d18/f30 [0,4194304] 0 2024-03-18T14:43:15.732 INFO:tasks.workunit.client.0.smithi087.stdout:6/373: read d3/d7/d25/d62/d7c/d29/d22/f7a [3702090,58883] 0 2024-03-18T14:43:15.733 INFO:tasks.workunit.client.1.smithi129.stdout:1/212: write d1/d2/f3e [906700,129958] 0 2024-03-18T14:43:15.734 INFO:tasks.workunit.client.0.smithi087.stdout:3/451: dread d0/d3/df/f50 [0,4194304] 0 2024-03-18T14:43:15.734 INFO:tasks.workunit.client.1.smithi129.stdout:3/184: dread d4/d11/d1d/d27/f2b [0,4194304] 0 2024-03-18T14:43:15.734 INFO:tasks.workunit.client.0.smithi087.stdout:2/389: creat d2/d44/d72/f7c x:0 0 0 2024-03-18T14:43:15.735 INFO:tasks.workunit.client.0.smithi087.stdout:7/490: read d1/d6/d29/d2f/f33 [3836776,110875] 0 2024-03-18T14:43:15.735 INFO:tasks.workunit.client.0.smithi087.stdout:1/456: creat d3/d3c/f8c x:0 0 0 2024-03-18T14:43:15.740 INFO:tasks.workunit.client.1.smithi129.stdout:6/218: rename d3/d30/df/f14 to d3/d30/d44/f4a 0 2024-03-18T14:43:15.740 INFO:tasks.workunit.client.1.smithi129.stdout:6/219: chown d3 927 1 2024-03-18T14:43:15.741 INFO:tasks.workunit.client.1.smithi129.stdout:6/220: chown d3/d30/f20 3770 1 2024-03-18T14:43:15.741 INFO:tasks.workunit.client.1.smithi129.stdout:7/205: link d4/d7/d8/f22 d4/d2d/d2e/f41 0 2024-03-18T14:43:15.742 INFO:tasks.workunit.client.0.smithi087.stdout:7/491: dread d1/d6/d29/d2f/d68/d65/d60/f94 [0,4194304] 0 2024-03-18T14:43:15.744 INFO:tasks.workunit.client.0.smithi087.stdout:4/366: truncate d2/db/d24/d30/f5c 3860191 0 2024-03-18T14:43:15.744 INFO:tasks.workunit.client.0.smithi087.stdout:6/374: mkdir d3/d7/d25/d62/d7e 0 2024-03-18T14:43:15.745 INFO:tasks.workunit.client.0.smithi087.stdout:4/367: readlink d2/db/d24/d30/d56/l64 0 2024-03-18T14:43:15.745 INFO:tasks.workunit.client.1.smithi129.stdout:9/191: truncate d0/f13 2610802 0 2024-03-18T14:43:15.745 INFO:tasks.workunit.client.1.smithi129.stdout:9/192: chown d0/c1 3100 1 2024-03-18T14:43:15.747 INFO:tasks.workunit.client.0.smithi087.stdout:1/457: creat d3/d1d/d79/f8d x:0 0 0 2024-03-18T14:43:15.748 INFO:tasks.workunit.client.1.smithi129.stdout:9/193: dread d0/db/d11/f27 [0,4194304] 0 2024-03-18T14:43:15.748 INFO:tasks.workunit.client.1.smithi129.stdout:2/180: truncate d7/d1c/f26 3146088 0 2024-03-18T14:43:15.748 INFO:tasks.workunit.client.0.smithi087.stdout:1/458: chown d3/d1d/d1f/d34/c5b 1830 1 2024-03-18T14:43:15.749 INFO:tasks.workunit.client.1.smithi129.stdout:5/211: sync 2024-03-18T14:43:15.750 INFO:tasks.workunit.client.1.smithi129.stdout:0/253: creat d0/d14/f4d x:0 0 0 2024-03-18T14:43:15.751 INFO:tasks.workunit.client.1.smithi129.stdout:0/254: chown d0/d14/c1b 6 1 2024-03-18T14:43:15.752 INFO:tasks.workunit.client.1.smithi129.stdout:4/183: dwrite d0/d19/f1f [0,4194304] 0 2024-03-18T14:43:15.753 INFO:tasks.workunit.client.1.smithi129.stdout:1/213: creat d1/f40 x:0 0 0 2024-03-18T14:43:15.755 INFO:tasks.workunit.client.0.smithi087.stdout:4/368: stat d2/d13/f3f 0 2024-03-18T14:43:15.756 INFO:tasks.workunit.client.0.smithi087.stdout:3/452: dread d0/d1c/d25/f6a [4194304,4194304] 0 2024-03-18T14:43:15.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/369: chown d2/db/d24/f2b 648344698 1 2024-03-18T14:43:15.757 INFO:tasks.workunit.client.1.smithi129.stdout:1/214: dwrite d1/d18/f21 [4194304,4194304] 0 2024-03-18T14:43:15.758 INFO:tasks.workunit.client.0.smithi087.stdout:7/492: write d1/d6/da/f43 [556237,37760] 0 2024-03-18T14:43:15.760 INFO:tasks.workunit.client.1.smithi129.stdout:9/194: mknod d0/db/d1f/d20/c39 0 2024-03-18T14:43:15.760 INFO:tasks.workunit.client.1.smithi129.stdout:5/212: rmdir d0 39 2024-03-18T14:43:15.763 INFO:tasks.workunit.client.1.smithi129.stdout:7/206: dread d4/d7/d8/f3d [0,4194304] 0 2024-03-18T14:43:15.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/390: write d2/d4/f1a [1880395,45080] 0 2024-03-18T14:43:15.764 INFO:tasks.workunit.client.1.smithi129.stdout:7/207: fsync f3 0 2024-03-18T14:43:15.764 INFO:tasks.workunit.client.0.smithi087.stdout:2/391: stat d2/d4/d22/d2c/c60 0 2024-03-18T14:43:15.765 INFO:tasks.workunit.client.0.smithi087.stdout:6/375: dread d3/d7/d25/d62/d7c/d29/d22/f32 [0,4194304] 0 2024-03-18T14:43:15.765 INFO:tasks.workunit.client.1.smithi129.stdout:2/181: creat d7/d1f/d20/d2a/f37 x:0 0 0 2024-03-18T14:43:15.765 INFO:tasks.workunit.client.0.smithi087.stdout:1/459: symlink d3/d1d/d1e/d43/d50/d72/l8e 0 2024-03-18T14:43:15.766 INFO:tasks.workunit.client.0.smithi087.stdout:6/376: chown d3/d7/f44 632 1 2024-03-18T14:43:15.766 INFO:tasks.workunit.client.1.smithi129.stdout:9/195: rmdir d0/db/d1f/d20/d26/d19 39 2024-03-18T14:43:15.768 INFO:tasks.workunit.client.1.smithi129.stdout:4/184: unlink d0/cf 0 2024-03-18T14:43:15.770 INFO:tasks.workunit.client.0.smithi087.stdout:4/370: rename d2/d13/c1a to d2/db/d24/d30/d4d/c72 0 2024-03-18T14:43:15.770 INFO:tasks.workunit.client.0.smithi087.stdout:3/453: dwrite d0/de/f81 [0,4194304] 0 2024-03-18T14:43:15.771 INFO:tasks.workunit.client.0.smithi087.stdout:8/412: sync 2024-03-18T14:43:15.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/395: sync 2024-03-18T14:43:15.771 INFO:tasks.workunit.client.0.smithi087.stdout:5/439: sync 2024-03-18T14:43:15.771 INFO:tasks.workunit.client.0.smithi087.stdout:7/493: creat d1/d6/d29/d2f/d68/fab x:0 0 0 2024-03-18T14:43:15.771 INFO:tasks.workunit.client.1.smithi129.stdout:4/185: dread d0/d1a/f23 [0,4194304] 0 2024-03-18T14:43:15.772 INFO:tasks.workunit.client.1.smithi129.stdout:3/185: rename d4/dd/d15/d16 to d4/d38 0 2024-03-18T14:43:15.773 INFO:tasks.workunit.client.0.smithi087.stdout:9/493: getdents db/d18/d1e/d28/d76/d80 0 2024-03-18T14:43:15.773 INFO:tasks.workunit.client.1.smithi129.stdout:3/186: write d4/d38/f37 [676138,92839] 0 2024-03-18T14:43:15.773 INFO:tasks.workunit.client.0.smithi087.stdout:5/440: write d13/d1b/f5c [1581803,68675] 0 2024-03-18T14:43:15.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/377: readlink d3/d7/d25/d62/d7c/l1f 0 2024-03-18T14:43:15.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/378: readlink d3/d7/l4a 0 2024-03-18T14:43:15.776 INFO:tasks.workunit.client.1.smithi129.stdout:0/255: truncate d0/d14/f4d 635724 0 2024-03-18T14:43:15.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/460: dread d3/f17 [0,4194304] 0 2024-03-18T14:43:15.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/461: stat d3/d1d/d6e 0 2024-03-18T14:43:15.779 INFO:tasks.workunit.client.1.smithi129.stdout:5/213: dwrite d0/df/f3c [8388608,4194304] 0 2024-03-18T14:43:15.779 INFO:tasks.workunit.client.0.smithi087.stdout:5/441: dwrite d13/d1b/d30/f7d [0,4194304] 0 2024-03-18T14:43:15.780 INFO:tasks.workunit.client.0.smithi087.stdout:2/392: rename d2/d4/d22/d2c/c41 to d2/d44/d72/c7d 0 2024-03-18T14:43:15.782 INFO:tasks.workunit.client.1.smithi129.stdout:6/221: write d3/d6/f18 [465593,72937] 0 2024-03-18T14:43:15.782 INFO:tasks.workunit.client.0.smithi087.stdout:1/462: dread d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:15.782 INFO:tasks.workunit.client.0.smithi087.stdout:8/413: mkdir d1/d6/d9/d5d/d87 0 2024-03-18T14:43:15.783 INFO:tasks.workunit.client.0.smithi087.stdout:0/396: mkdir d0/d1a/d7b/d2a/d9a 0 2024-03-18T14:43:15.783 INFO:tasks.workunit.client.1.smithi129.stdout:6/222: chown d3/d30/df/f42 901 1 2024-03-18T14:43:15.783 INFO:tasks.workunit.client.0.smithi087.stdout:0/397: readlink d0/d7f/l8e 0 2024-03-18T14:43:15.784 INFO:tasks.workunit.client.1.smithi129.stdout:5/214: dwrite d0/f2 [4194304,4194304] 0 2024-03-18T14:43:15.785 INFO:tasks.workunit.client.0.smithi087.stdout:9/494: mknod db/d12/c97 0 2024-03-18T14:43:15.786 INFO:tasks.workunit.client.1.smithi129.stdout:4/186: unlink d0/d19/f2b 0 2024-03-18T14:43:15.788 INFO:tasks.workunit.client.1.smithi129.stdout:8/222: rename d9/d11/d1a/d14/f28 to d9/d11/d1a/d32/d3a/f49 0 2024-03-18T14:43:15.789 INFO:tasks.workunit.client.1.smithi129.stdout:1/215: truncate d1/d18/d19/f37 537210 0 2024-03-18T14:43:15.791 INFO:tasks.workunit.client.0.smithi087.stdout:6/379: mknod d3/d7/d25/d62/d7c/d29/d22/d23/c7f 0 2024-03-18T14:43:15.792 INFO:tasks.workunit.client.1.smithi129.stdout:1/216: dread d1/d18/d19/f24 [0,4194304] 0 2024-03-18T14:43:15.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/208: dwrite d4/d7/d8/f3d [0,4194304] 0 2024-03-18T14:43:15.797 INFO:tasks.workunit.client.1.smithi129.stdout:7/209: chown d4/d7/d8/f3f 66123 1 2024-03-18T14:43:15.799 INFO:tasks.workunit.client.1.smithi129.stdout:3/187: mknod d4/d11/d1d/d36/c39 0 2024-03-18T14:43:15.799 INFO:tasks.workunit.client.0.smithi087.stdout:9/495: creat db/d18/d1e/f98 x:0 0 0 2024-03-18T14:43:15.800 INFO:tasks.workunit.client.0.smithi087.stdout:6/380: chown d3/d7/d25/d62/d7c/f42 5402 1 2024-03-18T14:43:15.801 INFO:tasks.workunit.client.1.smithi129.stdout:8/223: creat d9/d11/d1a/f4a x:0 0 0 2024-03-18T14:43:15.801 INFO:tasks.workunit.client.1.smithi129.stdout:9/196: sync 2024-03-18T14:43:15.802 INFO:tasks.workunit.client.1.smithi129.stdout:1/217: symlink d1/d35/l41 0 2024-03-18T14:43:15.803 INFO:tasks.workunit.client.1.smithi129.stdout:7/210: mkdir d4/d2d/d2e/d42 0 2024-03-18T14:43:15.804 INFO:tasks.workunit.client.0.smithi087.stdout:6/381: dwrite d3/d7/d25/d62/d7c/d29/f40 [0,4194304] 0 2024-03-18T14:43:15.806 INFO:tasks.workunit.client.1.smithi129.stdout:4/187: mkdir d0/d9/d1e/d21/d32 0 2024-03-18T14:43:15.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/454: creat d0/d1c/f84 x:0 0 0 2024-03-18T14:43:15.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/393: creat d2/d4/d22/d2c/d3a/d76/f7e x:0 0 0 2024-03-18T14:43:15.807 INFO:tasks.workunit.client.0.smithi087.stdout:8/414: mkdir d1/d6/d9/d5d/d87/d88 0 2024-03-18T14:43:15.808 INFO:tasks.workunit.client.0.smithi087.stdout:7/494: truncate d1/d6/d29/d2f/d68/d65/d60/d66/f90 803853 0 2024-03-18T14:43:15.808 INFO:tasks.workunit.client.0.smithi087.stdout:8/415: fdatasync d1/d6/d2f/d44/f6f 0 2024-03-18T14:43:15.810 INFO:tasks.workunit.client.1.smithi129.stdout:8/224: creat d9/d11/d1a/f4b x:0 0 0 2024-03-18T14:43:15.810 INFO:tasks.workunit.client.0.smithi087.stdout:4/371: link d2/db/l2a d2/db/d24/d30/d49/d4f/l73 0 2024-03-18T14:43:15.813 INFO:tasks.workunit.client.0.smithi087.stdout:9/496: mkdir db/d18/d1e/d7e/d99 0 2024-03-18T14:43:15.813 INFO:tasks.workunit.client.0.smithi087.stdout:7/495: dwrite d1/d6/d29/d2f/d68/d65/d72/f8f [0,4194304] 0 2024-03-18T14:43:15.815 INFO:tasks.workunit.client.0.smithi087.stdout:8/416: write d1/f6d [601204,16431] 0 2024-03-18T14:43:15.818 INFO:tasks.workunit.client.0.smithi087.stdout:1/463: getdents d3/d1d/d1e 0 2024-03-18T14:43:15.819 INFO:tasks.workunit.client.1.smithi129.stdout:7/211: creat d4/d7/f43 x:0 0 0 2024-03-18T14:43:15.819 INFO:tasks.workunit.client.1.smithi129.stdout:6/223: link d3/d5/d2b/c3d d3/d5/d2b/c4b 0 2024-03-18T14:43:15.819 INFO:tasks.workunit.client.0.smithi087.stdout:1/464: dread d3/f17 [0,4194304] 0 2024-03-18T14:43:15.820 INFO:tasks.workunit.client.1.smithi129.stdout:2/182: getdents d7/d1f/d34 0 2024-03-18T14:43:15.820 INFO:tasks.workunit.client.1.smithi129.stdout:9/197: getdents d0/db/d1f/d33 0 2024-03-18T14:43:15.820 INFO:tasks.workunit.client.1.smithi129.stdout:8/225: creat d9/f4c x:0 0 0 2024-03-18T14:43:15.820 INFO:tasks.workunit.client.1.smithi129.stdout:6/224: fsync d3/d30/de/f2e 0 2024-03-18T14:43:15.821 INFO:tasks.workunit.client.1.smithi129.stdout:7/212: chown d4/d7/l37 0 1 2024-03-18T14:43:15.822 INFO:tasks.workunit.client.1.smithi129.stdout:9/198: chown d0/db/d11/l14 37 1 2024-03-18T14:43:15.822 INFO:tasks.workunit.client.0.smithi087.stdout:7/496: mkdir d1/d6/d29/d2f/dac 0 2024-03-18T14:43:15.824 INFO:tasks.workunit.client.1.smithi129.stdout:7/213: read f3 [3214620,79125] 0 2024-03-18T14:43:15.824 INFO:tasks.workunit.client.0.smithi087.stdout:4/372: rename d2/f61 to d2/db/d24/d30/d56/f74 0 2024-03-18T14:43:15.824 INFO:tasks.workunit.client.1.smithi129.stdout:7/214: fdatasync d4/d7/d8/f3d 0 2024-03-18T14:43:15.825 INFO:tasks.workunit.client.1.smithi129.stdout:1/218: getdents d1/d18/d19 0 2024-03-18T14:43:15.825 INFO:tasks.workunit.client.1.smithi129.stdout:7/215: chown d4/fd 128300891 1 2024-03-18T14:43:15.827 INFO:tasks.workunit.client.0.smithi087.stdout:1/465: write d3/d1d/d79/f7f [3739779,69617] 0 2024-03-18T14:43:15.829 INFO:tasks.workunit.client.1.smithi129.stdout:7/216: dread d4/d2d/f2a [0,4194304] 0 2024-03-18T14:43:15.830 INFO:tasks.workunit.client.1.smithi129.stdout:0/256: write d0/d14/f2d [2801213,71457] 0 2024-03-18T14:43:15.830 INFO:tasks.workunit.client.1.smithi129.stdout:7/217: write d4/d2d/f18 [405807,110310] 0 2024-03-18T14:43:15.830 INFO:tasks.workunit.client.0.smithi087.stdout:7/497: symlink d1/d6/d29/d2f/d68/d65/lad 0 2024-03-18T14:43:15.831 INFO:tasks.workunit.client.0.smithi087.stdout:7/498: chown d1/d6/d29/d2f/d68/d65/d60/d66/l6c 1674 1 2024-03-18T14:43:15.832 INFO:tasks.workunit.client.0.smithi087.stdout:2/394: getdents d2/d4/d22/d2c/d3a 0 2024-03-18T14:43:15.834 INFO:tasks.workunit.client.0.smithi087.stdout:5/442: write d13/d1b/d27/d35/f4b [1059842,10586] 0 2024-03-18T14:43:15.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/226: truncate d9/d11/d1a/d32/d3a/f29 476674 0 2024-03-18T14:43:15.835 INFO:tasks.workunit.client.0.smithi087.stdout:5/443: stat d13/d1b/d30/d6e/d88/l8a 0 2024-03-18T14:43:15.836 INFO:tasks.workunit.client.0.smithi087.stdout:1/466: mkdir d3/d1d/d6e/d8f 0 2024-03-18T14:43:15.837 INFO:tasks.workunit.client.1.smithi129.stdout:5/215: dwrite d0/dc/d22/f1e [0,4194304] 0 2024-03-18T14:43:15.839 INFO:tasks.workunit.client.1.smithi129.stdout:7/218: getdents d4/d7/d38 0 2024-03-18T14:43:15.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/216: creat d0/df/f44 x:0 0 0 2024-03-18T14:43:15.842 INFO:tasks.workunit.client.1.smithi129.stdout:6/225: dread d3/d30/de/f2e [0,4194304] 0 2024-03-18T14:43:15.842 INFO:tasks.workunit.client.0.smithi087.stdout:6/382: truncate d3/d7/d25/f2a 4577016 0 2024-03-18T14:43:15.842 INFO:tasks.workunit.client.0.smithi087.stdout:0/398: dwrite d0/d2/f17 [0,4194304] 0 2024-03-18T14:43:15.843 INFO:tasks.workunit.client.1.smithi129.stdout:6/226: chown d3/d30/de/f1f 2804 1 2024-03-18T14:43:15.843 INFO:tasks.workunit.client.1.smithi129.stdout:6/227: fdatasync d3/d30/de/f2e 0 2024-03-18T14:43:15.844 INFO:tasks.workunit.client.1.smithi129.stdout:6/228: chown d3/d5/f48 565779 1 2024-03-18T14:43:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:0/399: chown d0/d1a/d7b/d2a/d85/l81 1 1 2024-03-18T14:43:15.845 INFO:tasks.workunit.client.0.smithi087.stdout:9/497: link db/c25 db/d18/d1c/d69/d6f/c9a 0 2024-03-18T14:43:15.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/188: truncate d4/d38/f24 2301216 0 2024-03-18T14:43:15.847 INFO:tasks.workunit.client.0.smithi087.stdout:3/455: dwrite d0/d1c/f2b [0,4194304] 0 2024-03-18T14:43:15.848 INFO:tasks.workunit.client.1.smithi129.stdout:2/183: write d7/fc [2247708,100411] 0 2024-03-18T14:43:15.848 INFO:tasks.workunit.client.1.smithi129.stdout:9/199: write d0/db/d1f/f30 [551503,92733] 0 2024-03-18T14:43:15.849 INFO:tasks.workunit.client.1.smithi129.stdout:4/188: dwrite d0/d1a/f24 [0,4194304] 0 2024-03-18T14:43:15.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/417: truncate d1/d6/d2f/f30 630322 0 2024-03-18T14:43:15.850 INFO:tasks.workunit.client.1.smithi129.stdout:2/184: write d7/d1f/d20/d2d/f35 [129117,59970] 0 2024-03-18T14:43:15.850 INFO:tasks.workunit.client.1.smithi129.stdout:4/189: readlink d0/d9/le 0 2024-03-18T14:43:15.854 INFO:tasks.workunit.client.1.smithi129.stdout:9/200: dwrite d0/f8 [4194304,4194304] 0 2024-03-18T14:43:15.856 INFO:tasks.workunit.client.1.smithi129.stdout:2/185: dwrite d7/fa [0,4194304] 0 2024-03-18T14:43:15.856 INFO:tasks.workunit.client.1.smithi129.stdout:8/227: mkdir d9/d11/d1a/d32/d41/d4d 0 2024-03-18T14:43:15.857 INFO:tasks.workunit.client.1.smithi129.stdout:0/257: link d0/l18 d0/d14/d3a/d4a/l4e 0 2024-03-18T14:43:15.857 INFO:tasks.workunit.client.1.smithi129.stdout:5/217: rename d0/dc/d1a/d3e to d0/d32/d3a/d45 0 2024-03-18T14:43:15.858 INFO:tasks.workunit.client.1.smithi129.stdout:6/229: chown d3/d30/df/d28 107343916 1 2024-03-18T14:43:15.858 INFO:tasks.workunit.client.0.smithi087.stdout:8/418: symlink d1/d6/d2f/d44/d4b/l89 0 2024-03-18T14:43:15.859 INFO:tasks.workunit.client.0.smithi087.stdout:7/499: dread d1/f31 [0,4194304] 0 2024-03-18T14:43:15.859 INFO:tasks.workunit.client.0.smithi087.stdout:5/444: getdents d13/d1b/d27/d98 0 2024-03-18T14:43:15.859 INFO:tasks.workunit.client.1.smithi129.stdout:6/230: read d3/f1a [3303666,60101] 0 2024-03-18T14:43:15.861 INFO:tasks.workunit.client.1.smithi129.stdout:6/231: write d3/d5/d2b/f31 [2557873,112445] 0 2024-03-18T14:43:15.862 INFO:tasks.workunit.client.1.smithi129.stdout:9/201: fsync d0/db/d11/f1a 0 2024-03-18T14:43:15.862 INFO:tasks.workunit.client.0.smithi087.stdout:2/395: dread d2/d4/f16 [0,4194304] 0 2024-03-18T14:43:15.862 INFO:tasks.workunit.client.0.smithi087.stdout:2/396: readlink d2/d4/d22/d2c/l3e 0 2024-03-18T14:43:15.863 INFO:tasks.workunit.client.1.smithi129.stdout:7/219: dwrite d4/d7/d8/f20 [0,4194304] 0 2024-03-18T14:43:15.863 INFO:tasks.workunit.client.0.smithi087.stdout:9/498: symlink db/l9b 0 2024-03-18T14:43:15.864 INFO:tasks.workunit.client.0.smithi087.stdout:4/373: chown d2/db/d24/d30/d4d/c72 84 1 2024-03-18T14:43:15.864 INFO:tasks.workunit.client.0.smithi087.stdout:6/383: dread d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:15.865 INFO:tasks.workunit.client.1.smithi129.stdout:8/228: symlink d9/d11/d1a/d32/d3a/l4e 0 2024-03-18T14:43:15.866 INFO:tasks.workunit.client.1.smithi129.stdout:8/229: write d9/f1b [5021033,98790] 0 2024-03-18T14:43:15.867 INFO:tasks.workunit.client.1.smithi129.stdout:5/218: mknod d0/c46 0 2024-03-18T14:43:15.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/419: creat d1/d6/d9/d5d/d87/f8a x:0 0 0 2024-03-18T14:43:15.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/420: dread - d1/d6/d9/d5d/d87/f8a zero size 2024-03-18T14:43:15.872 INFO:tasks.workunit.client.0.smithi087.stdout:0/400: creat d0/d2/d4/d27/f9b x:0 0 0 2024-03-18T14:43:15.873 INFO:tasks.workunit.client.0.smithi087.stdout:8/421: dwrite d1/f7d [0,4194304] 0 2024-03-18T14:43:15.873 INFO:tasks.workunit.client.0.smithi087.stdout:0/401: readlink d0/d1a/d7b/d2a/d85/l81 0 2024-03-18T14:43:15.875 INFO:tasks.workunit.client.0.smithi087.stdout:3/456: mkdir d0/d72/d85 0 2024-03-18T14:43:15.875 INFO:tasks.workunit.client.1.smithi129.stdout:1/219: sync 2024-03-18T14:43:15.876 INFO:tasks.workunit.client.0.smithi087.stdout:7/500: mkdir d1/d8e/d95/dae 0 2024-03-18T14:43:15.879 INFO:tasks.workunit.client.0.smithi087.stdout:5/445: dread f12 [0,4194304] 0 2024-03-18T14:43:15.879 INFO:tasks.workunit.client.0.smithi087.stdout:4/374: write d2/db/d24/d30/d56/f74 [331418,108427] 0 2024-03-18T14:43:15.881 INFO:tasks.workunit.client.1.smithi129.stdout:7/220: rename d4/d7/d8/cb to d4/d2d/d3a/c44 0 2024-03-18T14:43:15.881 INFO:tasks.workunit.client.0.smithi087.stdout:8/422: creat d1/d6/d2f/d44/d45/d50/f8b x:0 0 0 2024-03-18T14:43:15.881 INFO:tasks.workunit.client.1.smithi129.stdout:6/232: dwrite d3/d5/f48 [0,4194304] 0 2024-03-18T14:43:15.883 INFO:tasks.workunit.client.0.smithi087.stdout:9/499: symlink db/d18/d3a/l9c 0 2024-03-18T14:43:15.883 INFO:tasks.workunit.client.0.smithi087.stdout:9/500: stat db/d18/d1e/d7e/d99 0 2024-03-18T14:43:15.883 INFO:tasks.workunit.client.0.smithi087.stdout:3/457: mkdir d0/d72/d86 0 2024-03-18T14:43:15.885 INFO:tasks.workunit.client.0.smithi087.stdout:7/501: symlink d1/d6/d29/d2f/d68/d65/d60/d66/d8b/laf 0 2024-03-18T14:43:15.886 INFO:tasks.workunit.client.1.smithi129.stdout:1/220: symlink d1/d18/l42 0 2024-03-18T14:43:15.886 INFO:tasks.workunit.client.1.smithi129.stdout:1/221: fsync d1/d2/f3d 0 2024-03-18T14:43:15.887 INFO:tasks.workunit.client.1.smithi129.stdout:9/202: mknod d0/db/d1f/d20/d26/c3a 0 2024-03-18T14:43:15.887 INFO:tasks.workunit.client.1.smithi129.stdout:1/222: chown d1/d2/f3d 2 1 2024-03-18T14:43:15.887 INFO:tasks.workunit.client.1.smithi129.stdout:9/203: chown d0/db/d1f/d20/d26 1091 1 2024-03-18T14:43:15.888 INFO:tasks.workunit.client.1.smithi129.stdout:9/204: write d0/f1b [823277,48575] 0 2024-03-18T14:43:15.890 INFO:tasks.workunit.client.0.smithi087.stdout:0/402: symlink d0/d2/d4/d19/d24/d5d/d78/l9c 0 2024-03-18T14:43:15.892 INFO:tasks.workunit.client.1.smithi129.stdout:8/230: creat d9/d11/d1a/d32/d41/d4d/f4f x:0 0 0 2024-03-18T14:43:15.893 INFO:tasks.workunit.client.1.smithi129.stdout:6/233: dread d3/f1a [0,4194304] 0 2024-03-18T14:43:15.895 INFO:tasks.workunit.client.1.smithi129.stdout:1/223: fdatasync d1/d2/f33 0 2024-03-18T14:43:15.896 INFO:tasks.workunit.client.1.smithi129.stdout:9/205: read d0/db/f1d [519206,43375] 0 2024-03-18T14:43:15.897 INFO:tasks.workunit.client.1.smithi129.stdout:6/234: mknod d3/d5/d2b/c4c 0 2024-03-18T14:43:15.897 INFO:tasks.workunit.client.1.smithi129.stdout:6/235: fdatasync d3/d30/de/f22 0 2024-03-18T14:43:15.899 INFO:tasks.workunit.client.1.smithi129.stdout:1/224: creat d1/d18/d19/f43 x:0 0 0 2024-03-18T14:43:15.901 INFO:tasks.workunit.client.1.smithi129.stdout:9/206: rename d0/db to d0/db/d1f/d20/d26/d19/d29/d3b 22 2024-03-18T14:43:15.901 INFO:tasks.workunit.client.1.smithi129.stdout:9/207: readlink d0/db/l34 0 2024-03-18T14:43:15.901 INFO:tasks.workunit.client.1.smithi129.stdout:9/208: readlink d0/db/d11/l14 0 2024-03-18T14:43:15.903 INFO:tasks.workunit.client.1.smithi129.stdout:9/209: rename d0/db/d1f/d20/d26/d19/d29 to d0/db/d1f/d20/d26/d19/d29/d3c 22 2024-03-18T14:43:15.903 INFO:tasks.workunit.client.1.smithi129.stdout:1/225: mknod d1/d2/d28/c44 0 2024-03-18T14:43:15.904 INFO:tasks.workunit.client.1.smithi129.stdout:9/210: chown d0/db/d1f/d20/d26/f2a 24941 1 2024-03-18T14:43:15.905 INFO:tasks.workunit.client.1.smithi129.stdout:6/236: creat d3/d5/f4d x:0 0 0 2024-03-18T14:43:15.905 INFO:tasks.workunit.client.1.smithi129.stdout:6/237: fdatasync d3/d5/f34 0 2024-03-18T14:43:15.908 INFO:tasks.workunit.client.1.smithi129.stdout:1/226: rename d1/d18/d19/f22 to d1/d35/f45 0 2024-03-18T14:43:15.908 INFO:tasks.workunit.client.0.smithi087.stdout:8/423: creat d1/d6/d9/f8c x:0 0 0 2024-03-18T14:43:15.910 INFO:tasks.workunit.client.0.smithi087.stdout:6/384: rename d3/d7/d25/d62/d7c/d29/d22/f55 to d3/d7/d25/d62/d7c/d29/d22/f80 0 2024-03-18T14:43:15.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/501: symlink db/d18/d3a/d87/l9d 0 2024-03-18T14:43:15.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/502: chown db/c3e 31 1 2024-03-18T14:43:15.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/503: dread - db/d18/d1e/d28/f52 zero size 2024-03-18T14:43:15.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/458: mknod d0/de/d30/d67/c87 0 2024-03-18T14:43:15.913 INFO:tasks.workunit.client.0.smithi087.stdout:6/385: fsync d3/f4 0 2024-03-18T14:43:15.915 INFO:tasks.workunit.client.0.smithi087.stdout:2/397: dread d2/d4/f15 [4194304,4194304] 0 2024-03-18T14:43:15.915 INFO:tasks.workunit.client.0.smithi087.stdout:6/386: dread - d3/d7/d25/d62/d7c/d29/d22/f5f zero size 2024-03-18T14:43:15.916 INFO:tasks.workunit.client.0.smithi087.stdout:1/467: truncate d3/d1d/d45/f49 1870329 0 2024-03-18T14:43:15.916 INFO:tasks.workunit.client.0.smithi087.stdout:1/468: chown d3/d1d/d1f/d34/l3a 455 1 2024-03-18T14:43:15.917 INFO:tasks.workunit.client.1.smithi129.stdout:4/190: dwrite d0/d1a/f23 [0,4194304] 0 2024-03-18T14:43:15.917 INFO:tasks.workunit.client.0.smithi087.stdout:8/424: mkdir d1/d6/d8d 0 2024-03-18T14:43:15.918 INFO:tasks.workunit.client.1.smithi129.stdout:6/238: creat d3/d6/f4e x:0 0 0 2024-03-18T14:43:15.918 INFO:tasks.workunit.client.1.smithi129.stdout:6/239: fdatasync d3/d30/f26 0 2024-03-18T14:43:15.919 INFO:tasks.workunit.client.1.smithi129.stdout:2/186: write d7/d1f/d20/d2d/f2e [358677,25869] 0 2024-03-18T14:43:15.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/221: write d4/d7/f25 [1273223,53902] 0 2024-03-18T14:43:15.922 INFO:tasks.workunit.client.1.smithi129.stdout:0/258: dread d0/d14/f20 [4194304,4194304] 0 2024-03-18T14:43:15.923 INFO:tasks.workunit.client.0.smithi087.stdout:3/459: dwrite d0/d3/f29 [4194304,4194304] 0 2024-03-18T14:43:15.925 INFO:tasks.workunit.client.0.smithi087.stdout:3/460: write d0/de/d30/f7c [264600,74216] 0 2024-03-18T14:43:15.925 INFO:tasks.workunit.client.1.smithi129.stdout:3/189: write d4/d38/f24 [1196514,59819] 0 2024-03-18T14:43:15.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/231: dwrite d9/d11/d1a/d32/f38 [0,4194304] 0 2024-03-18T14:43:15.926 INFO:tasks.workunit.client.0.smithi087.stdout:4/375: truncate d2/db/d24/d30/d56/f74 701208 0 2024-03-18T14:43:15.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/502: getdents d1/d6/d29/d2f/d68/d65/d60/d66 0 2024-03-18T14:43:15.930 INFO:tasks.workunit.client.1.smithi129.stdout:1/227: rename d1/d2/f3e to d1/f46 0 2024-03-18T14:43:15.930 INFO:tasks.workunit.client.1.smithi129.stdout:3/190: dwrite d4/dd/d15/f25 [0,4194304] 0 2024-03-18T14:43:15.931 INFO:tasks.workunit.client.0.smithi087.stdout:2/398: chown d2/d4/c1f 65282705 1 2024-03-18T14:43:15.933 INFO:tasks.workunit.client.0.smithi087.stdout:6/387: rename d3/c4c to d3/d7/d25/c81 0 2024-03-18T14:43:15.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/240: symlink d3/d30/df/d28/l4f 0 2024-03-18T14:43:15.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/241: dread - d3/d30/f1e zero size 2024-03-18T14:43:15.935 INFO:tasks.workunit.client.1.smithi129.stdout:7/222: mkdir d4/d2d/d2e/d45 0 2024-03-18T14:43:15.935 INFO:tasks.workunit.client.1.smithi129.stdout:7/223: dread - d4/d2d/f34 zero size 2024-03-18T14:43:15.937 INFO:tasks.workunit.client.0.smithi087.stdout:8/425: creat d1/d6/d2f/d44/d45/d72/d7f/f8e x:0 0 0 2024-03-18T14:43:15.938 INFO:tasks.workunit.client.0.smithi087.stdout:3/461: fsync d0/d1c/d25/f3c 0 2024-03-18T14:43:15.942 INFO:tasks.workunit.client.0.smithi087.stdout:7/503: mknod d1/cb0 0 2024-03-18T14:43:15.942 INFO:tasks.workunit.client.0.smithi087.stdout:0/403: link d0/d2/d4/d19/d5a/l83 d0/d2/l9d 0 2024-03-18T14:43:15.943 INFO:tasks.workunit.client.0.smithi087.stdout:2/399: mkdir d2/d4/d22/d24/d65/d7f 0 2024-03-18T14:43:15.943 INFO:tasks.workunit.client.1.smithi129.stdout:3/191: mknod d4/d11/d1d/c3a 0 2024-03-18T14:43:15.943 INFO:tasks.workunit.client.1.smithi129.stdout:2/187: creat d7/d1f/d20/d36/f38 x:0 0 0 2024-03-18T14:43:15.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/376: read d2/d13/f34 [507633,102350] 0 2024-03-18T14:43:15.944 INFO:tasks.workunit.client.0.smithi087.stdout:6/388: symlink d3/d7/d25/d62/l82 0 2024-03-18T14:43:15.946 INFO:tasks.workunit.client.1.smithi129.stdout:7/224: creat d4/d2d/d3a/f46 x:0 0 0 2024-03-18T14:43:15.946 INFO:tasks.workunit.client.1.smithi129.stdout:5/219: dread d0/dc/d18/d2b/f30 [0,4194304] 0 2024-03-18T14:43:15.946 INFO:tasks.workunit.client.0.smithi087.stdout:5/446: sync 2024-03-18T14:43:15.946 INFO:tasks.workunit.client.0.smithi087.stdout:1/469: unlink d3/d1d/d67/f8a 0 2024-03-18T14:43:15.947 INFO:tasks.workunit.client.1.smithi129.stdout:3/192: mknod d4/d38/c3b 0 2024-03-18T14:43:15.947 INFO:tasks.workunit.client.1.smithi129.stdout:3/193: chown d4/dd/d1f/f26 412 1 2024-03-18T14:43:15.948 INFO:tasks.workunit.client.1.smithi129.stdout:3/194: write d4/dd/d1f/f26 [3366023,49980] 0 2024-03-18T14:43:15.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/462: fdatasync d0/f6d 0 2024-03-18T14:43:15.949 INFO:tasks.workunit.client.0.smithi087.stdout:3/463: readlink d0/d3/d4f/l5a 0 2024-03-18T14:43:15.949 INFO:tasks.workunit.client.1.smithi129.stdout:2/188: unlink d7/d1f/d20/d2a/f37 0 2024-03-18T14:43:15.949 INFO:tasks.workunit.client.1.smithi129.stdout:2/189: chown d7/d1f/d20/c31 833 1 2024-03-18T14:43:15.950 INFO:tasks.workunit.client.1.smithi129.stdout:4/191: getdents d0/d19 0 2024-03-18T14:43:15.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/404: dread d0/d2/d4/f66 [0,4194304] 0 2024-03-18T14:43:15.951 INFO:tasks.workunit.client.1.smithi129.stdout:5/220: creat d0/dc/d18/d2b/f47 x:0 0 0 2024-03-18T14:43:15.956 INFO:tasks.workunit.client.0.smithi087.stdout:7/504: creat d1/d6/d29/d2f/d68/d65/fb1 x:0 0 0 2024-03-18T14:43:15.957 INFO:tasks.workunit.client.0.smithi087.stdout:9/504: dwrite db/d12/f20 [0,4194304] 0 2024-03-18T14:43:15.957 INFO:tasks.workunit.client.0.smithi087.stdout:4/377: mknod d2/db/d24/d30/d4d/c75 0 2024-03-18T14:43:15.959 INFO:tasks.workunit.client.1.smithi129.stdout:5/221: dread - d0/dc/d22/f35 zero size 2024-03-18T14:43:15.959 INFO:tasks.workunit.client.1.smithi129.stdout:4/192: mkdir d0/d9/d1e/d33 0 2024-03-18T14:43:15.959 INFO:tasks.workunit.client.1.smithi129.stdout:9/211: write d0/f13 [3068114,16659] 0 2024-03-18T14:43:15.959 INFO:tasks.workunit.client.0.smithi087.stdout:1/470: rmdir d3/d1d/d1e/d20 39 2024-03-18T14:43:15.961 INFO:tasks.workunit.client.1.smithi129.stdout:3/195: mkdir d4/d11/d34/d3c 0 2024-03-18T14:43:15.962 INFO:tasks.workunit.client.0.smithi087.stdout:5/447: unlink d13/d1b/d30/d6e/d88/c91 0 2024-03-18T14:43:15.962 INFO:tasks.workunit.client.0.smithi087.stdout:5/448: readlink d13/d1b/d30/l90 0 2024-03-18T14:43:15.965 INFO:tasks.workunit.client.1.smithi129.stdout:0/259: dwrite d0/d23/f3f [4194304,4194304] 0 2024-03-18T14:43:15.966 INFO:tasks.workunit.client.1.smithi129.stdout:1/228: dwrite d1/d2/f34 [0,4194304] 0 2024-03-18T14:43:15.968 INFO:tasks.workunit.client.1.smithi129.stdout:6/242: getdents d3/d5 0 2024-03-18T14:43:15.968 INFO:tasks.workunit.client.0.smithi087.stdout:2/400: getdents d2/d4/d22/d24/d65/d7f 0 2024-03-18T14:43:15.969 INFO:tasks.workunit.client.1.smithi129.stdout:6/243: write d3/d30/de/f22 [296038,28839] 0 2024-03-18T14:43:15.969 INFO:tasks.workunit.client.0.smithi087.stdout:2/401: fdatasync d2/d44/d72/f7c 0 2024-03-18T14:43:15.970 INFO:tasks.workunit.client.1.smithi129.stdout:9/212: creat d0/db/d1f/d20/d25/f3d x:0 0 0 2024-03-18T14:43:15.970 INFO:tasks.workunit.client.0.smithi087.stdout:2/402: fdatasync d2/d44/f75 0 2024-03-18T14:43:15.972 INFO:tasks.workunit.client.1.smithi129.stdout:3/196: dread d4/f21 [0,4194304] 0 2024-03-18T14:43:15.972 INFO:tasks.workunit.client.1.smithi129.stdout:5/222: truncate d0/dc/d18/f1d 2364464 0 2024-03-18T14:43:15.974 INFO:tasks.workunit.client.0.smithi087.stdout:9/505: rename db/d18/d3a/f4f to db/d18/d1c/d69/d6f/f9e 0 2024-03-18T14:43:15.974 INFO:tasks.workunit.client.1.smithi129.stdout:0/260: readlink d0/l18 0 2024-03-18T14:43:15.974 INFO:tasks.workunit.client.1.smithi129.stdout:9/213: dwrite d0/f1b [0,4194304] 0 2024-03-18T14:43:15.975 INFO:tasks.workunit.client.0.smithi087.stdout:2/403: dwrite d2/d4/d22/f36 [4194304,4194304] 0 2024-03-18T14:43:15.975 INFO:tasks.workunit.client.1.smithi129.stdout:9/214: chown d0/f5 34789199 1 2024-03-18T14:43:15.976 INFO:tasks.workunit.client.1.smithi129.stdout:1/229: symlink d1/d2/d28/l47 0 2024-03-18T14:43:15.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/464: mknod d0/d1c/c88 0 2024-03-18T14:43:15.978 INFO:tasks.workunit.client.0.smithi087.stdout:0/405: link d0/d1a/d80/d88/f38 d0/d2/d4/d19/d5a/f9e 0 2024-03-18T14:43:15.979 INFO:tasks.workunit.client.0.smithi087.stdout:4/378: mknod d2/db/c76 0 2024-03-18T14:43:15.980 INFO:tasks.workunit.client.0.smithi087.stdout:3/465: dwrite d0/d3/df/f14 [4194304,4194304] 0 2024-03-18T14:43:15.981 INFO:tasks.workunit.client.0.smithi087.stdout:8/426: getdents d1/d6/d9/d5d 0 2024-03-18T14:43:15.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/223: write d0/f6 [4936298,120892] 0 2024-03-18T14:43:15.982 INFO:tasks.workunit.client.0.smithi087.stdout:1/471: readlink d3/d1d/d1e/d43/d50/d72/l8e 0 2024-03-18T14:43:15.983 INFO:tasks.workunit.client.1.smithi129.stdout:5/224: chown d0/dc/d18/d2b/f47 185998784 1 2024-03-18T14:43:15.983 INFO:tasks.workunit.client.1.smithi129.stdout:3/197: creat d4/dd/f3d x:0 0 0 2024-03-18T14:43:15.985 INFO:tasks.workunit.client.0.smithi087.stdout:7/505: dread d1/d6/d29/d2f/d68/d65/d60/f93 [0,4194304] 0 2024-03-18T14:43:15.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/190: getdents d7/d1f/d20/d36 0 2024-03-18T14:43:15.987 INFO:tasks.workunit.client.0.smithi087.stdout:2/404: fsync d2/d4/f16 0 2024-03-18T14:43:15.989 INFO:tasks.workunit.client.1.smithi129.stdout:8/232: dwrite d9/d11/d1a/d32/d3a/f29 [0,4194304] 0 2024-03-18T14:43:15.989 INFO:tasks.workunit.client.0.smithi087.stdout:0/406: write d0/d1a/d80/d88/f38 [1243399,86168] 0 2024-03-18T14:43:15.991 INFO:tasks.workunit.client.0.smithi087.stdout:4/379: unlink d2/db/f71 0 2024-03-18T14:43:15.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/193: truncate d0/f13 5096358 0 2024-03-18T14:43:15.992 INFO:tasks.workunit.client.1.smithi129.stdout:4/194: write d0/f1c [2194458,20483] 0 2024-03-18T14:43:15.992 INFO:tasks.workunit.client.0.smithi087.stdout:0/407: dread d0/d1a/d80/d88/f2b [0,4194304] 0 2024-03-18T14:43:15.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/466: creat d0/de/d30/d46/f89 x:0 0 0 2024-03-18T14:43:15.994 INFO:tasks.workunit.client.0.smithi087.stdout:1/472: symlink d3/l90 0 2024-03-18T14:43:15.994 INFO:tasks.workunit.client.1.smithi129.stdout:5/225: read d0/fb [3416609,92330] 0 2024-03-18T14:43:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:0/408: read d0/d2/d4/d19/f72 [155453,26723] 0 2024-03-18T14:43:15.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/506: write d1/d6/d29/d2f/d68/d65/d60/f94 [537384,119703] 0 2024-03-18T14:43:15.996 INFO:tasks.workunit.client.0.smithi087.stdout:7/507: chown d1/d6/d29/d2f/f33 159 1 2024-03-18T14:43:15.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/467: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:15.997 INFO:tasks.workunit.client.0.smithi087.stdout:2/405: creat d2/d4/d22/d2c/d3a/d40/f80 x:0 0 0 2024-03-18T14:43:15.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/406: chown d2/d4/fd 989 1 2024-03-18T14:43:15.999 INFO:tasks.workunit.client.1.smithi129.stdout:9/215: mkdir d0/db/d1f/d33/d3e 0 2024-03-18T14:43:16.000 INFO:tasks.workunit.client.1.smithi129.stdout:9/216: chown d0/db/d1f/d20/d26/c31 134505966 1 2024-03-18T14:43:16.001 INFO:tasks.workunit.client.1.smithi129.stdout:8/233: unlink d9/d11/d1a/f4a 0 2024-03-18T14:43:16.003 INFO:tasks.workunit.client.0.smithi087.stdout:6/389: sync 2024-03-18T14:43:16.004 INFO:tasks.workunit.client.1.smithi129.stdout:9/217: dread d0/db/d1f/d20/d26/d19/d29/f2d [0,4194304] 0 2024-03-18T14:43:16.007 INFO:tasks.workunit.client.0.smithi087.stdout:9/506: link db/d18/d3a/f6b db/d18/d3a/f9f 0 2024-03-18T14:43:16.008 INFO:tasks.workunit.client.0.smithi087.stdout:7/508: symlink d1/d6/d29/d2f/d68/d65/d60/d66/lb2 0 2024-03-18T14:43:16.008 INFO:tasks.workunit.client.1.smithi129.stdout:4/195: mknod d0/d9/d1e/c34 0 2024-03-18T14:43:16.008 INFO:tasks.workunit.client.1.smithi129.stdout:3/198: symlink d4/d11/d34/d3c/l3e 0 2024-03-18T14:43:16.008 INFO:tasks.workunit.client.1.smithi129.stdout:0/261: link d0/d23/d35/d3b/l2f d0/d14/d3a/l4f 0 2024-03-18T14:43:16.009 INFO:tasks.workunit.client.0.smithi087.stdout:6/390: write d3/d7/f57 [741205,86239] 0 2024-03-18T14:43:16.009 INFO:tasks.workunit.client.1.smithi129.stdout:4/196: fsync d0/d1a/f25 0 2024-03-18T14:43:16.010 INFO:tasks.workunit.client.1.smithi129.stdout:9/218: mknod d0/db/d11/c3f 0 2024-03-18T14:43:16.010 INFO:tasks.workunit.client.0.smithi087.stdout:2/407: mkdir d2/d4/d22/d2c/d3a/d76/d81 0 2024-03-18T14:43:16.011 INFO:tasks.workunit.client.1.smithi129.stdout:4/197: stat d0/d9/f17 0 2024-03-18T14:43:16.011 INFO:tasks.workunit.client.0.smithi087.stdout:6/391: chown d3/d7/d25/f4d 43660 1 2024-03-18T14:43:16.011 INFO:tasks.workunit.client.1.smithi129.stdout:9/219: fdatasync d0/db/d1f/f30 0 2024-03-18T14:43:16.012 INFO:tasks.workunit.client.0.smithi087.stdout:4/380: dwrite d2/f21 [0,4194304] 0 2024-03-18T14:43:16.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/198: rename d0/d19 to d0/d19/d1d/d2e/d35 22 2024-03-18T14:43:16.013 INFO:tasks.workunit.client.0.smithi087.stdout:4/381: stat d2/db/de/l6d 0 2024-03-18T14:43:16.013 INFO:tasks.workunit.client.1.smithi129.stdout:9/220: read d0/db/d11/f1a [857076,21541] 0 2024-03-18T14:43:16.014 INFO:tasks.workunit.client.1.smithi129.stdout:5/226: dwrite d0/df/f3c [8388608,4194304] 0 2024-03-18T14:43:16.016 INFO:tasks.workunit.client.1.smithi129.stdout:9/221: dread d0/db/f18 [0,4194304] 0 2024-03-18T14:43:16.016 INFO:tasks.workunit.client.1.smithi129.stdout:7/225: sync 2024-03-18T14:43:16.016 INFO:tasks.workunit.client.1.smithi129.stdout:3/199: mkdir d4/d11/d34/d3c/d3f 0 2024-03-18T14:43:16.018 INFO:tasks.workunit.client.1.smithi129.stdout:4/199: chown d0/l12 113 1 2024-03-18T14:43:16.018 INFO:tasks.workunit.client.1.smithi129.stdout:4/200: dread - d0/d9/d1e/f29 zero size 2024-03-18T14:43:16.019 INFO:tasks.workunit.client.0.smithi087.stdout:9/507: rename db/d12/c1b to db/d18/d1c/d69/d6f/ca0 0 2024-03-18T14:43:16.020 INFO:tasks.workunit.client.1.smithi129.stdout:6/244: dread d3/d30/de/f22 [0,4194304] 0 2024-03-18T14:43:16.020 INFO:tasks.workunit.client.1.smithi129.stdout:5/227: unlink d0/dc/d22/l2f 0 2024-03-18T14:43:16.020 INFO:tasks.workunit.client.0.smithi087.stdout:5/449: dread d13/d1b/d27/f2c [0,4194304] 0 2024-03-18T14:43:16.022 INFO:tasks.workunit.client.0.smithi087.stdout:6/392: symlink d3/d7/d25/d62/d7c/d29/d22/d47/l83 0 2024-03-18T14:43:16.022 INFO:tasks.workunit.client.0.smithi087.stdout:4/382: fsync d2/d13/d28/f2d 0 2024-03-18T14:43:16.022 INFO:tasks.workunit.client.1.smithi129.stdout:0/262: mkdir d0/d23/d35/d50 0 2024-03-18T14:43:16.022 INFO:tasks.workunit.client.1.smithi129.stdout:9/222: symlink d0/db/d2e/l40 0 2024-03-18T14:43:16.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/393: chown d3/d7/d25/d62/d7c/d29/d7d 3181119 1 2024-03-18T14:43:16.023 INFO:tasks.workunit.client.1.smithi129.stdout:0/263: fdatasync d0/d23/f3f 0 2024-03-18T14:43:16.024 INFO:tasks.workunit.client.1.smithi129.stdout:4/201: dwrite d0/d1a/f24 [0,4194304] 0 2024-03-18T14:43:16.024 INFO:tasks.workunit.client.1.smithi129.stdout:4/202: chown d0/d1a 4583792 1 2024-03-18T14:43:16.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/450: mkdir d13/d1b/d27/d28/d9a 0 2024-03-18T14:43:16.026 INFO:tasks.workunit.client.1.smithi129.stdout:7/226: creat d4/d7/d8/f47 x:0 0 0 2024-03-18T14:43:16.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/200: truncate d4/d38/f1b 2834554 0 2024-03-18T14:43:16.026 INFO:tasks.workunit.client.1.smithi129.stdout:7/227: dread - d4/d7/f43 zero size 2024-03-18T14:43:16.027 INFO:tasks.workunit.client.0.smithi087.stdout:4/383: stat d2/d13/d28/f40 0 2024-03-18T14:43:16.028 INFO:tasks.workunit.client.1.smithi129.stdout:6/245: rename d3/d30/de/f35 to d3/d30/de/d49/f50 0 2024-03-18T14:43:16.029 INFO:tasks.workunit.client.1.smithi129.stdout:6/246: fdatasync d3/d30/f1e 0 2024-03-18T14:43:16.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/247: write d3/d6/f4e [1030530,55055] 0 2024-03-18T14:43:16.030 INFO:tasks.workunit.client.0.smithi087.stdout:3/468: dread d0/d3/df/f3f [0,4194304] 0 2024-03-18T14:43:16.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/248: write f1 [933041,74577] 0 2024-03-18T14:43:16.031 INFO:tasks.workunit.client.0.smithi087.stdout:5/451: rmdir d13/d1b/d30/d6e/d88 39 2024-03-18T14:43:16.032 INFO:tasks.workunit.client.1.smithi129.stdout:3/201: mknod d4/d11/c40 0 2024-03-18T14:43:16.037 INFO:tasks.workunit.client.1.smithi129.stdout:7/228: symlink d4/d7/l48 0 2024-03-18T14:43:16.040 INFO:tasks.workunit.client.0.smithi087.stdout:5/452: symlink d13/d1b/d7e/l9b 0 2024-03-18T14:43:16.040 INFO:tasks.workunit.client.0.smithi087.stdout:7/509: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:16.041 INFO:tasks.workunit.client.1.smithi129.stdout:5/228: dread d0/f4 [0,4194304] 0 2024-03-18T14:43:16.041 INFO:tasks.workunit.client.1.smithi129.stdout:2/191: sync 2024-03-18T14:43:16.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/508: getdents db/d18/d1c 0 2024-03-18T14:43:16.043 INFO:tasks.workunit.client.0.smithi087.stdout:2/408: getdents d2/d4/d22/d2c/d3a 0 2024-03-18T14:43:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:5/453: dread d13/d1b/d30/f5d [0,4194304] 0 2024-03-18T14:43:16.044 INFO:tasks.workunit.client.0.smithi087.stdout:7/510: symlink d1/d6/da/d42/d67/lb3 0 2024-03-18T14:43:16.045 INFO:tasks.workunit.client.0.smithi087.stdout:5/454: write d13/d1b/f94 [64986,71809] 0 2024-03-18T14:43:16.046 INFO:tasks.workunit.client.1.smithi129.stdout:1/230: dwrite d1/d18/d19/f37 [0,4194304] 0 2024-03-18T14:43:16.048 INFO:tasks.workunit.client.1.smithi129.stdout:8/234: dwrite d9/d11/d1a/f30 [0,4194304] 0 2024-03-18T14:43:16.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/427: write d1/d6/d2f/f31 [1750380,73879] 0 2024-03-18T14:43:16.050 INFO:tasks.workunit.client.0.smithi087.stdout:8/428: fsync d1/d6/d14/f27 0 2024-03-18T14:43:16.053 INFO:tasks.workunit.client.1.smithi129.stdout:0/264: creat d0/d23/d35/d50/f51 x:0 0 0 2024-03-18T14:43:16.053 INFO:tasks.workunit.client.0.smithi087.stdout:1/473: write d3/d1d/d1e/d20/f56 [1438651,16224] 0 2024-03-18T14:43:16.053 INFO:tasks.workunit.client.1.smithi129.stdout:0/265: chown d0/f1e 292653 1 2024-03-18T14:43:16.054 INFO:tasks.workunit.client.0.smithi087.stdout:1/474: dread - d3/d3c/f8c zero size 2024-03-18T14:43:16.054 INFO:tasks.workunit.client.0.smithi087.stdout:1/475: fsync d3/d3c/f8c 0 2024-03-18T14:43:16.054 INFO:tasks.workunit.client.1.smithi129.stdout:6/249: creat d3/d6/f51 x:0 0 0 2024-03-18T14:43:16.055 INFO:tasks.workunit.client.0.smithi087.stdout:6/394: truncate d3/d7/f57 49963 0 2024-03-18T14:43:16.058 INFO:tasks.workunit.client.1.smithi129.stdout:3/202: mkdir d4/dd/d41 0 2024-03-18T14:43:16.058 INFO:tasks.workunit.client.0.smithi087.stdout:1/476: dwrite d3/d1d/d1e/d20/f5c [0,4194304] 0 2024-03-18T14:43:16.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/384: write d2/db/de/f2f [872834,24535] 0 2024-03-18T14:43:16.063 INFO:tasks.workunit.client.1.smithi129.stdout:1/231: rename d1/d18/d19/c3a to d1/d2/c48 0 2024-03-18T14:43:16.063 INFO:tasks.workunit.client.0.smithi087.stdout:8/429: creat d1/d6/d9/d5d/f8f x:0 0 0 2024-03-18T14:43:16.064 INFO:tasks.workunit.client.1.smithi129.stdout:8/235: write d9/f1d [4856232,71790] 0 2024-03-18T14:43:16.065 INFO:tasks.workunit.client.0.smithi087.stdout:6/395: symlink d3/d7/d25/d62/l84 0 2024-03-18T14:43:16.065 INFO:tasks.workunit.client.1.smithi129.stdout:9/223: rmdir d0/db/d2e/d37 0 2024-03-18T14:43:16.066 INFO:tasks.workunit.client.0.smithi087.stdout:2/409: creat d2/d4/d22/d2c/d3a/d76/d81/f82 x:0 0 0 2024-03-18T14:43:16.067 INFO:tasks.workunit.client.1.smithi129.stdout:4/203: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:16.067 INFO:tasks.workunit.client.0.smithi087.stdout:2/410: chown d2/d4/d22/c23 1828907699 1 2024-03-18T14:43:16.067 INFO:tasks.workunit.client.1.smithi129.stdout:9/224: fdatasync d0/db/d1f/d20/d26/d19/f21 0 2024-03-18T14:43:16.067 INFO:tasks.workunit.client.0.smithi087.stdout:2/411: write d2/f1d [3287667,28309] 0 2024-03-18T14:43:16.068 INFO:tasks.workunit.client.0.smithi087.stdout:2/412: chown d2/d4/d22/d2c/d3a/d68 167 1 2024-03-18T14:43:16.068 INFO:tasks.workunit.client.1.smithi129.stdout:0/266: creat d0/d23/d35/d50/f52 x:0 0 0 2024-03-18T14:43:16.069 INFO:tasks.workunit.client.1.smithi129.stdout:8/236: dread d9/d11/d1a/f3e [0,4194304] 0 2024-03-18T14:43:16.069 INFO:tasks.workunit.client.0.smithi087.stdout:0/409: sync 2024-03-18T14:43:16.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/396: creat d3/d7/f85 x:0 0 0 2024-03-18T14:43:16.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/509: getdents db/d18/d3a/d87 0 2024-03-18T14:43:16.072 INFO:tasks.workunit.client.1.smithi129.stdout:7/229: mkdir d4/d7/d38/d49 0 2024-03-18T14:43:16.073 INFO:tasks.workunit.client.1.smithi129.stdout:7/230: chown d4/d2d/f34 112193 1 2024-03-18T14:43:16.073 INFO:tasks.workunit.client.0.smithi087.stdout:4/385: symlink d2/l77 0 2024-03-18T14:43:16.074 INFO:tasks.workunit.client.1.smithi129.stdout:3/203: mknod d4/d11/c42 0 2024-03-18T14:43:16.074 INFO:tasks.workunit.client.1.smithi129.stdout:2/192: dread d7/d1f/d34/f18 [0,4194304] 0 2024-03-18T14:43:16.074 INFO:tasks.workunit.client.1.smithi129.stdout:7/231: chown d4/d7/f25 63637 1 2024-03-18T14:43:16.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/477: rename d3/d1d/d1f/f2e to d3/d1d/d1f/f91 0 2024-03-18T14:43:16.076 INFO:tasks.workunit.client.0.smithi087.stdout:0/410: creat d0/d1a/d34/f9f x:0 0 0 2024-03-18T14:43:16.077 INFO:tasks.workunit.client.1.smithi129.stdout:4/204: creat d0/d19/d1d/f36 x:0 0 0 2024-03-18T14:43:16.080 INFO:tasks.workunit.client.1.smithi129.stdout:9/225: rename d0/db/d1f/d20/d26/d19/l22 to d0/db/d1f/d20/l41 0 2024-03-18T14:43:16.080 INFO:tasks.workunit.client.0.smithi087.stdout:7/511: write d1/d6/da/f25 [2375065,42657] 0 2024-03-18T14:43:16.081 INFO:tasks.workunit.client.0.smithi087.stdout:2/413: dread d2/d4/d22/d2c/f2e [0,4194304] 0 2024-03-18T14:43:16.082 INFO:tasks.workunit.client.0.smithi087.stdout:0/411: dwrite d0/d1a/d80/d88/f15 [0,4194304] 0 2024-03-18T14:43:16.082 INFO:tasks.workunit.client.0.smithi087.stdout:2/414: fsync d2/f43 0 2024-03-18T14:43:16.083 INFO:tasks.workunit.client.1.smithi129.stdout:3/204: creat d4/d11/f43 x:0 0 0 2024-03-18T14:43:16.083 INFO:tasks.workunit.client.0.smithi087.stdout:6/397: write d3/d7/d25/d62/d7c/d29/f56 [1501633,124086] 0 2024-03-18T14:43:16.084 INFO:tasks.workunit.client.0.smithi087.stdout:2/415: fdatasync d2/d4/f6a 0 2024-03-18T14:43:16.084 INFO:tasks.workunit.client.1.smithi129.stdout:5/229: sync 2024-03-18T14:43:16.085 INFO:tasks.workunit.client.0.smithi087.stdout:5/455: getdents d13/d1b/d30 0 2024-03-18T14:43:16.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/412: fdatasync d0/d1a/d7b/d2a/d85/f7e 0 2024-03-18T14:43:16.085 INFO:tasks.workunit.client.1.smithi129.stdout:5/230: read d0/f4 [59118,99341] 0 2024-03-18T14:43:16.086 INFO:tasks.workunit.client.1.smithi129.stdout:2/193: dread d7/fc [0,4194304] 0 2024-03-18T14:43:16.086 INFO:tasks.workunit.client.0.smithi087.stdout:7/512: chown d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f91 1388 1 2024-03-18T14:43:16.086 INFO:tasks.workunit.client.1.smithi129.stdout:1/232: write d1/d2/f3 [856550,40456] 0 2024-03-18T14:43:16.087 INFO:tasks.workunit.client.0.smithi087.stdout:1/478: symlink d3/d1d/d1e/d20/d7a/l92 0 2024-03-18T14:43:16.088 INFO:tasks.workunit.client.0.smithi087.stdout:0/413: dread - d0/d2/d4/d27/f9b zero size 2024-03-18T14:43:16.089 INFO:tasks.workunit.client.1.smithi129.stdout:8/237: write d9/f1f [3717578,103366] 0 2024-03-18T14:43:16.089 INFO:tasks.workunit.client.1.smithi129.stdout:6/250: truncate d3/d30/f20 3301981 0 2024-03-18T14:43:16.089 INFO:tasks.workunit.client.1.smithi129.stdout:8/238: write f8 [1338884,3246] 0 2024-03-18T14:43:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:0/414: readlink d0/d2/d4/d19/d24/d5d/l75 0 2024-03-18T14:43:16.091 INFO:tasks.workunit.client.0.smithi087.stdout:9/510: dread db/d18/d3a/f9f [0,4194304] 0 2024-03-18T14:43:16.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/513: mknod d1/d6/d29/d2f/d68/d65/d72/cb4 0 2024-03-18T14:43:16.094 INFO:tasks.workunit.client.1.smithi129.stdout:0/267: mkdir d0/d14/d53 0 2024-03-18T14:43:16.095 INFO:tasks.workunit.client.0.smithi087.stdout:4/386: fsync d2/db/d67/f6a 0 2024-03-18T14:43:16.095 INFO:tasks.workunit.client.0.smithi087.stdout:6/398: dwrite d3/d7/f24 [0,4194304] 0 2024-03-18T14:43:16.095 INFO:tasks.workunit.client.0.smithi087.stdout:3/469: sync 2024-03-18T14:43:16.096 INFO:tasks.workunit.client.1.smithi129.stdout:4/205: mknod d0/d19/d1d/c37 0 2024-03-18T14:43:16.096 INFO:tasks.workunit.client.0.smithi087.stdout:2/416: dwrite d2/d4/d22/f39 [0,4194304] 0 2024-03-18T14:43:16.096 INFO:tasks.workunit.client.0.smithi087.stdout:0/415: symlink d0/d49/la0 0 2024-03-18T14:43:16.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/430: dread d1/d6/d2f/d44/d45/f70 [4194304,4194304] 0 2024-03-18T14:43:16.097 INFO:tasks.workunit.client.0.smithi087.stdout:9/511: mkdir db/d18/d3a/d87/da1 0 2024-03-18T14:43:16.098 INFO:tasks.workunit.client.0.smithi087.stdout:8/431: chown d1/d6/d9/l34 1575021 1 2024-03-18T14:43:16.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/416: stat d0/d2/d4/d19/d24/f63 0 2024-03-18T14:43:16.099 INFO:tasks.workunit.client.1.smithi129.stdout:7/232: rename d4/d7/l48 to d4/d2d/d2e/d45/l4a 0 2024-03-18T14:43:16.100 INFO:tasks.workunit.client.0.smithi087.stdout:2/417: write d2/d4/d22/d2c/d3a/d76/d81/f82 [286026,100140] 0 2024-03-18T14:43:16.100 INFO:tasks.workunit.client.1.smithi129.stdout:5/231: readlink d0/l7 0 2024-03-18T14:43:16.101 INFO:tasks.workunit.client.0.smithi087.stdout:7/514: unlink d1/d6/fa1 0 2024-03-18T14:43:16.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/417: stat d0/d1a/d80/d88/f2e 0 2024-03-18T14:43:16.102 INFO:tasks.workunit.client.1.smithi129.stdout:1/233: rmdir d1/d18/d19 39 2024-03-18T14:43:16.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/226: dread d0/f13 [0,4194304] 0 2024-03-18T14:43:16.104 INFO:tasks.workunit.client.1.smithi129.stdout:9/227: dread - d0/db/d1f/d20/d25/f3d zero size 2024-03-18T14:43:16.105 INFO:tasks.workunit.client.1.smithi129.stdout:2/194: dwrite d7/d1f/d34/f18 [0,4194304] 0 2024-03-18T14:43:16.105 INFO:tasks.workunit.client.1.smithi129.stdout:8/239: symlink d9/d11/d1a/d32/d3a/l50 0 2024-03-18T14:43:16.106 INFO:tasks.workunit.client.1.smithi129.stdout:1/234: dread d1/d2/f3d [0,4194304] 0 2024-03-18T14:43:16.106 INFO:tasks.workunit.client.1.smithi129.stdout:4/206: creat d0/d19/f38 x:0 0 0 2024-03-18T14:43:16.107 INFO:tasks.workunit.client.1.smithi129.stdout:1/235: chown d1/d2/l15 6903 1 2024-03-18T14:43:16.108 INFO:tasks.workunit.client.0.smithi087.stdout:6/399: dwrite d3/d7/d25/d62/d7c/d29/d22/f2c [0,4194304] 0 2024-03-18T14:43:16.108 INFO:tasks.workunit.client.0.smithi087.stdout:8/432: dwrite d1/f6d [0,4194304] 0 2024-03-18T14:43:16.110 INFO:tasks.workunit.client.0.smithi087.stdout:4/387: dwrite d2/f63 [0,4194304] 0 2024-03-18T14:43:16.111 INFO:tasks.workunit.client.0.smithi087.stdout:0/418: fdatasync d0/f10 0 2024-03-18T14:43:16.112 INFO:tasks.workunit.client.0.smithi087.stdout:4/388: dread - d2/db/f43 zero size 2024-03-18T14:43:16.113 INFO:tasks.workunit.client.0.smithi087.stdout:5/456: dwrite d13/f17 [0,4194304] 0 2024-03-18T14:43:16.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/512: link db/d31/f36 db/d18/d3a/fa2 0 2024-03-18T14:43:16.116 INFO:tasks.workunit.client.0.smithi087.stdout:6/400: creat d3/d7/f86 x:0 0 0 2024-03-18T14:43:16.117 INFO:tasks.workunit.client.0.smithi087.stdout:9/513: write db/d18/d1e/f46 [2240157,27379] 0 2024-03-18T14:43:16.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/433: symlink d1/d6/d9/d5d/l90 0 2024-03-18T14:43:16.118 INFO:tasks.workunit.client.0.smithi087.stdout:1/479: dread d3/d1d/d1e/d20/d7a/f83 [0,4194304] 0 2024-03-18T14:43:16.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/480: read d3/d1d/d45/f59 [2188089,387] 0 2024-03-18T14:43:16.120 INFO:tasks.workunit.client.0.smithi087.stdout:7/515: symlink d1/d6/d16/da6/lb5 0 2024-03-18T14:43:16.123 INFO:tasks.workunit.client.1.smithi129.stdout:7/233: symlink d4/d2d/d2e/d42/l4b 0 2024-03-18T14:43:16.124 INFO:tasks.workunit.client.0.smithi087.stdout:0/419: rmdir d0/d2/d6b 39 2024-03-18T14:43:16.125 INFO:tasks.workunit.client.1.smithi129.stdout:7/234: dread d4/d7/f25 [0,4194304] 0 2024-03-18T14:43:16.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/457: truncate d13/d1b/d27/d35/d3b/f6a 1187725 0 2024-03-18T14:43:16.126 INFO:tasks.workunit.client.1.smithi129.stdout:7/235: dread - d4/d2d/d3a/f46 zero size 2024-03-18T14:43:16.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/458: readlink d13/d1b/d70/l74 0 2024-03-18T14:43:16.127 INFO:tasks.workunit.client.1.smithi129.stdout:7/236: fsync d4/d7/d8/f3d 0 2024-03-18T14:43:16.130 INFO:tasks.workunit.client.1.smithi129.stdout:6/251: link d3/d30/c43 d3/d30/c52 0 2024-03-18T14:43:16.135 INFO:tasks.workunit.client.1.smithi129.stdout:0/268: rename d0/d14/c16 to d0/d23/d35/c54 0 2024-03-18T14:43:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/514: mknod db/d18/d51/d7b/ca3 0 2024-03-18T14:43:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:1/481: link d3/d1d/d1e/d43/d50/f58 d3/f93 0 2024-03-18T14:43:16.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/515: readlink db/d12/l14 0 2024-03-18T14:43:16.137 INFO:tasks.workunit.client.0.smithi087.stdout:8/434: truncate d1/d6/f1e 2290190 0 2024-03-18T14:43:16.138 INFO:tasks.workunit.client.1.smithi129.stdout:7/237: creat d4/d2d/d2e/d45/f4c x:0 0 0 2024-03-18T14:43:16.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/420: creat d0/d1a/d8c/fa1 x:0 0 0 2024-03-18T14:43:16.138 INFO:tasks.workunit.client.1.smithi129.stdout:6/252: creat d3/d5/d2b/f53 x:0 0 0 2024-03-18T14:43:16.139 INFO:tasks.workunit.client.0.smithi087.stdout:4/389: truncate d2/db/d24/d30/f4a 133624 0 2024-03-18T14:43:16.139 INFO:tasks.workunit.client.1.smithi129.stdout:1/236: truncate d1/f9 770754 0 2024-03-18T14:43:16.140 INFO:tasks.workunit.client.1.smithi129.stdout:1/237: readlink d1/d35/l41 0 2024-03-18T14:43:16.141 INFO:tasks.workunit.client.1.smithi129.stdout:7/238: rmdir d4 39 2024-03-18T14:43:16.144 INFO:tasks.workunit.client.1.smithi129.stdout:6/253: truncate d3/d5/f13 1925205 0 2024-03-18T14:43:16.144 INFO:tasks.workunit.client.0.smithi087.stdout:6/401: truncate d3/d7/d25/d62/d7c/d29/d22/d61/f70 8257418 0 2024-03-18T14:43:16.145 INFO:tasks.workunit.client.1.smithi129.stdout:6/254: write d3/d5/d2b/f53 [109507,70002] 0 2024-03-18T14:43:16.145 INFO:tasks.workunit.client.1.smithi129.stdout:8/240: dread f4 [0,4194304] 0 2024-03-18T14:43:16.146 INFO:tasks.workunit.client.0.smithi087.stdout:3/470: dwrite d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:16.146 INFO:tasks.workunit.client.1.smithi129.stdout:6/255: read - d3/d30/df/f42 zero size 2024-03-18T14:43:16.147 INFO:tasks.workunit.client.1.smithi129.stdout:6/256: write d3/d6/f4e [420777,2947] 0 2024-03-18T14:43:16.147 INFO:tasks.workunit.client.0.smithi087.stdout:3/471: chown d0/d3/d10/c38 15349526 1 2024-03-18T14:43:16.147 INFO:tasks.workunit.client.0.smithi087.stdout:6/402: write d3/d7/d25/d62/d7c/d29/f40 [1650554,65478] 0 2024-03-18T14:43:16.148 INFO:tasks.workunit.client.1.smithi129.stdout:3/205: truncate d4/d11/d1d/d27/f2b 3930036 0 2024-03-18T14:43:16.149 INFO:tasks.workunit.client.1.smithi129.stdout:2/195: write d7/d1f/d34/f15 [1925830,98656] 0 2024-03-18T14:43:16.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/232: write d0/f14 [2325000,82639] 0 2024-03-18T14:43:16.152 INFO:tasks.workunit.client.1.smithi129.stdout:5/233: readlink d0/dc/l3f 0 2024-03-18T14:43:16.152 INFO:tasks.workunit.client.1.smithi129.stdout:9/228: dwrite d0/f5 [4194304,4194304] 0 2024-03-18T14:43:16.152 INFO:tasks.workunit.client.0.smithi087.stdout:2/418: dread d2/d4/d22/d2c/f30 [0,4194304] 0 2024-03-18T14:43:16.153 INFO:tasks.workunit.client.0.smithi087.stdout:4/390: creat d2/db/d67/f78 x:0 0 0 2024-03-18T14:43:16.154 INFO:tasks.workunit.client.1.smithi129.stdout:1/238: mkdir d1/d18/d19/d49 0 2024-03-18T14:43:16.155 INFO:tasks.workunit.client.1.smithi129.stdout:8/241: symlink d9/l51 0 2024-03-18T14:43:16.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/234: dwrite d0/f6 [4194304,4194304] 0 2024-03-18T14:43:16.157 INFO:tasks.workunit.client.1.smithi129.stdout:9/229: read d0/db/fd [2427858,114430] 0 2024-03-18T14:43:16.157 INFO:tasks.workunit.client.0.smithi087.stdout:9/516: getdents db/d18/d1e/d28/d76/d80/d91 0 2024-03-18T14:43:16.157 INFO:tasks.workunit.client.0.smithi087.stdout:9/517: fdatasync db/d31/f6d 0 2024-03-18T14:43:16.158 INFO:tasks.workunit.client.1.smithi129.stdout:6/257: unlink d3/d5/f4d 0 2024-03-18T14:43:16.159 INFO:tasks.workunit.client.1.smithi129.stdout:3/206: symlink d4/d11/l44 0 2024-03-18T14:43:16.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/472: unlink d0/d1c/l64 0 2024-03-18T14:43:16.162 INFO:tasks.workunit.client.1.smithi129.stdout:0/269: truncate d0/fd 724936 0 2024-03-18T14:43:16.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/459: dread d13/d1b/d27/d35/d3b/f6a [0,4194304] 0 2024-03-18T14:43:16.169 INFO:tasks.workunit.client.1.smithi129.stdout:8/242: fsync f4 0 2024-03-18T14:43:16.171 INFO:tasks.workunit.client.0.smithi087.stdout:4/391: mknod d2/db/d24/d30/d4d/c79 0 2024-03-18T14:43:16.172 INFO:tasks.workunit.client.0.smithi087.stdout:7/516: link d1/d6/d29/d2f/d68/d65/d60/f64 d1/d97/fb6 0 2024-03-18T14:43:16.175 INFO:tasks.workunit.client.0.smithi087.stdout:4/392: chown d2/db/de/l6d 175 1 2024-03-18T14:43:16.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/460: creat d13/d1b/d27/d35/f9c x:0 0 0 2024-03-18T14:43:16.177 INFO:tasks.workunit.client.0.smithi087.stdout:0/421: dwrite d0/d1a/d7b/d26/d79/f44 [0,4194304] 0 2024-03-18T14:43:16.177 INFO:tasks.workunit.client.0.smithi087.stdout:8/435: dwrite d1/d6/d14/f5c [0,4194304] 0 2024-03-18T14:43:16.178 INFO:tasks.workunit.client.0.smithi087.stdout:5/461: fsync d13/f24 0 2024-03-18T14:43:16.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/419: dwrite d2/d4/f19 [0,4194304] 0 2024-03-18T14:43:16.181 INFO:tasks.workunit.client.0.smithi087.stdout:6/403: getdents d3/d7/d25/d62 0 2024-03-18T14:43:16.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/422: dread - d0/d1a/d80/f92 zero size 2024-03-18T14:43:16.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/436: chown d1/d6/d14/l7c 637 1 2024-03-18T14:43:16.183 INFO:tasks.workunit.client.0.smithi087.stdout:1/482: truncate d3/d1d/d1e/d43/d50/d72/f86 200394 0 2024-03-18T14:43:16.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/423: readlink d0/d1a/d80/d88/l46 0 2024-03-18T14:43:16.184 INFO:tasks.workunit.client.0.smithi087.stdout:6/404: rmdir d3/d7/d25/d62/d7c 39 2024-03-18T14:43:16.186 INFO:tasks.workunit.client.1.smithi129.stdout:6/258: creat d3/d30/df/d28/f54 x:0 0 0 2024-03-18T14:43:16.186 INFO:tasks.workunit.client.0.smithi087.stdout:1/483: dread d3/d1d/d1e/d20/d7a/f83 [0,4194304] 0 2024-03-18T14:43:16.187 INFO:tasks.workunit.client.1.smithi129.stdout:2/196: creat d7/d1f/d20/d2b/f39 x:0 0 0 2024-03-18T14:43:16.188 INFO:tasks.workunit.client.0.smithi087.stdout:3/473: dread d0/de/d30/d60/f6c [0,4194304] 0 2024-03-18T14:43:16.188 INFO:tasks.workunit.client.1.smithi129.stdout:3/207: rmdir d4/dd/d15 39 2024-03-18T14:43:16.188 INFO:tasks.workunit.client.1.smithi129.stdout:3/208: dread - d4/f9 zero size 2024-03-18T14:43:16.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/462: mknod d13/d1b/d30/d6e/d88/c9d 0 2024-03-18T14:43:16.189 INFO:tasks.workunit.client.1.smithi129.stdout:3/209: write d4/d38/f24 [1996332,87299] 0 2024-03-18T14:43:16.190 INFO:tasks.workunit.client.0.smithi087.stdout:5/463: dread - d13/d1b/d27/d28/f77 zero size 2024-03-18T14:43:16.193 INFO:tasks.workunit.client.0.smithi087.stdout:5/464: chown d13/d1b/d27/d28/f78 197 1 2024-03-18T14:43:16.193 INFO:tasks.workunit.client.0.smithi087.stdout:1/484: mkdir d3/d1d/d67/d94 0 2024-03-18T14:43:16.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/474: dwrite d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:16.195 INFO:tasks.workunit.client.1.smithi129.stdout:8/243: creat d9/d11/d1a/d32/d41/f52 x:0 0 0 2024-03-18T14:43:16.196 INFO:tasks.workunit.client.0.smithi087.stdout:4/393: dread d2/db/d24/f2b [0,4194304] 0 2024-03-18T14:43:16.197 INFO:tasks.workunit.client.1.smithi129.stdout:5/235: link d0/dc/d22/f1e d0/df/f48 0 2024-03-18T14:43:16.198 INFO:tasks.workunit.client.1.smithi129.stdout:5/236: chown d0/df/c31 225296 1 2024-03-18T14:43:16.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/420: dread d2/d4/fd [4194304,4194304] 0 2024-03-18T14:43:16.198 INFO:tasks.workunit.client.0.smithi087.stdout:6/405: dwrite d3/d7/d25/d62/d7c/d29/d22/f5d [0,4194304] 0 2024-03-18T14:43:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:3/475: dread - d0/de/d30/d46/f89 zero size 2024-03-18T14:43:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/406: stat d3/lc 0 2024-03-18T14:43:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:2/421: write d2/f32 [905926,40027] 0 2024-03-18T14:43:16.199 INFO:tasks.workunit.client.0.smithi087.stdout:3/476: chown d0/d1c/l3b 71569 1 2024-03-18T14:43:16.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/518: dread db/d18/d1c/d69/f8c [4194304,4194304] 0 2024-03-18T14:43:16.200 INFO:tasks.workunit.client.1.smithi129.stdout:6/259: unlink d3/c10 0 2024-03-18T14:43:16.201 INFO:tasks.workunit.client.1.smithi129.stdout:2/197: symlink d7/d1f/d20/d2d/l3a 0 2024-03-18T14:43:16.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/407: chown d3/d7/d25/d62/d7c/d29/d22/f5f 1982644300 1 2024-03-18T14:43:16.205 INFO:tasks.workunit.client.1.smithi129.stdout:3/210: chown d4/dd/d15/d31 1891093 1 2024-03-18T14:43:16.205 INFO:tasks.workunit.client.0.smithi087.stdout:7/517: dwrite d1/f20 [0,4194304] 0 2024-03-18T14:43:16.205 INFO:tasks.workunit.client.1.smithi129.stdout:3/211: write d4/d11/f43 [272134,7242] 0 2024-03-18T14:43:16.206 INFO:tasks.workunit.client.1.smithi129.stdout:3/212: chown d4/d11/d34/d3c/l3e 21732568 1 2024-03-18T14:43:16.207 INFO:tasks.workunit.client.1.smithi129.stdout:1/239: truncate d1/d2/f3b 212903 0 2024-03-18T14:43:16.209 INFO:tasks.workunit.client.0.smithi087.stdout:8/437: write d1/d6/d2f/d44/d45/d50/f5e [975227,125720] 0 2024-03-18T14:43:16.211 INFO:tasks.workunit.client.1.smithi129.stdout:9/230: dread d0/db/d1f/f23 [0,4194304] 0 2024-03-18T14:43:16.211 INFO:tasks.workunit.client.1.smithi129.stdout:5/237: dwrite d0/dc/d22/f35 [0,4194304] 0 2024-03-18T14:43:16.212 INFO:tasks.workunit.client.0.smithi087.stdout:5/465: creat d13/d1b/d27/d28/f9e x:0 0 0 2024-03-18T14:43:16.212 INFO:tasks.workunit.client.1.smithi129.stdout:5/238: readlink d0/dc/l29 0 2024-03-18T14:43:16.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/466: fsync d13/d1b/f46 0 2024-03-18T14:43:16.214 INFO:tasks.workunit.client.0.smithi087.stdout:1/485: dread d3/d1d/d1e/f36 [0,4194304] 0 2024-03-18T14:43:16.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/198: dread d7/fc [0,4194304] 0 2024-03-18T14:43:16.215 INFO:tasks.workunit.client.0.smithi087.stdout:3/477: write d0/f34 [1450821,10306] 0 2024-03-18T14:43:16.215 INFO:tasks.workunit.client.1.smithi129.stdout:2/199: fdatasync d7/d1f/d20/d2d/f2e 0 2024-03-18T14:43:16.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/408: read d3/d7/d25/f7b [58364,114425] 0 2024-03-18T14:43:16.219 INFO:tasks.workunit.client.0.smithi087.stdout:7/518: creat d1/d97/fb7 x:0 0 0 2024-03-18T14:43:16.219 INFO:tasks.workunit.client.1.smithi129.stdout:0/270: rename d0/d23/f37 to d0/f55 0 2024-03-18T14:43:16.220 INFO:tasks.workunit.client.0.smithi087.stdout:3/478: dwrite d0/de/d30/d46/f61 [0,4194304] 0 2024-03-18T14:43:16.220 INFO:tasks.workunit.client.1.smithi129.stdout:0/271: dread - d0/d23/d35/d50/f51 zero size 2024-03-18T14:43:16.220 INFO:tasks.workunit.client.1.smithi129.stdout:8/244: mkdir d9/d11/d53 0 2024-03-18T14:43:16.222 INFO:tasks.workunit.client.0.smithi087.stdout:8/438: creat d1/d6/d2f/f91 x:0 0 0 2024-03-18T14:43:16.224 INFO:tasks.workunit.client.1.smithi129.stdout:0/272: dwrite d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:16.225 INFO:tasks.workunit.client.0.smithi087.stdout:5/467: mknod d13/d1b/d27/d28/c9f 0 2024-03-18T14:43:16.225 INFO:tasks.workunit.client.1.smithi129.stdout:0/273: write d0/d14/f24 [3098550,94855] 0 2024-03-18T14:43:16.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/424: getdents d0/d1a/d7b/d2a/d85 0 2024-03-18T14:43:16.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/479: creat d0/d72/f8a x:0 0 0 2024-03-18T14:43:16.230 INFO:tasks.workunit.client.1.smithi129.stdout:7/239: truncate d4/fd 3508411 0 2024-03-18T14:43:16.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/240: dread - d4/d7/d8/f47 zero size 2024-03-18T14:43:16.231 INFO:tasks.workunit.client.0.smithi087.stdout:6/409: mkdir d3/d7/d25/d62/d7c/d29/d22/d47/d87 0 2024-03-18T14:43:16.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/241: chown d4/d7/d8/l26 4015711 1 2024-03-18T14:43:16.232 INFO:tasks.workunit.client.0.smithi087.stdout:6/410: write d3/d7/d25/f4d [619930,58404] 0 2024-03-18T14:43:16.233 INFO:tasks.workunit.client.0.smithi087.stdout:1/486: dread d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:16.235 INFO:tasks.workunit.client.1.smithi129.stdout:7/242: dwrite d4/d7/d8/f20 [4194304,4194304] 0 2024-03-18T14:43:16.236 INFO:tasks.workunit.client.1.smithi129.stdout:2/200: creat d7/d1f/d34/f3b x:0 0 0 2024-03-18T14:43:16.236 INFO:tasks.workunit.client.0.smithi087.stdout:8/439: dwrite d1/d6/d2f/f39 [0,4194304] 0 2024-03-18T14:43:16.237 INFO:tasks.workunit.client.1.smithi129.stdout:2/201: chown d7/fa 19 1 2024-03-18T14:43:16.239 INFO:tasks.workunit.client.0.smithi087.stdout:2/422: rmdir d2/d4/d22/d2c/d3a/d40/d6e 0 2024-03-18T14:43:16.239 INFO:tasks.workunit.client.1.smithi129.stdout:4/207: truncate d0/d19/f1f 2055714 0 2024-03-18T14:43:16.239 INFO:tasks.workunit.client.1.smithi129.stdout:4/208: chown d0 291320 1 2024-03-18T14:43:16.241 INFO:tasks.workunit.client.0.smithi087.stdout:4/394: write d2/db/d24/f33 [1232518,117652] 0 2024-03-18T14:43:16.242 INFO:tasks.workunit.client.0.smithi087.stdout:9/519: truncate db/d18/d1e/d28/f52 697600 0 2024-03-18T14:43:16.244 INFO:tasks.workunit.client.0.smithi087.stdout:9/520: rename db/d18/d3a to db/d18/d3a/da4 22 2024-03-18T14:43:16.244 INFO:tasks.workunit.client.0.smithi087.stdout:2/423: dwrite d2/d4/d22/d2c/d3a/f61 [0,4194304] 0 2024-03-18T14:43:16.246 INFO:tasks.workunit.client.1.smithi129.stdout:8/245: rmdir d9/d11/d1a/d32 39 2024-03-18T14:43:16.248 INFO:tasks.workunit.client.0.smithi087.stdout:2/424: dwrite d2/d4/d22/d2c/d3a/f51 [0,4194304] 0 2024-03-18T14:43:16.249 INFO:tasks.workunit.client.0.smithi087.stdout:1/487: mknod d3/d1d/d1f/d63/c95 0 2024-03-18T14:43:16.249 INFO:tasks.workunit.client.0.smithi087.stdout:6/411: stat d3/d7/le 0 2024-03-18T14:43:16.250 INFO:tasks.workunit.client.0.smithi087.stdout:8/440: rmdir d1/d6/d14 39 2024-03-18T14:43:16.254 INFO:tasks.workunit.client.0.smithi087.stdout:3/480: mknod d0/d3/df/d42/c8b 0 2024-03-18T14:43:16.256 INFO:tasks.workunit.client.0.smithi087.stdout:9/521: creat db/d18/d1e/d28/d76/d80/fa5 x:0 0 0 2024-03-18T14:43:16.257 INFO:tasks.workunit.client.1.smithi129.stdout:5/239: creat d0/d32/d3a/f49 x:0 0 0 2024-03-18T14:43:16.258 INFO:tasks.workunit.client.0.smithi087.stdout:7/519: truncate d1/d6/d29/d2f/d68/faa 184488 0 2024-03-18T14:43:16.259 INFO:tasks.workunit.client.0.smithi087.stdout:2/425: creat d2/d4/d22/d24/d65/f83 x:0 0 0 2024-03-18T14:43:16.259 INFO:tasks.workunit.client.1.smithi129.stdout:7/243: creat d4/d7/d8/d3b/f4d x:0 0 0 2024-03-18T14:43:16.259 INFO:tasks.workunit.client.1.smithi129.stdout:0/274: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:16.261 INFO:tasks.workunit.client.0.smithi087.stdout:5/468: creat d13/d1b/d27/fa0 x:0 0 0 2024-03-18T14:43:16.261 INFO:tasks.workunit.client.1.smithi129.stdout:3/213: creat d4/dd/f45 x:0 0 0 2024-03-18T14:43:16.261 INFO:tasks.workunit.client.1.smithi129.stdout:8/246: symlink d9/l54 0 2024-03-18T14:43:16.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/441: readlink d1/d6/d14/l47 0 2024-03-18T14:43:16.262 INFO:tasks.workunit.client.1.smithi129.stdout:6/260: creat d3/d5/d46/f55 x:0 0 0 2024-03-18T14:43:16.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/488: write d3/d1d/d1f/d34/f53 [2909132,86901] 0 2024-03-18T14:43:16.264 INFO:tasks.workunit.client.1.smithi129.stdout:2/202: symlink d7/d1c/d32/l3c 0 2024-03-18T14:43:16.264 INFO:tasks.workunit.client.1.smithi129.stdout:8/247: write d9/d11/d18/f24 [2904490,114859] 0 2024-03-18T14:43:16.265 INFO:tasks.workunit.client.1.smithi129.stdout:5/240: dwrite d0/d32/d3a/f49 [0,4194304] 0 2024-03-18T14:43:16.265 INFO:tasks.workunit.client.1.smithi129.stdout:7/244: rmdir d4/d2d 39 2024-03-18T14:43:16.265 INFO:tasks.workunit.client.1.smithi129.stdout:6/261: chown d3/d30/df/l25 2759520 1 2024-03-18T14:43:16.267 INFO:tasks.workunit.client.0.smithi087.stdout:4/395: dread f1 [0,4194304] 0 2024-03-18T14:43:16.268 INFO:tasks.workunit.client.1.smithi129.stdout:1/240: dwrite d1/d2/f3b [0,4194304] 0 2024-03-18T14:43:16.271 INFO:tasks.workunit.client.0.smithi087.stdout:2/426: rename d2/d44/f75 to d2/d4/d22/d2c/d3a/d40/f84 0 2024-03-18T14:43:16.273 INFO:tasks.workunit.client.1.smithi129.stdout:2/203: creat d7/d1f/d20/d2d/f3d x:0 0 0 2024-03-18T14:43:16.273 INFO:tasks.workunit.client.1.smithi129.stdout:2/204: dread - d7/d1f/d34/f3b zero size 2024-03-18T14:43:16.274 INFO:tasks.workunit.client.1.smithi129.stdout:2/205: write d7/d1f/d34/f15 [2945116,43457] 0 2024-03-18T14:43:16.274 INFO:tasks.workunit.client.0.smithi087.stdout:8/442: symlink d1/d6/d9/d5d/d87/l92 0 2024-03-18T14:43:16.275 INFO:tasks.workunit.client.1.smithi129.stdout:1/241: chown d1/f9 1810228 1 2024-03-18T14:43:16.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/275: truncate d0/d23/f3f 3674120 0 2024-03-18T14:43:16.276 INFO:tasks.workunit.client.0.smithi087.stdout:6/412: creat d3/d7/d25/d62/d7c/d46/f88 x:0 0 0 2024-03-18T14:43:16.276 INFO:tasks.workunit.client.1.smithi129.stdout:5/241: fdatasync d0/f36 0 2024-03-18T14:43:16.278 INFO:tasks.workunit.client.0.smithi087.stdout:3/481: mknod d0/d3/d7a/c8c 0 2024-03-18T14:43:16.278 INFO:tasks.workunit.client.1.smithi129.stdout:2/206: dwrite d7/d1f/d34/f1a [0,4194304] 0 2024-03-18T14:43:16.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/520: symlink d1/d6/d29/d2f/dac/lb8 0 2024-03-18T14:43:16.280 INFO:tasks.workunit.client.1.smithi129.stdout:1/242: creat d1/d18/d19/f4a x:0 0 0 2024-03-18T14:43:16.281 INFO:tasks.workunit.client.0.smithi087.stdout:1/489: dwrite d3/d1d/d1e/f37 [0,4194304] 0 2024-03-18T14:43:16.284 INFO:tasks.workunit.client.0.smithi087.stdout:2/427: creat d2/f85 x:0 0 0 2024-03-18T14:43:16.285 INFO:tasks.workunit.client.1.smithi129.stdout:2/207: rename d7/d1f/d20/d2d/f3d to d7/d1f/d20/d2d/f3e 0 2024-03-18T14:43:16.286 INFO:tasks.workunit.client.1.smithi129.stdout:2/208: dread - d7/d1f/d34/f3b zero size 2024-03-18T14:43:16.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/443: symlink d1/d6/d2f/d44/d45/l93 0 2024-03-18T14:43:16.288 INFO:tasks.workunit.client.1.smithi129.stdout:1/243: truncate d1/d2/f3d 525184 0 2024-03-18T14:43:16.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/521: mkdir d1/d97/db9 0 2024-03-18T14:43:16.293 INFO:tasks.workunit.client.0.smithi087.stdout:5/469: link d13/l15 d13/d1b/d27/d35/la1 0 2024-03-18T14:43:16.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/413: mknod d3/d7/d25/d62/d7c/d29/d22/d47/d87/c89 0 2024-03-18T14:43:16.293 INFO:tasks.workunit.client.0.smithi087.stdout:8/444: truncate d1/f5 21535 0 2024-03-18T14:43:16.294 INFO:tasks.workunit.client.0.smithi087.stdout:6/414: chown d3/d7/d25/d62 1247 1 2024-03-18T14:43:16.294 INFO:tasks.workunit.client.1.smithi129.stdout:1/244: creat d1/d2/f4b x:0 0 0 2024-03-18T14:43:16.296 INFO:tasks.workunit.client.0.smithi087.stdout:9/522: getdents db/d18 0 2024-03-18T14:43:16.297 INFO:tasks.workunit.client.1.smithi129.stdout:9/231: truncate d0/f4 5640820 0 2024-03-18T14:43:16.297 INFO:tasks.workunit.client.0.smithi087.stdout:3/482: mknod d0/d1c/c8d 0 2024-03-18T14:43:16.303 INFO:tasks.workunit.client.1.smithi129.stdout:9/232: truncate d0/db/d1f/d20/d26/d19/f21 1945235 0 2024-03-18T14:43:16.304 INFO:tasks.workunit.client.1.smithi129.stdout:3/214: sync 2024-03-18T14:43:16.304 INFO:tasks.workunit.client.1.smithi129.stdout:4/209: sync 2024-03-18T14:43:16.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/425: truncate d0/d1a/d7b/d2a/f68 5840934 0 2024-03-18T14:43:16.311 INFO:tasks.workunit.client.1.smithi129.stdout:6/262: dwrite d3/d30/fd [0,4194304] 0 2024-03-18T14:43:16.311 INFO:tasks.workunit.client.0.smithi087.stdout:9/523: rename db/d18/d1e/d7e/d99 to db/d18/da6 0 2024-03-18T14:43:16.312 INFO:tasks.workunit.client.1.smithi129.stdout:8/248: truncate d9/d11/d1a/d32/d3a/f49 2479462 0 2024-03-18T14:43:16.312 INFO:tasks.workunit.client.1.smithi129.stdout:6/263: chown d3/d30/df/d28/f54 131760 1 2024-03-18T14:43:16.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/276: write d0/fd [1270280,101984] 0 2024-03-18T14:43:16.313 INFO:tasks.workunit.client.1.smithi129.stdout:2/209: dread d7/d1c/f26 [0,4194304] 0 2024-03-18T14:43:16.313 INFO:tasks.workunit.client.1.smithi129.stdout:6/264: dread - d3/f3c zero size 2024-03-18T14:43:16.315 INFO:tasks.workunit.client.1.smithi129.stdout:4/210: dread d0/d9/f17 [0,4194304] 0 2024-03-18T14:43:16.315 INFO:tasks.workunit.client.1.smithi129.stdout:7/245: dread f3 [0,4194304] 0 2024-03-18T14:43:16.315 INFO:tasks.workunit.client.1.smithi129.stdout:2/210: dread - d7/d1f/d34/f30 zero size 2024-03-18T14:43:16.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/483: fdatasync d0/d3/df/f16 0 2024-03-18T14:43:16.318 INFO:tasks.workunit.client.0.smithi087.stdout:7/522: rmdir d1/d6 39 2024-03-18T14:43:16.319 INFO:tasks.workunit.client.1.smithi129.stdout:3/215: link d4/fb d4/d11/d1d/f46 0 2024-03-18T14:43:16.320 INFO:tasks.workunit.client.1.smithi129.stdout:6/265: symlink d3/d30/l56 0 2024-03-18T14:43:16.322 INFO:tasks.workunit.client.1.smithi129.stdout:4/211: dwrite d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:16.322 INFO:tasks.workunit.client.1.smithi129.stdout:7/246: stat d4/d2d/d3a 0 2024-03-18T14:43:16.322 INFO:tasks.workunit.client.0.smithi087.stdout:1/490: dwrite d3/d1d/f22 [0,4194304] 0 2024-03-18T14:43:16.322 INFO:tasks.workunit.client.0.smithi087.stdout:0/426: write d0/d2/d4/d19/d62/f70 [1514802,99546] 0 2024-03-18T14:43:16.323 INFO:tasks.workunit.client.1.smithi129.stdout:7/247: chown d4/d2d/d2e 47629 1 2024-03-18T14:43:16.323 INFO:tasks.workunit.client.1.smithi129.stdout:3/216: rmdir d4/d11/d34/d3c 39 2024-03-18T14:43:16.323 INFO:tasks.workunit.client.0.smithi087.stdout:0/427: write d0/d2/d4/f65 [352621,95503] 0 2024-03-18T14:43:16.324 INFO:tasks.workunit.client.1.smithi129.stdout:3/217: chown d4/dd/f3d 8 1 2024-03-18T14:43:16.324 INFO:tasks.workunit.client.1.smithi129.stdout:0/277: symlink d0/d14/d53/l56 0 2024-03-18T14:43:16.325 INFO:tasks.workunit.client.1.smithi129.stdout:3/218: chown d4/d38/f24 133132 1 2024-03-18T14:43:16.326 INFO:tasks.workunit.client.1.smithi129.stdout:5/242: sync 2024-03-18T14:43:16.327 INFO:tasks.workunit.client.1.smithi129.stdout:6/266: rmdir d3/d6 39 2024-03-18T14:43:16.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/484: mkdir d0/de/d30/d8e 0 2024-03-18T14:43:16.327 INFO:tasks.workunit.client.0.smithi087.stdout:3/485: chown d0/d3/df/c18 193 1 2024-03-18T14:43:16.328 INFO:tasks.workunit.client.1.smithi129.stdout:6/267: chown d3/f3c 439848 1 2024-03-18T14:43:16.328 INFO:tasks.workunit.client.1.smithi129.stdout:5/243: write d0/dc/d18/d2b/f47 [158868,10440] 0 2024-03-18T14:43:16.329 INFO:tasks.workunit.client.0.smithi087.stdout:6/415: link d3/f6c d3/d7/d25/d62/d7c/d29/f8a 0 2024-03-18T14:43:16.330 INFO:tasks.workunit.client.0.smithi087.stdout:1/491: rmdir d3/d1d/d1e/d43 39 2024-03-18T14:43:16.332 INFO:tasks.workunit.client.0.smithi087.stdout:7/523: symlink d1/d6/d29/d2f/d68/d65/d60/lba 0 2024-03-18T14:43:16.332 INFO:tasks.workunit.client.1.smithi129.stdout:9/233: unlink d0/db/d1f/d20/d26/d19/f21 0 2024-03-18T14:43:16.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/486: fsync d0/de/d30/d67/f79 0 2024-03-18T14:43:16.333 INFO:tasks.workunit.client.1.smithi129.stdout:9/234: write d0/f10 [957758,77320] 0 2024-03-18T14:43:16.335 INFO:tasks.workunit.client.1.smithi129.stdout:8/249: rmdir d9 39 2024-03-18T14:43:16.337 INFO:tasks.workunit.client.1.smithi129.stdout:2/211: mkdir d7/d3f 0 2024-03-18T14:43:16.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/428: rename d0/d2/d4/d19/d24/c4e to d0/d2/d3c/d73/ca2 0 2024-03-18T14:43:16.338 INFO:tasks.workunit.client.0.smithi087.stdout:3/487: fdatasync d0/d1c/f5b 0 2024-03-18T14:43:16.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/524: chown d1/l47 86 1 2024-03-18T14:43:16.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/488: fdatasync d0/d72/f8a 0 2024-03-18T14:43:16.339 INFO:tasks.workunit.client.1.smithi129.stdout:1/245: dread d1/f1d [0,4194304] 0 2024-03-18T14:43:16.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/428: truncate d2/fb 5896125 0 2024-03-18T14:43:16.341 INFO:tasks.workunit.client.1.smithi129.stdout:3/219: creat d4/d38/f47 x:0 0 0 2024-03-18T14:43:16.341 INFO:tasks.workunit.client.1.smithi129.stdout:1/246: chown d1/d18/c20 689180419 1 2024-03-18T14:43:16.341 INFO:tasks.workunit.client.1.smithi129.stdout:5/244: mknod d0/d32/d34/c4a 0 2024-03-18T14:43:16.342 INFO:tasks.workunit.client.1.smithi129.stdout:5/245: fdatasync d0/d32/d34/f3b 0 2024-03-18T14:43:16.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/429: mkdir d0/d2/d4/d19/d24/da3 0 2024-03-18T14:43:16.343 INFO:tasks.workunit.client.1.smithi129.stdout:2/212: dwrite d7/d1f/d20/d2d/f35 [0,4194304] 0 2024-03-18T14:43:16.344 INFO:tasks.workunit.client.0.smithi087.stdout:3/489: creat d0/d3/d7a/f8f x:0 0 0 2024-03-18T14:43:16.344 INFO:tasks.workunit.client.0.smithi087.stdout:5/470: dwrite d13/d1b/d27/d35/d3b/f6a [0,4194304] 0 2024-03-18T14:43:16.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/525: symlink d1/lbb 0 2024-03-18T14:43:16.347 INFO:tasks.workunit.client.0.smithi087.stdout:7/526: dread - d1/d6/d29/f92 zero size 2024-03-18T14:43:16.349 INFO:tasks.workunit.client.0.smithi087.stdout:0/430: rmdir d0/d49 39 2024-03-18T14:43:16.349 INFO:tasks.workunit.client.1.smithi129.stdout:3/220: symlink d4/dd/d15/d31/l48 0 2024-03-18T14:43:16.350 INFO:tasks.workunit.client.1.smithi129.stdout:9/235: creat d0/d15/f42 x:0 0 0 2024-03-18T14:43:16.351 INFO:tasks.workunit.client.1.smithi129.stdout:0/278: dwrite d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:16.352 INFO:tasks.workunit.client.1.smithi129.stdout:4/212: creat d0/d19/f39 x:0 0 0 2024-03-18T14:43:16.354 INFO:tasks.workunit.client.0.smithi087.stdout:8/445: truncate d1/d6/d2f/d44/d4b/f86 698706 0 2024-03-18T14:43:16.355 INFO:tasks.workunit.client.0.smithi087.stdout:3/490: dwrite d0/de/d30/d60/f6c [0,4194304] 0 2024-03-18T14:43:16.356 INFO:tasks.workunit.client.0.smithi087.stdout:3/491: chown d0/de/d30/d67/c87 8324 1 2024-03-18T14:43:16.360 INFO:tasks.workunit.client.1.smithi129.stdout:9/236: unlink d0/db/d11/l28 0 2024-03-18T14:43:16.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/416: dread d3/f45 [0,4194304] 0 2024-03-18T14:43:16.361 INFO:tasks.workunit.client.0.smithi087.stdout:9/524: mkdir db/d18/d1e/d28/d76/da7 0 2024-03-18T14:43:16.361 INFO:tasks.workunit.client.1.smithi129.stdout:0/279: creat d0/d23/d35/d3b/f57 x:0 0 0 2024-03-18T14:43:16.363 INFO:tasks.workunit.client.0.smithi087.stdout:5/471: getdents d13/d1b/d70 0 2024-03-18T14:43:16.364 INFO:tasks.workunit.client.1.smithi129.stdout:4/213: mknod d0/d9/d1e/d33/c3a 0 2024-03-18T14:43:16.366 INFO:tasks.workunit.client.1.smithi129.stdout:0/280: rmdir d0/d14 39 2024-03-18T14:43:16.368 INFO:tasks.workunit.client.0.smithi087.stdout:3/492: creat d0/d72/d85/f90 x:0 0 0 2024-03-18T14:43:16.370 INFO:tasks.workunit.client.1.smithi129.stdout:9/237: rename d0/f13 to d0/db/f43 0 2024-03-18T14:43:16.371 INFO:tasks.workunit.client.0.smithi087.stdout:4/396: sync 2024-03-18T14:43:16.373 INFO:tasks.workunit.client.0.smithi087.stdout:1/492: truncate d3/d1d/f3d 6363451 0 2024-03-18T14:43:16.374 INFO:tasks.workunit.client.1.smithi129.stdout:7/248: dread d4/d7/f19 [0,4194304] 0 2024-03-18T14:43:16.375 INFO:tasks.workunit.client.0.smithi087.stdout:5/472: creat d13/d1b/d7e/fa2 x:0 0 0 2024-03-18T14:43:16.376 INFO:tasks.workunit.client.1.smithi129.stdout:0/281: unlink d0/d23/d35/d50/f51 0 2024-03-18T14:43:16.376 INFO:tasks.workunit.client.0.smithi087.stdout:2/429: write d2/d4/f15 [2138324,33523] 0 2024-03-18T14:43:16.377 INFO:tasks.workunit.client.1.smithi129.stdout:6/268: sync 2024-03-18T14:43:16.377 INFO:tasks.workunit.client.1.smithi129.stdout:6/269: write f1 [2957636,84235] 0 2024-03-18T14:43:16.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/493: dwrite d3/f7 [0,4194304] 0 2024-03-18T14:43:16.378 INFO:tasks.workunit.client.0.smithi087.stdout:0/431: write d0/d2/d4/d19/f2f [497770,36130] 0 2024-03-18T14:43:16.378 INFO:tasks.workunit.client.0.smithi087.stdout:7/527: dread d1/d97/fb6 [0,4194304] 0 2024-03-18T14:43:16.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/270: dread - d3/d30/df/d28/f54 zero size 2024-03-18T14:43:16.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/238: creat d0/db/d1f/d20/d26/d19/d29/f44 x:0 0 0 2024-03-18T14:43:16.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/494: chown d3/d1d/d1f/f75 3188641 1 2024-03-18T14:43:16.380 INFO:tasks.workunit.client.0.smithi087.stdout:0/432: chown d0/d2/d4/d19/d24/f71 89391529 1 2024-03-18T14:43:16.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/239: chown d0/db/d11 297 1 2024-03-18T14:43:16.381 INFO:tasks.workunit.client.0.smithi087.stdout:8/446: truncate d1/d6/d9/d5d/d87/f8a 861 0 2024-03-18T14:43:16.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/417: mkdir d3/d7/d25/d62/d8b 0 2024-03-18T14:43:16.383 INFO:tasks.workunit.client.1.smithi129.stdout:9/240: dwrite d0/f8 [0,4194304] 0 2024-03-18T14:43:16.384 INFO:tasks.workunit.client.0.smithi087.stdout:9/525: dwrite db/f2f [0,4194304] 0 2024-03-18T14:43:16.386 INFO:tasks.workunit.client.0.smithi087.stdout:9/526: write db/d18/d1e/f46 [2453833,11473] 0 2024-03-18T14:43:16.386 INFO:tasks.workunit.client.0.smithi087.stdout:0/433: dwrite d0/d2/f4a [0,4194304] 0 2024-03-18T14:43:16.387 INFO:tasks.workunit.client.0.smithi087.stdout:3/493: rmdir d0/d1c 39 2024-03-18T14:43:16.387 INFO:tasks.workunit.client.1.smithi129.stdout:2/213: truncate d7/d1f/d20/d2d/f3e 360703 0 2024-03-18T14:43:16.388 INFO:tasks.workunit.client.1.smithi129.stdout:0/282: fsync d0/f55 0 2024-03-18T14:43:16.388 INFO:tasks.workunit.client.1.smithi129.stdout:3/221: rmdir d4 39 2024-03-18T14:43:16.389 INFO:tasks.workunit.client.1.smithi129.stdout:1/247: dwrite d1/d18/d19/f24 [0,4194304] 0 2024-03-18T14:43:16.389 INFO:tasks.workunit.client.0.smithi087.stdout:2/430: creat d2/d4/d22/d2c/d3a/d76/d81/f86 x:0 0 0 2024-03-18T14:43:16.390 INFO:tasks.workunit.client.1.smithi129.stdout:2/214: chown d7/d1f/d34/f1a 32516800 1 2024-03-18T14:43:16.390 INFO:tasks.workunit.client.1.smithi129.stdout:0/283: chown d0/c13 11951 1 2024-03-18T14:43:16.390 INFO:tasks.workunit.client.0.smithi087.stdout:7/528: symlink d1/d8e/lbc 0 2024-03-18T14:43:16.391 INFO:tasks.workunit.client.1.smithi129.stdout:5/246: dwrite d0/f36 [0,4194304] 0 2024-03-18T14:43:16.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/494: dwrite d0/de/d30/f7c [0,4194304] 0 2024-03-18T14:43:16.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/431: write d2/d4/f16 [2022707,130946] 0 2024-03-18T14:43:16.394 INFO:tasks.workunit.client.1.smithi129.stdout:1/248: dwrite d1/f1d [0,4194304] 0 2024-03-18T14:43:16.395 INFO:tasks.workunit.client.0.smithi087.stdout:7/529: dwrite d1/f36 [0,4194304] 0 2024-03-18T14:43:16.395 INFO:tasks.workunit.client.0.smithi087.stdout:1/495: stat d3/d1d/d1e/d43/d50/d71/l74 0 2024-03-18T14:43:16.395 INFO:tasks.workunit.client.1.smithi129.stdout:1/249: stat d1/d18/d19/l32 0 2024-03-18T14:43:16.395 INFO:tasks.workunit.client.1.smithi129.stdout:6/271: write d3/d6/f2d [2480540,60351] 0 2024-03-18T14:43:16.398 INFO:tasks.workunit.client.0.smithi087.stdout:8/447: rename d1/d6/f20 to d1/d6/d8d/f94 0 2024-03-18T14:43:16.401 INFO:tasks.workunit.client.1.smithi129.stdout:4/214: write d0/d1a/f2c [825148,114903] 0 2024-03-18T14:43:16.401 INFO:tasks.workunit.client.1.smithi129.stdout:9/241: symlink d0/db/d1f/d20/d26/d19/l45 0 2024-03-18T14:43:16.401 INFO:tasks.workunit.client.1.smithi129.stdout:7/249: getdents d4/d7/d38/d49 0 2024-03-18T14:43:16.403 INFO:tasks.workunit.client.1.smithi129.stdout:7/250: dread - d4/d7/d8/f3f zero size 2024-03-18T14:43:16.405 INFO:tasks.workunit.client.1.smithi129.stdout:1/250: creat d1/d35/f4c x:0 0 0 2024-03-18T14:43:16.405 INFO:tasks.workunit.client.1.smithi129.stdout:1/251: readlink d1/l2d 0 2024-03-18T14:43:16.406 INFO:tasks.workunit.client.1.smithi129.stdout:6/272: mkdir d3/d38/d57 0 2024-03-18T14:43:16.407 INFO:tasks.workunit.client.1.smithi129.stdout:3/222: dwrite d4/dd/d1f/f26 [0,4194304] 0 2024-03-18T14:43:16.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/434: rmdir d0 39 2024-03-18T14:43:16.408 INFO:tasks.workunit.client.0.smithi087.stdout:4/397: mkdir d2/db/d7a 0 2024-03-18T14:43:16.409 INFO:tasks.workunit.client.0.smithi087.stdout:4/398: write d2/db/d67/f78 [445284,55304] 0 2024-03-18T14:43:16.417 INFO:tasks.workunit.client.1.smithi129.stdout:8/250: sync 2024-03-18T14:43:16.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/448: creat d1/d6/d2f/f95 x:0 0 0 2024-03-18T14:43:16.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/418: link d3/d7/f86 d3/d7/d25/d62/d7c/d29/d7d/f8c 0 2024-03-18T14:43:16.421 INFO:tasks.workunit.client.0.smithi087.stdout:9/527: creat db/d18/d1e/d28/d76/d80/d91/fa8 x:0 0 0 2024-03-18T14:43:16.421 INFO:tasks.workunit.client.0.smithi087.stdout:0/435: readlink d0/d2/l37 0 2024-03-18T14:43:16.422 INFO:tasks.workunit.client.0.smithi087.stdout:5/473: creat d13/d1b/d30/d6e/fa3 x:0 0 0 2024-03-18T14:43:16.422 INFO:tasks.workunit.client.1.smithi129.stdout:0/284: read d0/d23/d35/f36 [1928336,101783] 0 2024-03-18T14:43:16.426 INFO:tasks.workunit.client.0.smithi087.stdout:1/496: symlink d3/d1d/l96 0 2024-03-18T14:43:16.432 INFO:tasks.workunit.client.1.smithi129.stdout:2/215: dwrite f5 [0,4194304] 0 2024-03-18T14:43:16.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/436: creat d0/d1a/d8c/fa4 x:0 0 0 2024-03-18T14:43:16.437 INFO:tasks.workunit.client.0.smithi087.stdout:5/474: unlink d13/d1b/d27/d28/f5a 0 2024-03-18T14:43:16.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/530: creat d1/d6/da/fbd x:0 0 0 2024-03-18T14:43:16.441 INFO:tasks.workunit.client.0.smithi087.stdout:5/475: dwrite d13/d1b/f5c [0,4194304] 0 2024-03-18T14:43:16.443 INFO:tasks.workunit.client.0.smithi087.stdout:5/476: write d13/d1b/d27/d28/f9e [363153,129292] 0 2024-03-18T14:43:16.443 INFO:tasks.workunit.client.0.smithi087.stdout:6/419: mknod d3/d7/d25/d62/d7c/d29/d22/d75/c8d 0 2024-03-18T14:43:16.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/495: creat d0/d1c/f91 x:0 0 0 2024-03-18T14:43:16.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/496: write d0/d3/d10/f2c [2854520,95993] 0 2024-03-18T14:43:16.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/420: dwrite d3/d7/d25/d62/d7c/d29/d22/f2c [0,4194304] 0 2024-03-18T14:43:16.451 INFO:tasks.workunit.client.0.smithi087.stdout:1/497: mknod d3/d1d/d6e/d8f/c97 0 2024-03-18T14:43:16.452 INFO:tasks.workunit.client.0.smithi087.stdout:9/528: creat db/d18/d3a/d87/da1/fa9 x:0 0 0 2024-03-18T14:43:16.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/437: dwrite d0/d2/d4/f98 [0,4194304] 0 2024-03-18T14:43:16.454 INFO:tasks.workunit.client.0.smithi087.stdout:3/497: symlink d0/d72/d85/l92 0 2024-03-18T14:43:16.455 INFO:tasks.workunit.client.0.smithi087.stdout:0/438: write d0/d2/d4/d19/f5e [964173,55480] 0 2024-03-18T14:43:16.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/432: rename d2/d44/c55 to d2/d4/d22/c87 0 2024-03-18T14:43:16.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/439: write d0/d1a/d80/f95 [49939,37862] 0 2024-03-18T14:43:16.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/498: dwrite d3/d1d/d79/f7f [0,4194304] 0 2024-03-18T14:43:16.462 INFO:tasks.workunit.client.0.smithi087.stdout:7/531: mkdir d1/d6/da/d59/dbe 0 2024-03-18T14:43:16.463 INFO:tasks.workunit.client.0.smithi087.stdout:1/499: dwrite d3/d1d/d45/f59 [4194304,4194304] 0 2024-03-18T14:43:16.469 INFO:tasks.workunit.client.0.smithi087.stdout:8/449: truncate d1/d6/d8d/f94 3545164 0 2024-03-18T14:43:16.472 INFO:tasks.workunit.client.0.smithi087.stdout:4/399: dwrite d2/d13/d28/f70 [0,4194304] 0 2024-03-18T14:43:16.476 INFO:tasks.workunit.client.0.smithi087.stdout:9/529: symlink db/d18/d1e/laa 0 2024-03-18T14:43:16.477 INFO:tasks.workunit.client.0.smithi087.stdout:3/498: symlink d0/de/d30/d46/l93 0 2024-03-18T14:43:16.481 INFO:tasks.workunit.client.0.smithi087.stdout:5/477: rename d13/d1b/d27/f2d to d13/d1b/d27/d35/d3b/fa4 0 2024-03-18T14:43:16.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/433: write d2/d4/d22/d2c/d3a/d40/f84 [99495,47162] 0 2024-03-18T14:43:16.483 INFO:tasks.workunit.client.0.smithi087.stdout:7/532: unlink d1/d6/da/l4b 0 2024-03-18T14:43:16.485 INFO:tasks.workunit.client.0.smithi087.stdout:1/500: rmdir d3/d1d/d1e/d43/d50/d72 39 2024-03-18T14:43:16.487 INFO:tasks.workunit.client.0.smithi087.stdout:4/400: mkdir d2/db/d24/d30/d7b 0 2024-03-18T14:43:16.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/421: dread d3/d7/d25/d62/d7c/f42 [0,4194304] 0 2024-03-18T14:43:16.490 INFO:tasks.workunit.client.0.smithi087.stdout:5/478: symlink d13/d1b/d70/la5 0 2024-03-18T14:43:16.490 INFO:tasks.workunit.client.0.smithi087.stdout:5/479: readlink l4 0 2024-03-18T14:43:16.491 INFO:tasks.workunit.client.0.smithi087.stdout:5/480: dread - d13/d1b/f46 zero size 2024-03-18T14:43:16.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/530: dwrite db/f68 [0,4194304] 0 2024-03-18T14:43:16.493 INFO:tasks.workunit.client.0.smithi087.stdout:4/401: mknod d2/d13/d28/c7c 0 2024-03-18T14:43:16.495 INFO:tasks.workunit.client.0.smithi087.stdout:5/481: dread d13/d1b/d27/d28/f54 [0,4194304] 0 2024-03-18T14:43:16.496 INFO:tasks.workunit.client.0.smithi087.stdout:0/440: truncate d0/d2/f84 458373 0 2024-03-18T14:43:16.497 INFO:tasks.workunit.client.0.smithi087.stdout:0/441: read - d0/f6c zero size 2024-03-18T14:43:16.498 INFO:tasks.workunit.client.0.smithi087.stdout:4/402: dwrite d2/db/d24/f58 [0,4194304] 0 2024-03-18T14:43:16.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/450: rename d1/d6/d14/f15 to d1/d6/d2f/d44/d45/d72/d7f/d83/f96 0 2024-03-18T14:43:16.500 INFO:tasks.workunit.client.0.smithi087.stdout:6/422: mkdir d3/d7/d25/d8e 0 2024-03-18T14:43:16.501 INFO:tasks.workunit.client.0.smithi087.stdout:6/423: write d3/d7/f44 [9388321,101051] 0 2024-03-18T14:43:16.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/424: dread - d3/f6c zero size 2024-03-18T14:43:16.506 INFO:tasks.workunit.client.0.smithi087.stdout:5/482: mknod d13/d1b/d27/d28/ca6 0 2024-03-18T14:43:16.507 INFO:tasks.workunit.client.0.smithi087.stdout:0/442: chown d0/l1c 40631869 1 2024-03-18T14:43:16.508 INFO:tasks.workunit.client.0.smithi087.stdout:4/403: symlink d2/db/d24/l7d 0 2024-03-18T14:43:16.514 INFO:tasks.workunit.client.0.smithi087.stdout:1/501: truncate d3/d1d/d1e/d20/f5c 3280444 0 2024-03-18T14:43:16.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/533: dread d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:16.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/534: dread d1/d6/da/f50 [4194304,4194304] 0 2024-03-18T14:43:16.519 INFO:tasks.workunit.client.0.smithi087.stdout:1/502: dwrite d3/d1d/d1e/d20/f85 [0,4194304] 0 2024-03-18T14:43:16.521 INFO:tasks.workunit.client.0.smithi087.stdout:9/531: creat db/d18/d51/d7b/fab x:0 0 0 2024-03-18T14:43:16.522 INFO:tasks.workunit.client.0.smithi087.stdout:5/483: unlink c5 0 2024-03-18T14:43:16.523 INFO:tasks.workunit.client.0.smithi087.stdout:0/443: symlink d0/d2/d4/d19/d62/la5 0 2024-03-18T14:43:16.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/535: dread d1/d6/f44 [0,4194304] 0 2024-03-18T14:43:16.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/532: truncate db/d12/f33 385144 0 2024-03-18T14:43:16.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/484: mkdir d13/d1b/d27/d35/da7 0 2024-03-18T14:43:16.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/451: truncate d1/d6/d9/f77 655388 0 2024-03-18T14:43:16.530 INFO:tasks.workunit.client.0.smithi087.stdout:8/452: dread - d1/d6/d2f/f91 zero size 2024-03-18T14:43:16.530 INFO:tasks.workunit.client.0.smithi087.stdout:6/425: link d3/d7/d25/d62/d7c/d29/c6e d3/d7/d25/d62/d7c/d29/d7d/c8f 0 2024-03-18T14:43:16.531 INFO:tasks.workunit.client.0.smithi087.stdout:6/426: fsync d3/d7/d25/f4d 0 2024-03-18T14:43:16.531 INFO:tasks.workunit.client.0.smithi087.stdout:8/453: read d1/d6/d2f/f39 [3544324,70581] 0 2024-03-18T14:43:16.533 INFO:tasks.workunit.client.0.smithi087.stdout:4/404: write d2/db/de/f44 [1072616,7414] 0 2024-03-18T14:43:16.533 INFO:tasks.workunit.client.0.smithi087.stdout:1/503: symlink d3/d1d/d67/d94/l98 0 2024-03-18T14:43:16.534 INFO:tasks.workunit.client.0.smithi087.stdout:7/536: mkdir d1/d6/d29/d2f/d68/dbf 0 2024-03-18T14:43:16.535 INFO:tasks.workunit.client.0.smithi087.stdout:9/533: stat db/d18/da6 0 2024-03-18T14:43:16.536 INFO:tasks.workunit.client.0.smithi087.stdout:9/534: dread - db/d18/d1e/d28/d76/d80/fa5 zero size 2024-03-18T14:43:16.537 INFO:tasks.workunit.client.0.smithi087.stdout:1/504: dread d3/d1d/d1e/f37 [0,4194304] 0 2024-03-18T14:43:16.538 INFO:tasks.workunit.client.0.smithi087.stdout:1/505: chown d3/d1d/d1f/d34/f35 14 1 2024-03-18T14:43:16.541 INFO:tasks.workunit.client.0.smithi087.stdout:0/444: write d0/d1a/d7b/d2a/f52 [205461,47153] 0 2024-03-18T14:43:16.544 INFO:tasks.workunit.client.0.smithi087.stdout:7/537: chown d1/d6/d16/f1e 972753 1 2024-03-18T14:43:16.545 INFO:tasks.workunit.client.0.smithi087.stdout:6/427: fsync d3/f5e 0 2024-03-18T14:43:16.547 INFO:tasks.workunit.client.0.smithi087.stdout:9/535: dread f3 [0,4194304] 0 2024-03-18T14:43:16.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/499: sync 2024-03-18T14:43:16.548 INFO:tasks.workunit.client.0.smithi087.stdout:5/485: truncate d13/d1b/f47 1955857 0 2024-03-18T14:43:16.549 INFO:tasks.workunit.client.0.smithi087.stdout:8/454: truncate d1/d6/d2f/f91 186221 0 2024-03-18T14:43:16.549 INFO:tasks.workunit.client.0.smithi087.stdout:7/538: dwrite d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:16.550 INFO:tasks.workunit.client.0.smithi087.stdout:5/486: write d13/d1b/d27/d35/f9c [1004070,67488] 0 2024-03-18T14:43:16.552 INFO:tasks.workunit.client.0.smithi087.stdout:0/445: creat d0/d2/d4/d8b/fa6 x:0 0 0 2024-03-18T14:43:16.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/506: truncate d3/d1d/d1e/d20/f52 4773440 0 2024-03-18T14:43:16.557 INFO:tasks.workunit.client.0.smithi087.stdout:0/446: read d0/fc [921511,69875] 0 2024-03-18T14:43:16.557 INFO:tasks.workunit.client.0.smithi087.stdout:3/500: unlink d0/de/d30/d67/l7e 0 2024-03-18T14:43:16.561 INFO:tasks.workunit.client.0.smithi087.stdout:4/405: getdents d2/db 0 2024-03-18T14:43:16.562 INFO:tasks.workunit.client.0.smithi087.stdout:8/455: write d1/d6/d9/d5d/f64 [432688,117140] 0 2024-03-18T14:43:16.563 INFO:tasks.workunit.client.0.smithi087.stdout:5/487: mkdir d13/d1b/d70/da8 0 2024-03-18T14:43:16.564 INFO:tasks.workunit.client.0.smithi087.stdout:9/536: dwrite db/d31/f36 [4194304,4194304] 0 2024-03-18T14:43:16.564 INFO:tasks.workunit.client.0.smithi087.stdout:1/507: mkdir d3/d1d/d6e/d8f/d99 0 2024-03-18T14:43:16.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/447: mkdir d0/d2/d4/d19/d24/d5d/d78/da7 0 2024-03-18T14:43:16.567 INFO:tasks.workunit.client.0.smithi087.stdout:3/501: rmdir d0/d3/d10 39 2024-03-18T14:43:16.568 INFO:tasks.workunit.client.0.smithi087.stdout:7/539: dwrite d1/d6/f44 [0,4194304] 0 2024-03-18T14:43:16.570 INFO:tasks.workunit.client.0.smithi087.stdout:4/406: unlink d2/db/d3c/c46 0 2024-03-18T14:43:16.572 INFO:tasks.workunit.client.0.smithi087.stdout:1/508: read d3/d1d/d1f/f3f [306879,103131] 0 2024-03-18T14:43:16.575 INFO:tasks.workunit.client.0.smithi087.stdout:6/428: creat d3/d7/d25/d62/d7c/d29/f90 x:0 0 0 2024-03-18T14:43:16.576 INFO:tasks.workunit.client.0.smithi087.stdout:6/429: fsync d3/d7/d25/d62/d7c/d46/f6d 0 2024-03-18T14:43:16.576 INFO:tasks.workunit.client.0.smithi087.stdout:5/488: fdatasync d13/d1b/d30/f5d 0 2024-03-18T14:43:16.581 INFO:tasks.workunit.client.0.smithi087.stdout:9/537: rmdir db/d18/d1e/d7e 39 2024-03-18T14:43:16.581 INFO:tasks.workunit.client.0.smithi087.stdout:0/448: chown d0/d1a/d7b/d26/f4b 579121522 1 2024-03-18T14:43:16.581 INFO:tasks.workunit.client.0.smithi087.stdout:7/540: chown d1/d6/d29/d2f/d68/d65/d60/d66/l9e 1243985 1 2024-03-18T14:43:16.584 INFO:tasks.workunit.client.0.smithi087.stdout:1/509: mknod d3/c9a 0 2024-03-18T14:43:16.584 INFO:tasks.workunit.client.0.smithi087.stdout:6/430: creat d3/d7/d25/f91 x:0 0 0 2024-03-18T14:43:16.586 INFO:tasks.workunit.client.0.smithi087.stdout:5/489: dread d13/d1b/d27/d28/f7f [0,4194304] 0 2024-03-18T14:43:16.588 INFO:tasks.workunit.client.0.smithi087.stdout:8/456: write d1/d6/d2f/d44/d45/d50/f66 [4566922,6078] 0 2024-03-18T14:43:16.589 INFO:tasks.workunit.client.0.smithi087.stdout:8/457: chown d1/d6/d9/f17 12297 1 2024-03-18T14:43:16.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/541: creat d1/d8e/d95/dae/fc0 x:0 0 0 2024-03-18T14:43:16.591 INFO:tasks.workunit.client.0.smithi087.stdout:6/431: rename d3/d7/d25/d62/d7e to d3/d7/d25/d62/d7c/d29/d22/d75/d92 0 2024-03-18T14:43:16.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/449: mkdir d0/d2/d4/d19/d24/da3/da8 0 2024-03-18T14:43:16.594 INFO:tasks.workunit.client.0.smithi087.stdout:5/490: unlink d13/d1b/d27/d28/f9e 0 2024-03-18T14:43:16.596 INFO:tasks.workunit.client.0.smithi087.stdout:4/407: creat d2/f7e x:0 0 0 2024-03-18T14:43:16.596 INFO:tasks.workunit.client.0.smithi087.stdout:1/510: mkdir d3/d1d/d1e/d43/d9b 0 2024-03-18T14:43:16.598 INFO:tasks.workunit.client.0.smithi087.stdout:0/450: dwrite d0/d1a/d80/d88/f2e [4194304,4194304] 0 2024-03-18T14:43:16.598 INFO:tasks.workunit.client.0.smithi087.stdout:7/542: symlink d1/d6/d29/d2f/d68/d65/d60/d66/d8b/lc1 0 2024-03-18T14:43:16.599 INFO:tasks.workunit.client.0.smithi087.stdout:4/408: read d2/db/de/f2f [341620,18418] 0 2024-03-18T14:43:16.600 INFO:tasks.workunit.client.0.smithi087.stdout:0/451: dread d0/d1a/d80/f95 [0,4194304] 0 2024-03-18T14:43:16.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/432: symlink d3/d7/d25/d62/d7c/d29/d22/d75/l93 0 2024-03-18T14:43:16.602 INFO:tasks.workunit.client.0.smithi087.stdout:6/433: write d3/d7/f2e [2633123,14983] 0 2024-03-18T14:43:16.603 INFO:tasks.workunit.client.0.smithi087.stdout:2/434: sync 2024-03-18T14:43:16.604 INFO:tasks.workunit.client.0.smithi087.stdout:2/435: write d2/d4/d22/d2c/d3a/d76/d81/f82 [1051975,85159] 0 2024-03-18T14:43:16.605 INFO:tasks.workunit.client.0.smithi087.stdout:8/458: mknod d1/d6/d9/d5d/d87/d88/c97 0 2024-03-18T14:43:16.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/459: dread - d1/d6/d9/d5d/f8f zero size 2024-03-18T14:43:16.607 INFO:tasks.workunit.client.0.smithi087.stdout:7/543: mknod d1/d6/d16/da6/cc2 0 2024-03-18T14:43:16.607 INFO:tasks.workunit.client.0.smithi087.stdout:1/511: dread d3/f19 [0,4194304] 0 2024-03-18T14:43:16.608 INFO:tasks.workunit.client.0.smithi087.stdout:7/544: fdatasync d1/d6/da/ff 0 2024-03-18T14:43:16.609 INFO:tasks.workunit.client.0.smithi087.stdout:4/409: rename d2/db/d24/d30/d4d to d2/db/d24/d30/d7b/d7f 0 2024-03-18T14:43:16.612 INFO:tasks.workunit.client.1.smithi129.stdout:9/242: creat d0/db/d1f/d33/f46 x:0 0 0 2024-03-18T14:43:16.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/252: stat l0 0 2024-03-18T14:43:16.615 INFO:tasks.workunit.client.1.smithi129.stdout:6/273: creat d3/d30/de/f58 x:0 0 0 2024-03-18T14:43:16.616 INFO:tasks.workunit.client.1.smithi129.stdout:5/247: truncate d0/f14 1473986 0 2024-03-18T14:43:16.619 INFO:tasks.workunit.client.1.smithi129.stdout:3/223: rename d4/dd/d15/f25 to d4/dd/d15/d31/f49 0 2024-03-18T14:43:16.621 INFO:tasks.workunit.client.1.smithi129.stdout:2/216: symlink d7/d1f/d20/d2b/l40 0 2024-03-18T14:43:16.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/215: chown d0/d19/d1d/c2f 28869 1 2024-03-18T14:43:16.623 INFO:tasks.workunit.client.1.smithi129.stdout:0/285: dread d0/d23/d35/d3b/f3c [0,4194304] 0 2024-03-18T14:43:16.624 INFO:tasks.workunit.client.0.smithi087.stdout:5/491: truncate d13/d1b/f94 511378 0 2024-03-18T14:43:16.624 INFO:tasks.workunit.client.1.smithi129.stdout:1/253: symlink d1/d2/d28/l4d 0 2024-03-18T14:43:16.625 INFO:tasks.workunit.client.0.smithi087.stdout:2/436: symlink d2/d4/d22/d2c/d3a/d68/l88 0 2024-03-18T14:43:16.625 INFO:tasks.workunit.client.0.smithi087.stdout:8/460: symlink d1/d6/d14/l98 0 2024-03-18T14:43:16.627 INFO:tasks.workunit.client.1.smithi129.stdout:5/248: mkdir d0/dc/d18/d4b 0 2024-03-18T14:43:16.628 INFO:tasks.workunit.client.0.smithi087.stdout:1/512: rename d3/d1d/d1f/d63/c95 to d3/d1d/d1f/d34/c9c 0 2024-03-18T14:43:16.630 INFO:tasks.workunit.client.0.smithi087.stdout:0/452: mkdir d0/d2/da9 0 2024-03-18T14:43:16.631 INFO:tasks.workunit.client.0.smithi087.stdout:7/545: dwrite d1/f31 [4194304,4194304] 0 2024-03-18T14:43:16.631 INFO:tasks.workunit.client.0.smithi087.stdout:8/461: dread d1/d6/d9/f51 [0,4194304] 0 2024-03-18T14:43:16.631 INFO:tasks.workunit.client.0.smithi087.stdout:4/410: creat d2/db/f80 x:0 0 0 2024-03-18T14:43:16.632 INFO:tasks.workunit.client.0.smithi087.stdout:8/462: readlink d1/d6/d9/l33 0 2024-03-18T14:43:16.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/251: read d9/d11/d1a/d32/d3a/f49 [1101088,76027] 0 2024-03-18T14:43:16.633 INFO:tasks.workunit.client.0.smithi087.stdout:4/411: write d2/f7e [985126,76316] 0 2024-03-18T14:43:16.634 INFO:tasks.workunit.client.0.smithi087.stdout:5/492: unlink d13/d1b/d30/c60 0 2024-03-18T14:43:16.635 INFO:tasks.workunit.client.1.smithi129.stdout:2/217: mkdir d7/d1f/d20/d2b/d41 0 2024-03-18T14:43:16.635 INFO:tasks.workunit.client.1.smithi129.stdout:6/274: dread d3/d5/f13 [0,4194304] 0 2024-03-18T14:43:16.636 INFO:tasks.workunit.client.0.smithi087.stdout:7/546: read d1/d6/d29/d2f/d68/d65/d60/f94 [461976,75798] 0 2024-03-18T14:43:16.636 INFO:tasks.workunit.client.0.smithi087.stdout:7/547: readlink d1/d97/l99 0 2024-03-18T14:43:16.636 INFO:tasks.workunit.client.1.smithi129.stdout:4/216: mknod d0/d19/d1d/d2e/c3b 0 2024-03-18T14:43:16.636 INFO:tasks.workunit.client.0.smithi087.stdout:7/548: fdatasync d1/d6/d29/f53 0 2024-03-18T14:43:16.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/224: dwrite d4/d38/f2c [4194304,4194304] 0 2024-03-18T14:43:16.638 INFO:tasks.workunit.client.1.smithi129.stdout:9/243: link d0/f8 d0/db/d1f/d20/d26/d19/d29/d36/f47 0 2024-03-18T14:43:16.639 INFO:tasks.workunit.client.1.smithi129.stdout:3/225: write d4/d38/f2c [7344431,15749] 0 2024-03-18T14:43:16.639 INFO:tasks.workunit.client.0.smithi087.stdout:6/434: creat d3/d7/d25/d62/d7c/f94 x:0 0 0 2024-03-18T14:43:16.641 INFO:tasks.workunit.client.1.smithi129.stdout:0/286: rename d0/f1e to d0/d23/d29/f58 0 2024-03-18T14:43:16.642 INFO:tasks.workunit.client.0.smithi087.stdout:0/453: creat d0/d1a/d7b/d26/faa x:0 0 0 2024-03-18T14:43:16.642 INFO:tasks.workunit.client.1.smithi129.stdout:2/218: dwrite d7/d1f/d34/f3b [0,4194304] 0 2024-03-18T14:43:16.644 INFO:tasks.workunit.client.1.smithi129.stdout:1/254: unlink d1/d18/d19/c25 0 2024-03-18T14:43:16.645 INFO:tasks.workunit.client.1.smithi129.stdout:1/255: chown d1/d35/f4c 1478642 1 2024-03-18T14:43:16.645 INFO:tasks.workunit.client.1.smithi129.stdout:9/244: dwrite d0/f35 [0,4194304] 0 2024-03-18T14:43:16.645 INFO:tasks.workunit.client.1.smithi129.stdout:9/245: chown d0/db/d1f/f23 0 1 2024-03-18T14:43:16.646 INFO:tasks.workunit.client.0.smithi087.stdout:2/437: dread d2/d4/d22/d2c/d3a/d68/f6f [4194304,4194304] 0 2024-03-18T14:43:16.647 INFO:tasks.workunit.client.1.smithi129.stdout:6/275: mknod d3/d30/de/c59 0 2024-03-18T14:43:16.647 INFO:tasks.workunit.client.1.smithi129.stdout:6/276: fsync d3/d30/de/f58 0 2024-03-18T14:43:16.652 INFO:tasks.workunit.client.1.smithi129.stdout:7/251: getdents d4/d2d/d2e/d45 0 2024-03-18T14:43:16.652 INFO:tasks.workunit.client.0.smithi087.stdout:5/493: unlink d13/d1b/d30/f40 0 2024-03-18T14:43:16.656 INFO:tasks.workunit.client.1.smithi129.stdout:3/226: creat d4/d11/d1d/d36/f4a x:0 0 0 2024-03-18T14:43:16.656 INFO:tasks.workunit.client.1.smithi129.stdout:0/287: rmdir d0/d23/d29 39 2024-03-18T14:43:16.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/256: creat d1/d18/d19/f4e x:0 0 0 2024-03-18T14:43:16.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/257: fdatasync d1/d18/d19/f37 0 2024-03-18T14:43:16.660 INFO:tasks.workunit.client.0.smithi087.stdout:8/463: mknod d1/d6/c99 0 2024-03-18T14:43:16.660 INFO:tasks.workunit.client.1.smithi129.stdout:9/246: mkdir d0/db/d1f/d20/d25/d48 0 2024-03-18T14:43:16.661 INFO:tasks.workunit.client.0.smithi087.stdout:0/454: truncate d0/d1a/d7b/d26/f4b 813942 0 2024-03-18T14:43:16.663 INFO:tasks.workunit.client.0.smithi087.stdout:3/502: sync 2024-03-18T14:43:16.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/538: sync 2024-03-18T14:43:16.664 INFO:tasks.workunit.client.1.smithi129.stdout:3/227: creat d4/dd/d1f/f4b x:0 0 0 2024-03-18T14:43:16.664 INFO:tasks.workunit.client.0.smithi087.stdout:3/503: chown d0/de/d30/d60/f6c 237 1 2024-03-18T14:43:16.664 INFO:tasks.workunit.client.0.smithi087.stdout:5/494: creat d13/d1b/fa9 x:0 0 0 2024-03-18T14:43:16.668 INFO:tasks.workunit.client.1.smithi129.stdout:2/219: symlink d7/d1f/d20/d2b/d41/l42 0 2024-03-18T14:43:16.669 INFO:tasks.workunit.client.1.smithi129.stdout:5/249: truncate d0/df/f37 12504 0 2024-03-18T14:43:16.669 INFO:tasks.workunit.client.1.smithi129.stdout:8/252: truncate d9/d11/d1a/d32/d41/d4d/f4f 817735 0 2024-03-18T14:43:16.673 INFO:tasks.workunit.client.1.smithi129.stdout:9/247: mknod d0/db/d1f/d20/d26/d19/c49 0 2024-03-18T14:43:16.673 INFO:tasks.workunit.client.1.smithi129.stdout:4/217: truncate d0/f5 4605384 0 2024-03-18T14:43:16.679 INFO:tasks.workunit.client.0.smithi087.stdout:9/539: mknod db/d18/d1e/d28/cac 0 2024-03-18T14:43:16.679 INFO:tasks.workunit.client.0.smithi087.stdout:7/549: link d1/d6/d29/d2f/d68/d65/d60/d66/l6c d1/d6/d29/d2f/d68/d65/d96/lc3 0 2024-03-18T14:43:16.679 INFO:tasks.workunit.client.0.smithi087.stdout:5/495: symlink d13/d1b/d27/d35/laa 0 2024-03-18T14:43:16.681 INFO:tasks.workunit.client.0.smithi087.stdout:0/455: mkdir d0/dab 0 2024-03-18T14:43:16.682 INFO:tasks.workunit.client.1.smithi129.stdout:4/218: dwrite d0/d1a/f2c [0,4194304] 0 2024-03-18T14:43:16.682 INFO:tasks.workunit.client.1.smithi129.stdout:6/277: write d3/d30/de/d49/f50 [1186533,26237] 0 2024-03-18T14:43:16.683 INFO:tasks.workunit.client.1.smithi129.stdout:1/258: dread d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:16.683 INFO:tasks.workunit.client.0.smithi087.stdout:4/412: write d2/db/d24/d30/d7b/d7f/f68 [155582,97492] 0 2024-03-18T14:43:16.684 INFO:tasks.workunit.client.1.smithi129.stdout:1/259: write d1/d18/d19/f43 [45806,20132] 0 2024-03-18T14:43:16.684 INFO:tasks.workunit.client.1.smithi129.stdout:8/253: write d9/d11/d1a/f3e [4315446,27824] 0 2024-03-18T14:43:16.684 INFO:tasks.workunit.client.0.smithi087.stdout:9/540: mknod db/d18/cad 0 2024-03-18T14:43:16.685 INFO:tasks.workunit.client.1.smithi129.stdout:7/252: truncate d4/f6 6140657 0 2024-03-18T14:43:16.687 INFO:tasks.workunit.client.1.smithi129.stdout:3/228: mkdir d4/d11/d34/d4c 0 2024-03-18T14:43:16.687 INFO:tasks.workunit.client.1.smithi129.stdout:0/288: symlink d0/d14/d3a/d4a/l59 0 2024-03-18T14:43:16.688 INFO:tasks.workunit.client.1.smithi129.stdout:0/289: stat d0/d14/d28 0 2024-03-18T14:43:16.689 INFO:tasks.workunit.client.0.smithi087.stdout:1/513: dwrite d3/d1d/d1e/d43/d50/d72/f86 [0,4194304] 0 2024-03-18T14:43:16.689 INFO:tasks.workunit.client.0.smithi087.stdout:3/504: dwrite d0/de/d30/d67/f79 [0,4194304] 0 2024-03-18T14:43:16.689 INFO:tasks.workunit.client.1.smithi129.stdout:0/290: fdatasync d0/fb 0 2024-03-18T14:43:16.690 INFO:tasks.workunit.client.0.smithi087.stdout:6/435: dwrite d3/d7/d25/f2a [0,4194304] 0 2024-03-18T14:43:16.691 INFO:tasks.workunit.client.1.smithi129.stdout:9/248: dwrite d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:16.692 INFO:tasks.workunit.client.0.smithi087.stdout:8/464: dwrite d1/d6/d9/f17 [0,4194304] 0 2024-03-18T14:43:16.692 INFO:tasks.workunit.client.0.smithi087.stdout:4/413: creat d2/db/d3c/f81 x:0 0 0 2024-03-18T14:43:16.692 INFO:tasks.workunit.client.1.smithi129.stdout:5/250: mkdir d0/dc/d4c 0 2024-03-18T14:43:16.693 INFO:tasks.workunit.client.1.smithi129.stdout:1/260: symlink d1/d2/d28/l4f 0 2024-03-18T14:43:16.695 INFO:tasks.workunit.client.0.smithi087.stdout:6/436: write d3/d7/f85 [862176,104439] 0 2024-03-18T14:43:16.695 INFO:tasks.workunit.client.0.smithi087.stdout:1/514: unlink d3/cb 0 2024-03-18T14:43:16.696 INFO:tasks.workunit.client.0.smithi087.stdout:7/550: dwrite d1/d6/d29/f34 [4194304,4194304] 0 2024-03-18T14:43:16.698 INFO:tasks.workunit.client.0.smithi087.stdout:0/456: dwrite d0/d2/d4/d19/f2f [0,4194304] 0 2024-03-18T14:43:16.699 INFO:tasks.workunit.client.0.smithi087.stdout:6/437: fsync d3/d7/d25/d62/d7c/d29/f40 0 2024-03-18T14:43:16.699 INFO:tasks.workunit.client.1.smithi129.stdout:4/219: mkdir d0/d3c 0 2024-03-18T14:43:16.699 INFO:tasks.workunit.client.1.smithi129.stdout:7/253: chown d4/d2d/d3a/c44 1044000 1 2024-03-18T14:43:16.701 INFO:tasks.workunit.client.0.smithi087.stdout:9/541: truncate db/d18/d1e/d28/f4a 641879 0 2024-03-18T14:43:16.703 INFO:tasks.workunit.client.0.smithi087.stdout:3/505: dwrite d0/f28 [0,4194304] 0 2024-03-18T14:43:16.703 INFO:tasks.workunit.client.0.smithi087.stdout:4/414: dread d2/db/de/f2c [0,4194304] 0 2024-03-18T14:43:16.707 INFO:tasks.workunit.client.1.smithi129.stdout:1/261: rename d1/d2/c10 to d1/d2/d28/c50 0 2024-03-18T14:43:16.707 INFO:tasks.workunit.client.1.smithi129.stdout:5/251: creat d0/d32/d34/f4d x:0 0 0 2024-03-18T14:43:16.707 INFO:tasks.workunit.client.0.smithi087.stdout:7/551: fsync d1/d6/da/d42/f4a 0 2024-03-18T14:43:16.707 INFO:tasks.workunit.client.0.smithi087.stdout:1/515: creat d3/d1d/d1e/d43/d50/d72/f9d x:0 0 0 2024-03-18T14:43:16.707 INFO:tasks.workunit.client.1.smithi129.stdout:4/220: readlink d0/d9/la 0 2024-03-18T14:43:16.708 INFO:tasks.workunit.client.1.smithi129.stdout:5/252: chown d0/dc/d18/d4b 680 1 2024-03-18T14:43:16.711 INFO:tasks.workunit.client.0.smithi087.stdout:6/438: mkdir d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95 0 2024-03-18T14:43:16.712 INFO:tasks.workunit.client.1.smithi129.stdout:1/262: creat d1/d2/d28/f51 x:0 0 0 2024-03-18T14:43:16.713 INFO:tasks.workunit.client.0.smithi087.stdout:3/506: dread - d0/d3/d10/d7f/f82 zero size 2024-03-18T14:43:16.714 INFO:tasks.workunit.client.1.smithi129.stdout:3/229: getdents d4/d11 0 2024-03-18T14:43:16.715 INFO:tasks.workunit.client.1.smithi129.stdout:0/291: getdents d0/d23/d35/d50 0 2024-03-18T14:43:16.715 INFO:tasks.workunit.client.1.smithi129.stdout:7/254: link d4/d7/c2b d4/d2d/d2e/c4e 0 2024-03-18T14:43:16.717 INFO:tasks.workunit.client.1.smithi129.stdout:1/263: mkdir d1/d18/d19/d52 0 2024-03-18T14:43:16.717 INFO:tasks.workunit.client.1.smithi129.stdout:4/221: fdatasync d0/d9/f15 0 2024-03-18T14:43:16.721 INFO:tasks.workunit.client.0.smithi087.stdout:7/552: creat d1/d8e/d95/fc4 x:0 0 0 2024-03-18T14:43:16.721 INFO:tasks.workunit.client.0.smithi087.stdout:1/516: mknod d3/d1d/d1f/d34/c9e 0 2024-03-18T14:43:16.722 INFO:tasks.workunit.client.1.smithi129.stdout:1/264: symlink d1/d18/d19/l53 0 2024-03-18T14:43:16.724 INFO:tasks.workunit.client.0.smithi087.stdout:4/415: unlink d2/db/de/c37 0 2024-03-18T14:43:16.725 INFO:tasks.workunit.client.1.smithi129.stdout:5/253: truncate d0/dc/d22/f39 895351 0 2024-03-18T14:43:16.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/465: truncate d1/d6/d9/f61 337688 0 2024-03-18T14:43:16.725 INFO:tasks.workunit.client.0.smithi087.stdout:7/553: dwrite d1/f31 [4194304,4194304] 0 2024-03-18T14:43:16.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/416: readlink d2/db/d24/d30/d56/l5f 0 2024-03-18T14:43:16.726 INFO:tasks.workunit.client.1.smithi129.stdout:5/254: dread d0/dc/d18/d2b/f30 [0,4194304] 0 2024-03-18T14:43:16.727 INFO:tasks.workunit.client.1.smithi129.stdout:2/220: sync 2024-03-18T14:43:16.727 INFO:tasks.workunit.client.0.smithi087.stdout:9/542: mknod db/d18/d51/d8f/cae 0 2024-03-18T14:43:16.728 INFO:tasks.workunit.client.1.smithi129.stdout:2/221: chown d7/d1c/d32/l3c 322156 1 2024-03-18T14:43:16.729 INFO:tasks.workunit.client.0.smithi087.stdout:6/439: getdents d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95 0 2024-03-18T14:43:16.731 INFO:tasks.workunit.client.0.smithi087.stdout:8/466: dwrite d1/d6/d2f/d44/d45/d50/f5e [0,4194304] 0 2024-03-18T14:43:16.731 INFO:tasks.workunit.client.0.smithi087.stdout:7/554: fsync d1/d6/d16/dc/f26 0 2024-03-18T14:43:16.732 INFO:tasks.workunit.client.0.smithi087.stdout:7/555: stat d1/d6/d29/d2f/f33 0 2024-03-18T14:43:16.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/417: mkdir d2/db/d82 0 2024-03-18T14:43:16.735 INFO:tasks.workunit.client.1.smithi129.stdout:3/230: creat d4/dd/f4d x:0 0 0 2024-03-18T14:43:16.737 INFO:tasks.workunit.client.0.smithi087.stdout:2/438: sync 2024-03-18T14:43:16.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/440: dwrite d3/f45 [0,4194304] 0 2024-03-18T14:43:16.738 INFO:tasks.workunit.client.0.smithi087.stdout:7/556: creat d1/d6/da/d42/d61/d74/fc5 x:0 0 0 2024-03-18T14:43:16.738 INFO:tasks.workunit.client.1.smithi129.stdout:7/255: creat d4/f4f x:0 0 0 2024-03-18T14:43:16.738 INFO:tasks.workunit.client.1.smithi129.stdout:7/256: dread - d4/d7/d8/f47 zero size 2024-03-18T14:43:16.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/439: write d2/d4/d22/d2c/d3a/d40/f84 [648792,45627] 0 2024-03-18T14:43:16.740 INFO:tasks.workunit.client.0.smithi087.stdout:4/418: write d2/db/d24/f33 [670934,36780] 0 2024-03-18T14:43:16.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/440: write d2/f10 [758724,56582] 0 2024-03-18T14:43:16.742 INFO:tasks.workunit.client.0.smithi087.stdout:2/441: write d2/d4/d22/d24/d65/f83 [274193,37208] 0 2024-03-18T14:43:16.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/222: link d0/d19/d1d/c28 d0/d19/d1d/d2e/c3d 0 2024-03-18T14:43:16.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/223: chown d0/d19/f38 575503 1 2024-03-18T14:43:16.742 INFO:tasks.workunit.client.1.smithi129.stdout:4/224: readlink d0/d9/le 0 2024-03-18T14:43:16.743 INFO:tasks.workunit.client.1.smithi129.stdout:4/225: stat d0/d19/d1d/d2e/c3b 0 2024-03-18T14:43:16.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/441: mkdir d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95/d96 0 2024-03-18T14:43:16.745 INFO:tasks.workunit.client.0.smithi087.stdout:2/442: chown d2/d4/d22/d2c/d3a/d40/d52/f5c 961235 1 2024-03-18T14:43:16.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/257: creat d4/d2d/d2e/f50 x:0 0 0 2024-03-18T14:43:16.747 INFO:tasks.workunit.client.1.smithi129.stdout:2/222: creat d7/d3f/f43 x:0 0 0 2024-03-18T14:43:16.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/419: symlink d2/db/l83 0 2024-03-18T14:43:16.750 INFO:tasks.workunit.client.1.smithi129.stdout:4/226: rename d0/d9/d1e to d0/d19/d1d/d3e 0 2024-03-18T14:43:16.751 INFO:tasks.workunit.client.1.smithi129.stdout:4/227: write d0/d1a/f24 [4808752,125594] 0 2024-03-18T14:43:16.751 INFO:tasks.workunit.client.1.smithi129.stdout:5/255: creat d0/dc/f4e x:0 0 0 2024-03-18T14:43:16.752 INFO:tasks.workunit.client.0.smithi087.stdout:4/420: fsync d2/d13/d28/f40 0 2024-03-18T14:43:16.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/265: link d1/c13 d1/d18/d19/d52/c54 0 2024-03-18T14:43:16.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/266: chown d1/d18 1428814890 1 2024-03-18T14:43:16.754 INFO:tasks.workunit.client.1.smithi129.stdout:2/223: creat d7/d1f/d20/d2d/f44 x:0 0 0 2024-03-18T14:43:16.756 INFO:tasks.workunit.client.0.smithi087.stdout:8/467: read d1/d6/d2f/d44/d45/d72/d7f/d83/f96 [586891,115751] 0 2024-03-18T14:43:16.756 INFO:tasks.workunit.client.0.smithi087.stdout:2/443: read d2/d4/d22/d2c/d3a/d40/f84 [261898,109046] 0 2024-03-18T14:43:16.757 INFO:tasks.workunit.client.0.smithi087.stdout:4/421: dread d2/db/de/f2c [0,4194304] 0 2024-03-18T14:43:16.759 INFO:tasks.workunit.client.1.smithi129.stdout:9/249: dwrite d0/db/fd [0,4194304] 0 2024-03-18T14:43:16.761 INFO:tasks.workunit.client.0.smithi087.stdout:2/444: mknod d2/d4/d22/d24/d65/d7f/c89 0 2024-03-18T14:43:16.761 INFO:tasks.workunit.client.1.smithi129.stdout:6/278: truncate d3/d5/d2b/f53 505769 0 2024-03-18T14:43:16.761 INFO:tasks.workunit.client.1.smithi129.stdout:6/279: dread - d3/f3c zero size 2024-03-18T14:43:16.762 INFO:tasks.workunit.client.0.smithi087.stdout:2/445: write d2/d4/d22/d2c/d3a/d49/f57 [1178822,115795] 0 2024-03-18T14:43:16.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/496: sync 2024-03-18T14:43:16.763 INFO:tasks.workunit.client.0.smithi087.stdout:4/422: mkdir d2/db/d84 0 2024-03-18T14:43:16.765 INFO:tasks.workunit.client.1.smithi129.stdout:6/280: dwrite d3/d30/f26 [4194304,4194304] 0 2024-03-18T14:43:16.768 INFO:tasks.workunit.client.1.smithi129.stdout:8/254: write d9/d11/d1a/d32/d41/d4d/f4f [392065,27785] 0 2024-03-18T14:43:16.768 INFO:tasks.workunit.client.1.smithi129.stdout:0/292: dwrite d0/d14/d28/f30 [0,4194304] 0 2024-03-18T14:43:16.769 INFO:tasks.workunit.client.1.smithi129.stdout:8/255: stat d9/f15 0 2024-03-18T14:43:16.772 INFO:tasks.workunit.client.0.smithi087.stdout:7/557: fsync d1/d8e/d95/fc4 0 2024-03-18T14:43:16.773 INFO:tasks.workunit.client.1.smithi129.stdout:2/224: creat d7/d1c/d32/f45 x:0 0 0 2024-03-18T14:43:16.773 INFO:tasks.workunit.client.1.smithi129.stdout:2/225: chown d7/d1f/d34/l13 52038793 1 2024-03-18T14:43:16.773 INFO:tasks.workunit.client.0.smithi087.stdout:8/468: read d1/d6/d2f/d44/f6f [3749697,31769] 0 2024-03-18T14:43:16.773 INFO:tasks.workunit.client.0.smithi087.stdout:3/507: write d0/f37 [1743471,47371] 0 2024-03-18T14:43:16.777 INFO:tasks.workunit.client.0.smithi087.stdout:6/442: rmdir d3/d7 39 2024-03-18T14:43:16.778 INFO:tasks.workunit.client.0.smithi087.stdout:0/457: dwrite d0/d2/f84 [0,4194304] 0 2024-03-18T14:43:16.780 INFO:tasks.workunit.client.0.smithi087.stdout:1/517: dwrite d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:16.780 INFO:tasks.workunit.client.0.smithi087.stdout:9/543: dwrite db/d18/d1c/d69/f8c [4194304,4194304] 0 2024-03-18T14:43:16.780 INFO:tasks.workunit.client.0.smithi087.stdout:0/458: write d0/d1a/d7b/f22 [373819,106098] 0 2024-03-18T14:43:16.784 INFO:tasks.workunit.client.0.smithi087.stdout:4/423: chown d2/f5b 11395 1 2024-03-18T14:43:16.785 INFO:tasks.workunit.client.1.smithi129.stdout:3/231: dread d4/d38/f1b [0,4194304] 0 2024-03-18T14:43:16.785 INFO:tasks.workunit.client.1.smithi129.stdout:3/232: chown d4/dd/d1f/l28 3300 1 2024-03-18T14:43:16.786 INFO:tasks.workunit.client.1.smithi129.stdout:7/258: link d4/d2d/d2e/l2f d4/d2d/l51 0 2024-03-18T14:43:16.787 INFO:tasks.workunit.client.0.smithi087.stdout:5/497: dwrite d13/d1b/d27/f7b [0,4194304] 0 2024-03-18T14:43:16.787 INFO:tasks.workunit.client.0.smithi087.stdout:5/498: write ff [3574083,76716] 0 2024-03-18T14:43:16.788 INFO:tasks.workunit.client.0.smithi087.stdout:5/499: chown d13/d1b/d27/d28/l85 1 1 2024-03-18T14:43:16.790 INFO:tasks.workunit.client.1.smithi129.stdout:2/226: mknod d7/d1f/d20/d2a/c46 0 2024-03-18T14:43:16.790 INFO:tasks.workunit.client.1.smithi129.stdout:4/228: link d0/l12 d0/d1a/l3f 0 2024-03-18T14:43:16.791 INFO:tasks.workunit.client.1.smithi129.stdout:4/229: write d0/d1a/f25 [301426,119101] 0 2024-03-18T14:43:16.791 INFO:tasks.workunit.client.0.smithi087.stdout:8/469: creat d1/f9a x:0 0 0 2024-03-18T14:43:16.791 INFO:tasks.workunit.client.0.smithi087.stdout:3/508: unlink d0/de/d30/d67/l77 0 2024-03-18T14:43:16.792 INFO:tasks.workunit.client.1.smithi129.stdout:4/230: fsync d0/d19/d1d/f36 0 2024-03-18T14:43:16.792 INFO:tasks.workunit.client.0.smithi087.stdout:8/470: chown d1/d6/d9/d5d/d87/d88 714749 1 2024-03-18T14:43:16.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/233: mknod d4/dd/d15/c4e 0 2024-03-18T14:43:16.794 INFO:tasks.workunit.client.1.smithi129.stdout:2/227: dread d7/d1c/f26 [0,4194304] 0 2024-03-18T14:43:16.794 INFO:tasks.workunit.client.1.smithi129.stdout:2/228: dread - d7/d1f/d34/f30 zero size 2024-03-18T14:43:16.795 INFO:tasks.workunit.client.1.smithi129.stdout:9/250: rmdir d0/db/d1f/d20/d25/d48 0 2024-03-18T14:43:16.795 INFO:tasks.workunit.client.1.smithi129.stdout:2/229: write d7/d1c/d32/f45 [428521,12423] 0 2024-03-18T14:43:16.796 INFO:tasks.workunit.client.1.smithi129.stdout:2/230: chown d7/d1f/d20/c31 74 1 2024-03-18T14:43:16.796 INFO:tasks.workunit.client.1.smithi129.stdout:7/259: getdents d4/d7/d38/d49 0 2024-03-18T14:43:16.800 INFO:tasks.workunit.client.0.smithi087.stdout:2/446: mkdir d2/d44/d72/d8a 0 2024-03-18T14:43:16.800 INFO:tasks.workunit.client.1.smithi129.stdout:9/251: rename d0/db/d1f/d33 to d0/db/d1f/d20/d4a 0 2024-03-18T14:43:16.804 INFO:tasks.workunit.client.0.smithi087.stdout:8/471: read d1/d6/f43 [181555,89008] 0 2024-03-18T14:43:16.804 INFO:tasks.workunit.client.1.smithi129.stdout:0/293: dread d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:16.806 INFO:tasks.workunit.client.0.smithi087.stdout:9/544: creat db/d18/d3a/faf x:0 0 0 2024-03-18T14:43:16.807 INFO:tasks.workunit.client.1.smithi129.stdout:2/231: unlink d7/d1c/d32/f45 0 2024-03-18T14:43:16.808 INFO:tasks.workunit.client.0.smithi087.stdout:5/500: fdatasync d13/d1b/f94 0 2024-03-18T14:43:16.810 INFO:tasks.workunit.client.1.smithi129.stdout:9/252: creat d0/db/d2e/f4b x:0 0 0 2024-03-18T14:43:16.810 INFO:tasks.workunit.client.1.smithi129.stdout:4/231: getdents d0/d19/d1d 0 2024-03-18T14:43:16.811 INFO:tasks.workunit.client.0.smithi087.stdout:6/443: mkdir d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95/d96/d97 0 2024-03-18T14:43:16.811 INFO:tasks.workunit.client.1.smithi129.stdout:4/232: readlink d0/d9/la 0 2024-03-18T14:43:16.811 INFO:tasks.workunit.client.0.smithi087.stdout:6/444: readlink d3/d7/d25/d62/d7c/d29/ld 0 2024-03-18T14:43:16.813 INFO:tasks.workunit.client.0.smithi087.stdout:9/545: mknod db/d18/d3a/cb0 0 2024-03-18T14:43:16.815 INFO:tasks.workunit.client.0.smithi087.stdout:5/501: mkdir d13/d1b/d27/d8f/dab 0 2024-03-18T14:43:16.815 INFO:tasks.workunit.client.1.smithi129.stdout:7/260: rename d4/d2d/l51 to d4/d7/l52 0 2024-03-18T14:43:16.820 INFO:tasks.workunit.client.1.smithi129.stdout:7/261: creat d4/d2d/d3a/f53 x:0 0 0 2024-03-18T14:43:16.821 INFO:tasks.workunit.client.1.smithi129.stdout:4/233: truncate d0/f13 2065488 0 2024-03-18T14:43:16.822 INFO:tasks.workunit.client.1.smithi129.stdout:2/232: link d7/d1f/d20/d2d/l3a d7/d1c/d32/l47 0 2024-03-18T14:43:16.822 INFO:tasks.workunit.client.0.smithi087.stdout:9/546: truncate db/d18/d3a/f9f 1092004 0 2024-03-18T14:43:16.823 INFO:tasks.workunit.client.0.smithi087.stdout:0/459: read d0/d1a/d7b/d2a/f68 [3601814,61850] 0 2024-03-18T14:43:16.824 INFO:tasks.workunit.client.0.smithi087.stdout:0/460: write d0/f10 [927419,30893] 0 2024-03-18T14:43:16.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/547: write db/d31/f42 [541385,71723] 0 2024-03-18T14:43:16.824 INFO:tasks.workunit.client.0.smithi087.stdout:3/509: dread d0/d3/f29 [0,4194304] 0 2024-03-18T14:43:16.824 INFO:tasks.workunit.client.0.smithi087.stdout:7/558: link d1/d6/d16/dc/c8a d1/cc6 0 2024-03-18T14:43:16.825 INFO:tasks.workunit.client.0.smithi087.stdout:3/510: read - d0/d1c/f91 zero size 2024-03-18T14:43:16.826 INFO:tasks.workunit.client.1.smithi129.stdout:8/256: write d9/d11/d18/f3f [84312,73910] 0 2024-03-18T14:43:16.826 INFO:tasks.workunit.client.1.smithi129.stdout:1/267: truncate d1/d2/f3b 406897 0 2024-03-18T14:43:16.828 INFO:tasks.workunit.client.1.smithi129.stdout:5/256: dwrite d0/f14 [0,4194304] 0 2024-03-18T14:43:16.828 INFO:tasks.workunit.client.1.smithi129.stdout:1/268: write d1/f40 [278179,99379] 0 2024-03-18T14:43:16.828 INFO:tasks.workunit.client.0.smithi087.stdout:7/559: dwrite d1/d6/da/d42/f7b [0,4194304] 0 2024-03-18T14:43:16.829 INFO:tasks.workunit.client.1.smithi129.stdout:2/233: dwrite d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:16.833 INFO:tasks.workunit.client.1.smithi129.stdout:8/257: dwrite d9/d11/f3b [0,4194304] 0 2024-03-18T14:43:16.835 INFO:tasks.workunit.client.1.smithi129.stdout:0/294: write d0/d14/f4d [1591554,18095] 0 2024-03-18T14:43:16.835 INFO:tasks.workunit.client.1.smithi129.stdout:2/234: dwrite d7/d1f/d34/f1a [4194304,4194304] 0 2024-03-18T14:43:16.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/295: chown d0/d14/f4d 7149489 1 2024-03-18T14:43:16.837 INFO:tasks.workunit.client.1.smithi129.stdout:2/235: write d7/d1f/d34/f3b [1655778,62210] 0 2024-03-18T14:43:16.838 INFO:tasks.workunit.client.1.smithi129.stdout:0/296: dread - d0/d23/d35/d3b/f57 zero size 2024-03-18T14:43:16.840 INFO:tasks.workunit.client.0.smithi087.stdout:5/502: dread d13/d1b/d27/d35/f4f [0,4194304] 0 2024-03-18T14:43:16.840 INFO:tasks.workunit.client.0.smithi087.stdout:2/447: dwrite d2/d4/f59 [4194304,4194304] 0 2024-03-18T14:43:16.842 INFO:tasks.workunit.client.0.smithi087.stdout:5/503: read - d13/d1b/d7e/f92 zero size 2024-03-18T14:43:16.842 INFO:tasks.workunit.client.0.smithi087.stdout:1/518: chown d3/d1d/c66 6147764 1 2024-03-18T14:43:16.843 INFO:tasks.workunit.client.1.smithi129.stdout:6/281: dwrite d3/d5/d2b/f53 [0,4194304] 0 2024-03-18T14:43:16.843 INFO:tasks.workunit.client.0.smithi087.stdout:7/560: mkdir d1/d6/d29/d2f/d68/dc7 0 2024-03-18T14:43:16.844 INFO:tasks.workunit.client.0.smithi087.stdout:4/424: write d2/d13/d28/f42 [41250,24143] 0 2024-03-18T14:43:16.845 INFO:tasks.workunit.client.0.smithi087.stdout:5/504: fsync d13/d1b/d27/d35/f43 0 2024-03-18T14:43:16.847 INFO:tasks.workunit.client.0.smithi087.stdout:8/472: dwrite d1/d6/d14/f79 [0,4194304] 0 2024-03-18T14:43:16.847 INFO:tasks.workunit.client.0.smithi087.stdout:6/445: rename d3/d7/d25/d62/d7c/d29/d22/d61/c6f to d3/d7/d25/d62/d7c/d29/d22/c98 0 2024-03-18T14:43:16.849 INFO:tasks.workunit.client.1.smithi129.stdout:4/234: mkdir d0/d9/d40 0 2024-03-18T14:43:16.849 INFO:tasks.workunit.client.1.smithi129.stdout:7/262: mkdir d4/d7/d54 0 2024-03-18T14:43:16.849 INFO:tasks.workunit.client.0.smithi087.stdout:9/548: dwrite db/d31/f8d [0,4194304] 0 2024-03-18T14:43:16.850 INFO:tasks.workunit.client.1.smithi129.stdout:5/257: chown d0/f11 8 1 2024-03-18T14:43:16.850 INFO:tasks.workunit.client.0.smithi087.stdout:9/549: chown db/d18/d3a/l86 297561386 1 2024-03-18T14:43:16.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/561: symlink d1/d6/da/d42/lc8 0 2024-03-18T14:43:16.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/505: mknod d13/cac 0 2024-03-18T14:43:16.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/297: mknod d0/d14/d53/c5a 0 2024-03-18T14:43:16.857 INFO:tasks.workunit.client.0.smithi087.stdout:1/519: rename d3/d1d/d67/d94/l98 to d3/d1d/d1e/d43/d9b/l9f 0 2024-03-18T14:43:16.857 INFO:tasks.workunit.client.1.smithi129.stdout:1/269: symlink d1/d18/d19/d49/l55 0 2024-03-18T14:43:16.858 INFO:tasks.workunit.client.0.smithi087.stdout:4/425: mknod d2/db/d67/c85 0 2024-03-18T14:43:16.859 INFO:tasks.workunit.client.1.smithi129.stdout:4/235: readlink d0/d1a/l3f 0 2024-03-18T14:43:16.862 INFO:tasks.workunit.client.1.smithi129.stdout:3/234: sync 2024-03-18T14:43:16.862 INFO:tasks.workunit.client.1.smithi129.stdout:3/235: chown d4 6 1 2024-03-18T14:43:16.866 INFO:tasks.workunit.client.1.smithi129.stdout:3/236: dwrite d4/d38/f24 [0,4194304] 0 2024-03-18T14:43:16.870 INFO:tasks.workunit.client.0.smithi087.stdout:9/550: symlink db/d18/d1c/d69/lb1 0 2024-03-18T14:43:16.870 INFO:tasks.workunit.client.0.smithi087.stdout:7/562: creat d1/d6/d29/d2f/d68/d65/d72/fc9 x:0 0 0 2024-03-18T14:43:16.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/563: chown d1/d6/d16/la0 41 1 2024-03-18T14:43:16.871 INFO:tasks.workunit.client.1.smithi129.stdout:8/258: mkdir d9/d11/d55 0 2024-03-18T14:43:16.872 INFO:tasks.workunit.client.0.smithi087.stdout:7/564: dread - d1/d6/da/fbd zero size 2024-03-18T14:43:16.872 INFO:tasks.workunit.client.0.smithi087.stdout:7/565: readlink d1/d6/d29/d2f/d68/d65/d96/lc3 0 2024-03-18T14:43:16.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/448: creat d2/d4/d22/d2c/d3a/d49/f8b x:0 0 0 2024-03-18T14:43:16.874 INFO:tasks.workunit.client.0.smithi087.stdout:1/520: readlink d3/l60 0 2024-03-18T14:43:16.874 INFO:tasks.workunit.client.1.smithi129.stdout:7/263: link d4/d7/d8/f1c d4/d2d/d2e/d45/f55 0 2024-03-18T14:43:16.875 INFO:tasks.workunit.client.1.smithi129.stdout:1/270: dwrite d1/d35/f45 [0,4194304] 0 2024-03-18T14:43:16.875 INFO:tasks.workunit.client.1.smithi129.stdout:7/264: chown d4/d2d/d3a/c44 177097878 1 2024-03-18T14:43:16.876 INFO:tasks.workunit.client.0.smithi087.stdout:9/551: creat db/d12/fb2 x:0 0 0 2024-03-18T14:43:16.878 INFO:tasks.workunit.client.0.smithi087.stdout:7/566: rename d1/d6/f14 to d1/d6/d29/d2f/fca 0 2024-03-18T14:43:16.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/449: creat d2/d4/d22/d2c/d3a/d49/d58/f8c x:0 0 0 2024-03-18T14:43:16.880 INFO:tasks.workunit.client.0.smithi087.stdout:1/521: chown d3/d1d/d1f/d34/d38/c4f 91770607 1 2024-03-18T14:43:16.883 INFO:tasks.workunit.client.0.smithi087.stdout:2/450: creat d2/d4/d22/d2c/d3a/d40/f8d x:0 0 0 2024-03-18T14:43:16.884 INFO:tasks.workunit.client.1.smithi129.stdout:4/236: symlink d0/l41 0 2024-03-18T14:43:16.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/552: truncate db/d12/f33 519771 0 2024-03-18T14:43:16.885 INFO:tasks.workunit.client.1.smithi129.stdout:3/237: mknod d4/d11/d34/c4f 0 2024-03-18T14:43:16.885 INFO:tasks.workunit.client.0.smithi087.stdout:1/522: symlink d3/d1d/d1e/la0 0 2024-03-18T14:43:16.888 INFO:tasks.workunit.client.1.smithi129.stdout:4/237: rename d0/d19/d1d/f22 to d0/d19/d1d/d3e/f42 0 2024-03-18T14:43:16.891 INFO:tasks.workunit.client.1.smithi129.stdout:3/238: mkdir d4/d11/d1d/d50 0 2024-03-18T14:43:16.892 INFO:tasks.workunit.client.1.smithi129.stdout:1/271: truncate d1/d2/f4b 414547 0 2024-03-18T14:43:16.892 INFO:tasks.workunit.client.1.smithi129.stdout:3/239: write d4/dd/f3d [602914,5070] 0 2024-03-18T14:43:16.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/451: write d2/d4/f46 [388974,34862] 0 2024-03-18T14:43:16.894 INFO:tasks.workunit.client.1.smithi129.stdout:9/253: sync 2024-03-18T14:43:16.895 INFO:tasks.workunit.client.0.smithi087.stdout:1/523: symlink d3/d3c/la1 0 2024-03-18T14:43:16.895 INFO:tasks.workunit.client.1.smithi129.stdout:7/265: link d4/d2d/d2e/d45/l4a d4/d7/l56 0 2024-03-18T14:43:16.895 INFO:tasks.workunit.client.1.smithi129.stdout:8/259: getdents d9/d11/d1a/d32/d41 0 2024-03-18T14:43:16.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/452: creat d2/d4/d22/d24/f8e x:0 0 0 2024-03-18T14:43:16.897 INFO:tasks.workunit.client.1.smithi129.stdout:1/272: mkdir d1/d18/d19/d49/d56 0 2024-03-18T14:43:16.898 INFO:tasks.workunit.client.1.smithi129.stdout:9/254: rmdir d0/db/d1f 39 2024-03-18T14:43:16.898 INFO:tasks.workunit.client.0.smithi087.stdout:1/524: dread d3/d1d/d1f/d34/f53 [0,4194304] 0 2024-03-18T14:43:16.899 INFO:tasks.workunit.client.1.smithi129.stdout:9/255: readlink d0/db/l17 0 2024-03-18T14:43:16.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/453: chown d2/d4/c67 4096300 1 2024-03-18T14:43:16.899 INFO:tasks.workunit.client.0.smithi087.stdout:2/454: fdatasync d2/d4/f16 0 2024-03-18T14:43:16.900 INFO:tasks.workunit.client.1.smithi129.stdout:8/260: dread d9/d11/f3b [0,4194304] 0 2024-03-18T14:43:16.901 INFO:tasks.workunit.client.1.smithi129.stdout:1/273: rmdir d1/d2/d28 39 2024-03-18T14:43:16.906 INFO:tasks.workunit.client.0.smithi087.stdout:8/473: dread d1/d6/d2f/d44/d4b/f4c [0,4194304] 0 2024-03-18T14:43:16.906 INFO:tasks.workunit.client.1.smithi129.stdout:1/274: rmdir d1/d18/d19/d52 39 2024-03-18T14:43:16.907 INFO:tasks.workunit.client.1.smithi129.stdout:3/240: link d4/dd/c2a d4/d11/d1d/d27/c51 0 2024-03-18T14:43:16.907 INFO:tasks.workunit.client.0.smithi087.stdout:8/474: read d1/d6/d14/f5c [416180,18933] 0 2024-03-18T14:43:16.907 INFO:tasks.workunit.client.1.smithi129.stdout:9/256: rmdir d0/db/d1f 39 2024-03-18T14:43:16.908 INFO:tasks.workunit.client.1.smithi129.stdout:5/258: dread d0/f6 [0,4194304] 0 2024-03-18T14:43:16.908 INFO:tasks.workunit.client.1.smithi129.stdout:5/259: chown d0/f11 3156 1 2024-03-18T14:43:16.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/553: dread f8 [4194304,4194304] 0 2024-03-18T14:43:16.911 INFO:tasks.workunit.client.0.smithi087.stdout:2/455: creat d2/d4/d22/d2c/d3a/d40/f8f x:0 0 0 2024-03-18T14:43:16.912 INFO:tasks.workunit.client.0.smithi087.stdout:9/554: fdatasync f7 0 2024-03-18T14:43:16.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/456: stat d2/f43 0 2024-03-18T14:43:16.913 INFO:tasks.workunit.client.1.smithi129.stdout:1/275: symlink d1/d18/d19/l57 0 2024-03-18T14:43:16.913 INFO:tasks.workunit.client.1.smithi129.stdout:2/236: write d7/fc [435921,2286] 0 2024-03-18T14:43:16.915 INFO:tasks.workunit.client.1.smithi129.stdout:2/237: write d7/fc [831027,119396] 0 2024-03-18T14:43:16.915 INFO:tasks.workunit.client.1.smithi129.stdout:9/257: dwrite d0/db/d1f/d20/d4a/f46 [0,4194304] 0 2024-03-18T14:43:16.915 INFO:tasks.workunit.client.0.smithi087.stdout:7/567: truncate d1/d6/d29/d2f/d68/d65/d72/f80 1642267 0 2024-03-18T14:43:16.915 INFO:tasks.workunit.client.0.smithi087.stdout:4/426: dwrite d2/db/de/f45 [0,4194304] 0 2024-03-18T14:43:16.916 INFO:tasks.workunit.client.1.smithi129.stdout:6/282: write d3/d30/d44/f4a [22156,59625] 0 2024-03-18T14:43:16.916 INFO:tasks.workunit.client.1.smithi129.stdout:9/258: chown d0/f1b 0 1 2024-03-18T14:43:16.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/259: write d0/f35 [5024399,7287] 0 2024-03-18T14:43:16.918 INFO:tasks.workunit.client.0.smithi087.stdout:1/525: write d3/d1d/d1f/f3f [329715,37901] 0 2024-03-18T14:43:16.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/555: dwrite db/d18/d1e/f46 [0,4194304] 0 2024-03-18T14:43:16.920 INFO:tasks.workunit.client.1.smithi129.stdout:9/260: dread d0/db/d1f/d20/d4a/f46 [0,4194304] 0 2024-03-18T14:43:16.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/475: mkdir d1/d6/d2f/d9b 0 2024-03-18T14:43:16.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/476: dread - d1/d6/d14/f27 zero size 2024-03-18T14:43:16.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/266: write d4/d2d/d2e/f41 [1060870,76468] 0 2024-03-18T14:43:16.923 INFO:tasks.workunit.client.0.smithi087.stdout:2/457: mknod d2/d4/d22/d2c/d3a/d40/d52/c90 0 2024-03-18T14:43:16.924 INFO:tasks.workunit.client.1.smithi129.stdout:4/238: dwrite d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:16.924 INFO:tasks.workunit.client.1.smithi129.stdout:8/261: getdents d9/d11 0 2024-03-18T14:43:16.929 INFO:tasks.workunit.client.1.smithi129.stdout:4/239: dwrite d0/d19/d1d/d3e/f29 [0,4194304] 0 2024-03-18T14:43:16.930 INFO:tasks.workunit.client.0.smithi087.stdout:5/506: truncate d13/f57 460079 0 2024-03-18T14:43:16.932 INFO:tasks.workunit.client.0.smithi087.stdout:2/458: mkdir d2/d4/d22/d24/d91 0 2024-03-18T14:43:16.932 INFO:tasks.workunit.client.1.smithi129.stdout:5/260: rmdir d0/df 39 2024-03-18T14:43:16.934 INFO:tasks.workunit.client.1.smithi129.stdout:0/298: sync 2024-03-18T14:43:16.934 INFO:tasks.workunit.client.0.smithi087.stdout:4/427: unlink d2/db/c14 0 2024-03-18T14:43:16.936 INFO:tasks.workunit.client.1.smithi129.stdout:6/283: chown d3/d5/l40 1689997 1 2024-03-18T14:43:16.937 INFO:tasks.workunit.client.1.smithi129.stdout:2/238: creat d7/d1f/d20/d2a/f48 x:0 0 0 2024-03-18T14:43:16.938 INFO:tasks.workunit.client.1.smithi129.stdout:2/239: write d7/d1f/d34/f1a [1352870,47815] 0 2024-03-18T14:43:16.939 INFO:tasks.workunit.client.1.smithi129.stdout:2/240: chown d7/d1f/d20/d2d/f35 211214 1 2024-03-18T14:43:16.940 INFO:tasks.workunit.client.1.smithi129.stdout:9/261: mkdir d0/db/d1f/d4c 0 2024-03-18T14:43:16.941 INFO:tasks.workunit.client.0.smithi087.stdout:1/526: creat d3/d1d/d1e/fa2 x:0 0 0 2024-03-18T14:43:16.941 INFO:tasks.workunit.client.1.smithi129.stdout:6/284: dwrite d3/d30/de/d49/f50 [0,4194304] 0 2024-03-18T14:43:16.941 INFO:tasks.workunit.client.1.smithi129.stdout:7/267: chown d4/d2d/d2e/c4e 7124 1 2024-03-18T14:43:16.942 INFO:tasks.workunit.client.0.smithi087.stdout:8/477: truncate d1/d6/d2f/f95 910082 0 2024-03-18T14:43:16.943 INFO:tasks.workunit.client.1.smithi129.stdout:9/262: write d0/db/d1f/d20/d25/f3d [912578,79683] 0 2024-03-18T14:43:16.946 INFO:tasks.workunit.client.0.smithi087.stdout:8/478: rmdir d1/d6/d2f/d44/d45 39 2024-03-18T14:43:16.947 INFO:tasks.workunit.client.1.smithi129.stdout:6/285: dwrite d3/d6/f4e [0,4194304] 0 2024-03-18T14:43:16.947 INFO:tasks.workunit.client.1.smithi129.stdout:6/286: chown d3/d30/de 15 1 2024-03-18T14:43:16.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/511: sync 2024-03-18T14:43:16.949 INFO:tasks.workunit.client.0.smithi087.stdout:0/461: sync 2024-03-18T14:43:16.949 INFO:tasks.workunit.client.0.smithi087.stdout:5/507: rename d13/f5e to d13/d1b/d70/fad 0 2024-03-18T14:43:16.950 INFO:tasks.workunit.client.0.smithi087.stdout:3/512: write d0/d3/f7 [2797288,52375] 0 2024-03-18T14:43:16.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/462: write d0/d1a/d80/d88/f2e [8815928,43598] 0 2024-03-18T14:43:16.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/463: chown d0/d1a/d7b/l8a 5743 1 2024-03-18T14:43:16.952 INFO:tasks.workunit.client.1.smithi129.stdout:6/287: dread d3/d30/de/d49/f50 [0,4194304] 0 2024-03-18T14:43:16.952 INFO:tasks.workunit.client.1.smithi129.stdout:0/299: dwrite d0/d23/d29/f3e [0,4194304] 0 2024-03-18T14:43:16.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/459: link d2/d4/d22/d2c/l3e d2/d4/d22/d2c/d3a/d40/l92 0 2024-03-18T14:43:16.953 INFO:tasks.workunit.client.0.smithi087.stdout:1/527: mkdir d3/d1d/d1e/d43/da3 0 2024-03-18T14:43:16.955 INFO:tasks.workunit.client.0.smithi087.stdout:3/513: dwrite d0/d3/d7a/f8f [0,4194304] 0 2024-03-18T14:43:16.957 INFO:tasks.workunit.client.1.smithi129.stdout:3/241: truncate d4/d11/d1d/d36/f4a 442635 0 2024-03-18T14:43:16.958 INFO:tasks.workunit.client.1.smithi129.stdout:7/268: truncate d4/d2d/f3e 3947372 0 2024-03-18T14:43:16.961 INFO:tasks.workunit.client.0.smithi087.stdout:2/460: creat d2/d4/d22/d2c/d3a/d68/f93 x:0 0 0 2024-03-18T14:43:16.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/528: creat d3/d1d/d1e/d20/d7a/fa4 x:0 0 0 2024-03-18T14:43:16.964 INFO:tasks.workunit.client.0.smithi087.stdout:2/461: creat d2/d44/d72/f94 x:0 0 0 2024-03-18T14:43:16.968 INFO:tasks.workunit.client.0.smithi087.stdout:2/462: dwrite d2/d4/d22/d2c/d3a/d49/f77 [0,4194304] 0 2024-03-18T14:43:16.969 INFO:tasks.workunit.client.0.smithi087.stdout:7/568: dread d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:16.969 INFO:tasks.workunit.client.1.smithi129.stdout:9/263: read d0/db/d1f/d20/d25/f3d [269549,31154] 0 2024-03-18T14:43:16.970 INFO:tasks.workunit.client.0.smithi087.stdout:3/514: unlink d0/d3/fc 0 2024-03-18T14:43:16.971 INFO:tasks.workunit.client.0.smithi087.stdout:0/464: dread d0/f50 [0,4194304] 0 2024-03-18T14:43:16.971 INFO:tasks.workunit.client.1.smithi129.stdout:9/264: fdatasync d0/db/d11/f1a 0 2024-03-18T14:43:16.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/288: dwrite d3/f41 [0,4194304] 0 2024-03-18T14:43:16.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/463: rename d2/d4/d22/d24/f35 to d2/d4/d22/d2c/f95 0 2024-03-18T14:43:16.975 INFO:tasks.workunit.client.0.smithi087.stdout:0/465: dwrite d0/d2/d4/d19/d24/f71 [0,4194304] 0 2024-03-18T14:43:16.978 INFO:tasks.workunit.client.0.smithi087.stdout:9/556: write db/d18/f2c [645205,117116] 0 2024-03-18T14:43:16.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/269: mknod d4/d2d/d3a/c57 0 2024-03-18T14:43:16.979 INFO:tasks.workunit.client.1.smithi129.stdout:0/300: symlink d0/d23/d35/d3b/d43/l5b 0 2024-03-18T14:43:16.979 INFO:tasks.workunit.client.1.smithi129.stdout:8/262: getdents d9/d11/d1a/d32/d41/d4d 0 2024-03-18T14:43:16.980 INFO:tasks.workunit.client.1.smithi129.stdout:8/263: chown d9/d11/d1a/l46 1 1 2024-03-18T14:43:16.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/261: dread d0/dc/d22/f39 [0,4194304] 0 2024-03-18T14:43:16.983 INFO:tasks.workunit.client.1.smithi129.stdout:7/270: mkdir d4/d2d/d2e/d42/d58 0 2024-03-18T14:43:16.986 INFO:tasks.workunit.client.1.smithi129.stdout:8/264: unlink d9/d11/d1a/d14/f39 0 2024-03-18T14:43:16.987 INFO:tasks.workunit.client.1.smithi129.stdout:8/265: write d9/d11/d1a/d32/d41/d4d/f4f [745998,117709] 0 2024-03-18T14:43:16.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/428: write d2/db/de/f2f [146441,1793] 0 2024-03-18T14:43:16.988 INFO:tasks.workunit.client.0.smithi087.stdout:4/429: dread - d2/db/f80 zero size 2024-03-18T14:43:16.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/446: sync 2024-03-18T14:43:16.989 INFO:tasks.workunit.client.1.smithi129.stdout:3/242: rename d4/c13 to d4/d11/d34/c52 0 2024-03-18T14:43:16.991 INFO:tasks.workunit.client.0.smithi087.stdout:3/515: getdents d0/d1c 0 2024-03-18T14:43:16.993 INFO:tasks.workunit.client.1.smithi129.stdout:3/243: dwrite d4/dd/f3d [0,4194304] 0 2024-03-18T14:43:16.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/430: unlink d2/d13/f34 0 2024-03-18T14:43:16.996 INFO:tasks.workunit.client.1.smithi129.stdout:8/266: creat d9/d11/d1a/d32/d41/d4d/f56 x:0 0 0 2024-03-18T14:43:16.996 INFO:tasks.workunit.client.1.smithi129.stdout:8/267: chown d9/f1b 47429051 1 2024-03-18T14:43:16.999 INFO:tasks.workunit.client.1.smithi129.stdout:7/271: rename d4/d7/f19 to d4/d7/d8/d3b/f59 0 2024-03-18T14:43:17.001 INFO:tasks.workunit.client.1.smithi129.stdout:3/244: fdatasync d4/fa 0 2024-03-18T14:43:17.001 INFO:tasks.workunit.client.1.smithi129.stdout:3/245: chown d4/d38/f2c 16068426 1 2024-03-18T14:43:17.001 INFO:tasks.workunit.client.1.smithi129.stdout:5/262: mknod d0/dc/c4f 0 2024-03-18T14:43:17.003 INFO:tasks.workunit.client.0.smithi087.stdout:8/479: dread d1/d6/d2f/d44/d45/f70 [4194304,4194304] 0 2024-03-18T14:43:17.004 INFO:tasks.workunit.client.1.smithi129.stdout:2/241: write d7/f1e [674324,93252] 0 2024-03-18T14:43:17.006 INFO:tasks.workunit.client.0.smithi087.stdout:0/466: write d0/d2/d3c/f69 [1657853,116887] 0 2024-03-18T14:43:17.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/529: rmdir d3/d1d/d1e 39 2024-03-18T14:43:17.006 INFO:tasks.workunit.client.1.smithi129.stdout:2/242: chown d7/d3f/f43 830 1 2024-03-18T14:43:17.007 INFO:tasks.workunit.client.0.smithi087.stdout:0/467: read - d0/d2/d4/d19/d24/f63 zero size 2024-03-18T14:43:17.007 INFO:tasks.workunit.client.1.smithi129.stdout:7/272: dwrite d4/d7/d8/d3b/f59 [0,4194304] 0 2024-03-18T14:43:17.008 INFO:tasks.workunit.client.1.smithi129.stdout:2/243: stat d7/d1f/d34/l2c 0 2024-03-18T14:43:17.009 INFO:tasks.workunit.client.1.smithi129.stdout:7/273: chown d4/c23 5 1 2024-03-18T14:43:17.009 INFO:tasks.workunit.client.0.smithi087.stdout:5/508: readlink d13/d1b/l63 0 2024-03-18T14:43:17.010 INFO:tasks.workunit.client.1.smithi129.stdout:4/240: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:17.010 INFO:tasks.workunit.client.0.smithi087.stdout:8/480: creat d1/d6/d9/d5d/f9c x:0 0 0 2024-03-18T14:43:17.011 INFO:tasks.workunit.client.0.smithi087.stdout:8/481: fsync d1/d6/f43 0 2024-03-18T14:43:17.012 INFO:tasks.workunit.client.1.smithi129.stdout:1/276: write d1/d2/f4b [46787,113001] 0 2024-03-18T14:43:17.014 INFO:tasks.workunit.client.1.smithi129.stdout:7/274: creat d4/d2d/d2e/f5a x:0 0 0 2024-03-18T14:43:17.014 INFO:tasks.workunit.client.0.smithi087.stdout:7/569: truncate d1/d6/d29/d2f/d68/d65/f86 7461140 0 2024-03-18T14:43:17.015 INFO:tasks.workunit.client.1.smithi129.stdout:4/241: chown d0/d19/d1d/d3e/f42 26718 1 2024-03-18T14:43:17.015 INFO:tasks.workunit.client.1.smithi129.stdout:2/244: dwrite d7/d1f/d34/f30 [0,4194304] 0 2024-03-18T14:43:17.015 INFO:tasks.workunit.client.1.smithi129.stdout:9/265: truncate d0/db/d1f/d20/d26/f2a 3173511 0 2024-03-18T14:43:17.016 INFO:tasks.workunit.client.0.smithi087.stdout:1/530: dwrite d3/d1d/d1f/d34/f53 [0,4194304] 0 2024-03-18T14:43:17.016 INFO:tasks.workunit.client.1.smithi129.stdout:7/275: dread - d4/d7/d8/d3b/f40 zero size 2024-03-18T14:43:17.017 INFO:tasks.workunit.client.1.smithi129.stdout:9/266: readlink d0/db/d2e/l40 0 2024-03-18T14:43:17.017 INFO:tasks.workunit.client.1.smithi129.stdout:2/245: write d7/d1f/d20/d36/f38 [1019012,119636] 0 2024-03-18T14:43:17.018 INFO:tasks.workunit.client.0.smithi087.stdout:9/557: dwrite db/d18/d1e/d28/f4a [0,4194304] 0 2024-03-18T14:43:17.020 INFO:tasks.workunit.client.0.smithi087.stdout:4/431: mknod d2/db/d84/c86 0 2024-03-18T14:43:17.021 INFO:tasks.workunit.client.1.smithi129.stdout:3/246: truncate d4/fa 688352 0 2024-03-18T14:43:17.023 INFO:tasks.workunit.client.1.smithi129.stdout:1/277: truncate d1/f9 361144 0 2024-03-18T14:43:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/531: unlink d3/d3c/c81 0 2024-03-18T14:43:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:7/570: creat d1/d6/d29/d2f/fcb x:0 0 0 2024-03-18T14:43:17.024 INFO:tasks.workunit.client.0.smithi087.stdout:5/509: dwrite d13/d1b/d70/fad [0,4194304] 0 2024-03-18T14:43:17.024 INFO:tasks.workunit.client.1.smithi129.stdout:1/278: chown d1/d18/l42 3356 1 2024-03-18T14:43:17.025 INFO:tasks.workunit.client.0.smithi087.stdout:1/532: fsync d3/d1d/d1f/d34/f62 0 2024-03-18T14:43:17.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/246: unlink d7/fc 0 2024-03-18T14:43:17.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/247: read d7/d1f/d20/d2d/f44 [857645,45566] 0 2024-03-18T14:43:17.031 INFO:tasks.workunit.client.0.smithi087.stdout:2/464: sync 2024-03-18T14:43:17.031 INFO:tasks.workunit.client.1.smithi129.stdout:7/276: mknod d4/c5b 0 2024-03-18T14:43:17.032 INFO:tasks.workunit.client.1.smithi129.stdout:7/277: fdatasync d4/d7/d8/f32 0 2024-03-18T14:43:17.032 INFO:tasks.workunit.client.0.smithi087.stdout:6/447: truncate d3/d7/d25/d62/d7c/d29/f56 1292871 0 2024-03-18T14:43:17.032 INFO:tasks.workunit.client.0.smithi087.stdout:4/432: mkdir d2/db/d84/d87 0 2024-03-18T14:43:17.032 INFO:tasks.workunit.client.0.smithi087.stdout:6/448: write d3/d7/d25/d62/d7c/d29/d22/f5d [481959,25753] 0 2024-03-18T14:43:17.033 INFO:tasks.workunit.client.1.smithi129.stdout:7/278: chown d4/d2d/d3a/c57 983920158 1 2024-03-18T14:43:17.033 INFO:tasks.workunit.client.0.smithi087.stdout:7/571: chown d1/d6/d29/f4d 588 1 2024-03-18T14:43:17.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/289: sync 2024-03-18T14:43:17.038 INFO:tasks.workunit.client.1.smithi129.stdout:1/279: getdents d1/d18/d19/d49/d56 0 2024-03-18T14:43:17.039 INFO:tasks.workunit.client.0.smithi087.stdout:4/433: creat d2/db/d84/d87/f88 x:0 0 0 2024-03-18T14:43:17.040 INFO:tasks.workunit.client.1.smithi129.stdout:5/263: dwrite d0/f11 [0,4194304] 0 2024-03-18T14:43:17.040 INFO:tasks.workunit.client.1.smithi129.stdout:7/279: mkdir d4/d7/d38/d5c 0 2024-03-18T14:43:17.041 INFO:tasks.workunit.client.1.smithi129.stdout:6/290: mknod d3/d30/c5a 0 2024-03-18T14:43:17.043 INFO:tasks.workunit.client.0.smithi087.stdout:6/449: fsync d3/d7/d25/d62/d7c/d29/d22/d61/f70 0 2024-03-18T14:43:17.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/558: getdents db/d18/d51/d8f 0 2024-03-18T14:43:17.043 INFO:tasks.workunit.client.0.smithi087.stdout:4/434: dwrite d2/db/d24/f4c [0,4194304] 0 2024-03-18T14:43:17.045 INFO:tasks.workunit.client.1.smithi129.stdout:5/264: symlink d0/dc/l50 0 2024-03-18T14:43:17.048 INFO:tasks.workunit.client.0.smithi087.stdout:1/533: link d3/d1d/d1f/f70 d3/d1d/d1e/d43/fa5 0 2024-03-18T14:43:17.049 INFO:tasks.workunit.client.0.smithi087.stdout:3/516: truncate d0/de/d30/d46/f61 1954772 0 2024-03-18T14:43:17.049 INFO:tasks.workunit.client.0.smithi087.stdout:7/572: getdents d1/d8e 0 2024-03-18T14:43:17.049 INFO:tasks.workunit.client.0.smithi087.stdout:5/510: chown d13/f57 0 1 2024-03-18T14:43:17.050 INFO:tasks.workunit.client.0.smithi087.stdout:9/559: dread - db/d18/f53 zero size 2024-03-18T14:43:17.051 INFO:tasks.workunit.client.1.smithi129.stdout:1/280: dread d1/f46 [0,4194304] 0 2024-03-18T14:43:17.051 INFO:tasks.workunit.client.0.smithi087.stdout:6/450: chown d3/d7/d25/d62/d7c/d29/d7d/c8f 37 1 2024-03-18T14:43:17.051 INFO:tasks.workunit.client.0.smithi087.stdout:1/534: creat d3/d1d/d45/fa6 x:0 0 0 2024-03-18T14:43:17.052 INFO:tasks.workunit.client.1.smithi129.stdout:8/268: sync 2024-03-18T14:43:17.052 INFO:tasks.workunit.client.1.smithi129.stdout:0/301: sync 2024-03-18T14:43:17.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/280: truncate d4/d2d/d3a/f46 1030546 0 2024-03-18T14:43:17.052 INFO:tasks.workunit.client.0.smithi087.stdout:6/451: read - d3/d7/d25/d62/f6a zero size 2024-03-18T14:43:17.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/281: fdatasync d4/d7/d8/f22 0 2024-03-18T14:43:17.053 INFO:tasks.workunit.client.1.smithi129.stdout:8/269: readlink d9/d11/d1a/d32/d3a/l50 0 2024-03-18T14:43:17.053 INFO:tasks.workunit.client.1.smithi129.stdout:6/291: link d3/d30/df/d28/l4f d3/d6/l5b 0 2024-03-18T14:43:17.056 INFO:tasks.workunit.client.0.smithi087.stdout:1/535: fsync d3/f19 0 2024-03-18T14:43:17.057 INFO:tasks.workunit.client.0.smithi087.stdout:1/536: write d3/d1d/d1e/d43/d50/d72/f86 [4476009,33247] 0 2024-03-18T14:43:17.057 INFO:tasks.workunit.client.1.smithi129.stdout:5/265: rename d0/dc/d22/f40 to d0/d32/d34/f51 0 2024-03-18T14:43:17.058 INFO:tasks.workunit.client.0.smithi087.stdout:5/511: unlink d13/l72 0 2024-03-18T14:43:17.058 INFO:tasks.workunit.client.1.smithi129.stdout:8/270: dread d9/d11/d1a/d32/f38 [0,4194304] 0 2024-03-18T14:43:17.058 INFO:tasks.workunit.client.1.smithi129.stdout:0/302: dwrite d0/d14/f20 [4194304,4194304] 0 2024-03-18T14:43:17.060 INFO:tasks.workunit.client.1.smithi129.stdout:4/242: write d0/d19/d1d/d3e/f42 [1515279,121797] 0 2024-03-18T14:43:17.061 INFO:tasks.workunit.client.0.smithi087.stdout:7/573: symlink d1/d6/da/d59/dbe/lcc 0 2024-03-18T14:43:17.061 INFO:tasks.workunit.client.1.smithi129.stdout:0/303: dread - d0/d23/d35/d3b/f33 zero size 2024-03-18T14:43:17.061 INFO:tasks.workunit.client.1.smithi129.stdout:7/282: dwrite d4/d7/d8/f32 [0,4194304] 0 2024-03-18T14:43:17.061 INFO:tasks.workunit.client.1.smithi129.stdout:6/292: symlink d3/d30/df/l5c 0 2024-03-18T14:43:17.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/452: dwrite d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:17.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/304: read - d0/d14/d3a/f4c zero size 2024-03-18T14:43:17.063 INFO:tasks.workunit.client.1.smithi129.stdout:7/283: chown d4/d2d/d2e/f5a 1416529362 1 2024-03-18T14:43:17.063 INFO:tasks.workunit.client.1.smithi129.stdout:6/293: write d3/d6/f4e [1760115,92479] 0 2024-03-18T14:43:17.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/305: fdatasync d0/d14/d3a/f4c 0 2024-03-18T14:43:17.063 INFO:tasks.workunit.client.1.smithi129.stdout:7/284: dread - d4/d7/f43 zero size 2024-03-18T14:43:17.064 INFO:tasks.workunit.client.1.smithi129.stdout:5/266: unlink d0/dc/d18/d2b/f30 0 2024-03-18T14:43:17.064 INFO:tasks.workunit.client.0.smithi087.stdout:9/560: creat db/d18/fb3 x:0 0 0 2024-03-18T14:43:17.065 INFO:tasks.workunit.client.1.smithi129.stdout:7/285: stat d4/d2d/d3a/c44 0 2024-03-18T14:43:17.065 INFO:tasks.workunit.client.1.smithi129.stdout:0/306: chown d0/d23/d35/d3b/f3c 125160110 1 2024-03-18T14:43:17.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/517: truncate d0/de/d30/d46/f68 827455 0 2024-03-18T14:43:17.066 INFO:tasks.workunit.client.1.smithi129.stdout:0/307: write d0/d23/d35/d3b/f57 [369054,42793] 0 2024-03-18T14:43:17.067 INFO:tasks.workunit.client.1.smithi129.stdout:6/294: symlink d3/d5/d2b/l5d 0 2024-03-18T14:43:17.067 INFO:tasks.workunit.client.0.smithi087.stdout:7/574: rmdir d1/d97 39 2024-03-18T14:43:17.067 INFO:tasks.workunit.client.1.smithi129.stdout:6/295: dread - d3/d5/d46/f55 zero size 2024-03-18T14:43:17.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/453: truncate d3/d7/d25/d62/d7c/d29/f8a 410430 0 2024-03-18T14:43:17.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/454: write d3/d7/d25/d62/d7c/d29/f40 [4932547,2447] 0 2024-03-18T14:43:17.071 INFO:tasks.workunit.client.1.smithi129.stdout:7/286: creat d4/d7/d38/f5d x:0 0 0 2024-03-18T14:43:17.072 INFO:tasks.workunit.client.0.smithi087.stdout:1/537: creat d3/fa7 x:0 0 0 2024-03-18T14:43:17.073 INFO:tasks.workunit.client.0.smithi087.stdout:7/575: mknod d1/d6/ccd 0 2024-03-18T14:43:17.073 INFO:tasks.workunit.client.1.smithi129.stdout:9/267: dwrite d0/f8 [4194304,4194304] 0 2024-03-18T14:43:17.074 INFO:tasks.workunit.client.0.smithi087.stdout:6/455: rmdir d3/d7/d25/d62/d7c/d29/d22/d23 39 2024-03-18T14:43:17.074 INFO:tasks.workunit.client.0.smithi087.stdout:9/561: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:17.075 INFO:tasks.workunit.client.0.smithi087.stdout:7/576: write d1/d6/d29/d2f/d68/d65/d60/d66/f6e [4145754,15856] 0 2024-03-18T14:43:17.076 INFO:tasks.workunit.client.1.smithi129.stdout:7/287: dread d4/d7/d8/f32 [0,4194304] 0 2024-03-18T14:43:17.078 INFO:tasks.workunit.client.0.smithi087.stdout:9/562: chown db/d12/c26 48 1 2024-03-18T14:43:17.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/577: write d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f9c [458336,18423] 0 2024-03-18T14:43:17.079 INFO:tasks.workunit.client.0.smithi087.stdout:6/456: dwrite d3/f74 [0,4194304] 0 2024-03-18T14:43:17.082 INFO:tasks.workunit.client.0.smithi087.stdout:3/518: getdents d0/d72 0 2024-03-18T14:43:17.083 INFO:tasks.workunit.client.0.smithi087.stdout:3/519: write d0/de/f81 [4878635,121779] 0 2024-03-18T14:43:17.084 INFO:tasks.workunit.client.0.smithi087.stdout:3/520: write d0/d1c/f5b [198231,125125] 0 2024-03-18T14:43:17.086 INFO:tasks.workunit.client.0.smithi087.stdout:0/468: truncate d0/d2/d4/d19/d62/f70 4373687 0 2024-03-18T14:43:17.088 INFO:tasks.workunit.client.0.smithi087.stdout:8/482: truncate d1/f1b 2905218 0 2024-03-18T14:43:17.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/465: write d2/fb [87451,82473] 0 2024-03-18T14:43:17.088 INFO:tasks.workunit.client.1.smithi129.stdout:3/247: write d4/d38/f1b [728233,113872] 0 2024-03-18T14:43:17.091 INFO:tasks.workunit.client.1.smithi129.stdout:2/248: dwrite d7/d1f/d20/d2d/f3e [0,4194304] 0 2024-03-18T14:43:17.092 INFO:tasks.workunit.client.1.smithi129.stdout:2/249: write d7/f1e [1523070,100855] 0 2024-03-18T14:43:17.093 INFO:tasks.workunit.client.0.smithi087.stdout:4/435: truncate d2/db/de/f2f 552055 0 2024-03-18T14:43:17.100 INFO:tasks.workunit.client.1.smithi129.stdout:9/268: symlink d0/db/l4d 0 2024-03-18T14:43:17.101 INFO:tasks.workunit.client.0.smithi087.stdout:1/538: rename d3/d1d/d1e/d43/d50/d71/l74 to d3/d1d/d1f/d34/la8 0 2024-03-18T14:43:17.103 INFO:tasks.workunit.client.0.smithi087.stdout:7/578: symlink d1/d6/d29/d2f/d68/d65/d60/lce 0 2024-03-18T14:43:17.104 INFO:tasks.workunit.client.1.smithi129.stdout:3/248: mkdir d4/d11/d34/d53 0 2024-03-18T14:43:17.104 INFO:tasks.workunit.client.1.smithi129.stdout:9/269: fdatasync d0/db/d1f/d20/d25/f3d 0 2024-03-18T14:43:17.104 INFO:tasks.workunit.client.1.smithi129.stdout:9/270: dread - d0/db/d2e/f4b zero size 2024-03-18T14:43:17.106 INFO:tasks.workunit.client.1.smithi129.stdout:9/271: read d0/db/d1f/f30 [370889,28115] 0 2024-03-18T14:43:17.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/250: rename d7/d1f/d34/f3b to d7/f49 0 2024-03-18T14:43:17.110 INFO:tasks.workunit.client.0.smithi087.stdout:3/521: unlink d0/d3/f73 0 2024-03-18T14:43:17.111 INFO:tasks.workunit.client.0.smithi087.stdout:0/469: symlink d0/d2/d4/d19/d62/lac 0 2024-03-18T14:43:17.111 INFO:tasks.workunit.client.1.smithi129.stdout:9/272: dwrite d0/db/d2e/f4b [0,4194304] 0 2024-03-18T14:43:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/483: creat d1/d6/d9/d5d/d87/d88/f9d x:0 0 0 2024-03-18T14:43:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:2/466: symlink d2/d44/d72/l96 0 2024-03-18T14:43:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:9/563: mkdir db/d18/d1e/db4 0 2024-03-18T14:43:17.112 INFO:tasks.workunit.client.0.smithi087.stdout:3/522: stat d0/d3/d40/c54 0 2024-03-18T14:43:17.112 INFO:tasks.workunit.client.1.smithi129.stdout:3/249: creat d4/f54 x:0 0 0 2024-03-18T14:43:17.113 INFO:tasks.workunit.client.0.smithi087.stdout:3/523: read d0/de/d30/d67/f79 [752124,102249] 0 2024-03-18T14:43:17.114 INFO:tasks.workunit.client.1.smithi129.stdout:2/251: dwrite d7/d1f/d34/f15 [0,4194304] 0 2024-03-18T14:43:17.114 INFO:tasks.workunit.client.1.smithi129.stdout:9/273: creat d0/db/d1f/f4e x:0 0 0 2024-03-18T14:43:17.115 INFO:tasks.workunit.client.0.smithi087.stdout:1/539: rename d3/d1d/d1e/d43/d50/d72/l8e to d3/d1d/d1e/d43/da3/la9 0 2024-03-18T14:43:17.116 INFO:tasks.workunit.client.1.smithi129.stdout:2/252: write d7/d1f/d34/f15 [553981,119744] 0 2024-03-18T14:43:17.118 INFO:tasks.workunit.client.1.smithi129.stdout:1/281: sync 2024-03-18T14:43:17.118 INFO:tasks.workunit.client.1.smithi129.stdout:3/250: dread d4/d38/f2c [4194304,4194304] 0 2024-03-18T14:43:17.118 INFO:tasks.workunit.client.1.smithi129.stdout:1/282: readlink d1/d2/l15 0 2024-03-18T14:43:17.119 INFO:tasks.workunit.client.1.smithi129.stdout:2/253: creat d7/d3f/f4a x:0 0 0 2024-03-18T14:43:17.119 INFO:tasks.workunit.client.1.smithi129.stdout:3/251: fsync d4/d38/f47 0 2024-03-18T14:43:17.121 INFO:tasks.workunit.client.1.smithi129.stdout:9/274: dwrite d0/d15/f42 [0,4194304] 0 2024-03-18T14:43:17.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/436: creat d2/db/d82/f89 x:0 0 0 2024-03-18T14:43:17.121 INFO:tasks.workunit.client.0.smithi087.stdout:7/579: fdatasync d1/d6/d29/d2f/d68/d65/d60/d66/f6e 0 2024-03-18T14:43:17.122 INFO:tasks.workunit.client.0.smithi087.stdout:0/470: fdatasync d0/d1a/d80/d88/f64 0 2024-03-18T14:43:17.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/275: read d0/db/f12 [4160620,74744] 0 2024-03-18T14:43:17.125 INFO:tasks.workunit.client.0.smithi087.stdout:8/484: unlink d1/d6/d9/f17 0 2024-03-18T14:43:17.125 INFO:tasks.workunit.client.0.smithi087.stdout:9/564: symlink db/d18/d1c/d69/lb5 0 2024-03-18T14:43:17.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/276: write d0/db/d1f/d20/d26/d19/d29/d36/f47 [5266886,84518] 0 2024-03-18T14:43:17.127 INFO:tasks.workunit.client.1.smithi129.stdout:0/308: truncate d0/d14/d28/f30 1984146 0 2024-03-18T14:43:17.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/512: write d13/f23 [249692,8721] 0 2024-03-18T14:43:17.128 INFO:tasks.workunit.client.1.smithi129.stdout:9/277: write d0/d15/f42 [3118776,16720] 0 2024-03-18T14:43:17.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/267: truncate d0/df/f3c 1708635 0 2024-03-18T14:43:17.129 INFO:tasks.workunit.client.1.smithi129.stdout:0/309: rename d0/d23 to d0/d23/d29/d5c 22 2024-03-18T14:43:17.131 INFO:tasks.workunit.client.1.smithi129.stdout:1/283: creat d1/d18/d19/d52/f58 x:0 0 0 2024-03-18T14:43:17.131 INFO:tasks.workunit.client.1.smithi129.stdout:9/278: stat d0/db/d1f/f23 0 2024-03-18T14:43:17.133 INFO:tasks.workunit.client.1.smithi129.stdout:4/243: dwrite d0/d1a/f23 [0,4194304] 0 2024-03-18T14:43:17.134 INFO:tasks.workunit.client.1.smithi129.stdout:6/296: dwrite d3/d30/de/f1f [0,4194304] 0 2024-03-18T14:43:17.135 INFO:tasks.workunit.client.1.smithi129.stdout:0/310: unlink d0/l17 0 2024-03-18T14:43:17.135 INFO:tasks.workunit.client.1.smithi129.stdout:9/279: stat d0/db/d1f/d20/d26/d19/l45 0 2024-03-18T14:43:17.136 INFO:tasks.workunit.client.1.smithi129.stdout:5/268: mkdir d0/d32/d3a/d52 0 2024-03-18T14:43:17.147 INFO:tasks.workunit.client.1.smithi129.stdout:1/284: write d1/d2/f1f [3856767,35750] 0 2024-03-18T14:43:17.151 INFO:tasks.workunit.client.1.smithi129.stdout:4/244: mkdir d0/d19/d1d/d3e/d33/d43 0 2024-03-18T14:43:17.153 INFO:tasks.workunit.client.0.smithi087.stdout:6/457: dwrite d3/d7/d25/f7b [0,4194304] 0 2024-03-18T14:43:17.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/297: symlink d3/d30/df/d28/l5e 0 2024-03-18T14:43:17.154 INFO:tasks.workunit.client.1.smithi129.stdout:0/311: mknod d0/d14/d3a/c5d 0 2024-03-18T14:43:17.155 INFO:tasks.workunit.client.1.smithi129.stdout:9/280: write d0/db/f43 [978215,49721] 0 2024-03-18T14:43:17.155 INFO:tasks.workunit.client.1.smithi129.stdout:7/288: dread d4/d7/d8/f20 [4194304,4194304] 0 2024-03-18T14:43:17.156 INFO:tasks.workunit.client.1.smithi129.stdout:5/269: creat d0/d32/d34/f53 x:0 0 0 2024-03-18T14:43:17.156 INFO:tasks.workunit.client.1.smithi129.stdout:7/289: stat d4/d7/d8/f3f 0 2024-03-18T14:43:17.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/467: mkdir d2/d4/d22/d2c/d3a/d40/d4a/d97 0 2024-03-18T14:43:17.157 INFO:tasks.workunit.client.1.smithi129.stdout:5/270: readlink d0/dc/d1a/l41 0 2024-03-18T14:43:17.159 INFO:tasks.workunit.client.0.smithi087.stdout:7/580: write d1/d97/fb7 [784920,75133] 0 2024-03-18T14:43:17.160 INFO:tasks.workunit.client.1.smithi129.stdout:8/271: sync 2024-03-18T14:43:17.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/437: mkdir d2/db/d24/d30/d8a 0 2024-03-18T14:43:17.161 INFO:tasks.workunit.client.0.smithi087.stdout:7/581: dread d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:17.163 INFO:tasks.workunit.client.1.smithi129.stdout:3/252: getdents d4/d11/d1d 0 2024-03-18T14:43:17.164 INFO:tasks.workunit.client.1.smithi129.stdout:5/271: chown d0/df/f48 650570 1 2024-03-18T14:43:17.165 INFO:tasks.workunit.client.1.smithi129.stdout:7/290: creat d4/d2d/d2e/d45/f5e x:0 0 0 2024-03-18T14:43:17.165 INFO:tasks.workunit.client.1.smithi129.stdout:4/245: mknod d0/d9/d40/c44 0 2024-03-18T14:43:17.166 INFO:tasks.workunit.client.0.smithi087.stdout:8/485: write d1/d6/d14/f5c [526853,104771] 0 2024-03-18T14:43:17.166 INFO:tasks.workunit.client.1.smithi129.stdout:3/253: write d4/dd/f3d [570158,113760] 0 2024-03-18T14:43:17.167 INFO:tasks.workunit.client.0.smithi087.stdout:8/486: write d1/d6/d2f/d44/f52 [1061797,3671] 0 2024-03-18T14:43:17.167 INFO:tasks.workunit.client.1.smithi129.stdout:9/281: symlink d0/db/d1f/d20/d4a/d3e/l4f 0 2024-03-18T14:43:17.167 INFO:tasks.workunit.client.1.smithi129.stdout:5/272: chown d0/df/f48 9 1 2024-03-18T14:43:17.167 INFO:tasks.workunit.client.0.smithi087.stdout:8/487: write d1/d6/d14/f5c [1148179,8262] 0 2024-03-18T14:43:17.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/513: read d13/d1b/f5c [3945231,4459] 0 2024-03-18T14:43:17.170 INFO:tasks.workunit.client.1.smithi129.stdout:4/246: dwrite d0/f13 [0,4194304] 0 2024-03-18T14:43:17.171 INFO:tasks.workunit.client.0.smithi087.stdout:5/514: chown d13/d1b/d30/f8d 2322 1 2024-03-18T14:43:17.171 INFO:tasks.workunit.client.1.smithi129.stdout:4/247: write d0/d1a/f2c [2420091,24642] 0 2024-03-18T14:43:17.172 INFO:tasks.workunit.client.1.smithi129.stdout:4/248: readlink d0/d19/d1d/d2e/l31 0 2024-03-18T14:43:17.172 INFO:tasks.workunit.client.0.smithi087.stdout:7/582: dread d1/d6/d16/dc/f32 [0,4194304] 0 2024-03-18T14:43:17.174 INFO:tasks.workunit.client.0.smithi087.stdout:6/458: creat d3/d7/d25/d62/d7c/d29/d22/d75/d92/f99 x:0 0 0 2024-03-18T14:43:17.174 INFO:tasks.workunit.client.0.smithi087.stdout:2/468: mkdir d2/d4/d22/d2c/d3a/d40/d98 0 2024-03-18T14:43:17.174 INFO:tasks.workunit.client.0.smithi087.stdout:7/583: chown d1/l7d 749 1 2024-03-18T14:43:17.174 INFO:tasks.workunit.client.1.smithi129.stdout:3/254: mkdir d4/d38/d55 0 2024-03-18T14:43:17.175 INFO:tasks.workunit.client.1.smithi129.stdout:8/272: mknod d9/d11/d1a/d32/c57 0 2024-03-18T14:43:17.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/515: dwrite f12 [0,4194304] 0 2024-03-18T14:43:17.179 INFO:tasks.workunit.client.1.smithi129.stdout:3/255: symlink d4/d11/d1d/d27/l56 0 2024-03-18T14:43:17.179 INFO:tasks.workunit.client.1.smithi129.stdout:8/273: dwrite d9/d11/d1a/d32/d41/f52 [0,4194304] 0 2024-03-18T14:43:17.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/471: dwrite d0/d2/d4/d19/f72 [0,4194304] 0 2024-03-18T14:43:17.183 INFO:tasks.workunit.client.0.smithi087.stdout:6/459: dwrite d3/d7/d25/d62/d7c/d29/d22/d75/d92/f99 [0,4194304] 0 2024-03-18T14:43:17.184 INFO:tasks.workunit.client.1.smithi129.stdout:6/298: link d3/d5/f34 d3/d30/df/f5f 0 2024-03-18T14:43:17.184 INFO:tasks.workunit.client.1.smithi129.stdout:0/312: dread d0/fd [0,4194304] 0 2024-03-18T14:43:17.186 INFO:tasks.workunit.client.0.smithi087.stdout:1/540: dwrite d3/d1d/d1e/d20/f52 [0,4194304] 0 2024-03-18T14:43:17.186 INFO:tasks.workunit.client.1.smithi129.stdout:2/254: sync 2024-03-18T14:43:17.188 INFO:tasks.workunit.client.1.smithi129.stdout:3/256: rename d4/dd/d15/d31/l35 to d4/d11/d1d/d27/l57 0 2024-03-18T14:43:17.189 INFO:tasks.workunit.client.0.smithi087.stdout:0/472: dwrite d0/d2/d4/d19/f72 [0,4194304] 0 2024-03-18T14:43:17.191 INFO:tasks.workunit.client.0.smithi087.stdout:3/524: link d0/d1c/f39 d0/d3/f94 0 2024-03-18T14:43:17.192 INFO:tasks.workunit.client.1.smithi129.stdout:4/249: link d0/c4 d0/d1a/c45 0 2024-03-18T14:43:17.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/584: write d1/d6/d29/d2f/fca [1663847,60599] 0 2024-03-18T14:43:17.194 INFO:tasks.workunit.client.1.smithi129.stdout:9/282: getdents d0/db/d11 0 2024-03-18T14:43:17.196 INFO:tasks.workunit.client.0.smithi087.stdout:2/469: unlink d2/d4/d22/d2c/d3a/d40/f5f 0 2024-03-18T14:43:17.196 INFO:tasks.workunit.client.0.smithi087.stdout:2/470: write d2/f85 [410778,101439] 0 2024-03-18T14:43:17.201 INFO:tasks.workunit.client.0.smithi087.stdout:2/471: dwrite d2/d4/d22/d2c/d3a/d40/f8d [0,4194304] 0 2024-03-18T14:43:17.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/565: rename db/d18/d1e/d7e/f89 to db/d18/d1e/d28/d76/da7/fb6 0 2024-03-18T14:43:17.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/438: dread d2/f36 [0,4194304] 0 2024-03-18T14:43:17.210 INFO:tasks.workunit.client.1.smithi129.stdout:2/255: rename l3 to d7/l4b 0 2024-03-18T14:43:17.214 INFO:tasks.workunit.client.0.smithi087.stdout:7/585: unlink d1/d6/f44 0 2024-03-18T14:43:17.215 INFO:tasks.workunit.client.1.smithi129.stdout:4/250: rename d0/d19/d1d to d0/d19/d46 0 2024-03-18T14:43:17.215 INFO:tasks.workunit.client.0.smithi087.stdout:5/516: mkdir d13/d1b/d27/d28/d9a/dae 0 2024-03-18T14:43:17.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/256: link d7/d1f/d20/d36/f38 d7/d1f/f4c 0 2024-03-18T14:43:17.220 INFO:tasks.workunit.client.1.smithi129.stdout:8/274: dread f4 [0,4194304] 0 2024-03-18T14:43:17.221 INFO:tasks.workunit.client.1.smithi129.stdout:2/257: readlink d7/d1f/d34/l2c 0 2024-03-18T14:43:17.222 INFO:tasks.workunit.client.1.smithi129.stdout:0/313: dread d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:17.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/473: rename d0/d1a/d99 to d0/d2/d4/d19/d62/dad 0 2024-03-18T14:43:17.225 INFO:tasks.workunit.client.0.smithi087.stdout:9/566: mkdir db/d18/d1e/d28/d76/db7 0 2024-03-18T14:43:17.226 INFO:tasks.workunit.client.0.smithi087.stdout:4/439: mkdir d2/db/de/d8b 0 2024-03-18T14:43:17.227 INFO:tasks.workunit.client.1.smithi129.stdout:2/258: chown d7/d1c/d32/l47 1161053 1 2024-03-18T14:43:17.228 INFO:tasks.workunit.client.0.smithi087.stdout:3/525: mkdir d0/d3/d95 0 2024-03-18T14:43:17.229 INFO:tasks.workunit.client.1.smithi129.stdout:8/275: rename d9/l51 to d9/d11/d55/l58 0 2024-03-18T14:43:17.229 INFO:tasks.workunit.client.0.smithi087.stdout:3/526: fsync d0/d3/d7a/f8f 0 2024-03-18T14:43:17.229 INFO:tasks.workunit.client.1.smithi129.stdout:8/276: chown d9/d11/d18/l42 332070428 1 2024-03-18T14:43:17.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/527: write d0/d1c/f91 [977119,115597] 0 2024-03-18T14:43:17.232 INFO:tasks.workunit.client.0.smithi087.stdout:0/474: mknod d0/d2/d3c/d73/cae 0 2024-03-18T14:43:17.233 INFO:tasks.workunit.client.1.smithi129.stdout:8/277: creat d9/d11/d1a/d32/d3a/f59 x:0 0 0 2024-03-18T14:43:17.233 INFO:tasks.workunit.client.1.smithi129.stdout:1/285: sync 2024-03-18T14:43:17.234 INFO:tasks.workunit.client.1.smithi129.stdout:0/314: truncate d0/f55 1025317 0 2024-03-18T14:43:17.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/460: creat d3/d7/d25/d62/d7c/f9a x:0 0 0 2024-03-18T14:43:17.235 INFO:tasks.workunit.client.1.smithi129.stdout:8/278: write d9/d11/f3b [4250622,119641] 0 2024-03-18T14:43:17.235 INFO:tasks.workunit.client.0.smithi087.stdout:6/461: chown d3/d7/d25/f2a 9 1 2024-03-18T14:43:17.238 INFO:tasks.workunit.client.1.smithi129.stdout:1/286: dwrite d1/d18/d19/f24 [0,4194304] 0 2024-03-18T14:43:17.238 INFO:tasks.workunit.client.1.smithi129.stdout:0/315: dread d0/d23/d29/f3e [0,4194304] 0 2024-03-18T14:43:17.239 INFO:tasks.workunit.client.1.smithi129.stdout:1/287: stat d1/f1d 0 2024-03-18T14:43:17.240 INFO:tasks.workunit.client.1.smithi129.stdout:1/288: readlink d1/d18/d19/d49/l55 0 2024-03-18T14:43:17.241 INFO:tasks.workunit.client.0.smithi087.stdout:3/528: symlink d0/d3/df/d42/l96 0 2024-03-18T14:43:17.242 INFO:tasks.workunit.client.0.smithi087.stdout:9/567: dread db/d18/d1e/d28/d7c/f7d [0,4194304] 0 2024-03-18T14:43:17.243 INFO:tasks.workunit.client.1.smithi129.stdout:6/299: write d3/d5/f11 [1869593,104888] 0 2024-03-18T14:43:17.247 INFO:tasks.workunit.client.1.smithi129.stdout:3/257: dwrite d4/f21 [0,4194304] 0 2024-03-18T14:43:17.247 INFO:tasks.workunit.client.1.smithi129.stdout:6/300: write d3/f41 [1310808,26126] 0 2024-03-18T14:43:17.248 INFO:tasks.workunit.client.1.smithi129.stdout:4/251: truncate d0/f13 2637104 0 2024-03-18T14:43:17.250 INFO:tasks.workunit.client.0.smithi087.stdout:2/472: dread d2/d4/d22/f39 [0,4194304] 0 2024-03-18T14:43:17.251 INFO:tasks.workunit.client.1.smithi129.stdout:2/259: write d7/d1c/f26 [2228003,14653] 0 2024-03-18T14:43:17.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/462: unlink f1 0 2024-03-18T14:43:17.252 INFO:tasks.workunit.client.0.smithi087.stdout:4/440: dread d2/f63 [0,4194304] 0 2024-03-18T14:43:17.252 INFO:tasks.workunit.client.1.smithi129.stdout:3/258: write d4/d11/f43 [91441,20674] 0 2024-03-18T14:43:17.253 INFO:tasks.workunit.client.1.smithi129.stdout:1/289: dwrite d1/d18/d19/f24 [0,4194304] 0 2024-03-18T14:43:17.253 INFO:tasks.workunit.client.0.smithi087.stdout:8/488: dwrite d1/f32 [0,4194304] 0 2024-03-18T14:43:17.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/273: dwrite d0/df/f3c [0,4194304] 0 2024-03-18T14:43:17.256 INFO:tasks.workunit.client.1.smithi129.stdout:7/291: dwrite d4/d2d/d3a/f46 [0,4194304] 0 2024-03-18T14:43:17.256 INFO:tasks.workunit.client.1.smithi129.stdout:8/279: dwrite f8 [0,4194304] 0 2024-03-18T14:43:17.256 INFO:tasks.workunit.client.1.smithi129.stdout:0/316: link d0/d14/f49 d0/d23/d35/d3b/d43/f5e 0 2024-03-18T14:43:17.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/541: write d3/f93 [4444219,56443] 0 2024-03-18T14:43:17.257 INFO:tasks.workunit.client.0.smithi087.stdout:9/568: dread db/f3d [0,4194304] 0 2024-03-18T14:43:17.257 INFO:tasks.workunit.client.0.smithi087.stdout:2/473: dwrite d2/d4/d22/d2c/d3a/d76/d81/f86 [0,4194304] 0 2024-03-18T14:43:17.258 INFO:tasks.workunit.client.0.smithi087.stdout:9/569: readlink db/d18/d1e/laa 0 2024-03-18T14:43:17.259 INFO:tasks.workunit.client.0.smithi087.stdout:1/542: dread - d3/d1d/d1e/d43/fa5 zero size 2024-03-18T14:43:17.260 INFO:tasks.workunit.client.1.smithi129.stdout:0/317: chown d0/d14/l1c 907 1 2024-03-18T14:43:17.260 INFO:tasks.workunit.client.0.smithi087.stdout:2/474: write d2/d4/d22/d24/d65/f6b [4612050,1989] 0 2024-03-18T14:43:17.260 INFO:tasks.workunit.client.1.smithi129.stdout:7/292: chown d4/c5b 5640780 1 2024-03-18T14:43:17.261 INFO:tasks.workunit.client.1.smithi129.stdout:2/260: fsync d7/d1f/d20/d36/f38 0 2024-03-18T14:43:17.261 INFO:tasks.workunit.client.1.smithi129.stdout:9/283: sync 2024-03-18T14:43:17.262 INFO:tasks.workunit.client.1.smithi129.stdout:0/318: stat d0/fb 0 2024-03-18T14:43:17.263 INFO:tasks.workunit.client.0.smithi087.stdout:7/586: rename d1/d6/da/d42/f4a to d1/d6/da/fcf 0 2024-03-18T14:43:17.264 INFO:tasks.workunit.client.1.smithi129.stdout:6/301: dwrite d3/d5/d2b/f53 [0,4194304] 0 2024-03-18T14:43:17.266 INFO:tasks.workunit.client.1.smithi129.stdout:0/319: dread - d0/d23/d35/d3b/f33 zero size 2024-03-18T14:43:17.267 INFO:tasks.workunit.client.1.smithi129.stdout:8/280: rename d9/d11/d1a/f3e to d9/d11/d55/f5a 0 2024-03-18T14:43:17.268 INFO:tasks.workunit.client.1.smithi129.stdout:1/290: dwrite d1/d18/f21 [0,4194304] 0 2024-03-18T14:43:17.271 INFO:tasks.workunit.client.1.smithi129.stdout:5/274: dwrite d0/d32/d3a/f49 [0,4194304] 0 2024-03-18T14:43:17.272 INFO:tasks.workunit.client.0.smithi087.stdout:4/441: dwrite d2/db/f1d [0,4194304] 0 2024-03-18T14:43:17.272 INFO:tasks.workunit.client.1.smithi129.stdout:8/281: write d9/d11/d1a/d32/d3a/f29 [3535815,14813] 0 2024-03-18T14:43:17.272 INFO:tasks.workunit.client.1.smithi129.stdout:7/293: dwrite d4/d7/f31 [0,4194304] 0 2024-03-18T14:43:17.272 INFO:tasks.workunit.client.1.smithi129.stdout:5/275: read - d0/df/f44 zero size 2024-03-18T14:43:17.273 INFO:tasks.workunit.client.1.smithi129.stdout:5/276: write d0/d32/d34/f53 [149023,126179] 0 2024-03-18T14:43:17.274 INFO:tasks.workunit.client.1.smithi129.stdout:9/284: creat d0/db/d2e/f50 x:0 0 0 2024-03-18T14:43:17.274 INFO:tasks.workunit.client.1.smithi129.stdout:6/302: creat d3/d5/d2b/f60 x:0 0 0 2024-03-18T14:43:17.274 INFO:tasks.workunit.client.1.smithi129.stdout:3/259: link d4/d11/d1d/c30 d4/d11/d34/d4c/c58 0 2024-03-18T14:43:17.275 INFO:tasks.workunit.client.1.smithi129.stdout:6/303: read - d3/d30/de/f58 zero size 2024-03-18T14:43:17.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/517: getdents d13/d1b/d30 0 2024-03-18T14:43:17.275 INFO:tasks.workunit.client.0.smithi087.stdout:2/475: creat d2/f99 x:0 0 0 2024-03-18T14:43:17.276 INFO:tasks.workunit.client.0.smithi087.stdout:5/518: dread - d13/d1b/d30/d6e/d88/f99 zero size 2024-03-18T14:43:17.279 INFO:tasks.workunit.client.1.smithi129.stdout:5/277: mknod d0/df/c54 0 2024-03-18T14:43:17.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/476: dwrite d2/d4/d22/d2c/d3a/d40/f8f [0,4194304] 0 2024-03-18T14:43:17.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/477: stat d2/d4/d22/d2c/d3a/d40/d4a/d97 0 2024-03-18T14:43:17.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/478: dread - d2/d4/d22/d2c/d3a/d49/d58/f8c zero size 2024-03-18T14:43:17.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/252: link d0/f5 d0/d19/d46/d3e/f47 0 2024-03-18T14:43:17.287 INFO:tasks.workunit.client.1.smithi129.stdout:1/291: symlink d1/d2/l59 0 2024-03-18T14:43:17.288 INFO:tasks.workunit.client.0.smithi087.stdout:6/463: rename d3/d7/f86 to d3/d7/d25/d62/d7c/d29/d22/d75/f9b 0 2024-03-18T14:43:17.288 INFO:tasks.workunit.client.1.smithi129.stdout:4/253: write d0/d1a/f24 [74386,67275] 0 2024-03-18T14:43:17.289 INFO:tasks.workunit.client.1.smithi129.stdout:3/260: mknod d4/dd/d41/c59 0 2024-03-18T14:43:17.289 INFO:tasks.workunit.client.0.smithi087.stdout:7/587: symlink d1/d6/da/d59/dbe/ld0 0 2024-03-18T14:43:17.290 INFO:tasks.workunit.client.0.smithi087.stdout:7/588: write d1/d6/d29/f53 [5126413,110866] 0 2024-03-18T14:43:17.291 INFO:tasks.workunit.client.1.smithi129.stdout:0/320: rename d0/d23/d35/d3b/d43/f5e to d0/d14/f5f 0 2024-03-18T14:43:17.292 INFO:tasks.workunit.client.1.smithi129.stdout:0/321: readlink d0/l15 0 2024-03-18T14:43:17.295 INFO:tasks.workunit.client.1.smithi129.stdout:5/278: mknod d0/d32/d3a/d52/c55 0 2024-03-18T14:43:17.295 INFO:tasks.workunit.client.1.smithi129.stdout:0/322: dread d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:17.295 INFO:tasks.workunit.client.0.smithi087.stdout:4/442: creat d2/db/d24/d30/d56/f8c x:0 0 0 2024-03-18T14:43:17.295 INFO:tasks.workunit.client.0.smithi087.stdout:8/489: truncate d1/f1b 1675802 0 2024-03-18T14:43:17.295 INFO:tasks.workunit.client.0.smithi087.stdout:4/443: readlink d2/d13/l59 0 2024-03-18T14:43:17.296 INFO:tasks.workunit.client.0.smithi087.stdout:5/519: creat d13/d1b/d27/d28/d9a/faf x:0 0 0 2024-03-18T14:43:17.297 INFO:tasks.workunit.client.1.smithi129.stdout:8/282: getdents d9/d11/d1a/d14 0 2024-03-18T14:43:17.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/479: mkdir d2/d4/d22/d2c/d3a/d76/d9a 0 2024-03-18T14:43:17.300 INFO:tasks.workunit.client.1.smithi129.stdout:4/254: symlink d0/d3c/l48 0 2024-03-18T14:43:17.301 INFO:tasks.workunit.client.0.smithi087.stdout:2/480: fdatasync d2/d4/d22/d2c/d3a/d49/f57 0 2024-03-18T14:43:17.301 INFO:tasks.workunit.client.1.smithi129.stdout:5/279: symlink d0/d32/l56 0 2024-03-18T14:43:17.302 INFO:tasks.workunit.client.1.smithi129.stdout:1/292: truncate d1/f9 360872 0 2024-03-18T14:43:17.302 INFO:tasks.workunit.client.1.smithi129.stdout:0/323: rmdir d0/d23/d35 39 2024-03-18T14:43:17.302 INFO:tasks.workunit.client.1.smithi129.stdout:3/261: dread d4/dd/f32 [0,4194304] 0 2024-03-18T14:43:17.303 INFO:tasks.workunit.client.0.smithi087.stdout:9/570: rename db/d18/d3a/d87 to db/d18/d1e/d7e/db8 0 2024-03-18T14:43:17.303 INFO:tasks.workunit.client.1.smithi129.stdout:1/293: chown d1/d2/l31 177534 1 2024-03-18T14:43:17.303 INFO:tasks.workunit.client.1.smithi129.stdout:3/262: fsync d4/dd/d1f/f4b 0 2024-03-18T14:43:17.305 INFO:tasks.workunit.client.0.smithi087.stdout:7/589: unlink d1/d6/d29/d2f/d68/d65/d72/f8f 0 2024-03-18T14:43:17.312 INFO:tasks.workunit.client.1.smithi129.stdout:4/255: symlink d0/d19/d46/d2e/l49 0 2024-03-18T14:43:17.312 INFO:tasks.workunit.client.1.smithi129.stdout:8/283: link d9/d11/d1a/d32/d41/d4d/f56 d9/d11/d1a/d32/d41/d4d/f5b 0 2024-03-18T14:43:17.312 INFO:tasks.workunit.client.1.smithi129.stdout:4/256: stat d0/d1a 0 2024-03-18T14:43:17.313 INFO:tasks.workunit.client.1.smithi129.stdout:3/263: readlink d4/d11/d1d/d27/l57 0 2024-03-18T14:43:17.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/284: symlink d9/d11/d18/l5c 0 2024-03-18T14:43:17.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/285: chown d9/d11/d18/l3d 130115300 1 2024-03-18T14:43:17.318 INFO:tasks.workunit.client.1.smithi129.stdout:8/286: dread - d9/d11/d1a/d32/d41/d4d/f56 zero size 2024-03-18T14:43:17.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/520: creat d13/d1b/d70/fb0 x:0 0 0 2024-03-18T14:43:17.319 INFO:tasks.workunit.client.1.smithi129.stdout:1/294: creat d1/d18/f5a x:0 0 0 2024-03-18T14:43:17.319 INFO:tasks.workunit.client.1.smithi129.stdout:0/324: dread d0/d23/d35/d3b/f57 [0,4194304] 0 2024-03-18T14:43:17.320 INFO:tasks.workunit.client.1.smithi129.stdout:1/295: write d1/d35/f45 [3028427,119796] 0 2024-03-18T14:43:17.320 INFO:tasks.workunit.client.0.smithi087.stdout:7/590: unlink d1/d6/d29/f79 0 2024-03-18T14:43:17.321 INFO:tasks.workunit.client.1.smithi129.stdout:0/325: chown d0/d23/d35/d3b/d43/l5b 227725119 1 2024-03-18T14:43:17.321 INFO:tasks.workunit.client.1.smithi129.stdout:3/264: rename d4/d11/c42 to d4/dd/d41/c5a 0 2024-03-18T14:43:17.321 INFO:tasks.workunit.client.1.smithi129.stdout:3/265: write d4/d38/f24 [2186391,42909] 0 2024-03-18T14:43:17.322 INFO:tasks.workunit.client.1.smithi129.stdout:3/266: write d4/f9 [686413,126455] 0 2024-03-18T14:43:17.324 INFO:tasks.workunit.client.1.smithi129.stdout:8/287: rmdir d9/d11/d18 39 2024-03-18T14:43:17.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/481: mkdir d2/d4/d22/d2c/d3a/d76/d9a/d9b 0 2024-03-18T14:43:17.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/482: chown d2/c18 1786 1 2024-03-18T14:43:17.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/483: chown d2/d4/d22/d2c/d3a/d49/f8b 1 1 2024-03-18T14:43:17.327 INFO:tasks.workunit.client.0.smithi087.stdout:5/521: mknod d13/d1b/d27/d28/d9a/cb1 0 2024-03-18T14:43:17.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/591: unlink d1/d6/d29/l5a 0 2024-03-18T14:43:17.329 INFO:tasks.workunit.client.1.smithi129.stdout:7/294: sync 2024-03-18T14:43:17.329 INFO:tasks.workunit.client.1.smithi129.stdout:0/326: mknod d0/d23/d29/c60 0 2024-03-18T14:43:17.329 INFO:tasks.workunit.client.1.smithi129.stdout:3/267: creat d4/dd/d15/f5b x:0 0 0 2024-03-18T14:43:17.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/268: readlink d4/d11/d1d/d27/l57 0 2024-03-18T14:43:17.330 INFO:tasks.workunit.client.0.smithi087.stdout:9/571: creat db/fb9 x:0 0 0 2024-03-18T14:43:17.332 INFO:tasks.workunit.client.0.smithi087.stdout:2/484: chown d2/c29 66 1 2024-03-18T14:43:17.334 INFO:tasks.workunit.client.0.smithi087.stdout:9/572: mkdir db/d18/d1e/d28/d7c/dba 0 2024-03-18T14:43:17.335 INFO:tasks.workunit.client.1.smithi129.stdout:3/269: dwrite d4/d38/f1b [0,4194304] 0 2024-03-18T14:43:17.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/485: dread d2/d4/f59 [4194304,4194304] 0 2024-03-18T14:43:17.336 INFO:tasks.workunit.client.1.smithi129.stdout:8/288: mkdir d9/d11/d1a/d32/d3a/d5d 0 2024-03-18T14:43:17.336 INFO:tasks.workunit.client.0.smithi087.stdout:2/486: stat d2/d44/d72/f7c 0 2024-03-18T14:43:17.338 INFO:tasks.workunit.client.0.smithi087.stdout:9/573: rename db/d18/d3a/c77 to db/d18/d3a/cbb 0 2024-03-18T14:43:17.340 INFO:tasks.workunit.client.0.smithi087.stdout:2/487: rmdir d2/d4/d22/d2c 39 2024-03-18T14:43:17.340 INFO:tasks.workunit.client.0.smithi087.stdout:7/592: getdents d1/d6/da/d42/d61 0 2024-03-18T14:43:17.343 INFO:tasks.workunit.client.0.smithi087.stdout:7/593: mknod d1/d8e/d95/dae/cd1 0 2024-03-18T14:43:17.346 INFO:tasks.workunit.client.0.smithi087.stdout:9/574: getdents db/d31 0 2024-03-18T14:43:17.346 INFO:tasks.workunit.client.0.smithi087.stdout:7/594: mknod d1/d97/cd2 0 2024-03-18T14:43:17.348 INFO:tasks.workunit.client.0.smithi087.stdout:2/488: link d2/d4/d22/d2c/f2e d2/d44/d72/d79/f9c 0 2024-03-18T14:43:17.349 INFO:tasks.workunit.client.1.smithi129.stdout:6/304: dread f1 [0,4194304] 0 2024-03-18T14:43:17.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/305: dread - d3/d5/d46/f55 zero size 2024-03-18T14:43:17.351 INFO:tasks.workunit.client.0.smithi087.stdout:7/595: creat d1/d6/da/d42/d61/fd3 x:0 0 0 2024-03-18T14:43:17.352 INFO:tasks.workunit.client.0.smithi087.stdout:2/489: mknod d2/d4/d22/d2c/d3a/d76/d9a/c9d 0 2024-03-18T14:43:17.354 INFO:tasks.workunit.client.1.smithi129.stdout:6/306: dwrite d3/d6/f4e [0,4194304] 0 2024-03-18T14:43:17.355 INFO:tasks.workunit.client.1.smithi129.stdout:6/307: fdatasync d3/d5/d2b/f53 0 2024-03-18T14:43:17.355 INFO:tasks.workunit.client.0.smithi087.stdout:7/596: mkdir d1/d8e/dd4 0 2024-03-18T14:43:17.356 INFO:tasks.workunit.client.0.smithi087.stdout:2/490: creat d2/d4/d22/d2c/d3a/d49/d58/f9e x:0 0 0 2024-03-18T14:43:17.357 INFO:tasks.workunit.client.1.smithi129.stdout:2/261: truncate d7/d1f/f4c 2184987 0 2024-03-18T14:43:17.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/475: write d0/d2/d4/d19/f41 [1058779,7073] 0 2024-03-18T14:43:17.361 INFO:tasks.workunit.client.0.smithi087.stdout:3/529: dwrite d0/de/d30/d67/f79 [0,4194304] 0 2024-03-18T14:43:17.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/464: getdents d3/d7/d25/d62/d7c/d29/d22/d75 0 2024-03-18T14:43:17.365 INFO:tasks.workunit.client.1.smithi129.stdout:1/296: rmdir d1/d2 39 2024-03-18T14:43:17.365 INFO:tasks.workunit.client.0.smithi087.stdout:0/476: dwrite d0/d2/d4/d27/f9b [0,4194304] 0 2024-03-18T14:43:17.365 INFO:tasks.workunit.client.0.smithi087.stdout:1/543: truncate d3/d1d/d1f/f75 638181 0 2024-03-18T14:43:17.368 INFO:tasks.workunit.client.1.smithi129.stdout:9/285: dwrite d0/db/d11/f27 [0,4194304] 0 2024-03-18T14:43:17.368 INFO:tasks.workunit.client.0.smithi087.stdout:3/530: dwrite d0/d1c/f59 [0,4194304] 0 2024-03-18T14:43:17.370 INFO:tasks.workunit.client.1.smithi129.stdout:8/289: rmdir d9/d11/d1a/d32/d41/d4d 39 2024-03-18T14:43:17.372 INFO:tasks.workunit.client.0.smithi087.stdout:8/490: write d1/d6/d9/f61 [270761,59707] 0 2024-03-18T14:43:17.373 INFO:tasks.workunit.client.1.smithi129.stdout:4/257: truncate d0/d9/f15 4795003 0 2024-03-18T14:43:17.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/444: truncate d2/f63 5217717 0 2024-03-18T14:43:17.374 INFO:tasks.workunit.client.1.smithi129.stdout:5/280: dwrite d0/f9 [0,4194304] 0 2024-03-18T14:43:17.374 INFO:tasks.workunit.client.1.smithi129.stdout:4/258: chown d0/d19/d46/d3e/d21 1008330098 1 2024-03-18T14:43:17.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/522: write d13/f1e [266273,1062] 0 2024-03-18T14:43:17.382 INFO:tasks.workunit.client.1.smithi129.stdout:0/327: dwrite d0/d23/d35/d3b/f3c [0,4194304] 0 2024-03-18T14:43:17.384 INFO:tasks.workunit.client.0.smithi087.stdout:9/575: dwrite db/d18/d3a/f9f [0,4194304] 0 2024-03-18T14:43:17.384 INFO:tasks.workunit.client.1.smithi129.stdout:7/295: dwrite d4/fd [0,4194304] 0 2024-03-18T14:43:17.384 INFO:tasks.workunit.client.1.smithi129.stdout:3/270: dwrite d4/fb [0,4194304] 0 2024-03-18T14:43:17.384 INFO:tasks.workunit.client.0.smithi087.stdout:7/597: symlink d1/d6/d29/d2f/d68/d65/d72/ld5 0 2024-03-18T14:43:17.385 INFO:tasks.workunit.client.1.smithi129.stdout:3/271: fdatasync d4/d38/f47 0 2024-03-18T14:43:17.385 INFO:tasks.workunit.client.1.smithi129.stdout:7/296: write d4/d7/d38/f5d [907845,49712] 0 2024-03-18T14:43:17.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/491: rename d2/d4/d22/d24/d65/d7f/c89 to d2/d4/d22/d2c/d3a/d40/d4a/d97/c9f 0 2024-03-18T14:43:17.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/477: symlink d0/d1a/d80/laf 0 2024-03-18T14:43:17.394 INFO:tasks.workunit.client.1.smithi129.stdout:4/259: creat d0/d1a/f4a x:0 0 0 2024-03-18T14:43:17.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/281: truncate d0/dc/d22/f39 256959 0 2024-03-18T14:43:17.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/531: unlink d0/f34 0 2024-03-18T14:43:17.395 INFO:tasks.workunit.client.1.smithi129.stdout:6/308: mknod d3/c61 0 2024-03-18T14:43:17.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/532: read - d0/d72/d85/f90 zero size 2024-03-18T14:43:17.396 INFO:tasks.workunit.client.0.smithi087.stdout:3/533: fdatasync d0/d1c/f91 0 2024-03-18T14:43:17.396 INFO:tasks.workunit.client.0.smithi087.stdout:3/534: chown d0/d3/d4f 389724 1 2024-03-18T14:43:17.399 INFO:tasks.workunit.client.1.smithi129.stdout:0/328: mkdir d0/d14/d3a/d4a/d61 0 2024-03-18T14:43:17.399 INFO:tasks.workunit.client.0.smithi087.stdout:8/491: symlink d1/d6/d8d/l9e 0 2024-03-18T14:43:17.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/445: write d2/f36 [1070754,42966] 0 2024-03-18T14:43:17.403 INFO:tasks.workunit.client.1.smithi129.stdout:8/290: fsync d9/d11/d1a/d32/d41/d4d/f56 0 2024-03-18T14:43:17.403 INFO:tasks.workunit.client.1.smithi129.stdout:6/309: mknod d3/d30/c62 0 2024-03-18T14:43:17.406 INFO:tasks.workunit.client.1.smithi129.stdout:4/260: dread d0/d19/f1f [0,4194304] 0 2024-03-18T14:43:17.406 INFO:tasks.workunit.client.0.smithi087.stdout:7/598: creat d1/d6/da/d42/d67/fd6 x:0 0 0 2024-03-18T14:43:17.410 INFO:tasks.workunit.client.1.smithi129.stdout:3/272: dread d4/d11/d1d/d36/f4a [0,4194304] 0 2024-03-18T14:43:17.410 INFO:tasks.workunit.client.0.smithi087.stdout:2/492: rename d2/d4/d22/d2c/d3a/d49/f77 to d2/d4/d22/d2c/d3a/d76/d9a/d9b/fa0 0 2024-03-18T14:43:17.410 INFO:tasks.workunit.client.0.smithi087.stdout:7/599: dwrite d1/d8e/d95/fc4 [0,4194304] 0 2024-03-18T14:43:17.414 INFO:tasks.workunit.client.1.smithi129.stdout:2/262: rmdir d7 39 2024-03-18T14:43:17.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/492: dread d1/d6/d2f/f95 [0,4194304] 0 2024-03-18T14:43:17.417 INFO:tasks.workunit.client.1.smithi129.stdout:8/291: write d9/d11/d18/f3f [1595771,24529] 0 2024-03-18T14:43:17.417 INFO:tasks.workunit.client.1.smithi129.stdout:6/310: chown d3/d5/l33 3627718 1 2024-03-18T14:43:17.419 INFO:tasks.workunit.client.0.smithi087.stdout:4/446: rename d2/db/de/f45 to d2/db/d24/f8d 0 2024-03-18T14:43:17.421 INFO:tasks.workunit.client.0.smithi087.stdout:8/493: dwrite d1/f32 [0,4194304] 0 2024-03-18T14:43:17.425 INFO:tasks.workunit.client.0.smithi087.stdout:8/494: dread d1/d6/d2f/d44/d45/d50/f5e [0,4194304] 0 2024-03-18T14:43:17.427 INFO:tasks.workunit.client.1.smithi129.stdout:8/292: creat d9/d11/d1a/d14/f5e x:0 0 0 2024-03-18T14:43:17.427 INFO:tasks.workunit.client.0.smithi087.stdout:7/600: fsync d1/d6/f2a 0 2024-03-18T14:43:17.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/535: link d0/d3/df/f4d d0/d3/d40/f97 0 2024-03-18T14:43:17.427 INFO:tasks.workunit.client.0.smithi087.stdout:0/478: getdents d0/d2/da9 0 2024-03-18T14:43:17.427 INFO:tasks.workunit.client.1.smithi129.stdout:9/286: dread d0/f1b [0,4194304] 0 2024-03-18T14:43:17.428 INFO:tasks.workunit.client.0.smithi087.stdout:7/601: write d1/f2e [446707,74995] 0 2024-03-18T14:43:17.428 INFO:tasks.workunit.client.1.smithi129.stdout:9/287: write d0/f5 [6808636,44643] 0 2024-03-18T14:43:17.428 INFO:tasks.workunit.client.1.smithi129.stdout:2/263: mkdir d7/d1f/d34/d4d 0 2024-03-18T14:43:17.429 INFO:tasks.workunit.client.1.smithi129.stdout:2/264: chown d7/d3f/f43 863092 1 2024-03-18T14:43:17.432 INFO:tasks.workunit.client.0.smithi087.stdout:4/447: dread d2/d13/d28/f70 [0,4194304] 0 2024-03-18T14:43:17.433 INFO:tasks.workunit.client.1.smithi129.stdout:9/288: dwrite d0/db/d1f/f30 [0,4194304] 0 2024-03-18T14:43:17.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/261: getdents d0/d9 0 2024-03-18T14:43:17.436 INFO:tasks.workunit.client.0.smithi087.stdout:4/448: dwrite d2/db/d24/f4b [0,4194304] 0 2024-03-18T14:43:17.436 INFO:tasks.workunit.client.1.smithi129.stdout:2/265: mknod d7/c4e 0 2024-03-18T14:43:17.437 INFO:tasks.workunit.client.1.smithi129.stdout:2/266: readlink d7/d1c/l33 0 2024-03-18T14:43:17.437 INFO:tasks.workunit.client.0.smithi087.stdout:0/479: symlink d0/d1a/d7b/d26/d79/lb0 0 2024-03-18T14:43:17.438 INFO:tasks.workunit.client.0.smithi087.stdout:0/480: write d0/d2/d3c/f61 [467944,105459] 0 2024-03-18T14:43:17.441 INFO:tasks.workunit.client.1.smithi129.stdout:2/267: dwrite d7/d1f/d20/d2d/f35 [0,4194304] 0 2024-03-18T14:43:17.445 INFO:tasks.workunit.client.0.smithi087.stdout:2/493: getdents d2/d4/d22/d2c/d3a/d40/d4a 0 2024-03-18T14:43:17.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/449: dwrite d2/db/d3c/f81 [0,4194304] 0 2024-03-18T14:43:17.445 INFO:tasks.workunit.client.0.smithi087.stdout:3/536: link d0/d1c/l5c d0/de/d30/d8e/l98 0 2024-03-18T14:43:17.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/537: readlink d0/d3/l1b 0 2024-03-18T14:43:17.447 INFO:tasks.workunit.client.0.smithi087.stdout:3/538: dread - d0/de/d30/d46/f89 zero size 2024-03-18T14:43:17.447 INFO:tasks.workunit.client.1.smithi129.stdout:2/268: rmdir d7/d1f/d20 39 2024-03-18T14:43:17.448 INFO:tasks.workunit.client.0.smithi087.stdout:6/465: dread d3/d7/d25/d62/d7c/d29/f1d [4194304,4194304] 0 2024-03-18T14:43:17.449 INFO:tasks.workunit.client.0.smithi087.stdout:6/466: chown d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95 262086 1 2024-03-18T14:43:17.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/467: fdatasync d3/d7/d25/d62/d7c/d29/d22/f5f 0 2024-03-18T14:43:17.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/481: getdents d0/d2/da9 0 2024-03-18T14:43:17.453 INFO:tasks.workunit.client.1.smithi129.stdout:2/269: readlink d7/d1f/d20/d2b/d41/l42 0 2024-03-18T14:43:17.454 INFO:tasks.workunit.client.0.smithi087.stdout:0/482: write d0/d2/d4/d19/f72 [1511492,24994] 0 2024-03-18T14:43:17.458 INFO:tasks.workunit.client.0.smithi087.stdout:0/483: dwrite d0/d1a/d7b/d26/faa [0,4194304] 0 2024-03-18T14:43:17.459 INFO:tasks.workunit.client.1.smithi129.stdout:7/297: truncate d4/d7/d38/f5d 735903 0 2024-03-18T14:43:17.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/544: write d3/d1d/d1e/d20/f5c [1071259,125292] 0 2024-03-18T14:43:17.460 INFO:tasks.workunit.client.1.smithi129.stdout:7/298: fdatasync d4/d2d/d2e/f5a 0 2024-03-18T14:43:17.460 INFO:tasks.workunit.client.0.smithi087.stdout:5/523: truncate d13/d1b/d27/d35/f4b 454201 0 2024-03-18T14:43:17.463 INFO:tasks.workunit.client.0.smithi087.stdout:0/484: dwrite d0/d2/f4a [4194304,4194304] 0 2024-03-18T14:43:17.464 INFO:tasks.workunit.client.1.smithi129.stdout:2/270: rmdir d7/d1c/d32 39 2024-03-18T14:43:17.464 INFO:tasks.workunit.client.0.smithi087.stdout:9/576: dread db/d18/d1c/f50 [0,4194304] 0 2024-03-18T14:43:17.468 INFO:tasks.workunit.client.1.smithi129.stdout:2/271: dwrite d7/d3f/f43 [0,4194304] 0 2024-03-18T14:43:17.470 INFO:tasks.workunit.client.1.smithi129.stdout:2/272: chown d7/d1f/d34/f18 509 1 2024-03-18T14:43:17.471 INFO:tasks.workunit.client.1.smithi129.stdout:5/282: sync 2024-03-18T14:43:17.473 INFO:tasks.workunit.client.1.smithi129.stdout:6/311: dread d3/d5/f48 [0,4194304] 0 2024-03-18T14:43:17.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/539: creat d0/d72/f99 x:0 0 0 2024-03-18T14:43:17.474 INFO:tasks.workunit.client.1.smithi129.stdout:6/312: write d3/d30/d44/f4a [3721209,67970] 0 2024-03-18T14:43:17.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/540: fsync d0/f6d 0 2024-03-18T14:43:17.475 INFO:tasks.workunit.client.1.smithi129.stdout:5/283: fsync d0/f36 0 2024-03-18T14:43:17.475 INFO:tasks.workunit.client.0.smithi087.stdout:3/541: write d0/de/d30/f5d [1325537,18004] 0 2024-03-18T14:43:17.475 INFO:tasks.workunit.client.1.smithi129.stdout:5/284: chown d0/d32/d34/c3d 239 1 2024-03-18T14:43:17.477 INFO:tasks.workunit.client.0.smithi087.stdout:6/468: dwrite d3/d7/d25/d62/d7c/f42 [0,4194304] 0 2024-03-18T14:43:17.477 INFO:tasks.workunit.client.1.smithi129.stdout:2/273: rename d7/d3f/f4a to d7/d1c/d32/f4f 0 2024-03-18T14:43:17.479 INFO:tasks.workunit.client.1.smithi129.stdout:1/297: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:17.481 INFO:tasks.workunit.client.1.smithi129.stdout:2/274: fsync f0 0 2024-03-18T14:43:17.483 INFO:tasks.workunit.client.0.smithi087.stdout:9/577: symlink db/d12/lbc 0 2024-03-18T14:43:17.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/329: dread d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:17.484 INFO:tasks.workunit.client.1.smithi129.stdout:5/285: link d0/f11 d0/dc/d18/d2b/f57 0 2024-03-18T14:43:17.484 INFO:tasks.workunit.client.1.smithi129.stdout:0/330: chown d0/d23/d29 748 1 2024-03-18T14:43:17.485 INFO:tasks.workunit.client.0.smithi087.stdout:0/485: read d0/d2/d4/d19/d62/f70 [1260543,100177] 0 2024-03-18T14:43:17.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/275: creat d7/d3f/f50 x:0 0 0 2024-03-18T14:43:17.487 INFO:tasks.workunit.client.1.smithi129.stdout:0/331: creat d0/d14/d3a/f62 x:0 0 0 2024-03-18T14:43:17.488 INFO:tasks.workunit.client.0.smithi087.stdout:7/602: symlink d1/d6/d29/d2f/d68/d65/d60/d66/d8b/ld7 0 2024-03-18T14:43:17.488 INFO:tasks.workunit.client.0.smithi087.stdout:7/603: chown d1/d6/d29/f49 411367 1 2024-03-18T14:43:17.489 INFO:tasks.workunit.client.1.smithi129.stdout:2/276: unlink f5 0 2024-03-18T14:43:17.489 INFO:tasks.workunit.client.0.smithi087.stdout:9/578: symlink db/d31/lbd 0 2024-03-18T14:43:17.490 INFO:tasks.workunit.client.1.smithi129.stdout:2/277: dread - d7/d1f/d20/d2a/f48 zero size 2024-03-18T14:43:17.491 INFO:tasks.workunit.client.0.smithi087.stdout:3/542: mkdir d0/d3/df/d9a 0 2024-03-18T14:43:17.495 INFO:tasks.workunit.client.1.smithi129.stdout:5/286: rename d0/d32/d3a/d52/c55 to d0/dc/c58 0 2024-03-18T14:43:17.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/450: rename d2/d13/d28/l32 to d2/d13/d28/l8e 0 2024-03-18T14:43:17.497 INFO:tasks.workunit.client.1.smithi129.stdout:3/273: truncate d4/d38/f37 864735 0 2024-03-18T14:43:17.497 INFO:tasks.workunit.client.0.smithi087.stdout:7/604: creat d1/d6/da/d59/dbe/fd8 x:0 0 0 2024-03-18T14:43:17.498 INFO:tasks.workunit.client.0.smithi087.stdout:2/494: getdents d2/d4/d22/d2c/d3a/d49/d58 0 2024-03-18T14:43:17.498 INFO:tasks.workunit.client.0.smithi087.stdout:2/495: read - d2/d4/d22/f4d zero size 2024-03-18T14:43:17.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/579: creat db/d18/d1c/d69/fbe x:0 0 0 2024-03-18T14:43:17.499 INFO:tasks.workunit.client.1.smithi129.stdout:0/332: unlink d0/d23/d35/c54 0 2024-03-18T14:43:17.502 INFO:tasks.workunit.client.1.smithi129.stdout:1/298: dread d1/d2/f3b [0,4194304] 0 2024-03-18T14:43:17.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/469: truncate d3/d7/d25/d62/d7c/d29/f90 729497 0 2024-03-18T14:43:17.503 INFO:tasks.workunit.client.1.smithi129.stdout:7/299: sync 2024-03-18T14:43:17.503 INFO:tasks.workunit.client.1.smithi129.stdout:2/278: creat d7/d1f/d20/d2b/f51 x:0 0 0 2024-03-18T14:43:17.503 INFO:tasks.workunit.client.1.smithi129.stdout:1/299: fsync d1/d18/d19/f37 0 2024-03-18T14:43:17.503 INFO:tasks.workunit.client.1.smithi129.stdout:5/287: creat d0/df/f59 x:0 0 0 2024-03-18T14:43:17.503 INFO:tasks.workunit.client.1.smithi129.stdout:2/279: chown d7/d3f/f50 441 1 2024-03-18T14:43:17.504 INFO:tasks.workunit.client.1.smithi129.stdout:7/300: fdatasync d4/d2d/d2e/f50 0 2024-03-18T14:43:17.504 INFO:tasks.workunit.client.0.smithi087.stdout:4/451: creat d2/db/d24/d30/d49/d4f/f8f x:0 0 0 2024-03-18T14:43:17.504 INFO:tasks.workunit.client.1.smithi129.stdout:3/274: creat d4/dd/d15/d31/f5c x:0 0 0 2024-03-18T14:43:17.505 INFO:tasks.workunit.client.1.smithi129.stdout:2/280: fdatasync d7/d1f/d34/f15 0 2024-03-18T14:43:17.505 INFO:tasks.workunit.client.0.smithi087.stdout:7/605: symlink d1/d97/ld9 0 2024-03-18T14:43:17.506 INFO:tasks.workunit.client.1.smithi129.stdout:5/288: fsync d0/fb 0 2024-03-18T14:43:17.506 INFO:tasks.workunit.client.1.smithi129.stdout:2/281: fdatasync d7/d1f/d34/f30 0 2024-03-18T14:43:17.507 INFO:tasks.workunit.client.0.smithi087.stdout:7/606: chown d1/d6/d16 7027 1 2024-03-18T14:43:17.507 INFO:tasks.workunit.client.0.smithi087.stdout:2/496: creat d2/fa1 x:0 0 0 2024-03-18T14:43:17.507 INFO:tasks.workunit.client.1.smithi129.stdout:7/301: readlink d4/d7/l52 0 2024-03-18T14:43:17.508 INFO:tasks.workunit.client.0.smithi087.stdout:5/524: dread d13/d1b/f5c [0,4194304] 0 2024-03-18T14:43:17.509 INFO:tasks.workunit.client.1.smithi129.stdout:7/302: chown d4/d7/f43 715 1 2024-03-18T14:43:17.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/470: mknod d3/d7/d25/d62/d7c/d29/d22/d47/d87/c9c 0 2024-03-18T14:43:17.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/471: fsync d3/f45 0 2024-03-18T14:43:17.510 INFO:tasks.workunit.client.1.smithi129.stdout:8/293: write d9/d11/d18/f35 [1104387,127457] 0 2024-03-18T14:43:17.511 INFO:tasks.workunit.client.0.smithi087.stdout:6/472: rename d3/d7/d25 to d3/d7/d25/d62/d7c/d29/d22/d47/d9d 22 2024-03-18T14:43:17.511 INFO:tasks.workunit.client.0.smithi087.stdout:2/497: mknod d2/d4/d22/d24/ca2 0 2024-03-18T14:43:17.512 INFO:tasks.workunit.client.1.smithi129.stdout:3/275: dwrite d4/dd/d1f/f4b [0,4194304] 0 2024-03-18T14:43:17.512 INFO:tasks.workunit.client.0.smithi087.stdout:2/498: dread - d2/d4/d22/d2c/d3a/d68/f93 zero size 2024-03-18T14:43:17.514 INFO:tasks.workunit.client.1.smithi129.stdout:3/276: write d4/fb [726245,69781] 0 2024-03-18T14:43:17.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/289: truncate d0/db/d11/f27 817215 0 2024-03-18T14:43:17.515 INFO:tasks.workunit.client.1.smithi129.stdout:5/289: dwrite d0/d32/d34/f3b [0,4194304] 0 2024-03-18T14:43:17.515 INFO:tasks.workunit.client.0.smithi087.stdout:1/545: truncate d3/d1d/d1e/d20/d7a/f83 795224 0 2024-03-18T14:43:17.518 INFO:tasks.workunit.client.1.smithi129.stdout:4/262: dwrite d0/d19/d46/d3e/f47 [0,4194304] 0 2024-03-18T14:43:17.519 INFO:tasks.workunit.client.0.smithi087.stdout:0/486: truncate d0/d2/d3c/f61 1559471 0 2024-03-18T14:43:17.519 INFO:tasks.workunit.client.0.smithi087.stdout:3/543: write d0/d1c/f59 [4122339,103142] 0 2024-03-18T14:43:17.520 INFO:tasks.workunit.client.1.smithi129.stdout:1/300: dread d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:17.520 INFO:tasks.workunit.client.1.smithi129.stdout:7/303: creat d4/d7/f5f x:0 0 0 2024-03-18T14:43:17.520 INFO:tasks.workunit.client.1.smithi129.stdout:6/313: truncate d3/d5/f11 1085563 0 2024-03-18T14:43:17.521 INFO:tasks.workunit.client.0.smithi087.stdout:3/544: dread - d0/d1c/d25/f7b zero size 2024-03-18T14:43:17.522 INFO:tasks.workunit.client.0.smithi087.stdout:0/487: read d0/d2/f17 [31089,23352] 0 2024-03-18T14:43:17.525 INFO:tasks.workunit.client.1.smithi129.stdout:1/301: dwrite d1/d2/f34 [0,4194304] 0 2024-03-18T14:43:17.527 INFO:tasks.workunit.client.0.smithi087.stdout:9/580: dwrite db/d18/d3a/f47 [0,4194304] 0 2024-03-18T14:43:17.527 INFO:tasks.workunit.client.0.smithi087.stdout:6/473: fsync d3/d7/f57 0 2024-03-18T14:43:17.529 INFO:tasks.workunit.client.1.smithi129.stdout:0/333: sync 2024-03-18T14:43:17.529 INFO:tasks.workunit.client.0.smithi087.stdout:1/546: mknod d3/d1d/d1e/d43/d50/d71/caa 0 2024-03-18T14:43:17.532 INFO:tasks.workunit.client.0.smithi087.stdout:9/581: dread db/d18/d3a/f6b [0,4194304] 0 2024-03-18T14:43:17.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/334: dwrite d0/d14/d3a/f4c [0,4194304] 0 2024-03-18T14:43:17.533 INFO:tasks.workunit.client.0.smithi087.stdout:9/582: fsync db/f73 0 2024-03-18T14:43:17.534 INFO:tasks.workunit.client.1.smithi129.stdout:9/290: creat d0/db/d1f/d20/d25/f51 x:0 0 0 2024-03-18T14:43:17.535 INFO:tasks.workunit.client.1.smithi129.stdout:5/290: mknod d0/dc/d18/c5a 0 2024-03-18T14:43:17.535 INFO:tasks.workunit.client.1.smithi129.stdout:3/277: chown d4/dd/d41/c5a 0 1 2024-03-18T14:43:17.537 INFO:tasks.workunit.client.1.smithi129.stdout:4/263: creat d0/d19/d46/d3e/f4b x:0 0 0 2024-03-18T14:43:17.539 INFO:tasks.workunit.client.1.smithi129.stdout:7/304: stat d4/f16 0 2024-03-18T14:43:17.539 INFO:tasks.workunit.client.1.smithi129.stdout:3/278: dread d4/fb [0,4194304] 0 2024-03-18T14:43:17.540 INFO:tasks.workunit.client.1.smithi129.stdout:3/279: stat d4/dd/d41 0 2024-03-18T14:43:17.540 INFO:tasks.workunit.client.1.smithi129.stdout:7/305: write d4/d7/d8/d3b/f40 [757990,30984] 0 2024-03-18T14:43:17.541 INFO:tasks.workunit.client.1.smithi129.stdout:3/280: fsync d4/dd/f3d 0 2024-03-18T14:43:17.542 INFO:tasks.workunit.client.1.smithi129.stdout:6/314: dread d3/d30/de/f2e [0,4194304] 0 2024-03-18T14:43:17.543 INFO:tasks.workunit.client.1.smithi129.stdout:2/282: creat d7/d1f/f52 x:0 0 0 2024-03-18T14:43:17.543 INFO:tasks.workunit.client.1.smithi129.stdout:6/315: write d3/d30/de/f58 [835846,110876] 0 2024-03-18T14:43:17.544 INFO:tasks.workunit.client.1.smithi129.stdout:2/283: fsync d7/d1f/d20/d2d/f2e 0 2024-03-18T14:43:17.546 INFO:tasks.workunit.client.1.smithi129.stdout:1/302: symlink d1/d18/d19/d49/l5b 0 2024-03-18T14:43:17.546 INFO:tasks.workunit.client.0.smithi087.stdout:7/607: truncate d1/d6/d16/dc/f26 5805740 0 2024-03-18T14:43:17.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/547: mkdir d3/d1d/d1f/dab 0 2024-03-18T14:43:17.548 INFO:tasks.workunit.client.1.smithi129.stdout:0/335: rename d0/d23/d35/d3b/d43 to d0/d14/d28/d63 0 2024-03-18T14:43:17.549 INFO:tasks.workunit.client.0.smithi087.stdout:6/474: creat d3/d7/d25/d62/d7c/f9e x:0 0 0 2024-03-18T14:43:17.549 INFO:tasks.workunit.client.1.smithi129.stdout:9/291: rmdir d0/db/d11 39 2024-03-18T14:43:17.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/583: fsync db/d18/d1e/d28/d76/da7/fb6 0 2024-03-18T14:43:17.552 INFO:tasks.workunit.client.1.smithi129.stdout:4/264: mkdir d0/d9/d4c 0 2024-03-18T14:43:17.553 INFO:tasks.workunit.client.0.smithi087.stdout:7/608: mknod d1/d6/da/d42/d61/d74/cda 0 2024-03-18T14:43:17.554 INFO:tasks.workunit.client.0.smithi087.stdout:6/475: write d3/d7/d25/d62/d7c/d29/d22/f80 [1795026,46371] 0 2024-03-18T14:43:17.554 INFO:tasks.workunit.client.1.smithi129.stdout:8/294: mkdir d9/d11/d53/d5f 0 2024-03-18T14:43:17.555 INFO:tasks.workunit.client.1.smithi129.stdout:8/295: chown d9/d11/d18/f34 15 1 2024-03-18T14:43:17.555 INFO:tasks.workunit.client.1.smithi129.stdout:7/306: unlink d4/d2d/d3a/f46 0 2024-03-18T14:43:17.556 INFO:tasks.workunit.client.1.smithi129.stdout:8/296: chown d9/d11/d18/c3c 119615 1 2024-03-18T14:43:17.556 INFO:tasks.workunit.client.1.smithi129.stdout:7/307: readlink d4/l2c 0 2024-03-18T14:43:17.556 INFO:tasks.workunit.client.1.smithi129.stdout:7/308: fdatasync d4/d2d/d2e/f5a 0 2024-03-18T14:43:17.556 INFO:tasks.workunit.client.1.smithi129.stdout:8/297: fdatasync d9/d11/d18/f35 0 2024-03-18T14:43:17.558 INFO:tasks.workunit.client.1.smithi129.stdout:7/309: write d4/d7/d8/d3b/f40 [590628,73275] 0 2024-03-18T14:43:17.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/476: mkdir d3/d7/d25/d9f 0 2024-03-18T14:43:17.558 INFO:tasks.workunit.client.1.smithi129.stdout:2/284: mknod d7/d1f/d20/d36/c53 0 2024-03-18T14:43:17.559 INFO:tasks.workunit.client.0.smithi087.stdout:9/584: mkdir db/d18/d1e/d28/d76/db7/dbf 0 2024-03-18T14:43:17.562 INFO:tasks.workunit.client.0.smithi087.stdout:3/545: dread d0/d3/df/f4d [0,4194304] 0 2024-03-18T14:43:17.564 INFO:tasks.workunit.client.1.smithi129.stdout:3/281: creat d4/d11/d34/d4c/f5d x:0 0 0 2024-03-18T14:43:17.564 INFO:tasks.workunit.client.1.smithi129.stdout:7/310: read d4/f16 [2889742,74005] 0 2024-03-18T14:43:17.564 INFO:tasks.workunit.client.0.smithi087.stdout:8/495: sync 2024-03-18T14:43:17.565 INFO:tasks.workunit.client.1.smithi129.stdout:8/298: mkdir d9/d11/d1a/d14/d60 0 2024-03-18T14:43:17.566 INFO:tasks.workunit.client.0.smithi087.stdout:9/585: creat db/d18/da6/fc0 x:0 0 0 2024-03-18T14:43:17.566 INFO:tasks.workunit.client.1.smithi129.stdout:8/299: fdatasync d9/d11/d18/f34 0 2024-03-18T14:43:17.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/452: truncate d2/db/d24/d30/d7b/d7f/f57 484941 0 2024-03-18T14:43:17.567 INFO:tasks.workunit.client.1.smithi129.stdout:3/282: dread d4/d38/f1b [0,4194304] 0 2024-03-18T14:43:17.568 INFO:tasks.workunit.client.1.smithi129.stdout:5/291: creat d0/dc/f5b x:0 0 0 2024-03-18T14:43:17.572 INFO:tasks.workunit.client.1.smithi129.stdout:5/292: dread d0/d32/d34/f3b [0,4194304] 0 2024-03-18T14:43:17.573 INFO:tasks.workunit.client.1.smithi129.stdout:9/292: mknod d0/db/d11/c52 0 2024-03-18T14:43:17.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/548: dwrite d3/d1d/f3d [0,4194304] 0 2024-03-18T14:43:17.576 INFO:tasks.workunit.client.1.smithi129.stdout:8/300: mknod d9/d11/d1a/d14/c61 0 2024-03-18T14:43:17.579 INFO:tasks.workunit.client.0.smithi087.stdout:0/488: dread d0/d1a/d7b/d2a/f68 [0,4194304] 0 2024-03-18T14:43:17.581 INFO:tasks.workunit.client.0.smithi087.stdout:9/586: creat db/d18/d1e/d28/d76/db7/fc1 x:0 0 0 2024-03-18T14:43:17.582 INFO:tasks.workunit.client.0.smithi087.stdout:3/546: dwrite d0/d3/f29 [0,4194304] 0 2024-03-18T14:43:17.582 INFO:tasks.workunit.client.0.smithi087.stdout:9/587: fdatasync db/d18/d1c/d69/f8c 0 2024-03-18T14:43:17.583 INFO:tasks.workunit.client.1.smithi129.stdout:7/311: dread d4/d2d/f3e [0,4194304] 0 2024-03-18T14:43:17.583 INFO:tasks.workunit.client.1.smithi129.stdout:7/312: dread - d4/d7/f43 zero size 2024-03-18T14:43:17.584 INFO:tasks.workunit.client.1.smithi129.stdout:7/313: write d4/d7/d8/f29 [54186,44846] 0 2024-03-18T14:43:17.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/496: dread d1/d6/d9/f51 [0,4194304] 0 2024-03-18T14:43:17.584 INFO:tasks.workunit.client.0.smithi087.stdout:4/453: mkdir d2/db/d3c/d90 0 2024-03-18T14:43:17.585 INFO:tasks.workunit.client.0.smithi087.stdout:4/454: fdatasync d2/db/de/f44 0 2024-03-18T14:43:17.586 INFO:tasks.workunit.client.0.smithi087.stdout:8/497: read d1/d6/d2f/d44/d4b/f4c [20266,104709] 0 2024-03-18T14:43:17.586 INFO:tasks.workunit.client.0.smithi087.stdout:6/477: rename d3/d7/d25/d62/d7c/d29/d22/d75/d92/d95 to d3/d7/d25/d62/d7c/da0 0 2024-03-18T14:43:17.587 INFO:tasks.workunit.client.0.smithi087.stdout:8/498: chown d1/d6/f1e 450610 1 2024-03-18T14:43:17.587 INFO:tasks.workunit.client.0.smithi087.stdout:6/478: stat d3/d7/d25/f41 0 2024-03-18T14:43:17.587 INFO:tasks.workunit.client.0.smithi087.stdout:1/549: rmdir d3/d1d/d1e/d20/d7a 39 2024-03-18T14:43:17.590 INFO:tasks.workunit.client.1.smithi129.stdout:1/303: rename d1/d18/l42 to d1/d18/d19/l5c 0 2024-03-18T14:43:17.591 INFO:tasks.workunit.client.1.smithi129.stdout:5/293: mknod d0/d32/d3a/d45/c5c 0 2024-03-18T14:43:17.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/588: mkdir db/d18/d1e/d28/dc2 0 2024-03-18T14:43:17.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/316: getdents d3/d30 0 2024-03-18T14:43:17.592 INFO:tasks.workunit.client.1.smithi129.stdout:5/294: dread - d0/df/f44 zero size 2024-03-18T14:43:17.593 INFO:tasks.workunit.client.0.smithi087.stdout:4/455: creat d2/db/d24/d30/f91 x:0 0 0 2024-03-18T14:43:17.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/336: getdents d0/d14/d28/d63 0 2024-03-18T14:43:17.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/337: stat d0/d14/l1c 0 2024-03-18T14:43:17.595 INFO:tasks.workunit.client.0.smithi087.stdout:1/550: dwrite d3/d1d/d79/f7f [4194304,4194304] 0 2024-03-18T14:43:17.595 INFO:tasks.workunit.client.1.smithi129.stdout:4/265: rename d0/d19/d46/d3e/d33/d43 to d0/d19/d46/d3e/d21/d4d 0 2024-03-18T14:43:17.595 INFO:tasks.workunit.client.0.smithi087.stdout:6/479: dwrite d3/d7/d25/d62/d7c/d29/f40 [0,4194304] 0 2024-03-18T14:43:17.596 INFO:tasks.workunit.client.1.smithi129.stdout:7/314: creat d4/d2d/d2e/d42/d58/f60 x:0 0 0 2024-03-18T14:43:17.600 INFO:tasks.workunit.client.1.smithi129.stdout:2/285: rename d7/d3f/f43 to d7/d1f/d20/d2a/f54 0 2024-03-18T14:43:17.601 INFO:tasks.workunit.client.0.smithi087.stdout:4/456: creat d2/d13/f92 x:0 0 0 2024-03-18T14:43:17.602 INFO:tasks.workunit.client.1.smithi129.stdout:9/293: dread d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:17.602 INFO:tasks.workunit.client.0.smithi087.stdout:3/547: dread d0/d3/df/f3f [0,4194304] 0 2024-03-18T14:43:17.603 INFO:tasks.workunit.client.1.smithi129.stdout:7/315: fdatasync d4/d2d/f2a 0 2024-03-18T14:43:17.603 INFO:tasks.workunit.client.0.smithi087.stdout:3/548: stat d0/d1c/d25/c51 0 2024-03-18T14:43:17.605 INFO:tasks.workunit.client.1.smithi129.stdout:6/317: truncate d3/d5/d46/f55 681550 0 2024-03-18T14:43:17.605 INFO:tasks.workunit.client.0.smithi087.stdout:5/525: sync 2024-03-18T14:43:17.607 INFO:tasks.workunit.client.1.smithi129.stdout:3/283: rename d4/d11/d1d/c3a to d4/dd/d1f/c5e 0 2024-03-18T14:43:17.608 INFO:tasks.workunit.client.0.smithi087.stdout:0/489: dwrite d0/d2/d4/f66 [0,4194304] 0 2024-03-18T14:43:17.609 INFO:tasks.workunit.client.1.smithi129.stdout:2/286: creat d7/d1f/d20/f55 x:0 0 0 2024-03-18T14:43:17.610 INFO:tasks.workunit.client.1.smithi129.stdout:2/287: readlink d7/d1f/d34/l13 0 2024-03-18T14:43:17.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/549: readlink d0/de/l24 0 2024-03-18T14:43:17.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/550: chown d0/d1c 1 1 2024-03-18T14:43:17.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/316: mkdir d4/d7/d38/d61 0 2024-03-18T14:43:17.612 INFO:tasks.workunit.client.1.smithi129.stdout:4/266: creat d0/d19/f4e x:0 0 0 2024-03-18T14:43:17.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/317: stat d4/d2d/d3a/f53 0 2024-03-18T14:43:17.613 INFO:tasks.workunit.client.1.smithi129.stdout:6/318: creat d3/d5/d46/f63 x:0 0 0 2024-03-18T14:43:17.615 INFO:tasks.workunit.client.0.smithi087.stdout:5/526: rmdir d13/d1b/d7e 39 2024-03-18T14:43:17.616 INFO:tasks.workunit.client.1.smithi129.stdout:0/338: rename d0/c19 to d0/d23/d29/c64 0 2024-03-18T14:43:17.616 INFO:tasks.workunit.client.1.smithi129.stdout:9/294: mkdir d0/db/d53 0 2024-03-18T14:43:17.617 INFO:tasks.workunit.client.0.smithi087.stdout:9/589: creat db/d18/d1e/fc3 x:0 0 0 2024-03-18T14:43:17.617 INFO:tasks.workunit.client.0.smithi087.stdout:4/457: creat d2/db/d3c/d90/f93 x:0 0 0 2024-03-18T14:43:17.617 INFO:tasks.workunit.client.0.smithi087.stdout:9/590: readlink db/d31/l5d 0 2024-03-18T14:43:17.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/339: write d0/d23/d35/d50/f52 [99114,108327] 0 2024-03-18T14:43:17.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/551: rename d3/d1d/d1e/d43/l68 to d3/d1d/d1e/d43/lac 0 2024-03-18T14:43:17.622 INFO:tasks.workunit.client.0.smithi087.stdout:0/490: dwrite d0/d49/f56 [0,4194304] 0 2024-03-18T14:43:17.622 INFO:tasks.workunit.client.0.smithi087.stdout:1/552: fsync d3/d1d/d1e/d20/f56 0 2024-03-18T14:43:17.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/304: dread d1/d18/f30 [0,4194304] 0 2024-03-18T14:43:17.624 INFO:tasks.workunit.client.1.smithi129.stdout:1/305: chown d1/f40 671207207 1 2024-03-18T14:43:17.624 INFO:tasks.workunit.client.1.smithi129.stdout:3/284: rename d4/dd/d15 to d4/dd/d1f/d5f 0 2024-03-18T14:43:17.624 INFO:tasks.workunit.client.0.smithi087.stdout:1/553: readlink d3/d1d/d1e/d43/d50/d72/l7b 0 2024-03-18T14:43:17.624 INFO:tasks.workunit.client.1.smithi129.stdout:0/340: fsync d0/d14/f20 0 2024-03-18T14:43:17.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/591: dwrite db/d18/d1e/d28/d76/d80/d91/fa8 [0,4194304] 0 2024-03-18T14:43:17.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/554: fsync d3/d1d/d1e/f36 0 2024-03-18T14:43:17.626 INFO:tasks.workunit.client.0.smithi087.stdout:1/555: fdatasync d3/d1d/d1f/f3f 0 2024-03-18T14:43:17.629 INFO:tasks.workunit.client.1.smithi129.stdout:5/295: write d0/dc/d18/f1d [2379442,122691] 0 2024-03-18T14:43:17.629 INFO:tasks.workunit.client.1.smithi129.stdout:8/301: sync 2024-03-18T14:43:17.629 INFO:tasks.workunit.client.0.smithi087.stdout:6/480: dread d3/d7/d25/d62/d7c/d29/f8a [0,4194304] 0 2024-03-18T14:43:17.629 INFO:tasks.workunit.client.0.smithi087.stdout:4/458: chown d2/db/de/c2e 9 1 2024-03-18T14:43:17.630 INFO:tasks.workunit.client.1.smithi129.stdout:5/296: write d0/d32/d34/f53 [1026401,73644] 0 2024-03-18T14:43:17.633 INFO:tasks.workunit.client.1.smithi129.stdout:8/302: dwrite d9/d11/d1a/d32/d41/f52 [0,4194304] 0 2024-03-18T14:43:17.634 INFO:tasks.workunit.client.0.smithi087.stdout:8/499: dread d1/d6/d2f/d44/d45/d71/f7e [4194304,4194304] 0 2024-03-18T14:43:17.634 INFO:tasks.workunit.client.0.smithi087.stdout:8/500: write d1/d6/d9/f8c [549353,4764] 0 2024-03-18T14:43:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/609: sync 2024-03-18T14:43:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:2/499: sync 2024-03-18T14:43:17.638 INFO:tasks.workunit.client.0.smithi087.stdout:7/610: fdatasync d1/d6/f18 0 2024-03-18T14:43:17.639 INFO:tasks.workunit.client.0.smithi087.stdout:9/592: rename db/f73 to db/d18/d1e/db4/fc4 0 2024-03-18T14:43:17.639 INFO:tasks.workunit.client.1.smithi129.stdout:7/318: creat d4/d7/d38/d49/f62 x:0 0 0 2024-03-18T14:43:17.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/500: dread d2/d4/d22/d2c/d3a/d40/d52/f5c [0,4194304] 0 2024-03-18T14:43:17.641 INFO:tasks.workunit.client.0.smithi087.stdout:6/481: chown d3/d7/d25/d62/d7c/d29/d22/d23/f33 197 1 2024-03-18T14:43:17.642 INFO:tasks.workunit.client.1.smithi129.stdout:6/319: creat d3/d38/d57/f64 x:0 0 0 2024-03-18T14:43:17.643 INFO:tasks.workunit.client.1.smithi129.stdout:1/306: symlink d1/d18/d19/d49/l5d 0 2024-03-18T14:43:17.643 INFO:tasks.workunit.client.1.smithi129.stdout:0/341: rmdir d0/d14/d53 39 2024-03-18T14:43:17.644 INFO:tasks.workunit.client.0.smithi087.stdout:8/501: creat d1/d6/d8d/f9f x:0 0 0 2024-03-18T14:43:17.645 INFO:tasks.workunit.client.1.smithi129.stdout:2/288: dread d7/f1e [0,4194304] 0 2024-03-18T14:43:17.645 INFO:tasks.workunit.client.1.smithi129.stdout:9/295: dread d0/f35 [0,4194304] 0 2024-03-18T14:43:17.645 INFO:tasks.workunit.client.1.smithi129.stdout:2/289: chown d7/f1e 32631 1 2024-03-18T14:43:17.648 INFO:tasks.workunit.client.1.smithi129.stdout:5/297: stat d0/f14 0 2024-03-18T14:43:17.649 INFO:tasks.workunit.client.0.smithi087.stdout:7/611: rmdir d1 39 2024-03-18T14:43:17.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/298: chown d0/df/f44 0 1 2024-03-18T14:43:17.650 INFO:tasks.workunit.client.1.smithi129.stdout:2/290: dread d7/d1f/d20/d2d/f2e [0,4194304] 0 2024-03-18T14:43:17.650 INFO:tasks.workunit.client.1.smithi129.stdout:6/320: mkdir d3/d30/de/d65 0 2024-03-18T14:43:17.651 INFO:tasks.workunit.client.0.smithi087.stdout:0/491: dread d0/d1a/d34/f5f [0,4194304] 0 2024-03-18T14:43:17.652 INFO:tasks.workunit.client.0.smithi087.stdout:0/492: write d0/d1a/d8c/fa4 [750045,107450] 0 2024-03-18T14:43:17.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/593: truncate f3 3053623 0 2024-03-18T14:43:17.653 INFO:tasks.workunit.client.0.smithi087.stdout:9/594: stat db/d18 0 2024-03-18T14:43:17.654 INFO:tasks.workunit.client.0.smithi087.stdout:5/527: truncate d13/d1b/d27/d28/f66 4692325 0 2024-03-18T14:43:17.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/285: mknod d4/d11/d34/d53/c60 0 2024-03-18T14:43:17.656 INFO:tasks.workunit.client.1.smithi129.stdout:0/342: symlink d0/d23/d35/d3b/l65 0 2024-03-18T14:43:17.657 INFO:tasks.workunit.client.0.smithi087.stdout:1/556: mknod d3/d1d/d1e/d43/cad 0 2024-03-18T14:43:17.658 INFO:tasks.workunit.client.1.smithi129.stdout:9/296: creat d0/db/d1f/d20/d26/d19/d29/d36/f54 x:0 0 0 2024-03-18T14:43:17.659 INFO:tasks.workunit.client.0.smithi087.stdout:3/551: dread d0/de/d30/d46/f61 [0,4194304] 0 2024-03-18T14:43:17.659 INFO:tasks.workunit.client.0.smithi087.stdout:3/552: fsync d0/f28 0 2024-03-18T14:43:17.659 INFO:tasks.workunit.client.1.smithi129.stdout:8/303: creat d9/d11/d1a/d32/d3a/d5d/f62 x:0 0 0 2024-03-18T14:43:17.659 INFO:tasks.workunit.client.1.smithi129.stdout:9/297: chown d0/f8 9 1 2024-03-18T14:43:17.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/553: dread - d0/f6d zero size 2024-03-18T14:43:17.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/554: stat d0/d3/df/f33 0 2024-03-18T14:43:17.660 INFO:tasks.workunit.client.1.smithi129.stdout:2/291: mknod d7/d1f/d20/c56 0 2024-03-18T14:43:17.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/555: stat d0/d3/d10/f75 0 2024-03-18T14:43:17.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/321: rename d3/d6/f18 to d3/d30/f66 0 2024-03-18T14:43:17.663 INFO:tasks.workunit.client.1.smithi129.stdout:7/319: truncate d4/d7/d8/f22 1770502 0 2024-03-18T14:43:17.664 INFO:tasks.workunit.client.1.smithi129.stdout:4/267: dread d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:17.666 INFO:tasks.workunit.client.0.smithi087.stdout:8/502: symlink d1/d6/d2f/d44/d45/d72/la0 0 2024-03-18T14:43:17.667 INFO:tasks.workunit.client.1.smithi129.stdout:0/343: dwrite d0/d23/d35/d3b/f57 [0,4194304] 0 2024-03-18T14:43:17.669 INFO:tasks.workunit.client.1.smithi129.stdout:1/307: truncate d1/f46 770874 0 2024-03-18T14:43:17.669 INFO:tasks.workunit.client.1.smithi129.stdout:1/308: fdatasync d1/d2/f4b 0 2024-03-18T14:43:17.670 INFO:tasks.workunit.client.0.smithi087.stdout:4/459: rename d2/db/c76 to d2/db/de/d8b/c94 0 2024-03-18T14:43:17.671 INFO:tasks.workunit.client.1.smithi129.stdout:6/322: rmdir d3/d30 39 2024-03-18T14:43:17.671 INFO:tasks.workunit.client.1.smithi129.stdout:5/299: link d0/dc/l3f d0/dc/d22/l5d 0 2024-03-18T14:43:17.673 INFO:tasks.workunit.client.0.smithi087.stdout:9/595: creat db/d18/d1e/d28/d76/da7/fc5 x:0 0 0 2024-03-18T14:43:17.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/528: dread - d13/d1b/d7e/f92 zero size 2024-03-18T14:43:17.674 INFO:tasks.workunit.client.1.smithi129.stdout:2/292: dwrite d7/f1e [0,4194304] 0 2024-03-18T14:43:17.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/529: dread - d13/d1b/d30/f49 zero size 2024-03-18T14:43:17.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/530: readlink d13/d1b/d27/d35/l44 0 2024-03-18T14:43:17.675 INFO:tasks.workunit.client.1.smithi129.stdout:9/298: write d0/db/d1f/f23 [303587,5956] 0 2024-03-18T14:43:17.677 INFO:tasks.workunit.client.0.smithi087.stdout:1/557: creat d3/d1d/d45/fae x:0 0 0 2024-03-18T14:43:17.677 INFO:tasks.workunit.client.0.smithi087.stdout:6/482: creat d3/d7/d25/d62/d8b/fa1 x:0 0 0 2024-03-18T14:43:17.677 INFO:tasks.workunit.client.1.smithi129.stdout:7/320: write d4/d7/d8/f32 [2852012,35481] 0 2024-03-18T14:43:17.679 INFO:tasks.workunit.client.0.smithi087.stdout:8/503: mknod d1/d6/d2f/d44/d45/ca1 0 2024-03-18T14:43:17.680 INFO:tasks.workunit.client.1.smithi129.stdout:8/304: readlink d9/d11/d55/l58 0 2024-03-18T14:43:17.681 INFO:tasks.workunit.client.1.smithi129.stdout:8/305: write d9/d11/d1a/f4b [1018593,63300] 0 2024-03-18T14:43:17.683 INFO:tasks.workunit.client.1.smithi129.stdout:6/323: unlink d3/d5/f34 0 2024-03-18T14:43:17.686 INFO:tasks.workunit.client.1.smithi129.stdout:9/299: mknod d0/db/d1f/d20/d4a/d3e/c55 0 2024-03-18T14:43:17.687 INFO:tasks.workunit.client.1.smithi129.stdout:4/268: symlink d0/d9/d4c/l4f 0 2024-03-18T14:43:17.688 INFO:tasks.workunit.client.1.smithi129.stdout:0/344: mknod d0/d23/d35/c66 0 2024-03-18T14:43:17.689 INFO:tasks.workunit.client.0.smithi087.stdout:0/493: write d0/d1a/d80/f95 [242420,124458] 0 2024-03-18T14:43:17.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/558: mknod d3/d1d/d1e/d43/da3/caf 0 2024-03-18T14:43:17.693 INFO:tasks.workunit.client.0.smithi087.stdout:6/483: mknod d3/d7/d25/d62/d7c/d29/d22/d61/ca2 0 2024-03-18T14:43:17.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/494: dwrite d0/f6c [0,4194304] 0 2024-03-18T14:43:17.694 INFO:tasks.workunit.client.1.smithi129.stdout:4/269: unlink d0/d19/f1f 0 2024-03-18T14:43:17.695 INFO:tasks.workunit.client.0.smithi087.stdout:8/504: mkdir d1/d6/d9/d5d/d87/da2 0 2024-03-18T14:43:17.695 INFO:tasks.workunit.client.1.smithi129.stdout:1/309: truncate d1/d18/d19/f37 1365969 0 2024-03-18T14:43:17.696 INFO:tasks.workunit.client.1.smithi129.stdout:1/310: readlink d1/d18/l39 0 2024-03-18T14:43:17.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/484: chown d3/d7/d25/d62/d7c/d29/d22/d47/d87/c89 382468 1 2024-03-18T14:43:17.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/460: rmdir d2/d13/d28 39 2024-03-18T14:43:17.698 INFO:tasks.workunit.client.0.smithi087.stdout:8/505: write d1/d6/d9/f60 [1742216,48562] 0 2024-03-18T14:43:17.699 INFO:tasks.workunit.client.0.smithi087.stdout:5/531: creat d13/d1b/d70/da8/fb2 x:0 0 0 2024-03-18T14:43:17.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/461: chown d2/l77 0 1 2024-03-18T14:43:17.700 INFO:tasks.workunit.client.1.smithi129.stdout:7/321: truncate d4/d7/d8/d3b/f40 301843 0 2024-03-18T14:43:17.700 INFO:tasks.workunit.client.1.smithi129.stdout:9/300: write d0/db/f18 [1008596,31789] 0 2024-03-18T14:43:17.701 INFO:tasks.workunit.client.0.smithi087.stdout:7/612: creat d1/fdb x:0 0 0 2024-03-18T14:43:17.701 INFO:tasks.workunit.client.1.smithi129.stdout:5/300: truncate d0/df/f59 882767 0 2024-03-18T14:43:17.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/506: chown d1/d6/d2f/d44/d4b/l56 1717 1 2024-03-18T14:43:17.701 INFO:tasks.workunit.client.0.smithi087.stdout:5/532: chown d13/d1b/d30/d6e/l7c 1 1 2024-03-18T14:43:17.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/495: dwrite d0/d1a/d7b/d2a/f52 [0,4194304] 0 2024-03-18T14:43:17.702 INFO:tasks.workunit.client.1.smithi129.stdout:6/324: fdatasync d3/d30/f66 0 2024-03-18T14:43:17.703 INFO:tasks.workunit.client.0.smithi087.stdout:4/462: chown d2/db/d24/d30/d56/c5e 353418543 1 2024-03-18T14:43:17.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/293: creat d7/d1f/f57 x:0 0 0 2024-03-18T14:43:17.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/294: readlink d7/d1c/l2f 0 2024-03-18T14:43:17.704 INFO:tasks.workunit.client.0.smithi087.stdout:7/613: stat d1/d6/d29/d2f/d68/d65/d72/cb4 0 2024-03-18T14:43:17.706 INFO:tasks.workunit.client.1.smithi129.stdout:8/306: creat d9/d11/d1a/f63 x:0 0 0 2024-03-18T14:43:17.707 INFO:tasks.workunit.client.1.smithi129.stdout:8/307: fdatasync d9/d11/d18/f35 0 2024-03-18T14:43:17.708 INFO:tasks.workunit.client.0.smithi087.stdout:2/501: rename d2/f1e to d2/d4/d22/d2c/d3a/d49/fa3 0 2024-03-18T14:43:17.708 INFO:tasks.workunit.client.0.smithi087.stdout:6/485: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f30 [0,4194304] 0 2024-03-18T14:43:17.710 INFO:tasks.workunit.client.0.smithi087.stdout:3/556: getdents d0/d3/d10 0 2024-03-18T14:43:17.711 INFO:tasks.workunit.client.1.smithi129.stdout:9/301: mknod d0/db/d2e/c56 0 2024-03-18T14:43:17.713 INFO:tasks.workunit.client.0.smithi087.stdout:9/596: truncate db/d18/d3a/f47 3656683 0 2024-03-18T14:43:17.714 INFO:tasks.workunit.client.1.smithi129.stdout:6/325: symlink d3/d30/de/d49/l67 0 2024-03-18T14:43:17.715 INFO:tasks.workunit.client.0.smithi087.stdout:0/496: dwrite d0/d1a/d7b/d26/f2c [0,4194304] 0 2024-03-18T14:43:17.716 INFO:tasks.workunit.client.0.smithi087.stdout:4/463: dwrite d2/db/d24/d30/d56/f8c [0,4194304] 0 2024-03-18T14:43:17.717 INFO:tasks.workunit.client.1.smithi129.stdout:4/270: truncate d0/d9/f20 855146 0 2024-03-18T14:43:17.718 INFO:tasks.workunit.client.0.smithi087.stdout:7/614: mkdir d1/d6/d16/dc/ddc 0 2024-03-18T14:43:17.718 INFO:tasks.workunit.client.1.smithi129.stdout:1/311: mknod d1/d18/d19/c5e 0 2024-03-18T14:43:17.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/486: dwrite d3/f19 [0,4194304] 0 2024-03-18T14:43:17.719 INFO:tasks.workunit.client.1.smithi129.stdout:6/326: dwrite d3/d30/de/f22 [0,4194304] 0 2024-03-18T14:43:17.720 INFO:tasks.workunit.client.0.smithi087.stdout:0/497: chown d0/d2/d4/d19/f25 148891 1 2024-03-18T14:43:17.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/327: write d3/d6/f4e [1996087,47166] 0 2024-03-18T14:43:17.720 INFO:tasks.workunit.client.1.smithi129.stdout:1/312: read d1/d2/f33 [155781,100964] 0 2024-03-18T14:43:17.721 INFO:tasks.workunit.client.1.smithi129.stdout:3/286: sync 2024-03-18T14:43:17.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/557: rename d0/d1c/f1e to d0/d3/df/d9a/f9b 0 2024-03-18T14:43:17.726 INFO:tasks.workunit.client.1.smithi129.stdout:8/308: creat d9/d11/d1a/d32/d3a/f64 x:0 0 0 2024-03-18T14:43:17.726 INFO:tasks.workunit.client.1.smithi129.stdout:6/328: dwrite d3/d38/d57/f64 [0,4194304] 0 2024-03-18T14:43:17.727 INFO:tasks.workunit.client.1.smithi129.stdout:8/309: chown d9/d11/d1a/d14/d60 109377 1 2024-03-18T14:43:17.727 INFO:tasks.workunit.client.0.smithi087.stdout:5/533: getdents d13/d1b/d27/d35/da7 0 2024-03-18T14:43:17.729 INFO:tasks.workunit.client.0.smithi087.stdout:6/487: mknod d3/d7/d25/d62/d7c/d46/ca3 0 2024-03-18T14:43:17.730 INFO:tasks.workunit.client.1.smithi129.stdout:6/329: dwrite d3/f3c [0,4194304] 0 2024-03-18T14:43:17.731 INFO:tasks.workunit.client.0.smithi087.stdout:9/597: dread db/d31/f42 [0,4194304] 0 2024-03-18T14:43:17.733 INFO:tasks.workunit.client.0.smithi087.stdout:7/615: rename d1/d6/d16/l3a to d1/d6/d29/d2f/d68/dbf/ldd 0 2024-03-18T14:43:17.734 INFO:tasks.workunit.client.1.smithi129.stdout:7/322: dread d4/d7/d8/f20 [0,4194304] 0 2024-03-18T14:43:17.734 INFO:tasks.workunit.client.0.smithi087.stdout:0/498: dwrite d0/d1a/d34/f5f [0,4194304] 0 2024-03-18T14:43:17.735 INFO:tasks.workunit.client.0.smithi087.stdout:1/559: dread d3/d1d/f21 [0,4194304] 0 2024-03-18T14:43:17.735 INFO:tasks.workunit.client.0.smithi087.stdout:0/499: chown d0/d2/d4/d19/d5a/f7d 5 1 2024-03-18T14:43:17.736 INFO:tasks.workunit.client.0.smithi087.stdout:0/500: chown d0/d1a/d7b/d2a/d9a 9709 1 2024-03-18T14:43:17.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/558: mknod d0/d3/d4f/c9c 0 2024-03-18T14:43:17.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/560: dwrite d3/d1d/d1f/d34/f76 [0,4194304] 0 2024-03-18T14:43:17.740 INFO:tasks.workunit.client.0.smithi087.stdout:8/507: link d1/d6/d2f/d44/d45/ca1 d1/d6/d2f/d44/d45/d72/d7f/d83/ca3 0 2024-03-18T14:43:17.740 INFO:tasks.workunit.client.0.smithi087.stdout:2/502: truncate d2/d4/d22/f62 394634 0 2024-03-18T14:43:17.740 INFO:tasks.workunit.client.0.smithi087.stdout:4/464: mkdir d2/db/d24/d30/d8a/d95 0 2024-03-18T14:43:17.742 INFO:tasks.workunit.client.1.smithi129.stdout:9/302: mkdir d0/db/d1f/d4c/d57 0 2024-03-18T14:43:17.742 INFO:tasks.workunit.client.0.smithi087.stdout:1/561: fdatasync d3/d1d/d1e/d43/d50/d72/f9d 0 2024-03-18T14:43:17.745 INFO:tasks.workunit.client.1.smithi129.stdout:5/301: sync 2024-03-18T14:43:17.746 INFO:tasks.workunit.client.1.smithi129.stdout:8/310: unlink d9/d11/d18/c2a 0 2024-03-18T14:43:17.746 INFO:tasks.workunit.client.1.smithi129.stdout:6/330: mkdir d3/d30/de/d49/d68 0 2024-03-18T14:43:17.747 INFO:tasks.workunit.client.1.smithi129.stdout:7/323: creat d4/d7/f63 x:0 0 0 2024-03-18T14:43:17.748 INFO:tasks.workunit.client.0.smithi087.stdout:5/534: unlink d13/f3f 0 2024-03-18T14:43:17.748 INFO:tasks.workunit.client.0.smithi087.stdout:6/488: symlink d3/d7/d25/d62/d7c/d29/d22/la4 0 2024-03-18T14:43:17.750 INFO:tasks.workunit.client.1.smithi129.stdout:3/287: link d4/dd/d1f/f4b d4/d11/d1d/d27/f61 0 2024-03-18T14:43:17.751 INFO:tasks.workunit.client.1.smithi129.stdout:2/295: getdents d7/d1f/d20/d2b 0 2024-03-18T14:43:17.752 INFO:tasks.workunit.client.1.smithi129.stdout:2/296: write d7/d1f/d20/d2a/f48 [783238,90801] 0 2024-03-18T14:43:17.754 INFO:tasks.workunit.client.0.smithi087.stdout:3/559: mknod d0/de/d30/d8e/c9d 0 2024-03-18T14:43:17.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/501: read d0/d1a/d80/d88/f2e [2489416,97441] 0 2024-03-18T14:43:17.755 INFO:tasks.workunit.client.1.smithi129.stdout:0/345: truncate d0/d14/f2d 165728 0 2024-03-18T14:43:17.756 INFO:tasks.workunit.client.0.smithi087.stdout:7/616: dread d1/f76 [0,4194304] 0 2024-03-18T14:43:17.758 INFO:tasks.workunit.client.0.smithi087.stdout:9/598: rename db/d18/d1e/d28/f94 to db/d18/fc6 0 2024-03-18T14:43:17.759 INFO:tasks.workunit.client.1.smithi129.stdout:5/302: creat d0/dc/d18/d2b/f5e x:0 0 0 2024-03-18T14:43:17.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/535: read d13/d1b/d27/d28/f78 [110005,92094] 0 2024-03-18T14:43:17.763 INFO:tasks.workunit.client.0.smithi087.stdout:6/489: creat d3/d7/d25/d9f/fa5 x:0 0 0 2024-03-18T14:43:17.765 INFO:tasks.workunit.client.1.smithi129.stdout:7/324: rename d4/d7/f43 to d4/d7/f64 0 2024-03-18T14:43:17.766 INFO:tasks.workunit.client.0.smithi087.stdout:9/599: unlink c4 0 2024-03-18T14:43:17.769 INFO:tasks.workunit.client.0.smithi087.stdout:8/508: rename d1/d6/d2f/d44/d45/d71/f7e to d1/d6/d2f/d44/d45/fa4 0 2024-03-18T14:43:17.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/562: creat d3/d1d/d1f/fb0 x:0 0 0 2024-03-18T14:43:17.770 INFO:tasks.workunit.client.1.smithi129.stdout:4/271: dread d0/f13 [0,4194304] 0 2024-03-18T14:43:17.771 INFO:tasks.workunit.client.1.smithi129.stdout:1/313: rmdir d1 39 2024-03-18T14:43:17.771 INFO:tasks.workunit.client.1.smithi129.stdout:4/272: read - d0/d19/f4e zero size 2024-03-18T14:43:17.773 INFO:tasks.workunit.client.1.smithi129.stdout:6/331: dread - d3/d30/df/d28/f54 zero size 2024-03-18T14:43:17.775 INFO:tasks.workunit.client.1.smithi129.stdout:8/311: symlink d9/d11/d1a/d32/d41/l65 0 2024-03-18T14:43:17.775 INFO:tasks.workunit.client.0.smithi087.stdout:4/465: getdents d2/db 0 2024-03-18T14:43:17.776 INFO:tasks.workunit.client.1.smithi129.stdout:8/312: dread - d9/d11/d1a/d32/d3a/f64 zero size 2024-03-18T14:43:17.777 INFO:tasks.workunit.client.1.smithi129.stdout:3/288: link d4/dd/d1f/f26 d4/d11/f62 0 2024-03-18T14:43:17.777 INFO:tasks.workunit.client.1.smithi129.stdout:3/289: stat d4/dd/d41/c59 0 2024-03-18T14:43:17.780 INFO:tasks.workunit.client.1.smithi129.stdout:7/325: creat d4/d7/d38/d49/f65 x:0 0 0 2024-03-18T14:43:17.780 INFO:tasks.workunit.client.1.smithi129.stdout:7/326: fsync d4/d7/d8/f29 0 2024-03-18T14:43:17.781 INFO:tasks.workunit.client.1.smithi129.stdout:7/327: chown d4/d7/f63 30743052 1 2024-03-18T14:43:17.781 INFO:tasks.workunit.client.1.smithi129.stdout:7/328: write d4/d7/f31 [1231183,3791] 0 2024-03-18T14:43:17.782 INFO:tasks.workunit.client.1.smithi129.stdout:7/329: chown d4/d2d/d3a 223187834 1 2024-03-18T14:43:17.782 INFO:tasks.workunit.client.0.smithi087.stdout:1/563: creat d3/d1d/d1f/d34/d38/fb1 x:0 0 0 2024-03-18T14:43:17.784 INFO:tasks.workunit.client.1.smithi129.stdout:1/314: write d1/d18/f21 [2232848,85250] 0 2024-03-18T14:43:17.789 INFO:tasks.workunit.client.1.smithi129.stdout:4/273: write d0/d9/f20 [1101653,64285] 0 2024-03-18T14:43:17.790 INFO:tasks.workunit.client.1.smithi129.stdout:9/303: dwrite d0/db/d1f/d20/d26/d19/d29/f2d [0,4194304] 0 2024-03-18T14:43:17.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/503: truncate d2/d4/f16 1412685 0 2024-03-18T14:43:17.797 INFO:tasks.workunit.client.1.smithi129.stdout:2/297: creat d7/f58 x:0 0 0 2024-03-18T14:43:17.797 INFO:tasks.workunit.client.1.smithi129.stdout:2/298: write f0 [317083,88858] 0 2024-03-18T14:43:17.798 INFO:tasks.workunit.client.0.smithi087.stdout:2/504: dread d2/d4/d22/d24/d65/f83 [0,4194304] 0 2024-03-18T14:43:17.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/502: link d0/d1a/d34/c97 d0/d2/d4/d19/d24/d5d/cb1 0 2024-03-18T14:43:17.801 INFO:tasks.workunit.client.1.smithi129.stdout:3/290: write d4/dd/f32 [592540,28125] 0 2024-03-18T14:43:17.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/536: fdatasync d13/d1b/d27/d35/d3b/fa4 0 2024-03-18T14:43:17.805 INFO:tasks.workunit.client.1.smithi129.stdout:0/346: creat d0/d23/f67 x:0 0 0 2024-03-18T14:43:17.806 INFO:tasks.workunit.client.1.smithi129.stdout:5/303: fdatasync d0/df/f59 0 2024-03-18T14:43:17.807 INFO:tasks.workunit.client.0.smithi087.stdout:8/509: unlink d1/c82 0 2024-03-18T14:43:17.809 INFO:tasks.workunit.client.0.smithi087.stdout:1/564: rmdir d3/d1d/d1f 39 2024-03-18T14:43:17.811 INFO:tasks.workunit.client.1.smithi129.stdout:9/304: dwrite d0/db/d1f/d20/d26/d19/d29/f2d [4194304,4194304] 0 2024-03-18T14:43:17.811 INFO:tasks.workunit.client.1.smithi129.stdout:2/299: chown d7/d1f/d20/d36/f38 109 1 2024-03-18T14:43:17.815 INFO:tasks.workunit.client.0.smithi087.stdout:1/565: dwrite d3/d1d/d1e/d20/f85 [0,4194304] 0 2024-03-18T14:43:17.815 INFO:tasks.workunit.client.0.smithi087.stdout:7/617: getdents d1/d6/da/d59/dbe 0 2024-03-18T14:43:17.815 INFO:tasks.workunit.client.1.smithi129.stdout:7/330: write d4/d7/d8/f22 [2584457,103444] 0 2024-03-18T14:43:17.815 INFO:tasks.workunit.client.1.smithi129.stdout:6/332: link d3/c21 d3/d30/de/c69 0 2024-03-18T14:43:17.816 INFO:tasks.workunit.client.1.smithi129.stdout:6/333: fsync d3/f3c 0 2024-03-18T14:43:17.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/560: dwrite d0/d1c/d25/f7b [0,4194304] 0 2024-03-18T14:43:17.816 INFO:tasks.workunit.client.1.smithi129.stdout:6/334: readlink d3/d30/l3e 0 2024-03-18T14:43:17.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/490: rename d3/d7/d25/l71 to d3/d7/d25/d62/d7c/d29/d22/la6 0 2024-03-18T14:43:17.817 INFO:tasks.workunit.client.1.smithi129.stdout:5/304: dread d0/fb [0,4194304] 0 2024-03-18T14:43:17.817 INFO:tasks.workunit.client.1.smithi129.stdout:5/305: chown d0/dc/d1a 80817 1 2024-03-18T14:43:17.818 INFO:tasks.workunit.client.0.smithi087.stdout:5/537: chown d13/l55 0 1 2024-03-18T14:43:17.819 INFO:tasks.workunit.client.0.smithi087.stdout:4/466: unlink d2/db/d24/d30/f4a 0 2024-03-18T14:43:17.820 INFO:tasks.workunit.client.0.smithi087.stdout:4/467: readlink d2/db/de/l6d 0 2024-03-18T14:43:17.822 INFO:tasks.workunit.client.1.smithi129.stdout:1/315: rename d1/d18/d19/f43 to d1/f5f 0 2024-03-18T14:43:17.823 INFO:tasks.workunit.client.0.smithi087.stdout:2/505: symlink d2/d4/d22/la4 0 2024-03-18T14:43:17.824 INFO:tasks.workunit.client.0.smithi087.stdout:2/506: readlink d2/d4/d22/l69 0 2024-03-18T14:43:17.824 INFO:tasks.workunit.client.1.smithi129.stdout:8/313: getdents d9/d11/d53 0 2024-03-18T14:43:17.824 INFO:tasks.workunit.client.1.smithi129.stdout:8/314: write d9/d11/d18/f3f [1501318,99975] 0 2024-03-18T14:43:17.825 INFO:tasks.workunit.client.1.smithi129.stdout:8/315: fdatasync d9/d11/d1a/d32/d3a/d5d/f62 0 2024-03-18T14:43:17.827 INFO:tasks.workunit.client.1.smithi129.stdout:5/306: mkdir d0/dc/d18/d5f 0 2024-03-18T14:43:17.828 INFO:tasks.workunit.client.1.smithi129.stdout:5/307: stat d0/fb 0 2024-03-18T14:43:17.830 INFO:tasks.workunit.client.1.smithi129.stdout:8/316: dwrite d9/d11/d1a/d14/f5e [0,4194304] 0 2024-03-18T14:43:17.831 INFO:tasks.workunit.client.1.smithi129.stdout:9/305: creat d0/db/d53/f58 x:0 0 0 2024-03-18T14:43:17.833 INFO:tasks.workunit.client.1.smithi129.stdout:3/291: link d4/dd/d1f/d5f/f5b d4/d11/d34/d3c/d3f/f63 0 2024-03-18T14:43:17.833 INFO:tasks.workunit.client.1.smithi129.stdout:5/308: dread d0/df/f3c [0,4194304] 0 2024-03-18T14:43:17.837 INFO:tasks.workunit.client.1.smithi129.stdout:4/274: sync 2024-03-18T14:43:17.839 INFO:tasks.workunit.client.1.smithi129.stdout:2/300: creat d7/f59 x:0 0 0 2024-03-18T14:43:17.843 INFO:tasks.workunit.client.1.smithi129.stdout:9/306: mkdir d0/db/d1f/d20/d25/d59 0 2024-03-18T14:43:17.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/292: rmdir d4/d11/d34/d3c/d3f 39 2024-03-18T14:43:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:0/503: mknod d0/d1a/d7b/d2a/d9a/cb2 0 2024-03-18T14:43:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:1/566: symlink d3/d1d/d1e/d43/d9b/lb2 0 2024-03-18T14:43:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:9/600: rename db/d18/da6 to db/d18/d1e/d7e/dc7 0 2024-03-18T14:43:17.847 INFO:tasks.workunit.client.0.smithi087.stdout:6/491: creat d3/d7/d25/d62/d7c/da0/fa7 x:0 0 0 2024-03-18T14:43:17.848 INFO:tasks.workunit.client.0.smithi087.stdout:8/510: write d1/f2c [713175,103631] 0 2024-03-18T14:43:17.850 INFO:tasks.workunit.client.1.smithi129.stdout:0/347: link d0/d14/d3a/d4a/l59 d0/l68 0 2024-03-18T14:43:17.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/567: chown d3/d3c/f8c 26480 1 2024-03-18T14:43:17.851 INFO:tasks.workunit.client.0.smithi087.stdout:2/507: rename d2/d4/c67 to d2/d44/d72/ca5 0 2024-03-18T14:43:17.853 INFO:tasks.workunit.client.0.smithi087.stdout:9/601: rmdir db/d18/d3a 39 2024-03-18T14:43:17.853 INFO:tasks.workunit.client.0.smithi087.stdout:8/511: dwrite d1/d6/d2f/d44/d45/d50/f66 [0,4194304] 0 2024-03-18T14:43:17.854 INFO:tasks.workunit.client.0.smithi087.stdout:9/602: fdatasync db/d18/d1c/f27 0 2024-03-18T14:43:17.854 INFO:tasks.workunit.client.0.smithi087.stdout:9/603: dread - db/d18/fc6 zero size 2024-03-18T14:43:17.855 INFO:tasks.workunit.client.0.smithi087.stdout:7/618: truncate d1/fdb 501020 0 2024-03-18T14:43:17.856 INFO:tasks.workunit.client.0.smithi087.stdout:9/604: readlink db/d18/d1c/d69/d6f/l82 0 2024-03-18T14:43:17.856 INFO:tasks.workunit.client.1.smithi129.stdout:5/309: dread d0/dc/d18/d2b/f57 [0,4194304] 0 2024-03-18T14:43:17.856 INFO:tasks.workunit.client.1.smithi129.stdout:1/316: creat d1/f60 x:0 0 0 2024-03-18T14:43:17.857 INFO:tasks.workunit.client.0.smithi087.stdout:5/538: truncate d13/d1b/d30/d6e/d88/f99 111369 0 2024-03-18T14:43:17.858 INFO:tasks.workunit.client.0.smithi087.stdout:5/539: dread - d13/d1b/d30/d6e/fa3 zero size 2024-03-18T14:43:17.858 INFO:tasks.workunit.client.1.smithi129.stdout:6/335: truncate d3/d5/f27 6901311 0 2024-03-18T14:43:17.860 INFO:tasks.workunit.client.1.smithi129.stdout:9/307: mknod d0/db/d1f/d20/d4a/c5a 0 2024-03-18T14:43:17.861 INFO:tasks.workunit.client.1.smithi129.stdout:9/308: write d0/db/d1f/f30 [1363298,53182] 0 2024-03-18T14:43:17.862 INFO:tasks.workunit.client.1.smithi129.stdout:0/348: truncate d0/d14/f5f 377292 0 2024-03-18T14:43:17.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/317: dwrite d1/d35/f45 [0,4194304] 0 2024-03-18T14:43:17.862 INFO:tasks.workunit.client.1.smithi129.stdout:7/331: link d4/d2d/f2a d4/f66 0 2024-03-18T14:43:17.864 INFO:tasks.workunit.client.1.smithi129.stdout:7/332: write d4/d7/d8/f32 [4062595,11306] 0 2024-03-18T14:43:17.865 INFO:tasks.workunit.client.1.smithi129.stdout:8/317: dread d9/d11/f3b [0,4194304] 0 2024-03-18T14:43:17.866 INFO:tasks.workunit.client.0.smithi087.stdout:4/468: link d2/db/d82/f89 d2/f96 0 2024-03-18T14:43:17.866 INFO:tasks.workunit.client.1.smithi129.stdout:6/336: fsync d3/d5/d2b/f31 0 2024-03-18T14:43:17.867 INFO:tasks.workunit.client.0.smithi087.stdout:8/512: dwrite d1/d6/d2f/d44/d45/f70 [0,4194304] 0 2024-03-18T14:43:17.867 INFO:tasks.workunit.client.0.smithi087.stdout:4/469: stat d2/f5b 0 2024-03-18T14:43:17.867 INFO:tasks.workunit.client.0.smithi087.stdout:0/504: creat d0/d2/d4/d19/d24/da3/da8/fb3 x:0 0 0 2024-03-18T14:43:17.869 INFO:tasks.workunit.client.0.smithi087.stdout:9/605: creat db/d18/d1e/d28/d76/db7/fc8 x:0 0 0 2024-03-18T14:43:17.869 INFO:tasks.workunit.client.0.smithi087.stdout:1/568: mknod d3/d1d/cb3 0 2024-03-18T14:43:17.871 INFO:tasks.workunit.client.0.smithi087.stdout:2/508: link d2/fa1 d2/d4/d22/d24/d65/d7f/fa6 0 2024-03-18T14:43:17.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/619: dwrite d1/d6/f1d [0,4194304] 0 2024-03-18T14:43:17.872 INFO:tasks.workunit.client.0.smithi087.stdout:5/540: creat d13/d1b/d27/d35/fb3 x:0 0 0 2024-03-18T14:43:17.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/541: chown d13/d1b/d30/d6e/f80 1082317 1 2024-03-18T14:43:17.874 INFO:tasks.workunit.client.1.smithi129.stdout:9/309: unlink d0/db/d1f/f30 0 2024-03-18T14:43:17.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/542: dread - d13/d1b/d7e/f92 zero size 2024-03-18T14:43:17.875 INFO:tasks.workunit.client.0.smithi087.stdout:0/505: unlink d0/d1a/d7b/d2a/l76 0 2024-03-18T14:43:17.875 INFO:tasks.workunit.client.1.smithi129.stdout:7/333: chown d4/d7/ff 4 1 2024-03-18T14:43:17.875 INFO:tasks.workunit.client.0.smithi087.stdout:5/543: fsync d13/d1b/d30/d6e/f80 0 2024-03-18T14:43:17.877 INFO:tasks.workunit.client.0.smithi087.stdout:2/509: chown d2/d44/d72/c7d 166891 1 2024-03-18T14:43:17.878 INFO:tasks.workunit.client.1.smithi129.stdout:7/334: dread d4/d7/f25 [0,4194304] 0 2024-03-18T14:43:17.878 INFO:tasks.workunit.client.0.smithi087.stdout:4/470: symlink d2/d13/l97 0 2024-03-18T14:43:17.879 INFO:tasks.workunit.client.1.smithi129.stdout:2/301: sync 2024-03-18T14:43:17.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/606: dwrite db/d18/d1e/db4/fc4 [0,4194304] 0 2024-03-18T14:43:17.880 INFO:tasks.workunit.client.1.smithi129.stdout:2/302: chown d7/d1c/f26 464448 1 2024-03-18T14:43:17.881 INFO:tasks.workunit.client.1.smithi129.stdout:3/293: write d4/dd/d1f/f4b [693482,117381] 0 2024-03-18T14:43:17.882 INFO:tasks.workunit.client.0.smithi087.stdout:2/510: read d2/d4/d22/d24/f2a [91814,47363] 0 2024-03-18T14:43:17.882 INFO:tasks.workunit.client.0.smithi087.stdout:2/511: stat d2/d44/d72/c7d 0 2024-03-18T14:43:17.883 INFO:tasks.workunit.client.1.smithi129.stdout:4/275: getdents d0/d19/d46/d3e/d21 0 2024-03-18T14:43:17.885 INFO:tasks.workunit.client.0.smithi087.stdout:0/506: rename d0/d2/d4/d19/d62/la5 to d0/d1a/lb4 0 2024-03-18T14:43:17.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/544: mkdir d13/d1b/d30/d6e/d88/db4 0 2024-03-18T14:43:17.886 INFO:tasks.workunit.client.0.smithi087.stdout:1/569: mkdir d3/d1d/d1e/d20/d7a/db4 0 2024-03-18T14:43:17.887 INFO:tasks.workunit.client.0.smithi087.stdout:1/570: write d3/d1d/d1e/d20/d7a/fa4 [862797,86495] 0 2024-03-18T14:43:17.887 INFO:tasks.workunit.client.1.smithi129.stdout:9/310: rename d0/db/l17 to d0/d15/l5b 0 2024-03-18T14:43:17.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/607: mknod db/d18/d1c/d69/cc9 0 2024-03-18T14:43:17.892 INFO:tasks.workunit.client.0.smithi087.stdout:9/608: chown db/d31/f8d 1 1 2024-03-18T14:43:17.892 INFO:tasks.workunit.client.1.smithi129.stdout:0/349: creat d0/d23/d35/f69 x:0 0 0 2024-03-18T14:43:17.893 INFO:tasks.workunit.client.1.smithi129.stdout:7/335: creat d4/d2d/d2e/d42/d58/f67 x:0 0 0 2024-03-18T14:43:17.894 INFO:tasks.workunit.client.1.smithi129.stdout:7/336: chown d4/d2d/d2e/d42 885286079 1 2024-03-18T14:43:17.895 INFO:tasks.workunit.client.1.smithi129.stdout:1/318: creat d1/d18/d19/f61 x:0 0 0 2024-03-18T14:43:17.895 INFO:tasks.workunit.client.0.smithi087.stdout:3/561: sync 2024-03-18T14:43:17.896 INFO:tasks.workunit.client.1.smithi129.stdout:4/276: creat d0/d3c/f50 x:0 0 0 2024-03-18T14:43:17.897 INFO:tasks.workunit.client.1.smithi129.stdout:5/310: getdents d0/dc/d18 0 2024-03-18T14:43:17.899 INFO:tasks.workunit.client.1.smithi129.stdout:6/337: creat d3/f6a x:0 0 0 2024-03-18T14:43:17.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/562: dwrite d0/d3/d10/d7f/f82 [0,4194304] 0 2024-03-18T14:43:17.900 INFO:tasks.workunit.client.0.smithi087.stdout:5/545: unlink d13/d1b/d30/d6e/d88/l8a 0 2024-03-18T14:43:17.902 INFO:tasks.workunit.client.1.smithi129.stdout:2/303: dread d7/f49 [0,4194304] 0 2024-03-18T14:43:17.903 INFO:tasks.workunit.client.1.smithi129.stdout:9/311: dwrite d0/f35 [0,4194304] 0 2024-03-18T14:43:17.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/609: symlink db/d18/d1e/d7e/lca 0 2024-03-18T14:43:17.903 INFO:tasks.workunit.client.0.smithi087.stdout:9/610: readlink db/d31/l5d 0 2024-03-18T14:43:17.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/512: mkdir d2/d44/d72/d8a/da7 0 2024-03-18T14:43:17.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/337: chown d4/d7/l56 12 1 2024-03-18T14:43:17.905 INFO:tasks.workunit.client.1.smithi129.stdout:8/318: truncate d9/d11/d1a/d32/d41/d4d/f4f 261088 0 2024-03-18T14:43:17.906 INFO:tasks.workunit.client.1.smithi129.stdout:0/350: dwrite d0/d23/d35/f36 [0,4194304] 0 2024-03-18T14:43:17.907 INFO:tasks.workunit.client.1.smithi129.stdout:7/338: write d4/d2d/d2e/d42/d58/f67 [103919,120933] 0 2024-03-18T14:43:17.908 INFO:tasks.workunit.client.0.smithi087.stdout:7/620: truncate d1/d6/da/f43 2419586 0 2024-03-18T14:43:17.908 INFO:tasks.workunit.client.0.smithi087.stdout:2/513: dwrite d2/d4/d22/d2c/d3a/d40/f8f [4194304,4194304] 0 2024-03-18T14:43:17.909 INFO:tasks.workunit.client.0.smithi087.stdout:7/621: chown d1/d6/da/d59/l88 16943 1 2024-03-18T14:43:17.909 INFO:tasks.workunit.client.0.smithi087.stdout:7/622: fdatasync d1/d6/d29/d2f/d68/fab 0 2024-03-18T14:43:17.910 INFO:tasks.workunit.client.0.smithi087.stdout:5/546: write d13/f24 [827505,47506] 0 2024-03-18T14:43:17.911 INFO:tasks.workunit.client.1.smithi129.stdout:3/294: truncate d4/dd/f32 1306862 0 2024-03-18T14:43:17.912 INFO:tasks.workunit.client.1.smithi129.stdout:3/295: chown d4/d11/d34/d53 44 1 2024-03-18T14:43:17.912 INFO:tasks.workunit.client.1.smithi129.stdout:7/339: dwrite d4/d2d/f18 [0,4194304] 0 2024-03-18T14:43:17.914 INFO:tasks.workunit.client.1.smithi129.stdout:6/338: unlink f1 0 2024-03-18T14:43:17.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/547: dwrite d13/d1b/d27/d35/d3b/f6a [0,4194304] 0 2024-03-18T14:43:17.915 INFO:tasks.workunit.client.1.smithi129.stdout:9/312: rmdir d0/db/d53 39 2024-03-18T14:43:17.917 INFO:tasks.workunit.client.1.smithi129.stdout:2/304: creat d7/d1f/d20/d2a/f5a x:0 0 0 2024-03-18T14:43:17.918 INFO:tasks.workunit.client.0.smithi087.stdout:7/623: mkdir d1/d6/da/d42/dde 0 2024-03-18T14:43:17.918 INFO:tasks.workunit.client.1.smithi129.stdout:6/339: dwrite d3/d30/f1e [0,4194304] 0 2024-03-18T14:43:17.919 INFO:tasks.workunit.client.1.smithi129.stdout:1/319: symlink d1/d18/d19/l62 0 2024-03-18T14:43:17.920 INFO:tasks.workunit.client.1.smithi129.stdout:5/311: sync 2024-03-18T14:43:17.921 INFO:tasks.workunit.client.1.smithi129.stdout:0/351: mknod d0/d14/d3a/c6a 0 2024-03-18T14:43:17.922 INFO:tasks.workunit.client.1.smithi129.stdout:5/312: stat d0/df/c21 0 2024-03-18T14:43:17.922 INFO:tasks.workunit.client.0.smithi087.stdout:9/611: symlink db/d18/d1e/d28/d76/db7/dbf/lcb 0 2024-03-18T14:43:17.922 INFO:tasks.workunit.client.0.smithi087.stdout:4/471: getdents d2/db/d82 0 2024-03-18T14:43:17.923 INFO:tasks.workunit.client.0.smithi087.stdout:9/612: write db/d31/f8a [481322,89273] 0 2024-03-18T14:43:17.923 INFO:tasks.workunit.client.0.smithi087.stdout:2/514: creat d2/d4/d5a/fa8 x:0 0 0 2024-03-18T14:43:17.924 INFO:tasks.workunit.client.1.smithi129.stdout:3/296: mkdir d4/d11/d64 0 2024-03-18T14:43:17.924 INFO:tasks.workunit.client.1.smithi129.stdout:9/313: creat d0/db/d1f/d20/d4a/d3e/f5c x:0 0 0 2024-03-18T14:43:17.925 INFO:tasks.workunit.client.0.smithi087.stdout:0/507: getdents d0/d2/d4 0 2024-03-18T14:43:17.926 INFO:tasks.workunit.client.0.smithi087.stdout:1/571: getdents d3/d3c 0 2024-03-18T14:43:17.927 INFO:tasks.workunit.client.0.smithi087.stdout:7/624: chown d1/d6/d29/d2f/d68/d65/d60/d66/l9b 420010052 1 2024-03-18T14:43:17.928 INFO:tasks.workunit.client.0.smithi087.stdout:9/613: dwrite db/d18/fb3 [0,4194304] 0 2024-03-18T14:43:17.929 INFO:tasks.workunit.client.1.smithi129.stdout:8/319: mkdir d9/d11/d1a/d66 0 2024-03-18T14:43:17.929 INFO:tasks.workunit.client.0.smithi087.stdout:9/614: chown db/d18/d1e/d28/d76/d80 110022251 1 2024-03-18T14:43:17.930 INFO:tasks.workunit.client.1.smithi129.stdout:6/340: rmdir d3/d6 39 2024-03-18T14:43:17.930 INFO:tasks.workunit.client.0.smithi087.stdout:4/472: mknod d2/db/d3c/c98 0 2024-03-18T14:43:17.931 INFO:tasks.workunit.client.0.smithi087.stdout:2/515: chown d2/d4/l33 51610 1 2024-03-18T14:43:17.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/473: chown d2/db/d84/d87 105 1 2024-03-18T14:43:17.934 INFO:tasks.workunit.client.1.smithi129.stdout:5/313: fsync d0/df/f3c 0 2024-03-18T14:43:17.934 INFO:tasks.workunit.client.1.smithi129.stdout:5/314: stat d0/df/l10 0 2024-03-18T14:43:17.934 INFO:tasks.workunit.client.1.smithi129.stdout:5/315: chown d0/dc/c2d 695 1 2024-03-18T14:43:17.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/508: rmdir d0/d1a/d34/d3d 39 2024-03-18T14:43:17.936 INFO:tasks.workunit.client.1.smithi129.stdout:9/314: rmdir d0/db/d1f/d20/d4a 39 2024-03-18T14:43:17.936 INFO:tasks.workunit.client.1.smithi129.stdout:3/297: creat d4/d11/d34/d4c/f65 x:0 0 0 2024-03-18T14:43:17.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/572: stat d3/d1d/d1f/d34/f62 0 2024-03-18T14:43:17.938 INFO:tasks.workunit.client.0.smithi087.stdout:6/492: sync 2024-03-18T14:43:17.939 INFO:tasks.workunit.client.1.smithi129.stdout:1/320: creat d1/d2/d28/f63 x:0 0 0 2024-03-18T14:43:17.939 INFO:tasks.workunit.client.1.smithi129.stdout:5/316: dwrite d0/dc/d22/f35 [4194304,4194304] 0 2024-03-18T14:43:17.940 INFO:tasks.workunit.client.1.smithi129.stdout:1/321: fdatasync d1/d35/f3f 0 2024-03-18T14:43:17.941 INFO:tasks.workunit.client.1.smithi129.stdout:0/352: mkdir d0/d23/d6b 0 2024-03-18T14:43:17.942 INFO:tasks.workunit.client.1.smithi129.stdout:2/305: creat d7/d1c/f5b x:0 0 0 2024-03-18T14:43:17.943 INFO:tasks.workunit.client.0.smithi087.stdout:5/548: truncate d13/d1b/d30/d6e/fa3 743441 0 2024-03-18T14:43:17.944 INFO:tasks.workunit.client.0.smithi087.stdout:4/474: mkdir d2/db/d82/d99 0 2024-03-18T14:43:17.945 INFO:tasks.workunit.client.0.smithi087.stdout:9/615: read db/d18/d1c/d69/f8c [1111569,121574] 0 2024-03-18T14:43:17.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/516: creat d2/d4/d22/d2c/fa9 x:0 0 0 2024-03-18T14:43:17.946 INFO:tasks.workunit.client.0.smithi087.stdout:9/616: chown db/d18/cad 10241757 1 2024-03-18T14:43:17.946 INFO:tasks.workunit.client.0.smithi087.stdout:2/517: chown d2/d4/f15 0 1 2024-03-18T14:43:17.946 INFO:tasks.workunit.client.1.smithi129.stdout:2/306: mknod d7/d1f/d20/d36/c5c 0 2024-03-18T14:43:17.946 INFO:tasks.workunit.client.1.smithi129.stdout:3/298: dread d4/d11/d1d/f46 [0,4194304] 0 2024-03-18T14:43:17.947 INFO:tasks.workunit.client.1.smithi129.stdout:3/299: chown d4/d38 30504759 1 2024-03-18T14:43:17.949 INFO:tasks.workunit.client.1.smithi129.stdout:0/353: mkdir d0/d6c 0 2024-03-18T14:43:17.950 INFO:tasks.workunit.client.1.smithi129.stdout:2/307: dread d7/f49 [0,4194304] 0 2024-03-18T14:43:17.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/475: creat d2/db/d84/d87/f9a x:0 0 0 2024-03-18T14:43:17.952 INFO:tasks.workunit.client.1.smithi129.stdout:4/277: dread d0/d1a/f25 [0,4194304] 0 2024-03-18T14:43:17.952 INFO:tasks.workunit.client.1.smithi129.stdout:8/320: rename d9/d11/l26 to d9/d11/d1a/d32/l67 0 2024-03-18T14:43:17.952 INFO:tasks.workunit.client.1.smithi129.stdout:3/300: rename d4/d11/d34/d3c/d3f to d4/d11/d34/d3c/d3f/d66 22 2024-03-18T14:43:17.953 INFO:tasks.workunit.client.1.smithi129.stdout:9/315: creat d0/db/f5d x:0 0 0 2024-03-18T14:43:17.953 INFO:tasks.workunit.client.1.smithi129.stdout:7/340: sync 2024-03-18T14:43:17.953 INFO:tasks.workunit.client.1.smithi129.stdout:3/301: chown d4/dd/d1f/d5f/c4e 4089 1 2024-03-18T14:43:17.954 INFO:tasks.workunit.client.0.smithi087.stdout:4/476: dread d2/db/d24/d30/d56/f8c [0,4194304] 0 2024-03-18T14:43:17.954 INFO:tasks.workunit.client.1.smithi129.stdout:7/341: stat d4/d7/d8/d3b/l3c 0 2024-03-18T14:43:17.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/477: fsync d2/db/d24/d30/d56/f8c 0 2024-03-18T14:43:17.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/322: creat d1/d2/f64 x:0 0 0 2024-03-18T14:43:17.955 INFO:tasks.workunit.client.0.smithi087.stdout:4/478: chown d2/db/d24/d30/d49/d4f/l5a 2533749 1 2024-03-18T14:43:17.957 INFO:tasks.workunit.client.1.smithi129.stdout:2/308: creat d7/d1f/d20/d2b/d41/f5d x:0 0 0 2024-03-18T14:43:17.957 INFO:tasks.workunit.client.1.smithi129.stdout:2/309: write d7/fa [161024,76162] 0 2024-03-18T14:43:17.958 INFO:tasks.workunit.client.1.smithi129.stdout:4/278: creat d0/d9/f51 x:0 0 0 2024-03-18T14:43:17.959 INFO:tasks.workunit.client.0.smithi087.stdout:0/509: write d0/d2/d4/d19/f2f [4813701,4133] 0 2024-03-18T14:43:17.961 INFO:tasks.workunit.client.1.smithi129.stdout:8/321: mkdir d9/d11/d55/d68 0 2024-03-18T14:43:17.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/617: creat db/d18/d1e/d28/d7c/fcc x:0 0 0 2024-03-18T14:43:17.962 INFO:tasks.workunit.client.0.smithi087.stdout:9/618: fsync db/d18/d1e/fc3 0 2024-03-18T14:43:17.962 INFO:tasks.workunit.client.0.smithi087.stdout:5/549: symlink d13/d1b/d27/lb5 0 2024-03-18T14:43:17.963 INFO:tasks.workunit.client.1.smithi129.stdout:9/316: creat d0/db/d1f/d20/d26/d19/d29/d36/f5e x:0 0 0 2024-03-18T14:43:17.964 INFO:tasks.workunit.client.1.smithi129.stdout:9/317: write d0/f5 [9375755,91329] 0 2024-03-18T14:43:17.964 INFO:tasks.workunit.client.0.smithi087.stdout:8/513: sync 2024-03-18T14:43:17.965 INFO:tasks.workunit.client.0.smithi087.stdout:1/573: creat d3/fb5 x:0 0 0 2024-03-18T14:43:17.965 INFO:tasks.workunit.client.0.smithi087.stdout:4/479: creat d2/db/d84/d87/f9b x:0 0 0 2024-03-18T14:43:17.967 INFO:tasks.workunit.client.0.smithi087.stdout:2/518: mknod d2/d44/caa 0 2024-03-18T14:43:17.968 INFO:tasks.workunit.client.0.smithi087.stdout:7/625: getdents d1/d6/d16/da6 0 2024-03-18T14:43:17.969 INFO:tasks.workunit.client.0.smithi087.stdout:5/550: mknod d13/d1b/d27/d35/d3b/cb6 0 2024-03-18T14:43:17.971 INFO:tasks.workunit.client.0.smithi087.stdout:8/514: mkdir d1/d6/d2f/d44/d4b/da5 0 2024-03-18T14:43:17.973 INFO:tasks.workunit.client.1.smithi129.stdout:8/322: mknod d9/d11/d55/c69 0 2024-03-18T14:43:17.974 INFO:tasks.workunit.client.0.smithi087.stdout:2/519: mknod d2/cab 0 2024-03-18T14:43:17.976 INFO:tasks.workunit.client.0.smithi087.stdout:7/626: symlink d1/d6/d29/d2f/ldf 0 2024-03-18T14:43:17.978 INFO:tasks.workunit.client.0.smithi087.stdout:1/574: mknod d3/d1d/d1f/cb6 0 2024-03-18T14:43:17.978 INFO:tasks.workunit.client.0.smithi087.stdout:9/619: dread db/d18/d1c/d69/f8c [4194304,4194304] 0 2024-03-18T14:43:17.978 INFO:tasks.workunit.client.1.smithi129.stdout:5/317: dwrite d0/f4 [0,4194304] 0 2024-03-18T14:43:17.980 INFO:tasks.workunit.client.0.smithi087.stdout:4/480: link d2/db/f1d d2/db/d67/f9c 0 2024-03-18T14:43:17.981 INFO:tasks.workunit.client.1.smithi129.stdout:2/310: unlink d7/d1f/l27 0 2024-03-18T14:43:17.981 INFO:tasks.workunit.client.0.smithi087.stdout:4/481: write d2/db/d84/d87/f9b [390929,21554] 0 2024-03-18T14:43:17.982 INFO:tasks.workunit.client.0.smithi087.stdout:0/510: truncate d0/d1a/d80/f92 930363 0 2024-03-18T14:43:17.982 INFO:tasks.workunit.client.1.smithi129.stdout:0/354: getdents d0/d23/d29 0 2024-03-18T14:43:17.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/511: chown d0/d49/f93 117511964 1 2024-03-18T14:43:17.984 INFO:tasks.workunit.client.1.smithi129.stdout:8/323: mkdir d9/d11/d55/d6a 0 2024-03-18T14:43:17.984 INFO:tasks.workunit.client.0.smithi087.stdout:2/520: rename d2/cab to d2/d4/d22/d2c/d3a/d76/d81/cac 0 2024-03-18T14:43:17.985 INFO:tasks.workunit.client.1.smithi129.stdout:3/302: dwrite d4/d11/d1d/d36/f4a [0,4194304] 0 2024-03-18T14:43:17.985 INFO:tasks.workunit.client.0.smithi087.stdout:2/521: fsync d2/d4/f46 0 2024-03-18T14:43:17.986 INFO:tasks.workunit.client.1.smithi129.stdout:8/324: readlink d9/d11/d18/l43 0 2024-03-18T14:43:17.986 INFO:tasks.workunit.client.1.smithi129.stdout:1/323: dwrite d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:17.986 INFO:tasks.workunit.client.0.smithi087.stdout:7/627: dread d1/d6/d29/d2f/d68/faa [0,4194304] 0 2024-03-18T14:43:17.988 INFO:tasks.workunit.client.1.smithi129.stdout:9/318: mkdir d0/db/d1f/d20/d26/d5f 0 2024-03-18T14:43:17.988 INFO:tasks.workunit.client.1.smithi129.stdout:8/325: chown d9/d11/d1a/d32/d41/d4d 15307 1 2024-03-18T14:43:17.988 INFO:tasks.workunit.client.0.smithi087.stdout:8/515: symlink d1/d6/d2f/d44/d4b/da5/la6 0 2024-03-18T14:43:17.988 INFO:tasks.workunit.client.0.smithi087.stdout:2/522: read - d2/d4/d22/d2c/d3a/d40/f80 zero size 2024-03-18T14:43:17.988 INFO:tasks.workunit.client.0.smithi087.stdout:7/628: stat d1/d6/d29 0 2024-03-18T14:43:17.989 INFO:tasks.workunit.client.0.smithi087.stdout:6/493: dwrite d3/d7/d25/d62/d7c/d29/f56 [0,4194304] 0 2024-03-18T14:43:17.989 INFO:tasks.workunit.client.0.smithi087.stdout:1/575: write d3/f93 [5202602,90078] 0 2024-03-18T14:43:17.990 INFO:tasks.workunit.client.1.smithi129.stdout:0/355: symlink d0/d14/d3a/d4a/l6d 0 2024-03-18T14:43:17.990 INFO:tasks.workunit.client.1.smithi129.stdout:6/341: sync 2024-03-18T14:43:17.993 INFO:tasks.workunit.client.1.smithi129.stdout:1/324: rename d1/d18 to d1/d2/d28/d65 0 2024-03-18T14:43:17.996 INFO:tasks.workunit.client.1.smithi129.stdout:5/318: link d0/d32/d34/c4a d0/dc/d18/c60 0 2024-03-18T14:43:17.996 INFO:tasks.workunit.client.0.smithi087.stdout:3/563: sync 2024-03-18T14:43:17.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/523: creat d2/d44/d72/fad x:0 0 0 2024-03-18T14:43:17.997 INFO:tasks.workunit.client.0.smithi087.stdout:3/564: chown d0/d3/d10/f75 51 1 2024-03-18T14:43:17.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/524: write d2/d4/d22/d2c/f30 [1111676,90955] 0 2024-03-18T14:43:17.999 INFO:tasks.workunit.client.1.smithi129.stdout:8/326: unlink d9/c21 0 2024-03-18T14:43:17.999 INFO:tasks.workunit.client.0.smithi087.stdout:9/620: link db/f68 db/d18/d1e/d28/d76/db7/fcd 0 2024-03-18T14:43:18.000 INFO:tasks.workunit.client.0.smithi087.stdout:2/525: chown d2/d4/d22/d2c/d3a/c6c 18 1 2024-03-18T14:43:18.000 INFO:tasks.workunit.client.0.smithi087.stdout:9/621: dread - db/d18/d1e/d7e/dc7/fc0 zero size 2024-03-18T14:43:18.000 INFO:tasks.workunit.client.1.smithi129.stdout:8/327: write d9/d11/d18/f3f [556851,130064] 0 2024-03-18T14:43:18.000 INFO:tasks.workunit.client.1.smithi129.stdout:9/319: mkdir d0/db/d1f/d20/d26/d19/d29/d60 0 2024-03-18T14:43:18.000 INFO:tasks.workunit.client.1.smithi129.stdout:8/328: chown d9/d11/d1a/d32/c57 102469 1 2024-03-18T14:43:18.001 INFO:tasks.workunit.client.1.smithi129.stdout:3/303: creat d4/d11/d1d/d50/f67 x:0 0 0 2024-03-18T14:43:18.003 INFO:tasks.workunit.client.1.smithi129.stdout:0/356: rename d0/c10 to d0/d23/d35/d3b/c6e 0 2024-03-18T14:43:18.004 INFO:tasks.workunit.client.1.smithi129.stdout:1/325: fsync d1/d2/d28/d65/f30 0 2024-03-18T14:43:18.005 INFO:tasks.workunit.client.0.smithi087.stdout:1/576: unlink d3/d1d/c66 0 2024-03-18T14:43:18.006 INFO:tasks.workunit.client.1.smithi129.stdout:5/319: chown d0/l7 32 1 2024-03-18T14:43:18.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/577: chown d3/d1d/d1f/d34/d38/fb1 29717 1 2024-03-18T14:43:18.006 INFO:tasks.workunit.client.0.smithi087.stdout:4/482: unlink d2/l3e 0 2024-03-18T14:43:18.007 INFO:tasks.workunit.client.1.smithi129.stdout:6/342: dwrite d3/d30/df/f42 [0,4194304] 0 2024-03-18T14:43:18.008 INFO:tasks.workunit.client.0.smithi087.stdout:8/516: mknod d1/d6/d2f/d44/ca7 0 2024-03-18T14:43:18.009 INFO:tasks.workunit.client.0.smithi087.stdout:3/565: symlink d0/d3/d4f/l9e 0 2024-03-18T14:43:18.010 INFO:tasks.workunit.client.0.smithi087.stdout:4/483: dwrite d2/db/f43 [0,4194304] 0 2024-03-18T14:43:18.011 INFO:tasks.workunit.client.0.smithi087.stdout:4/484: dread - d2/db/d24/d30/d49/d4f/f8f zero size 2024-03-18T14:43:18.011 INFO:tasks.workunit.client.1.smithi129.stdout:9/320: unlink d0/db/d1f/l2f 0 2024-03-18T14:43:18.013 INFO:tasks.workunit.client.1.smithi129.stdout:7/342: sync 2024-03-18T14:43:18.013 INFO:tasks.workunit.client.1.smithi129.stdout:4/279: sync 2024-03-18T14:43:18.014 INFO:tasks.workunit.client.1.smithi129.stdout:7/343: dread - d4/d2d/d2e/d45/f4c zero size 2024-03-18T14:43:18.015 INFO:tasks.workunit.client.1.smithi129.stdout:7/344: fdatasync d4/d7/d8/f32 0 2024-03-18T14:43:18.018 INFO:tasks.workunit.client.0.smithi087.stdout:9/622: rename db/d18/d1e/d7e/db8/da1 to db/d18/d1e/d28/d76/d80/d91/dce 0 2024-03-18T14:43:18.018 INFO:tasks.workunit.client.0.smithi087.stdout:7/629: link d1/d6/d29/d2f/d68/d65/d60/f93 d1/d6/da/d42/d61/fe0 0 2024-03-18T14:43:18.019 INFO:tasks.workunit.client.0.smithi087.stdout:7/630: chown d1/f2e 1549207 1 2024-03-18T14:43:18.020 INFO:tasks.workunit.client.0.smithi087.stdout:8/517: creat d1/d6/d2f/fa8 x:0 0 0 2024-03-18T14:43:18.021 INFO:tasks.workunit.client.1.smithi129.stdout:0/357: mkdir d0/d14/d53/d6f 0 2024-03-18T14:43:18.021 INFO:tasks.workunit.client.1.smithi129.stdout:2/311: dread d7/d1f/d34/f30 [0,4194304] 0 2024-03-18T14:43:18.022 INFO:tasks.workunit.client.1.smithi129.stdout:2/312: fdatasync d7/d1c/f26 0 2024-03-18T14:43:18.024 INFO:tasks.workunit.client.1.smithi129.stdout:8/329: dread d9/f1d [0,4194304] 0 2024-03-18T14:43:18.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/313: stat d7/d1f/d20/d2a/f54 0 2024-03-18T14:43:18.025 INFO:tasks.workunit.client.1.smithi129.stdout:8/330: chown d9/f4c 13766 1 2024-03-18T14:43:18.026 INFO:tasks.workunit.client.1.smithi129.stdout:9/321: dwrite d0/db/d1f/d20/d4a/d3e/f5c [0,4194304] 0 2024-03-18T14:43:18.029 INFO:tasks.workunit.client.1.smithi129.stdout:1/326: symlink d1/d2/l66 0 2024-03-18T14:43:18.030 INFO:tasks.workunit.client.1.smithi129.stdout:8/331: dread d9/f1d [0,4194304] 0 2024-03-18T14:43:18.030 INFO:tasks.workunit.client.1.smithi129.stdout:1/327: readlink d1/d2/d28/d65/d19/l57 0 2024-03-18T14:43:18.031 INFO:tasks.workunit.client.0.smithi087.stdout:0/512: write d0/d2/d4/f4c [3639570,131040] 0 2024-03-18T14:43:18.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/280: symlink d0/d19/l52 0 2024-03-18T14:43:18.032 INFO:tasks.workunit.client.0.smithi087.stdout:4/485: chown d2/db/d3c/l62 243 1 2024-03-18T14:43:18.033 INFO:tasks.workunit.client.0.smithi087.stdout:5/551: truncate d13/f1a 100295 0 2024-03-18T14:43:18.035 INFO:tasks.workunit.client.1.smithi129.stdout:9/322: creat d0/db/d1f/d20/d25/f61 x:0 0 0 2024-03-18T14:43:18.036 INFO:tasks.workunit.client.1.smithi129.stdout:9/323: chown d0/db/d1f 3284867 1 2024-03-18T14:43:18.036 INFO:tasks.workunit.client.1.smithi129.stdout:7/345: mkdir d4/d7/d38/d61/d68 0 2024-03-18T14:43:18.036 INFO:tasks.workunit.client.1.smithi129.stdout:3/304: getdents d4/d11/d1d/d36 0 2024-03-18T14:43:18.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/324: stat d0/db/d1f/d20/d25/f3d 0 2024-03-18T14:43:18.037 INFO:tasks.workunit.client.1.smithi129.stdout:1/328: mkdir d1/d2/d28/d67 0 2024-03-18T14:43:18.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/526: write d2/d4/d22/d24/d65/f83 [186140,34518] 0 2024-03-18T14:43:18.039 INFO:tasks.workunit.client.1.smithi129.stdout:4/281: rmdir d0/d9 39 2024-03-18T14:43:18.039 INFO:tasks.workunit.client.1.smithi129.stdout:9/325: chown d0/db/d1f/d20/d26 12959319 1 2024-03-18T14:43:18.039 INFO:tasks.workunit.client.1.smithi129.stdout:1/329: write d1/d2/d28/f63 [93075,22920] 0 2024-03-18T14:43:18.039 INFO:tasks.workunit.client.0.smithi087.stdout:2/527: dread - d2/d4/d22/d2c/f3d zero size 2024-03-18T14:43:18.040 INFO:tasks.workunit.client.0.smithi087.stdout:6/494: truncate d3/d7/f44 9104118 0 2024-03-18T14:43:18.041 INFO:tasks.workunit.client.1.smithi129.stdout:1/330: write d1/d2/d28/d65/d19/f61 [623898,82829] 0 2024-03-18T14:43:18.042 INFO:tasks.workunit.client.1.smithi129.stdout:7/346: dread d4/d2d/f18 [0,4194304] 0 2024-03-18T14:43:18.044 INFO:tasks.workunit.client.0.smithi087.stdout:9/623: chown db/d18/d3a/c4e 709638 1 2024-03-18T14:43:18.044 INFO:tasks.workunit.client.0.smithi087.stdout:7/631: fsync d1/d6/da/d42/d61/fe0 0 2024-03-18T14:43:18.047 INFO:tasks.workunit.client.1.smithi129.stdout:3/305: symlink d4/d11/d34/d4c/l68 0 2024-03-18T14:43:18.047 INFO:tasks.workunit.client.1.smithi129.stdout:6/343: write d3/d30/df/f5f [616591,57139] 0 2024-03-18T14:43:18.047 INFO:tasks.workunit.client.1.smithi129.stdout:1/331: dread d1/f40 [0,4194304] 0 2024-03-18T14:43:18.049 INFO:tasks.workunit.client.1.smithi129.stdout:6/344: read - d3/d30/df/d28/f54 zero size 2024-03-18T14:43:18.049 INFO:tasks.workunit.client.1.smithi129.stdout:5/320: dread d0/f6 [4194304,4194304] 0 2024-03-18T14:43:18.050 INFO:tasks.workunit.client.1.smithi129.stdout:8/332: link d9/d11/d18/f24 d9/d11/d55/d68/f6b 0 2024-03-18T14:43:18.053 INFO:tasks.workunit.client.1.smithi129.stdout:1/332: dwrite d1/f40 [0,4194304] 0 2024-03-18T14:43:18.054 INFO:tasks.workunit.client.1.smithi129.stdout:2/314: rmdir d7/d1f/d34/d4d 0 2024-03-18T14:43:18.055 INFO:tasks.workunit.client.0.smithi087.stdout:3/566: dwrite d0/d3/df/f7d [4194304,4194304] 0 2024-03-18T14:43:18.055 INFO:tasks.workunit.client.1.smithi129.stdout:0/358: write d0/d14/d28/f30 [2184576,12380] 0 2024-03-18T14:43:18.056 INFO:tasks.workunit.client.1.smithi129.stdout:0/359: write d0/d14/d3a/f4c [2535387,78093] 0 2024-03-18T14:43:18.056 INFO:tasks.workunit.client.1.smithi129.stdout:2/315: dread d7/d1f/d20/d2d/f2e [0,4194304] 0 2024-03-18T14:43:18.058 INFO:tasks.workunit.client.0.smithi087.stdout:6/495: creat d3/d7/d25/d62/d7c/da0/d96/d97/fa8 x:0 0 0 2024-03-18T14:43:18.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/347: unlink d4/d7/d8/f32 0 2024-03-18T14:43:18.061 INFO:tasks.workunit.client.1.smithi129.stdout:6/345: chown d3/d6/f51 5726114 1 2024-03-18T14:43:18.061 INFO:tasks.workunit.client.1.smithi129.stdout:9/326: dread d0/f5 [0,4194304] 0 2024-03-18T14:43:18.062 INFO:tasks.workunit.client.1.smithi129.stdout:8/333: write d9/d11/d18/f24 [5052449,62196] 0 2024-03-18T14:43:18.062 INFO:tasks.workunit.client.1.smithi129.stdout:8/334: readlink d9/d11/d18/l5c 0 2024-03-18T14:43:18.062 INFO:tasks.workunit.client.1.smithi129.stdout:4/282: mknod d0/d19/d46/d3e/d21/d32/c53 0 2024-03-18T14:43:18.064 INFO:tasks.workunit.client.1.smithi129.stdout:1/333: creat d1/d2/d28/f68 x:0 0 0 2024-03-18T14:43:18.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/518: truncate d1/d6/d9/f6e 306137 0 2024-03-18T14:43:18.065 INFO:tasks.workunit.client.0.smithi087.stdout:0/513: dread d0/f3 [0,4194304] 0 2024-03-18T14:43:18.066 INFO:tasks.workunit.client.0.smithi087.stdout:0/514: chown d0/d2/d4/f66 546400 1 2024-03-18T14:43:18.066 INFO:tasks.workunit.client.1.smithi129.stdout:1/334: write d1/d2/d28/d65/d19/d52/f58 [314272,9862] 0 2024-03-18T14:43:18.068 INFO:tasks.workunit.client.1.smithi129.stdout:4/283: dwrite d0/d3c/f50 [0,4194304] 0 2024-03-18T14:43:18.069 INFO:tasks.workunit.client.0.smithi087.stdout:5/552: rename d13/d1b/d27/d35/d3b/f83 to d13/d1b/fb7 0 2024-03-18T14:43:18.070 INFO:tasks.workunit.client.1.smithi129.stdout:2/316: creat d7/d1f/d20/d2b/d41/f5e x:0 0 0 2024-03-18T14:43:18.071 INFO:tasks.workunit.client.0.smithi087.stdout:7/632: creat d1/d6/d29/fe1 x:0 0 0 2024-03-18T14:43:18.072 INFO:tasks.workunit.client.0.smithi087.stdout:8/519: fsync d1/d6/d2f/d44/d4b/f4c 0 2024-03-18T14:43:18.074 INFO:tasks.workunit.client.1.smithi129.stdout:8/335: dread d9/d11/d1a/f4b [0,4194304] 0 2024-03-18T14:43:18.075 INFO:tasks.workunit.client.1.smithi129.stdout:8/336: dread - d9/d11/d1a/d32/d3a/f64 zero size 2024-03-18T14:43:18.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/486: mknod d2/c9d 0 2024-03-18T14:43:18.076 INFO:tasks.workunit.client.0.smithi087.stdout:7/633: dwrite d1/d6/da/d42/d67/fd6 [0,4194304] 0 2024-03-18T14:43:18.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/284: fsync d0/d9/f51 0 2024-03-18T14:43:18.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/317: mkdir d7/d3f/d5f 0 2024-03-18T14:43:18.078 INFO:tasks.workunit.client.0.smithi087.stdout:2/528: write d2/d4/f16 [1973713,29695] 0 2024-03-18T14:43:18.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/520: dwrite d1/d6/d2f/f31 [0,4194304] 0 2024-03-18T14:43:18.078 INFO:tasks.workunit.client.1.smithi129.stdout:8/337: write d9/d11/d18/f35 [2054051,108613] 0 2024-03-18T14:43:18.078 INFO:tasks.workunit.client.1.smithi129.stdout:0/360: dread d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:18.079 INFO:tasks.workunit.client.1.smithi129.stdout:2/318: chown d7/d1c/f26 55107455 1 2024-03-18T14:43:18.079 INFO:tasks.workunit.client.1.smithi129.stdout:3/306: dread d4/f21 [0,4194304] 0 2024-03-18T14:43:18.080 INFO:tasks.workunit.client.1.smithi129.stdout:1/335: dread d1/d2/d28/f63 [0,4194304] 0 2024-03-18T14:43:18.080 INFO:tasks.workunit.client.1.smithi129.stdout:8/338: dread - d9/d11/d1a/d32/d3a/f59 zero size 2024-03-18T14:43:18.080 INFO:tasks.workunit.client.0.smithi087.stdout:9/624: rename db/d12/c26 to db/d18/d1e/d28/d76/db7/ccf 0 2024-03-18T14:43:18.081 INFO:tasks.workunit.client.1.smithi129.stdout:2/319: write d7/d1f/d20/d2b/d41/f5e [998615,109624] 0 2024-03-18T14:43:18.082 INFO:tasks.workunit.client.0.smithi087.stdout:5/553: rename d13/d1b/d30/l62 to d13/d1b/d30/lb8 0 2024-03-18T14:43:18.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/487: fsync d2/db/d24/f4b 0 2024-03-18T14:43:18.084 INFO:tasks.workunit.client.0.smithi087.stdout:9/625: dwrite db/d18/d1e/fc3 [0,4194304] 0 2024-03-18T14:43:18.085 INFO:tasks.workunit.client.1.smithi129.stdout:3/307: dread d4/dd/d1f/f4b [0,4194304] 0 2024-03-18T14:43:18.085 INFO:tasks.workunit.client.0.smithi087.stdout:7/634: creat d1/d6/da/d42/d61/d74/fe2 x:0 0 0 2024-03-18T14:43:18.086 INFO:tasks.workunit.client.1.smithi129.stdout:1/336: dwrite d1/d2/d28/f68 [0,4194304] 0 2024-03-18T14:43:18.086 INFO:tasks.workunit.client.0.smithi087.stdout:9/626: chown db/d31/l5d 378115867 1 2024-03-18T14:43:18.086 INFO:tasks.workunit.client.1.smithi129.stdout:1/337: write d1/d2/f64 [1035651,40496] 0 2024-03-18T14:43:18.087 INFO:tasks.workunit.client.0.smithi087.stdout:8/521: mknod d1/d6/d2f/ca9 0 2024-03-18T14:43:18.088 INFO:tasks.workunit.client.0.smithi087.stdout:2/529: creat d2/d4/d22/d2c/d3a/d40/d52/fae x:0 0 0 2024-03-18T14:43:18.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/488: dread d2/db/d24/f4b [0,4194304] 0 2024-03-18T14:43:18.089 INFO:tasks.workunit.client.1.smithi129.stdout:9/327: symlink d0/db/d1f/d20/d25/d59/l62 0 2024-03-18T14:43:18.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/320: read d7/d1f/d34/f1a [4732259,82100] 0 2024-03-18T14:43:18.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/321: dread - d7/d1f/f52 zero size 2024-03-18T14:43:18.091 INFO:tasks.workunit.client.0.smithi087.stdout:6/496: rename d3/d7/d25/d62/d7c/d29/d22/d47 to d3/d7/d25/d62/d7c/d29/d22/d23/da9 0 2024-03-18T14:43:18.094 INFO:tasks.workunit.client.1.smithi129.stdout:0/361: unlink d0/fb 0 2024-03-18T14:43:18.095 INFO:tasks.workunit.client.1.smithi129.stdout:8/339: creat d9/f6c x:0 0 0 2024-03-18T14:43:18.095 INFO:tasks.workunit.client.1.smithi129.stdout:0/362: chown d0/d14/d53/d6f 7014 1 2024-03-18T14:43:18.097 INFO:tasks.workunit.client.0.smithi087.stdout:2/530: rmdir d2/d4/d22/d24/d65 39 2024-03-18T14:43:18.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/515: rename d0/d1a/d7b/d2a/d85/l81 to d0/d2/d6b/d7c/lb5 0 2024-03-18T14:43:18.102 INFO:tasks.workunit.client.0.smithi087.stdout:5/554: mknod d13/d1b/d30/d6e/d88/db4/cb9 0 2024-03-18T14:43:18.104 INFO:tasks.workunit.client.0.smithi087.stdout:6/497: creat d3/d7/d25/d62/d7c/da0/d96/d97/faa x:0 0 0 2024-03-18T14:43:18.105 INFO:tasks.workunit.client.0.smithi087.stdout:7/635: mkdir d1/d6/da/de3 0 2024-03-18T14:43:18.106 INFO:tasks.workunit.client.0.smithi087.stdout:1/578: sync 2024-03-18T14:43:18.106 INFO:tasks.workunit.client.1.smithi129.stdout:2/322: creat d7/d1c/d32/f60 x:0 0 0 2024-03-18T14:43:18.111 INFO:tasks.workunit.client.0.smithi087.stdout:5/555: creat d13/d1b/d70/fba x:0 0 0 2024-03-18T14:43:18.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/522: dread d1/d6/d2f/d44/d45/f70 [4194304,4194304] 0 2024-03-18T14:43:18.112 INFO:tasks.workunit.client.1.smithi129.stdout:3/308: truncate d4/dd/f4d 87935 0 2024-03-18T14:43:18.112 INFO:tasks.workunit.client.0.smithi087.stdout:8/523: readlink d1/d6/d2f/d44/d45/d72/la0 0 2024-03-18T14:43:18.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/340: dwrite d9/d11/d1a/f4b [0,4194304] 0 2024-03-18T14:43:18.115 INFO:tasks.workunit.client.1.smithi129.stdout:1/338: getdents d1/d35 0 2024-03-18T14:43:18.115 INFO:tasks.workunit.client.0.smithi087.stdout:9/627: creat db/d18/d1e/fd0 x:0 0 0 2024-03-18T14:43:18.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/341: stat d9/d11/d18 0 2024-03-18T14:43:18.117 INFO:tasks.workunit.client.1.smithi129.stdout:0/363: dwrite d0/fd [0,4194304] 0 2024-03-18T14:43:18.117 INFO:tasks.workunit.client.0.smithi087.stdout:7/636: rename d1/d6/f18 to d1/d6/da/d42/d67/fe4 0 2024-03-18T14:43:18.118 INFO:tasks.workunit.client.0.smithi087.stdout:7/637: fdatasync d1/f31 0 2024-03-18T14:43:18.118 INFO:tasks.workunit.client.1.smithi129.stdout:0/364: write d0/d23/f67 [644841,120744] 0 2024-03-18T14:43:18.119 INFO:tasks.workunit.client.1.smithi129.stdout:0/365: fdatasync d0/d23/d35/d50/f52 0 2024-03-18T14:43:18.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/579: creat d3/d1d/d1e/d43/d9b/fb7 x:0 0 0 2024-03-18T14:43:18.120 INFO:tasks.workunit.client.0.smithi087.stdout:2/531: getdents d2/d44/d72/d8a/da7 0 2024-03-18T14:43:18.120 INFO:tasks.workunit.client.0.smithi087.stdout:4/489: read d2/d13/d28/f42 [84952,69351] 0 2024-03-18T14:43:18.121 INFO:tasks.workunit.client.0.smithi087.stdout:4/490: chown d2/db/d24/d30/d7b/d7f 591352 1 2024-03-18T14:43:18.121 INFO:tasks.workunit.client.1.smithi129.stdout:8/342: dread d9/d11/d1a/d14/f5e [0,4194304] 0 2024-03-18T14:43:18.122 INFO:tasks.workunit.client.0.smithi087.stdout:6/498: mknod d3/cab 0 2024-03-18T14:43:18.124 INFO:tasks.workunit.client.1.smithi129.stdout:9/328: dread d0/db/d2e/f4b [0,4194304] 0 2024-03-18T14:43:18.125 INFO:tasks.workunit.client.1.smithi129.stdout:1/339: mknod d1/d2/c69 0 2024-03-18T14:43:18.126 INFO:tasks.workunit.client.1.smithi129.stdout:0/366: creat d0/d14/d3a/d4a/f70 x:0 0 0 2024-03-18T14:43:18.127 INFO:tasks.workunit.client.1.smithi129.stdout:8/343: symlink d9/d11/d1a/d14/l6d 0 2024-03-18T14:43:18.129 INFO:tasks.workunit.client.1.smithi129.stdout:8/344: symlink d9/d11/d53/l6e 0 2024-03-18T14:43:18.129 INFO:tasks.workunit.client.1.smithi129.stdout:0/367: getdents d0/d23/d35/d50 0 2024-03-18T14:43:18.129 INFO:tasks.workunit.client.0.smithi087.stdout:4/491: dwrite d2/db/d24/f58 [0,4194304] 0 2024-03-18T14:43:18.131 INFO:tasks.workunit.client.1.smithi129.stdout:6/346: write d3/d5/d46/f55 [1418977,50618] 0 2024-03-18T14:43:18.132 INFO:tasks.workunit.client.1.smithi129.stdout:6/347: write d3/f1a [2031609,126078] 0 2024-03-18T14:43:18.138 INFO:tasks.workunit.client.1.smithi129.stdout:5/321: sync 2024-03-18T14:43:18.146 INFO:tasks.workunit.client.0.smithi087.stdout:3/567: sync 2024-03-18T14:43:18.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/492: chown d2/db/d24/d30/d56/f8c 11247818 1 2024-03-18T14:43:18.148 INFO:tasks.workunit.client.0.smithi087.stdout:7/638: creat d1/d6/da/d42/d67/fe5 x:0 0 0 2024-03-18T14:43:18.149 INFO:tasks.workunit.client.0.smithi087.stdout:6/499: dwrite d3/d7/d25/d62/d7c/da0/d96/d97/faa [0,4194304] 0 2024-03-18T14:43:18.151 INFO:tasks.workunit.client.0.smithi087.stdout:0/516: dread d0/f11 [0,4194304] 0 2024-03-18T14:43:18.152 INFO:tasks.workunit.client.1.smithi129.stdout:0/368: dread d0/d23/d35/d3b/f57 [0,4194304] 0 2024-03-18T14:43:18.152 INFO:tasks.workunit.client.1.smithi129.stdout:4/285: truncate d0/d19/d46/d3e/f47 1120172 0 2024-03-18T14:43:18.152 INFO:tasks.workunit.client.1.smithi129.stdout:2/323: write d7/d1f/f4c [1054616,127785] 0 2024-03-18T14:43:18.152 INFO:tasks.workunit.client.1.smithi129.stdout:8/345: mkdir d9/d11/d55/d6a/d6f 0 2024-03-18T14:43:18.153 INFO:tasks.workunit.client.1.smithi129.stdout:3/309: truncate d4/f9 528181 0 2024-03-18T14:43:18.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/556: write d13/d1b/d27/d28/f78 [3586647,87067] 0 2024-03-18T14:43:18.154 INFO:tasks.workunit.client.1.smithi129.stdout:0/369: readlink d0/d14/d3a/d4a/l59 0 2024-03-18T14:43:18.154 INFO:tasks.workunit.client.1.smithi129.stdout:8/346: write d9/f4c [224559,27365] 0 2024-03-18T14:43:18.154 INFO:tasks.workunit.client.1.smithi129.stdout:5/322: rmdir d0/df 39 2024-03-18T14:43:18.156 INFO:tasks.workunit.client.1.smithi129.stdout:8/347: stat d9/d11/d53/d5f 0 2024-03-18T14:43:18.156 INFO:tasks.workunit.client.1.smithi129.stdout:5/323: dread - d0/dc/d18/d2b/f5e zero size 2024-03-18T14:43:18.157 INFO:tasks.workunit.client.1.smithi129.stdout:2/324: read d7/d1f/d34/f18 [4111678,27270] 0 2024-03-18T14:43:18.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/493: unlink d2/db/l6e 0 2024-03-18T14:43:18.157 INFO:tasks.workunit.client.1.smithi129.stdout:6/348: symlink d3/d5/l6b 0 2024-03-18T14:43:18.158 INFO:tasks.workunit.client.0.smithi087.stdout:7/639: dwrite d1/d6/da/f9f [0,4194304] 0 2024-03-18T14:43:18.159 INFO:tasks.workunit.client.0.smithi087.stdout:3/568: dwrite d0/de/d30/d46/f89 [0,4194304] 0 2024-03-18T14:43:18.159 INFO:tasks.workunit.client.0.smithi087.stdout:6/500: mknod d3/d7/d25/d62/d7c/d29/d22/d23/da9/cac 0 2024-03-18T14:43:18.161 INFO:tasks.workunit.client.1.smithi129.stdout:6/349: dwrite d3/d30/f26 [4194304,4194304] 0 2024-03-18T14:43:18.162 INFO:tasks.workunit.client.0.smithi087.stdout:7/640: read d1/d6/d29/d2f/fca [2217987,12862] 0 2024-03-18T14:43:18.163 INFO:tasks.workunit.client.1.smithi129.stdout:3/310: creat d4/dd/d1f/d2f/f69 x:0 0 0 2024-03-18T14:43:18.163 INFO:tasks.workunit.client.0.smithi087.stdout:4/494: rmdir d2/db/de 39 2024-03-18T14:43:18.164 INFO:tasks.workunit.client.0.smithi087.stdout:6/501: fdatasync d3/f5e 0 2024-03-18T14:43:18.165 INFO:tasks.workunit.client.1.smithi129.stdout:5/324: write d0/df/f59 [510316,70783] 0 2024-03-18T14:43:18.165 INFO:tasks.workunit.client.1.smithi129.stdout:8/348: mkdir d9/d11/d1a/d32/d3a/d70 0 2024-03-18T14:43:18.165 INFO:tasks.workunit.client.1.smithi129.stdout:5/325: chown d0/dc/d18/d2b/f47 42858 1 2024-03-18T14:43:18.166 INFO:tasks.workunit.client.1.smithi129.stdout:8/349: fdatasync d9/d11/d1a/d32/d3a/f29 0 2024-03-18T14:43:18.166 INFO:tasks.workunit.client.1.smithi129.stdout:5/326: fsync d0/d32/d3a/f49 0 2024-03-18T14:43:18.166 INFO:tasks.workunit.client.1.smithi129.stdout:2/325: truncate d7/d1f/d34/f1a 2080585 0 2024-03-18T14:43:18.167 INFO:tasks.workunit.client.0.smithi087.stdout:7/641: dwrite d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:18.167 INFO:tasks.workunit.client.1.smithi129.stdout:2/326: chown d7/d1c/d32/f60 1 1 2024-03-18T14:43:18.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/350: chown d9/d11/d55/d68/f6b 19 1 2024-03-18T14:43:18.168 INFO:tasks.workunit.client.1.smithi129.stdout:2/327: chown d7/d1f/d20/d2b/f51 9 1 2024-03-18T14:43:18.169 INFO:tasks.workunit.client.1.smithi129.stdout:4/286: rename d0/d3c/f50 to d0/d19/f54 0 2024-03-18T14:43:18.171 INFO:tasks.workunit.client.0.smithi087.stdout:3/569: link d0/d3/df/f50 d0/de/d30/f9f 0 2024-03-18T14:43:18.172 INFO:tasks.workunit.client.0.smithi087.stdout:0/517: truncate d0/d2/d4/f8d 681314 0 2024-03-18T14:43:18.172 INFO:tasks.workunit.client.0.smithi087.stdout:2/532: link d2/d4/d22/d2c/d3a/d40/l92 d2/d4/d22/d24/laf 0 2024-03-18T14:43:18.172 INFO:tasks.workunit.client.0.smithi087.stdout:9/628: sync 2024-03-18T14:43:18.173 INFO:tasks.workunit.client.0.smithi087.stdout:0/518: fsync d0/f6c 0 2024-03-18T14:43:18.173 INFO:tasks.workunit.client.0.smithi087.stdout:4/495: dwrite d2/d13/d28/f65 [0,4194304] 0 2024-03-18T14:43:18.175 INFO:tasks.workunit.client.1.smithi129.stdout:5/327: mkdir d0/dc/d1a/d61 0 2024-03-18T14:43:18.176 INFO:tasks.workunit.client.1.smithi129.stdout:2/328: mknod d7/d1f/d20/d2d/c61 0 2024-03-18T14:43:18.178 INFO:tasks.workunit.client.0.smithi087.stdout:2/533: write d2/fb [3900942,86692] 0 2024-03-18T14:43:18.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/519: write d0/d2/d4/d19/d24/f71 [3248436,102080] 0 2024-03-18T14:43:18.181 INFO:tasks.workunit.client.1.smithi129.stdout:6/350: rename d3/d5/d2b to d3/d30/de/d6c 0 2024-03-18T14:43:18.181 INFO:tasks.workunit.client.1.smithi129.stdout:6/351: fdatasync d3/d30/de/f2e 0 2024-03-18T14:43:18.182 INFO:tasks.workunit.client.1.smithi129.stdout:5/328: creat d0/d32/d3a/f62 x:0 0 0 2024-03-18T14:43:18.183 INFO:tasks.workunit.client.1.smithi129.stdout:0/370: getdents d0/d23/d35 0 2024-03-18T14:43:18.184 INFO:tasks.workunit.client.0.smithi087.stdout:3/570: dwrite d0/d72/d85/f90 [0,4194304] 0 2024-03-18T14:43:18.185 INFO:tasks.workunit.client.0.smithi087.stdout:8/524: dwrite d1/d6/d9/f77 [0,4194304] 0 2024-03-18T14:43:18.186 INFO:tasks.workunit.client.1.smithi129.stdout:5/329: mknod d0/d32/d3a/c63 0 2024-03-18T14:43:18.187 INFO:tasks.workunit.client.0.smithi087.stdout:5/557: dread d13/d1b/d30/f67 [0,4194304] 0 2024-03-18T14:43:18.187 INFO:tasks.workunit.client.0.smithi087.stdout:5/558: dread - d13/d1b/d27/d35/fb3 zero size 2024-03-18T14:43:18.190 INFO:tasks.workunit.client.1.smithi129.stdout:2/329: mkdir d7/d1c/d62 0 2024-03-18T14:43:18.190 INFO:tasks.workunit.client.1.smithi129.stdout:6/352: symlink d3/d30/de/d65/l6d 0 2024-03-18T14:43:18.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/642: getdents d1/d6/d29/d2f/d68/d65/d72 0 2024-03-18T14:43:18.191 INFO:tasks.workunit.client.1.smithi129.stdout:6/353: readlink d3/d30/de/d49/l67 0 2024-03-18T14:43:18.195 INFO:tasks.workunit.client.1.smithi129.stdout:6/354: symlink d3/d30/de/d65/l6e 0 2024-03-18T14:43:18.195 INFO:tasks.workunit.client.0.smithi087.stdout:3/571: mkdir d0/de/d30/d46/da0 0 2024-03-18T14:43:18.196 INFO:tasks.workunit.client.1.smithi129.stdout:7/348: sync 2024-03-18T14:43:18.198 INFO:tasks.workunit.client.0.smithi087.stdout:8/525: mkdir d1/d6/d2f/d44/d45/d71/daa 0 2024-03-18T14:43:18.198 INFO:tasks.workunit.client.1.smithi129.stdout:0/371: rename d0/d14/d53/d6f to d0/d23/d71 0 2024-03-18T14:43:18.198 INFO:tasks.workunit.client.0.smithi087.stdout:2/534: creat d2/d44/d72/d79/fb0 x:0 0 0 2024-03-18T14:43:18.200 INFO:tasks.workunit.client.0.smithi087.stdout:0/520: read d0/d2/d4/d19/f25 [3543641,91864] 0 2024-03-18T14:43:18.201 INFO:tasks.workunit.client.1.smithi129.stdout:2/330: mknod d7/d1c/d62/c63 0 2024-03-18T14:43:18.202 INFO:tasks.workunit.client.0.smithi087.stdout:7/643: mknod d1/d6/d29/d2f/d68/ce6 0 2024-03-18T14:43:18.203 INFO:tasks.workunit.client.0.smithi087.stdout:3/572: rmdir d0/de/d30/d60 39 2024-03-18T14:43:18.204 INFO:tasks.workunit.client.1.smithi129.stdout:4/287: stat d0/f5 0 2024-03-18T14:43:18.204 INFO:tasks.workunit.client.0.smithi087.stdout:3/573: stat d0/d3/d4f/l9e 0 2024-03-18T14:43:18.205 INFO:tasks.workunit.client.0.smithi087.stdout:1/580: sync 2024-03-18T14:43:18.206 INFO:tasks.workunit.client.1.smithi129.stdout:2/331: dwrite d7/d1f/d34/f15 [0,4194304] 0 2024-03-18T14:43:18.209 INFO:tasks.workunit.client.0.smithi087.stdout:1/581: dwrite d3/d1d/d79/f7f [4194304,4194304] 0 2024-03-18T14:43:18.210 INFO:tasks.workunit.client.1.smithi129.stdout:8/351: dread d9/d11/d1a/d32/d3a/f29 [0,4194304] 0 2024-03-18T14:43:18.211 INFO:tasks.workunit.client.1.smithi129.stdout:2/332: dwrite d7/d1f/d20/d2b/d41/f5d [0,4194304] 0 2024-03-18T14:43:18.212 INFO:tasks.workunit.client.1.smithi129.stdout:0/372: truncate d0/d23/f3f 1400123 0 2024-03-18T14:43:18.212 INFO:tasks.workunit.client.1.smithi129.stdout:7/349: creat d4/d7/d54/f69 x:0 0 0 2024-03-18T14:43:18.216 INFO:tasks.workunit.client.1.smithi129.stdout:8/352: dread d9/f1d [0,4194304] 0 2024-03-18T14:43:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/574: dwrite d0/f52 [0,4194304] 0 2024-03-18T14:43:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:1/582: rename d3/d1d/d6e to d3/d3c/db8 0 2024-03-18T14:43:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:6/502: dread d3/f45 [0,4194304] 0 2024-03-18T14:43:18.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/526: getdents d1/d6/d9/d5d/d87/da2 0 2024-03-18T14:43:18.218 INFO:tasks.workunit.client.1.smithi129.stdout:4/288: dwrite d0/d1a/f24 [0,4194304] 0 2024-03-18T14:43:18.218 INFO:tasks.workunit.client.0.smithi087.stdout:2/535: mknod d2/d4/d22/d2c/d3a/d49/d58/d78/cb1 0 2024-03-18T14:43:18.220 INFO:tasks.workunit.client.1.smithi129.stdout:7/350: mkdir d4/d7/d38/d61/d6a 0 2024-03-18T14:43:18.220 INFO:tasks.workunit.client.1.smithi129.stdout:2/333: write d7/d1f/d34/f18 [4337011,115087] 0 2024-03-18T14:43:18.222 INFO:tasks.workunit.client.1.smithi129.stdout:6/355: getdents d3/d30/df 0 2024-03-18T14:43:18.222 INFO:tasks.workunit.client.1.smithi129.stdout:2/334: chown d7/l8 2731481 1 2024-03-18T14:43:18.222 INFO:tasks.workunit.client.1.smithi129.stdout:6/356: chown d3/d38/d57/f64 380522 1 2024-03-18T14:43:18.223 INFO:tasks.workunit.client.1.smithi129.stdout:2/335: write d7/d1f/d20/d2a/f5a [1012974,21237] 0 2024-03-18T14:43:18.223 INFO:tasks.workunit.client.1.smithi129.stdout:6/357: write d3/d30/f1e [4376308,131049] 0 2024-03-18T14:43:18.225 INFO:tasks.workunit.client.1.smithi129.stdout:8/353: symlink d9/d11/d55/d6a/l71 0 2024-03-18T14:43:18.226 INFO:tasks.workunit.client.1.smithi129.stdout:4/289: rename d0/l12 to d0/d19/d46/d3e/d21/d32/l55 0 2024-03-18T14:43:18.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/575: mknod d0/d3/d4f/ca1 0 2024-03-18T14:43:18.230 INFO:tasks.workunit.client.1.smithi129.stdout:0/373: creat d0/f72 x:0 0 0 2024-03-18T14:43:18.230 INFO:tasks.workunit.client.1.smithi129.stdout:0/374: write d0/d23/d35/d3b/f3c [4391152,78417] 0 2024-03-18T14:43:18.232 INFO:tasks.workunit.client.0.smithi087.stdout:9/629: truncate db/d31/f66 3870322 0 2024-03-18T14:43:18.232 INFO:tasks.workunit.client.0.smithi087.stdout:3/576: dread d0/de/d30/d60/f6c [0,4194304] 0 2024-03-18T14:43:18.234 INFO:tasks.workunit.client.0.smithi087.stdout:4/496: truncate d2/f36 262063 0 2024-03-18T14:43:18.234 INFO:tasks.workunit.client.1.smithi129.stdout:6/358: mknod d3/d30/df/d28/c6f 0 2024-03-18T14:43:18.235 INFO:tasks.workunit.client.1.smithi129.stdout:0/375: dwrite d0/fd [0,4194304] 0 2024-03-18T14:43:18.236 INFO:tasks.workunit.client.1.smithi129.stdout:7/351: mkdir d4/d7/d38/d61/d68/d6b 0 2024-03-18T14:43:18.237 INFO:tasks.workunit.client.1.smithi129.stdout:7/352: dread - d4/d7/d38/d49/f65 zero size 2024-03-18T14:43:18.238 INFO:tasks.workunit.client.0.smithi087.stdout:1/583: fdatasync d3/f4e 0 2024-03-18T14:43:18.239 INFO:tasks.workunit.client.1.smithi129.stdout:1/340: sync 2024-03-18T14:43:18.239 INFO:tasks.workunit.client.1.smithi129.stdout:9/329: sync 2024-03-18T14:43:18.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/584: fsync d3/d1d/d1f/d34/f53 0 2024-03-18T14:43:18.240 INFO:tasks.workunit.client.1.smithi129.stdout:9/330: read - d0/db/d1f/d20/d26/d19/d29/d36/f5e zero size 2024-03-18T14:43:18.241 INFO:tasks.workunit.client.0.smithi087.stdout:5/559: write d13/d1b/d30/f67 [745697,62765] 0 2024-03-18T14:43:18.242 INFO:tasks.workunit.client.1.smithi129.stdout:2/336: symlink d7/l64 0 2024-03-18T14:43:18.242 INFO:tasks.workunit.client.1.smithi129.stdout:8/354: mkdir d9/d11/d55/d68/d72 0 2024-03-18T14:43:18.242 INFO:tasks.workunit.client.1.smithi129.stdout:8/355: chown d9/d11/d18/c2e 0 1 2024-03-18T14:43:18.242 INFO:tasks.workunit.client.1.smithi129.stdout:2/337: write d7/d3f/f50 [466529,66170] 0 2024-03-18T14:43:18.243 INFO:tasks.workunit.client.1.smithi129.stdout:2/338: chown d7/d1c 77543336 1 2024-03-18T14:43:18.243 INFO:tasks.workunit.client.1.smithi129.stdout:8/356: write d9/d11/d55/d68/f6b [5420094,21838] 0 2024-03-18T14:43:18.244 INFO:tasks.workunit.client.0.smithi087.stdout:0/521: getdents d0/d2/d4/d19/d24/da3 0 2024-03-18T14:43:18.244 INFO:tasks.workunit.client.1.smithi129.stdout:6/359: creat d3/d38/f70 x:0 0 0 2024-03-18T14:43:18.245 INFO:tasks.workunit.client.1.smithi129.stdout:7/353: creat d4/d7/d38/d61/f6c x:0 0 0 2024-03-18T14:43:18.245 INFO:tasks.workunit.client.0.smithi087.stdout:2/536: mkdir d2/d4/d22/d24/db2 0 2024-03-18T14:43:18.248 INFO:tasks.workunit.client.1.smithi129.stdout:1/341: creat d1/d2/d28/d65/d19/d52/f6a x:0 0 0 2024-03-18T14:43:18.249 INFO:tasks.workunit.client.0.smithi087.stdout:2/537: dwrite d2/d4/d22/f36 [4194304,4194304] 0 2024-03-18T14:43:18.250 INFO:tasks.workunit.client.1.smithi129.stdout:4/290: link d0/d19/l52 d0/d9/d4c/l56 0 2024-03-18T14:43:18.251 INFO:tasks.workunit.client.1.smithi129.stdout:8/357: write d9/d11/d55/f5a [3595724,56203] 0 2024-03-18T14:43:18.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/354: creat d4/d7/d8/d3b/f6d x:0 0 0 2024-03-18T14:43:18.254 INFO:tasks.workunit.client.1.smithi129.stdout:2/339: fsync d7/d1f/d34/f15 0 2024-03-18T14:43:18.254 INFO:tasks.workunit.client.1.smithi129.stdout:7/355: readlink d4/d7/l1a 0 2024-03-18T14:43:18.256 INFO:tasks.workunit.client.1.smithi129.stdout:9/331: creat d0/db/d1f/d4c/d57/f63 x:0 0 0 2024-03-18T14:43:18.257 INFO:tasks.workunit.client.0.smithi087.stdout:7/644: truncate d1/d6/f1d 4268986 0 2024-03-18T14:43:18.258 INFO:tasks.workunit.client.1.smithi129.stdout:4/291: unlink d0/d19/d46/d3e/f4b 0 2024-03-18T14:43:18.259 INFO:tasks.workunit.client.1.smithi129.stdout:4/292: chown d0/d19/d46/d2e/c3b 15352126 1 2024-03-18T14:43:18.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/577: symlink d0/de/la2 0 2024-03-18T14:43:18.260 INFO:tasks.workunit.client.1.smithi129.stdout:8/358: symlink d9/d11/d53/l73 0 2024-03-18T14:43:18.260 INFO:tasks.workunit.client.0.smithi087.stdout:3/578: chown d0/de/f81 164007378 1 2024-03-18T14:43:18.260 INFO:tasks.workunit.client.1.smithi129.stdout:8/359: fdatasync d9/d11/d1a/f30 0 2024-03-18T14:43:18.261 INFO:tasks.workunit.client.0.smithi087.stdout:1/585: creat d3/d1d/d1e/d20/d7a/db4/fb9 x:0 0 0 2024-03-18T14:43:18.261 INFO:tasks.workunit.client.1.smithi129.stdout:8/360: stat d9/d11/d1a/d14/l6d 0 2024-03-18T14:43:18.263 INFO:tasks.workunit.client.0.smithi087.stdout:5/560: rename d13/d1b/d30/d6e/fa3 to d13/d1b/d70/fbb 0 2024-03-18T14:43:18.264 INFO:tasks.workunit.client.1.smithi129.stdout:5/330: truncate d0/f14 2814847 0 2024-03-18T14:43:18.266 INFO:tasks.workunit.client.1.smithi129.stdout:3/311: write d4/dd/f4d [583572,104192] 0 2024-03-18T14:43:18.270 INFO:tasks.workunit.client.0.smithi087.stdout:4/497: truncate d2/db/de/f2f 1392056 0 2024-03-18T14:43:18.271 INFO:tasks.workunit.client.0.smithi087.stdout:1/586: mkdir d3/d1d/d1f/d34/d38/dba 0 2024-03-18T14:43:18.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/579: chown d0/de/d30/d46/l93 22771 1 2024-03-18T14:43:18.273 INFO:tasks.workunit.client.0.smithi087.stdout:0/522: creat d0/fb6 x:0 0 0 2024-03-18T14:43:18.274 INFO:tasks.workunit.client.1.smithi129.stdout:0/376: dread d0/d23/d29/f3e [0,4194304] 0 2024-03-18T14:43:18.274 INFO:tasks.workunit.client.0.smithi087.stdout:9/630: dwrite f3 [0,4194304] 0 2024-03-18T14:43:18.275 INFO:tasks.workunit.client.0.smithi087.stdout:9/631: chown db/d18/d1e/d28/d76/db7/dbf 5629745 1 2024-03-18T14:43:18.276 INFO:tasks.workunit.client.0.smithi087.stdout:7/645: rename d1/d6/d29/d2f/d68/ce6 to d1/d6/d16/da6/ce7 0 2024-03-18T14:43:18.276 INFO:tasks.workunit.client.0.smithi087.stdout:7/646: fsync d1/d6/da/f25 0 2024-03-18T14:43:18.278 INFO:tasks.workunit.client.0.smithi087.stdout:4/498: dread d2/db/d24/d30/d56/f74 [0,4194304] 0 2024-03-18T14:43:18.278 INFO:tasks.workunit.client.0.smithi087.stdout:8/527: sync 2024-03-18T14:43:18.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/503: sync 2024-03-18T14:43:18.279 INFO:tasks.workunit.client.0.smithi087.stdout:3/580: rmdir d0/d3 39 2024-03-18T14:43:18.279 INFO:tasks.workunit.client.1.smithi129.stdout:2/340: dread d7/d1f/d20/d2a/f54 [0,4194304] 0 2024-03-18T14:43:18.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/561: fdatasync d13/f1a 0 2024-03-18T14:43:18.281 INFO:tasks.workunit.client.1.smithi129.stdout:7/356: creat d4/d7/d54/f6e x:0 0 0 2024-03-18T14:43:18.281 INFO:tasks.workunit.client.0.smithi087.stdout:0/523: mknod d0/d1a/cb7 0 2024-03-18T14:43:18.282 INFO:tasks.workunit.client.1.smithi129.stdout:1/342: mknod d1/d2/d28/d65/d19/c6b 0 2024-03-18T14:43:18.282 INFO:tasks.workunit.client.0.smithi087.stdout:2/538: getdents d2 0 2024-03-18T14:43:18.283 INFO:tasks.workunit.client.0.smithi087.stdout:2/539: dread - d2/d44/d72/fad zero size 2024-03-18T14:43:18.284 INFO:tasks.workunit.client.1.smithi129.stdout:4/293: readlink d0/d19/l52 0 2024-03-18T14:43:18.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/647: creat d1/d6/d29/d2f/d68/dbf/fe8 x:0 0 0 2024-03-18T14:43:18.286 INFO:tasks.workunit.client.1.smithi129.stdout:3/312: mknod d4/d11/d1d/d36/c6a 0 2024-03-18T14:43:18.287 INFO:tasks.workunit.client.1.smithi129.stdout:3/313: chown d4/d38 3058547 1 2024-03-18T14:43:18.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/528: mknod d1/d6/d2f/d44/d45/d71/cab 0 2024-03-18T14:43:18.288 INFO:tasks.workunit.client.1.smithi129.stdout:7/357: creat d4/d7/d8/d3b/f6f x:0 0 0 2024-03-18T14:43:18.290 INFO:tasks.workunit.client.1.smithi129.stdout:1/343: unlink d1/d2/f34 0 2024-03-18T14:43:18.293 INFO:tasks.workunit.client.1.smithi129.stdout:8/361: write d9/d11/d1a/d32/d3a/f49 [3464339,116314] 0 2024-03-18T14:43:18.295 INFO:tasks.workunit.client.0.smithi087.stdout:5/562: symlink d13/d1b/d27/d28/d9a/lbc 0 2024-03-18T14:43:18.296 INFO:tasks.workunit.client.0.smithi087.stdout:5/563: dread - d13/d1b/d27/d28/f77 zero size 2024-03-18T14:43:18.296 INFO:tasks.workunit.client.1.smithi129.stdout:4/294: rename d0/d19/f4e to d0/d19/d46/d3e/d21/d32/f57 0 2024-03-18T14:43:18.296 INFO:tasks.workunit.client.1.smithi129.stdout:5/331: getdents d0/dc/d18/d5f 0 2024-03-18T14:43:18.297 INFO:tasks.workunit.client.0.smithi087.stdout:9/632: dread db/d31/f8d [0,4194304] 0 2024-03-18T14:43:18.297 INFO:tasks.workunit.client.1.smithi129.stdout:6/360: getdents d3/d30/de/d49 0 2024-03-18T14:43:18.299 INFO:tasks.workunit.client.0.smithi087.stdout:4/499: creat d2/db/d7a/f9e x:0 0 0 2024-03-18T14:43:18.301 INFO:tasks.workunit.client.0.smithi087.stdout:8/529: creat d1/d6/d8d/fac x:0 0 0 2024-03-18T14:43:18.302 INFO:tasks.workunit.client.0.smithi087.stdout:5/564: dwrite d13/d1b/d30/d6e/f80 [0,4194304] 0 2024-03-18T14:43:18.303 INFO:tasks.workunit.client.0.smithi087.stdout:8/530: readlink d1/d6/d2f/d44/d4b/l56 0 2024-03-18T14:43:18.303 INFO:tasks.workunit.client.0.smithi087.stdout:5/565: stat d13/d1b/d27/f45 0 2024-03-18T14:43:18.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/633: dread db/d18/d1e/d28/d76/d80/d91/fa8 [0,4194304] 0 2024-03-18T14:43:18.306 INFO:tasks.workunit.client.0.smithi087.stdout:8/531: read d1/d6/d2f/d44/d45/d50/f73 [285159,25684] 0 2024-03-18T14:43:18.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/581: dread d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:18.307 INFO:tasks.workunit.client.0.smithi087.stdout:3/582: write d0/d3/f7 [748565,72979] 0 2024-03-18T14:43:18.308 INFO:tasks.workunit.client.0.smithi087.stdout:3/583: stat d0/d3/d10/c17 0 2024-03-18T14:43:18.313 INFO:tasks.workunit.client.0.smithi087.stdout:5/566: dread d13/d1b/d70/fbb [0,4194304] 0 2024-03-18T14:43:18.314 INFO:tasks.workunit.client.0.smithi087.stdout:6/504: truncate d3/d7/d25/d62/d7c/d29/d22/f80 554483 0 2024-03-18T14:43:18.315 INFO:tasks.workunit.client.0.smithi087.stdout:4/500: read d2/db/d24/d30/d7b/d7f/f57 [87260,15266] 0 2024-03-18T14:43:18.315 INFO:tasks.workunit.client.0.smithi087.stdout:1/587: getdents d3/d3c/db8/d8f 0 2024-03-18T14:43:18.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/501: stat d2/db/d24/d30/d56/l64 0 2024-03-18T14:43:18.318 INFO:tasks.workunit.client.0.smithi087.stdout:1/588: dread d3/d1d/d1f/f7d [0,4194304] 0 2024-03-18T14:43:18.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/567: fsync d13/d1b/d27/d35/d3b/fa4 0 2024-03-18T14:43:18.320 INFO:tasks.workunit.client.0.smithi087.stdout:6/505: symlink d3/d7/d25/d62/d7c/d46/lad 0 2024-03-18T14:43:18.321 INFO:tasks.workunit.client.0.smithi087.stdout:2/540: rename d2/d4/d22/d2c/d3a/d40/l92 to d2/d4/d22/d2c/d3a/d49/lb3 0 2024-03-18T14:43:18.322 INFO:tasks.workunit.client.0.smithi087.stdout:6/506: readlink d3/d7/d25/d62/d7c/d29/d22/d75/l93 0 2024-03-18T14:43:18.322 INFO:tasks.workunit.client.1.smithi129.stdout:9/332: link d0/db/d2e/c56 d0/d15/c64 0 2024-03-18T14:43:18.322 INFO:tasks.workunit.client.1.smithi129.stdout:8/362: rename d9/d11/d1a/d32/d41/l65 to d9/l74 0 2024-03-18T14:43:18.323 INFO:tasks.workunit.client.0.smithi087.stdout:1/589: dwrite d3/d1d/f21 [4194304,4194304] 0 2024-03-18T14:43:18.323 INFO:tasks.workunit.client.0.smithi087.stdout:2/541: write d2/f43 [17397,104531] 0 2024-03-18T14:43:18.324 INFO:tasks.workunit.client.1.smithi129.stdout:3/314: dread d4/d11/d1d/d27/f61 [0,4194304] 0 2024-03-18T14:43:18.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/341: truncate d7/d3f/f50 1086876 0 2024-03-18T14:43:18.324 INFO:tasks.workunit.client.1.smithi129.stdout:5/332: creat d0/d32/d34/f64 x:0 0 0 2024-03-18T14:43:18.324 INFO:tasks.workunit.client.1.smithi129.stdout:7/358: write d4/f16 [619976,124489] 0 2024-03-18T14:43:18.325 INFO:tasks.workunit.client.1.smithi129.stdout:4/295: mkdir d0/d19/d46/d3e/d21/d4d/d58 0 2024-03-18T14:43:18.325 INFO:tasks.workunit.client.0.smithi087.stdout:4/502: symlink d2/db/d24/d30/d56/l9f 0 2024-03-18T14:43:18.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/532: mkdir d1/d6/d2f/d44/d45/d71/daa/dad 0 2024-03-18T14:43:18.327 INFO:tasks.workunit.client.1.smithi129.stdout:8/363: write d9/d11/d18/f34 [826876,111273] 0 2024-03-18T14:43:18.328 INFO:tasks.workunit.client.1.smithi129.stdout:9/333: unlink d0/db/d1f/d20/d25/f51 0 2024-03-18T14:43:18.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/503: dwrite d2/db/d24/f26 [0,4194304] 0 2024-03-18T14:43:18.330 INFO:tasks.workunit.client.1.smithi129.stdout:2/342: dread d7/f1e [0,4194304] 0 2024-03-18T14:43:18.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/315: symlink d4/l6b 0 2024-03-18T14:43:18.333 INFO:tasks.workunit.client.1.smithi129.stdout:4/296: symlink d0/d19/d46/d3e/d21/d32/l59 0 2024-03-18T14:43:18.333 INFO:tasks.workunit.client.0.smithi087.stdout:6/507: truncate d3/d7/d25/d62/d7c/d29/f1d 2443637 0 2024-03-18T14:43:18.334 INFO:tasks.workunit.client.0.smithi087.stdout:3/584: link d0/c83 d0/d1c/d25/ca3 0 2024-03-18T14:43:18.337 INFO:tasks.workunit.client.1.smithi129.stdout:2/343: mkdir d7/d1f/d20/d2b/d41/d65 0 2024-03-18T14:43:18.337 INFO:tasks.workunit.client.1.smithi129.stdout:7/359: symlink d4/d7/d38/d61/d68/d6b/l70 0 2024-03-18T14:43:18.338 INFO:tasks.workunit.client.0.smithi087.stdout:7/648: rename d1/d6/da/d42/fa8 to d1/d6/d29/d2f/d68/d65/d60/fe9 0 2024-03-18T14:43:18.339 INFO:tasks.workunit.client.1.smithi129.stdout:0/377: sync 2024-03-18T14:43:18.339 INFO:tasks.workunit.client.1.smithi129.stdout:2/344: read d7/d1f/f4c [88612,65052] 0 2024-03-18T14:43:18.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/649: write d1/d6/d29/fe1 [320827,6588] 0 2024-03-18T14:43:18.340 INFO:tasks.workunit.client.1.smithi129.stdout:0/378: chown d0/d14/d3a/d4a/d61 81511 1 2024-03-18T14:43:18.340 INFO:tasks.workunit.client.0.smithi087.stdout:7/650: write d1/d6/d29/d2f/d68/fab [294537,38765] 0 2024-03-18T14:43:18.341 INFO:tasks.workunit.client.1.smithi129.stdout:7/360: unlink d4/d2d/d2e/f50 0 2024-03-18T14:43:18.341 INFO:tasks.workunit.client.0.smithi087.stdout:7/651: fdatasync d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f8c 0 2024-03-18T14:43:18.342 INFO:tasks.workunit.client.1.smithi129.stdout:6/361: dread d3/f1a [0,4194304] 0 2024-03-18T14:43:18.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/590: link d3/d1d/d1f/f5d d3/d1d/d67/d94/fbb 0 2024-03-18T14:43:18.345 INFO:tasks.workunit.client.0.smithi087.stdout:0/524: rename d0/d49/f93 to d0/d1a/d34/d3d/fb8 0 2024-03-18T14:43:18.347 INFO:tasks.workunit.client.1.smithi129.stdout:5/333: truncate d0/d32/d3a/f49 863245 0 2024-03-18T14:43:18.348 INFO:tasks.workunit.client.0.smithi087.stdout:7/652: mkdir d1/d6/d29/d2f/dea 0 2024-03-18T14:43:18.349 INFO:tasks.workunit.client.1.smithi129.stdout:9/334: dwrite d0/db/f12 [0,4194304] 0 2024-03-18T14:43:18.350 INFO:tasks.workunit.client.0.smithi087.stdout:0/525: dwrite d0/d2/d4/d19/f41 [0,4194304] 0 2024-03-18T14:43:18.351 INFO:tasks.workunit.client.0.smithi087.stdout:0/526: fdatasync d0/d2/d4/f98 0 2024-03-18T14:43:18.353 INFO:tasks.workunit.client.1.smithi129.stdout:4/297: creat d0/d1a/f5a x:0 0 0 2024-03-18T14:43:18.354 INFO:tasks.workunit.client.0.smithi087.stdout:9/634: rename db/d12/c1f to db/d18/d1e/d28/d76/cd1 0 2024-03-18T14:43:18.354 INFO:tasks.workunit.client.1.smithi129.stdout:5/334: creat d0/d32/d3a/d45/f65 x:0 0 0 2024-03-18T14:43:18.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/635: dread - db/d31/f6d zero size 2024-03-18T14:43:18.355 INFO:tasks.workunit.client.0.smithi087.stdout:9/636: fdatasync f3 0 2024-03-18T14:43:18.355 INFO:tasks.workunit.client.1.smithi129.stdout:5/335: write d0/f9 [2879788,33658] 0 2024-03-18T14:43:18.356 INFO:tasks.workunit.client.1.smithi129.stdout:5/336: chown d0/dc/c4f 1780451 1 2024-03-18T14:43:18.356 INFO:tasks.workunit.client.1.smithi129.stdout:9/335: write d0/db/d2e/f4b [846376,74831] 0 2024-03-18T14:43:18.357 INFO:tasks.workunit.client.1.smithi129.stdout:9/336: chown d0/db/d1f/d20/d25/d59 1021288829 1 2024-03-18T14:43:18.358 INFO:tasks.workunit.client.1.smithi129.stdout:0/379: mknod d0/d23/d6b/c73 0 2024-03-18T14:43:18.358 INFO:tasks.workunit.client.0.smithi087.stdout:0/527: read d0/d2/d4/d19/f72 [105896,109479] 0 2024-03-18T14:43:18.360 INFO:tasks.workunit.client.1.smithi129.stdout:5/337: dwrite d0/f36 [0,4194304] 0 2024-03-18T14:43:18.361 INFO:tasks.workunit.client.1.smithi129.stdout:5/338: chown d0/dc/d22/f35 0 1 2024-03-18T14:43:18.362 INFO:tasks.workunit.client.1.smithi129.stdout:7/361: symlink d4/d7/d38/d5c/l71 0 2024-03-18T14:43:18.363 INFO:tasks.workunit.client.1.smithi129.stdout:7/362: readlink d4/d2d/d2e/d45/l4a 0 2024-03-18T14:43:18.363 INFO:tasks.workunit.client.1.smithi129.stdout:7/363: dread - d4/d7/d8/d3b/f6f zero size 2024-03-18T14:43:18.363 INFO:tasks.workunit.client.1.smithi129.stdout:1/344: sync 2024-03-18T14:43:18.367 INFO:tasks.workunit.client.0.smithi087.stdout:6/508: dread d3/d7/d25/d62/d7c/d29/d22/f2c [0,4194304] 0 2024-03-18T14:43:18.367 INFO:tasks.workunit.client.0.smithi087.stdout:4/504: link d2/db/d67/f6a d2/db/d3c/fa0 0 2024-03-18T14:43:18.368 INFO:tasks.workunit.client.1.smithi129.stdout:2/345: truncate f0 4804385 0 2024-03-18T14:43:18.368 INFO:tasks.workunit.client.1.smithi129.stdout:1/345: dwrite d1/d2/d28/d65/f36 [0,4194304] 0 2024-03-18T14:43:18.368 INFO:tasks.workunit.client.1.smithi129.stdout:6/362: fdatasync d3/d5/f11 0 2024-03-18T14:43:18.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/542: getdents d2/d4/d22 0 2024-03-18T14:43:18.369 INFO:tasks.workunit.client.0.smithi087.stdout:3/585: dread d0/d3/df/f14 [0,4194304] 0 2024-03-18T14:43:18.369 INFO:tasks.workunit.client.0.smithi087.stdout:1/591: mknod d3/cbc 0 2024-03-18T14:43:18.369 INFO:tasks.workunit.client.1.smithi129.stdout:3/316: getdents d4/d11/d1d 0 2024-03-18T14:43:18.370 INFO:tasks.workunit.client.0.smithi087.stdout:2/543: stat d2/d4/d22/l4f 0 2024-03-18T14:43:18.370 INFO:tasks.workunit.client.1.smithi129.stdout:1/346: write d1/d2/d28/d65/f5a [673903,106623] 0 2024-03-18T14:43:18.372 INFO:tasks.workunit.client.0.smithi087.stdout:4/505: dwrite d2/db/d3c/f50 [0,4194304] 0 2024-03-18T14:43:18.374 INFO:tasks.workunit.client.0.smithi087.stdout:4/506: chown d2/db/d24/d30/d56/l5f 45 1 2024-03-18T14:43:18.374 INFO:tasks.workunit.client.0.smithi087.stdout:4/507: readlink d2/db/d24/d30/d7b/d7f/l60 0 2024-03-18T14:43:18.374 INFO:tasks.workunit.client.1.smithi129.stdout:4/298: rename d0/d19/d46/d3e/c34 to d0/d19/d46/d3e/c5b 0 2024-03-18T14:43:18.375 INFO:tasks.workunit.client.1.smithi129.stdout:9/337: symlink d0/db/d1f/d20/d4a/l65 0 2024-03-18T14:43:18.376 INFO:tasks.workunit.client.0.smithi087.stdout:9/637: creat db/d18/d1e/d7e/dc7/fd2 x:0 0 0 2024-03-18T14:43:18.376 INFO:tasks.workunit.client.1.smithi129.stdout:0/380: rename d0/c47 to d0/d23/d35/d50/c74 0 2024-03-18T14:43:18.377 INFO:tasks.workunit.client.0.smithi087.stdout:0/528: symlink d0/d1a/d7b/d2a/d85/lb9 0 2024-03-18T14:43:18.378 INFO:tasks.workunit.client.1.smithi129.stdout:5/339: creat d0/df/f66 x:0 0 0 2024-03-18T14:43:18.379 INFO:tasks.workunit.client.1.smithi129.stdout:7/364: rmdir d4/d7/d38/d5c 39 2024-03-18T14:43:18.379 INFO:tasks.workunit.client.1.smithi129.stdout:7/365: chown d4/d7/d38/d61/d68/d6b 898317990 1 2024-03-18T14:43:18.380 INFO:tasks.workunit.client.1.smithi129.stdout:7/366: dread - d4/d7/d38/d61/f6c zero size 2024-03-18T14:43:18.380 INFO:tasks.workunit.client.1.smithi129.stdout:7/367: dread - d4/d7/d8/f47 zero size 2024-03-18T14:43:18.381 INFO:tasks.workunit.client.0.smithi087.stdout:0/529: dwrite d0/d1a/d34/f9f [0,4194304] 0 2024-03-18T14:43:18.385 INFO:tasks.workunit.client.0.smithi087.stdout:4/508: dwrite d2/db/de/f2c [0,4194304] 0 2024-03-18T14:43:18.386 INFO:tasks.workunit.client.0.smithi087.stdout:5/568: rename d13/d1b/d27/d28/f66 to d13/d1b/d30/fbd 0 2024-03-18T14:43:18.390 INFO:tasks.workunit.client.1.smithi129.stdout:9/338: creat d0/db/d1f/d20/d4a/d3e/f66 x:0 0 0 2024-03-18T14:43:18.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/530: symlink d0/d2/d6b/d7c/lba 0 2024-03-18T14:43:18.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/586: rmdir d0/d72/d86 0 2024-03-18T14:43:18.393 INFO:tasks.workunit.client.1.smithi129.stdout:7/368: creat d4/d7/d38/d61/d68/f72 x:0 0 0 2024-03-18T14:43:18.394 INFO:tasks.workunit.client.1.smithi129.stdout:7/369: dread - d4/d7/d8/d3b/f6d zero size 2024-03-18T14:43:18.394 INFO:tasks.workunit.client.0.smithi087.stdout:3/587: read d0/d3/d10/f5e [167683,32495] 0 2024-03-18T14:43:18.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/533: rename d1/d6/d9/c25 to d1/d6/d2f/d44/d45/d71/cae 0 2024-03-18T14:43:18.396 INFO:tasks.workunit.client.0.smithi087.stdout:1/592: dread d3/d1d/d1f/f75 [0,4194304] 0 2024-03-18T14:43:18.397 INFO:tasks.workunit.client.1.smithi129.stdout:9/339: readlink d0/d15/l5b 0 2024-03-18T14:43:18.398 INFO:tasks.workunit.client.0.smithi087.stdout:5/569: creat d13/d1b/d70/fbe x:0 0 0 2024-03-18T14:43:18.398 INFO:tasks.workunit.client.1.smithi129.stdout:7/370: dwrite d4/d2d/d2e/f30 [0,4194304] 0 2024-03-18T14:43:18.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/544: getdents d2/d4/d22/d2c/d3a/d40/d4a/d97 0 2024-03-18T14:43:18.400 INFO:tasks.workunit.client.1.smithi129.stdout:6/363: creat d3/d5/f71 x:0 0 0 2024-03-18T14:43:18.401 INFO:tasks.workunit.client.0.smithi087.stdout:1/593: dwrite d3/d1d/d1f/f3f [0,4194304] 0 2024-03-18T14:43:18.401 INFO:tasks.workunit.client.1.smithi129.stdout:3/317: rmdir d4/d11/d64 0 2024-03-18T14:43:18.404 INFO:tasks.workunit.client.1.smithi129.stdout:1/347: rmdir d1/d2/d28/d67 0 2024-03-18T14:43:18.405 INFO:tasks.workunit.client.1.smithi129.stdout:6/364: dwrite d3/d5/d46/f55 [0,4194304] 0 2024-03-18T14:43:18.407 INFO:tasks.workunit.client.0.smithi087.stdout:9/638: dwrite db/d18/d1e/d28/d76/db7/fcd [0,4194304] 0 2024-03-18T14:43:18.407 INFO:tasks.workunit.client.1.smithi129.stdout:3/318: dwrite d4/d11/d34/d4c/f65 [0,4194304] 0 2024-03-18T14:43:18.408 INFO:tasks.workunit.client.1.smithi129.stdout:9/340: creat d0/db/d1f/d20/d25/d59/f67 x:0 0 0 2024-03-18T14:43:18.408 INFO:tasks.workunit.client.1.smithi129.stdout:3/319: fsync d4/f54 0 2024-03-18T14:43:18.409 INFO:tasks.workunit.client.0.smithi087.stdout:9/639: write db/d18/d1e/f46 [2240882,53232] 0 2024-03-18T14:43:18.410 INFO:tasks.workunit.client.0.smithi087.stdout:6/509: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f69 [0,4194304] 0 2024-03-18T14:43:18.412 INFO:tasks.workunit.client.1.smithi129.stdout:8/364: sync 2024-03-18T14:43:18.413 INFO:tasks.workunit.client.1.smithi129.stdout:8/365: write d9/f1b [2405731,124527] 0 2024-03-18T14:43:18.414 INFO:tasks.workunit.client.1.smithi129.stdout:7/371: creat d4/d2d/d2e/f73 x:0 0 0 2024-03-18T14:43:18.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/510: dwrite d3/d7/d25/d62/d7c/d46/f88 [0,4194304] 0 2024-03-18T14:43:18.416 INFO:tasks.workunit.client.1.smithi129.stdout:5/340: link d0/dc/d18/d2b/f57 d0/f67 0 2024-03-18T14:43:18.416 INFO:tasks.workunit.client.1.smithi129.stdout:5/341: readlink d0/dc/d22/l42 0 2024-03-18T14:43:18.418 INFO:tasks.workunit.client.0.smithi087.stdout:1/594: mkdir d3/d1d/d1e/d20/dbd 0 2024-03-18T14:43:18.418 INFO:tasks.workunit.client.0.smithi087.stdout:2/545: mknod d2/d4/cb4 0 2024-03-18T14:43:18.421 INFO:tasks.workunit.client.0.smithi087.stdout:1/595: creat d3/d1d/d1e/d20/d7a/fbe x:0 0 0 2024-03-18T14:43:18.422 INFO:tasks.workunit.client.0.smithi087.stdout:1/596: read - d3/fb5 zero size 2024-03-18T14:43:18.422 INFO:tasks.workunit.client.1.smithi129.stdout:8/366: symlink d9/d11/d1a/d32/d3a/l75 0 2024-03-18T14:43:18.423 INFO:tasks.workunit.client.0.smithi087.stdout:2/546: mkdir d2/d4/d22/d2c/d3a/d76/d9a/db5 0 2024-03-18T14:43:18.423 INFO:tasks.workunit.client.0.smithi087.stdout:3/588: link d0/d1c/c65 d0/d3/d4f/d6e/ca4 0 2024-03-18T14:43:18.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/547: chown d2/d4/d22/d2c/c56 467899350 1 2024-03-18T14:43:18.426 INFO:tasks.workunit.client.0.smithi087.stdout:1/597: mkdir d3/dbf 0 2024-03-18T14:43:18.426 INFO:tasks.workunit.client.1.smithi129.stdout:7/372: readlink d4/d7/d38/d5c/l71 0 2024-03-18T14:43:18.429 INFO:tasks.workunit.client.1.smithi129.stdout:0/381: truncate d0/d14/f4d 1137188 0 2024-03-18T14:43:18.429 INFO:tasks.workunit.client.1.smithi129.stdout:0/382: write d0/d14/d3a/f62 [1013104,50405] 0 2024-03-18T14:43:18.430 INFO:tasks.workunit.client.1.smithi129.stdout:0/383: chown d0/d23/d35 59743612 1 2024-03-18T14:43:18.434 INFO:tasks.workunit.client.0.smithi087.stdout:7/653: sync 2024-03-18T14:43:18.434 INFO:tasks.workunit.client.0.smithi087.stdout:2/548: mknod d2/d4/d22/d2c/d3a/d49/d58/d78/cb6 0 2024-03-18T14:43:18.435 INFO:tasks.workunit.client.0.smithi087.stdout:5/570: dread d13/d1b/d27/f2a [0,4194304] 0 2024-03-18T14:43:18.436 INFO:tasks.workunit.client.1.smithi129.stdout:8/367: creat d9/d11/d55/d68/f76 x:0 0 0 2024-03-18T14:43:18.436 INFO:tasks.workunit.client.1.smithi129.stdout:7/373: rmdir d4/d7/d54 39 2024-03-18T14:43:18.436 INFO:tasks.workunit.client.0.smithi087.stdout:5/571: chown d13/d1b/d27/d28/c2f 0 1 2024-03-18T14:43:18.437 INFO:tasks.workunit.client.1.smithi129.stdout:6/365: link d3/c32 d3/c72 0 2024-03-18T14:43:18.437 INFO:tasks.workunit.client.0.smithi087.stdout:3/589: dwrite d0/d3/f94 [0,4194304] 0 2024-03-18T14:43:18.438 INFO:tasks.workunit.client.1.smithi129.stdout:6/366: readlink d3/d5/l23 0 2024-03-18T14:43:18.439 INFO:tasks.workunit.client.1.smithi129.stdout:2/346: sync 2024-03-18T14:43:18.439 INFO:tasks.workunit.client.0.smithi087.stdout:7/654: unlink d1/c30 0 2024-03-18T14:43:18.441 INFO:tasks.workunit.client.0.smithi087.stdout:2/549: fsync d2/d4/d22/f62 0 2024-03-18T14:43:18.441 INFO:tasks.workunit.client.0.smithi087.stdout:5/572: dwrite ff [8388608,4194304] 0 2024-03-18T14:43:18.442 INFO:tasks.workunit.client.0.smithi087.stdout:3/590: mkdir d0/d3/d10/da5 0 2024-03-18T14:43:18.443 INFO:tasks.workunit.client.1.smithi129.stdout:6/367: creat d3/d38/f73 x:0 0 0 2024-03-18T14:43:18.444 INFO:tasks.workunit.client.0.smithi087.stdout:7/655: unlink d1/d6/da/d42/lc8 0 2024-03-18T14:43:18.444 INFO:tasks.workunit.client.1.smithi129.stdout:8/368: getdents d9/d11/d53 0 2024-03-18T14:43:18.445 INFO:tasks.workunit.client.1.smithi129.stdout:6/368: write d3/d30/df/d28/f54 [1015081,92720] 0 2024-03-18T14:43:18.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/573: creat d13/d1b/d7e/fbf x:0 0 0 2024-03-18T14:43:18.449 INFO:tasks.workunit.client.0.smithi087.stdout:7/656: chown d1/d6/d29/d2f/d68/d65/c3e 1719641235 1 2024-03-18T14:43:18.452 INFO:tasks.workunit.client.1.smithi129.stdout:3/320: write d4/d11/d1d/f46 [2348274,6148] 0 2024-03-18T14:43:18.453 INFO:tasks.workunit.client.0.smithi087.stdout:2/550: creat d2/d44/fb7 x:0 0 0 2024-03-18T14:43:18.454 INFO:tasks.workunit.client.0.smithi087.stdout:5/574: mknod d13/d1b/d7e/cc0 0 2024-03-18T14:43:18.456 INFO:tasks.workunit.client.1.smithi129.stdout:7/374: truncate d4/d7/d8/f3d 2266838 0 2024-03-18T14:43:18.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/657: rename d1/d6/da/fbd to d1/d8e/d95/dae/feb 0 2024-03-18T14:43:18.457 INFO:tasks.workunit.client.0.smithi087.stdout:2/551: dwrite d2/f43 [0,4194304] 0 2024-03-18T14:43:18.457 INFO:tasks.workunit.client.1.smithi129.stdout:2/347: mknod d7/d3f/d5f/c66 0 2024-03-18T14:43:18.458 INFO:tasks.workunit.client.1.smithi129.stdout:7/375: write d4/fd [2365711,58692] 0 2024-03-18T14:43:18.458 INFO:tasks.workunit.client.1.smithi129.stdout:1/348: dwrite d1/f46 [0,4194304] 0 2024-03-18T14:43:18.459 INFO:tasks.workunit.client.0.smithi087.stdout:2/552: write d2/d44/d72/f94 [712959,17625] 0 2024-03-18T14:43:18.459 INFO:tasks.workunit.client.0.smithi087.stdout:5/575: dwrite d13/d1b/d27/f45 [4194304,4194304] 0 2024-03-18T14:43:18.462 INFO:tasks.workunit.client.1.smithi129.stdout:4/299: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:18.462 INFO:tasks.workunit.client.1.smithi129.stdout:9/341: dwrite d0/f4 [0,4194304] 0 2024-03-18T14:43:18.464 INFO:tasks.workunit.client.0.smithi087.stdout:2/553: dwrite d2/d44/d72/f94 [0,4194304] 0 2024-03-18T14:43:18.466 INFO:tasks.workunit.client.1.smithi129.stdout:4/300: write d0/d9/f17 [248811,28784] 0 2024-03-18T14:43:18.468 INFO:tasks.workunit.client.0.smithi087.stdout:8/534: truncate d1/d6/d9/f77 2844705 0 2024-03-18T14:43:18.469 INFO:tasks.workunit.client.1.smithi129.stdout:3/321: rename c1 to d4/dd/d41/c6c 0 2024-03-18T14:43:18.471 INFO:tasks.workunit.client.0.smithi087.stdout:9/640: dwrite db/d18/d1e/d28/d7c/f7d [0,4194304] 0 2024-03-18T14:43:18.476 INFO:tasks.workunit.client.0.smithi087.stdout:7/658: unlink d1/d8e/d95/fc4 0 2024-03-18T14:43:18.477 INFO:tasks.workunit.client.1.smithi129.stdout:4/301: read d0/f13 [989024,73090] 0 2024-03-18T14:43:18.477 INFO:tasks.workunit.client.1.smithi129.stdout:8/369: creat d9/d11/d1a/f77 x:0 0 0 2024-03-18T14:43:18.478 INFO:tasks.workunit.client.1.smithi129.stdout:7/376: link d4/d7/d8/c1b d4/d7/d38/d61/d68/d6b/c74 0 2024-03-18T14:43:18.481 INFO:tasks.workunit.client.1.smithi129.stdout:4/302: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:18.481 INFO:tasks.workunit.client.0.smithi087.stdout:4/509: sync 2024-03-18T14:43:18.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/554: rmdir d2/d4/d22/d2c/d3a/d76/d9a 39 2024-03-18T14:43:18.482 INFO:tasks.workunit.client.1.smithi129.stdout:6/369: getdents d3/d5/d46 0 2024-03-18T14:43:18.483 INFO:tasks.workunit.client.1.smithi129.stdout:9/342: getdents d0/db/d1f/d20/d26/d19 0 2024-03-18T14:43:18.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/535: creat d1/faf x:0 0 0 2024-03-18T14:43:18.484 INFO:tasks.workunit.client.1.smithi129.stdout:5/342: dread d0/f6 [0,4194304] 0 2024-03-18T14:43:18.484 INFO:tasks.workunit.client.0.smithi087.stdout:8/536: fsync d1/d6/d2f/d44/d45/d50/f8b 0 2024-03-18T14:43:18.486 INFO:tasks.workunit.client.1.smithi129.stdout:7/377: rmdir d4/d2d/d2e/d42/d58 39 2024-03-18T14:43:18.488 INFO:tasks.workunit.client.1.smithi129.stdout:4/303: rename d0/d9/f17 to d0/d19/d46/d3e/d21/f5c 0 2024-03-18T14:43:18.489 INFO:tasks.workunit.client.1.smithi129.stdout:0/384: dread d0/d23/d29/f58 [4194304,4194304] 0 2024-03-18T14:43:18.490 INFO:tasks.workunit.client.1.smithi129.stdout:9/343: write d0/db/d53/f58 [510733,118720] 0 2024-03-18T14:43:18.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/641: rename db/fd to db/d31/fd3 0 2024-03-18T14:43:18.492 INFO:tasks.workunit.client.1.smithi129.stdout:3/322: getdents d4/d11 0 2024-03-18T14:43:18.493 INFO:tasks.workunit.client.0.smithi087.stdout:5/576: fdatasync d13/d1b/f3a 0 2024-03-18T14:43:18.495 INFO:tasks.workunit.client.0.smithi087.stdout:7/659: read d1/d6/da/d42/d67/fe4 [1626365,61279] 0 2024-03-18T14:43:18.496 INFO:tasks.workunit.client.1.smithi129.stdout:7/378: creat d4/d7/d38/d61/d68/f75 x:0 0 0 2024-03-18T14:43:18.496 INFO:tasks.workunit.client.1.smithi129.stdout:1/349: dread d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:18.498 INFO:tasks.workunit.client.0.smithi087.stdout:4/510: mknod d2/db/d7a/ca1 0 2024-03-18T14:43:18.498 INFO:tasks.workunit.client.1.smithi129.stdout:4/304: fdatasync d0/d19/f54 0 2024-03-18T14:43:18.500 INFO:tasks.workunit.client.1.smithi129.stdout:8/370: getdents d9/d11/d18 0 2024-03-18T14:43:18.502 INFO:tasks.workunit.client.0.smithi087.stdout:9/642: creat db/d18/d1c/d69/d6f/fd4 x:0 0 0 2024-03-18T14:43:18.502 INFO:tasks.workunit.client.1.smithi129.stdout:7/379: write d4/d7/d38/f5d [954955,126749] 0 2024-03-18T14:43:18.502 INFO:tasks.workunit.client.1.smithi129.stdout:7/380: stat d4/l2c 0 2024-03-18T14:43:18.505 INFO:tasks.workunit.client.0.smithi087.stdout:1/598: sync 2024-03-18T14:43:18.505 INFO:tasks.workunit.client.0.smithi087.stdout:0/531: sync 2024-03-18T14:43:18.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/511: sync 2024-03-18T14:43:18.507 INFO:tasks.workunit.client.0.smithi087.stdout:1/599: write d3/d1d/d1f/d34/f35 [779151,82811] 0 2024-03-18T14:43:18.511 INFO:tasks.workunit.client.1.smithi129.stdout:9/344: dread d0/db/f43 [0,4194304] 0 2024-03-18T14:43:18.512 INFO:tasks.workunit.client.0.smithi087.stdout:3/591: truncate d0/d3/df/f4d 870415 0 2024-03-18T14:43:18.512 INFO:tasks.workunit.client.1.smithi129.stdout:2/348: dwrite d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:18.514 INFO:tasks.workunit.client.0.smithi087.stdout:3/592: read d0/d3/fd [3135196,83925] 0 2024-03-18T14:43:18.514 INFO:tasks.workunit.client.0.smithi087.stdout:7/660: symlink d1/d6/d29/d2f/lec 0 2024-03-18T14:43:18.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/661: chown d1/d6/da/de3 346673 1 2024-03-18T14:43:18.515 INFO:tasks.workunit.client.0.smithi087.stdout:3/593: write d0/d72/d85/f90 [3046502,64924] 0 2024-03-18T14:43:18.515 INFO:tasks.workunit.client.1.smithi129.stdout:5/343: getdents d0/df 0 2024-03-18T14:43:18.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/305: mkdir d0/d19/d5d 0 2024-03-18T14:43:18.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/662: chown d1/d8e/l9d 0 1 2024-03-18T14:43:18.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/663: readlink d1/d6/d29/d2f/d68/d65/d60/d66/d8b/laf 0 2024-03-18T14:43:18.517 INFO:tasks.workunit.client.0.smithi087.stdout:7/664: dread - d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f8c zero size 2024-03-18T14:43:18.517 INFO:tasks.workunit.client.1.smithi129.stdout:1/350: creat d1/f6c x:0 0 0 2024-03-18T14:43:18.518 INFO:tasks.workunit.client.1.smithi129.stdout:2/349: dwrite d7/d1f/d20/d2d/f3e [0,4194304] 0 2024-03-18T14:43:18.521 INFO:tasks.workunit.client.0.smithi087.stdout:7/665: dwrite d1/d6/d29/d2f/d6b/f7c [0,4194304] 0 2024-03-18T14:43:18.524 INFO:tasks.workunit.client.1.smithi129.stdout:0/385: link d0/d23/d35/d3b/l2f d0/d6c/l75 0 2024-03-18T14:43:18.525 INFO:tasks.workunit.client.1.smithi129.stdout:3/323: dread d4/d11/d1d/d27/f2b [0,4194304] 0 2024-03-18T14:43:18.525 INFO:tasks.workunit.client.1.smithi129.stdout:8/371: creat d9/d11/f78 x:0 0 0 2024-03-18T14:43:18.526 INFO:tasks.workunit.client.1.smithi129.stdout:4/306: write d0/d9/f20 [2032290,44785] 0 2024-03-18T14:43:18.527 INFO:tasks.workunit.client.0.smithi087.stdout:4/511: rename d2/db/d24/d30/d56/c5e to d2/db/d24/ca2 0 2024-03-18T14:43:18.527 INFO:tasks.workunit.client.0.smithi087.stdout:5/577: dwrite d13/d1b/d27/d28/f54 [0,4194304] 0 2024-03-18T14:43:18.527 INFO:tasks.workunit.client.1.smithi129.stdout:3/324: write d4/d11/d34/d4c/f65 [1241134,6807] 0 2024-03-18T14:43:18.528 INFO:tasks.workunit.client.0.smithi087.stdout:5/578: readlink d13/d1b/d30/l90 0 2024-03-18T14:43:18.528 INFO:tasks.workunit.client.1.smithi129.stdout:4/307: write d0/d1a/f24 [558602,83012] 0 2024-03-18T14:43:18.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/579: dread - d13/d1b/d27/d35/fb3 zero size 2024-03-18T14:43:18.529 INFO:tasks.workunit.client.1.smithi129.stdout:1/351: symlink d1/d2/d28/d65/d19/d52/l6d 0 2024-03-18T14:43:18.529 INFO:tasks.workunit.client.0.smithi087.stdout:5/580: chown d13/d1b/d27/d28/d9a 8796 1 2024-03-18T14:43:18.530 INFO:tasks.workunit.client.0.smithi087.stdout:0/532: mkdir d0/d1a/d7b/d2a/dbb 0 2024-03-18T14:43:18.530 INFO:tasks.workunit.client.1.smithi129.stdout:6/370: sync 2024-03-18T14:43:18.531 INFO:tasks.workunit.client.1.smithi129.stdout:0/386: dwrite d0/d14/d3a/d4a/f70 [0,4194304] 0 2024-03-18T14:43:18.531 INFO:tasks.workunit.client.0.smithi087.stdout:0/533: write d0/d1a/d7b/d26/d79/f44 [2730059,57959] 0 2024-03-18T14:43:18.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/600: symlink d3/d1d/d1f/d34/lc0 0 2024-03-18T14:43:18.533 INFO:tasks.workunit.client.1.smithi129.stdout:7/381: truncate d4/d7/d8/f3f 139416 0 2024-03-18T14:43:18.533 INFO:tasks.workunit.client.1.smithi129.stdout:2/350: symlink d7/l67 0 2024-03-18T14:43:18.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/594: chown d0/d1c/c88 3 1 2024-03-18T14:43:18.535 INFO:tasks.workunit.client.1.smithi129.stdout:1/352: dwrite d1/f1d [0,4194304] 0 2024-03-18T14:43:18.535 INFO:tasks.workunit.client.1.smithi129.stdout:2/351: fsync d7/d1f/d34/f30 0 2024-03-18T14:43:18.535 INFO:tasks.workunit.client.1.smithi129.stdout:2/352: stat d7/d1f/d20/d2b/d41/f5d 0 2024-03-18T14:43:18.537 INFO:tasks.workunit.client.0.smithi087.stdout:2/555: symlink d2/d4/d22/d2c/d3a/d76/d9a/db5/lb8 0 2024-03-18T14:43:18.539 INFO:tasks.workunit.client.1.smithi129.stdout:9/345: rename d0/db/f12 to d0/db/d1f/d20/d26/f68 0 2024-03-18T14:43:18.540 INFO:tasks.workunit.client.1.smithi129.stdout:9/346: fsync d0/db/d1f/d20/d25/d59/f67 0 2024-03-18T14:43:18.540 INFO:tasks.workunit.client.0.smithi087.stdout:7/666: dwrite d1/d6/da/d42/d67/fe4 [0,4194304] 0 2024-03-18T14:43:18.541 INFO:tasks.workunit.client.1.smithi129.stdout:9/347: fsync d0/f35 0 2024-03-18T14:43:18.541 INFO:tasks.workunit.client.0.smithi087.stdout:4/512: chown d2/db/de/f2f 2 1 2024-03-18T14:43:18.544 INFO:tasks.workunit.client.1.smithi129.stdout:4/308: dwrite d0/d1a/f2c [0,4194304] 0 2024-03-18T14:43:18.544 INFO:tasks.workunit.client.1.smithi129.stdout:8/372: mkdir d9/d11/d1a/d79 0 2024-03-18T14:43:18.544 INFO:tasks.workunit.client.0.smithi087.stdout:6/512: creat d3/d7/d25/d8e/fae x:0 0 0 2024-03-18T14:43:18.544 INFO:tasks.workunit.client.0.smithi087.stdout:5/581: write d13/d1b/d27/d35/f4f [4331379,40181] 0 2024-03-18T14:43:18.545 INFO:tasks.workunit.client.1.smithi129.stdout:4/309: stat d0/d19/d46/f36 0 2024-03-18T14:43:18.545 INFO:tasks.workunit.client.0.smithi087.stdout:7/667: dwrite d1/d6/da/d59/f5d [4194304,4194304] 0 2024-03-18T14:43:18.546 INFO:tasks.workunit.client.1.smithi129.stdout:7/382: creat d4/d7/d38/d5c/f76 x:0 0 0 2024-03-18T14:43:18.547 INFO:tasks.workunit.client.1.smithi129.stdout:2/353: write d7/f49 [4157631,128278] 0 2024-03-18T14:43:18.549 INFO:tasks.workunit.client.1.smithi129.stdout:8/373: dwrite d9/d11/d1a/d32/d3a/f49 [0,4194304] 0 2024-03-18T14:43:18.549 INFO:tasks.workunit.client.0.smithi087.stdout:6/513: dwrite d3/d7/f24 [0,4194304] 0 2024-03-18T14:43:18.551 INFO:tasks.workunit.client.0.smithi087.stdout:1/601: rename d3/d1d/d1f/f24 to d3/d1d/d1e/d43/d50/d71/fc1 0 2024-03-18T14:43:18.552 INFO:tasks.workunit.client.1.smithi129.stdout:9/348: symlink d0/db/d1f/d20/d26/d19/l69 0 2024-03-18T14:43:18.552 INFO:tasks.workunit.client.0.smithi087.stdout:4/513: dread d2/db/f20 [0,4194304] 0 2024-03-18T14:43:18.552 INFO:tasks.workunit.client.0.smithi087.stdout:3/595: creat d0/d3/df/d42/fa6 x:0 0 0 2024-03-18T14:43:18.553 INFO:tasks.workunit.client.1.smithi129.stdout:8/374: dwrite f8 [0,4194304] 0 2024-03-18T14:43:18.553 INFO:tasks.workunit.client.0.smithi087.stdout:8/537: getdents d1/d6/d9/d5d 0 2024-03-18T14:43:18.559 INFO:tasks.workunit.client.0.smithi087.stdout:5/582: creat d13/d1b/d27/d35/fc1 x:0 0 0 2024-03-18T14:43:18.560 INFO:tasks.workunit.client.1.smithi129.stdout:9/349: creat d0/db/d1f/d20/d26/d19/f6a x:0 0 0 2024-03-18T14:43:18.560 INFO:tasks.workunit.client.1.smithi129.stdout:6/371: truncate d3/d30/de/d6c/f60 562579 0 2024-03-18T14:43:18.561 INFO:tasks.workunit.client.1.smithi129.stdout:6/372: chown d3/f3c 3565 1 2024-03-18T14:43:18.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/354: mknod d7/c68 0 2024-03-18T14:43:18.565 INFO:tasks.workunit.client.1.smithi129.stdout:4/310: creat d0/d19/f5e x:0 0 0 2024-03-18T14:43:18.568 INFO:tasks.workunit.client.1.smithi129.stdout:7/383: creat d4/d7/d38/f77 x:0 0 0 2024-03-18T14:43:18.569 INFO:tasks.workunit.client.1.smithi129.stdout:2/355: mknod d7/d1f/d20/d2b/d41/c69 0 2024-03-18T14:43:18.569 INFO:tasks.workunit.client.1.smithi129.stdout:7/384: fdatasync d4/d7/d8/d3b/f6d 0 2024-03-18T14:43:18.570 INFO:tasks.workunit.client.1.smithi129.stdout:4/311: dread d0/d19/f54 [0,4194304] 0 2024-03-18T14:43:18.570 INFO:tasks.workunit.client.1.smithi129.stdout:7/385: fdatasync d4/d7/f63 0 2024-03-18T14:43:18.570 INFO:tasks.workunit.client.1.smithi129.stdout:2/356: write d7/f58 [889681,81497] 0 2024-03-18T14:43:18.574 INFO:tasks.workunit.client.1.smithi129.stdout:4/312: dwrite d0/d19/f39 [0,4194304] 0 2024-03-18T14:43:18.577 INFO:tasks.workunit.client.1.smithi129.stdout:5/344: truncate d0/f2 2269980 0 2024-03-18T14:43:18.578 INFO:tasks.workunit.client.0.smithi087.stdout:1/602: truncate d3/d1d/d1f/f7d 1212869 0 2024-03-18T14:43:18.580 INFO:tasks.workunit.client.0.smithi087.stdout:3/596: chown d0/l57 110554839 1 2024-03-18T14:43:18.581 INFO:tasks.workunit.client.1.smithi129.stdout:3/325: truncate d4/dd/f4d 1262417 0 2024-03-18T14:43:18.581 INFO:tasks.workunit.client.1.smithi129.stdout:5/345: write d0/d32/d3a/d45/f65 [810613,82246] 0 2024-03-18T14:43:18.581 INFO:tasks.workunit.client.1.smithi129.stdout:0/387: dwrite d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:18.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/514: rename d2/db/d24/f8d to d2/db/de/fa3 0 2024-03-18T14:43:18.582 INFO:tasks.workunit.client.0.smithi087.stdout:4/515: stat d2/db/d24/f26 0 2024-03-18T14:43:18.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/643: getdents db/d18/d1c/d69/d6f 0 2024-03-18T14:43:18.583 INFO:tasks.workunit.client.1.smithi129.stdout:7/386: creat d4/d2d/d3a/f78 x:0 0 0 2024-03-18T14:43:18.583 INFO:tasks.workunit.client.1.smithi129.stdout:9/350: dread d0/db/d1f/d20/d26/f2a [0,4194304] 0 2024-03-18T14:43:18.583 INFO:tasks.workunit.client.1.smithi129.stdout:4/313: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:18.584 INFO:tasks.workunit.client.0.smithi087.stdout:0/534: link d0/f50 d0/d2/d4/d19/d62/fbc 0 2024-03-18T14:43:18.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/353: write d1/d2/f3d [75056,48712] 0 2024-03-18T14:43:18.589 INFO:tasks.workunit.client.1.smithi129.stdout:6/373: truncate d3/d6/f4e 5167668 0 2024-03-18T14:43:18.590 INFO:tasks.workunit.client.0.smithi087.stdout:9/644: fdatasync db/d18/d1e/f54 0 2024-03-18T14:43:18.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/374: fdatasync d3/d38/d57/f64 0 2024-03-18T14:43:18.592 INFO:tasks.workunit.client.0.smithi087.stdout:5/583: mkdir d13/d1b/d27/d98/dc2 0 2024-03-18T14:43:18.593 INFO:tasks.workunit.client.0.smithi087.stdout:5/584: stat d13/d1b/d30/c58 0 2024-03-18T14:43:18.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/535: fsync d0/d2/f4a 0 2024-03-18T14:43:18.594 INFO:tasks.workunit.client.0.smithi087.stdout:2/556: getdents d2/d44/d72 0 2024-03-18T14:43:18.595 INFO:tasks.workunit.client.1.smithi129.stdout:5/346: creat d0/df/f68 x:0 0 0 2024-03-18T14:43:18.596 INFO:tasks.workunit.client.0.smithi087.stdout:2/557: dread - d2/d4/d22/d2c/d3a/d68/f93 zero size 2024-03-18T14:43:18.596 INFO:tasks.workunit.client.0.smithi087.stdout:7/668: dread d1/d6/da/d42/f7b [0,4194304] 0 2024-03-18T14:43:18.600 INFO:tasks.workunit.client.0.smithi087.stdout:3/597: rename d0/d1c/f69 to d0/d3/d7a/fa7 0 2024-03-18T14:43:18.601 INFO:tasks.workunit.client.0.smithi087.stdout:4/516: truncate d2/db/d3c/fa0 1535911 0 2024-03-18T14:43:18.602 INFO:tasks.workunit.client.1.smithi129.stdout:4/314: mkdir d0/d9/d40/d5f 0 2024-03-18T14:43:18.607 INFO:tasks.workunit.client.1.smithi129.stdout:9/351: rmdir d0/db/d1f/d20/d26/d19/d29 39 2024-03-18T14:43:18.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/357: dread f0 [4194304,4194304] 0 2024-03-18T14:43:18.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/514: write d3/d7/d25/d62/d7c/d29/d22/d61/f70 [267876,100041] 0 2024-03-18T14:43:18.608 INFO:tasks.workunit.client.0.smithi087.stdout:6/515: readlink d3/d7/d25/d62/d7c/d46/lad 0 2024-03-18T14:43:18.609 INFO:tasks.workunit.client.0.smithi087.stdout:6/516: fdatasync d3/d7/d25/d62/d7c/da0/d96/d97/fa8 0 2024-03-18T14:43:18.611 INFO:tasks.workunit.client.1.smithi129.stdout:6/375: rmdir d3/d30 39 2024-03-18T14:43:18.613 INFO:tasks.workunit.client.1.smithi129.stdout:8/375: sync 2024-03-18T14:43:18.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/354: dwrite d1/d2/f3 [4194304,4194304] 0 2024-03-18T14:43:18.616 INFO:tasks.workunit.client.1.smithi129.stdout:4/315: creat d0/d19/d46/d3e/f60 x:0 0 0 2024-03-18T14:43:18.617 INFO:tasks.workunit.client.1.smithi129.stdout:4/316: chown d0/f13 765201859 1 2024-03-18T14:43:18.617 INFO:tasks.workunit.client.1.smithi129.stdout:4/317: write d0/d19/f5e [19537,34756] 0 2024-03-18T14:43:18.618 INFO:tasks.workunit.client.0.smithi087.stdout:0/536: rename d0/d2/d4/d19/d24/d5d/d78/da7 to d0/d1a/d80/d88/dbd 0 2024-03-18T14:43:18.619 INFO:tasks.workunit.client.0.smithi087.stdout:3/598: write d0/d3/df/f14 [6644394,58923] 0 2024-03-18T14:43:18.622 INFO:tasks.workunit.client.0.smithi087.stdout:4/517: mkdir d2/db/d24/d30/d7b/d7f/da4 0 2024-03-18T14:43:18.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/645: dread db/d18/fb3 [0,4194304] 0 2024-03-18T14:43:18.627 INFO:tasks.workunit.client.1.smithi129.stdout:3/326: dread d4/dd/f4d [0,4194304] 0 2024-03-18T14:43:18.628 INFO:tasks.workunit.client.1.smithi129.stdout:3/327: dread - d4/dd/d1f/d5f/d31/f5c zero size 2024-03-18T14:43:18.628 INFO:tasks.workunit.client.0.smithi087.stdout:9/646: dwrite db/d18/d1c/d69/f8c [4194304,4194304] 0 2024-03-18T14:43:18.629 INFO:tasks.workunit.client.1.smithi129.stdout:2/358: mkdir d7/d1f/d20/d2b/d41/d65/d6a 0 2024-03-18T14:43:18.630 INFO:tasks.workunit.client.1.smithi129.stdout:5/347: sync 2024-03-18T14:43:18.631 INFO:tasks.workunit.client.1.smithi129.stdout:0/388: link d0/d14/f2d d0/d14/d3a/d4a/d61/f76 0 2024-03-18T14:43:18.635 INFO:tasks.workunit.client.1.smithi129.stdout:5/348: mkdir d0/d32/d3a/d52/d69 0 2024-03-18T14:43:18.636 INFO:tasks.workunit.client.1.smithi129.stdout:8/376: creat d9/d11/d1a/d32/d41/f7a x:0 0 0 2024-03-18T14:43:18.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/328: symlink d4/d11/d34/d3c/l6d 0 2024-03-18T14:43:18.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/329: stat d4/d38/f1b 0 2024-03-18T14:43:18.638 INFO:tasks.workunit.client.1.smithi129.stdout:4/318: truncate d0/d19/f54 156872 0 2024-03-18T14:43:18.643 INFO:tasks.workunit.client.1.smithi129.stdout:3/330: mknod d4/d11/d34/d4c/c6e 0 2024-03-18T14:43:18.643 INFO:tasks.workunit.client.1.smithi129.stdout:3/331: chown d4/d38/f24 53796331 1 2024-03-18T14:43:18.643 INFO:tasks.workunit.client.1.smithi129.stdout:4/319: fdatasync d0/f5 0 2024-03-18T14:43:18.645 INFO:tasks.workunit.client.0.smithi087.stdout:8/538: truncate d1/fd 4795135 0 2024-03-18T14:43:18.646 INFO:tasks.workunit.client.0.smithi087.stdout:1/603: dread d3/d1d/d1f/f7d [0,4194304] 0 2024-03-18T14:43:18.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/359: getdents d7/d1f/d34 0 2024-03-18T14:43:18.646 INFO:tasks.workunit.client.1.smithi129.stdout:2/360: write d7/f58 [956940,129179] 0 2024-03-18T14:43:18.648 INFO:tasks.workunit.client.0.smithi087.stdout:1/604: write d3/d1d/d1f/d34/f76 [435412,6569] 0 2024-03-18T14:43:18.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/349: truncate d0/fb 1917305 0 2024-03-18T14:43:18.650 INFO:tasks.workunit.client.0.smithi087.stdout:9/647: dwrite db/d18/d51/f5c [0,4194304] 0 2024-03-18T14:43:18.650 INFO:tasks.workunit.client.0.smithi087.stdout:1/605: stat d3/d1d/d1e/d43/d50/d72 0 2024-03-18T14:43:18.651 INFO:tasks.workunit.client.1.smithi129.stdout:2/361: dwrite d7/fa [0,4194304] 0 2024-03-18T14:43:18.651 INFO:tasks.workunit.client.0.smithi087.stdout:5/585: creat d13/fc3 x:0 0 0 2024-03-18T14:43:18.652 INFO:tasks.workunit.client.0.smithi087.stdout:6/517: dread d3/d7/d25/d62/d7c/d29/f1d [0,4194304] 0 2024-03-18T14:43:18.653 INFO:tasks.workunit.client.1.smithi129.stdout:3/332: symlink d4/d38/d55/l6f 0 2024-03-18T14:43:18.653 INFO:tasks.workunit.client.0.smithi087.stdout:2/558: link d2/d4/d22/c54 d2/d4/d22/d2c/d3a/d76/d9a/d9b/cb9 0 2024-03-18T14:43:18.655 INFO:tasks.workunit.client.1.smithi129.stdout:5/350: dwrite d0/df/f66 [0,4194304] 0 2024-03-18T14:43:18.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/333: fsync d4/dd/f3d 0 2024-03-18T14:43:18.656 INFO:tasks.workunit.client.0.smithi087.stdout:2/559: read d2/d4/f19 [2109795,92994] 0 2024-03-18T14:43:18.656 INFO:tasks.workunit.client.1.smithi129.stdout:7/387: truncate d4/d2d/d3a/f78 740332 0 2024-03-18T14:43:18.656 INFO:tasks.workunit.client.1.smithi129.stdout:0/389: fsync d0/d14/f2d 0 2024-03-18T14:43:18.659 INFO:tasks.workunit.client.1.smithi129.stdout:9/352: truncate d0/db/d53/f58 692587 0 2024-03-18T14:43:18.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/355: write d1/d2/d28/d65/d19/f37 [337767,25089] 0 2024-03-18T14:43:18.660 INFO:tasks.workunit.client.1.smithi129.stdout:1/356: chown d1/d2/d28/l2a 8 1 2024-03-18T14:43:18.660 INFO:tasks.workunit.client.1.smithi129.stdout:0/390: dread d0/d23/d29/f3e [0,4194304] 0 2024-03-18T14:43:18.663 INFO:tasks.workunit.client.0.smithi087.stdout:4/518: dread d2/db/f1d [0,4194304] 0 2024-03-18T14:43:18.663 INFO:tasks.workunit.client.1.smithi129.stdout:6/376: truncate d3/d30/df/f42 613877 0 2024-03-18T14:43:18.663 INFO:tasks.workunit.client.1.smithi129.stdout:6/377: rename d3/d30/de to d3/d30/de/d74 22 2024-03-18T14:43:18.665 INFO:tasks.workunit.client.0.smithi087.stdout:7/669: getdents d1/d6/da/d42/d67 0 2024-03-18T14:43:18.666 INFO:tasks.workunit.client.1.smithi129.stdout:4/320: mkdir d0/d19/d46/d3e/d21/d4d/d58/d61 0 2024-03-18T14:43:18.667 INFO:tasks.workunit.client.1.smithi129.stdout:2/362: mkdir d7/d1f/d20/d2a/d6b 0 2024-03-18T14:43:18.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/586: creat d13/d1b/d27/d35/d3b/fc4 x:0 0 0 2024-03-18T14:43:18.672 INFO:tasks.workunit.client.0.smithi087.stdout:6/518: creat d3/d7/d25/d62/d7c/da0/d96/d97/faf x:0 0 0 2024-03-18T14:43:18.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/334: unlink d4/d11/l1e 0 2024-03-18T14:43:18.673 INFO:tasks.workunit.client.1.smithi129.stdout:8/377: dread d9/d11/d1a/f30 [0,4194304] 0 2024-03-18T14:43:18.673 INFO:tasks.workunit.client.1.smithi129.stdout:7/388: fdatasync d4/d2d/d2e/d45/f55 0 2024-03-18T14:43:18.673 INFO:tasks.workunit.client.1.smithi129.stdout:7/389: stat d4/d2d/f34 0 2024-03-18T14:43:18.674 INFO:tasks.workunit.client.0.smithi087.stdout:2/560: mkdir d2/d4/d22/d2c/d3a/dba 0 2024-03-18T14:43:18.674 INFO:tasks.workunit.client.1.smithi129.stdout:7/390: chown d4/d7/d38/d49/f62 151 1 2024-03-18T14:43:18.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/537: truncate d0/d49/f56 693077 0 2024-03-18T14:43:18.679 INFO:tasks.workunit.client.0.smithi087.stdout:4/519: dwrite d2/f7e [0,4194304] 0 2024-03-18T14:43:18.680 INFO:tasks.workunit.client.1.smithi129.stdout:1/357: rmdir d1/d2/d28 39 2024-03-18T14:43:18.681 INFO:tasks.workunit.client.0.smithi087.stdout:6/519: creat d3/d7/d25/d62/d7c/d29/d22/d23/fb0 x:0 0 0 2024-03-18T14:43:18.682 INFO:tasks.workunit.client.0.smithi087.stdout:6/520: write d3/f19 [5233057,79086] 0 2024-03-18T14:43:18.682 INFO:tasks.workunit.client.0.smithi087.stdout:0/538: dread d0/d1a/d8c/fa4 [0,4194304] 0 2024-03-18T14:43:18.683 INFO:tasks.workunit.client.0.smithi087.stdout:1/606: truncate d3/d1d/d1e/d20/d7a/fbe 662776 0 2024-03-18T14:43:18.685 INFO:tasks.workunit.client.0.smithi087.stdout:7/670: symlink d1/d6/d16/led 0 2024-03-18T14:43:18.685 INFO:tasks.workunit.client.1.smithi129.stdout:6/378: creat d3/d38/d57/f75 x:0 0 0 2024-03-18T14:43:18.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/520: mkdir d2/db/d24/d30/d7b/d7f/da5 0 2024-03-18T14:43:18.686 INFO:tasks.workunit.client.1.smithi129.stdout:6/379: chown d3/d5/d46/f63 0 1 2024-03-18T14:43:18.687 INFO:tasks.workunit.client.0.smithi087.stdout:2/561: mkdir d2/d4/dbb 0 2024-03-18T14:43:18.688 INFO:tasks.workunit.client.1.smithi129.stdout:4/321: rename d0/d19/f39 to d0/d9/d40/d5f/f62 0 2024-03-18T14:43:18.688 INFO:tasks.workunit.client.0.smithi087.stdout:1/607: dwrite d3/f93 [0,4194304] 0 2024-03-18T14:43:18.688 INFO:tasks.workunit.client.1.smithi129.stdout:5/351: mknod d0/dc/d18/d4b/c6a 0 2024-03-18T14:43:18.689 INFO:tasks.workunit.client.1.smithi129.stdout:5/352: chown d0/dc/d18/d2b 88407613 1 2024-03-18T14:43:18.689 INFO:tasks.workunit.client.1.smithi129.stdout:3/335: mknod d4/d11/c70 0 2024-03-18T14:43:18.690 INFO:tasks.workunit.client.0.smithi087.stdout:3/599: sync 2024-03-18T14:43:18.690 INFO:tasks.workunit.client.0.smithi087.stdout:8/539: sync 2024-03-18T14:43:18.690 INFO:tasks.workunit.client.0.smithi087.stdout:9/648: getdents db/d31 0 2024-03-18T14:43:18.692 INFO:tasks.workunit.client.0.smithi087.stdout:3/600: chown d0/de/d30/d46/f89 87739226 1 2024-03-18T14:43:18.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/649: write db/d12/fb2 [535647,52902] 0 2024-03-18T14:43:18.692 INFO:tasks.workunit.client.0.smithi087.stdout:9/650: chown db/d18/d1e/fc3 3824274 1 2024-03-18T14:43:18.693 INFO:tasks.workunit.client.1.smithi129.stdout:7/391: write d4/d7/d8/f20 [818485,110656] 0 2024-03-18T14:43:18.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/539: rename d0/d1a/d7b/c1e to d0/d1a/d7b/d26/d79/cbe 0 2024-03-18T14:43:18.694 INFO:tasks.workunit.client.0.smithi087.stdout:9/651: dread - db/d18/d1e/d28/d76/db7/fc1 zero size 2024-03-18T14:43:18.695 INFO:tasks.workunit.client.1.smithi129.stdout:1/358: write d1/d2/d28/d65/f21 [8750331,35647] 0 2024-03-18T14:43:18.696 INFO:tasks.workunit.client.0.smithi087.stdout:2/562: write d2/d4/d22/d24/d65/f6b [3004242,17271] 0 2024-03-18T14:43:18.697 INFO:tasks.workunit.client.0.smithi087.stdout:1/608: stat d3/l90 0 2024-03-18T14:43:18.697 INFO:tasks.workunit.client.0.smithi087.stdout:3/601: dwrite d0/f52 [4194304,4194304] 0 2024-03-18T14:43:18.697 INFO:tasks.workunit.client.1.smithi129.stdout:2/363: dwrite f0 [0,4194304] 0 2024-03-18T14:43:18.698 INFO:tasks.workunit.client.1.smithi129.stdout:0/391: getdents d0/d23/d35/d3b/d42 0 2024-03-18T14:43:18.699 INFO:tasks.workunit.client.0.smithi087.stdout:8/540: unlink d1/d6/d2f/d44/d45/d71/cab 0 2024-03-18T14:43:18.700 INFO:tasks.workunit.client.1.smithi129.stdout:6/380: unlink d3/c61 0 2024-03-18T14:43:18.701 INFO:tasks.workunit.client.0.smithi087.stdout:2/563: dread d2/d4/d22/d2c/d3a/d40/d52/f5c [0,4194304] 0 2024-03-18T14:43:18.702 INFO:tasks.workunit.client.1.smithi129.stdout:4/322: creat d0/d19/d46/f63 x:0 0 0 2024-03-18T14:43:18.702 INFO:tasks.workunit.client.0.smithi087.stdout:2/564: chown d2/d4/cb4 0 1 2024-03-18T14:43:18.702 INFO:tasks.workunit.client.1.smithi129.stdout:4/323: chown d0/f5 192 1 2024-03-18T14:43:18.703 INFO:tasks.workunit.client.0.smithi087.stdout:0/540: rmdir d0/d1a/d34 39 2024-03-18T14:43:18.704 INFO:tasks.workunit.client.0.smithi087.stdout:9/652: mkdir db/d18/d1e/d28/d76/db7/dd5 0 2024-03-18T14:43:18.706 INFO:tasks.workunit.client.1.smithi129.stdout:3/336: creat d4/dd/d41/f71 x:0 0 0 2024-03-18T14:43:18.707 INFO:tasks.workunit.client.1.smithi129.stdout:8/378: mknod d9/d11/c7b 0 2024-03-18T14:43:18.707 INFO:tasks.workunit.client.1.smithi129.stdout:3/337: write d4/d11/d34/d4c/f5d [358121,70041] 0 2024-03-18T14:43:18.709 INFO:tasks.workunit.client.1.smithi129.stdout:7/392: mkdir d4/d2d/d2e/d79 0 2024-03-18T14:43:18.712 INFO:tasks.workunit.client.1.smithi129.stdout:5/353: rmdir d0/dc 39 2024-03-18T14:43:18.713 INFO:tasks.workunit.client.1.smithi129.stdout:5/354: fsync d0/d32/d34/f64 0 2024-03-18T14:43:18.716 INFO:tasks.workunit.client.0.smithi087.stdout:5/587: sync 2024-03-18T14:43:18.716 INFO:tasks.workunit.client.0.smithi087.stdout:4/521: write d2/db/f20 [416484,129918] 0 2024-03-18T14:43:18.717 INFO:tasks.workunit.client.0.smithi087.stdout:1/609: unlink d3/d1d/d1f/d34/d38/c4f 0 2024-03-18T14:43:18.718 INFO:tasks.workunit.client.0.smithi087.stdout:6/521: truncate d3/d7/d25/d62/d7c/f9a 589139 0 2024-03-18T14:43:18.719 INFO:tasks.workunit.client.1.smithi129.stdout:0/392: creat d0/d23/d35/d50/f77 x:0 0 0 2024-03-18T14:43:18.719 INFO:tasks.workunit.client.0.smithi087.stdout:1/610: fdatasync d3/d1d/d1e/d43/d50/f58 0 2024-03-18T14:43:18.719 INFO:tasks.workunit.client.1.smithi129.stdout:0/393: fsync d0/d14/d3a/f62 0 2024-03-18T14:43:18.720 INFO:tasks.workunit.client.0.smithi087.stdout:8/541: creat d1/d6/d9/d5d/d87/fb0 x:0 0 0 2024-03-18T14:43:18.720 INFO:tasks.workunit.client.0.smithi087.stdout:2/565: dread - d2/d4/d22/d2c/f74 zero size 2024-03-18T14:43:18.722 INFO:tasks.workunit.client.0.smithi087.stdout:5/588: dwrite d13/d1b/d27/d35/fb3 [0,4194304] 0 2024-03-18T14:43:18.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/379: mkdir d9/d11/d1a/d14/d7c 0 2024-03-18T14:43:18.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/611: write d3/d1d/d1e/d43/d9b/fb7 [650067,10418] 0 2024-03-18T14:43:18.723 INFO:tasks.workunit.client.1.smithi129.stdout:3/338: mknod d4/dd/d1f/d2f/c72 0 2024-03-18T14:43:18.724 INFO:tasks.workunit.client.0.smithi087.stdout:2/566: write d2/d4/d22/d2c/d3a/f61 [1306103,117573] 0 2024-03-18T14:43:18.725 INFO:tasks.workunit.client.1.smithi129.stdout:7/393: creat d4/d7/d38/d49/f7a x:0 0 0 2024-03-18T14:43:18.726 INFO:tasks.workunit.client.1.smithi129.stdout:7/394: dread - d4/d2d/f34 zero size 2024-03-18T14:43:18.726 INFO:tasks.workunit.client.0.smithi087.stdout:2/567: stat d2/d4/d22/d2c/d3a/d40/d98 0 2024-03-18T14:43:18.726 INFO:tasks.workunit.client.1.smithi129.stdout:9/353: truncate d0/db/d53/f58 1124809 0 2024-03-18T14:43:18.727 INFO:tasks.workunit.client.0.smithi087.stdout:2/568: chown d2/d44/d72/fad 16723695 1 2024-03-18T14:43:18.727 INFO:tasks.workunit.client.0.smithi087.stdout:0/541: dwrite d0/d1a/d34/f5f [0,4194304] 0 2024-03-18T14:43:18.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/569: fsync d2/d4/d22/d2c/d3a/d76/d81/f86 0 2024-03-18T14:43:18.728 INFO:tasks.workunit.client.0.smithi087.stdout:4/522: rmdir d2/db/d24/d30 39 2024-03-18T14:43:18.729 INFO:tasks.workunit.client.0.smithi087.stdout:2/570: chown d2/d4/d22/d2c/d3a/d40/f8d 0 1 2024-03-18T14:43:18.730 INFO:tasks.workunit.client.1.smithi129.stdout:6/381: dread d3/d5/f48 [0,4194304] 0 2024-03-18T14:43:18.733 INFO:tasks.workunit.client.0.smithi087.stdout:4/523: dwrite d2/d13/d28/f65 [4194304,4194304] 0 2024-03-18T14:43:18.733 INFO:tasks.workunit.client.1.smithi129.stdout:8/380: rename d9/d11/d1a/d32/d3a/f64 to d9/f7d 0 2024-03-18T14:43:18.734 INFO:tasks.workunit.client.0.smithi087.stdout:7/671: getdents d1/d6/d29/d2f/d68/d65/d60/d66/d8b 0 2024-03-18T14:43:18.734 INFO:tasks.workunit.client.1.smithi129.stdout:4/324: write d0/f5 [2101795,30097] 0 2024-03-18T14:43:18.734 INFO:tasks.workunit.client.0.smithi087.stdout:8/542: stat d1/d6/d2f/d44/d45/d50/f66 0 2024-03-18T14:43:18.735 INFO:tasks.workunit.client.1.smithi129.stdout:4/325: write d0/d1a/f2c [1079879,65173] 0 2024-03-18T14:43:18.738 INFO:tasks.workunit.client.0.smithi087.stdout:3/602: symlink d0/d1c/d25/la8 0 2024-03-18T14:43:18.741 INFO:tasks.workunit.client.1.smithi129.stdout:6/382: dwrite d3/d30/fd [0,4194304] 0 2024-03-18T14:43:18.743 INFO:tasks.workunit.client.0.smithi087.stdout:2/571: unlink d2/d4/d22/d24/ca2 0 2024-03-18T14:43:18.743 INFO:tasks.workunit.client.1.smithi129.stdout:0/394: mknod d0/d23/c78 0 2024-03-18T14:43:18.745 INFO:tasks.workunit.client.1.smithi129.stdout:2/364: truncate d7/d1f/d20/d2a/f54 4716564 0 2024-03-18T14:43:18.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/522: creat d3/d7/d25/d62/d7c/d29/d7d/fb1 x:0 0 0 2024-03-18T14:43:18.746 INFO:tasks.workunit.client.1.smithi129.stdout:7/395: rmdir d4/d7/d38/d49 39 2024-03-18T14:43:18.746 INFO:tasks.workunit.client.1.smithi129.stdout:6/383: read d3/d30/de/d6c/f53 [2569148,2628] 0 2024-03-18T14:43:18.747 INFO:tasks.workunit.client.0.smithi087.stdout:4/524: creat d2/db/de/d8b/fa6 x:0 0 0 2024-03-18T14:43:18.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/523: chown d3/d7/l4a 7 1 2024-03-18T14:43:18.747 INFO:tasks.workunit.client.1.smithi129.stdout:3/339: truncate d4/dd/f32 266291 0 2024-03-18T14:43:18.748 INFO:tasks.workunit.client.0.smithi087.stdout:7/672: mkdir d1/d6/d16/da6/dee 0 2024-03-18T14:43:18.748 INFO:tasks.workunit.client.1.smithi129.stdout:4/326: dread - d0/d1a/f4a zero size 2024-03-18T14:43:18.749 INFO:tasks.workunit.client.0.smithi087.stdout:2/572: dwrite d2/d4/d22/d2c/d3a/d49/d58/f63 [0,4194304] 0 2024-03-18T14:43:18.749 INFO:tasks.workunit.client.1.smithi129.stdout:1/359: dwrite d1/f9 [0,4194304] 0 2024-03-18T14:43:18.751 INFO:tasks.workunit.client.1.smithi129.stdout:0/395: dwrite d0/d23/d35/d3b/f3c [0,4194304] 0 2024-03-18T14:43:18.753 INFO:tasks.workunit.client.0.smithi087.stdout:3/603: unlink d0/d3/d4f/l5a 0 2024-03-18T14:43:18.755 INFO:tasks.workunit.client.0.smithi087.stdout:5/589: dread d13/f24 [0,4194304] 0 2024-03-18T14:43:18.761 INFO:tasks.workunit.client.0.smithi087.stdout:8/543: mkdir d1/d6/d2f/d9b/db1 0 2024-03-18T14:43:18.761 INFO:tasks.workunit.client.0.smithi087.stdout:7/673: symlink d1/d8e/d95/lef 0 2024-03-18T14:43:18.761 INFO:tasks.workunit.client.0.smithi087.stdout:9/653: write db/d18/d1c/f93 [5349854,64504] 0 2024-03-18T14:43:18.763 INFO:tasks.workunit.client.1.smithi129.stdout:2/365: creat d7/d1c/d32/f6c x:0 0 0 2024-03-18T14:43:18.763 INFO:tasks.workunit.client.0.smithi087.stdout:3/604: readlink d0/d3/d4f/l80 0 2024-03-18T14:43:18.763 INFO:tasks.workunit.client.0.smithi087.stdout:5/590: creat d13/d1b/d27/d28/d9a/fc5 x:0 0 0 2024-03-18T14:43:18.763 INFO:tasks.workunit.client.1.smithi129.stdout:9/354: creat d0/db/f6b x:0 0 0 2024-03-18T14:43:18.764 INFO:tasks.workunit.client.0.smithi087.stdout:9/654: write f7 [1731274,46983] 0 2024-03-18T14:43:18.764 INFO:tasks.workunit.client.0.smithi087.stdout:7/674: write d1/d6/da/f25 [201963,29101] 0 2024-03-18T14:43:18.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/340: dread d4/d11/d34/d4c/f65 [0,4194304] 0 2024-03-18T14:43:18.767 INFO:tasks.workunit.client.1.smithi129.stdout:1/360: mknod d1/c6e 0 2024-03-18T14:43:18.767 INFO:tasks.workunit.client.1.smithi129.stdout:4/327: mknod d0/d1a/c64 0 2024-03-18T14:43:18.768 INFO:tasks.workunit.client.0.smithi087.stdout:3/605: write d0/f1 [3691454,42419] 0 2024-03-18T14:43:18.768 INFO:tasks.workunit.client.1.smithi129.stdout:3/341: chown d4/d11/d34/d4c 708306 1 2024-03-18T14:43:18.768 INFO:tasks.workunit.client.0.smithi087.stdout:6/524: dwrite d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:18.769 INFO:tasks.workunit.client.1.smithi129.stdout:0/396: dwrite d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:18.769 INFO:tasks.workunit.client.1.smithi129.stdout:3/342: chown d4/d11/d34/d3c 2 1 2024-03-18T14:43:18.770 INFO:tasks.workunit.client.1.smithi129.stdout:0/397: fsync d0/d14/f5f 0 2024-03-18T14:43:18.771 INFO:tasks.workunit.client.0.smithi087.stdout:5/591: dwrite d13/d1b/d27/fa0 [0,4194304] 0 2024-03-18T14:43:18.772 INFO:tasks.workunit.client.1.smithi129.stdout:0/398: chown d0/d23/d35/d50/f77 3061292 1 2024-03-18T14:43:18.773 INFO:tasks.workunit.client.1.smithi129.stdout:4/328: rmdir d0/d19/d46/d3e/d33 39 2024-03-18T14:43:18.774 INFO:tasks.workunit.client.1.smithi129.stdout:1/361: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:18.774 INFO:tasks.workunit.client.0.smithi087.stdout:4/525: getdents d2/db/d24/d30/d7b/d7f 0 2024-03-18T14:43:18.775 INFO:tasks.workunit.client.1.smithi129.stdout:9/355: mkdir d0/db/d1f/d20/d6c 0 2024-03-18T14:43:18.776 INFO:tasks.workunit.client.1.smithi129.stdout:1/362: chown d1/d2/d28/d65/d19/l53 170660670 1 2024-03-18T14:43:18.776 INFO:tasks.workunit.client.1.smithi129.stdout:9/356: chown d0/d15 15 1 2024-03-18T14:43:18.778 INFO:tasks.workunit.client.1.smithi129.stdout:2/366: dread d7/d3f/f50 [0,4194304] 0 2024-03-18T14:43:18.778 INFO:tasks.workunit.client.1.smithi129.stdout:2/367: dread - d7/d1c/d32/f60 zero size 2024-03-18T14:43:18.779 INFO:tasks.workunit.client.1.smithi129.stdout:2/368: write d7/d1f/d34/f30 [352696,91270] 0 2024-03-18T14:43:18.781 INFO:tasks.workunit.client.0.smithi087.stdout:0/542: dwrite d0/d2/f17 [0,4194304] 0 2024-03-18T14:43:18.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/612: dwrite d3/d1d/d1e/d43/fa5 [0,4194304] 0 2024-03-18T14:43:18.783 INFO:tasks.workunit.client.1.smithi129.stdout:4/329: creat d0/d19/d46/d3e/d21/d4d/d58/f65 x:0 0 0 2024-03-18T14:43:18.783 INFO:tasks.workunit.client.0.smithi087.stdout:4/526: stat d2/c6c 0 2024-03-18T14:43:18.786 INFO:tasks.workunit.client.0.smithi087.stdout:9/655: link db/d18/fc6 db/d18/d1e/d28/d76/db7/dbf/fd6 0 2024-03-18T14:43:18.787 INFO:tasks.workunit.client.0.smithi087.stdout:9/656: dread - db/d18/d1e/d7e/dc7/fd2 zero size 2024-03-18T14:43:18.787 INFO:tasks.workunit.client.0.smithi087.stdout:3/606: symlink d0/la9 0 2024-03-18T14:43:18.788 INFO:tasks.workunit.client.1.smithi129.stdout:4/330: dwrite d0/d19/d46/d3e/f42 [0,4194304] 0 2024-03-18T14:43:18.788 INFO:tasks.workunit.client.1.smithi129.stdout:2/369: creat d7/d1f/d20/d36/f6d x:0 0 0 2024-03-18T14:43:18.791 INFO:tasks.workunit.client.1.smithi129.stdout:8/381: write d9/d11/d1a/d32/d41/d4d/f4f [51636,58616] 0 2024-03-18T14:43:18.791 INFO:tasks.workunit.client.0.smithi087.stdout:0/543: creat d0/d2/d3c/d73/fbf x:0 0 0 2024-03-18T14:43:18.793 INFO:tasks.workunit.client.1.smithi129.stdout:1/363: creat d1/d2/d28/d65/d19/d49/d56/f6f x:0 0 0 2024-03-18T14:43:18.793 INFO:tasks.workunit.client.0.smithi087.stdout:3/607: fsync d0/d3/df/f3f 0 2024-03-18T14:43:18.794 INFO:tasks.workunit.client.1.smithi129.stdout:1/364: fdatasync d1/f6c 0 2024-03-18T14:43:18.794 INFO:tasks.workunit.client.0.smithi087.stdout:4/527: mknod d2/db/ca7 0 2024-03-18T14:43:18.794 INFO:tasks.workunit.client.0.smithi087.stdout:3/608: stat d0/d3/d4f/l9e 0 2024-03-18T14:43:18.795 INFO:tasks.workunit.client.1.smithi129.stdout:9/357: creat d0/db/d1f/d20/d26/d19/d29/d36/f6d x:0 0 0 2024-03-18T14:43:18.795 INFO:tasks.workunit.client.1.smithi129.stdout:4/331: stat d0/d19/d46/c28 0 2024-03-18T14:43:18.795 INFO:tasks.workunit.client.1.smithi129.stdout:9/358: write d0/db/f5d [653543,73415] 0 2024-03-18T14:43:18.796 INFO:tasks.workunit.client.0.smithi087.stdout:3/609: chown d0/d3/d10/d7f/f82 246 1 2024-03-18T14:43:18.797 INFO:tasks.workunit.client.1.smithi129.stdout:4/332: write d0/d19/d46/d3e/f60 [843515,41591] 0 2024-03-18T14:43:18.797 INFO:tasks.workunit.client.0.smithi087.stdout:0/544: dwrite d0/d1a/d7b/d2a/d85/f7e [0,4194304] 0 2024-03-18T14:43:18.798 INFO:tasks.workunit.client.0.smithi087.stdout:0/545: chown d0/d2/f4a 152 1 2024-03-18T14:43:18.799 INFO:tasks.workunit.client.0.smithi087.stdout:6/525: rmdir d3 39 2024-03-18T14:43:18.801 INFO:tasks.workunit.client.1.smithi129.stdout:4/333: dwrite d0/d19/d46/d3e/f60 [0,4194304] 0 2024-03-18T14:43:18.801 INFO:tasks.workunit.client.1.smithi129.stdout:8/382: rename d9/d11/d53/l6e to d9/l7e 0 2024-03-18T14:43:18.801 INFO:tasks.workunit.client.0.smithi087.stdout:3/610: dwrite d0/de/d30/d46/f89 [0,4194304] 0 2024-03-18T14:43:18.802 INFO:tasks.workunit.client.0.smithi087.stdout:1/613: getdents d3/d1d/d1e/d43 0 2024-03-18T14:43:18.804 INFO:tasks.workunit.client.1.smithi129.stdout:4/334: dread d0/d19/f54 [0,4194304] 0 2024-03-18T14:43:18.805 INFO:tasks.workunit.client.0.smithi087.stdout:6/526: write d3/d7/d25/d62/d7c/da0/d96/d97/faa [4414178,6074] 0 2024-03-18T14:43:18.806 INFO:tasks.workunit.client.0.smithi087.stdout:0/546: creat d0/d2/d4/d19/d24/da3/fc0 x:0 0 0 2024-03-18T14:43:18.806 INFO:tasks.workunit.client.1.smithi129.stdout:9/359: truncate d0/db/d1f/d20/d26/d19/f6a 50093 0 2024-03-18T14:43:18.806 INFO:tasks.workunit.client.0.smithi087.stdout:6/527: fdatasync d3/d7/d25/d62/d7c/f94 0 2024-03-18T14:43:18.807 INFO:tasks.workunit.client.1.smithi129.stdout:9/360: dread - d0/db/d1f/d20/d25/f61 zero size 2024-03-18T14:43:18.808 INFO:tasks.workunit.client.0.smithi087.stdout:3/611: stat d0/l8 0 2024-03-18T14:43:18.808 INFO:tasks.workunit.client.1.smithi129.stdout:8/383: dwrite f6 [0,4194304] 0 2024-03-18T14:43:18.808 INFO:tasks.workunit.client.1.smithi129.stdout:4/335: mkdir d0/d19/d46/d2e/d66 0 2024-03-18T14:43:18.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/528: creat d2/db/d24/d30/d7b/d7f/da4/fa8 x:0 0 0 2024-03-18T14:43:18.809 INFO:tasks.workunit.client.0.smithi087.stdout:4/529: write d2/db/d67/f78 [74911,130431] 0 2024-03-18T14:43:18.810 INFO:tasks.workunit.client.1.smithi129.stdout:6/384: dread d3/d30/de/d6c/f53 [0,4194304] 0 2024-03-18T14:43:18.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/614: mkdir d3/d3c/db8/d8f/dc2 0 2024-03-18T14:43:18.814 INFO:tasks.workunit.client.1.smithi129.stdout:5/355: dread d0/dc/d18/f1d [0,4194304] 0 2024-03-18T14:43:18.815 INFO:tasks.workunit.client.1.smithi129.stdout:9/361: symlink d0/db/d1f/d20/d26/d19/d29/l6e 0 2024-03-18T14:43:18.815 INFO:tasks.workunit.client.0.smithi087.stdout:0/547: rmdir d0/d1a/d34/d3d 39 2024-03-18T14:43:18.816 INFO:tasks.workunit.client.0.smithi087.stdout:3/612: fsync d0/d3/df/f33 0 2024-03-18T14:43:18.819 INFO:tasks.workunit.client.1.smithi129.stdout:9/362: mkdir d0/db/d6f 0 2024-03-18T14:43:18.819 INFO:tasks.workunit.client.1.smithi129.stdout:4/336: dread d0/d19/d46/d3e/d21/f5c [0,4194304] 0 2024-03-18T14:43:18.820 INFO:tasks.workunit.client.1.smithi129.stdout:9/363: chown d0/c1 606 1 2024-03-18T14:43:18.821 INFO:tasks.workunit.client.0.smithi087.stdout:2/573: write d2/d4/f19 [1495637,66726] 0 2024-03-18T14:43:18.821 INFO:tasks.workunit.client.0.smithi087.stdout:2/574: dread - d2/d4/d22/f4d zero size 2024-03-18T14:43:18.824 INFO:tasks.workunit.client.1.smithi129.stdout:7/396: sync 2024-03-18T14:43:18.824 INFO:tasks.workunit.client.1.smithi129.stdout:7/397: dread - d4/d7/d8/f47 zero size 2024-03-18T14:43:18.828 INFO:tasks.workunit.client.1.smithi129.stdout:4/337: truncate d0/d1a/f23 1288193 0 2024-03-18T14:43:18.831 INFO:tasks.workunit.client.0.smithi087.stdout:4/530: rename d2/c6c to d2/db/de/ca9 0 2024-03-18T14:43:18.832 INFO:tasks.workunit.client.1.smithi129.stdout:7/398: rename d4/d2d/f34 to d4/d2d/d2e/d42/f7b 0 2024-03-18T14:43:18.832 INFO:tasks.workunit.client.0.smithi087.stdout:6/528: mknod d3/d7/d25/d62/d7c/d29/cb2 0 2024-03-18T14:43:18.832 INFO:tasks.workunit.client.1.smithi129.stdout:7/399: dread - d4/f4f zero size 2024-03-18T14:43:18.833 INFO:tasks.workunit.client.1.smithi129.stdout:4/338: dwrite d0/d19/d46/d3e/d21/d4d/d58/f65 [0,4194304] 0 2024-03-18T14:43:18.834 INFO:tasks.workunit.client.0.smithi087.stdout:2/575: creat d2/d4/d22/d2c/d3a/d40/fbc x:0 0 0 2024-03-18T14:43:18.839 INFO:tasks.workunit.client.0.smithi087.stdout:4/531: creat d2/db/d24/d30/d7b/d7f/faa x:0 0 0 2024-03-18T14:43:18.840 INFO:tasks.workunit.client.1.smithi129.stdout:9/364: dread d0/db/f18 [0,4194304] 0 2024-03-18T14:43:18.841 INFO:tasks.workunit.client.0.smithi087.stdout:2/576: mknod d2/d4/d22/d2c/d3a/d40/d4a/cbd 0 2024-03-18T14:43:18.841 INFO:tasks.workunit.client.1.smithi129.stdout:4/339: mknod d0/d19/d46/c67 0 2024-03-18T14:43:18.843 INFO:tasks.workunit.client.0.smithi087.stdout:1/615: truncate d3/f19 1957161 0 2024-03-18T14:43:18.845 INFO:tasks.workunit.client.0.smithi087.stdout:7/675: dread d1/d6/d16/fa3 [0,4194304] 0 2024-03-18T14:43:18.845 INFO:tasks.workunit.client.0.smithi087.stdout:4/532: read d2/db/d67/f78 [380696,77531] 0 2024-03-18T14:43:18.845 INFO:tasks.workunit.client.0.smithi087.stdout:7/676: fdatasync d1/d6/d29/fe1 0 2024-03-18T14:43:18.846 INFO:tasks.workunit.client.0.smithi087.stdout:1/616: mkdir d3/d1d/d1e/d43/da3/dc3 0 2024-03-18T14:43:18.847 INFO:tasks.workunit.client.1.smithi129.stdout:6/385: dread d3/d30/f1e [0,4194304] 0 2024-03-18T14:43:18.847 INFO:tasks.workunit.client.0.smithi087.stdout:7/677: fdatasync d1/d6/d29/d2f/d68/fab 0 2024-03-18T14:43:18.848 INFO:tasks.workunit.client.0.smithi087.stdout:5/592: sync 2024-03-18T14:43:18.848 INFO:tasks.workunit.client.0.smithi087.stdout:4/533: creat d2/db/d24/d30/d56/fab x:0 0 0 2024-03-18T14:43:18.849 INFO:tasks.workunit.client.1.smithi129.stdout:4/340: mknod d0/d19/d46/d3e/d21/d32/c68 0 2024-03-18T14:43:18.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/617: dread d3/d1d/d1e/f55 [0,4194304] 0 2024-03-18T14:43:18.851 INFO:tasks.workunit.client.0.smithi087.stdout:5/593: chown d13/d1b/f47 107229 1 2024-03-18T14:43:18.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/386: unlink d3/d5/l23 0 2024-03-18T14:43:18.853 INFO:tasks.workunit.client.0.smithi087.stdout:5/594: stat d13/d1b/d30/f7d 0 2024-03-18T14:43:18.853 INFO:tasks.workunit.client.0.smithi087.stdout:7/678: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f9c [0,4194304] 0 2024-03-18T14:43:18.853 INFO:tasks.workunit.client.0.smithi087.stdout:4/534: chown d2/f36 203844974 1 2024-03-18T14:43:18.853 INFO:tasks.workunit.client.0.smithi087.stdout:8/544: write d1/f1b [636451,1424] 0 2024-03-18T14:43:18.854 INFO:tasks.workunit.client.1.smithi129.stdout:3/343: dwrite d4/dd/d1f/d5f/f5b [0,4194304] 0 2024-03-18T14:43:18.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/399: dwrite d0/d14/d3a/d4a/d61/f76 [0,4194304] 0 2024-03-18T14:43:18.855 INFO:tasks.workunit.client.1.smithi129.stdout:0/400: readlink d0/d23/d35/d3b/l65 0 2024-03-18T14:43:18.861 INFO:tasks.workunit.client.0.smithi087.stdout:1/618: rmdir d3/d1d/d45 39 2024-03-18T14:43:18.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/595: mkdir d13/d1b/d27/d35/dc6 0 2024-03-18T14:43:18.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/596: fsync d13/d1b/f2b 0 2024-03-18T14:43:18.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/597: dread - d13/d1b/d27/d28/d9a/fc5 zero size 2024-03-18T14:43:18.863 INFO:tasks.workunit.client.1.smithi129.stdout:1/365: sync 2024-03-18T14:43:18.866 INFO:tasks.workunit.client.0.smithi087.stdout:9/657: dwrite db/f10 [0,4194304] 0 2024-03-18T14:43:18.870 INFO:tasks.workunit.client.0.smithi087.stdout:7/679: truncate d1/d6/d16/fa3 1142369 0 2024-03-18T14:43:18.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/370: write d7/d1f/d20/d2a/f54 [5075797,18476] 0 2024-03-18T14:43:18.871 INFO:tasks.workunit.client.0.smithi087.stdout:7/680: write d1/d6/da/d59/dbe/fd8 [370402,101396] 0 2024-03-18T14:43:18.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/577: dread d2/d4/d22/d2c/f95 [0,4194304] 0 2024-03-18T14:43:18.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/578: write d2/d44/d72/fad [165574,126310] 0 2024-03-18T14:43:18.875 INFO:tasks.workunit.client.1.smithi129.stdout:6/387: link d3/d30/l3e d3/d38/d57/l76 0 2024-03-18T14:43:18.876 INFO:tasks.workunit.client.1.smithi129.stdout:5/356: write d0/df/f48 [3814217,66526] 0 2024-03-18T14:43:18.876 INFO:tasks.workunit.client.1.smithi129.stdout:3/344: link d4/d11/d1d/d27/l56 d4/d11/d1d/d50/l73 0 2024-03-18T14:43:18.876 INFO:tasks.workunit.client.0.smithi087.stdout:3/613: write d0/de/d30/f9f [679106,118123] 0 2024-03-18T14:43:18.879 INFO:tasks.workunit.client.0.smithi087.stdout:6/529: dwrite d3/d7/d25/d62/d7c/d29/d7d/f8c [0,4194304] 0 2024-03-18T14:43:18.882 INFO:tasks.workunit.client.0.smithi087.stdout:0/548: sync 2024-03-18T14:43:18.882 INFO:tasks.workunit.client.1.smithi129.stdout:0/401: getdents d0/d14/d3a/d4a/d61 0 2024-03-18T14:43:18.883 INFO:tasks.workunit.client.0.smithi087.stdout:0/549: write d0/d2/d4/f4c [3572219,65906] 0 2024-03-18T14:43:18.885 INFO:tasks.workunit.client.0.smithi087.stdout:5/598: fdatasync d13/d1b/d27/d35/f4b 0 2024-03-18T14:43:18.886 INFO:tasks.workunit.client.1.smithi129.stdout:6/388: creat d3/d30/d44/f77 x:0 0 0 2024-03-18T14:43:18.886 INFO:tasks.workunit.client.1.smithi129.stdout:5/357: symlink d0/dc/d18/d2b/l6b 0 2024-03-18T14:43:18.887 INFO:tasks.workunit.client.1.smithi129.stdout:5/358: readlink d0/l7 0 2024-03-18T14:43:18.887 INFO:tasks.workunit.client.0.smithi087.stdout:2/579: creat d2/d4/d22/d2c/d3a/d76/d9a/d9b/fbe x:0 0 0 2024-03-18T14:43:18.888 INFO:tasks.workunit.client.0.smithi087.stdout:5/599: write d13/d1b/d70/da8/fb2 [219222,77645] 0 2024-03-18T14:43:18.888 INFO:tasks.workunit.client.0.smithi087.stdout:8/545: dwrite d1/d6/d9/f3a [0,4194304] 0 2024-03-18T14:43:18.889 INFO:tasks.workunit.client.1.smithi129.stdout:8/384: sync 2024-03-18T14:43:18.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/385: dread - d9/d11/d1a/f77 zero size 2024-03-18T14:43:18.890 INFO:tasks.workunit.client.0.smithi087.stdout:6/530: creat d3/d7/d25/d62/d7c/d29/d22/d61/fb3 x:0 0 0 2024-03-18T14:43:18.890 INFO:tasks.workunit.client.0.smithi087.stdout:5/600: chown d13/d1b/d27/d28/c9f 109146367 1 2024-03-18T14:43:18.890 INFO:tasks.workunit.client.0.smithi087.stdout:2/580: write d2/d4/d22/d2c/d3a/f51 [2309406,53807] 0 2024-03-18T14:43:18.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/366: truncate d1/d35/f4c 1041527 0 2024-03-18T14:43:18.893 INFO:tasks.workunit.client.1.smithi129.stdout:0/402: creat d0/d23/d35/d3b/f79 x:0 0 0 2024-03-18T14:43:18.893 INFO:tasks.workunit.client.0.smithi087.stdout:0/550: read d0/d1a/d80/f92 [674806,67207] 0 2024-03-18T14:43:18.893 INFO:tasks.workunit.client.0.smithi087.stdout:1/619: truncate d3/d1d/d1f/d34/f53 3175617 0 2024-03-18T14:43:18.894 INFO:tasks.workunit.client.1.smithi129.stdout:2/371: creat d7/f6e x:0 0 0 2024-03-18T14:43:18.897 INFO:tasks.workunit.client.1.smithi129.stdout:0/403: readlink d0/d14/d3a/l4f 0 2024-03-18T14:43:18.897 INFO:tasks.workunit.client.1.smithi129.stdout:1/367: dwrite d1/d2/d28/d65/d19/f61 [0,4194304] 0 2024-03-18T14:43:18.897 INFO:tasks.workunit.client.1.smithi129.stdout:8/386: getdents d9/d11/d1a/d32/d3a/d70 0 2024-03-18T14:43:18.899 INFO:tasks.workunit.client.1.smithi129.stdout:3/345: getdents d4/dd 0 2024-03-18T14:43:18.899 INFO:tasks.workunit.client.0.smithi087.stdout:9/658: rename db/d18/d1c/d69/d6f/c7a to db/d18/cd7 0 2024-03-18T14:43:18.899 INFO:tasks.workunit.client.0.smithi087.stdout:1/620: rename d3/d3c/db8 to d3/d3c/db8/d8f/d99/dc4 22 2024-03-18T14:43:18.899 INFO:tasks.workunit.client.0.smithi087.stdout:1/621: chown d3/d1d/d1e/fa2 226053777 1 2024-03-18T14:43:18.900 INFO:tasks.workunit.client.1.smithi129.stdout:2/372: rename d7/d1f/d34/f30 to d7/d1f/d20/d2b/d41/f6f 0 2024-03-18T14:43:18.901 INFO:tasks.workunit.client.1.smithi129.stdout:3/346: write d4/d11/d34/d4c/f5d [1450678,49373] 0 2024-03-18T14:43:18.901 INFO:tasks.workunit.client.0.smithi087.stdout:6/531: chown d3/d7/d25/d62/d7c/l63 18 1 2024-03-18T14:43:18.902 INFO:tasks.workunit.client.1.smithi129.stdout:1/368: chown d1/d2/d28/d65/d19/d52/l6d 15 1 2024-03-18T14:43:18.902 INFO:tasks.workunit.client.1.smithi129.stdout:8/387: write d9/d11/d1a/d32/d41/d4d/f4f [567540,94567] 0 2024-03-18T14:43:18.902 INFO:tasks.workunit.client.1.smithi129.stdout:6/389: dwrite d3/d30/f1e [0,4194304] 0 2024-03-18T14:43:18.903 INFO:tasks.workunit.client.0.smithi087.stdout:1/622: dwrite d3/d1d/d1e/d20/f5c [0,4194304] 0 2024-03-18T14:43:18.904 INFO:tasks.workunit.client.1.smithi129.stdout:1/369: write d1/d2/f4b [374108,94056] 0 2024-03-18T14:43:18.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/581: unlink d2/d4/d22/d2c/d3a/d40/f80 0 2024-03-18T14:43:18.905 INFO:tasks.workunit.client.1.smithi129.stdout:9/365: truncate d0/db/d1f/d20/d26/d19/f6a 220671 0 2024-03-18T14:43:18.905 INFO:tasks.workunit.client.0.smithi087.stdout:1/623: chown d3/d1d/d67/d94/fbb 73932792 1 2024-03-18T14:43:18.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/551: fdatasync d0/d1a/d7b/d2a/f68 0 2024-03-18T14:43:18.906 INFO:tasks.workunit.client.0.smithi087.stdout:1/624: dread d3/d1d/d1e/f55 [0,4194304] 0 2024-03-18T14:43:18.907 INFO:tasks.workunit.client.1.smithi129.stdout:9/366: write d0/db/d1f/d20/d25/f61 [141953,103250] 0 2024-03-18T14:43:18.907 INFO:tasks.workunit.client.1.smithi129.stdout:3/347: mknod d4/d11/c74 0 2024-03-18T14:43:18.907 INFO:tasks.workunit.client.1.smithi129.stdout:8/388: unlink d9/d11/d53/l73 0 2024-03-18T14:43:18.908 INFO:tasks.workunit.client.0.smithi087.stdout:9/659: stat db/d18/l8e 0 2024-03-18T14:43:18.909 INFO:tasks.workunit.client.1.smithi129.stdout:4/341: dwrite d0/d1a/f23 [0,4194304] 0 2024-03-18T14:43:18.909 INFO:tasks.workunit.client.1.smithi129.stdout:8/389: write f6 [3739229,74698] 0 2024-03-18T14:43:18.910 INFO:tasks.workunit.client.1.smithi129.stdout:9/367: chown d0/db/d11/c52 0 1 2024-03-18T14:43:18.910 INFO:tasks.workunit.client.0.smithi087.stdout:2/582: dwrite d2/d4/d22/d2c/d3a/d40/d52/fae [0,4194304] 0 2024-03-18T14:43:18.911 INFO:tasks.workunit.client.0.smithi087.stdout:2/583: write d2/d4/d22/f4d [39870,72530] 0 2024-03-18T14:43:18.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/584: dread - d2/d4/d22/d2c/f3d zero size 2024-03-18T14:43:18.913 INFO:tasks.workunit.client.0.smithi087.stdout:6/532: symlink d3/d7/d25/d62/d8b/lb4 0 2024-03-18T14:43:18.915 INFO:tasks.workunit.client.0.smithi087.stdout:7/681: getdents d1/d6/d16/dc 0 2024-03-18T14:43:18.915 INFO:tasks.workunit.client.1.smithi129.stdout:5/359: write d0/f67 [3400742,3852] 0 2024-03-18T14:43:18.915 INFO:tasks.workunit.client.1.smithi129.stdout:0/404: getdents d0 0 2024-03-18T14:43:18.916 INFO:tasks.workunit.client.1.smithi129.stdout:5/360: stat d0/dc/d18/l2a 0 2024-03-18T14:43:18.916 INFO:tasks.workunit.client.0.smithi087.stdout:5/601: dread d13/d1b/f59 [0,4194304] 0 2024-03-18T14:43:18.917 INFO:tasks.workunit.client.1.smithi129.stdout:8/390: mknod d9/d11/d55/d68/c7f 0 2024-03-18T14:43:18.917 INFO:tasks.workunit.client.1.smithi129.stdout:8/391: stat f8 0 2024-03-18T14:43:18.917 INFO:tasks.workunit.client.1.smithi129.stdout:4/342: write d0/d19/d46/d3e/d21/d32/f57 [677162,7022] 0 2024-03-18T14:43:18.919 INFO:tasks.workunit.client.1.smithi129.stdout:9/368: mkdir d0/db/d1f/d20/d4a/d70 0 2024-03-18T14:43:18.920 INFO:tasks.workunit.client.1.smithi129.stdout:2/373: getdents d7/d3f/d5f 0 2024-03-18T14:43:18.920 INFO:tasks.workunit.client.1.smithi129.stdout:9/369: chown d0/d15/l5b 19 1 2024-03-18T14:43:18.921 INFO:tasks.workunit.client.0.smithi087.stdout:9/660: creat db/d18/d1e/d28/d76/fd8 x:0 0 0 2024-03-18T14:43:18.921 INFO:tasks.workunit.client.1.smithi129.stdout:0/405: dwrite d0/d14/f20 [4194304,4194304] 0 2024-03-18T14:43:18.922 INFO:tasks.workunit.client.1.smithi129.stdout:7/400: sync 2024-03-18T14:43:18.923 INFO:tasks.workunit.client.1.smithi129.stdout:1/370: rename d1/d2/d28/d65/d19/d49 to d1/d2/d70 0 2024-03-18T14:43:18.925 INFO:tasks.workunit.client.0.smithi087.stdout:4/535: truncate d2/db/d24/f33 905193 0 2024-03-18T14:43:18.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/392: creat d9/d11/d53/f80 x:0 0 0 2024-03-18T14:43:18.927 INFO:tasks.workunit.client.0.smithi087.stdout:7/682: stat d1/d6/f1d 0 2024-03-18T14:43:18.927 INFO:tasks.workunit.client.1.smithi129.stdout:7/401: dwrite d4/d2d/d2e/f41 [0,4194304] 0 2024-03-18T14:43:18.928 INFO:tasks.workunit.client.1.smithi129.stdout:8/393: stat d9/d11/d18/l5c 0 2024-03-18T14:43:18.929 INFO:tasks.workunit.client.1.smithi129.stdout:8/394: fsync f4 0 2024-03-18T14:43:18.929 INFO:tasks.workunit.client.0.smithi087.stdout:7/683: dread d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:18.929 INFO:tasks.workunit.client.0.smithi087.stdout:1/625: mkdir d3/d1d/d1f/dab/dc5 0 2024-03-18T14:43:18.930 INFO:tasks.workunit.client.1.smithi129.stdout:2/374: rename d7/d1c/d32/l3c to d7/d1c/d32/l70 0 2024-03-18T14:43:18.931 INFO:tasks.workunit.client.1.smithi129.stdout:1/371: dwrite d1/d35/f45 [0,4194304] 0 2024-03-18T14:43:18.931 INFO:tasks.workunit.client.1.smithi129.stdout:8/395: chown d9/d11/d1a/d14/c61 4 1 2024-03-18T14:43:18.931 INFO:tasks.workunit.client.0.smithi087.stdout:8/546: sync 2024-03-18T14:43:18.932 INFO:tasks.workunit.client.1.smithi129.stdout:1/372: fdatasync d1/d2/d28/d65/f5a 0 2024-03-18T14:43:18.932 INFO:tasks.workunit.client.1.smithi129.stdout:0/406: truncate d0/f55 1337424 0 2024-03-18T14:43:18.933 INFO:tasks.workunit.client.0.smithi087.stdout:2/585: creat d2/d4/dbb/fbf x:0 0 0 2024-03-18T14:43:18.933 INFO:tasks.workunit.client.1.smithi129.stdout:1/373: chown d1/d2/l59 314156 1 2024-03-18T14:43:18.938 INFO:tasks.workunit.client.1.smithi129.stdout:9/370: truncate d0/db/d11/f27 1155034 0 2024-03-18T14:43:18.939 INFO:tasks.workunit.client.1.smithi129.stdout:6/390: fdatasync d3/d30/f1e 0 2024-03-18T14:43:18.939 INFO:tasks.workunit.client.1.smithi129.stdout:2/375: mknod d7/d1f/d20/c71 0 2024-03-18T14:43:18.940 INFO:tasks.workunit.client.1.smithi129.stdout:6/391: chown d3/d30/de/d6c/c4c 249 1 2024-03-18T14:43:18.940 INFO:tasks.workunit.client.1.smithi129.stdout:2/376: chown d7/d1f/d20/d2b/d41/d65 3227 1 2024-03-18T14:43:18.940 INFO:tasks.workunit.client.1.smithi129.stdout:4/343: dread d0/d1a/f25 [0,4194304] 0 2024-03-18T14:43:18.941 INFO:tasks.workunit.client.0.smithi087.stdout:1/626: mknod d3/d3c/cc6 0 2024-03-18T14:43:18.941 INFO:tasks.workunit.client.0.smithi087.stdout:0/552: link d0/d2/d4/d19/c59 d0/dab/cc1 0 2024-03-18T14:43:18.942 INFO:tasks.workunit.client.0.smithi087.stdout:0/553: chown d0/d1a/d8c 167 1 2024-03-18T14:43:18.942 INFO:tasks.workunit.client.0.smithi087.stdout:1/627: readlink d3/d1d/d1e/d20/d7a/l92 0 2024-03-18T14:43:18.943 INFO:tasks.workunit.client.0.smithi087.stdout:0/554: chown d0/d2/d4/f98 107390 1 2024-03-18T14:43:18.944 INFO:tasks.workunit.client.0.smithi087.stdout:2/586: rename d2/d4/d22/d2c/d3a/c6c to d2/d44/d72/d8a/da7/cc0 0 2024-03-18T14:43:18.946 INFO:tasks.workunit.client.1.smithi129.stdout:4/344: dwrite d0/d19/d46/d3e/d21/d32/f57 [0,4194304] 0 2024-03-18T14:43:18.946 INFO:tasks.workunit.client.0.smithi087.stdout:2/587: read d2/d4/f15 [5592488,99657] 0 2024-03-18T14:43:18.947 INFO:tasks.workunit.client.0.smithi087.stdout:1/628: dwrite d3/d1d/d1f/d34/f3e [0,4194304] 0 2024-03-18T14:43:18.948 INFO:tasks.workunit.client.0.smithi087.stdout:2/588: write d2/d4/d22/d2c/d3a/d49/f57 [48289,104261] 0 2024-03-18T14:43:18.949 INFO:tasks.workunit.client.1.smithi129.stdout:0/407: mkdir d0/d14/d3a/d4a/d7a 0 2024-03-18T14:43:18.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/348: rename d4/dd/d41/c6c to d4/d11/d34/d53/c75 0 2024-03-18T14:43:18.949 INFO:tasks.workunit.client.1.smithi129.stdout:6/392: mknod d3/d30/de/c78 0 2024-03-18T14:43:18.950 INFO:tasks.workunit.client.1.smithi129.stdout:9/371: write d0/db/d1f/d20/d26/f68 [3991107,114199] 0 2024-03-18T14:43:18.950 INFO:tasks.workunit.client.1.smithi129.stdout:3/349: write d4/f54 [95427,24193] 0 2024-03-18T14:43:18.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/661: getdents db/d18/d1e/d28/d76/d80 0 2024-03-18T14:43:18.951 INFO:tasks.workunit.client.0.smithi087.stdout:9/662: readlink db/d31/lbd 0 2024-03-18T14:43:18.953 INFO:tasks.workunit.client.0.smithi087.stdout:4/536: truncate d2/d13/d28/f2d 524826 0 2024-03-18T14:43:18.955 INFO:tasks.workunit.client.1.smithi129.stdout:3/350: dwrite d4/dd/d1f/d5f/d31/f5c [0,4194304] 0 2024-03-18T14:43:18.957 INFO:tasks.workunit.client.1.smithi129.stdout:8/396: link f4 d9/d11/d1a/d32/d3a/d70/f81 0 2024-03-18T14:43:18.957 INFO:tasks.workunit.client.0.smithi087.stdout:7/684: sync 2024-03-18T14:43:18.958 INFO:tasks.workunit.client.0.smithi087.stdout:2/589: write d2/d4/d22/d2c/d3a/d49/fa3 [1138734,16468] 0 2024-03-18T14:43:18.958 INFO:tasks.workunit.client.1.smithi129.stdout:2/377: mkdir d7/d1f/d20/d72 0 2024-03-18T14:43:18.958 INFO:tasks.workunit.client.1.smithi129.stdout:2/378: chown d7/l9 2 1 2024-03-18T14:43:18.958 INFO:tasks.workunit.client.1.smithi129.stdout:8/397: write d9/d11/d1a/d32/d3a/d5d/f62 [181603,55521] 0 2024-03-18T14:43:18.959 INFO:tasks.workunit.client.0.smithi087.stdout:7/685: read d1/d6/d29/d2f/d68/d65/d60/f93 [1701229,53527] 0 2024-03-18T14:43:18.960 INFO:tasks.workunit.client.1.smithi129.stdout:8/398: read - d9/d11/d1a/d32/d3a/f59 zero size 2024-03-18T14:43:18.960 INFO:tasks.workunit.client.0.smithi087.stdout:1/629: rename d3/c1a to d3/d1d/d1e/d43/d50/d72/cc7 0 2024-03-18T14:43:18.960 INFO:tasks.workunit.client.0.smithi087.stdout:7/686: fsync d1/d6/d29/f92 0 2024-03-18T14:43:18.965 INFO:tasks.workunit.client.1.smithi129.stdout:5/361: rename d0/dc/d18/d4b to d0/d32/d34/d6c 0 2024-03-18T14:43:18.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/590: rmdir d2/d44/d72/d8a 39 2024-03-18T14:43:18.966 INFO:tasks.workunit.client.1.smithi129.stdout:5/362: write d0/dc/d18/d2b/f57 [3569855,129329] 0 2024-03-18T14:43:18.966 INFO:tasks.workunit.client.0.smithi087.stdout:2/591: write d2/d4/f6a [417545,15070] 0 2024-03-18T14:43:18.967 INFO:tasks.workunit.client.0.smithi087.stdout:2/592: write d2/d4/d22/d2c/d3a/d76/f7e [406472,108183] 0 2024-03-18T14:43:18.969 INFO:tasks.workunit.client.1.smithi129.stdout:2/379: readlink d7/d1c/d32/l70 0 2024-03-18T14:43:18.969 INFO:tasks.workunit.client.1.smithi129.stdout:2/380: write f0 [544877,124513] 0 2024-03-18T14:43:18.970 INFO:tasks.workunit.client.1.smithi129.stdout:0/408: creat d0/d23/d35/d3b/d42/f7b x:0 0 0 2024-03-18T14:43:18.971 INFO:tasks.workunit.client.1.smithi129.stdout:0/409: chown d0/d14/d28/d63/l5b 8940 1 2024-03-18T14:43:18.973 INFO:tasks.workunit.client.0.smithi087.stdout:1/630: read d3/d1d/d1e/d20/d7a/fbe [501436,76414] 0 2024-03-18T14:43:18.973 INFO:tasks.workunit.client.0.smithi087.stdout:9/663: rename db/d18/d3a/l79 to db/d12/ld9 0 2024-03-18T14:43:18.974 INFO:tasks.workunit.client.0.smithi087.stdout:4/537: link d2/db/d3c/l62 d2/db/d7a/lac 0 2024-03-18T14:43:18.975 INFO:tasks.workunit.client.1.smithi129.stdout:2/381: creat d7/d1f/d20/d36/f73 x:0 0 0 2024-03-18T14:43:18.976 INFO:tasks.workunit.client.1.smithi129.stdout:2/382: chown d7/d1f/d20/d2b/d41/c69 12369054 1 2024-03-18T14:43:18.976 INFO:tasks.workunit.client.1.smithi129.stdout:2/383: stat d7/d1f/d34/l13 0 2024-03-18T14:43:18.976 INFO:tasks.workunit.client.1.smithi129.stdout:5/363: creat d0/dc/d1a/d61/f6d x:0 0 0 2024-03-18T14:43:18.977 INFO:tasks.workunit.client.1.smithi129.stdout:2/384: chown d7/d1f/d20/f55 770 1 2024-03-18T14:43:18.978 INFO:tasks.workunit.client.1.smithi129.stdout:3/351: creat d4/d11/d34/f76 x:0 0 0 2024-03-18T14:43:18.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/385: write d7/d1f/f52 [468291,123233] 0 2024-03-18T14:43:18.980 INFO:tasks.workunit.client.1.smithi129.stdout:2/386: chown d7/d1f/d20/d36/f38 1630103995 1 2024-03-18T14:43:18.980 INFO:tasks.workunit.client.1.smithi129.stdout:2/387: chown d7/d1f/d20/d72 26753 1 2024-03-18T14:43:18.981 INFO:tasks.workunit.client.0.smithi087.stdout:3/614: truncate d0/d1c/f39 2356484 0 2024-03-18T14:43:18.983 INFO:tasks.workunit.client.1.smithi129.stdout:7/402: rename d4/d7/d38/f5d to d4/d2d/d2e/d42/f7c 0 2024-03-18T14:43:18.986 INFO:tasks.workunit.client.0.smithi087.stdout:3/615: dread d0/d3/d4f/f6f [0,4194304] 0 2024-03-18T14:43:18.987 INFO:tasks.workunit.client.1.smithi129.stdout:7/403: mknod d4/d7/d38/d5c/c7d 0 2024-03-18T14:43:18.988 INFO:tasks.workunit.client.0.smithi087.stdout:6/533: dread d3/d7/d25/d62/d7c/d29/d22/d75/d92/f99 [0,4194304] 0 2024-03-18T14:43:18.989 INFO:tasks.workunit.client.1.smithi129.stdout:5/364: dread d0/df/f59 [0,4194304] 0 2024-03-18T14:43:18.990 INFO:tasks.workunit.client.1.smithi129.stdout:6/393: dread d3/f41 [0,4194304] 0 2024-03-18T14:43:18.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/593: creat d2/d4/d22/d2c/d3a/fc1 x:0 0 0 2024-03-18T14:43:18.991 INFO:tasks.workunit.client.0.smithi087.stdout:5/602: write d13/d1b/f3a [1843732,65765] 0 2024-03-18T14:43:18.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/594: write d2/f85 [1090324,103281] 0 2024-03-18T14:43:18.991 INFO:tasks.workunit.client.1.smithi129.stdout:8/399: dread d9/f1f [0,4194304] 0 2024-03-18T14:43:18.993 INFO:tasks.workunit.client.0.smithi087.stdout:8/547: write d1/d6/d2f/d44/d45/d50/f73 [117741,81650] 0 2024-03-18T14:43:18.995 INFO:tasks.workunit.client.0.smithi087.stdout:0/555: truncate d0/d2/f17 2937622 0 2024-03-18T14:43:18.997 INFO:tasks.workunit.client.1.smithi129.stdout:1/374: sync 2024-03-18T14:43:18.999 INFO:tasks.workunit.client.1.smithi129.stdout:0/410: dread d0/d23/d35/f36 [4194304,4194304] 0 2024-03-18T14:43:19.001 INFO:tasks.workunit.client.1.smithi129.stdout:5/365: mkdir d0/d32/d3a/d52/d6e 0 2024-03-18T14:43:19.001 INFO:tasks.workunit.client.1.smithi129.stdout:1/375: read d1/d2/d28/f63 [18635,99424] 0 2024-03-18T14:43:19.001 INFO:tasks.workunit.client.1.smithi129.stdout:1/376: write d1/f60 [954195,82784] 0 2024-03-18T14:43:19.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/394: unlink d3/f3c 0 2024-03-18T14:43:19.005 INFO:tasks.workunit.client.1.smithi129.stdout:5/366: dwrite d0/f11 [4194304,4194304] 0 2024-03-18T14:43:19.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/631: chown d3/d1d/d1e/d43/d50/d72/cc7 24278 1 2024-03-18T14:43:19.007 INFO:tasks.workunit.client.0.smithi087.stdout:1/632: write d3/d1d/d1e/d20/f85 [1088004,31786] 0 2024-03-18T14:43:19.009 INFO:tasks.workunit.client.1.smithi129.stdout:2/388: rmdir d7/d1f/d20/d2b/d41/d65/d6a 0 2024-03-18T14:43:19.010 INFO:tasks.workunit.client.1.smithi129.stdout:2/389: stat d7/d1c/f26 0 2024-03-18T14:43:19.010 INFO:tasks.workunit.client.1.smithi129.stdout:3/352: getdents d4/d11/d34 0 2024-03-18T14:43:19.010 INFO:tasks.workunit.client.1.smithi129.stdout:2/390: readlink d7/d1c/d32/l47 0 2024-03-18T14:43:19.012 INFO:tasks.workunit.client.0.smithi087.stdout:0/556: fdatasync d0/f11 0 2024-03-18T14:43:19.014 INFO:tasks.workunit.client.1.smithi129.stdout:1/377: mkdir d1/d2/d70/d71 0 2024-03-18T14:43:19.014 INFO:tasks.workunit.client.1.smithi129.stdout:6/395: mkdir d3/d30/df/d28/d79 0 2024-03-18T14:43:19.015 INFO:tasks.workunit.client.0.smithi087.stdout:9/664: mknod db/d18/d1e/d28/d76/db7/dd5/cda 0 2024-03-18T14:43:19.016 INFO:tasks.workunit.client.1.smithi129.stdout:0/411: dwrite d0/d23/d29/f58 [0,4194304] 0 2024-03-18T14:43:19.016 INFO:tasks.workunit.client.1.smithi129.stdout:5/367: rename d0/dc/l50 to d0/dc/d1a/d61/l6f 0 2024-03-18T14:43:19.016 INFO:tasks.workunit.client.1.smithi129.stdout:8/400: symlink d9/d11/d53/d5f/l82 0 2024-03-18T14:43:19.017 INFO:tasks.workunit.client.1.smithi129.stdout:0/412: chown d0/d23 403 1 2024-03-18T14:43:19.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/404: link d4/d7/d8/d3b/l3c d4/d2d/d2e/l7e 0 2024-03-18T14:43:19.020 INFO:tasks.workunit.client.0.smithi087.stdout:3/616: mknod d0/de/caa 0 2024-03-18T14:43:19.020 INFO:tasks.workunit.client.0.smithi087.stdout:3/617: stat d0/de 0 2024-03-18T14:43:19.023 INFO:tasks.workunit.client.1.smithi129.stdout:7/405: read d4/d7/ff [113417,16978] 0 2024-03-18T14:43:19.024 INFO:tasks.workunit.client.1.smithi129.stdout:1/378: dwrite d1/d2/d28/d65/d19/d52/f6a [0,4194304] 0 2024-03-18T14:43:19.026 INFO:tasks.workunit.client.0.smithi087.stdout:7/687: getdents d1/d6/d29/d2f/d68 0 2024-03-18T14:43:19.026 INFO:tasks.workunit.client.1.smithi129.stdout:5/368: dwrite d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:19.026 INFO:tasks.workunit.client.0.smithi087.stdout:7/688: chown d1/f20 109805267 1 2024-03-18T14:43:19.027 INFO:tasks.workunit.client.0.smithi087.stdout:7/689: chown d1/d6/d29/fe1 532796435 1 2024-03-18T14:43:19.027 INFO:tasks.workunit.client.1.smithi129.stdout:6/396: dwrite d3/d30/de/d49/f50 [4194304,4194304] 0 2024-03-18T14:43:19.027 INFO:tasks.workunit.client.0.smithi087.stdout:0/557: creat d0/d2/d4/d19/d24/fc2 x:0 0 0 2024-03-18T14:43:19.029 INFO:tasks.workunit.client.0.smithi087.stdout:9/665: creat db/d18/d51/d8f/fdb x:0 0 0 2024-03-18T14:43:19.030 INFO:tasks.workunit.client.0.smithi087.stdout:3/618: chown d0/d1c/l74 43640 1 2024-03-18T14:43:19.030 INFO:tasks.workunit.client.0.smithi087.stdout:2/595: link d2/d4/c1f d2/d4/d22/d2c/d3a/d40/d98/cc2 0 2024-03-18T14:43:19.030 INFO:tasks.workunit.client.0.smithi087.stdout:3/619: chown d0/de/d30/f9f 68533 1 2024-03-18T14:43:19.031 INFO:tasks.workunit.client.1.smithi129.stdout:5/369: dwrite d0/f9 [0,4194304] 0 2024-03-18T14:43:19.031 INFO:tasks.workunit.client.1.smithi129.stdout:4/345: sync 2024-03-18T14:43:19.033 INFO:tasks.workunit.client.1.smithi129.stdout:2/391: truncate d7/f58 1307903 0 2024-03-18T14:43:19.033 INFO:tasks.workunit.client.1.smithi129.stdout:3/353: getdents d4/dd/d1f/d5f 0 2024-03-18T14:43:19.033 INFO:tasks.workunit.client.0.smithi087.stdout:7/690: creat d1/d8e/d95/dae/ff0 x:0 0 0 2024-03-18T14:43:19.034 INFO:tasks.workunit.client.1.smithi129.stdout:0/413: creat d0/d14/d28/d63/f7c x:0 0 0 2024-03-18T14:43:19.034 INFO:tasks.workunit.client.1.smithi129.stdout:3/354: write d4/dd/f3d [3591582,57430] 0 2024-03-18T14:43:19.034 INFO:tasks.workunit.client.1.smithi129.stdout:2/392: chown d7/d1f/d20/d2b/d41/f6f 39957043 1 2024-03-18T14:43:19.035 INFO:tasks.workunit.client.0.smithi087.stdout:9/666: creat db/d18/d3a/fdc x:0 0 0 2024-03-18T14:43:19.038 INFO:tasks.workunit.client.0.smithi087.stdout:0/558: mkdir d0/d2/d4/d27/dc3 0 2024-03-18T14:43:19.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/620: fdatasync d0/d3/d40/f97 0 2024-03-18T14:43:19.041 INFO:tasks.workunit.client.0.smithi087.stdout:2/596: mkdir d2/d4/d22/d2c/d3a/d76/dc3 0 2024-03-18T14:43:19.042 INFO:tasks.workunit.client.1.smithi129.stdout:4/346: symlink d0/d19/d46/d3e/d21/l69 0 2024-03-18T14:43:19.042 INFO:tasks.workunit.client.1.smithi129.stdout:0/414: creat d0/d23/d35/d50/f7d x:0 0 0 2024-03-18T14:43:19.043 INFO:tasks.workunit.client.0.smithi087.stdout:0/559: mknod d0/d2/d4/d19/d24/da3/cc4 0 2024-03-18T14:43:19.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/355: creat d4/dd/d1f/d5f/d31/f77 x:0 0 0 2024-03-18T14:43:19.046 INFO:tasks.workunit.client.1.smithi129.stdout:1/379: unlink d1/cf 0 2024-03-18T14:43:19.046 INFO:tasks.workunit.client.1.smithi129.stdout:1/380: fsync d1/d2/d28/d65/d19/f4e 0 2024-03-18T14:43:19.047 INFO:tasks.workunit.client.0.smithi087.stdout:1/633: write d3/d1d/d1f/f7d [2197368,69516] 0 2024-03-18T14:43:19.047 INFO:tasks.workunit.client.1.smithi129.stdout:6/397: mknod d3/d30/df/d28/d79/c7a 0 2024-03-18T14:43:19.050 INFO:tasks.workunit.client.1.smithi129.stdout:7/406: rename d4/d7/d38/d61/f6c to d4/d2d/d2e/d42/d58/f7f 0 2024-03-18T14:43:19.050 INFO:tasks.workunit.client.1.smithi129.stdout:5/370: getdents d0/d32/d3a/d52/d6e 0 2024-03-18T14:43:19.051 INFO:tasks.workunit.client.0.smithi087.stdout:2/597: unlink d2/d4/d22/d2c/d3a/f61 0 2024-03-18T14:43:19.053 INFO:tasks.workunit.client.1.smithi129.stdout:4/347: mkdir d0/d9/d6a 0 2024-03-18T14:43:19.053 INFO:tasks.workunit.client.1.smithi129.stdout:4/348: chown d0/d3c/l48 59414372 1 2024-03-18T14:43:19.054 INFO:tasks.workunit.client.0.smithi087.stdout:1/634: readlink d3/l11 0 2024-03-18T14:43:19.054 INFO:tasks.workunit.client.1.smithi129.stdout:4/349: fsync d0/d1a/f24 0 2024-03-18T14:43:19.055 INFO:tasks.workunit.client.0.smithi087.stdout:2/598: dwrite d2/d4/d22/d2c/d3a/d40/fbc [0,4194304] 0 2024-03-18T14:43:19.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/635: chown d3/d1d/d1f/f70 10364971 1 2024-03-18T14:43:19.057 INFO:tasks.workunit.client.0.smithi087.stdout:2/599: chown d2/d4/d22/d2c/d3a/fc1 0 1 2024-03-18T14:43:19.057 INFO:tasks.workunit.client.0.smithi087.stdout:4/538: dread d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:19.057 INFO:tasks.workunit.client.0.smithi087.stdout:6/534: truncate d3/d7/d25/d62/d7c/d29/d22/d75/f9b 4695613 0 2024-03-18T14:43:19.057 INFO:tasks.workunit.client.0.smithi087.stdout:5/603: truncate d13/d1b/d70/fad 1426643 0 2024-03-18T14:43:19.058 INFO:tasks.workunit.client.1.smithi129.stdout:3/356: mkdir d4/dd/d1f/d5f/d31/d78 0 2024-03-18T14:43:19.058 INFO:tasks.workunit.client.0.smithi087.stdout:8/548: write d1/d6/d9/f77 [155194,9180] 0 2024-03-18T14:43:19.059 INFO:tasks.workunit.client.0.smithi087.stdout:4/539: fdatasync d2/db/d84/d87/f9b 0 2024-03-18T14:43:19.059 INFO:tasks.workunit.client.0.smithi087.stdout:6/535: chown d3/d7/d25/d62/d7c/f1e 59441439 1 2024-03-18T14:43:19.060 INFO:tasks.workunit.client.0.smithi087.stdout:5/604: write d13/d1b/d70/da8/fb2 [886040,81807] 0 2024-03-18T14:43:19.060 INFO:tasks.workunit.client.1.smithi129.stdout:2/393: creat d7/d1c/f74 x:0 0 0 2024-03-18T14:43:19.062 INFO:tasks.workunit.client.0.smithi087.stdout:6/536: chown d3/d7/d25/d62/d7c/d29/d22/d23/f30 12475 1 2024-03-18T14:43:19.064 INFO:tasks.workunit.client.1.smithi129.stdout:4/350: fdatasync d0/d1a/f25 0 2024-03-18T14:43:19.064 INFO:tasks.workunit.client.1.smithi129.stdout:9/372: sync 2024-03-18T14:43:19.064 INFO:tasks.workunit.client.0.smithi087.stdout:7/691: dwrite d1/d6/d16/f1e [0,4194304] 0 2024-03-18T14:43:19.064 INFO:tasks.workunit.client.0.smithi087.stdout:3/621: link d0/d3/df/l3a d0/de/d30/d60/lab 0 2024-03-18T14:43:19.066 INFO:tasks.workunit.client.0.smithi087.stdout:1/636: mkdir d3/d1d/d1e/d43/d50/d72/dc8 0 2024-03-18T14:43:19.066 INFO:tasks.workunit.client.1.smithi129.stdout:4/351: write d0/d1a/f24 [3881344,111664] 0 2024-03-18T14:43:19.068 INFO:tasks.workunit.client.1.smithi129.stdout:2/394: dwrite d7/d1c/d32/f60 [0,4194304] 0 2024-03-18T14:43:19.069 INFO:tasks.workunit.client.1.smithi129.stdout:8/401: dread d9/d11/d55/f5a [0,4194304] 0 2024-03-18T14:43:19.070 INFO:tasks.workunit.client.1.smithi129.stdout:2/395: dread - d7/f59 zero size 2024-03-18T14:43:19.070 INFO:tasks.workunit.client.1.smithi129.stdout:0/415: dread d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:19.070 INFO:tasks.workunit.client.1.smithi129.stdout:2/396: readlink d7/d1f/d34/l2c 0 2024-03-18T14:43:19.071 INFO:tasks.workunit.client.0.smithi087.stdout:8/549: mkdir d1/d6/d14/db2 0 2024-03-18T14:43:19.071 INFO:tasks.workunit.client.1.smithi129.stdout:2/397: fdatasync f0 0 2024-03-18T14:43:19.071 INFO:tasks.workunit.client.1.smithi129.stdout:2/398: fsync d7/f59 0 2024-03-18T14:43:19.073 INFO:tasks.workunit.client.0.smithi087.stdout:5/605: rename d13/d1b/d27/f2c to d13/d1b/d30/d6e/d88/db4/fc7 0 2024-03-18T14:43:19.076 INFO:tasks.workunit.client.0.smithi087.stdout:3/622: creat d0/d72/d85/fac x:0 0 0 2024-03-18T14:43:19.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/399: dwrite d7/d1c/f26 [0,4194304] 0 2024-03-18T14:43:19.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/400: readlink d7/l19 0 2024-03-18T14:43:19.078 INFO:tasks.workunit.client.1.smithi129.stdout:5/371: dread d0/f2e [0,4194304] 0 2024-03-18T14:43:19.079 INFO:tasks.workunit.client.0.smithi087.stdout:5/606: dwrite d13/d1b/d27/d35/f43 [0,4194304] 0 2024-03-18T14:43:19.079 INFO:tasks.workunit.client.1.smithi129.stdout:3/357: write d4/d38/f1c [1859742,27556] 0 2024-03-18T14:43:19.079 INFO:tasks.workunit.client.1.smithi129.stdout:1/381: truncate d1/d2/f3 1066200 0 2024-03-18T14:43:19.080 INFO:tasks.workunit.client.0.smithi087.stdout:5/607: chown d13/d1b/d7e/cc0 176 1 2024-03-18T14:43:19.080 INFO:tasks.workunit.client.0.smithi087.stdout:1/637: dread d3/d1d/d1e/d20/f5f [0,4194304] 0 2024-03-18T14:43:19.081 INFO:tasks.workunit.client.1.smithi129.stdout:4/352: rmdir d0/d9/d40/d5f 39 2024-03-18T14:43:19.081 INFO:tasks.workunit.client.1.smithi129.stdout:6/398: dread d3/d6/f2d [0,4194304] 0 2024-03-18T14:43:19.082 INFO:tasks.workunit.client.1.smithi129.stdout:6/399: write d3/d38/f73 [483375,11236] 0 2024-03-18T14:43:19.084 INFO:tasks.workunit.client.1.smithi129.stdout:9/373: rename d0/db/d1f/d20/d4a/d3e/l4f to d0/db/d1f/d20/d4a/l71 0 2024-03-18T14:43:19.084 INFO:tasks.workunit.client.1.smithi129.stdout:5/372: dwrite d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:19.085 INFO:tasks.workunit.client.1.smithi129.stdout:9/374: dread - d0/db/d1f/d20/d26/d19/d29/d36/f5e zero size 2024-03-18T14:43:19.089 INFO:tasks.workunit.client.1.smithi129.stdout:4/353: symlink d0/d19/d46/d3e/d21/d32/l6b 0 2024-03-18T14:43:19.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/638: dread d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:19.092 INFO:tasks.workunit.client.1.smithi129.stdout:7/407: dread d4/d7/d8/f1c [0,4194304] 0 2024-03-18T14:43:19.092 INFO:tasks.workunit.client.1.smithi129.stdout:7/408: write d4/d7/d8/f22 [3778482,84700] 0 2024-03-18T14:43:19.093 INFO:tasks.workunit.client.0.smithi087.stdout:0/560: link d0/d2/d4/d19/d24/c6d d0/d1a/d34/d3d/cc5 0 2024-03-18T14:43:19.093 INFO:tasks.workunit.client.0.smithi087.stdout:6/537: link d3/d7/d25/d62/l82 d3/d7/d25/d62/d7c/da0/d96/lb5 0 2024-03-18T14:43:19.095 INFO:tasks.workunit.client.0.smithi087.stdout:2/600: getdents d2/d4/d22/d24/d65 0 2024-03-18T14:43:19.095 INFO:tasks.workunit.client.0.smithi087.stdout:6/538: chown d3/d7/d25/d62/d7c/d29/d22/d23/f33 433 1 2024-03-18T14:43:19.096 INFO:tasks.workunit.client.0.smithi087.stdout:8/550: link d1/d6/d14/c68 d1/d6/d2f/cb3 0 2024-03-18T14:43:19.096 INFO:tasks.workunit.client.1.smithi129.stdout:3/358: symlink d4/l79 0 2024-03-18T14:43:19.098 INFO:tasks.workunit.client.0.smithi087.stdout:8/551: write d1/d6/d9/d5d/d87/d88/f9d [105576,88793] 0 2024-03-18T14:43:19.098 INFO:tasks.workunit.client.0.smithi087.stdout:3/623: mknod d0/d3/d95/cad 0 2024-03-18T14:43:19.098 INFO:tasks.workunit.client.1.smithi129.stdout:1/382: mkdir d1/d2/d28/d65/d72 0 2024-03-18T14:43:19.099 INFO:tasks.workunit.client.1.smithi129.stdout:4/354: mkdir d0/d3c/d6c 0 2024-03-18T14:43:19.099 INFO:tasks.workunit.client.1.smithi129.stdout:9/375: dread d0/db/f5d [0,4194304] 0 2024-03-18T14:43:19.100 INFO:tasks.workunit.client.1.smithi129.stdout:6/400: truncate d3/d6/f4e 3188805 0 2024-03-18T14:43:19.101 INFO:tasks.workunit.client.1.smithi129.stdout:6/401: fsync d3/d30/de/f1f 0 2024-03-18T14:43:19.101 INFO:tasks.workunit.client.0.smithi087.stdout:1/639: creat d3/d1d/d1e/d20/d7a/db4/fc9 x:0 0 0 2024-03-18T14:43:19.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/640: chown d3/d1d/d1e/d20/f56 5561 1 2024-03-18T14:43:19.102 INFO:tasks.workunit.client.0.smithi087.stdout:1/641: chown d3/d3c 5319323 1 2024-03-18T14:43:19.103 INFO:tasks.workunit.client.0.smithi087.stdout:1/642: chown d3/d1d/d1e/d43/d50/f58 2 1 2024-03-18T14:43:19.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/608: mkdir d13/d1b/d30/d6e/dc8 0 2024-03-18T14:43:19.105 INFO:tasks.workunit.client.0.smithi087.stdout:0/561: creat d0/d2/d3c/d73/fc6 x:0 0 0 2024-03-18T14:43:19.105 INFO:tasks.workunit.client.1.smithi129.stdout:2/401: truncate d7/d1f/d20/d36/f6d 1009740 0 2024-03-18T14:43:19.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/601: creat d2/d4/d22/fc4 x:0 0 0 2024-03-18T14:43:19.107 INFO:tasks.workunit.client.0.smithi087.stdout:4/540: link d2/db/d67/f6a d2/fad 0 2024-03-18T14:43:19.107 INFO:tasks.workunit.client.0.smithi087.stdout:4/541: stat d2/db/de/c41 0 2024-03-18T14:43:19.109 INFO:tasks.workunit.client.1.smithi129.stdout:0/416: write d0/d14/f4d [2038276,4347] 0 2024-03-18T14:43:19.109 INFO:tasks.workunit.client.1.smithi129.stdout:2/402: dwrite d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:19.109 INFO:tasks.workunit.client.0.smithi087.stdout:6/539: rename d3/d7/d25/d9f to d3/d7/d25/d62/d7c/d29/d22/d23/da9/d87/db6 0 2024-03-18T14:43:19.110 INFO:tasks.workunit.client.1.smithi129.stdout:0/417: chown d0/ce 14088 1 2024-03-18T14:43:19.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/562: readlink d0/d2/d6b/d7c/lb5 0 2024-03-18T14:43:19.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/402: rename d3/d5/f48 to d3/d38/f7b 0 2024-03-18T14:43:19.115 INFO:tasks.workunit.client.0.smithi087.stdout:8/552: rename d1/c11 to d1/d6/d2f/d44/d45/d71/daa/dad/cb4 0 2024-03-18T14:43:19.116 INFO:tasks.workunit.client.0.smithi087.stdout:3/624: dwrite d0/d3/d7a/fa7 [0,4194304] 0 2024-03-18T14:43:19.116 INFO:tasks.workunit.client.0.smithi087.stdout:6/540: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f30 [0,4194304] 0 2024-03-18T14:43:19.117 INFO:tasks.workunit.client.0.smithi087.stdout:8/553: chown d1/d6/d9/f48 4112 1 2024-03-18T14:43:19.119 INFO:tasks.workunit.client.1.smithi129.stdout:7/409: truncate d4/f6 5026779 0 2024-03-18T14:43:19.119 INFO:tasks.workunit.client.1.smithi129.stdout:7/410: stat d4/d7/f31 0 2024-03-18T14:43:19.120 INFO:tasks.workunit.client.1.smithi129.stdout:7/411: chown d4/d7/d38/d61/d68/d6b 2432160 1 2024-03-18T14:43:19.121 INFO:tasks.workunit.client.0.smithi087.stdout:9/667: sync 2024-03-18T14:43:19.122 INFO:tasks.workunit.client.0.smithi087.stdout:3/625: dwrite d0/d3/df/f16 [4194304,4194304] 0 2024-03-18T14:43:19.123 INFO:tasks.workunit.client.0.smithi087.stdout:9/668: read - db/d18/d1e/d28/d76/db7/dbf/fd6 zero size 2024-03-18T14:43:19.123 INFO:tasks.workunit.client.1.smithi129.stdout:5/373: truncate d0/f36 1771459 0 2024-03-18T14:43:19.124 INFO:tasks.workunit.client.1.smithi129.stdout:5/374: chown d0/dc/d22 436609650 1 2024-03-18T14:43:19.124 INFO:tasks.workunit.client.1.smithi129.stdout:7/412: dwrite d4/d2d/d2e/d45/f4c [0,4194304] 0 2024-03-18T14:43:19.126 INFO:tasks.workunit.client.0.smithi087.stdout:9/669: dread - db/d18/d1e/f4c zero size 2024-03-18T14:43:19.126 INFO:tasks.workunit.client.0.smithi087.stdout:5/609: dread d13/d1b/d30/f7d [0,4194304] 0 2024-03-18T14:43:19.130 INFO:tasks.workunit.client.1.smithi129.stdout:4/355: link d0/f13 d0/d9/d4c/f6d 0 2024-03-18T14:43:19.130 INFO:tasks.workunit.client.1.smithi129.stdout:2/403: creat d7/d1c/d32/f75 x:0 0 0 2024-03-18T14:43:19.130 INFO:tasks.workunit.client.1.smithi129.stdout:0/418: mknod d0/c7e 0 2024-03-18T14:43:19.130 INFO:tasks.workunit.client.1.smithi129.stdout:8/402: sync 2024-03-18T14:43:19.131 INFO:tasks.workunit.client.1.smithi129.stdout:8/403: fdatasync f8 0 2024-03-18T14:43:19.131 INFO:tasks.workunit.client.1.smithi129.stdout:9/376: creat d0/db/d1f/d20/d26/d5f/f72 x:0 0 0 2024-03-18T14:43:19.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/404: write d7/d1f/d20/d2b/f39 [1007365,51819] 0 2024-03-18T14:43:19.132 INFO:tasks.workunit.client.1.smithi129.stdout:2/405: chown d7/d1f/d20/d2b/d41/d65 320919045 1 2024-03-18T14:43:19.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/542: mkdir d2/db/d24/d30/d7b/d7f/da5/dae 0 2024-03-18T14:43:19.136 INFO:tasks.workunit.client.1.smithi129.stdout:2/406: dread d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:19.137 INFO:tasks.workunit.client.1.smithi129.stdout:2/407: write d7/d1f/d34/f18 [4887082,55221] 0 2024-03-18T14:43:19.138 INFO:tasks.workunit.client.0.smithi087.stdout:1/643: rename d3/l90 to d3/d3c/db8/d8f/d99/lca 0 2024-03-18T14:43:19.139 INFO:tasks.workunit.client.0.smithi087.stdout:1/644: chown d3/d1d/d1e/d43/fa5 27905268 1 2024-03-18T14:43:19.140 INFO:tasks.workunit.client.1.smithi129.stdout:6/403: dwrite d3/d38/f7b [0,4194304] 0 2024-03-18T14:43:19.141 INFO:tasks.workunit.client.0.smithi087.stdout:8/554: mknod d1/cb5 0 2024-03-18T14:43:19.141 INFO:tasks.workunit.client.1.smithi129.stdout:5/375: creat d0/d32/d34/f70 x:0 0 0 2024-03-18T14:43:19.141 INFO:tasks.workunit.client.1.smithi129.stdout:7/413: symlink d4/d7/d38/d61/d68/d6b/l80 0 2024-03-18T14:43:19.142 INFO:tasks.workunit.client.1.smithi129.stdout:5/376: fsync d0/d32/d34/f64 0 2024-03-18T14:43:19.143 INFO:tasks.workunit.client.1.smithi129.stdout:9/377: symlink d0/db/d1f/d20/d26/d19/d29/l73 0 2024-03-18T14:43:19.146 INFO:tasks.workunit.client.0.smithi087.stdout:5/610: unlink d13/d1b/d30/l61 0 2024-03-18T14:43:19.147 INFO:tasks.workunit.client.1.smithi129.stdout:6/404: symlink d3/d38/d57/l7c 0 2024-03-18T14:43:19.148 INFO:tasks.workunit.client.1.smithi129.stdout:3/359: sync 2024-03-18T14:43:19.148 INFO:tasks.workunit.client.1.smithi129.stdout:9/378: dwrite d0/db/d1f/d20/d25/f61 [0,4194304] 0 2024-03-18T14:43:19.149 INFO:tasks.workunit.client.1.smithi129.stdout:6/405: dread - d3/d5/d46/f63 zero size 2024-03-18T14:43:19.150 INFO:tasks.workunit.client.1.smithi129.stdout:6/406: write d3/d30/f1e [17716,101517] 0 2024-03-18T14:43:19.152 INFO:tasks.workunit.client.1.smithi129.stdout:5/377: stat d0/dc/d1a/d61/l6f 0 2024-03-18T14:43:19.152 INFO:tasks.workunit.client.1.smithi129.stdout:2/408: symlink d7/d1f/d20/d2a/d6b/l76 0 2024-03-18T14:43:19.153 INFO:tasks.workunit.client.1.smithi129.stdout:1/383: rename d1/d35/l41 to d1/d2/d28/d65/d19/l73 0 2024-03-18T14:43:19.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/356: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:19.155 INFO:tasks.workunit.client.0.smithi087.stdout:4/543: mknod d2/db/d24/d30/d7b/d7f/da5/caf 0 2024-03-18T14:43:19.155 INFO:tasks.workunit.client.0.smithi087.stdout:1/645: mknod d3/d1d/d67/d94/ccb 0 2024-03-18T14:43:19.155 INFO:tasks.workunit.client.0.smithi087.stdout:8/555: mkdir d1/d6/d2f/d44/d45/d72/db6 0 2024-03-18T14:43:19.156 INFO:tasks.workunit.client.1.smithi129.stdout:9/379: symlink d0/db/d1f/d4c/l74 0 2024-03-18T14:43:19.156 INFO:tasks.workunit.client.1.smithi129.stdout:6/407: rmdir d3/d30 39 2024-03-18T14:43:19.156 INFO:tasks.workunit.client.1.smithi129.stdout:7/414: fsync d4/d2d/d2e/d45/f4c 0 2024-03-18T14:43:19.156 INFO:tasks.workunit.client.1.smithi129.stdout:6/408: dread - d3/f6a zero size 2024-03-18T14:43:19.156 INFO:tasks.workunit.client.0.smithi087.stdout:2/602: dread - d2/d4/d22/d2c/d3a/d49/d58/f8c zero size 2024-03-18T14:43:19.157 INFO:tasks.workunit.client.1.smithi129.stdout:7/415: chown d4/d7/d8 10164645 1 2024-03-18T14:43:19.157 INFO:tasks.workunit.client.0.smithi087.stdout:6/541: link d3/d7/d25/d62/d7c/da0/fa7 d3/d7/d25/d62/d8b/fb7 0 2024-03-18T14:43:19.157 INFO:tasks.workunit.client.0.smithi087.stdout:4/544: write d2/db/de/d8b/fa6 [800117,46813] 0 2024-03-18T14:43:19.159 INFO:tasks.workunit.client.1.smithi129.stdout:3/360: dread d4/fa [0,4194304] 0 2024-03-18T14:43:19.160 INFO:tasks.workunit.client.0.smithi087.stdout:0/563: write d0/d2/d4/d19/d5a/f5b [347997,49331] 0 2024-03-18T14:43:19.160 INFO:tasks.workunit.client.1.smithi129.stdout:6/409: fsync d3/d5/f11 0 2024-03-18T14:43:19.161 INFO:tasks.workunit.client.0.smithi087.stdout:3/626: link d0/d3/d10/d7f/f82 d0/d3/d95/fae 0 2024-03-18T14:43:19.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/542: dread d3/d7/f57 [0,4194304] 0 2024-03-18T14:43:19.161 INFO:tasks.workunit.client.0.smithi087.stdout:5/611: mknod d13/d1b/d30/d6e/d88/db4/cc9 0 2024-03-18T14:43:19.162 INFO:tasks.workunit.client.1.smithi129.stdout:5/378: truncate d0/f2 2193422 0 2024-03-18T14:43:19.162 INFO:tasks.workunit.client.1.smithi129.stdout:5/379: readlink d0/dc/d22/l42 0 2024-03-18T14:43:19.163 INFO:tasks.workunit.client.0.smithi087.stdout:8/556: dwrite d1/d6/d9/f61 [0,4194304] 0 2024-03-18T14:43:19.163 INFO:tasks.workunit.client.1.smithi129.stdout:7/416: mkdir d4/d7/d38/d61/d68/d6b/d81 0 2024-03-18T14:43:19.164 INFO:tasks.workunit.client.0.smithi087.stdout:5/612: stat d13/d1b/d27/d28/d9a/dae 0 2024-03-18T14:43:19.166 INFO:tasks.workunit.client.0.smithi087.stdout:4/545: dwrite d2/db/d24/f26 [0,4194304] 0 2024-03-18T14:43:19.166 INFO:tasks.workunit.client.1.smithi129.stdout:1/384: link d1/d2/d28/d65/f36 d1/d2/d70/f74 0 2024-03-18T14:43:19.166 INFO:tasks.workunit.client.1.smithi129.stdout:1/385: fdatasync d1/f6c 0 2024-03-18T14:43:19.167 INFO:tasks.workunit.client.0.smithi087.stdout:1/646: dread d3/d1d/d1e/d20/d7a/fa4 [0,4194304] 0 2024-03-18T14:43:19.169 INFO:tasks.workunit.client.0.smithi087.stdout:3/627: rmdir d0/d72 39 2024-03-18T14:43:19.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/543: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f69 [0,4194304] 0 2024-03-18T14:43:19.171 INFO:tasks.workunit.client.0.smithi087.stdout:3/628: write d0/de/d30/f7c [1517655,74336] 0 2024-03-18T14:43:19.173 INFO:tasks.workunit.client.0.smithi087.stdout:5/613: dwrite d13/d1b/d7e/fa2 [0,4194304] 0 2024-03-18T14:43:19.173 INFO:tasks.workunit.client.0.smithi087.stdout:3/629: chown d0/d3/df/d42/l4a 37 1 2024-03-18T14:43:19.173 INFO:tasks.workunit.client.1.smithi129.stdout:4/357: mknod d0/d19/d46/d2e/d66/c6e 0 2024-03-18T14:43:19.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/692: sync 2024-03-18T14:43:19.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/647: creat d3/d1d/d1e/d20/d7a/db4/fcc x:0 0 0 2024-03-18T14:43:19.177 INFO:tasks.workunit.client.1.smithi129.stdout:8/404: dread d9/f15 [0,4194304] 0 2024-03-18T14:43:19.177 INFO:tasks.workunit.client.0.smithi087.stdout:1/648: chown d3/d1d/d67/d94 1648282967 1 2024-03-18T14:43:19.178 INFO:tasks.workunit.client.1.smithi129.stdout:9/380: rename d0/db/d1f/d20/l41 to d0/db/d1f/d20/d6c/l75 0 2024-03-18T14:43:19.179 INFO:tasks.workunit.client.1.smithi129.stdout:9/381: fdatasync d0/db/d1f/d20/d25/d59/f67 0 2024-03-18T14:43:19.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/630: fdatasync d0/d3/df/f4d 0 2024-03-18T14:43:19.181 INFO:tasks.workunit.client.0.smithi087.stdout:3/631: write d0/f6d [317255,13655] 0 2024-03-18T14:43:19.181 INFO:tasks.workunit.client.1.smithi129.stdout:2/409: getdents d7/d1f/d20/d2b/d41/d65 0 2024-03-18T14:43:19.188 INFO:tasks.workunit.client.1.smithi129.stdout:8/405: write d9/f7d [584378,87462] 0 2024-03-18T14:43:19.189 INFO:tasks.workunit.client.0.smithi087.stdout:5/614: creat d13/d1b/d30/d6e/d88/fca x:0 0 0 2024-03-18T14:43:19.191 INFO:tasks.workunit.client.1.smithi129.stdout:1/386: symlink d1/d2/d28/d65/l75 0 2024-03-18T14:43:19.192 INFO:tasks.workunit.client.0.smithi087.stdout:4/546: link d2/db/d24/d30/d7b/d7f/da4/fa8 d2/db/d82/fb0 0 2024-03-18T14:43:19.192 INFO:tasks.workunit.client.1.smithi129.stdout:0/419: creat d0/d23/d71/f7f x:0 0 0 2024-03-18T14:43:19.193 INFO:tasks.workunit.client.0.smithi087.stdout:2/603: symlink d2/d4/d22/d24/lc5 0 2024-03-18T14:43:19.193 INFO:tasks.workunit.client.1.smithi129.stdout:5/380: truncate d0/dc/f4e 13281 0 2024-03-18T14:43:19.195 INFO:tasks.workunit.client.1.smithi129.stdout:3/361: rename d4/dd/c2a to d4/d11/d1d/d27/c7a 0 2024-03-18T14:43:19.196 INFO:tasks.workunit.client.1.smithi129.stdout:1/387: dwrite d1/d35/f45 [0,4194304] 0 2024-03-18T14:43:19.196 INFO:tasks.workunit.client.0.smithi087.stdout:1/649: symlink d3/d1d/d79/lcd 0 2024-03-18T14:43:19.196 INFO:tasks.workunit.client.0.smithi087.stdout:8/557: dwrite d1/d6/d14/f1c [0,4194304] 0 2024-03-18T14:43:19.198 INFO:tasks.workunit.client.0.smithi087.stdout:5/615: creat d13/d1b/d27/d28/d9a/fcb x:0 0 0 2024-03-18T14:43:19.199 INFO:tasks.workunit.client.1.smithi129.stdout:8/406: unlink d9/d11/d1a/d32/d3a/f29 0 2024-03-18T14:43:19.199 INFO:tasks.workunit.client.0.smithi087.stdout:9/670: sync 2024-03-18T14:43:19.199 INFO:tasks.workunit.client.0.smithi087.stdout:5/616: chown d13/d1b/d27/d28/f77 42755 1 2024-03-18T14:43:19.199 INFO:tasks.workunit.client.1.smithi129.stdout:8/407: chown d9/d11/d1a/d32/d3a/d70/f81 564 1 2024-03-18T14:43:19.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/544: link d3/d7/d25/d62/d7c/d29/d22/f2c d3/d7/d25/d62/d7c/d29/d22/d61/fb8 0 2024-03-18T14:43:19.201 INFO:tasks.workunit.client.0.smithi087.stdout:7/693: creat d1/d6/d29/d2f/d68/dc7/ff1 x:0 0 0 2024-03-18T14:43:19.202 INFO:tasks.workunit.client.0.smithi087.stdout:2/604: symlink d2/d4/d22/d2c/d3a/lc6 0 2024-03-18T14:43:19.203 INFO:tasks.workunit.client.0.smithi087.stdout:2/605: chown d2/d4/d22/d24 247 1 2024-03-18T14:43:19.207 INFO:tasks.workunit.client.0.smithi087.stdout:9/671: mknod db/d18/d1e/d28/d76/cdd 0 2024-03-18T14:43:19.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/672: read - db/d18/d1c/d69/d6f/fd4 zero size 2024-03-18T14:43:19.208 INFO:tasks.workunit.client.1.smithi129.stdout:9/382: truncate d0/db/f1d 647636 0 2024-03-18T14:43:19.208 INFO:tasks.workunit.client.1.smithi129.stdout:7/417: link d4/d7/l37 d4/d2d/d2e/d79/l82 0 2024-03-18T14:43:19.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/694: mknod d1/d97/cf2 0 2024-03-18T14:43:19.209 INFO:tasks.workunit.client.1.smithi129.stdout:7/418: write d4/d7/d8/d3b/f6d [264903,101941] 0 2024-03-18T14:43:19.209 INFO:tasks.workunit.client.0.smithi087.stdout:7/695: stat d1/d6/d29/d2f/d68/d65/d72/f80 0 2024-03-18T14:43:19.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/606: truncate d2/d4/f34 930376 0 2024-03-18T14:43:19.212 INFO:tasks.workunit.client.0.smithi087.stdout:8/558: creat d1/d6/d14/db2/fb7 x:0 0 0 2024-03-18T14:43:19.213 INFO:tasks.workunit.client.1.smithi129.stdout:2/410: link d7/d1f/d20/d2a/f5a d7/d1c/d32/f77 0 2024-03-18T14:43:19.213 INFO:tasks.workunit.client.1.smithi129.stdout:6/410: truncate d3/d30/de/d6c/f53 5207626 0 2024-03-18T14:43:19.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/617: creat d13/d1b/d27/d35/dc6/fcc x:0 0 0 2024-03-18T14:43:19.215 INFO:tasks.workunit.client.0.smithi087.stdout:4/547: link d2/db/d24/d30/d49/d4f/l5a d2/db/d24/d30/d7b/d7f/da4/lb1 0 2024-03-18T14:43:19.215 INFO:tasks.workunit.client.1.smithi129.stdout:0/420: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:19.216 INFO:tasks.workunit.client.1.smithi129.stdout:1/388: fsync d1/f40 0 2024-03-18T14:43:19.216 INFO:tasks.workunit.client.1.smithi129.stdout:1/389: chown d1/d35 43 1 2024-03-18T14:43:19.217 INFO:tasks.workunit.client.0.smithi087.stdout:2/607: mknod d2/d4/d22/d2c/d3a/d49/d58/d78/cc7 0 2024-03-18T14:43:19.218 INFO:tasks.workunit.client.1.smithi129.stdout:9/383: mknod d0/db/d11/c76 0 2024-03-18T14:43:19.219 INFO:tasks.workunit.client.0.smithi087.stdout:8/559: creat d1/d6/d2f/d44/d45/d71/daa/fb8 x:0 0 0 2024-03-18T14:43:19.220 INFO:tasks.workunit.client.1.smithi129.stdout:6/411: creat d3/d30/f7d x:0 0 0 2024-03-18T14:43:19.221 INFO:tasks.workunit.client.1.smithi129.stdout:2/411: dwrite d7/d1f/d20/d2d/f2e [0,4194304] 0 2024-03-18T14:43:19.223 INFO:tasks.workunit.client.1.smithi129.stdout:2/412: chown d7/d3f/d5f 309730704 1 2024-03-18T14:43:19.223 INFO:tasks.workunit.client.1.smithi129.stdout:6/412: chown d3/d30/de/f22 939651410 1 2024-03-18T14:43:19.224 INFO:tasks.workunit.client.1.smithi129.stdout:0/421: dwrite d0/d14/d28/f30 [0,4194304] 0 2024-03-18T14:43:19.226 INFO:tasks.workunit.client.0.smithi087.stdout:3/632: truncate d0/d3/d7a/fa7 2158183 0 2024-03-18T14:43:19.227 INFO:tasks.workunit.client.1.smithi129.stdout:1/390: unlink d1/d2/d28/d65/d19/l53 0 2024-03-18T14:43:19.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/419: dwrite d4/d2d/f18 [0,4194304] 0 2024-03-18T14:43:19.231 INFO:tasks.workunit.client.1.smithi129.stdout:4/358: rename d0/d19/d46/d3e/d21/d32/c53 to d0/d1a/c6f 0 2024-03-18T14:43:19.231 INFO:tasks.workunit.client.0.smithi087.stdout:6/545: write d3/d7/d25/d62/d7c/f9a [854796,51536] 0 2024-03-18T14:43:19.232 INFO:tasks.workunit.client.1.smithi129.stdout:8/408: rmdir d9/d11/d1a/d14/d7c 0 2024-03-18T14:43:19.233 INFO:tasks.workunit.client.1.smithi129.stdout:7/420: dwrite d4/d7/d8/d3b/f6d [0,4194304] 0 2024-03-18T14:43:19.233 INFO:tasks.workunit.client.0.smithi087.stdout:6/546: chown d3/d7/d25/d62/d7c/da0/d96/d97/faa 4905 1 2024-03-18T14:43:19.234 INFO:tasks.workunit.client.1.smithi129.stdout:6/413: chown d3/d30/l3e 493 1 2024-03-18T14:43:19.234 INFO:tasks.workunit.client.1.smithi129.stdout:8/409: chown d9/d11/d55/c69 6994 1 2024-03-18T14:43:19.235 INFO:tasks.workunit.client.0.smithi087.stdout:6/547: dread d3/d7/d25/d62/d7c/d29/f8a [0,4194304] 0 2024-03-18T14:43:19.236 INFO:tasks.workunit.client.0.smithi087.stdout:6/548: readlink d3/d7/d25/d62/d7c/d29/d22/d23/l3d 0 2024-03-18T14:43:19.236 INFO:tasks.workunit.client.1.smithi129.stdout:5/381: getdents d0/d32 0 2024-03-18T14:43:19.238 INFO:tasks.workunit.client.1.smithi129.stdout:4/359: dwrite d0/d19/d46/f36 [0,4194304] 0 2024-03-18T14:43:19.239 INFO:tasks.workunit.client.0.smithi087.stdout:5/618: mknod d13/d1b/d30/d6e/ccd 0 2024-03-18T14:43:19.239 INFO:tasks.workunit.client.0.smithi087.stdout:8/560: creat d1/d6/d9/d5d/d87/fb9 x:0 0 0 2024-03-18T14:43:19.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/633: fsync d0/de/d30/d46/f61 0 2024-03-18T14:43:19.240 INFO:tasks.workunit.client.1.smithi129.stdout:5/382: dread d0/df/f37 [0,4194304] 0 2024-03-18T14:43:19.240 INFO:tasks.workunit.client.0.smithi087.stdout:8/561: fdatasync d1/d6/d9/f6c 0 2024-03-18T14:43:19.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/564: sync 2024-03-18T14:43:19.241 INFO:tasks.workunit.client.1.smithi129.stdout:9/384: creat d0/f77 x:0 0 0 2024-03-18T14:43:19.241 INFO:tasks.workunit.client.0.smithi087.stdout:7/696: link d1/d6/d16/dc/l41 d1/d6/d16/dc/lf3 0 2024-03-18T14:43:19.242 INFO:tasks.workunit.client.0.smithi087.stdout:0/565: stat d0/d1a/d80/laf 0 2024-03-18T14:43:19.242 INFO:tasks.workunit.client.1.smithi129.stdout:6/414: write d3/d30/de/f22 [4020878,47356] 0 2024-03-18T14:43:19.243 INFO:tasks.workunit.client.1.smithi129.stdout:8/410: dwrite d9/d11/d18/f3f [0,4194304] 0 2024-03-18T14:43:19.244 INFO:tasks.workunit.client.1.smithi129.stdout:6/415: write d3/d30/de/d49/f50 [1846475,3378] 0 2024-03-18T14:43:19.244 INFO:tasks.workunit.client.1.smithi129.stdout:7/421: mkdir d4/d83 0 2024-03-18T14:43:19.244 INFO:tasks.workunit.client.1.smithi129.stdout:8/411: write d9/d11/d1a/f77 [279329,105776] 0 2024-03-18T14:43:19.245 INFO:tasks.workunit.client.0.smithi087.stdout:9/673: getdents db/d18/d1e/d28/d76 0 2024-03-18T14:43:19.246 INFO:tasks.workunit.client.1.smithi129.stdout:6/416: chown d3/d38/f70 9 1 2024-03-18T14:43:19.247 INFO:tasks.workunit.client.1.smithi129.stdout:4/360: dread d0/d19/d46/d3e/d21/d4d/d58/f65 [0,4194304] 0 2024-03-18T14:43:19.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/548: link d2/db/d24/f26 d2/fb2 0 2024-03-18T14:43:19.250 INFO:tasks.workunit.client.1.smithi129.stdout:3/362: truncate d4/dd/f4d 2083048 0 2024-03-18T14:43:19.253 INFO:tasks.workunit.client.1.smithi129.stdout:2/413: truncate d7/d1f/f57 142037 0 2024-03-18T14:43:19.253 INFO:tasks.workunit.client.1.smithi129.stdout:2/414: read d7/d1c/f26 [3221799,15868] 0 2024-03-18T14:43:19.257 INFO:tasks.workunit.client.1.smithi129.stdout:7/422: symlink d4/d7/d38/d61/d68/l84 0 2024-03-18T14:43:19.258 INFO:tasks.workunit.client.1.smithi129.stdout:7/423: write d4/d2d/d2e/d42/d58/f60 [524319,38467] 0 2024-03-18T14:43:19.258 INFO:tasks.workunit.client.1.smithi129.stdout:8/412: symlink d9/d11/d1a/d32/d41/d4d/l83 0 2024-03-18T14:43:19.260 INFO:tasks.workunit.client.1.smithi129.stdout:6/417: rename d3/d38/d57/l76 to d3/d30/d44/l7e 0 2024-03-18T14:43:19.261 INFO:tasks.workunit.client.0.smithi087.stdout:4/549: mknod d2/db/d24/d30/d7b/d7f/cb3 0 2024-03-18T14:43:19.261 INFO:tasks.workunit.client.0.smithi087.stdout:2/608: link d2/d4/d22/d2c/c7a d2/d44/d72/d8a/da7/cc8 0 2024-03-18T14:43:19.262 INFO:tasks.workunit.client.0.smithi087.stdout:6/549: link d3/d7/le d3/d7/d25/d62/d7c/d29/d22/d23/da9/lb9 0 2024-03-18T14:43:19.263 INFO:tasks.workunit.client.1.smithi129.stdout:0/422: getdents d0/d23/d35/d3b 0 2024-03-18T14:43:19.263 INFO:tasks.workunit.client.0.smithi087.stdout:6/550: readlink d3/d7/d25/d62/d8b/lb4 0 2024-03-18T14:43:19.265 INFO:tasks.workunit.client.0.smithi087.stdout:0/566: rename d0/d49/f56 to d0/d1a/d80/d88/dbd/fc7 0 2024-03-18T14:43:19.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/650: sync 2024-03-18T14:43:19.268 INFO:tasks.workunit.client.1.smithi129.stdout:3/363: dread d4/d38/f37 [0,4194304] 0 2024-03-18T14:43:19.269 INFO:tasks.workunit.client.1.smithi129.stdout:1/391: truncate d1/d2/f4b 366346 0 2024-03-18T14:43:19.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/651: dwrite d3/d1d/d1f/d34/f76 [0,4194304] 0 2024-03-18T14:43:19.277 INFO:tasks.workunit.client.0.smithi087.stdout:0/567: dread d0/d1a/d80/d88/f38 [0,4194304] 0 2024-03-18T14:43:19.277 INFO:tasks.workunit.client.1.smithi129.stdout:9/385: read d0/f1e [642198,105565] 0 2024-03-18T14:43:19.278 INFO:tasks.workunit.client.0.smithi087.stdout:0/568: chown d0/d2/d4/d8b 11971573 1 2024-03-18T14:43:19.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/569: read d0/d1a/d80/d88/f2b [3794162,39398] 0 2024-03-18T14:43:19.279 INFO:tasks.workunit.client.1.smithi129.stdout:9/386: chown d0/db/d1f/d4c/d57 618660 1 2024-03-18T14:43:19.280 INFO:tasks.workunit.client.1.smithi129.stdout:4/361: rename d0/d1a to d0/d19/d46/d3e/d21/d4d/d70 0 2024-03-18T14:43:19.281 INFO:tasks.workunit.client.1.smithi129.stdout:6/418: mkdir d3/d6/d7f 0 2024-03-18T14:43:19.283 INFO:tasks.workunit.client.1.smithi129.stdout:0/423: write d0/d23/d29/f38 [2390211,6073] 0 2024-03-18T14:43:19.283 INFO:tasks.workunit.client.1.smithi129.stdout:5/383: getdents d0/d32 0 2024-03-18T14:43:19.285 INFO:tasks.workunit.client.1.smithi129.stdout:7/424: dread d4/d7/f31 [0,4194304] 0 2024-03-18T14:43:19.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/674: rename db/d18/d1e/d28/d76/d80/d91 to db/d18/d1e/dde 0 2024-03-18T14:43:19.286 INFO:tasks.workunit.client.0.smithi087.stdout:9/675: chown db/d18/d1c/d69/d6f/c88 42967 1 2024-03-18T14:43:19.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/562: write d1/d6/d2f/f95 [1359828,14695] 0 2024-03-18T14:43:19.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/415: dread d7/d1f/d34/f15 [0,4194304] 0 2024-03-18T14:43:19.288 INFO:tasks.workunit.client.1.smithi129.stdout:6/419: mkdir d3/d30/de/d65/d80 0 2024-03-18T14:43:19.289 INFO:tasks.workunit.client.1.smithi129.stdout:3/364: symlink d4/l7b 0 2024-03-18T14:43:19.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/676: mknod db/d18/d51/d7b/cdf 0 2024-03-18T14:43:19.290 INFO:tasks.workunit.client.1.smithi129.stdout:0/424: mknod d0/d23/d35/d50/c80 0 2024-03-18T14:43:19.291 INFO:tasks.workunit.client.0.smithi087.stdout:0/570: mknod d0/d2/d4/d27/cc8 0 2024-03-18T14:43:19.293 INFO:tasks.workunit.client.0.smithi087.stdout:7/697: dread d1/f36 [0,4194304] 0 2024-03-18T14:43:19.293 INFO:tasks.workunit.client.1.smithi129.stdout:6/420: symlink d3/d30/de/d65/l81 0 2024-03-18T14:43:19.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/619: truncate d13/d1b/d30/f67 1485853 0 2024-03-18T14:43:19.295 INFO:tasks.workunit.client.1.smithi129.stdout:3/365: unlink d4/d38/f24 0 2024-03-18T14:43:19.295 INFO:tasks.workunit.client.1.smithi129.stdout:6/421: dread - d3/d6/f51 zero size 2024-03-18T14:43:19.296 INFO:tasks.workunit.client.1.smithi129.stdout:2/416: dwrite d7/d1c/d32/f6c [0,4194304] 0 2024-03-18T14:43:19.296 INFO:tasks.workunit.client.0.smithi087.stdout:3/634: truncate d0/d3/f7 3495365 0 2024-03-18T14:43:19.298 INFO:tasks.workunit.client.1.smithi129.stdout:4/362: creat d0/d9/d40/f71 x:0 0 0 2024-03-18T14:43:19.298 INFO:tasks.workunit.client.0.smithi087.stdout:2/609: truncate d2/d4/d22/d24/d65/f6b 1250781 0 2024-03-18T14:43:19.299 INFO:tasks.workunit.client.1.smithi129.stdout:0/425: dwrite d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:19.299 INFO:tasks.workunit.client.1.smithi129.stdout:7/425: dwrite d4/d7/f64 [0,4194304] 0 2024-03-18T14:43:19.300 INFO:tasks.workunit.client.0.smithi087.stdout:4/550: truncate d2/f5b 933825 0 2024-03-18T14:43:19.301 INFO:tasks.workunit.client.1.smithi129.stdout:7/426: write d4/d7/d8/d3b/f6f [897852,27921] 0 2024-03-18T14:43:19.302 INFO:tasks.workunit.client.1.smithi129.stdout:5/384: truncate d0/df/f44 715185 0 2024-03-18T14:43:19.302 INFO:tasks.workunit.client.1.smithi129.stdout:7/427: dread - d4/d7/f63 zero size 2024-03-18T14:43:19.303 INFO:tasks.workunit.client.1.smithi129.stdout:1/392: getdents d1/d2/d70 0 2024-03-18T14:43:19.303 INFO:tasks.workunit.client.1.smithi129.stdout:7/428: fdatasync d4/f16 0 2024-03-18T14:43:19.304 INFO:tasks.workunit.client.1.smithi129.stdout:4/363: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:19.305 INFO:tasks.workunit.client.1.smithi129.stdout:6/422: mkdir d3/d6/d82 0 2024-03-18T14:43:19.306 INFO:tasks.workunit.client.1.smithi129.stdout:3/366: symlink d4/d11/d1d/l7c 0 2024-03-18T14:43:19.307 INFO:tasks.workunit.client.0.smithi087.stdout:8/563: dread d1/d6/d14/f5c [0,4194304] 0 2024-03-18T14:43:19.307 INFO:tasks.workunit.client.0.smithi087.stdout:6/551: rename d3/d7/d25/d62/l82 to d3/d7/d25/lba 0 2024-03-18T14:43:19.307 INFO:tasks.workunit.client.0.smithi087.stdout:9/677: mkdir db/d18/d1e/d28/d76/de0 0 2024-03-18T14:43:19.308 INFO:tasks.workunit.client.1.smithi129.stdout:9/387: getdents d0/db/d1f/d20/d4a/d3e 0 2024-03-18T14:43:19.308 INFO:tasks.workunit.client.0.smithi087.stdout:0/571: creat d0/d1a/d34/d3d/fc9 x:0 0 0 2024-03-18T14:43:19.308 INFO:tasks.workunit.client.0.smithi087.stdout:7/698: chown d1/d6/da/f50 2 1 2024-03-18T14:43:19.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/620: mkdir d13/d1b/d70/dce 0 2024-03-18T14:43:19.309 INFO:tasks.workunit.client.1.smithi129.stdout:5/385: dread d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:19.309 INFO:tasks.workunit.client.1.smithi129.stdout:0/426: symlink d0/d23/d6b/l81 0 2024-03-18T14:43:19.310 INFO:tasks.workunit.client.1.smithi129.stdout:9/388: stat d0/f77 0 2024-03-18T14:43:19.310 INFO:tasks.workunit.client.0.smithi087.stdout:8/564: write d1/d6/d2f/d44/f6f [1612742,5548] 0 2024-03-18T14:43:19.311 INFO:tasks.workunit.client.0.smithi087.stdout:4/551: mkdir d2/db/d24/d30/d7b/d7f/da5/db4 0 2024-03-18T14:43:19.311 INFO:tasks.workunit.client.0.smithi087.stdout:2/610: chown d2/d4/d22/f36 21402 1 2024-03-18T14:43:19.312 INFO:tasks.workunit.client.1.smithi129.stdout:1/393: dwrite d1/d35/f3f [0,4194304] 0 2024-03-18T14:43:19.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/572: mkdir d0/d2/d6b/dca 0 2024-03-18T14:43:19.312 INFO:tasks.workunit.client.1.smithi129.stdout:5/386: chown d0/d32/d34/f4d 3605654 1 2024-03-18T14:43:19.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/635: symlink d0/d3/d4f/d6e/laf 0 2024-03-18T14:43:19.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/565: write d1/d6/d2f/d44/d45/d50/f73 [1317374,83681] 0 2024-03-18T14:43:19.314 INFO:tasks.workunit.client.1.smithi129.stdout:6/423: dread d3/d30/de/f22 [0,4194304] 0 2024-03-18T14:43:19.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/621: symlink d13/d1b/d27/d8f/lcf 0 2024-03-18T14:43:19.317 INFO:tasks.workunit.client.0.smithi087.stdout:9/678: dwrite db/d18/d1e/fd0 [0,4194304] 0 2024-03-18T14:43:19.318 INFO:tasks.workunit.client.1.smithi129.stdout:0/427: dwrite d0/d23/d35/d3b/f3c [4194304,4194304] 0 2024-03-18T14:43:19.319 INFO:tasks.workunit.client.0.smithi087.stdout:9/679: write f7 [54570,106980] 0 2024-03-18T14:43:19.320 INFO:tasks.workunit.client.0.smithi087.stdout:0/573: rmdir d0/d1a/d80/d88 39 2024-03-18T14:43:19.320 INFO:tasks.workunit.client.0.smithi087.stdout:7/699: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f91 [0,4194304] 0 2024-03-18T14:43:19.322 INFO:tasks.workunit.client.0.smithi087.stdout:2/611: write d2/d4/d22/d2c/f95 [376766,119789] 0 2024-03-18T14:43:19.323 INFO:tasks.workunit.client.1.smithi129.stdout:4/364: creat d0/d19/d46/d3e/d21/f72 x:0 0 0 2024-03-18T14:43:19.323 INFO:tasks.workunit.client.0.smithi087.stdout:8/566: mknod d1/cba 0 2024-03-18T14:43:19.325 INFO:tasks.workunit.client.0.smithi087.stdout:1/652: sync 2024-03-18T14:43:19.326 INFO:tasks.workunit.client.0.smithi087.stdout:4/552: symlink d2/db/lb5 0 2024-03-18T14:43:19.326 INFO:tasks.workunit.client.0.smithi087.stdout:5/622: dwrite d13/d1b/d27/d28/f77 [0,4194304] 0 2024-03-18T14:43:19.327 INFO:tasks.workunit.client.1.smithi129.stdout:2/417: dread d7/f49 [0,4194304] 0 2024-03-18T14:43:19.328 INFO:tasks.workunit.client.0.smithi087.stdout:0/574: mkdir d0/d2/d4/d19/d24/dcb 0 2024-03-18T14:43:19.328 INFO:tasks.workunit.client.1.smithi129.stdout:8/413: sync 2024-03-18T14:43:19.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/367: creat d4/d11/d1d/d36/f7d x:0 0 0 2024-03-18T14:43:19.332 INFO:tasks.workunit.client.0.smithi087.stdout:7/700: symlink d1/d6/da/d42/d61/lf4 0 2024-03-18T14:43:19.333 INFO:tasks.workunit.client.0.smithi087.stdout:5/623: dwrite d13/d1b/d27/d28/f71 [0,4194304] 0 2024-03-18T14:43:19.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/701: dwrite d1/d6/d29/d2f/d68/d65/fb1 [0,4194304] 0 2024-03-18T14:43:19.337 INFO:tasks.workunit.client.1.smithi129.stdout:5/387: mkdir d0/dc/d18/d2b/d71 0 2024-03-18T14:43:19.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/424: creat d3/d30/de/f83 x:0 0 0 2024-03-18T14:43:19.338 INFO:tasks.workunit.client.1.smithi129.stdout:0/428: symlink d0/d23/d6b/l82 0 2024-03-18T14:43:19.338 INFO:tasks.workunit.client.1.smithi129.stdout:4/365: mknod d0/d19/d46/d3e/d21/c73 0 2024-03-18T14:43:19.338 INFO:tasks.workunit.client.1.smithi129.stdout:4/366: write d0/d19/d46/f36 [3194390,28815] 0 2024-03-18T14:43:19.339 INFO:tasks.workunit.client.0.smithi087.stdout:7/702: fdatasync d1/d8e/d95/dae/ff0 0 2024-03-18T14:43:19.339 INFO:tasks.workunit.client.0.smithi087.stdout:5/624: symlink d13/d1b/d27/d98/ld0 0 2024-03-18T14:43:19.344 INFO:tasks.workunit.client.1.smithi129.stdout:8/414: mkdir d9/d11/d55/d6a/d84 0 2024-03-18T14:43:19.344 INFO:tasks.workunit.client.1.smithi129.stdout:3/368: creat d4/d11/d1d/d36/f7e x:0 0 0 2024-03-18T14:43:19.344 INFO:tasks.workunit.client.1.smithi129.stdout:9/389: symlink d0/db/d1f/d20/d4a/d70/l78 0 2024-03-18T14:43:19.347 INFO:tasks.workunit.client.0.smithi087.stdout:9/680: getdents db/d18 0 2024-03-18T14:43:19.348 INFO:tasks.workunit.client.0.smithi087.stdout:6/552: dread d3/d7/d25/d62/d7c/d29/d22/d61/f70 [4194304,4194304] 0 2024-03-18T14:43:19.349 INFO:tasks.workunit.client.0.smithi087.stdout:4/553: creat d2/fb6 x:0 0 0 2024-03-18T14:43:19.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/553: chown d3/f74 7023858 1 2024-03-18T14:43:19.349 INFO:tasks.workunit.client.1.smithi129.stdout:0/429: readlink d0/l18 0 2024-03-18T14:43:19.349 INFO:tasks.workunit.client.1.smithi129.stdout:5/388: mknod d0/dc/d22/c72 0 2024-03-18T14:43:19.350 INFO:tasks.workunit.client.1.smithi129.stdout:6/425: chown d3/d30/c52 2 1 2024-03-18T14:43:19.350 INFO:tasks.workunit.client.0.smithi087.stdout:6/554: write d3/d7/d25/d62/d7c/f1e [3520245,102234] 0 2024-03-18T14:43:19.351 INFO:tasks.workunit.client.1.smithi129.stdout:7/429: dread d4/d7/f25 [0,4194304] 0 2024-03-18T14:43:19.352 INFO:tasks.workunit.client.0.smithi087.stdout:9/681: rename db/d18/d1c/f40 to db/d18/d3a/fe1 0 2024-03-18T14:43:19.354 INFO:tasks.workunit.client.0.smithi087.stdout:6/555: mknod d3/d7/d25/d62/d7c/da0/cbb 0 2024-03-18T14:43:19.355 INFO:tasks.workunit.client.0.smithi087.stdout:6/556: chown d3/d7/d25/d62/d7c/da0/d96/d97/faf 12333 1 2024-03-18T14:43:19.356 INFO:tasks.workunit.client.0.smithi087.stdout:9/682: creat db/d31/fe2 x:0 0 0 2024-03-18T14:43:19.356 INFO:tasks.workunit.client.1.smithi129.stdout:8/415: symlink d9/d11/d55/d6a/l85 0 2024-03-18T14:43:19.358 INFO:tasks.workunit.client.1.smithi129.stdout:8/416: readlink d9/d11/d1a/d14/l6d 0 2024-03-18T14:43:19.360 INFO:tasks.workunit.client.0.smithi087.stdout:6/557: mkdir d3/d7/d25/d62/d7c/da0/d96/d97/dbc 0 2024-03-18T14:43:19.360 INFO:tasks.workunit.client.0.smithi087.stdout:4/554: getdents d2/db/d24/d30/d7b/d7f/da4 0 2024-03-18T14:43:19.360 INFO:tasks.workunit.client.1.smithi129.stdout:8/417: dread f4 [0,4194304] 0 2024-03-18T14:43:19.361 INFO:tasks.workunit.client.0.smithi087.stdout:9/683: rename db/d31/c56 to db/d18/d1e/d28/d76/db7/dd5/ce3 0 2024-03-18T14:43:19.362 INFO:tasks.workunit.client.0.smithi087.stdout:4/555: chown d2/l47 30 1 2024-03-18T14:43:19.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/556: stat d2/db/d24/d30/d56/f8c 0 2024-03-18T14:43:19.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/558: mkdir d3/d7/dbd 0 2024-03-18T14:43:19.367 INFO:tasks.workunit.client.1.smithi129.stdout:6/426: rename d3/d30/df/l5c to d3/d30/df/d28/d79/l84 0 2024-03-18T14:43:19.368 INFO:tasks.workunit.client.0.smithi087.stdout:4/557: dwrite d2/db/de/f44 [0,4194304] 0 2024-03-18T14:43:19.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/430: dwrite d4/d7/d38/d49/f7a [0,4194304] 0 2024-03-18T14:43:19.369 INFO:tasks.workunit.client.1.smithi129.stdout:6/427: chown d3/d30/de/d65/l6e 2048063 1 2024-03-18T14:43:19.370 INFO:tasks.workunit.client.1.smithi129.stdout:1/394: dread d1/f40 [0,4194304] 0 2024-03-18T14:43:19.375 INFO:tasks.workunit.client.0.smithi087.stdout:3/636: dread d0/de/d30/f7c [0,4194304] 0 2024-03-18T14:43:19.375 INFO:tasks.workunit.client.0.smithi087.stdout:7/703: dread d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:19.377 INFO:tasks.workunit.client.1.smithi129.stdout:4/367: getdents d0/d19/d46/d3e 0 2024-03-18T14:43:19.377 INFO:tasks.workunit.client.1.smithi129.stdout:7/431: symlink d4/d7/d38/d61/l85 0 2024-03-18T14:43:19.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/395: rmdir d1/d2/d28 39 2024-03-18T14:43:19.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/625: dread d13/d1b/d27/f34 [0,4194304] 0 2024-03-18T14:43:19.379 INFO:tasks.workunit.client.1.smithi129.stdout:1/396: write d1/f60 [2082772,289] 0 2024-03-18T14:43:19.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/653: dread d3/d1d/d1f/d63/f6d [0,4194304] 0 2024-03-18T14:43:19.386 INFO:tasks.workunit.client.1.smithi129.stdout:8/418: creat d9/d11/d1a/d32/d3a/d70/f86 x:0 0 0 2024-03-18T14:43:19.386 INFO:tasks.workunit.client.1.smithi129.stdout:4/368: symlink d0/d19/d46/l74 0 2024-03-18T14:43:19.387 INFO:tasks.workunit.client.1.smithi129.stdout:8/419: chown d9/ca 31 1 2024-03-18T14:43:19.387 INFO:tasks.workunit.client.0.smithi087.stdout:2/612: dread d2/d4/d22/d2c/d3a/f51 [0,4194304] 0 2024-03-18T14:43:19.388 INFO:tasks.workunit.client.0.smithi087.stdout:6/559: dread d3/d7/d25/d62/d7c/d29/d22/d75/f9b [0,4194304] 0 2024-03-18T14:43:19.388 INFO:tasks.workunit.client.0.smithi087.stdout:2/613: write d2/d4/f1a [1680503,11645] 0 2024-03-18T14:43:19.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/369: chown d0/d19/d46/d3e/d21/d4d/d70/f2c 1 1 2024-03-18T14:43:19.389 INFO:tasks.workunit.client.0.smithi087.stdout:3/637: creat d0/d3/d4f/d6e/fb0 x:0 0 0 2024-03-18T14:43:19.391 INFO:tasks.workunit.client.1.smithi129.stdout:1/397: dwrite d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:19.393 INFO:tasks.workunit.client.1.smithi129.stdout:8/420: dwrite d9/d11/d1a/f77 [0,4194304] 0 2024-03-18T14:43:19.394 INFO:tasks.workunit.client.1.smithi129.stdout:8/421: write d9/f6c [289354,89338] 0 2024-03-18T14:43:19.395 INFO:tasks.workunit.client.1.smithi129.stdout:8/422: chown d9/d11/d1a/d32/d3a/d70 1568243369 1 2024-03-18T14:43:19.396 INFO:tasks.workunit.client.1.smithi129.stdout:2/418: truncate d7/d1f/d20/d2b/d41/f6f 3958823 0 2024-03-18T14:43:19.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/560: read d3/d7/d25/d62/d7c/f42 [3492302,41893] 0 2024-03-18T14:43:19.399 INFO:tasks.workunit.client.0.smithi087.stdout:3/638: read d0/f28 [3050681,84270] 0 2024-03-18T14:43:19.400 INFO:tasks.workunit.client.0.smithi087.stdout:4/558: mkdir d2/db/d24/d30/d7b/d7f/da5/db4/db7 0 2024-03-18T14:43:19.400 INFO:tasks.workunit.client.0.smithi087.stdout:7/704: creat d1/d97/db9/ff5 x:0 0 0 2024-03-18T14:43:19.401 INFO:tasks.workunit.client.0.smithi087.stdout:5/626: mknod d13/d1b/d70/dce/cd1 0 2024-03-18T14:43:19.402 INFO:tasks.workunit.client.1.smithi129.stdout:3/369: dwrite d4/d38/f37 [0,4194304] 0 2024-03-18T14:43:19.402 INFO:tasks.workunit.client.1.smithi129.stdout:0/430: truncate d0/d14/d3a/d4a/d61/f76 1420721 0 2024-03-18T14:43:19.403 INFO:tasks.workunit.client.0.smithi087.stdout:8/567: write d1/d6/d2f/f91 [72000,17375] 0 2024-03-18T14:43:19.405 INFO:tasks.workunit.client.0.smithi087.stdout:2/614: dwrite d2/d44/d72/fad [0,4194304] 0 2024-03-18T14:43:19.405 INFO:tasks.workunit.client.0.smithi087.stdout:7/705: readlink d1/d6/d29/d2f/d68/d65/d60/lba 0 2024-03-18T14:43:19.405 INFO:tasks.workunit.client.1.smithi129.stdout:3/370: chown d4/d11/d34/d4c/f65 371761892 1 2024-03-18T14:43:19.405 INFO:tasks.workunit.client.1.smithi129.stdout:9/390: dread d0/db/fd [0,4194304] 0 2024-03-18T14:43:19.406 INFO:tasks.workunit.client.0.smithi087.stdout:0/575: truncate d0/d1a/d34/f5f 4331389 0 2024-03-18T14:43:19.407 INFO:tasks.workunit.client.1.smithi129.stdout:7/432: mkdir d4/d7/d54/d86 0 2024-03-18T14:43:19.407 INFO:tasks.workunit.client.0.smithi087.stdout:0/576: readlink d0/d2/d6b/d7c/l82 0 2024-03-18T14:43:19.407 INFO:tasks.workunit.client.1.smithi129.stdout:7/433: read - d4/d7/d38/d5c/f76 zero size 2024-03-18T14:43:19.408 INFO:tasks.workunit.client.1.smithi129.stdout:0/431: dwrite d0/d23/d29/f58 [4194304,4194304] 0 2024-03-18T14:43:19.410 INFO:tasks.workunit.client.0.smithi087.stdout:9/684: dwrite db/d18/d3a/f59 [0,4194304] 0 2024-03-18T14:43:19.410 INFO:tasks.workunit.client.0.smithi087.stdout:5/627: creat d13/d1b/d27/d35/d3b/fd2 x:0 0 0 2024-03-18T14:43:19.411 INFO:tasks.workunit.client.1.smithi129.stdout:8/423: rename d9/d11/d18/c2e to d9/d11/d53/d5f/c87 0 2024-03-18T14:43:19.411 INFO:tasks.workunit.client.1.smithi129.stdout:2/419: rename d7/d1f/d20 to d7/d1f/d20/d2d/d78 22 2024-03-18T14:43:19.412 INFO:tasks.workunit.client.1.smithi129.stdout:8/424: fsync d9/d11/d1a/d32/d3a/d70/f86 0 2024-03-18T14:43:19.417 INFO:tasks.workunit.client.1.smithi129.stdout:1/398: write d1/d2/d28/f51 [538642,15778] 0 2024-03-18T14:43:19.418 INFO:tasks.workunit.client.0.smithi087.stdout:6/561: rename d3/d7/d25/d62/d7c/d29/d22/d23/da9/d87 to d3/d7/d25/d62/d7c/da0/dbe 0 2024-03-18T14:43:19.419 INFO:tasks.workunit.client.0.smithi087.stdout:2/615: rmdir d2/d4/d22/d2c/d3a/d40/d98 39 2024-03-18T14:43:19.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/577: creat d0/d2/d4/d19/d24/da3/da8/fcc x:0 0 0 2024-03-18T14:43:19.421 INFO:tasks.workunit.client.1.smithi129.stdout:8/425: creat d9/d11/d1a/d32/d3a/d70/f88 x:0 0 0 2024-03-18T14:43:19.421 INFO:tasks.workunit.client.1.smithi129.stdout:4/370: creat d0/d19/f75 x:0 0 0 2024-03-18T14:43:19.422 INFO:tasks.workunit.client.1.smithi129.stdout:6/428: creat d3/d30/df/f85 x:0 0 0 2024-03-18T14:43:19.423 INFO:tasks.workunit.client.1.smithi129.stdout:2/420: mkdir d7/d1c/d79 0 2024-03-18T14:43:19.423 INFO:tasks.workunit.client.0.smithi087.stdout:5/628: mknod d13/d1b/d27/d98/cd3 0 2024-03-18T14:43:19.424 INFO:tasks.workunit.client.1.smithi129.stdout:6/429: write d3/d5/d46/f55 [2859820,75350] 0 2024-03-18T14:43:19.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/421: chown d7/d1f/d34 14 1 2024-03-18T14:43:19.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/706: fdatasync d1/d6/da/fcf 0 2024-03-18T14:43:19.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/578: dwrite d0/d1a/d7b/d26/faa [0,4194304] 0 2024-03-18T14:43:19.430 INFO:tasks.workunit.client.1.smithi129.stdout:3/371: truncate d4/d11/d34/f76 284089 0 2024-03-18T14:43:19.430 INFO:tasks.workunit.client.1.smithi129.stdout:7/434: link d4/d7/d8/f29 d4/f87 0 2024-03-18T14:43:19.430 INFO:tasks.workunit.client.1.smithi129.stdout:4/371: creat d0/d19/d46/d3e/f76 x:0 0 0 2024-03-18T14:43:19.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/568: creat d1/d6/d9/d5d/d87/da2/fbb x:0 0 0 2024-03-18T14:43:19.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/569: chown d1/d6 4 1 2024-03-18T14:43:19.432 INFO:tasks.workunit.client.0.smithi087.stdout:6/562: mknod d3/d7/d25/d62/d7c/d46/cbf 0 2024-03-18T14:43:19.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/570: write d1/d6/d14/f1c [533583,109674] 0 2024-03-18T14:43:19.433 INFO:tasks.workunit.client.1.smithi129.stdout:6/430: mknod d3/d30/de/d65/c86 0 2024-03-18T14:43:19.433 INFO:tasks.workunit.client.0.smithi087.stdout:6/563: read d3/d7/d25/d62/d7c/d29/d7d/f8c [2959878,63997] 0 2024-03-18T14:43:19.437 INFO:tasks.workunit.client.0.smithi087.stdout:7/707: creat d1/d6/d29/d2f/d68/dbf/ff6 x:0 0 0 2024-03-18T14:43:19.438 INFO:tasks.workunit.client.0.smithi087.stdout:7/708: dread - d1/d8e/d95/dae/ff0 zero size 2024-03-18T14:43:19.438 INFO:tasks.workunit.client.1.smithi129.stdout:2/422: creat d7/d1f/d20/d2a/f7a x:0 0 0 2024-03-18T14:43:19.439 INFO:tasks.workunit.client.1.smithi129.stdout:2/423: write d7/d1f/d20/d2b/d41/f5d [3834871,70081] 0 2024-03-18T14:43:19.440 INFO:tasks.workunit.client.0.smithi087.stdout:3/639: link d0/d72/d85/f90 d0/d1c/fb1 0 2024-03-18T14:43:19.444 INFO:tasks.workunit.client.0.smithi087.stdout:5/629: rename d13/d1b/d30/d6e/d88/f99 to d13/d1b/d27/d8f/fd4 0 2024-03-18T14:43:19.445 INFO:tasks.workunit.client.1.smithi129.stdout:3/372: rename d4/dd/d41/f71 to d4/d11/d1d/f7f 0 2024-03-18T14:43:19.446 INFO:tasks.workunit.client.1.smithi129.stdout:1/399: creat d1/d2/d28/d65/d19/f76 x:0 0 0 2024-03-18T14:43:19.446 INFO:tasks.workunit.client.0.smithi087.stdout:8/571: dread d1/d6/d2f/d44/f52 [0,4194304] 0 2024-03-18T14:43:19.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/616: truncate d2/d4/dbb/fbf 784061 0 2024-03-18T14:43:19.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/431: creat d3/d30/f87 x:0 0 0 2024-03-18T14:43:19.447 INFO:tasks.workunit.client.0.smithi087.stdout:2/617: readlink d2/d4/d22/d2c/d3a/lc6 0 2024-03-18T14:43:19.448 INFO:tasks.workunit.client.0.smithi087.stdout:9/685: getdents db/d31 0 2024-03-18T14:43:19.449 INFO:tasks.workunit.client.1.smithi129.stdout:8/426: rmdir d9/d11/d55/d6a/d84 0 2024-03-18T14:43:19.450 INFO:tasks.workunit.client.1.smithi129.stdout:7/435: dread d4/d7/d8/d3b/f40 [0,4194304] 0 2024-03-18T14:43:19.451 INFO:tasks.workunit.client.0.smithi087.stdout:8/572: mkdir d1/d6/d14/db2/dbc 0 2024-03-18T14:43:19.451 INFO:tasks.workunit.client.1.smithi129.stdout:7/436: chown d4/d7/l37 13 1 2024-03-18T14:43:19.451 INFO:tasks.workunit.client.1.smithi129.stdout:1/400: readlink d1/d2/d28/l47 0 2024-03-18T14:43:19.452 INFO:tasks.workunit.client.0.smithi087.stdout:2/618: creat d2/d4/d22/d2c/d3a/d40/d52/fc9 x:0 0 0 2024-03-18T14:43:19.452 INFO:tasks.workunit.client.1.smithi129.stdout:1/401: chown d1/c1e 1590 1 2024-03-18T14:43:19.452 INFO:tasks.workunit.client.0.smithi087.stdout:6/564: creat d3/d7/d25/d62/d7c/d29/d22/fc0 x:0 0 0 2024-03-18T14:43:19.453 INFO:tasks.workunit.client.1.smithi129.stdout:9/391: dread d0/db/d1f/d20/d26/d19/d29/f2d [0,4194304] 0 2024-03-18T14:43:19.453 INFO:tasks.workunit.client.0.smithi087.stdout:9/686: dwrite f3 [0,4194304] 0 2024-03-18T14:43:19.455 INFO:tasks.workunit.client.1.smithi129.stdout:6/432: mknod d3/d5/d46/c88 0 2024-03-18T14:43:19.456 INFO:tasks.workunit.client.1.smithi129.stdout:5/389: dwrite d0/df/f44 [0,4194304] 0 2024-03-18T14:43:19.457 INFO:tasks.workunit.client.0.smithi087.stdout:6/565: dread d3/d7/d25/d62/d7c/d29/d22/d75/d92/f99 [0,4194304] 0 2024-03-18T14:43:19.458 INFO:tasks.workunit.client.1.smithi129.stdout:0/432: sync 2024-03-18T14:43:19.458 INFO:tasks.workunit.client.1.smithi129.stdout:2/424: mkdir d7/d1c/d7b 0 2024-03-18T14:43:19.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/654: sync 2024-03-18T14:43:19.462 INFO:tasks.workunit.client.0.smithi087.stdout:4/559: truncate d2/db/d24/f4c 872485 0 2024-03-18T14:43:19.468 INFO:tasks.workunit.client.1.smithi129.stdout:3/373: dread d4/d11/d34/d4c/f65 [0,4194304] 0 2024-03-18T14:43:19.470 INFO:tasks.workunit.client.1.smithi129.stdout:6/433: creat d3/d5/d46/f89 x:0 0 0 2024-03-18T14:43:19.473 INFO:tasks.workunit.client.1.smithi129.stdout:0/433: readlink d0/l44 0 2024-03-18T14:43:19.473 INFO:tasks.workunit.client.1.smithi129.stdout:8/427: mknod d9/d11/d1a/d79/c89 0 2024-03-18T14:43:19.473 INFO:tasks.workunit.client.0.smithi087.stdout:7/709: write d1/d6/d29/f4d [2146283,111839] 0 2024-03-18T14:43:19.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/573: creat d1/d6/d9/d5d/d87/d88/fbd x:0 0 0 2024-03-18T14:43:19.474 INFO:tasks.workunit.client.1.smithi129.stdout:0/434: chown d0/d23/d35/d3b/c41 62168 1 2024-03-18T14:43:19.474 INFO:tasks.workunit.client.1.smithi129.stdout:3/374: creat d4/d11/d34/d53/f80 x:0 0 0 2024-03-18T14:43:19.476 INFO:tasks.workunit.client.0.smithi087.stdout:5/630: dwrite d13/d1b/d30/f52 [0,4194304] 0 2024-03-18T14:43:19.476 INFO:tasks.workunit.client.0.smithi087.stdout:3/640: dread d0/d3/df/f7d [4194304,4194304] 0 2024-03-18T14:43:19.477 INFO:tasks.workunit.client.0.smithi087.stdout:9/687: creat db/d18/d1e/d28/d76/de0/fe4 x:0 0 0 2024-03-18T14:43:19.478 INFO:tasks.workunit.client.1.smithi129.stdout:1/402: rename d1/c2b to d1/d2/c77 0 2024-03-18T14:43:19.479 INFO:tasks.workunit.client.1.smithi129.stdout:1/403: chown d1/d2/f1f 13 1 2024-03-18T14:43:19.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/435: rmdir d0 39 2024-03-18T14:43:19.481 INFO:tasks.workunit.client.0.smithi087.stdout:1/655: getdents d3/d1d/d1f/dab/dc5 0 2024-03-18T14:43:19.481 INFO:tasks.workunit.client.1.smithi129.stdout:6/434: fsync d3/d5/f27 0 2024-03-18T14:43:19.482 INFO:tasks.workunit.client.0.smithi087.stdout:5/631: read d13/d1b/d27/d35/d3b/f6a [752510,120990] 0 2024-03-18T14:43:19.484 INFO:tasks.workunit.client.0.smithi087.stdout:2/619: rename d2/d44/d72/d8a/da7 to d2/d4/dca 0 2024-03-18T14:43:19.484 INFO:tasks.workunit.client.0.smithi087.stdout:1/656: dread d3/d1d/d1f/f70 [0,4194304] 0 2024-03-18T14:43:19.486 INFO:tasks.workunit.client.1.smithi129.stdout:9/392: getdents d0/db/d1f 0 2024-03-18T14:43:19.486 INFO:tasks.workunit.client.1.smithi129.stdout:3/375: unlink d4/d11/d34/c52 0 2024-03-18T14:43:19.486 INFO:tasks.workunit.client.0.smithi087.stdout:6/566: truncate d3/d7/f21 3071775 0 2024-03-18T14:43:19.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/641: chown d0/d3/df/l3a 1098 1 2024-03-18T14:43:19.488 INFO:tasks.workunit.client.1.smithi129.stdout:7/437: rename d4/d7/d38/d61/d68/d6b/l70 to d4/d7/d8/d3b/l88 0 2024-03-18T14:43:19.489 INFO:tasks.workunit.client.0.smithi087.stdout:9/688: symlink db/d18/d51/d7b/le5 0 2024-03-18T14:43:19.490 INFO:tasks.workunit.client.0.smithi087.stdout:0/579: sync 2024-03-18T14:43:19.491 INFO:tasks.workunit.client.1.smithi129.stdout:0/436: read d0/d23/d29/f58 [5954975,102488] 0 2024-03-18T14:43:19.492 INFO:tasks.workunit.client.1.smithi129.stdout:0/437: readlink d0/l18 0 2024-03-18T14:43:19.492 INFO:tasks.workunit.client.1.smithi129.stdout:6/435: creat d3/d6/f8a x:0 0 0 2024-03-18T14:43:19.493 INFO:tasks.workunit.client.1.smithi129.stdout:6/436: write d3/d38/d57/f75 [702558,16403] 0 2024-03-18T14:43:19.494 INFO:tasks.workunit.client.0.smithi087.stdout:1/657: chown d3/d1d/d45/f59 1686218 1 2024-03-18T14:43:19.496 INFO:tasks.workunit.client.1.smithi129.stdout:9/393: dread d0/db/d2e/f4b [0,4194304] 0 2024-03-18T14:43:19.497 INFO:tasks.workunit.client.1.smithi129.stdout:7/438: symlink d4/d7/d38/d5c/l89 0 2024-03-18T14:43:19.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/567: rmdir d3/d7/d25/d62/d7c/da0/dbe 39 2024-03-18T14:43:19.499 INFO:tasks.workunit.client.1.smithi129.stdout:8/428: truncate d9/d11/d18/f34 1461336 0 2024-03-18T14:43:19.500 INFO:tasks.workunit.client.0.smithi087.stdout:9/689: creat db/d18/d1e/d7e/dc7/fe6 x:0 0 0 2024-03-18T14:43:19.501 INFO:tasks.workunit.client.0.smithi087.stdout:0/580: truncate d0/d2/d4/d27/f55 796602 0 2024-03-18T14:43:19.502 INFO:tasks.workunit.client.1.smithi129.stdout:9/394: dread d0/db/d2e/f4b [0,4194304] 0 2024-03-18T14:43:19.502 INFO:tasks.workunit.client.1.smithi129.stdout:1/404: dwrite d1/d2/d28/f63 [0,4194304] 0 2024-03-18T14:43:19.502 INFO:tasks.workunit.client.0.smithi087.stdout:7/710: getdents d1/d97/db9 0 2024-03-18T14:43:19.503 INFO:tasks.workunit.client.1.smithi129.stdout:0/438: symlink d0/d23/d35/d50/l83 0 2024-03-18T14:43:19.504 INFO:tasks.workunit.client.1.smithi129.stdout:4/372: getdents d0/d19/d46/d3e/d21/d4d/d70 0 2024-03-18T14:43:19.506 INFO:tasks.workunit.client.0.smithi087.stdout:6/568: read d3/d7/d25/f41 [767032,124533] 0 2024-03-18T14:43:19.506 INFO:tasks.workunit.client.0.smithi087.stdout:2/620: write d2/d4/f34 [1702368,130619] 0 2024-03-18T14:43:19.510 INFO:tasks.workunit.client.0.smithi087.stdout:3/642: dread d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:19.511 INFO:tasks.workunit.client.0.smithi087.stdout:9/690: truncate db/d18/d1c/f50 2371931 0 2024-03-18T14:43:19.511 INFO:tasks.workunit.client.0.smithi087.stdout:7/711: rename d1/d6 to d1/d6/d16/df7 22 2024-03-18T14:43:19.511 INFO:tasks.workunit.client.1.smithi129.stdout:0/439: fdatasync d0/fd 0 2024-03-18T14:43:19.512 INFO:tasks.workunit.client.0.smithi087.stdout:6/569: dwrite d3/d7/d25/d62/d7c/d46/f6d [0,4194304] 0 2024-03-18T14:43:19.512 INFO:tasks.workunit.client.0.smithi087.stdout:9/691: read db/d31/f36 [849430,30240] 0 2024-03-18T14:43:19.513 INFO:tasks.workunit.client.0.smithi087.stdout:7/712: write d1/d6/da/d42/d67/fd6 [2836302,104715] 0 2024-03-18T14:43:19.513 INFO:tasks.workunit.client.0.smithi087.stdout:1/658: link d3/d1d/d1e/d20/d7a/db4/fb9 d3/d3c/fce 0 2024-03-18T14:43:19.515 INFO:tasks.workunit.client.1.smithi129.stdout:6/437: mknod d3/d30/df/d28/c8b 0 2024-03-18T14:43:19.516 INFO:tasks.workunit.client.0.smithi087.stdout:7/713: chown d1/d6/da/d42/d61/d74 51047 1 2024-03-18T14:43:19.516 INFO:tasks.workunit.client.0.smithi087.stdout:5/632: getdents d13 0 2024-03-18T14:43:19.516 INFO:tasks.workunit.client.0.smithi087.stdout:4/560: sync 2024-03-18T14:43:19.517 INFO:tasks.workunit.client.1.smithi129.stdout:2/425: rename d7/d1f/d20/d36/c5c to d7/c7c 0 2024-03-18T14:43:19.519 INFO:tasks.workunit.client.1.smithi129.stdout:7/439: creat d4/d7/d54/d86/f8a x:0 0 0 2024-03-18T14:43:19.519 INFO:tasks.workunit.client.0.smithi087.stdout:4/561: write d2/fb6 [1043564,73736] 0 2024-03-18T14:43:19.520 INFO:tasks.workunit.client.1.smithi129.stdout:8/429: mkdir d9/d11/d1a/d14/d60/d8a 0 2024-03-18T14:43:19.520 INFO:tasks.workunit.client.0.smithi087.stdout:5/633: chown d13/d1b/d30/c33 80445 1 2024-03-18T14:43:19.521 INFO:tasks.workunit.client.1.smithi129.stdout:1/405: creat d1/d2/d28/d65/d72/f78 x:0 0 0 2024-03-18T14:43:19.523 INFO:tasks.workunit.client.0.smithi087.stdout:9/692: creat db/d18/d1e/d7e/db8/fe7 x:0 0 0 2024-03-18T14:43:19.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/570: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/fb0 [0,4194304] 0 2024-03-18T14:43:19.523 INFO:tasks.workunit.client.1.smithi129.stdout:5/390: sync 2024-03-18T14:43:19.524 INFO:tasks.workunit.client.1.smithi129.stdout:0/440: symlink d0/d23/d35/d3b/l84 0 2024-03-18T14:43:19.524 INFO:tasks.workunit.client.0.smithi087.stdout:2/621: dwrite d2/d4/d22/f4d [0,4194304] 0 2024-03-18T14:43:19.525 INFO:tasks.workunit.client.1.smithi129.stdout:5/391: dread d0/df/f37 [0,4194304] 0 2024-03-18T14:43:19.525 INFO:tasks.workunit.client.1.smithi129.stdout:6/438: truncate d3/d5/f11 165614 0 2024-03-18T14:43:19.525 INFO:tasks.workunit.client.0.smithi087.stdout:9/693: fdatasync db/d18/d1e/db4/fc4 0 2024-03-18T14:43:19.526 INFO:tasks.workunit.client.1.smithi129.stdout:6/439: chown d3/d5/d46/c88 9751953 1 2024-03-18T14:43:19.526 INFO:tasks.workunit.client.1.smithi129.stdout:2/426: fdatasync d7/d1f/d20/d36/f38 0 2024-03-18T14:43:19.527 INFO:tasks.workunit.client.0.smithi087.stdout:9/694: readlink db/d18/l8e 0 2024-03-18T14:43:19.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/622: chown d2/d4/d22/d2c/f30 1770007757 1 2024-03-18T14:43:19.528 INFO:tasks.workunit.client.0.smithi087.stdout:1/659: rename d3/d1d/d1e/d43/f46 to d3/d1d/d1e/d20/dbd/fcf 0 2024-03-18T14:43:19.529 INFO:tasks.workunit.client.1.smithi129.stdout:8/430: creat d9/d11/d1a/d14/f8b x:0 0 0 2024-03-18T14:43:19.529 INFO:tasks.workunit.client.0.smithi087.stdout:2/623: chown d2/fa1 25192 1 2024-03-18T14:43:19.530 INFO:tasks.workunit.client.0.smithi087.stdout:4/562: dwrite d2/db/d24/d30/f6f [0,4194304] 0 2024-03-18T14:43:19.530 INFO:tasks.workunit.client.1.smithi129.stdout:5/392: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:19.532 INFO:tasks.workunit.client.1.smithi129.stdout:1/406: unlink d1/f46 0 2024-03-18T14:43:19.533 INFO:tasks.workunit.client.1.smithi129.stdout:1/407: chown d1/d2/d28/d65/f5a 218575333 1 2024-03-18T14:43:19.533 INFO:tasks.workunit.client.0.smithi087.stdout:5/634: write d13/d1b/f59 [1694876,21349] 0 2024-03-18T14:43:19.534 INFO:tasks.workunit.client.0.smithi087.stdout:9/695: dwrite db/d18/d1e/f4c [0,4194304] 0 2024-03-18T14:43:19.534 INFO:tasks.workunit.client.0.smithi087.stdout:6/571: unlink d3/d7/c2b 0 2024-03-18T14:43:19.536 INFO:tasks.workunit.client.0.smithi087.stdout:6/572: write d3/d7/d25/d62/d7c/d29/d7d/fb1 [1045320,24684] 0 2024-03-18T14:43:19.537 INFO:tasks.workunit.client.0.smithi087.stdout:6/573: chown d3/d7/d25/d62/d7c/d29/d22/d23/da9 2 1 2024-03-18T14:43:19.538 INFO:tasks.workunit.client.1.smithi129.stdout:6/440: creat d3/d30/df/d28/f8c x:0 0 0 2024-03-18T14:43:19.539 INFO:tasks.workunit.client.1.smithi129.stdout:6/441: fdatasync d3/d6/f51 0 2024-03-18T14:43:19.541 INFO:tasks.workunit.client.0.smithi087.stdout:8/574: sync 2024-03-18T14:43:19.541 INFO:tasks.workunit.client.1.smithi129.stdout:8/431: creat d9/d11/d1a/d32/d3a/d70/f8c x:0 0 0 2024-03-18T14:43:19.542 INFO:tasks.workunit.client.1.smithi129.stdout:1/408: symlink d1/d2/d70/l79 0 2024-03-18T14:43:19.544 INFO:tasks.workunit.client.0.smithi087.stdout:3/643: dread d0/d1c/f2b [0,4194304] 0 2024-03-18T14:43:19.545 INFO:tasks.workunit.client.0.smithi087.stdout:2/624: rename d2/d4/d22/d2c/d3a/dba to d2/d4/d22/d2c/d3a/d68/dcb 0 2024-03-18T14:43:19.546 INFO:tasks.workunit.client.0.smithi087.stdout:9/696: mknod db/d18/d51/d7b/ce8 0 2024-03-18T14:43:19.547 INFO:tasks.workunit.client.1.smithi129.stdout:4/373: getdents d0/d19/d46/d3e/d21/d4d/d58 0 2024-03-18T14:43:19.547 INFO:tasks.workunit.client.1.smithi129.stdout:3/376: getdents d4/d11/d34/d4c 0 2024-03-18T14:43:19.549 INFO:tasks.workunit.client.1.smithi129.stdout:4/374: write d0/d19/f5e [510913,77247] 0 2024-03-18T14:43:19.551 INFO:tasks.workunit.client.1.smithi129.stdout:9/395: dwrite d0/db/f18 [0,4194304] 0 2024-03-18T14:43:19.553 INFO:tasks.workunit.client.1.smithi129.stdout:2/427: fdatasync d7/d1f/d20/d36/f6d 0 2024-03-18T14:43:19.553 INFO:tasks.workunit.client.1.smithi129.stdout:7/440: write d4/f66 [4945117,80557] 0 2024-03-18T14:43:19.558 INFO:tasks.workunit.client.0.smithi087.stdout:4/563: fsync d2/f16 0 2024-03-18T14:43:19.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/575: creat d1/d6/d2f/d9b/fbe x:0 0 0 2024-03-18T14:43:19.561 INFO:tasks.workunit.client.1.smithi129.stdout:4/375: unlink d0/d19/d46/d3e/d21/d4d/d58/f65 0 2024-03-18T14:43:19.563 INFO:tasks.workunit.client.1.smithi129.stdout:9/396: symlink d0/db/d1f/d20/d26/d19/d29/d36/l79 0 2024-03-18T14:43:19.563 INFO:tasks.workunit.client.0.smithi087.stdout:2/625: unlink d2/d4/d22/d2c/d3a/d49/d58/d78/cb1 0 2024-03-18T14:43:19.564 INFO:tasks.workunit.client.1.smithi129.stdout:9/397: dread - d0/db/d1f/d20/d26/d19/d29/d36/f54 zero size 2024-03-18T14:43:19.564 INFO:tasks.workunit.client.0.smithi087.stdout:2/626: dread - d2/fa1 zero size 2024-03-18T14:43:19.566 INFO:tasks.workunit.client.0.smithi087.stdout:0/581: dread d0/d1a/d80/d88/f15 [0,4194304] 0 2024-03-18T14:43:19.566 INFO:tasks.workunit.client.0.smithi087.stdout:8/576: dwrite d1/d6/d14/f79 [4194304,4194304] 0 2024-03-18T14:43:19.567 INFO:tasks.workunit.client.1.smithi129.stdout:2/428: creat d7/d3f/d5f/f7d x:0 0 0 2024-03-18T14:43:19.567 INFO:tasks.workunit.client.0.smithi087.stdout:1/660: rmdir d3/d1d/d1f/dab/dc5 0 2024-03-18T14:43:19.568 INFO:tasks.workunit.client.1.smithi129.stdout:0/441: dread d0/d23/d35/d3b/f57 [0,4194304] 0 2024-03-18T14:43:19.569 INFO:tasks.workunit.client.1.smithi129.stdout:9/398: rmdir d0/db/d11 39 2024-03-18T14:43:19.573 INFO:tasks.workunit.client.1.smithi129.stdout:8/432: write d9/d11/d1a/d32/d41/d4d/f5b [44156,63627] 0 2024-03-18T14:43:19.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/582: write d0/d1a/d80/d88/f15 [3871634,90420] 0 2024-03-18T14:43:19.574 INFO:tasks.workunit.client.1.smithi129.stdout:8/433: chown d9/d11/d1a 27083 1 2024-03-18T14:43:19.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/577: read d1/f2 [184129,55438] 0 2024-03-18T14:43:19.575 INFO:tasks.workunit.client.0.smithi087.stdout:0/583: read - d0/d2/d3c/d73/fc6 zero size 2024-03-18T14:43:19.576 INFO:tasks.workunit.client.1.smithi129.stdout:4/376: mkdir d0/d9/d40/d5f/d77 0 2024-03-18T14:43:19.577 INFO:tasks.workunit.client.0.smithi087.stdout:5/635: getdents d13/d1b/d7e 0 2024-03-18T14:43:19.579 INFO:tasks.workunit.client.0.smithi087.stdout:2/627: rename d2/d4/d22/l4f to d2/d4/d22/d2c/d3a/d68/lcc 0 2024-03-18T14:43:19.580 INFO:tasks.workunit.client.0.smithi087.stdout:6/574: getdents d3/d7/d25/d62/d7c/d46 0 2024-03-18T14:43:19.580 INFO:tasks.workunit.client.0.smithi087.stdout:4/564: dread d2/d13/f3f [0,4194304] 0 2024-03-18T14:43:19.580 INFO:tasks.workunit.client.0.smithi087.stdout:0/584: symlink d0/d1a/d7b/lcd 0 2024-03-18T14:43:19.581 INFO:tasks.workunit.client.1.smithi129.stdout:1/409: truncate d1/d2/d28/f51 805436 0 2024-03-18T14:43:19.582 INFO:tasks.workunit.client.0.smithi087.stdout:7/714: truncate d1/d6/da/d42/d61/fa2 1940835 0 2024-03-18T14:43:19.582 INFO:tasks.workunit.client.1.smithi129.stdout:7/441: truncate d4/d2d/f2a 1558147 0 2024-03-18T14:43:19.584 INFO:tasks.workunit.client.0.smithi087.stdout:3/644: sync 2024-03-18T14:43:19.584 INFO:tasks.workunit.client.1.smithi129.stdout:3/377: rename d4/d38/f37 to d4/d11/d34/d3c/f81 0 2024-03-18T14:43:19.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/410: mkdir d1/d35/d7a 0 2024-03-18T14:43:19.586 INFO:tasks.workunit.client.0.smithi087.stdout:8/578: dread d1/d6/d2f/d44/d45/d72/d7f/d83/f96 [0,4194304] 0 2024-03-18T14:43:19.587 INFO:tasks.workunit.client.1.smithi129.stdout:4/377: symlink d0/d19/d5d/l78 0 2024-03-18T14:43:19.587 INFO:tasks.workunit.client.0.smithi087.stdout:9/697: truncate db/f2f 1622138 0 2024-03-18T14:43:19.588 INFO:tasks.workunit.client.1.smithi129.stdout:7/442: dwrite d4/d7/d8/f47 [0,4194304] 0 2024-03-18T14:43:19.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/698: chown db/d18/d1e 244393043 1 2024-03-18T14:43:19.588 INFO:tasks.workunit.client.1.smithi129.stdout:6/442: dread d3/d30/de/d49/f50 [0,4194304] 0 2024-03-18T14:43:19.590 INFO:tasks.workunit.client.1.smithi129.stdout:8/434: rename d9/f6c to d9/d11/d18/f8d 0 2024-03-18T14:43:19.593 INFO:tasks.workunit.client.0.smithi087.stdout:0/585: creat d0/d1a/d7b/d26/fce x:0 0 0 2024-03-18T14:43:19.594 INFO:tasks.workunit.client.0.smithi087.stdout:7/715: symlink d1/d8e/lf8 0 2024-03-18T14:43:19.598 INFO:tasks.workunit.client.0.smithi087.stdout:9/699: dread db/d18/d1c/f71 [0,4194304] 0 2024-03-18T14:43:19.598 INFO:tasks.workunit.client.1.smithi129.stdout:5/393: sync 2024-03-18T14:43:19.599 INFO:tasks.workunit.client.0.smithi087.stdout:1/661: truncate d3/d1d/d1f/d34/f73 188178 0 2024-03-18T14:43:19.599 INFO:tasks.workunit.client.0.smithi087.stdout:4/565: mknod d2/db/d24/cb8 0 2024-03-18T14:43:19.599 INFO:tasks.workunit.client.0.smithi087.stdout:5/636: creat d13/d1b/d27/d8f/dab/fd5 x:0 0 0 2024-03-18T14:43:19.601 INFO:tasks.workunit.client.0.smithi087.stdout:0/586: dread d0/d2/d4/d19/d62/fbc [0,4194304] 0 2024-03-18T14:43:19.601 INFO:tasks.workunit.client.0.smithi087.stdout:8/579: creat d1/d6/d14/db2/dbc/fbf x:0 0 0 2024-03-18T14:43:19.602 INFO:tasks.workunit.client.1.smithi129.stdout:3/378: mkdir d4/dd/d1f/d5f/d82 0 2024-03-18T14:43:19.602 INFO:tasks.workunit.client.1.smithi129.stdout:7/443: fdatasync d4/d7/f31 0 2024-03-18T14:43:19.602 INFO:tasks.workunit.client.0.smithi087.stdout:8/580: fdatasync d1/d6/d2f/f31 0 2024-03-18T14:43:19.603 INFO:tasks.workunit.client.1.smithi129.stdout:0/442: rename d0/d23/d29/f3e to d0/d6c/f85 0 2024-03-18T14:43:19.603 INFO:tasks.workunit.client.1.smithi129.stdout:4/378: dwrite d0/d9/d40/f71 [0,4194304] 0 2024-03-18T14:43:19.605 INFO:tasks.workunit.client.1.smithi129.stdout:0/443: write d0/d23/d35/f69 [231828,130109] 0 2024-03-18T14:43:19.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/575: write d3/f4 [543546,94705] 0 2024-03-18T14:43:19.607 INFO:tasks.workunit.client.1.smithi129.stdout:9/399: write d0/db/d11/f27 [1893232,34020] 0 2024-03-18T14:43:19.608 INFO:tasks.workunit.client.0.smithi087.stdout:9/700: fdatasync db/d31/fd3 0 2024-03-18T14:43:19.609 INFO:tasks.workunit.client.1.smithi129.stdout:8/435: mknod d9/d11/d1a/d32/d3a/d5d/c8e 0 2024-03-18T14:43:19.611 INFO:tasks.workunit.client.1.smithi129.stdout:7/444: dwrite d4/d2d/d2e/f73 [0,4194304] 0 2024-03-18T14:43:19.612 INFO:tasks.workunit.client.0.smithi087.stdout:5/637: mkdir d13/d1b/d27/d35/dc6/dd6 0 2024-03-18T14:43:19.613 INFO:tasks.workunit.client.1.smithi129.stdout:4/379: dwrite d0/d19/d46/f63 [0,4194304] 0 2024-03-18T14:43:19.613 INFO:tasks.workunit.client.1.smithi129.stdout:3/379: dread d4/dd/f32 [0,4194304] 0 2024-03-18T14:43:19.613 INFO:tasks.workunit.client.0.smithi087.stdout:4/566: creat d2/db/d24/d30/d7b/d7f/fb9 x:0 0 0 2024-03-18T14:43:19.615 INFO:tasks.workunit.client.0.smithi087.stdout:2/628: chown d2/d4/d22/d2c/d3a/d40/d4a/c4c 42061 1 2024-03-18T14:43:19.616 INFO:tasks.workunit.client.1.smithi129.stdout:6/443: truncate d3/d5/f11 450405 0 2024-03-18T14:43:19.616 INFO:tasks.workunit.client.1.smithi129.stdout:0/444: dwrite d0/d23/d35/d3b/f79 [0,4194304] 0 2024-03-18T14:43:19.616 INFO:tasks.workunit.client.1.smithi129.stdout:6/444: chown d3 15244226 1 2024-03-18T14:43:19.617 INFO:tasks.workunit.client.0.smithi087.stdout:8/581: read d1/d6/d2f/f30 [404023,13467] 0 2024-03-18T14:43:19.619 INFO:tasks.workunit.client.1.smithi129.stdout:7/445: truncate d4/d7/ff 687403 0 2024-03-18T14:43:19.620 INFO:tasks.workunit.client.0.smithi087.stdout:6/576: fsync d3/d7/d25/d62/d7c/d29/f5a 0 2024-03-18T14:43:19.620 INFO:tasks.workunit.client.0.smithi087.stdout:2/629: dwrite d2/d44/d72/fad [0,4194304] 0 2024-03-18T14:43:19.621 INFO:tasks.workunit.client.1.smithi129.stdout:3/380: mknod d4/dd/d1f/c83 0 2024-03-18T14:43:19.621 INFO:tasks.workunit.client.1.smithi129.stdout:8/436: dwrite d9/d11/d18/f8d [0,4194304] 0 2024-03-18T14:43:19.622 INFO:tasks.workunit.client.1.smithi129.stdout:3/381: chown d4/d11/d34/d3c/l6d 20 1 2024-03-18T14:43:19.623 INFO:tasks.workunit.client.0.smithi087.stdout:8/582: dwrite d1/f1b [0,4194304] 0 2024-03-18T14:43:19.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/630: write d2/d4/d22/d2c/d3a/d40/fbc [2146694,111479] 0 2024-03-18T14:43:19.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/645: getdents d0/de/d30/d46 0 2024-03-18T14:43:19.626 INFO:tasks.workunit.client.1.smithi129.stdout:8/437: dwrite d9/d11/d1a/f63 [0,4194304] 0 2024-03-18T14:43:19.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/567: write d2/d13/d28/f70 [2991663,23807] 0 2024-03-18T14:43:19.627 INFO:tasks.workunit.client.0.smithi087.stdout:4/568: write d2/db/d24/d30/d7b/d7f/faa [714155,85336] 0 2024-03-18T14:43:19.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/569: chown d2/db/d3c/d90 621792053 1 2024-03-18T14:43:19.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/570: chown d2/l47 182 1 2024-03-18T14:43:19.632 INFO:tasks.workunit.client.1.smithi129.stdout:5/394: creat d0/dc/f73 x:0 0 0 2024-03-18T14:43:19.633 INFO:tasks.workunit.client.1.smithi129.stdout:4/380: mknod d0/d19/d46/d3e/d21/d4d/d58/d61/c79 0 2024-03-18T14:43:19.636 INFO:tasks.workunit.client.1.smithi129.stdout:2/429: sync 2024-03-18T14:43:19.638 INFO:tasks.workunit.client.1.smithi129.stdout:3/382: symlink d4/d11/d34/d4c/l84 0 2024-03-18T14:43:19.638 INFO:tasks.workunit.client.1.smithi129.stdout:8/438: stat d9/l74 0 2024-03-18T14:43:19.638 INFO:tasks.workunit.client.1.smithi129.stdout:3/383: write d4/d38/f47 [883006,71236] 0 2024-03-18T14:43:19.639 INFO:tasks.workunit.client.1.smithi129.stdout:3/384: chown d4/d11/d1d/d36/c39 24010204 1 2024-03-18T14:43:19.640 INFO:tasks.workunit.client.1.smithi129.stdout:5/395: creat d0/d32/d3a/d45/f74 x:0 0 0 2024-03-18T14:43:19.640 INFO:tasks.workunit.client.1.smithi129.stdout:3/385: dread - d4/d11/d1d/f7f zero size 2024-03-18T14:43:19.642 INFO:tasks.workunit.client.1.smithi129.stdout:4/381: symlink d0/d19/d46/d3e/d21/d4d/l7a 0 2024-03-18T14:43:19.642 INFO:tasks.workunit.client.1.smithi129.stdout:2/430: mkdir d7/d1f/d20/d2d/d7e 0 2024-03-18T14:43:19.643 INFO:tasks.workunit.client.1.smithi129.stdout:6/445: truncate d3/d5/d46/f89 843470 0 2024-03-18T14:43:19.643 INFO:tasks.workunit.client.1.smithi129.stdout:8/439: dwrite d9/d11/d18/f24 [4194304,4194304] 0 2024-03-18T14:43:19.644 INFO:tasks.workunit.client.1.smithi129.stdout:8/440: write d9/d11/d1a/d32/d3a/d70/f8c [263731,107897] 0 2024-03-18T14:43:19.648 INFO:tasks.workunit.client.1.smithi129.stdout:5/396: stat d0/dc/c58 0 2024-03-18T14:43:19.649 INFO:tasks.workunit.client.1.smithi129.stdout:3/386: creat d4/d38/d55/f85 x:0 0 0 2024-03-18T14:43:19.650 INFO:tasks.workunit.client.1.smithi129.stdout:3/387: read d4/d11/d34/d4c/f65 [425586,24102] 0 2024-03-18T14:43:19.654 INFO:tasks.workunit.client.1.smithi129.stdout:3/388: dwrite d4/dd/f3d [0,4194304] 0 2024-03-18T14:43:19.657 INFO:tasks.workunit.client.1.smithi129.stdout:3/389: write d4/d11/d34/d3c/f81 [1992894,36495] 0 2024-03-18T14:43:19.658 INFO:tasks.workunit.client.0.smithi087.stdout:8/583: unlink d1/d6/f67 0 2024-03-18T14:43:19.659 INFO:tasks.workunit.client.0.smithi087.stdout:8/584: stat d1/f32 0 2024-03-18T14:43:19.659 INFO:tasks.workunit.client.1.smithi129.stdout:6/446: creat d3/f8d x:0 0 0 2024-03-18T14:43:19.664 INFO:tasks.workunit.client.1.smithi129.stdout:0/445: dwrite d0/d6c/f85 [0,4194304] 0 2024-03-18T14:43:19.665 INFO:tasks.workunit.client.1.smithi129.stdout:2/431: getdents d7/d1f/d20 0 2024-03-18T14:43:19.665 INFO:tasks.workunit.client.1.smithi129.stdout:1/411: sync 2024-03-18T14:43:19.666 INFO:tasks.workunit.client.1.smithi129.stdout:8/441: getdents d9/d11/d1a/d32/d3a 0 2024-03-18T14:43:19.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/631: rename d2/d4/d22/d2c/d3a/d76/d9a/c9d to d2/d4/d22/d2c/d3a/d49/d58/d78/ccd 0 2024-03-18T14:43:19.667 INFO:tasks.workunit.client.0.smithi087.stdout:0/587: truncate d0/d1a/d34/d3d/fc9 354884 0 2024-03-18T14:43:19.668 INFO:tasks.workunit.client.0.smithi087.stdout:7/716: getdents d1/d6/d16/dc 0 2024-03-18T14:43:19.668 INFO:tasks.workunit.client.0.smithi087.stdout:4/571: truncate d2/d13/d28/f2d 327614 0 2024-03-18T14:43:19.670 INFO:tasks.workunit.client.1.smithi129.stdout:8/442: dread d9/f15 [0,4194304] 0 2024-03-18T14:43:19.671 INFO:tasks.workunit.client.0.smithi087.stdout:9/701: link db/c23 db/d31/ce9 0 2024-03-18T14:43:19.672 INFO:tasks.workunit.client.0.smithi087.stdout:1/662: getdents d3/d1d/d1f/dab 0 2024-03-18T14:43:19.674 INFO:tasks.workunit.client.1.smithi129.stdout:8/443: dwrite d9/d11/d18/f35 [0,4194304] 0 2024-03-18T14:43:19.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/638: sync 2024-03-18T14:43:19.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/588: creat d0/d1a/d80/d88/fcf x:0 0 0 2024-03-18T14:43:19.676 INFO:tasks.workunit.client.1.smithi129.stdout:8/444: read d9/d11/d18/f35 [125,21894] 0 2024-03-18T14:43:19.676 INFO:tasks.workunit.client.1.smithi129.stdout:8/445: stat d9/d11/d18/f35 0 2024-03-18T14:43:19.676 INFO:tasks.workunit.client.0.smithi087.stdout:5/639: chown d13/d1b/d27/d35/c53 722045047 1 2024-03-18T14:43:19.677 INFO:tasks.workunit.client.0.smithi087.stdout:4/572: symlink d2/db/de/lba 0 2024-03-18T14:43:19.678 INFO:tasks.workunit.client.0.smithi087.stdout:9/702: rename db/d18/d1e/f4c to db/d18/d1c/d69/fea 0 2024-03-18T14:43:19.682 INFO:tasks.workunit.client.1.smithi129.stdout:9/400: sync 2024-03-18T14:43:19.682 INFO:tasks.workunit.client.1.smithi129.stdout:5/397: sync 2024-03-18T14:43:19.684 INFO:tasks.workunit.client.1.smithi129.stdout:0/446: dread d0/d23/d35/f36 [4194304,4194304] 0 2024-03-18T14:43:19.684 INFO:tasks.workunit.client.1.smithi129.stdout:8/446: creat d9/d11/d1a/d32/d3a/f8f x:0 0 0 2024-03-18T14:43:19.685 INFO:tasks.workunit.client.1.smithi129.stdout:1/412: link d1/c1a d1/d2/d28/d65/d72/c7b 0 2024-03-18T14:43:19.687 INFO:tasks.workunit.client.1.smithi129.stdout:9/401: creat d0/d15/f7a x:0 0 0 2024-03-18T14:43:19.688 INFO:tasks.workunit.client.0.smithi087.stdout:3/646: link d0/d1c/l3b d0/d3/d10/da5/lb2 0 2024-03-18T14:43:19.688 INFO:tasks.workunit.client.1.smithi129.stdout:5/398: dwrite d0/df/f3c [0,4194304] 0 2024-03-18T14:43:19.689 INFO:tasks.workunit.client.0.smithi087.stdout:0/589: symlink d0/d1a/d34/ld0 0 2024-03-18T14:43:19.690 INFO:tasks.workunit.client.1.smithi129.stdout:0/447: creat d0/d14/d28/f86 x:0 0 0 2024-03-18T14:43:19.690 INFO:tasks.workunit.client.0.smithi087.stdout:0/590: write d0/d2/d3c/f69 [1881633,34302] 0 2024-03-18T14:43:19.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/640: fsync d13/d1b/d30/d6e/d88/db4/fc7 0 2024-03-18T14:43:19.693 INFO:tasks.workunit.client.1.smithi129.stdout:9/402: creat d0/db/d1f/f7b x:0 0 0 2024-03-18T14:43:19.694 INFO:tasks.workunit.client.0.smithi087.stdout:0/591: dwrite d0/d1a/d7b/d26/faa [0,4194304] 0 2024-03-18T14:43:19.694 INFO:tasks.workunit.client.1.smithi129.stdout:5/399: write d0/d32/d34/f3b [525931,3332] 0 2024-03-18T14:43:19.695 INFO:tasks.workunit.client.1.smithi129.stdout:1/413: mkdir d1/d2/d28/d65/d7c 0 2024-03-18T14:43:19.696 INFO:tasks.workunit.client.1.smithi129.stdout:3/390: dread d4/d38/f1b [0,4194304] 0 2024-03-18T14:43:19.696 INFO:tasks.workunit.client.1.smithi129.stdout:7/446: truncate d4/d2d/d2e/d42/d58/f7f 480334 0 2024-03-18T14:43:19.697 INFO:tasks.workunit.client.1.smithi129.stdout:7/447: chown d4/d7/d8/d3b/f6d 34 1 2024-03-18T14:43:19.697 INFO:tasks.workunit.client.0.smithi087.stdout:8/585: dread d1/d6/f1e [0,4194304] 0 2024-03-18T14:43:19.700 INFO:tasks.workunit.client.1.smithi129.stdout:4/382: write d0/d9/f15 [985699,124596] 0 2024-03-18T14:43:19.700 INFO:tasks.workunit.client.1.smithi129.stdout:6/447: write d3/d30/de/f22 [191777,47067] 0 2024-03-18T14:43:19.700 INFO:tasks.workunit.client.1.smithi129.stdout:3/391: read d4/dd/d1f/d5f/d31/f5c [743900,69595] 0 2024-03-18T14:43:19.701 INFO:tasks.workunit.client.1.smithi129.stdout:2/432: truncate d7/d1f/d20/d2b/d41/f5d 2460761 0 2024-03-18T14:43:19.701 INFO:tasks.workunit.client.1.smithi129.stdout:6/448: write d3/d30/f1e [2745833,104062] 0 2024-03-18T14:43:19.701 INFO:tasks.workunit.client.1.smithi129.stdout:3/392: dread - d4/d38/d55/f85 zero size 2024-03-18T14:43:19.702 INFO:tasks.workunit.client.1.smithi129.stdout:2/433: dread - d7/d3f/d5f/f7d zero size 2024-03-18T14:43:19.703 INFO:tasks.workunit.client.1.smithi129.stdout:6/449: write d3/d30/df/d28/f54 [1196873,70904] 0 2024-03-18T14:43:19.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/434: readlink d7/d1f/d20/d2b/d41/l42 0 2024-03-18T14:43:19.704 INFO:tasks.workunit.client.1.smithi129.stdout:2/435: write d7/d1f/d20/d2d/f2e [1120381,39836] 0 2024-03-18T14:43:19.730 INFO:tasks.workunit.client.0.smithi087.stdout:6/577: write d3/d7/d25/d62/d7c/d29/d22/f80 [26820,18275] 0 2024-03-18T14:43:19.738 INFO:tasks.workunit.client.0.smithi087.stdout:1/663: write d3/d1d/d45/f49 [2611588,115469] 0 2024-03-18T14:43:19.738 INFO:tasks.workunit.client.1.smithi129.stdout:9/403: readlink d0/db/d1f/d20/d6c/l75 0 2024-03-18T14:43:19.739 INFO:tasks.workunit.client.1.smithi129.stdout:9/404: chown d0/db/d1f/d20/d26/d19/d29/l73 1 1 2024-03-18T14:43:19.743 INFO:tasks.workunit.client.1.smithi129.stdout:5/400: dread d0/dc/f4e [0,4194304] 0 2024-03-18T14:43:19.744 INFO:tasks.workunit.client.1.smithi129.stdout:5/401: write d0/d32/d34/f3b [1687528,53144] 0 2024-03-18T14:43:19.748 INFO:tasks.workunit.client.1.smithi129.stdout:7/448: write d4/d2d/d2e/d42/f7c [308833,4422] 0 2024-03-18T14:43:19.774 INFO:tasks.workunit.client.0.smithi087.stdout:7/717: getdents d1/d8e/d95/dae 0 2024-03-18T14:43:19.778 INFO:tasks.workunit.client.0.smithi087.stdout:4/573: truncate d2/db/d84/d87/f9b 113329 0 2024-03-18T14:43:19.783 INFO:tasks.workunit.client.0.smithi087.stdout:5/641: dwrite d13/d1b/d27/f34 [4194304,4194304] 0 2024-03-18T14:43:19.784 INFO:tasks.workunit.client.0.smithi087.stdout:8/586: dwrite d1/d6/d2f/d44/f52 [0,4194304] 0 2024-03-18T14:43:19.797 INFO:tasks.workunit.client.1.smithi129.stdout:2/436: unlink d7/l17 0 2024-03-18T14:43:19.798 INFO:tasks.workunit.client.1.smithi129.stdout:8/447: truncate d9/d11/d1a/d32/d3a/f59 686345 0 2024-03-18T14:43:19.799 INFO:tasks.workunit.client.1.smithi129.stdout:8/448: write d9/d11/d1a/d32/d3a/f20 [941521,77632] 0 2024-03-18T14:43:19.800 INFO:tasks.workunit.client.1.smithi129.stdout:9/405: unlink d0/db/d1f/d20/d4a/f46 0 2024-03-18T14:43:19.801 INFO:tasks.workunit.client.1.smithi129.stdout:9/406: write d0/db/d1f/f4e [473035,11220] 0 2024-03-18T14:43:19.802 INFO:tasks.workunit.client.1.smithi129.stdout:8/449: dread d9/d11/d18/f3f [0,4194304] 0 2024-03-18T14:43:19.804 INFO:tasks.workunit.client.1.smithi129.stdout:1/414: mkdir d1/d2/d28/d65/d7c/d7d 0 2024-03-18T14:43:19.805 INFO:tasks.workunit.client.1.smithi129.stdout:1/415: chown d1/d2/d70/d71 110752468 1 2024-03-18T14:43:19.807 INFO:tasks.workunit.client.1.smithi129.stdout:8/450: dwrite d9/d11/d1a/d32/d41/d4d/f5b [0,4194304] 0 2024-03-18T14:43:19.809 INFO:tasks.workunit.client.1.smithi129.stdout:4/383: mkdir d0/d9/d6a/d7b 0 2024-03-18T14:43:19.810 INFO:tasks.workunit.client.1.smithi129.stdout:3/393: rmdir d4/d11/d34/d53 39 2024-03-18T14:43:19.819 INFO:tasks.workunit.client.1.smithi129.stdout:9/407: creat d0/db/d2e/f7c x:0 0 0 2024-03-18T14:43:19.819 INFO:tasks.workunit.client.1.smithi129.stdout:5/402: mknod d0/dc/d18/d2b/d71/c75 0 2024-03-18T14:43:19.820 INFO:tasks.workunit.client.1.smithi129.stdout:1/416: mknod d1/d2/d28/d65/d19/d52/c7e 0 2024-03-18T14:43:19.822 INFO:tasks.workunit.client.1.smithi129.stdout:1/417: dread d1/f5f [0,4194304] 0 2024-03-18T14:43:19.827 INFO:tasks.workunit.client.1.smithi129.stdout:0/448: getdents d0/d23 0 2024-03-18T14:43:19.828 INFO:tasks.workunit.client.1.smithi129.stdout:0/449: write d0/d14/d3a/f62 [884785,90756] 0 2024-03-18T14:43:19.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/450: rmdir d3/d30/de/d49/d68 0 2024-03-18T14:43:19.831 INFO:tasks.workunit.client.1.smithi129.stdout:9/408: fsync d0/db/d1f/d20/d26/f2a 0 2024-03-18T14:43:19.832 INFO:tasks.workunit.client.0.smithi087.stdout:9/703: truncate f3 759253 0 2024-03-18T14:43:19.832 INFO:tasks.workunit.client.1.smithi129.stdout:6/451: fsync d3/d5/d46/f55 0 2024-03-18T14:43:19.833 INFO:tasks.workunit.client.0.smithi087.stdout:9/704: write db/d18/d1e/d28/d76/db7/fc1 [337046,101010] 0 2024-03-18T14:43:19.833 INFO:tasks.workunit.client.1.smithi129.stdout:6/452: chown d3/d30/c62 354371573 1 2024-03-18T14:43:19.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/450: dwrite d0/d23/d35/f69 [0,4194304] 0 2024-03-18T14:43:19.834 INFO:tasks.workunit.client.0.smithi087.stdout:1/664: rmdir d3/d1d 39 2024-03-18T14:43:19.837 INFO:tasks.workunit.client.0.smithi087.stdout:3/647: dwrite d0/d1c/d25/f6a [4194304,4194304] 0 2024-03-18T14:43:19.838 INFO:tasks.workunit.client.0.smithi087.stdout:3/648: chown d0/de/d30/d46/f89 173025 1 2024-03-18T14:43:19.838 INFO:tasks.workunit.client.1.smithi129.stdout:8/451: mkdir d9/d11/d55/d68/d72/d90 0 2024-03-18T14:43:19.840 INFO:tasks.workunit.client.1.smithi129.stdout:0/451: dwrite d0/d14/d28/f86 [0,4194304] 0 2024-03-18T14:43:19.843 INFO:tasks.workunit.client.1.smithi129.stdout:7/449: getdents d4/d7/d8/d3b 0 2024-03-18T14:43:19.843 INFO:tasks.workunit.client.1.smithi129.stdout:4/384: dread d0/d19/d46/d3e/d21/d4d/d70/f24 [0,4194304] 0 2024-03-18T14:43:19.844 INFO:tasks.workunit.client.1.smithi129.stdout:5/403: dread d0/d32/d34/f3b [0,4194304] 0 2024-03-18T14:43:19.849 INFO:tasks.workunit.client.1.smithi129.stdout:5/404: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:19.849 INFO:tasks.workunit.client.1.smithi129.stdout:8/452: rename d9/d11/d1a/d32/d41/d4d/l83 to d9/d11/d1a/d32/d3a/d5d/l91 0 2024-03-18T14:43:19.849 INFO:tasks.workunit.client.1.smithi129.stdout:1/418: creat d1/d2/d28/f7f x:0 0 0 2024-03-18T14:43:19.850 INFO:tasks.workunit.client.1.smithi129.stdout:8/453: fdatasync d9/f7d 0 2024-03-18T14:43:19.851 INFO:tasks.workunit.client.1.smithi129.stdout:5/405: read d0/f6 [1417596,20433] 0 2024-03-18T14:43:19.852 INFO:tasks.workunit.client.1.smithi129.stdout:5/406: write d0/df/f68 [1038271,47520] 0 2024-03-18T14:43:19.853 INFO:tasks.workunit.client.1.smithi129.stdout:2/437: dread d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:19.854 INFO:tasks.workunit.client.1.smithi129.stdout:0/452: rename d0/d23/d6b/l81 to d0/d14/d3a/d4a/d7a/l87 0 2024-03-18T14:43:19.855 INFO:tasks.workunit.client.1.smithi129.stdout:3/394: sync 2024-03-18T14:43:19.857 INFO:tasks.workunit.client.1.smithi129.stdout:7/450: creat d4/d83/f8b x:0 0 0 2024-03-18T14:43:19.860 INFO:tasks.workunit.client.1.smithi129.stdout:5/407: chown d0/df/c24 349647 1 2024-03-18T14:43:19.860 INFO:tasks.workunit.client.1.smithi129.stdout:5/408: chown d0/df 24926438 1 2024-03-18T14:43:19.860 INFO:tasks.workunit.client.1.smithi129.stdout:2/438: symlink d7/d1c/d62/l7f 0 2024-03-18T14:43:19.861 INFO:tasks.workunit.client.1.smithi129.stdout:0/453: mknod d0/d23/d6b/c88 0 2024-03-18T14:43:19.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/419: mkdir d1/d2/d28/d65/d7c/d7d/d80 0 2024-03-18T14:43:19.868 INFO:tasks.workunit.client.0.smithi087.stdout:5/642: fsync d13/d1b/d70/fbb 0 2024-03-18T14:43:19.868 INFO:tasks.workunit.client.0.smithi087.stdout:8/587: symlink d1/d6/d2f/d44/d45/d72/d7f/d83/lc0 0 2024-03-18T14:43:19.869 INFO:tasks.workunit.client.1.smithi129.stdout:0/454: unlink d0/d23/d35/c66 0 2024-03-18T14:43:19.870 INFO:tasks.workunit.client.0.smithi087.stdout:3/649: symlink d0/de/d30/d67/lb3 0 2024-03-18T14:43:19.870 INFO:tasks.workunit.client.1.smithi129.stdout:3/395: fsync d4/d11/d34/d3c/d3f/f63 0 2024-03-18T14:43:19.872 INFO:tasks.workunit.client.0.smithi087.stdout:2/632: rename d2/d4/f16 to d2/d4/d22/d24/fce 0 2024-03-18T14:43:19.872 INFO:tasks.workunit.client.1.smithi129.stdout:8/454: creat d9/d11/d1a/f92 x:0 0 0 2024-03-18T14:43:19.872 INFO:tasks.workunit.client.1.smithi129.stdout:5/409: mknod d0/d32/d3a/d52/d69/c76 0 2024-03-18T14:43:19.873 INFO:tasks.workunit.client.0.smithi087.stdout:7/718: symlink d1/d6/d16/da6/dee/lf9 0 2024-03-18T14:43:19.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/643: dread d13/f23 [0,4194304] 0 2024-03-18T14:43:19.873 INFO:tasks.workunit.client.1.smithi129.stdout:6/453: dread d3/d5/d46/f55 [0,4194304] 0 2024-03-18T14:43:19.873 INFO:tasks.workunit.client.1.smithi129.stdout:8/455: fsync d9/d11/d1a/d32/d41/d4d/f5b 0 2024-03-18T14:43:19.873 INFO:tasks.workunit.client.0.smithi087.stdout:2/633: stat d2/d4/d22/d2c/f74 0 2024-03-18T14:43:19.874 INFO:tasks.workunit.client.1.smithi129.stdout:6/454: fsync d3/d38/d57/f75 0 2024-03-18T14:43:19.874 INFO:tasks.workunit.client.0.smithi087.stdout:1/665: dread d3/d1d/d1f/f70 [0,4194304] 0 2024-03-18T14:43:19.874 INFO:tasks.workunit.client.1.smithi129.stdout:7/451: rename d4/d7/d38/d5c to d4/d8c 0 2024-03-18T14:43:19.875 INFO:tasks.workunit.client.0.smithi087.stdout:4/574: creat d2/db/d24/d30/d8a/d95/fbb x:0 0 0 2024-03-18T14:43:19.875 INFO:tasks.workunit.client.0.smithi087.stdout:6/578: write d3/d7/f44 [6402513,48968] 0 2024-03-18T14:43:19.877 INFO:tasks.workunit.client.0.smithi087.stdout:3/650: dwrite d0/de/d30/f5d [0,4194304] 0 2024-03-18T14:43:19.878 INFO:tasks.workunit.client.1.smithi129.stdout:4/385: truncate d0/f5 2503328 0 2024-03-18T14:43:19.879 INFO:tasks.workunit.client.0.smithi087.stdout:8/588: read d1/d6/d9/d5d/d87/f8a [800,51877] 0 2024-03-18T14:43:19.880 INFO:tasks.workunit.client.0.smithi087.stdout:8/589: chown d1/d6/d2f/d44/d45/d72/db6 47 1 2024-03-18T14:43:19.881 INFO:tasks.workunit.client.1.smithi129.stdout:1/420: truncate d1/d2/d28/d65/f36 3813612 0 2024-03-18T14:43:19.883 INFO:tasks.workunit.client.1.smithi129.stdout:1/421: dread d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:19.886 INFO:tasks.workunit.client.0.smithi087.stdout:2/634: readlink d2/d4/l9 0 2024-03-18T14:43:19.889 INFO:tasks.workunit.client.0.smithi087.stdout:9/705: dwrite db/d18/d1c/f50 [0,4194304] 0 2024-03-18T14:43:19.889 INFO:tasks.workunit.client.0.smithi087.stdout:6/579: fdatasync d3/d7/d25/d62/d8b/fb7 0 2024-03-18T14:43:19.889 INFO:tasks.workunit.client.0.smithi087.stdout:1/666: dread d3/d1d/d1f/f5d [0,4194304] 0 2024-03-18T14:43:19.889 INFO:tasks.workunit.client.1.smithi129.stdout:6/455: chown d3/c72 3 1 2024-03-18T14:43:19.890 INFO:tasks.workunit.client.0.smithi087.stdout:8/590: creat d1/d6/d2f/d44/d45/d72/d7f/fc1 x:0 0 0 2024-03-18T14:43:19.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/456: symlink d9/d11/d1a/d32/d3a/l93 0 2024-03-18T14:43:19.891 INFO:tasks.workunit.client.1.smithi129.stdout:2/439: rename d7/d1f/d20/c29 to d7/d3f/c80 0 2024-03-18T14:43:19.892 INFO:tasks.workunit.client.1.smithi129.stdout:2/440: fsync f0 0 2024-03-18T14:43:19.892 INFO:tasks.workunit.client.1.smithi129.stdout:2/441: chown d7/d1f/d20/c56 14369 1 2024-03-18T14:43:19.894 INFO:tasks.workunit.client.1.smithi129.stdout:2/442: write d7/d1f/d20/d2d/f2e [3829035,30332] 0 2024-03-18T14:43:19.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/592: rename d0/d1a/d7b/d2a/d85/f7e to d0/d1a/fd1 0 2024-03-18T14:43:19.896 INFO:tasks.workunit.client.0.smithi087.stdout:2/635: dwrite d2/d4/d22/d2c/d3a/d76/d81/f82 [0,4194304] 0 2024-03-18T14:43:19.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/593: write d0/d1a/d7b/d26/f2c [1474453,130704] 0 2024-03-18T14:43:19.896 INFO:tasks.workunit.client.1.smithi129.stdout:0/455: link d0/d14/f5f d0/d23/d6b/f89 0 2024-03-18T14:43:19.898 INFO:tasks.workunit.client.0.smithi087.stdout:1/667: symlink d3/d1d/d67/ld0 0 2024-03-18T14:43:19.898 INFO:tasks.workunit.client.1.smithi129.stdout:9/409: sync 2024-03-18T14:43:19.900 INFO:tasks.workunit.client.0.smithi087.stdout:5/644: dwrite d13/d1b/f94 [0,4194304] 0 2024-03-18T14:43:19.902 INFO:tasks.workunit.client.0.smithi087.stdout:7/719: rename d1/d6/d29/d2f/f33 to d1/d6/d16/da6/dee/ffa 0 2024-03-18T14:43:19.903 INFO:tasks.workunit.client.0.smithi087.stdout:8/591: dread d1/d6/d2f/d44/d4b/f4c [0,4194304] 0 2024-03-18T14:43:19.903 INFO:tasks.workunit.client.1.smithi129.stdout:7/452: symlink d4/d2d/d2e/d79/l8d 0 2024-03-18T14:43:19.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/636: fsync d2/d4/d22/d2c/d3a/d40/f84 0 2024-03-18T14:43:19.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/575: rename d2/db/d82/fb0 to d2/db/d67/fbc 0 2024-03-18T14:43:19.909 INFO:tasks.workunit.client.0.smithi087.stdout:4/576: fdatasync d2/db/d3c/d90/f93 0 2024-03-18T14:43:19.910 INFO:tasks.workunit.client.1.smithi129.stdout:4/386: symlink d0/d19/d46/d3e/d33/l7c 0 2024-03-18T14:43:19.911 INFO:tasks.workunit.client.1.smithi129.stdout:4/387: read d0/d19/f5e [381376,32519] 0 2024-03-18T14:43:19.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/637: creat d2/d4/d22/d2c/d3a/fcf x:0 0 0 2024-03-18T14:43:19.913 INFO:tasks.workunit.client.0.smithi087.stdout:6/580: getdents d3/d7/d25/d62/d7c/d29/d22/d75 0 2024-03-18T14:43:19.915 INFO:tasks.workunit.client.1.smithi129.stdout:9/410: symlink d0/db/d1f/d20/d4a/l7d 0 2024-03-18T14:43:19.916 INFO:tasks.workunit.client.1.smithi129.stdout:5/410: sync 2024-03-18T14:43:19.916 INFO:tasks.workunit.client.1.smithi129.stdout:6/456: creat d3/d30/de/d65/d80/f8e x:0 0 0 2024-03-18T14:43:19.916 INFO:tasks.workunit.client.0.smithi087.stdout:7/720: truncate d1/d6/d29/d2f/d68/d65/d60/f84 221033 0 2024-03-18T14:43:19.917 INFO:tasks.workunit.client.1.smithi129.stdout:3/396: dwrite d4/dd/f4d [0,4194304] 0 2024-03-18T14:43:19.917 INFO:tasks.workunit.client.0.smithi087.stdout:9/706: write db/d18/d1e/d28/d76/da7/fb6 [147926,94711] 0 2024-03-18T14:43:19.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/707: chown db/d18/d51/f5c 7694 1 2024-03-18T14:43:19.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/645: write d13/d1b/d27/d35/f4b [649699,102882] 0 2024-03-18T14:43:19.920 INFO:tasks.workunit.client.1.smithi129.stdout:2/443: mkdir d7/d1f/d81 0 2024-03-18T14:43:19.921 INFO:tasks.workunit.client.1.smithi129.stdout:3/397: dread d4/f54 [0,4194304] 0 2024-03-18T14:43:19.922 INFO:tasks.workunit.client.0.smithi087.stdout:0/594: truncate d0/d1a/d80/f95 771603 0 2024-03-18T14:43:19.924 INFO:tasks.workunit.client.1.smithi129.stdout:1/422: creat d1/d2/d28/f81 x:0 0 0 2024-03-18T14:43:19.924 INFO:tasks.workunit.client.0.smithi087.stdout:1/668: creat d3/d1d/d1f/fd1 x:0 0 0 2024-03-18T14:43:19.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/577: mkdir d2/db/d3c/dbd 0 2024-03-18T14:43:19.925 INFO:tasks.workunit.client.0.smithi087.stdout:1/669: dread - d3/d1d/d1e/fa2 zero size 2024-03-18T14:43:19.925 INFO:tasks.workunit.client.1.smithi129.stdout:1/423: readlink d1/d2/d28/d65/d19/l62 0 2024-03-18T14:43:19.925 INFO:tasks.workunit.client.1.smithi129.stdout:8/457: creat d9/d11/d1a/d32/d41/f94 x:0 0 0 2024-03-18T14:43:19.926 INFO:tasks.workunit.client.1.smithi129.stdout:1/424: chown d1/d2/d70/d56/f6f 5083 1 2024-03-18T14:43:19.926 INFO:tasks.workunit.client.1.smithi129.stdout:1/425: stat d1/d2/d70/d56 0 2024-03-18T14:43:19.927 INFO:tasks.workunit.client.1.smithi129.stdout:5/411: rmdir d0/d32/d3a/d45 39 2024-03-18T14:43:19.927 INFO:tasks.workunit.client.1.smithi129.stdout:1/426: fdatasync d1/d35/f45 0 2024-03-18T14:43:19.928 INFO:tasks.workunit.client.1.smithi129.stdout:1/427: dread - d1/d2/d28/d65/d19/f76 zero size 2024-03-18T14:43:19.929 INFO:tasks.workunit.client.0.smithi087.stdout:6/581: unlink d3/d7/f44 0 2024-03-18T14:43:19.930 INFO:tasks.workunit.client.1.smithi129.stdout:7/453: dread d4/fd [0,4194304] 0 2024-03-18T14:43:19.930 INFO:tasks.workunit.client.0.smithi087.stdout:5/646: rename d13/d1b/d27/f45 to d13/d1b/d27/d28/d9a/dae/fd7 0 2024-03-18T14:43:19.930 INFO:tasks.workunit.client.1.smithi129.stdout:7/454: readlink d4/d2d/d2e/d79/l82 0 2024-03-18T14:43:19.932 INFO:tasks.workunit.client.1.smithi129.stdout:4/388: truncate d0/d9/d4c/f6d 4288874 0 2024-03-18T14:43:19.932 INFO:tasks.workunit.client.1.smithi129.stdout:9/411: getdents d0/db/d1f/d20/d4a/d3e 0 2024-03-18T14:43:19.932 INFO:tasks.workunit.client.1.smithi129.stdout:4/389: chown d0 916675134 1 2024-03-18T14:43:19.933 INFO:tasks.workunit.client.1.smithi129.stdout:8/458: mkdir d9/d11/d55/d6a/d95 0 2024-03-18T14:43:19.934 INFO:tasks.workunit.client.0.smithi087.stdout:2/638: link d2/d4/d22/d2c/d3a/d40/f8d d2/d4/d22/d2c/d3a/d40/d98/fd0 0 2024-03-18T14:43:19.935 INFO:tasks.workunit.client.1.smithi129.stdout:5/412: truncate d0/dc/f4e 827391 0 2024-03-18T14:43:19.936 INFO:tasks.workunit.client.1.smithi129.stdout:5/413: chown d0/dc/d18/l38 169371890 1 2024-03-18T14:43:19.938 INFO:tasks.workunit.client.1.smithi129.stdout:9/412: dwrite d0/db/d1f/d20/d25/f3d [0,4194304] 0 2024-03-18T14:43:19.938 INFO:tasks.workunit.client.0.smithi087.stdout:7/721: link d1/d8e/d95/dae/ff0 d1/d6/d29/d2f/d68/d65/ffb 0 2024-03-18T14:43:19.939 INFO:tasks.workunit.client.1.smithi129.stdout:5/414: write d0/dc/d1a/d61/f6d [54406,74279] 0 2024-03-18T14:43:19.939 INFO:tasks.workunit.client.0.smithi087.stdout:7/722: chown d1/c83 2 1 2024-03-18T14:43:19.940 INFO:tasks.workunit.client.0.smithi087.stdout:7/723: chown d1/d6/d29/d2f/d68/faa 9623 1 2024-03-18T14:43:19.940 INFO:tasks.workunit.client.1.smithi129.stdout:0/456: truncate d0/d14/f20 2653006 0 2024-03-18T14:43:19.942 INFO:tasks.workunit.client.1.smithi129.stdout:1/428: creat d1/d2/d70/d56/f82 x:0 0 0 2024-03-18T14:43:19.942 INFO:tasks.workunit.client.0.smithi087.stdout:9/708: dread db/f68 [0,4194304] 0 2024-03-18T14:43:19.943 INFO:tasks.workunit.client.1.smithi129.stdout:2/444: dread d7/d1c/d32/f6c [0,4194304] 0 2024-03-18T14:43:19.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/724: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f9c [0,4194304] 0 2024-03-18T14:43:19.946 INFO:tasks.workunit.client.1.smithi129.stdout:6/457: dwrite d3/d5/f27 [0,4194304] 0 2024-03-18T14:43:19.948 INFO:tasks.workunit.client.1.smithi129.stdout:4/390: creat d0/d19/d46/d3e/d33/f7d x:0 0 0 2024-03-18T14:43:19.949 INFO:tasks.workunit.client.1.smithi129.stdout:9/413: stat d0/d15/c64 0 2024-03-18T14:43:19.950 INFO:tasks.workunit.client.0.smithi087.stdout:4/578: rename d2/db/d24/d30/d7b/d7f/da4 to d2/db/d24/d30/d7b/dbe 0 2024-03-18T14:43:19.950 INFO:tasks.workunit.client.0.smithi087.stdout:8/592: getdents d1/d6/d2f/d44/d4b 0 2024-03-18T14:43:19.951 INFO:tasks.workunit.client.1.smithi129.stdout:5/415: rmdir d0/d32/d3a/d52 39 2024-03-18T14:43:19.951 INFO:tasks.workunit.client.0.smithi087.stdout:5/647: fdatasync d13/d1b/d30/f5b 0 2024-03-18T14:43:19.951 INFO:tasks.workunit.client.0.smithi087.stdout:0/595: mkdir d0/d2/d4/d27/dc3/dd2 0 2024-03-18T14:43:19.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/651: sync 2024-03-18T14:43:19.952 INFO:tasks.workunit.client.1.smithi129.stdout:0/457: rmdir d0/d14/d53 39 2024-03-18T14:43:19.954 INFO:tasks.workunit.client.0.smithi087.stdout:9/709: unlink db/d18/d1e/f5a 0 2024-03-18T14:43:19.955 INFO:tasks.workunit.client.1.smithi129.stdout:5/416: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:19.956 INFO:tasks.workunit.client.1.smithi129.stdout:3/398: rename d4/d38/c3b to d4/d11/d34/c86 0 2024-03-18T14:43:19.957 INFO:tasks.workunit.client.1.smithi129.stdout:3/399: readlink d4/d11/d1d/d27/l2d 0 2024-03-18T14:43:19.957 INFO:tasks.workunit.client.1.smithi129.stdout:6/458: readlink d3/d6/l5b 0 2024-03-18T14:43:19.958 INFO:tasks.workunit.client.0.smithi087.stdout:0/596: dread d0/d1a/d7b/f22 [0,4194304] 0 2024-03-18T14:43:19.959 INFO:tasks.workunit.client.0.smithi087.stdout:8/593: mkdir d1/d6/d8d/dc2 0 2024-03-18T14:43:19.960 INFO:tasks.workunit.client.0.smithi087.stdout:2/639: dread d2/d4/d22/d2c/d3a/d40/d98/fd0 [0,4194304] 0 2024-03-18T14:43:19.960 INFO:tasks.workunit.client.0.smithi087.stdout:0/597: chown d0/d2/d4/d19/f2f 9376197 1 2024-03-18T14:43:19.960 INFO:tasks.workunit.client.0.smithi087.stdout:8/594: write d1/d6/d9/f61 [1660211,56514] 0 2024-03-18T14:43:19.963 INFO:tasks.workunit.client.1.smithi129.stdout:7/455: dwrite d4/d2d/d2e/d45/f55 [0,4194304] 0 2024-03-18T14:43:19.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/391: fdatasync d0/d19/d46/d3e/d21/f5c 0 2024-03-18T14:43:19.965 INFO:tasks.workunit.client.0.smithi087.stdout:8/595: dwrite d1/d6/d2f/d44/d4b/f4c [0,4194304] 0 2024-03-18T14:43:19.965 INFO:tasks.workunit.client.0.smithi087.stdout:8/596: stat d1/d6/f7b 0 2024-03-18T14:43:19.966 INFO:tasks.workunit.client.0.smithi087.stdout:6/582: truncate d3/d7/d25/d62/f6a 950391 0 2024-03-18T14:43:19.968 INFO:tasks.workunit.client.1.smithi129.stdout:2/445: unlink d7/c7c 0 2024-03-18T14:43:19.970 INFO:tasks.workunit.client.0.smithi087.stdout:4/579: rename d2/fad to d2/db/d7a/fbf 0 2024-03-18T14:43:19.970 INFO:tasks.workunit.client.0.smithi087.stdout:8/597: dwrite d1/d6/d9/f61 [0,4194304] 0 2024-03-18T14:43:19.975 INFO:tasks.workunit.client.1.smithi129.stdout:8/459: truncate d9/d11/d1a/d32/d3a/f49 4892453 0 2024-03-18T14:43:19.979 INFO:tasks.workunit.client.0.smithi087.stdout:3/652: creat d0/de/d30/d46/da0/fb4 x:0 0 0 2024-03-18T14:43:19.980 INFO:tasks.workunit.client.0.smithi087.stdout:9/710: mkdir db/d18/d1e/d28/dc2/deb 0 2024-03-18T14:43:19.980 INFO:tasks.workunit.client.1.smithi129.stdout:1/429: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:19.981 INFO:tasks.workunit.client.1.smithi129.stdout:2/446: rename f0 to d7/d1f/d34/f82 0 2024-03-18T14:43:19.982 INFO:tasks.workunit.client.1.smithi129.stdout:6/459: mkdir d3/d6/d7f/d8f 0 2024-03-18T14:43:19.984 INFO:tasks.workunit.client.1.smithi129.stdout:8/460: mkdir d9/d11/d1a/d32/d41/d4d/d96 0 2024-03-18T14:43:19.985 INFO:tasks.workunit.client.1.smithi129.stdout:8/461: write d9/f4c [564526,124896] 0 2024-03-18T14:43:19.986 INFO:tasks.workunit.client.0.smithi087.stdout:6/583: creat d3/d7/d25/d62/d7c/d29/d22/d23/da9/fc1 x:0 0 0 2024-03-18T14:43:19.987 INFO:tasks.workunit.client.1.smithi129.stdout:0/458: creat d0/d14/f8a x:0 0 0 2024-03-18T14:43:19.987 INFO:tasks.workunit.client.0.smithi087.stdout:4/580: mknod d2/db/de/d8b/cc0 0 2024-03-18T14:43:19.987 INFO:tasks.workunit.client.1.smithi129.stdout:0/459: fdatasync d0/d14/f24 0 2024-03-18T14:43:19.988 INFO:tasks.workunit.client.1.smithi129.stdout:1/430: fdatasync d1/d2/d28/d65/f30 0 2024-03-18T14:43:19.988 INFO:tasks.workunit.client.1.smithi129.stdout:1/431: stat d1/d2/d70/d56 0 2024-03-18T14:43:19.991 INFO:tasks.workunit.client.0.smithi087.stdout:8/598: creat d1/d6/d2f/d44/d45/d72/fc3 x:0 0 0 2024-03-18T14:43:19.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/400: rename d4/d38/d55 to d4/d11/d34/d53/d87 0 2024-03-18T14:43:19.992 INFO:tasks.workunit.client.0.smithi087.stdout:9/711: mkdir db/d18/d1e/d28/dc2/dec 0 2024-03-18T14:43:19.992 INFO:tasks.workunit.client.1.smithi129.stdout:1/432: read d1/d2/f3d [7576,106792] 0 2024-03-18T14:43:19.993 INFO:tasks.workunit.client.0.smithi087.stdout:5/648: write d13/d1b/d27/d35/f39 [3003460,4185] 0 2024-03-18T14:43:19.993 INFO:tasks.workunit.client.0.smithi087.stdout:1/670: getdents d3/d1d/d1e/d43/da3 0 2024-03-18T14:43:19.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/725: truncate d1/d6/da/f9f 1814384 0 2024-03-18T14:43:19.996 INFO:tasks.workunit.client.0.smithi087.stdout:7/726: write d1/d8e/d95/dae/fc0 [255762,107621] 0 2024-03-18T14:43:19.997 INFO:tasks.workunit.client.1.smithi129.stdout:1/433: dwrite d1/d2/d28/f7f [0,4194304] 0 2024-03-18T14:43:19.998 INFO:tasks.workunit.client.1.smithi129.stdout:0/460: creat d0/d23/d6b/f8b x:0 0 0 2024-03-18T14:43:20.000 INFO:tasks.workunit.client.0.smithi087.stdout:7/727: dwrite d1/d6/d29/f92 [0,4194304] 0 2024-03-18T14:43:20.001 INFO:tasks.workunit.client.0.smithi087.stdout:7/728: readlink d1/d6/d29/d2f/d68/d65/lad 0 2024-03-18T14:43:20.001 INFO:tasks.workunit.client.0.smithi087.stdout:4/581: rename d2/db/d24/d30/d7b/d7f/faa to d2/db/d24/d30/d49/fc1 0 2024-03-18T14:43:20.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/460: fdatasync d3/d30/de/d6c/f60 0 2024-03-18T14:43:20.003 INFO:tasks.workunit.client.1.smithi129.stdout:3/401: dread d4/d11/d34/f76 [0,4194304] 0 2024-03-18T14:43:20.003 INFO:tasks.workunit.client.1.smithi129.stdout:4/392: getdents d0 0 2024-03-18T14:43:20.004 INFO:tasks.workunit.client.0.smithi087.stdout:0/598: creat d0/d2/d4/d27/fd3 x:0 0 0 2024-03-18T14:43:20.005 INFO:tasks.workunit.client.1.smithi129.stdout:8/462: truncate d9/d11/d1a/d32/d3a/f59 1012916 0 2024-03-18T14:43:20.007 INFO:tasks.workunit.client.0.smithi087.stdout:5/649: mkdir d13/dd8 0 2024-03-18T14:43:20.009 INFO:tasks.workunit.client.0.smithi087.stdout:9/712: dwrite db/d31/f42 [0,4194304] 0 2024-03-18T14:43:20.009 INFO:tasks.workunit.client.1.smithi129.stdout:8/463: dwrite d9/d11/d1a/d32/d3a/d70/f86 [0,4194304] 0 2024-03-18T14:43:20.010 INFO:tasks.workunit.client.0.smithi087.stdout:9/713: write db/d18/d1e/dde/dce/fa9 [359800,65207] 0 2024-03-18T14:43:20.011 INFO:tasks.workunit.client.1.smithi129.stdout:1/434: rename d1/d2/d28/d65/d19/f24 to d1/d2/d28/d65/d7c/d7d/d80/f83 0 2024-03-18T14:43:20.011 INFO:tasks.workunit.client.1.smithi129.stdout:6/461: readlink d3/d30/df/d28/d79/l84 0 2024-03-18T14:43:20.013 INFO:tasks.workunit.client.0.smithi087.stdout:8/599: rename d1/d6/d2f/d44/d45/d72/d7f/d83/lc0 to d1/d6/d2f/d44/d45/d71/daa/dad/lc4 0 2024-03-18T14:43:20.013 INFO:tasks.workunit.client.0.smithi087.stdout:2/640: getdents d2/d4/d22/d2c/d3a/d76/d9a/db5 0 2024-03-18T14:43:20.014 INFO:tasks.workunit.client.1.smithi129.stdout:2/447: truncate d7/d1f/d20/f55 755794 0 2024-03-18T14:43:20.014 INFO:tasks.workunit.client.0.smithi087.stdout:8/600: readlink d1/d6/d2f/d44/d45/l93 0 2024-03-18T14:43:20.014 INFO:tasks.workunit.client.0.smithi087.stdout:4/582: mkdir d2/dc2 0 2024-03-18T14:43:20.016 INFO:tasks.workunit.client.1.smithi129.stdout:0/461: truncate d0/d14/f49 911447 0 2024-03-18T14:43:20.019 INFO:tasks.workunit.client.0.smithi087.stdout:7/729: getdents d1/d6/da 0 2024-03-18T14:43:20.021 INFO:tasks.workunit.client.0.smithi087.stdout:0/599: rename d0/d2/f17 to d0/d7f/fd4 0 2024-03-18T14:43:20.021 INFO:tasks.workunit.client.1.smithi129.stdout:0/462: mknod d0/d6c/c8c 0 2024-03-18T14:43:20.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/730: rmdir d1/d6/d29/d2f/d68/d65/d60/d66/d8b 39 2024-03-18T14:43:20.025 INFO:tasks.workunit.client.1.smithi129.stdout:9/414: sync 2024-03-18T14:43:20.025 INFO:tasks.workunit.client.1.smithi129.stdout:4/393: dread d0/d19/f5e [0,4194304] 0 2024-03-18T14:43:20.025 INFO:tasks.workunit.client.1.smithi129.stdout:0/463: dread d0/d6c/f85 [0,4194304] 0 2024-03-18T14:43:20.025 INFO:tasks.workunit.client.1.smithi129.stdout:6/462: link d3/d30/de/d65/l6e d3/d30/l90 0 2024-03-18T14:43:20.025 INFO:tasks.workunit.client.1.smithi129.stdout:4/394: stat d0/d19/d46/c28 0 2024-03-18T14:43:20.026 INFO:tasks.workunit.client.0.smithi087.stdout:1/671: rename d3/d1d/d1e/d43/d50/d71/c61 to d3/d1d/d1e/d43/d50/d72/cd2 0 2024-03-18T14:43:20.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/653: sync 2024-03-18T14:43:20.029 INFO:tasks.workunit.client.1.smithi129.stdout:5/417: write d0/fb [2897188,91215] 0 2024-03-18T14:43:20.030 INFO:tasks.workunit.client.0.smithi087.stdout:9/714: rename db/d18/d1e/d28/d76/fd8 to db/d18/d1e/d28/fed 0 2024-03-18T14:43:20.031 INFO:tasks.workunit.client.0.smithi087.stdout:1/672: truncate d3/d1d/f33 318607 0 2024-03-18T14:43:20.033 INFO:tasks.workunit.client.1.smithi129.stdout:7/456: dwrite f3 [0,4194304] 0 2024-03-18T14:43:20.036 INFO:tasks.workunit.client.0.smithi087.stdout:6/584: rmdir d3/d7 39 2024-03-18T14:43:20.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/415: mkdir d0/db/d1f/d20/d4a/d3e/d7e 0 2024-03-18T14:43:20.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/416: dread - d0/db/d1f/f7b zero size 2024-03-18T14:43:20.038 INFO:tasks.workunit.client.1.smithi129.stdout:9/417: chown d0/db/d1f/d20/d4a/d70/l78 3997424 1 2024-03-18T14:43:20.038 INFO:tasks.workunit.client.1.smithi129.stdout:1/435: getdents d1/d2/d28/d65/d7c/d7d/d80 0 2024-03-18T14:43:20.041 INFO:tasks.workunit.client.1.smithi129.stdout:4/395: dread d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:20.043 INFO:tasks.workunit.client.1.smithi129.stdout:3/402: write d4/f9 [776872,28867] 0 2024-03-18T14:43:20.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/448: write d7/d1f/d20/d36/f38 [2028504,24124] 0 2024-03-18T14:43:20.043 INFO:tasks.workunit.client.1.smithi129.stdout:8/464: truncate d9/d11/d1a/d32/d3a/f20 409187 0 2024-03-18T14:43:20.044 INFO:tasks.workunit.client.1.smithi129.stdout:2/449: chown d7/d1f/d34/f82 36284 1 2024-03-18T14:43:20.044 INFO:tasks.workunit.client.0.smithi087.stdout:2/641: write d2/d4/d22/f62 [795139,126594] 0 2024-03-18T14:43:20.044 INFO:tasks.workunit.client.1.smithi129.stdout:8/465: chown d9/d11/d1a/d32/d41/d4d/f4f 7 1 2024-03-18T14:43:20.047 INFO:tasks.workunit.client.0.smithi087.stdout:4/583: rename d2/db/ca7 to d2/db/d24/d30/d49/cc3 0 2024-03-18T14:43:20.048 INFO:tasks.workunit.client.0.smithi087.stdout:8/601: dwrite d1/d6/d2f/d44/f5f [0,4194304] 0 2024-03-18T14:43:20.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/602: fsync d1/d6/f43 0 2024-03-18T14:43:20.049 INFO:tasks.workunit.client.0.smithi087.stdout:8/603: chown d1/d6/d2f/f41 4566 1 2024-03-18T14:43:20.049 INFO:tasks.workunit.client.0.smithi087.stdout:0/600: link d0/d1a/d7b/d26/d79/c57 d0/d2/d4/d19/d24/da3/cd5 0 2024-03-18T14:43:20.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/450: dwrite d7/d1f/d20/d2a/f54 [0,4194304] 0 2024-03-18T14:43:20.050 INFO:tasks.workunit.client.1.smithi129.stdout:8/466: dwrite d9/d11/d1a/d32/d41/f7a [0,4194304] 0 2024-03-18T14:43:20.052 INFO:tasks.workunit.client.0.smithi087.stdout:5/650: readlink d13/d1b/d27/d28/l50 0 2024-03-18T14:43:20.052 INFO:tasks.workunit.client.0.smithi087.stdout:7/731: dread d1/d6/da/ff [4194304,4194304] 0 2024-03-18T14:43:20.052 INFO:tasks.workunit.client.1.smithi129.stdout:4/396: mkdir d0/d19/d46/d3e/d21/d4d/d58/d61/d7e 0 2024-03-18T14:43:20.054 INFO:tasks.workunit.client.1.smithi129.stdout:6/463: creat d3/d6/d82/f91 x:0 0 0 2024-03-18T14:43:20.054 INFO:tasks.workunit.client.0.smithi087.stdout:9/715: symlink db/d18/d1e/d28/dc2/deb/lee 0 2024-03-18T14:43:20.055 INFO:tasks.workunit.client.1.smithi129.stdout:4/397: dread d0/d19/f5e [0,4194304] 0 2024-03-18T14:43:20.056 INFO:tasks.workunit.client.1.smithi129.stdout:2/451: dread d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:20.058 INFO:tasks.workunit.client.0.smithi087.stdout:4/584: mkdir d2/db/de/d8b/dc4 0 2024-03-18T14:43:20.059 INFO:tasks.workunit.client.0.smithi087.stdout:0/601: unlink d0/d1a/d34/f86 0 2024-03-18T14:43:20.060 INFO:tasks.workunit.client.1.smithi129.stdout:3/403: dwrite d4/d11/d1d/d27/f61 [0,4194304] 0 2024-03-18T14:43:20.060 INFO:tasks.workunit.client.1.smithi129.stdout:3/404: readlink d4/dd/l10 0 2024-03-18T14:43:20.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/467: symlink d9/d11/d1a/d14/d60/l97 0 2024-03-18T14:43:20.062 INFO:tasks.workunit.client.1.smithi129.stdout:4/398: dread d0/d19/d46/d3e/d21/d4d/d70/f25 [0,4194304] 0 2024-03-18T14:43:20.063 INFO:tasks.workunit.client.1.smithi129.stdout:2/452: mkdir d7/d1f/d20/d2b/d41/d65/d83 0 2024-03-18T14:43:20.066 INFO:tasks.workunit.client.1.smithi129.stdout:7/457: rename d4/d7/l52 to d4/d2d/d2e/d42/l8e 0 2024-03-18T14:43:20.069 INFO:tasks.workunit.client.1.smithi129.stdout:4/399: mkdir d0/d19/d46/d3e/d21/d7f 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.1.smithi129.stdout:0/464: truncate d0/d14/d28/f86 4857669 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.1.smithi129.stdout:5/418: write d0/f2 [806153,103431] 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.0.smithi087.stdout:9/716: mknod db/d18/d1e/dde/cef 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.0.smithi087.stdout:1/673: truncate d3/d1d/d1f/d34/d38/fb1 326681 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.0.smithi087.stdout:0/602: fdatasync d0/d1a/fd1 0 2024-03-18T14:43:20.072 INFO:tasks.workunit.client.0.smithi087.stdout:6/585: creat d3/d7/d25/d62/d7c/da0/dbe/fc2 x:0 0 0 2024-03-18T14:43:20.074 INFO:tasks.workunit.client.1.smithi129.stdout:9/418: getdents d0/db/d11 0 2024-03-18T14:43:20.074 INFO:tasks.workunit.client.0.smithi087.stdout:8/604: dread d1/f32 [0,4194304] 0 2024-03-18T14:43:20.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/654: rename d0/l57 to d0/d3/df/lb5 0 2024-03-18T14:43:20.076 INFO:tasks.workunit.client.1.smithi129.stdout:3/405: rename d4/dd/l10 to d4/dd/d1f/d5f/d31/d78/l88 0 2024-03-18T14:43:20.077 INFO:tasks.workunit.client.1.smithi129.stdout:8/468: truncate d9/d11/d1a/d32/d3a/f59 1886362 0 2024-03-18T14:43:20.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/674: mkdir d3/d1d/d1e/d43/da3/dd3 0 2024-03-18T14:43:20.079 INFO:tasks.workunit.client.0.smithi087.stdout:6/586: dwrite d3/d7/d25/d62/d7c/da0/d96/d97/fa8 [0,4194304] 0 2024-03-18T14:43:20.081 INFO:tasks.workunit.client.0.smithi087.stdout:5/651: getdents d13/d1b/d30/d6e/d88/db4 0 2024-03-18T14:43:20.081 INFO:tasks.workunit.client.0.smithi087.stdout:1/675: write d3/d1d/d1e/d20/f56 [1539243,94318] 0 2024-03-18T14:43:20.081 INFO:tasks.workunit.client.1.smithi129.stdout:8/469: dread d9/d11/d1a/d32/d3a/d70/f86 [0,4194304] 0 2024-03-18T14:43:20.082 INFO:tasks.workunit.client.1.smithi129.stdout:8/470: stat d9/d11/d18/c3c 0 2024-03-18T14:43:20.082 INFO:tasks.workunit.client.1.smithi129.stdout:9/419: rename d0/db/f5d to d0/db/d53/f7f 0 2024-03-18T14:43:20.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/605: creat d1/d6/d9/d5d/d87/d88/fc5 x:0 0 0 2024-03-18T14:43:20.083 INFO:tasks.workunit.client.1.smithi129.stdout:3/406: read d4/f54 [91286,89318] 0 2024-03-18T14:43:20.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/603: dwrite d0/d1a/d34/d3d/fb8 [0,4194304] 0 2024-03-18T14:43:20.086 INFO:tasks.workunit.client.0.smithi087.stdout:0/604: fdatasync d0/d2/d4/f65 0 2024-03-18T14:43:20.086 INFO:tasks.workunit.client.0.smithi087.stdout:6/587: read d3/d7/d25/d62/d7c/d29/d22/d23/f69 [3785986,11938] 0 2024-03-18T14:43:20.086 INFO:tasks.workunit.client.0.smithi087.stdout:6/588: chown d3 125960 1 2024-03-18T14:43:20.087 INFO:tasks.workunit.client.0.smithi087.stdout:2/642: rename d2/d4/d22/d2c/d3a/d49/lb3 to d2/d4/d22/d2c/d3a/d40/d4a/ld1 0 2024-03-18T14:43:20.088 INFO:tasks.workunit.client.0.smithi087.stdout:9/717: dread db/d12/fb2 [0,4194304] 0 2024-03-18T14:43:20.088 INFO:tasks.workunit.client.1.smithi129.stdout:3/407: dwrite d4/dd/d1f/f4b [4194304,4194304] 0 2024-03-18T14:43:20.089 INFO:tasks.workunit.client.0.smithi087.stdout:6/589: readlink d3/d7/d25/d62/d7c/d29/d22/la4 0 2024-03-18T14:43:20.093 INFO:tasks.workunit.client.0.smithi087.stdout:6/590: dwrite d3/d7/d25/d62/d7c/d29/d22/f80 [0,4194304] 0 2024-03-18T14:43:20.094 INFO:tasks.workunit.client.0.smithi087.stdout:7/732: dwrite d1/d6/da/d42/d67/f87 [0,4194304] 0 2024-03-18T14:43:20.097 INFO:tasks.workunit.client.0.smithi087.stdout:5/652: creat d13/d1b/d27/d98/fd9 x:0 0 0 2024-03-18T14:43:20.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/605: dread d0/d2/d4/d19/d5a/f5b [0,4194304] 0 2024-03-18T14:43:20.099 INFO:tasks.workunit.client.0.smithi087.stdout:0/606: readlink d0/d7f/l8e 0 2024-03-18T14:43:20.104 INFO:tasks.workunit.client.0.smithi087.stdout:3/655: creat d0/fb6 x:0 0 0 2024-03-18T14:43:20.104 INFO:tasks.workunit.client.1.smithi129.stdout:6/464: truncate d3/f1a 3306075 0 2024-03-18T14:43:20.105 INFO:tasks.workunit.client.0.smithi087.stdout:3/656: write d0/d3/df/d42/fa6 [649534,95901] 0 2024-03-18T14:43:20.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/465: truncate d0/d14/d3a/f4c 2580559 0 2024-03-18T14:43:20.106 INFO:tasks.workunit.client.1.smithi129.stdout:3/408: dread - d4/d11/d1d/d36/f7d zero size 2024-03-18T14:43:20.106 INFO:tasks.workunit.client.0.smithi087.stdout:4/585: rename d2/db/d24/d30/d49/fc1 to d2/db/d24/d30/fc5 0 2024-03-18T14:43:20.106 INFO:tasks.workunit.client.1.smithi129.stdout:7/458: getdents d4/d7/d38/d61/d68/d6b 0 2024-03-18T14:43:20.107 INFO:tasks.workunit.client.0.smithi087.stdout:4/586: fdatasync d2/db/de/f2c 0 2024-03-18T14:43:20.107 INFO:tasks.workunit.client.1.smithi129.stdout:5/419: dread d0/dc/d18/f1d [0,4194304] 0 2024-03-18T14:43:20.108 INFO:tasks.workunit.client.1.smithi129.stdout:0/466: chown d0/d23/c31 47 1 2024-03-18T14:43:20.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/453: dread d7/f1e [0,4194304] 0 2024-03-18T14:43:20.109 INFO:tasks.workunit.client.0.smithi087.stdout:9/718: symlink db/d18/d1e/d28/d7c/lf0 0 2024-03-18T14:43:20.110 INFO:tasks.workunit.client.1.smithi129.stdout:2/454: write d7/f1d [516783,72703] 0 2024-03-18T14:43:20.110 INFO:tasks.workunit.client.1.smithi129.stdout:0/467: write d0/d23/d35/d3b/f3c [1159721,26837] 0 2024-03-18T14:43:20.111 INFO:tasks.workunit.client.1.smithi129.stdout:5/420: read d0/dc/f4e [663521,130905] 0 2024-03-18T14:43:20.111 INFO:tasks.workunit.client.1.smithi129.stdout:2/455: fsync d7/f6e 0 2024-03-18T14:43:20.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/459: dread d4/d7/d8/d3b/f40 [0,4194304] 0 2024-03-18T14:43:20.113 INFO:tasks.workunit.client.1.smithi129.stdout:6/465: dwrite d3/d30/de/f58 [0,4194304] 0 2024-03-18T14:43:20.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/466: chown d3/d30/c47 25751356 1 2024-03-18T14:43:20.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/467: chown d3/d38/c39 7245840 1 2024-03-18T14:43:20.114 INFO:tasks.workunit.client.1.smithi129.stdout:0/468: mkdir d0/d14/d28/d63/d8d 0 2024-03-18T14:43:20.115 INFO:tasks.workunit.client.1.smithi129.stdout:6/468: chown d3/d5/l6b 1271 1 2024-03-18T14:43:20.117 INFO:tasks.workunit.client.0.smithi087.stdout:0/607: write d0/d2/d4/d19/f25 [2229225,85145] 0 2024-03-18T14:43:20.122 INFO:tasks.workunit.client.0.smithi087.stdout:1/676: rename d3/d1d/l96 to d3/d3c/db8/d8f/d99/ld4 0 2024-03-18T14:43:20.122 INFO:tasks.workunit.client.1.smithi129.stdout:4/400: dread d0/d19/d46/d3e/d21/d32/f57 [0,4194304] 0 2024-03-18T14:43:20.122 INFO:tasks.workunit.client.1.smithi129.stdout:5/421: creat d0/dc/f77 x:0 0 0 2024-03-18T14:43:20.123 INFO:tasks.workunit.client.1.smithi129.stdout:0/469: dwrite d0/d14/d3a/d4a/f70 [4194304,4194304] 0 2024-03-18T14:43:20.123 INFO:tasks.workunit.client.1.smithi129.stdout:6/469: dwrite d3/d30/df/f85 [0,4194304] 0 2024-03-18T14:43:20.124 INFO:tasks.workunit.client.1.smithi129.stdout:1/436: sync 2024-03-18T14:43:20.124 INFO:tasks.workunit.client.1.smithi129.stdout:5/422: stat d0/d32/d34/d6c/c6a 0 2024-03-18T14:43:20.126 INFO:tasks.workunit.client.1.smithi129.stdout:1/437: write d1/f40 [1247354,121937] 0 2024-03-18T14:43:20.126 INFO:tasks.workunit.client.1.smithi129.stdout:5/423: chown d0/c46 64535 1 2024-03-18T14:43:20.126 INFO:tasks.workunit.client.1.smithi129.stdout:5/424: chown d0/df 1062830696 1 2024-03-18T14:43:20.128 INFO:tasks.workunit.client.1.smithi129.stdout:1/438: dread - d1/d2/d28/d65/d19/f4a zero size 2024-03-18T14:43:20.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/425: readlink d0/dc/d18/l2a 0 2024-03-18T14:43:20.129 INFO:tasks.workunit.client.0.smithi087.stdout:4/587: dwrite d2/db/d67/f78 [0,4194304] 0 2024-03-18T14:43:20.131 INFO:tasks.workunit.client.0.smithi087.stdout:5/653: symlink d13/d1b/d27/d98/dc2/lda 0 2024-03-18T14:43:20.131 INFO:tasks.workunit.client.0.smithi087.stdout:7/733: dread d1/d6/d29/d2f/d68/d65/d60/d66/f90 [0,4194304] 0 2024-03-18T14:43:20.131 INFO:tasks.workunit.client.1.smithi129.stdout:6/470: dwrite d3/d30/f7d [0,4194304] 0 2024-03-18T14:43:20.131 INFO:tasks.workunit.client.1.smithi129.stdout:1/439: write d1/d2/d28/d65/f5a [973824,112318] 0 2024-03-18T14:43:20.134 INFO:tasks.workunit.client.1.smithi129.stdout:4/401: dwrite d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:20.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/606: truncate d1/d6/d9/d5d/f64 4828700 0 2024-03-18T14:43:20.134 INFO:tasks.workunit.client.1.smithi129.stdout:4/402: chown d0/d19/d46/c2f 12142 1 2024-03-18T14:43:20.136 INFO:tasks.workunit.client.1.smithi129.stdout:8/471: truncate d9/d11/d1a/f63 458597 0 2024-03-18T14:43:20.136 INFO:tasks.workunit.client.1.smithi129.stdout:2/456: write d7/d1f/d20/d2b/d41/f5d [950950,12061] 0 2024-03-18T14:43:20.137 INFO:tasks.workunit.client.1.smithi129.stdout:2/457: readlink d7/d1c/d32/l70 0 2024-03-18T14:43:20.138 INFO:tasks.workunit.client.0.smithi087.stdout:3/657: dread d0/d3/d10/d7f/f82 [0,4194304] 0 2024-03-18T14:43:20.140 INFO:tasks.workunit.client.1.smithi129.stdout:7/460: dwrite d4/d2d/d2e/d42/d58/f7f [0,4194304] 0 2024-03-18T14:43:20.141 INFO:tasks.workunit.client.1.smithi129.stdout:7/461: chown d4/d2d/d2e/d45/f55 6351876 1 2024-03-18T14:43:20.143 INFO:tasks.workunit.client.0.smithi087.stdout:0/608: rename d0/d49 to d0/d1a/d34/d3d/dd6 0 2024-03-18T14:43:20.144 INFO:tasks.workunit.client.1.smithi129.stdout:5/426: creat d0/d32/d34/d6c/f78 x:0 0 0 2024-03-18T14:43:20.146 INFO:tasks.workunit.client.0.smithi087.stdout:2/643: dwrite d2/d4/dbb/fbf [0,4194304] 0 2024-03-18T14:43:20.147 INFO:tasks.workunit.client.1.smithi129.stdout:0/470: dread d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:20.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/588: mkdir d2/db/d24/d30/d7b/dbe/dc6 0 2024-03-18T14:43:20.148 INFO:tasks.workunit.client.1.smithi129.stdout:1/440: mkdir d1/d2/d28/d65/d19/d84 0 2024-03-18T14:43:20.148 INFO:tasks.workunit.client.0.smithi087.stdout:4/589: stat d2/db/d24/f4c 0 2024-03-18T14:43:20.149 INFO:tasks.workunit.client.1.smithi129.stdout:8/472: dwrite d9/d11/d18/f35 [4194304,4194304] 0 2024-03-18T14:43:20.149 INFO:tasks.workunit.client.0.smithi087.stdout:7/734: fdatasync d1/d6/d29/d2f/d68/d65/d72/f80 0 2024-03-18T14:43:20.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/420: sync 2024-03-18T14:43:20.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/421: stat d0/d15/c64 0 2024-03-18T14:43:20.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/422: chown d0/f10 1 1 2024-03-18T14:43:20.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/427: creat d0/d32/f79 x:0 0 0 2024-03-18T14:43:20.154 INFO:tasks.workunit.client.1.smithi129.stdout:2/458: creat d7/d1c/f84 x:0 0 0 2024-03-18T14:43:20.155 INFO:tasks.workunit.client.1.smithi129.stdout:8/473: mknod d9/d11/d18/c98 0 2024-03-18T14:43:20.156 INFO:tasks.workunit.client.1.smithi129.stdout:5/428: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:20.156 INFO:tasks.workunit.client.1.smithi129.stdout:8/474: stat d9/d11/d55/c69 0 2024-03-18T14:43:20.158 INFO:tasks.workunit.client.1.smithi129.stdout:8/475: write d9/d11/d1a/f77 [2274138,110344] 0 2024-03-18T14:43:20.159 INFO:tasks.workunit.client.1.smithi129.stdout:9/423: creat d0/db/d1f/d20/d25/d59/f80 x:0 0 0 2024-03-18T14:43:20.159 INFO:tasks.workunit.client.1.smithi129.stdout:7/462: truncate d4/d7/f31 2043220 0 2024-03-18T14:43:20.160 INFO:tasks.workunit.client.0.smithi087.stdout:8/607: mkdir d1/d6/d2f/d44/d45/d71/dc6 0 2024-03-18T14:43:20.160 INFO:tasks.workunit.client.0.smithi087.stdout:3/658: mknod d0/d3/d10/cb7 0 2024-03-18T14:43:20.160 INFO:tasks.workunit.client.1.smithi129.stdout:6/471: getdents d3/d38 0 2024-03-18T14:43:20.160 INFO:tasks.workunit.client.1.smithi129.stdout:1/441: symlink d1/d35/d7a/l85 0 2024-03-18T14:43:20.161 INFO:tasks.workunit.client.0.smithi087.stdout:2/644: symlink d2/d4/d22/d2c/d3a/d68/ld2 0 2024-03-18T14:43:20.162 INFO:tasks.workunit.client.0.smithi087.stdout:1/677: write d3/d1d/d1e/d43/fa5 [742000,114141] 0 2024-03-18T14:43:20.162 INFO:tasks.workunit.client.1.smithi129.stdout:2/459: rename d7/d1f/d20/c56 to d7/d3f/c85 0 2024-03-18T14:43:20.163 INFO:tasks.workunit.client.0.smithi087.stdout:6/591: dread d3/f6 [0,4194304] 0 2024-03-18T14:43:20.163 INFO:tasks.workunit.client.1.smithi129.stdout:5/429: creat d0/dc/d1a/f7a x:0 0 0 2024-03-18T14:43:20.163 INFO:tasks.workunit.client.0.smithi087.stdout:1/678: fsync d3/d1d/d1e/d20/f80 0 2024-03-18T14:43:20.164 INFO:tasks.workunit.client.0.smithi087.stdout:4/590: creat d2/db/d82/fc7 x:0 0 0 2024-03-18T14:43:20.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/719: getdents db/d18/d51/d7b 0 2024-03-18T14:43:20.165 INFO:tasks.workunit.client.1.smithi129.stdout:1/442: dwrite d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:20.168 INFO:tasks.workunit.client.0.smithi087.stdout:7/735: truncate d1/d6/da/f37 2348093 0 2024-03-18T14:43:20.169 INFO:tasks.workunit.client.1.smithi129.stdout:1/443: dwrite d1/d35/f45 [0,4194304] 0 2024-03-18T14:43:20.170 INFO:tasks.workunit.client.1.smithi129.stdout:0/471: creat d0/f8e x:0 0 0 2024-03-18T14:43:20.171 INFO:tasks.workunit.client.1.smithi129.stdout:7/463: chown d4/d2d/d2e/d42/l8e 2400837 1 2024-03-18T14:43:20.172 INFO:tasks.workunit.client.1.smithi129.stdout:9/424: creat d0/db/d1f/d20/d4a/d3e/f81 x:0 0 0 2024-03-18T14:43:20.173 INFO:tasks.workunit.client.0.smithi087.stdout:3/659: symlink d0/d3/d10/d7f/lb8 0 2024-03-18T14:43:20.175 INFO:tasks.workunit.client.0.smithi087.stdout:8/608: symlink d1/d6/d2f/d44/d45/d72/d7f/lc7 0 2024-03-18T14:43:20.177 INFO:tasks.workunit.client.1.smithi129.stdout:4/403: truncate d0/d9/d40/d5f/f62 4755087 0 2024-03-18T14:43:20.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/679: stat d3/f19 0 2024-03-18T14:43:20.180 INFO:tasks.workunit.client.0.smithi087.stdout:6/592: creat d3/d7/d25/d62/d7c/d29/d22/d61/fc3 x:0 0 0 2024-03-18T14:43:20.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/609: fdatasync d1/f2 0 2024-03-18T14:43:20.182 INFO:tasks.workunit.client.0.smithi087.stdout:6/593: write d3/d7/d25/d62/d7c/d29/f16 [3381570,62211] 0 2024-03-18T14:43:20.184 INFO:tasks.workunit.client.0.smithi087.stdout:4/591: mknod d2/d13/d28/cc8 0 2024-03-18T14:43:20.184 INFO:tasks.workunit.client.0.smithi087.stdout:4/592: chown d2/db/de/d8b/cc0 3253427 1 2024-03-18T14:43:20.185 INFO:tasks.workunit.client.1.smithi129.stdout:2/460: mknod d7/d1f/d34/c86 0 2024-03-18T14:43:20.188 INFO:tasks.workunit.client.0.smithi087.stdout:2/645: truncate d2/d44/d72/d79/fb0 603744 0 2024-03-18T14:43:20.189 INFO:tasks.workunit.client.0.smithi087.stdout:8/610: creat d1/d6/d2f/d44/d45/d71/fc8 x:0 0 0 2024-03-18T14:43:20.190 INFO:tasks.workunit.client.1.smithi129.stdout:3/409: sync 2024-03-18T14:43:20.191 INFO:tasks.workunit.client.1.smithi129.stdout:9/425: rmdir d0/db/d1f 39 2024-03-18T14:43:20.192 INFO:tasks.workunit.client.1.smithi129.stdout:5/430: dread d0/dc/d22/f39 [0,4194304] 0 2024-03-18T14:43:20.194 INFO:tasks.workunit.client.1.smithi129.stdout:1/444: symlink d1/d2/d28/d65/d19/d84/l86 0 2024-03-18T14:43:20.195 INFO:tasks.workunit.client.0.smithi087.stdout:8/611: creat d1/d6/d2f/d44/d4b/fc9 x:0 0 0 2024-03-18T14:43:20.197 INFO:tasks.workunit.client.0.smithi087.stdout:1/680: creat d3/d1d/d1e/d20/fd5 x:0 0 0 2024-03-18T14:43:20.197 INFO:tasks.workunit.client.1.smithi129.stdout:0/472: dread d0/d23/f67 [0,4194304] 0 2024-03-18T14:43:20.198 INFO:tasks.workunit.client.1.smithi129.stdout:0/473: chown d0/d23/d35 275999 1 2024-03-18T14:43:20.201 INFO:tasks.workunit.client.0.smithi087.stdout:6/594: creat d3/d7/d25/d62/d7c/da0/fc4 x:0 0 0 2024-03-18T14:43:20.202 INFO:tasks.workunit.client.1.smithi129.stdout:7/464: creat d4/d2d/d2e/d42/f8f x:0 0 0 2024-03-18T14:43:20.203 INFO:tasks.workunit.client.1.smithi129.stdout:3/410: mknod d4/d11/d34/d3c/c89 0 2024-03-18T14:43:20.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/646: dread d2/d4/f34 [0,4194304] 0 2024-03-18T14:43:20.204 INFO:tasks.workunit.client.0.smithi087.stdout:5/654: truncate d13/f1e 310137 0 2024-03-18T14:43:20.205 INFO:tasks.workunit.client.0.smithi087.stdout:1/681: dread d3/f17 [0,4194304] 0 2024-03-18T14:43:20.206 INFO:tasks.workunit.client.0.smithi087.stdout:7/736: write d1/d8e/d95/dae/ff0 [845888,23682] 0 2024-03-18T14:43:20.208 INFO:tasks.workunit.client.0.smithi087.stdout:6/595: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f30 [0,4194304] 0 2024-03-18T14:43:20.208 INFO:tasks.workunit.client.1.smithi129.stdout:8/476: write d9/d11/d1a/d32/d3a/d70/f86 [145478,30036] 0 2024-03-18T14:43:20.209 INFO:tasks.workunit.client.1.smithi129.stdout:4/404: dread d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:20.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/477: fdatasync d9/d11/d1a/d14/f8b 0 2024-03-18T14:43:20.209 INFO:tasks.workunit.client.1.smithi129.stdout:4/405: chown d0/d19/d46/c28 12900419 1 2024-03-18T14:43:20.210 INFO:tasks.workunit.client.0.smithi087.stdout:9/720: dwrite db/d31/f74 [0,4194304] 0 2024-03-18T14:43:20.210 INFO:tasks.workunit.client.0.smithi087.stdout:9/721: stat db/d18/d3a/c49 0 2024-03-18T14:43:20.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/655: creat d13/d1b/d27/d35/dc6/fdb x:0 0 0 2024-03-18T14:43:20.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/682: symlink d3/d3c/db8/ld6 0 2024-03-18T14:43:20.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/656: write d13/d1b/d7e/f8e [101136,61099] 0 2024-03-18T14:43:20.213 INFO:tasks.workunit.client.1.smithi129.stdout:2/461: truncate d7/d1f/d20/d2d/f2e 479904 0 2024-03-18T14:43:20.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/406: dwrite d0/d19/d46/d3e/d21/d4d/d70/f23 [0,4194304] 0 2024-03-18T14:43:20.214 INFO:tasks.workunit.client.0.smithi087.stdout:6/596: dread d3/d7/d25/d62/d7c/d29/d7d/f8c [0,4194304] 0 2024-03-18T14:43:20.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/597: dwrite d3/f45 [0,4194304] 0 2024-03-18T14:43:20.219 INFO:tasks.workunit.client.0.smithi087.stdout:8/612: truncate d1/d6/f1e 152333 0 2024-03-18T14:43:20.219 INFO:tasks.workunit.client.1.smithi129.stdout:9/426: creat d0/db/d1f/d4c/d57/f82 x:0 0 0 2024-03-18T14:43:20.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/472: getdents d3/d30/de/d65/d80 0 2024-03-18T14:43:20.219 INFO:tasks.workunit.client.1.smithi129.stdout:0/474: rename d0/d23/d35/d3b/f3c to d0/d14/d3a/d4a/d7a/f8f 0 2024-03-18T14:43:20.220 INFO:tasks.workunit.client.0.smithi087.stdout:6/598: fdatasync d3/d7/d25/f7b 0 2024-03-18T14:43:20.225 INFO:tasks.workunit.client.1.smithi129.stdout:7/465: unlink d4/d8c/l71 0 2024-03-18T14:43:20.225 INFO:tasks.workunit.client.0.smithi087.stdout:9/722: read db/d18/d1e/d28/d76/da7/fb6 [1322762,76569] 0 2024-03-18T14:43:20.227 INFO:tasks.workunit.client.1.smithi129.stdout:0/475: dwrite d0/d23/d35/d3b/d42/f7b [0,4194304] 0 2024-03-18T14:43:20.231 INFO:tasks.workunit.client.1.smithi129.stdout:0/476: dwrite d0/f8e [0,4194304] 0 2024-03-18T14:43:20.232 INFO:tasks.workunit.client.0.smithi087.stdout:5/657: getdents d13 0 2024-03-18T14:43:20.234 INFO:tasks.workunit.client.0.smithi087.stdout:1/683: dread d3/d1d/d1f/f7d [0,4194304] 0 2024-03-18T14:43:20.235 INFO:tasks.workunit.client.0.smithi087.stdout:5/658: dread d13/d1b/d30/f52 [0,4194304] 0 2024-03-18T14:43:20.237 INFO:tasks.workunit.client.1.smithi129.stdout:0/477: write d0/d14/d3a/d4a/d7a/f8f [4263216,25971] 0 2024-03-18T14:43:20.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/466: link d4/d7/d54/f6e d4/d2d/d3a/f90 0 2024-03-18T14:43:20.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/467: readlink d4/d2d/d2e/d79/l8d 0 2024-03-18T14:43:20.240 INFO:tasks.workunit.client.0.smithi087.stdout:5/659: symlink d13/d1b/d27/d98/dc2/ldc 0 2024-03-18T14:43:20.241 INFO:tasks.workunit.client.0.smithi087.stdout:6/599: creat d3/d7/d25/d62/fc5 x:0 0 0 2024-03-18T14:43:20.241 INFO:tasks.workunit.client.0.smithi087.stdout:8/613: getdents d1/d6/d2f/d44/d4b/da5 0 2024-03-18T14:43:20.243 INFO:tasks.workunit.client.1.smithi129.stdout:5/431: truncate d0/dc/d18/d2b/f57 7262541 0 2024-03-18T14:43:20.243 INFO:tasks.workunit.client.0.smithi087.stdout:0/609: sync 2024-03-18T14:43:20.244 INFO:tasks.workunit.client.1.smithi129.stdout:3/411: write d4/f54 [621985,29655] 0 2024-03-18T14:43:20.246 INFO:tasks.workunit.client.1.smithi129.stdout:1/445: dwrite d1/d2/d70/f74 [0,4194304] 0 2024-03-18T14:43:20.251 INFO:tasks.workunit.client.0.smithi087.stdout:6/600: unlink d3/d7/d25/d62/d7c/da0/d96/d97/faa 0 2024-03-18T14:43:20.252 INFO:tasks.workunit.client.1.smithi129.stdout:0/478: rename d0/d14/c46 to d0/d23/d6b/c90 0 2024-03-18T14:43:20.252 INFO:tasks.workunit.client.1.smithi129.stdout:4/407: write d0/d19/d46/d3e/f47 [254600,37295] 0 2024-03-18T14:43:20.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/737: dwrite d1/d6/da/d42/d67/fe4 [0,4194304] 0 2024-03-18T14:43:20.252 INFO:tasks.workunit.client.0.smithi087.stdout:7/738: chown d1/la4 255537127 1 2024-03-18T14:43:20.253 INFO:tasks.workunit.client.1.smithi129.stdout:9/427: truncate d0/f1b 1006471 0 2024-03-18T14:43:20.256 INFO:tasks.workunit.client.1.smithi129.stdout:3/412: creat d4/d11/d1d/d36/f8a x:0 0 0 2024-03-18T14:43:20.257 INFO:tasks.workunit.client.0.smithi087.stdout:1/684: truncate d3/d1d/d1f/fd1 1015023 0 2024-03-18T14:43:20.258 INFO:tasks.workunit.client.1.smithi129.stdout:1/446: mkdir d1/d2/d70/d87 0 2024-03-18T14:43:20.259 INFO:tasks.workunit.client.1.smithi129.stdout:7/468: dwrite d4/fd [0,4194304] 0 2024-03-18T14:43:20.259 INFO:tasks.workunit.client.1.smithi129.stdout:8/478: link d9/d11/d1a/d32/l67 d9/d11/d55/d6a/d6f/l99 0 2024-03-18T14:43:20.259 INFO:tasks.workunit.client.1.smithi129.stdout:2/462: sync 2024-03-18T14:43:20.260 INFO:tasks.workunit.client.0.smithi087.stdout:5/660: symlink d13/d1b/d27/d35/dc6/dd6/ldd 0 2024-03-18T14:43:20.260 INFO:tasks.workunit.client.0.smithi087.stdout:5/661: write d13/d1b/d27/d28/f78 [3988613,80849] 0 2024-03-18T14:43:20.260 INFO:tasks.workunit.client.0.smithi087.stdout:9/723: dread db/d18/d1e/fd0 [0,4194304] 0 2024-03-18T14:43:20.262 INFO:tasks.workunit.client.1.smithi129.stdout:4/408: creat d0/f80 x:0 0 0 2024-03-18T14:43:20.262 INFO:tasks.workunit.client.0.smithi087.stdout:8/614: creat d1/d6/d2f/d44/d45/d72/db6/fca x:0 0 0 2024-03-18T14:43:20.263 INFO:tasks.workunit.client.0.smithi087.stdout:8/615: write d1/d6/d2f/d44/d4b/f4c [3239537,86925] 0 2024-03-18T14:43:20.263 INFO:tasks.workunit.client.1.smithi129.stdout:8/479: dread d9/d11/d1a/d32/d41/d4d/f5b [0,4194304] 0 2024-03-18T14:43:20.264 INFO:tasks.workunit.client.1.smithi129.stdout:8/480: chown d9/d11/d1a/d14/d60/d8a 1506 1 2024-03-18T14:43:20.266 INFO:tasks.workunit.client.1.smithi129.stdout:3/413: symlink d4/dd/d1f/d5f/d31/d78/l8b 0 2024-03-18T14:43:20.266 INFO:tasks.workunit.client.0.smithi087.stdout:0/610: write d0/d2/d4/d19/d24/f40 [349123,29161] 0 2024-03-18T14:43:20.267 INFO:tasks.workunit.client.1.smithi129.stdout:3/414: fdatasync d4/d11/d1d/d36/f8a 0 2024-03-18T14:43:20.267 INFO:tasks.workunit.client.1.smithi129.stdout:6/473: dread d3/d30/de/d6c/f53 [0,4194304] 0 2024-03-18T14:43:20.268 INFO:tasks.workunit.client.1.smithi129.stdout:0/479: mkdir d0/d14/d91 0 2024-03-18T14:43:20.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/611: fsync d0/d2/d4/d27/f9b 0 2024-03-18T14:43:20.269 INFO:tasks.workunit.client.0.smithi087.stdout:0/612: chown d0/d2/d4/d19/d5a/f5b 382486 1 2024-03-18T14:43:20.272 INFO:tasks.workunit.client.0.smithi087.stdout:1/685: creat d3/d1d/d79/fd7 x:0 0 0 2024-03-18T14:43:20.273 INFO:tasks.workunit.client.0.smithi087.stdout:5/662: symlink d13/d1b/d30/d6e/d88/lde 0 2024-03-18T14:43:20.273 INFO:tasks.workunit.client.1.smithi129.stdout:2/463: creat d7/d3f/f87 x:0 0 0 2024-03-18T14:43:20.274 INFO:tasks.workunit.client.1.smithi129.stdout:8/481: mkdir d9/d11/d1a/d32/d3a/d9a 0 2024-03-18T14:43:20.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/480: readlink d0/l2e 0 2024-03-18T14:43:20.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/481: fdatasync d0/d23/d35/d3b/f79 0 2024-03-18T14:43:20.276 INFO:tasks.workunit.client.1.smithi129.stdout:0/482: fsync d0/d23/d35/d3b/f79 0 2024-03-18T14:43:20.276 INFO:tasks.workunit.client.1.smithi129.stdout:9/428: link d0/db/d1f/d20/d6c/l75 d0/db/d1f/d20/d4a/l83 0 2024-03-18T14:43:20.277 INFO:tasks.workunit.client.1.smithi129.stdout:0/483: fsync d0/d14/d28/f30 0 2024-03-18T14:43:20.277 INFO:tasks.workunit.client.1.smithi129.stdout:9/429: readlink d0/db/d1f/d20/d4a/d70/l78 0 2024-03-18T14:43:20.279 INFO:tasks.workunit.client.1.smithi129.stdout:5/432: getdents d0 0 2024-03-18T14:43:20.279 INFO:tasks.workunit.client.0.smithi087.stdout:0/613: rename d0/f11 to d0/d1a/d7b/d26/d79/fd7 0 2024-03-18T14:43:20.280 INFO:tasks.workunit.client.1.smithi129.stdout:1/447: creat d1/f88 x:0 0 0 2024-03-18T14:43:20.280 INFO:tasks.workunit.client.0.smithi087.stdout:8/616: symlink d1/d6/lcb 0 2024-03-18T14:43:20.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/448: read d1/d2/f64 [527433,60137] 0 2024-03-18T14:43:20.281 INFO:tasks.workunit.client.1.smithi129.stdout:2/464: mkdir d7/d1f/d20/d2b/d41/d65/d88 0 2024-03-18T14:43:20.282 INFO:tasks.workunit.client.0.smithi087.stdout:8/617: read d1/d6/d9/f3a [2340699,123371] 0 2024-03-18T14:43:20.283 INFO:tasks.workunit.client.1.smithi129.stdout:7/469: truncate d4/f4f 62751 0 2024-03-18T14:43:20.284 INFO:tasks.workunit.client.0.smithi087.stdout:7/739: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:20.284 INFO:tasks.workunit.client.0.smithi087.stdout:5/663: rename d13/d1b/d27/d28/d9a/fc5 to d13/d1b/d70/fdf 0 2024-03-18T14:43:20.284 INFO:tasks.workunit.client.1.smithi129.stdout:0/484: fsync d0/f72 0 2024-03-18T14:43:20.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/686: truncate d3/f17 1225582 0 2024-03-18T14:43:20.288 INFO:tasks.workunit.client.0.smithi087.stdout:1/687: fsync d3/d1d/d1f/d34/f35 0 2024-03-18T14:43:20.289 INFO:tasks.workunit.client.1.smithi129.stdout:9/430: creat d0/db/d1f/d20/d26/d5f/f84 x:0 0 0 2024-03-18T14:43:20.289 INFO:tasks.workunit.client.1.smithi129.stdout:0/485: dwrite d0/d14/f4d [0,4194304] 0 2024-03-18T14:43:20.289 INFO:tasks.workunit.client.0.smithi087.stdout:9/724: getdents db/d18/d1e/d28/dc2/deb 0 2024-03-18T14:43:20.290 INFO:tasks.workunit.client.0.smithi087.stdout:8/618: truncate d1/d6/d2f/f30 919826 0 2024-03-18T14:43:20.291 INFO:tasks.workunit.client.0.smithi087.stdout:3/660: sync 2024-03-18T14:43:20.294 INFO:tasks.workunit.client.0.smithi087.stdout:0/614: rename d0/d1a/d80/d88/fcf to d0/dab/fd8 0 2024-03-18T14:43:20.297 INFO:tasks.workunit.client.0.smithi087.stdout:7/740: mknod d1/d6/d29/d2f/dac/cfc 0 2024-03-18T14:43:20.297 INFO:tasks.workunit.client.1.smithi129.stdout:2/465: dread d7/d1f/d34/f82 [0,4194304] 0 2024-03-18T14:43:20.299 INFO:tasks.workunit.client.1.smithi129.stdout:1/449: unlink d1/d2/c1c 0 2024-03-18T14:43:20.301 INFO:tasks.workunit.client.0.smithi087.stdout:8/619: creat d1/d6/d2f/d9b/fcc x:0 0 0 2024-03-18T14:43:20.303 INFO:tasks.workunit.client.1.smithi129.stdout:9/431: write d0/db/d53/f7f [1392206,72601] 0 2024-03-18T14:43:20.304 INFO:tasks.workunit.client.1.smithi129.stdout:9/432: dread - d0/db/d1f/d20/d26/d5f/f72 zero size 2024-03-18T14:43:20.305 INFO:tasks.workunit.client.0.smithi087.stdout:9/725: write db/d18/d3a/f6b [1545068,28563] 0 2024-03-18T14:43:20.305 INFO:tasks.workunit.client.0.smithi087.stdout:8/620: dwrite d1/d6/d2f/d44/d45/d71/daa/fb8 [0,4194304] 0 2024-03-18T14:43:20.306 INFO:tasks.workunit.client.1.smithi129.stdout:4/409: dread - d0/d9/f51 zero size 2024-03-18T14:43:20.307 INFO:tasks.workunit.client.0.smithi087.stdout:7/741: unlink d1/d6/d29/d2f/fcb 0 2024-03-18T14:43:20.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/415: getdents d4/d11/d1d/d27 0 2024-03-18T14:43:20.308 INFO:tasks.workunit.client.1.smithi129.stdout:9/433: dwrite d0/db/d1f/d20/d25/f61 [0,4194304] 0 2024-03-18T14:43:20.309 INFO:tasks.workunit.client.0.smithi087.stdout:9/726: dread db/d31/f74 [0,4194304] 0 2024-03-18T14:43:20.309 INFO:tasks.workunit.client.1.smithi129.stdout:5/433: truncate d0/d32/d34/f3b 1339730 0 2024-03-18T14:43:20.312 INFO:tasks.workunit.client.1.smithi129.stdout:1/450: read d1/d2/f64 [331479,80382] 0 2024-03-18T14:43:20.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/486: rename d0/c21 to d0/d23/d29/c92 0 2024-03-18T14:43:20.314 INFO:tasks.workunit.client.0.smithi087.stdout:8/621: mkdir d1/d6/d8d/dcd 0 2024-03-18T14:43:20.314 INFO:tasks.workunit.client.0.smithi087.stdout:3/661: creat d0/fb9 x:0 0 0 2024-03-18T14:43:20.315 INFO:tasks.workunit.client.1.smithi129.stdout:2/466: dwrite d7/d1f/d34/f82 [4194304,4194304] 0 2024-03-18T14:43:20.315 INFO:tasks.workunit.client.0.smithi087.stdout:3/662: chown d0/d3/d10/l3e 176538 1 2024-03-18T14:43:20.315 INFO:tasks.workunit.client.1.smithi129.stdout:3/416: dwrite d4/dd/d1f/f4b [0,4194304] 0 2024-03-18T14:43:20.315 INFO:tasks.workunit.client.1.smithi129.stdout:4/410: chown d0/d19/d46 61 1 2024-03-18T14:43:20.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/663: write d0/d3/fd [3413162,80528] 0 2024-03-18T14:43:20.316 INFO:tasks.workunit.client.0.smithi087.stdout:9/727: mkdir db/d18/df1 0 2024-03-18T14:43:20.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/664: write d0/f52 [6337955,37446] 0 2024-03-18T14:43:20.319 INFO:tasks.workunit.client.0.smithi087.stdout:1/688: truncate d3/d1d/d1e/d43/d50/d71/fc1 1854854 0 2024-03-18T14:43:20.320 INFO:tasks.workunit.client.1.smithi129.stdout:1/451: creat d1/d2/d28/d65/d19/d52/f89 x:0 0 0 2024-03-18T14:43:20.322 INFO:tasks.workunit.client.1.smithi129.stdout:4/411: rmdir d0/d19/d46/d3e/d21 39 2024-03-18T14:43:20.323 INFO:tasks.workunit.client.1.smithi129.stdout:3/417: mkdir d4/dd/d1f/d5f/d8c 0 2024-03-18T14:43:20.326 INFO:tasks.workunit.client.0.smithi087.stdout:6/601: sync 2024-03-18T14:43:20.326 INFO:tasks.workunit.client.0.smithi087.stdout:4/593: sync 2024-03-18T14:43:20.326 INFO:tasks.workunit.client.0.smithi087.stdout:2/647: sync 2024-03-18T14:43:20.327 INFO:tasks.workunit.client.1.smithi129.stdout:4/412: mknod d0/d9/d4c/c81 0 2024-03-18T14:43:20.327 INFO:tasks.workunit.client.1.smithi129.stdout:3/418: dwrite d4/fb [0,4194304] 0 2024-03-18T14:43:20.327 INFO:tasks.workunit.client.1.smithi129.stdout:6/474: sync 2024-03-18T14:43:20.328 INFO:tasks.workunit.client.0.smithi087.stdout:3/665: mkdir d0/d1c/d25/dba 0 2024-03-18T14:43:20.328 INFO:tasks.workunit.client.0.smithi087.stdout:7/742: creat d1/d6/d29/d2f/d68/d65/d60/d66/ffd x:0 0 0 2024-03-18T14:43:20.328 INFO:tasks.workunit.client.0.smithi087.stdout:4/594: write d2/db/d24/d30/f91 [340610,6842] 0 2024-03-18T14:43:20.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/743: fsync d1/d8e/d95/dae/fc0 0 2024-03-18T14:43:20.331 INFO:tasks.workunit.client.0.smithi087.stdout:8/622: mknod d1/d6/d8d/dc2/cce 0 2024-03-18T14:43:20.331 INFO:tasks.workunit.client.1.smithi129.stdout:5/434: creat d0/dc/f7b x:0 0 0 2024-03-18T14:43:20.331 INFO:tasks.workunit.client.1.smithi129.stdout:9/434: creat d0/db/d1f/d20/f85 x:0 0 0 2024-03-18T14:43:20.332 INFO:tasks.workunit.client.0.smithi087.stdout:1/689: mknod d3/d1d/d1e/d43/da3/dd3/cd8 0 2024-03-18T14:43:20.332 INFO:tasks.workunit.client.0.smithi087.stdout:7/744: dread - d1/d6/da/d42/d61/fd3 zero size 2024-03-18T14:43:20.332 INFO:tasks.workunit.client.1.smithi129.stdout:5/435: read - d0/dc/f73 zero size 2024-03-18T14:43:20.333 INFO:tasks.workunit.client.1.smithi129.stdout:6/475: dwrite d3/d38/d57/f64 [0,4194304] 0 2024-03-18T14:43:20.333 INFO:tasks.workunit.client.0.smithi087.stdout:6/602: dwrite d3/d7/d25/d62/d7c/da0/d96/d97/faf [0,4194304] 0 2024-03-18T14:43:20.334 INFO:tasks.workunit.client.1.smithi129.stdout:6/476: readlink d3/d30/l56 0 2024-03-18T14:43:20.336 INFO:tasks.workunit.client.1.smithi129.stdout:1/452: rename d1/d2/d28/d65/d19/d84/l86 to d1/l8a 0 2024-03-18T14:43:20.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/477: mknod d3/d30/de/c92 0 2024-03-18T14:43:20.339 INFO:tasks.workunit.client.0.smithi087.stdout:3/666: rename d0/d3/d10/l3e to d0/d3/df/d9a/lbb 0 2024-03-18T14:43:20.340 INFO:tasks.workunit.client.1.smithi129.stdout:4/413: chown d0/d19/d46/d3e/d21/d4d/d70/f24 1936988 1 2024-03-18T14:43:20.341 INFO:tasks.workunit.client.1.smithi129.stdout:9/435: dwrite d0/db/f43 [0,4194304] 0 2024-03-18T14:43:20.342 INFO:tasks.workunit.client.1.smithi129.stdout:7/470: sync 2024-03-18T14:43:20.342 INFO:tasks.workunit.client.1.smithi129.stdout:8/482: sync 2024-03-18T14:43:20.342 INFO:tasks.workunit.client.0.smithi087.stdout:0/615: sync 2024-03-18T14:43:20.342 INFO:tasks.workunit.client.0.smithi087.stdout:5/664: sync 2024-03-18T14:43:20.343 INFO:tasks.workunit.client.0.smithi087.stdout:3/667: dwrite d0/fb6 [0,4194304] 0 2024-03-18T14:43:20.343 INFO:tasks.workunit.client.0.smithi087.stdout:8/623: symlink d1/d6/d2f/d44/d45/d72/lcf 0 2024-03-18T14:43:20.343 INFO:tasks.workunit.client.1.smithi129.stdout:8/483: write d9/d11/d1a/f92 [1017981,34344] 0 2024-03-18T14:43:20.343 INFO:tasks.workunit.client.1.smithi129.stdout:7/471: write d4/d7/d54/f69 [1013423,34536] 0 2024-03-18T14:43:20.344 INFO:tasks.workunit.client.0.smithi087.stdout:3/668: stat d0/d3/df/f14 0 2024-03-18T14:43:20.345 INFO:tasks.workunit.client.0.smithi087.stdout:9/728: fdatasync db/d18/d1e/db4/fc4 0 2024-03-18T14:43:20.346 INFO:tasks.workunit.client.1.smithi129.stdout:9/436: dwrite d0/f10 [0,4194304] 0 2024-03-18T14:43:20.348 INFO:tasks.workunit.client.1.smithi129.stdout:6/478: mkdir d3/d30/de/d65/d93 0 2024-03-18T14:43:20.348 INFO:tasks.workunit.client.0.smithi087.stdout:9/729: dread db/d18/d1e/d28/d76/db7/fcd [0,4194304] 0 2024-03-18T14:43:20.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/730: write db/fb9 [912957,71552] 0 2024-03-18T14:43:20.349 INFO:tasks.workunit.client.0.smithi087.stdout:6/603: mkdir d3/d7/d25/d62/d7c/da0/d96/d97/dc6 0 2024-03-18T14:43:20.349 INFO:tasks.workunit.client.0.smithi087.stdout:2/648: getdents d2/d4/d22/d2c/d3a/d76/d9a/db5 0 2024-03-18T14:43:20.352 INFO:tasks.workunit.client.1.smithi129.stdout:3/419: dread d4/d38/f47 [0,4194304] 0 2024-03-18T14:43:20.354 INFO:tasks.workunit.client.0.smithi087.stdout:0/616: creat d0/d1a/d34/d3d/fd9 x:0 0 0 2024-03-18T14:43:20.355 INFO:tasks.workunit.client.0.smithi087.stdout:5/665: rmdir d13/d1b/d27/d35/dc6/dd6 39 2024-03-18T14:43:20.356 INFO:tasks.workunit.client.1.smithi129.stdout:8/484: write d9/d11/d1a/d32/d3a/d70/f81 [4401307,23690] 0 2024-03-18T14:43:20.356 INFO:tasks.workunit.client.1.smithi129.stdout:1/453: getdents d1/d2/d70/d87 0 2024-03-18T14:43:20.357 INFO:tasks.workunit.client.1.smithi129.stdout:1/454: chown d1/d2/l4 4880 1 2024-03-18T14:43:20.357 INFO:tasks.workunit.client.1.smithi129.stdout:1/455: write d1/f9 [665308,15865] 0 2024-03-18T14:43:20.358 INFO:tasks.workunit.client.0.smithi087.stdout:3/669: mkdir d0/d3/df/d42/dbc 0 2024-03-18T14:43:20.364 INFO:tasks.workunit.client.0.smithi087.stdout:6/604: symlink d3/d7/d25/d62/d7c/d29/d22/d61/lc7 0 2024-03-18T14:43:20.365 INFO:tasks.workunit.client.0.smithi087.stdout:6/605: chown d3/d7/d25/d62/d7c/d29/d22/d23/da9/c48 2109076 1 2024-03-18T14:43:20.365 INFO:tasks.workunit.client.0.smithi087.stdout:0/617: symlink d0/d1a/d7b/lda 0 2024-03-18T14:43:20.366 INFO:tasks.workunit.client.1.smithi129.stdout:8/485: read f6 [4161980,130498] 0 2024-03-18T14:43:20.366 INFO:tasks.workunit.client.0.smithi087.stdout:5/666: truncate d13/d1b/f47 1829652 0 2024-03-18T14:43:20.367 INFO:tasks.workunit.client.1.smithi129.stdout:2/467: truncate d7/d1f/d20/d2d/f3e 1729431 0 2024-03-18T14:43:20.368 INFO:tasks.workunit.client.1.smithi129.stdout:0/487: dwrite d0/d14/f20 [0,4194304] 0 2024-03-18T14:43:20.369 INFO:tasks.workunit.client.0.smithi087.stdout:2/649: unlink d2/d44/d72/ca5 0 2024-03-18T14:43:20.371 INFO:tasks.workunit.client.1.smithi129.stdout:3/420: rmdir d4/dd/d41 39 2024-03-18T14:43:20.373 INFO:tasks.workunit.client.1.smithi129.stdout:5/436: getdents d0/dc/d1a/d61 0 2024-03-18T14:43:20.374 INFO:tasks.workunit.client.0.smithi087.stdout:2/650: dwrite d2/d4/d22/d2c/f3d [0,4194304] 0 2024-03-18T14:43:20.375 INFO:tasks.workunit.client.0.smithi087.stdout:0/618: symlink d0/d1a/d7b/ldb 0 2024-03-18T14:43:20.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/595: dwrite d2/db/d24/d30/d7b/dbe/fa8 [0,4194304] 0 2024-03-18T14:43:20.377 INFO:tasks.workunit.client.1.smithi129.stdout:1/456: mknod d1/d2/d70/c8b 0 2024-03-18T14:43:20.377 INFO:tasks.workunit.client.1.smithi129.stdout:6/479: truncate d3/d5/f11 715778 0 2024-03-18T14:43:20.377 INFO:tasks.workunit.client.1.smithi129.stdout:8/486: creat d9/d11/d1a/d32/d41/d4d/f9b x:0 0 0 2024-03-18T14:43:20.378 INFO:tasks.workunit.client.0.smithi087.stdout:6/606: creat d3/d7/d25/d62/d7c/d29/d7d/fc8 x:0 0 0 2024-03-18T14:43:20.378 INFO:tasks.workunit.client.0.smithi087.stdout:3/670: symlink d0/d3/df/d42/dbc/lbd 0 2024-03-18T14:43:20.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/667: creat d13/d1b/d27/d8f/dab/fe0 x:0 0 0 2024-03-18T14:43:20.381 INFO:tasks.workunit.client.0.smithi087.stdout:6/607: fsync d3/d7/d25/d62/d7c/d29/d22/d61/fc3 0 2024-03-18T14:43:20.381 INFO:tasks.workunit.client.0.smithi087.stdout:5/668: chown d13/d1b/d27/d35/d3b/fc4 27946536 1 2024-03-18T14:43:20.382 INFO:tasks.workunit.client.0.smithi087.stdout:8/624: getdents d1/d6/d2f/d44/d45/d71/daa 0 2024-03-18T14:43:20.383 INFO:tasks.workunit.client.0.smithi087.stdout:0/619: readlink d0/d2/l9d 0 2024-03-18T14:43:20.384 INFO:tasks.workunit.client.1.smithi129.stdout:3/421: dread d4/d11/d1d/d27/f2b [0,4194304] 0 2024-03-18T14:43:20.384 INFO:tasks.workunit.client.1.smithi129.stdout:2/468: symlink d7/d1c/d79/l89 0 2024-03-18T14:43:20.386 INFO:tasks.workunit.client.1.smithi129.stdout:6/480: fsync d3/d30/f20 0 2024-03-18T14:43:20.387 INFO:tasks.workunit.client.1.smithi129.stdout:9/437: getdents d0/db/d1f/d4c 0 2024-03-18T14:43:20.388 INFO:tasks.workunit.client.1.smithi129.stdout:9/438: chown d0/db/d1f/d20/d26/d19/d29 0 1 2024-03-18T14:43:20.389 INFO:tasks.workunit.client.0.smithi087.stdout:4/596: unlink d2/db/d24/cb8 0 2024-03-18T14:43:20.390 INFO:tasks.workunit.client.0.smithi087.stdout:6/608: mkdir d3/d7/d25/d62/d7c/d46/dc9 0 2024-03-18T14:43:20.391 INFO:tasks.workunit.client.0.smithi087.stdout:5/669: creat d13/d1b/d27/d28/d9a/dae/fe1 x:0 0 0 2024-03-18T14:43:20.393 INFO:tasks.workunit.client.0.smithi087.stdout:0/620: read d0/d1a/d80/f95 [469625,128555] 0 2024-03-18T14:43:20.394 INFO:tasks.workunit.client.1.smithi129.stdout:1/457: mkdir d1/d2/d70/d87/d8c 0 2024-03-18T14:43:20.394 INFO:tasks.workunit.client.0.smithi087.stdout:8/625: mknod d1/d6/d2f/d9b/cd0 0 2024-03-18T14:43:20.394 INFO:tasks.workunit.client.0.smithi087.stdout:6/609: read d3/d7/d25/d62/d7c/d29/f1d [376670,39808] 0 2024-03-18T14:43:20.395 INFO:tasks.workunit.client.1.smithi129.stdout:6/481: symlink d3/d6/l94 0 2024-03-18T14:43:20.396 INFO:tasks.workunit.client.0.smithi087.stdout:0/621: dread - d0/d2/d3c/d73/fbf zero size 2024-03-18T14:43:20.396 INFO:tasks.workunit.client.0.smithi087.stdout:3/671: link d0/de/d30/d67/f79 d0/d3/d10/fbe 0 2024-03-18T14:43:20.396 INFO:tasks.workunit.client.0.smithi087.stdout:7/745: dwrite d1/d6/da/fcf [0,4194304] 0 2024-03-18T14:43:20.397 INFO:tasks.workunit.client.1.smithi129.stdout:9/439: mknod d0/db/d1f/d4c/c86 0 2024-03-18T14:43:20.398 INFO:tasks.workunit.client.0.smithi087.stdout:0/622: fdatasync d0/d2/d4/d19/d62/f70 0 2024-03-18T14:43:20.399 INFO:tasks.workunit.client.0.smithi087.stdout:2/651: rename d2/d4/d22/d24/lc5 to d2/d44/d72/ld3 0 2024-03-18T14:43:20.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/610: write d3/d7/d25/d62/d7c/da0/d96/d97/fa8 [621445,41059] 0 2024-03-18T14:43:20.399 INFO:tasks.workunit.client.1.smithi129.stdout:6/482: dread d3/d38/d57/f64 [0,4194304] 0 2024-03-18T14:43:20.401 INFO:tasks.workunit.client.1.smithi129.stdout:2/469: creat d7/d1f/d20/d2b/d41/d65/d88/f8a x:0 0 0 2024-03-18T14:43:20.401 INFO:tasks.workunit.client.1.smithi129.stdout:9/440: dwrite d0/db/f18 [0,4194304] 0 2024-03-18T14:43:20.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/623: chown d0/d2/d3c/d73/cae 484 1 2024-03-18T14:43:20.403 INFO:tasks.workunit.client.0.smithi087.stdout:9/731: dread db/d18/d1e/f46 [0,4194304] 0 2024-03-18T14:43:20.403 INFO:tasks.workunit.client.1.smithi129.stdout:4/414: truncate d0/d19/f38 1581459 0 2024-03-18T14:43:20.404 INFO:tasks.workunit.client.0.smithi087.stdout:6/611: write d3/d7/d25/d62/d7c/d29/d22/fc0 [429415,56454] 0 2024-03-18T14:43:20.404 INFO:tasks.workunit.client.0.smithi087.stdout:1/690: dwrite d3/d1d/d1f/fd1 [0,4194304] 0 2024-03-18T14:43:20.405 INFO:tasks.workunit.client.1.smithi129.stdout:4/415: write d0/d19/d46/d3e/d21/f72 [341602,42845] 0 2024-03-18T14:43:20.407 INFO:tasks.workunit.client.1.smithi129.stdout:8/487: rmdir d9/d11/d55/d6a/d95 0 2024-03-18T14:43:20.407 INFO:tasks.workunit.client.1.smithi129.stdout:7/472: dwrite d4/d7/f31 [0,4194304] 0 2024-03-18T14:43:20.407 INFO:tasks.workunit.client.0.smithi087.stdout:5/670: unlink d13/d1b/d27/d28/c38 0 2024-03-18T14:43:20.408 INFO:tasks.workunit.client.1.smithi129.stdout:8/488: write d9/d11/d55/d68/f76 [1030231,126452] 0 2024-03-18T14:43:20.408 INFO:tasks.workunit.client.0.smithi087.stdout:5/671: write d13/d1b/d70/fbe [169787,43225] 0 2024-03-18T14:43:20.409 INFO:tasks.workunit.client.1.smithi129.stdout:8/489: fsync d9/d11/d1a/d32/d3a/d70/f88 0 2024-03-18T14:43:20.414 INFO:tasks.workunit.client.1.smithi129.stdout:3/422: truncate d4/dd/d1f/d5f/f5b 5217575 0 2024-03-18T14:43:20.415 INFO:tasks.workunit.client.0.smithi087.stdout:2/652: symlink d2/d4/d22/d2c/d3a/d40/d52/ld4 0 2024-03-18T14:43:20.415 INFO:tasks.workunit.client.1.smithi129.stdout:0/488: dwrite d0/f55 [0,4194304] 0 2024-03-18T14:43:20.416 INFO:tasks.workunit.client.1.smithi129.stdout:0/489: fsync d0/d23/d35/d50/f77 0 2024-03-18T14:43:20.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/624: dread d0/d1a/d7b/f22 [0,4194304] 0 2024-03-18T14:43:20.417 INFO:tasks.workunit.client.1.smithi129.stdout:6/483: rename d3/f8d to d3/d30/f95 0 2024-03-18T14:43:20.420 INFO:tasks.workunit.client.0.smithi087.stdout:0/625: dwrite d0/d1a/d7b/d26/f2c [0,4194304] 0 2024-03-18T14:43:20.421 INFO:tasks.workunit.client.0.smithi087.stdout:0/626: fdatasync d0/d2/d4/d19/f25 0 2024-03-18T14:43:20.425 INFO:tasks.workunit.client.1.smithi129.stdout:2/470: symlink d7/d1c/d62/l8b 0 2024-03-18T14:43:20.426 INFO:tasks.workunit.client.1.smithi129.stdout:9/441: chown d0/c3 8 1 2024-03-18T14:43:20.426 INFO:tasks.workunit.client.1.smithi129.stdout:2/471: dread - d7/d3f/f87 zero size 2024-03-18T14:43:20.427 INFO:tasks.workunit.client.1.smithi129.stdout:9/442: chown d0/db/d1f/d20/d4a/d3e 0 1 2024-03-18T14:43:20.427 INFO:tasks.workunit.client.1.smithi129.stdout:9/443: dread - d0/db/d1f/f7b zero size 2024-03-18T14:43:20.428 INFO:tasks.workunit.client.0.smithi087.stdout:3/672: mknod d0/de/cbf 0 2024-03-18T14:43:20.431 INFO:tasks.workunit.client.0.smithi087.stdout:8/626: write d1/d6/d9/f51 [58632,98440] 0 2024-03-18T14:43:20.431 INFO:tasks.workunit.client.1.smithi129.stdout:1/458: symlink d1/d2/d70/d87/d8c/l8d 0 2024-03-18T14:43:20.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/627: write d1/d6/d9/f6c [988041,87120] 0 2024-03-18T14:43:20.433 INFO:tasks.workunit.client.0.smithi087.stdout:0/627: symlink d0/d2/d6b/d7c/ldc 0 2024-03-18T14:43:20.434 INFO:tasks.workunit.client.1.smithi129.stdout:5/437: getdents d0/d32/d3a/d52 0 2024-03-18T14:43:20.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/612: creat d3/d7/dbd/fca x:0 0 0 2024-03-18T14:43:20.436 INFO:tasks.workunit.client.1.smithi129.stdout:7/473: mknod d4/d7/d54/c91 0 2024-03-18T14:43:20.437 INFO:tasks.workunit.client.0.smithi087.stdout:1/691: creat d3/d1d/d1e/d43/d50/d72/dc8/fd9 x:0 0 0 2024-03-18T14:43:20.437 INFO:tasks.workunit.client.0.smithi087.stdout:4/597: truncate d2/db/de/f2c 1206624 0 2024-03-18T14:43:20.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/672: symlink d13/d1b/d27/d35/da7/le2 0 2024-03-18T14:43:20.439 INFO:tasks.workunit.client.0.smithi087.stdout:5/673: dread - d13/d1b/d27/d28/d9a/fcb zero size 2024-03-18T14:43:20.442 INFO:tasks.workunit.client.1.smithi129.stdout:0/490: creat d0/d23/f93 x:0 0 0 2024-03-18T14:43:20.444 INFO:tasks.workunit.client.0.smithi087.stdout:8/628: mkdir d1/d6/d9/d5d/d87/dd1 0 2024-03-18T14:43:20.444 INFO:tasks.workunit.client.0.smithi087.stdout:8/629: stat d1/d6/d2f/d44/d45/fa4 0 2024-03-18T14:43:20.445 INFO:tasks.workunit.client.0.smithi087.stdout:8/630: chown d1/d6/d9/f77 7431878 1 2024-03-18T14:43:20.445 INFO:tasks.workunit.client.1.smithi129.stdout:2/472: dread d7/d1f/f52 [0,4194304] 0 2024-03-18T14:43:20.445 INFO:tasks.workunit.client.0.smithi087.stdout:0/628: mknod d0/d2/d4/d19/cdd 0 2024-03-18T14:43:20.446 INFO:tasks.workunit.client.1.smithi129.stdout:2/473: chown d7/f1e 29023 1 2024-03-18T14:43:20.446 INFO:tasks.workunit.client.0.smithi087.stdout:7/746: truncate d1/d6/d29/d2f/d68/d65/d60/d66/f6e 3459519 0 2024-03-18T14:43:20.447 INFO:tasks.workunit.client.0.smithi087.stdout:7/747: stat d1/d6/da/d42/f7b 0 2024-03-18T14:43:20.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/484: dread d3/d5/d46/f89 [0,4194304] 0 2024-03-18T14:43:20.447 INFO:tasks.workunit.client.1.smithi129.stdout:8/490: creat d9/d11/d1a/d14/d60/d8a/f9c x:0 0 0 2024-03-18T14:43:20.449 INFO:tasks.workunit.client.1.smithi129.stdout:8/491: fsync d9/d11/d1a/d32/d41/d4d/f5b 0 2024-03-18T14:43:20.449 INFO:tasks.workunit.client.0.smithi087.stdout:5/674: rename d13/d1b/d27/d35/d3b/cb6 to d13/d1b/d70/dce/ce3 0 2024-03-18T14:43:20.449 INFO:tasks.workunit.client.1.smithi129.stdout:3/423: creat d4/dd/d1f/d5f/d8c/f8d x:0 0 0 2024-03-18T14:43:20.450 INFO:tasks.workunit.client.1.smithi129.stdout:3/424: read - d4/dd/d1f/d5f/d31/f77 zero size 2024-03-18T14:43:20.451 INFO:tasks.workunit.client.1.smithi129.stdout:2/474: chown d7/d3f/c85 32763 1 2024-03-18T14:43:20.452 INFO:tasks.workunit.client.0.smithi087.stdout:8/631: creat d1/d6/d2f/d44/d45/d50/fd2 x:0 0 0 2024-03-18T14:43:20.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/475: dread d7/f1e [0,4194304] 0 2024-03-18T14:43:20.455 INFO:tasks.workunit.client.1.smithi129.stdout:2/476: write d7/d1c/f84 [694018,21710] 0 2024-03-18T14:43:20.457 INFO:tasks.workunit.client.0.smithi087.stdout:7/748: mkdir d1/d6/da/d59/dfe 0 2024-03-18T14:43:20.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/629: creat d0/d2/d4/d19/d5a/fde x:0 0 0 2024-03-18T14:43:20.458 INFO:tasks.workunit.client.0.smithi087.stdout:9/732: link db/d18/d1c/d69/f8c db/ff2 0 2024-03-18T14:43:20.460 INFO:tasks.workunit.client.0.smithi087.stdout:2/653: dread d2/d4/d22/d2c/d3a/d49/fa3 [0,4194304] 0 2024-03-18T14:43:20.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/654: read - d2/d4/d22/d2c/d3a/d40/d52/fc9 zero size 2024-03-18T14:43:20.462 INFO:tasks.workunit.client.1.smithi129.stdout:8/492: rename d9/d11/d55/d68/f6b to d9/d11/d1a/d32/d3a/f9d 0 2024-03-18T14:43:20.464 INFO:tasks.workunit.client.1.smithi129.stdout:9/444: truncate d0/db/f6b 648440 0 2024-03-18T14:43:20.464 INFO:tasks.workunit.client.0.smithi087.stdout:1/692: dread d3/d1d/d1e/d43/d50/d72/f86 [0,4194304] 0 2024-03-18T14:43:20.465 INFO:tasks.workunit.client.1.smithi129.stdout:9/445: rename d0 to d0/db/d1f/d20/d4a/d87 22 2024-03-18T14:43:20.465 INFO:tasks.workunit.client.1.smithi129.stdout:3/425: readlink d4/d11/d34/d4c/l68 0 2024-03-18T14:43:20.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/749: write d1/d6/da/d42/f7b [4680820,82118] 0 2024-03-18T14:43:20.467 INFO:tasks.workunit.client.1.smithi129.stdout:1/459: creat d1/d2/d28/d65/f8e x:0 0 0 2024-03-18T14:43:20.467 INFO:tasks.workunit.client.1.smithi129.stdout:5/438: truncate d0/dc/f73 86968 0 2024-03-18T14:43:20.468 INFO:tasks.workunit.client.1.smithi129.stdout:1/460: write d1/d2/d28/d65/f8e [283265,100038] 0 2024-03-18T14:43:20.470 INFO:tasks.workunit.client.1.smithi129.stdout:7/474: truncate d4/d7/d38/d61/d68/f75 675096 0 2024-03-18T14:43:20.470 INFO:tasks.workunit.client.1.smithi129.stdout:4/416: dread d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:20.470 INFO:tasks.workunit.client.1.smithi129.stdout:7/475: chown d4/c28 2165 1 2024-03-18T14:43:20.471 INFO:tasks.workunit.client.0.smithi087.stdout:3/673: write d0/d3/f7 [3293231,69263] 0 2024-03-18T14:43:20.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/675: dread d13/d1b/d27/fa0 [0,4194304] 0 2024-03-18T14:43:20.472 INFO:tasks.workunit.client.0.smithi087.stdout:5/676: chown d13/d1b/c1d 12630472 1 2024-03-18T14:43:20.473 INFO:tasks.workunit.client.1.smithi129.stdout:7/476: write d4/d2d/d2e/f30 [3907845,32891] 0 2024-03-18T14:43:20.473 INFO:tasks.workunit.client.1.smithi129.stdout:4/417: write d0/d19/d46/d3e/d21/d4d/d70/f4a [605007,48224] 0 2024-03-18T14:43:20.473 INFO:tasks.workunit.client.0.smithi087.stdout:3/674: read d0/d3/df/f16 [8370009,22416] 0 2024-03-18T14:43:20.473 INFO:tasks.workunit.client.0.smithi087.stdout:5/677: dread - d13/d1b/d27/d35/d3b/fc4 zero size 2024-03-18T14:43:20.474 INFO:tasks.workunit.client.1.smithi129.stdout:8/493: creat d9/d11/d1a/d32/d3a/d5d/f9e x:0 0 0 2024-03-18T14:43:20.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/675: write d0/de/f81 [1136895,49270] 0 2024-03-18T14:43:20.474 INFO:tasks.workunit.client.1.smithi129.stdout:1/461: dwrite d1/f9 [0,4194304] 0 2024-03-18T14:43:20.474 INFO:tasks.workunit.client.1.smithi129.stdout:4/418: stat d0/d19/d46/d3e/d21/d32/l6b 0 2024-03-18T14:43:20.475 INFO:tasks.workunit.client.1.smithi129.stdout:9/446: symlink d0/d15/l88 0 2024-03-18T14:43:20.476 INFO:tasks.workunit.client.1.smithi129.stdout:2/477: symlink d7/d1c/l8c 0 2024-03-18T14:43:20.476 INFO:tasks.workunit.client.1.smithi129.stdout:8/494: write d9/d11/d1a/d32/d3a/d5d/f9e [327697,121202] 0 2024-03-18T14:43:20.477 INFO:tasks.workunit.client.1.smithi129.stdout:2/478: dread - d7/d1c/f5b zero size 2024-03-18T14:43:20.477 INFO:tasks.workunit.client.1.smithi129.stdout:1/462: read d1/d35/f3f [3376701,64304] 0 2024-03-18T14:43:20.485 INFO:tasks.workunit.client.1.smithi129.stdout:5/439: symlink d0/d32/d34/d6c/l7c 0 2024-03-18T14:43:20.486 INFO:tasks.workunit.client.1.smithi129.stdout:6/485: link d3/d30/df/d28/l2c d3/d30/df/d28/l96 0 2024-03-18T14:43:20.488 INFO:tasks.workunit.client.1.smithi129.stdout:0/491: mknod d0/d23/d35/d3b/d42/c94 0 2024-03-18T14:43:20.489 INFO:tasks.workunit.client.1.smithi129.stdout:0/492: write d0/d23/d35/d50/f7d [897258,12769] 0 2024-03-18T14:43:20.490 INFO:tasks.workunit.client.1.smithi129.stdout:4/419: write d0/d19/d46/d3e/f29 [1568897,9745] 0 2024-03-18T14:43:20.495 INFO:tasks.workunit.client.1.smithi129.stdout:5/440: mknod d0/dc/d1a/d61/c7d 0 2024-03-18T14:43:20.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/447: mknod d0/db/d1f/d20/d26/c89 0 2024-03-18T14:43:20.498 INFO:tasks.workunit.client.1.smithi129.stdout:8/495: mknod d9/d11/d1a/d32/c9f 0 2024-03-18T14:43:20.501 INFO:tasks.workunit.client.1.smithi129.stdout:2/479: truncate d7/d1f/d20/d2b/d41/f6f 1006423 0 2024-03-18T14:43:20.501 INFO:tasks.workunit.client.1.smithi129.stdout:3/426: link d4/fa d4/d11/d34/d53/f8e 0 2024-03-18T14:43:20.502 INFO:tasks.workunit.client.1.smithi129.stdout:2/480: write d7/d1f/d20/d36/f38 [2700303,88823] 0 2024-03-18T14:43:20.502 INFO:tasks.workunit.client.1.smithi129.stdout:3/427: chown d4/d11/d34/f76 1 1 2024-03-18T14:43:20.503 INFO:tasks.workunit.client.1.smithi129.stdout:1/463: truncate d1/d2/d28/f63 4434625 0 2024-03-18T14:43:20.504 INFO:tasks.workunit.client.1.smithi129.stdout:6/486: creat d3/d30/de/d65/d93/f97 x:0 0 0 2024-03-18T14:43:20.504 INFO:tasks.workunit.client.1.smithi129.stdout:5/441: mknod d0/d32/d3a/d52/d69/c7e 0 2024-03-18T14:43:20.505 INFO:tasks.workunit.client.0.smithi087.stdout:9/733: symlink db/d18/d1e/dde/lf3 0 2024-03-18T14:43:20.505 INFO:tasks.workunit.client.0.smithi087.stdout:2/655: mknod d2/d4/d22/d2c/d3a/d40/d4a/cd5 0 2024-03-18T14:43:20.506 INFO:tasks.workunit.client.0.smithi087.stdout:7/750: symlink d1/d97/lff 0 2024-03-18T14:43:20.506 INFO:tasks.workunit.client.1.smithi129.stdout:8/496: chown d9/d11/d1a/d32/f38 2 1 2024-03-18T14:43:20.507 INFO:tasks.workunit.client.0.smithi087.stdout:0/630: creat d0/d1a/fdf x:0 0 0 2024-03-18T14:43:20.507 INFO:tasks.workunit.client.1.smithi129.stdout:2/481: dwrite d7/fa [4194304,4194304] 0 2024-03-18T14:43:20.511 INFO:tasks.workunit.client.0.smithi087.stdout:8/632: link d1/d6/d14/f79 d1/d6/d9/d5d/d87/da2/fd3 0 2024-03-18T14:43:20.511 INFO:tasks.workunit.client.1.smithi129.stdout:8/497: dwrite d9/d11/d1a/d32/d3a/d5d/f62 [0,4194304] 0 2024-03-18T14:43:20.513 INFO:tasks.workunit.client.0.smithi087.stdout:3/676: dwrite d0/d3/d40/f78 [0,4194304] 0 2024-03-18T14:43:20.514 INFO:tasks.workunit.client.0.smithi087.stdout:9/734: dwrite db/d31/fe2 [0,4194304] 0 2024-03-18T14:43:20.515 INFO:tasks.workunit.client.1.smithi129.stdout:4/420: truncate d0/d19/d46/d3e/d21/d4d/d70/f24 3325229 0 2024-03-18T14:43:20.515 INFO:tasks.workunit.client.0.smithi087.stdout:7/751: dwrite d1/d6/d16/fa3 [0,4194304] 0 2024-03-18T14:43:20.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/493: rename d0/d23/d35/d3b/f57 to d0/f95 0 2024-03-18T14:43:20.517 INFO:tasks.workunit.client.0.smithi087.stdout:2/656: symlink d2/d4/d22/d24/d91/ld6 0 2024-03-18T14:43:20.518 INFO:tasks.workunit.client.0.smithi087.stdout:2/657: write d2/f85 [2070951,48341] 0 2024-03-18T14:43:20.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/678: link d13/d1b/d27/d8f/lcf d13/d1b/d70/da8/le4 0 2024-03-18T14:43:20.519 INFO:tasks.workunit.client.0.smithi087.stdout:2/658: chown d2/d4/d22/d2c/f74 1300221 1 2024-03-18T14:43:20.519 INFO:tasks.workunit.client.1.smithi129.stdout:5/442: rmdir d0/dc/d18 39 2024-03-18T14:43:20.520 INFO:tasks.workunit.client.0.smithi087.stdout:8/633: unlink d1/d6/d2f/d44/f5f 0 2024-03-18T14:43:20.521 INFO:tasks.workunit.client.1.smithi129.stdout:6/487: creat d3/d30/de/d65/d80/f98 x:0 0 0 2024-03-18T14:43:20.522 INFO:tasks.workunit.client.1.smithi129.stdout:6/488: read - d3/d30/de/f83 zero size 2024-03-18T14:43:20.522 INFO:tasks.workunit.client.0.smithi087.stdout:3/677: truncate d0/d3/d10/f5e 146831 0 2024-03-18T14:43:20.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/613: sync 2024-03-18T14:43:20.524 INFO:tasks.workunit.client.0.smithi087.stdout:2/659: dwrite d2/f99 [0,4194304] 0 2024-03-18T14:43:20.526 INFO:tasks.workunit.client.1.smithi129.stdout:7/477: sync 2024-03-18T14:43:20.526 INFO:tasks.workunit.client.0.smithi087.stdout:7/752: dread d1/d6/f2a [0,4194304] 0 2024-03-18T14:43:20.527 INFO:tasks.workunit.client.0.smithi087.stdout:8/634: mknod d1/d6/d2f/d44/d45/d72/d7f/cd4 0 2024-03-18T14:43:20.527 INFO:tasks.workunit.client.0.smithi087.stdout:7/753: write d1/d6/da/ff [5772505,118440] 0 2024-03-18T14:43:20.528 INFO:tasks.workunit.client.1.smithi129.stdout:9/448: link d0/db/d1f/d20/d25/d59/l62 d0/db/d6f/l8a 0 2024-03-18T14:43:20.530 INFO:tasks.workunit.client.1.smithi129.stdout:3/428: creat d4/dd/f8f x:0 0 0 2024-03-18T14:43:20.530 INFO:tasks.workunit.client.0.smithi087.stdout:3/678: unlink d0/d3/l1b 0 2024-03-18T14:43:20.534 INFO:tasks.workunit.client.1.smithi129.stdout:6/489: rename d3/d30/c62 to d3/d5/d46/c99 0 2024-03-18T14:43:20.535 INFO:tasks.workunit.client.1.smithi129.stdout:8/498: creat d9/d11/d1a/d32/d41/d4d/d96/fa0 x:0 0 0 2024-03-18T14:43:20.535 INFO:tasks.workunit.client.1.smithi129.stdout:0/494: creat d0/d23/d71/f96 x:0 0 0 2024-03-18T14:43:20.536 INFO:tasks.workunit.client.0.smithi087.stdout:5/679: mknod d13/d1b/d27/ce5 0 2024-03-18T14:43:20.539 INFO:tasks.workunit.client.1.smithi129.stdout:0/495: dwrite d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:20.540 INFO:tasks.workunit.client.1.smithi129.stdout:1/464: getdents d1/d2/d70/d87 0 2024-03-18T14:43:20.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/490: mkdir d3/d6/d82/d9a 0 2024-03-18T14:43:20.541 INFO:tasks.workunit.client.1.smithi129.stdout:6/491: chown d3/d30/de/c3b 53 1 2024-03-18T14:43:20.542 INFO:tasks.workunit.client.1.smithi129.stdout:8/499: creat d9/d11/d53/fa1 x:0 0 0 2024-03-18T14:43:20.543 INFO:tasks.workunit.client.0.smithi087.stdout:0/631: getdents d0/d2/d6b 0 2024-03-18T14:43:20.543 INFO:tasks.workunit.client.0.smithi087.stdout:9/735: creat db/d18/d1e/ff4 x:0 0 0 2024-03-18T14:43:20.544 INFO:tasks.workunit.client.1.smithi129.stdout:7/478: link d4/d2d/d2e/d42/f7b d4/d7/d38/d61/d6a/f92 0 2024-03-18T14:43:20.545 INFO:tasks.workunit.client.0.smithi087.stdout:3/679: symlink d0/d3/d4f/lc0 0 2024-03-18T14:43:20.546 INFO:tasks.workunit.client.0.smithi087.stdout:3/680: chown d0/d3/df/d42/l96 4 1 2024-03-18T14:43:20.547 INFO:tasks.workunit.client.1.smithi129.stdout:2/482: link d7/d1c/l8c d7/d1f/l8d 0 2024-03-18T14:43:20.548 INFO:tasks.workunit.client.0.smithi087.stdout:6/614: rename d3/d7/le to d3/d7/dbd/lcb 0 2024-03-18T14:43:20.548 INFO:tasks.workunit.client.0.smithi087.stdout:5/680: symlink d13/d1b/d30/d6e/d88/db4/le6 0 2024-03-18T14:43:20.549 INFO:tasks.workunit.client.1.smithi129.stdout:0/496: readlink d0/d14/d53/l56 0 2024-03-18T14:43:20.549 INFO:tasks.workunit.client.1.smithi129.stdout:0/497: fdatasync d0/d14/d3a/d4a/f70 0 2024-03-18T14:43:20.550 INFO:tasks.workunit.client.1.smithi129.stdout:6/492: fsync d3/d30/df/f5f 0 2024-03-18T14:43:20.551 INFO:tasks.workunit.client.1.smithi129.stdout:6/493: chown d3/d30/de/f83 144380693 1 2024-03-18T14:43:20.551 INFO:tasks.workunit.client.0.smithi087.stdout:4/598: sync 2024-03-18T14:43:20.552 INFO:tasks.workunit.client.1.smithi129.stdout:5/443: getdents d0/df 0 2024-03-18T14:43:20.552 INFO:tasks.workunit.client.1.smithi129.stdout:7/479: mknod d4/d7/d38/d61/d68/d6b/c93 0 2024-03-18T14:43:20.556 INFO:tasks.workunit.client.0.smithi087.stdout:2/660: write d2/d44/d72/d79/f9c [2858594,8224] 0 2024-03-18T14:43:20.558 INFO:tasks.workunit.client.1.smithi129.stdout:6/494: rename d3/d30/de/f1f to d3/d6/f9b 0 2024-03-18T14:43:20.558 INFO:tasks.workunit.client.1.smithi129.stdout:7/480: rmdir d4/d2d/d2e/d42/d58 39 2024-03-18T14:43:20.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/635: rmdir d1/d6/d2f/d44/d45/d71/dc6 0 2024-03-18T14:43:20.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/481: write d4/d7/d38/d49/f7a [1219343,87446] 0 2024-03-18T14:43:20.560 INFO:tasks.workunit.client.1.smithi129.stdout:7/482: fsync d4/d7/d38/f77 0 2024-03-18T14:43:20.562 INFO:tasks.workunit.client.0.smithi087.stdout:6/615: rename d3/d7/d25/d62/d7c/d29/d22/d61/c67 to d3/d7/d25/d62/d7c/da0/d96/d97/dc6/ccc 0 2024-03-18T14:43:20.563 INFO:tasks.workunit.client.0.smithi087.stdout:7/754: creat d1/d6/d16/f100 x:0 0 0 2024-03-18T14:43:20.564 INFO:tasks.workunit.client.1.smithi129.stdout:4/421: write d0/d9/d4c/f6d [1181180,55487] 0 2024-03-18T14:43:20.565 INFO:tasks.workunit.client.0.smithi087.stdout:9/736: mkdir db/d18/d1e/df5 0 2024-03-18T14:43:20.567 INFO:tasks.workunit.client.1.smithi129.stdout:0/498: creat d0/d14/d28/d63/d8d/f97 x:0 0 0 2024-03-18T14:43:20.568 INFO:tasks.workunit.client.0.smithi087.stdout:9/737: read db/d18/d1e/dde/fa8 [64313,104970] 0 2024-03-18T14:43:20.568 INFO:tasks.workunit.client.1.smithi129.stdout:0/499: write d0/d23/d35/d50/f77 [929919,92232] 0 2024-03-18T14:43:20.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/681: mknod d13/d1b/d27/ce7 0 2024-03-18T14:43:20.569 INFO:tasks.workunit.client.0.smithi087.stdout:9/738: dread - db/d18/d1e/f98 zero size 2024-03-18T14:43:20.570 INFO:tasks.workunit.client.1.smithi129.stdout:9/449: truncate d0/db/d1f/d20/d26/d19/d29/f2d 7174692 0 2024-03-18T14:43:20.570 INFO:tasks.workunit.client.0.smithi087.stdout:2/661: dwrite d2/f2f [0,4194304] 0 2024-03-18T14:43:20.570 INFO:tasks.workunit.client.1.smithi129.stdout:3/429: truncate d4/d11/d1d/f46 2874004 0 2024-03-18T14:43:20.571 INFO:tasks.workunit.client.0.smithi087.stdout:9/739: dread - db/d18/d1e/d28/d76/d80/fa5 zero size 2024-03-18T14:43:20.571 INFO:tasks.workunit.client.1.smithi129.stdout:7/483: dread d4/d7/d8/f20 [4194304,4194304] 0 2024-03-18T14:43:20.572 INFO:tasks.workunit.client.0.smithi087.stdout:8/636: rmdir d1/d6/d9/d5d/d87/da2 39 2024-03-18T14:43:20.573 INFO:tasks.workunit.client.0.smithi087.stdout:0/632: truncate d0/d2/d4/d19/d24/f63 893933 0 2024-03-18T14:43:20.574 INFO:tasks.workunit.client.1.smithi129.stdout:6/495: creat d3/d38/f9c x:0 0 0 2024-03-18T14:43:20.574 INFO:tasks.workunit.client.1.smithi129.stdout:1/465: write d1/d2/d28/f51 [1495987,84908] 0 2024-03-18T14:43:20.576 INFO:tasks.workunit.client.1.smithi129.stdout:2/483: dwrite d7/d1c/d32/f77 [0,4194304] 0 2024-03-18T14:43:20.581 INFO:tasks.workunit.client.1.smithi129.stdout:5/444: dwrite d0/d32/d34/f3b [0,4194304] 0 2024-03-18T14:43:20.581 INFO:tasks.workunit.client.0.smithi087.stdout:4/599: write d2/d13/f3f [1745825,65000] 0 2024-03-18T14:43:20.582 INFO:tasks.workunit.client.1.smithi129.stdout:8/500: getdents d9/d11/d55 0 2024-03-18T14:43:20.582 INFO:tasks.workunit.client.1.smithi129.stdout:8/501: fdatasync d9/d11/d1a/d32/d3a/d70/f88 0 2024-03-18T14:43:20.584 INFO:tasks.workunit.client.1.smithi129.stdout:4/422: write d0/d9/f15 [1893328,124940] 0 2024-03-18T14:43:20.584 INFO:tasks.workunit.client.1.smithi129.stdout:4/423: chown d0/d19/d5d/l78 700751 1 2024-03-18T14:43:20.586 INFO:tasks.workunit.client.0.smithi087.stdout:2/662: mkdir d2/d4/d22/d24/d91/dd7 0 2024-03-18T14:43:20.586 INFO:tasks.workunit.client.1.smithi129.stdout:0/500: readlink d0/d23/d6b/l82 0 2024-03-18T14:43:20.586 INFO:tasks.workunit.client.1.smithi129.stdout:3/430: mkdir d4/d11/d1d/d50/d90 0 2024-03-18T14:43:20.588 INFO:tasks.workunit.client.0.smithi087.stdout:8/637: rename d1/d6/d2f/d44/f6f to d1/d6/d2f/d44/d45/d50/fd5 0 2024-03-18T14:43:20.589 INFO:tasks.workunit.client.0.smithi087.stdout:0/633: symlink d0/d1a/d7b/le0 0 2024-03-18T14:43:20.589 INFO:tasks.workunit.client.1.smithi129.stdout:1/466: creat d1/d2/d70/d87/f8f x:0 0 0 2024-03-18T14:43:20.589 INFO:tasks.workunit.client.0.smithi087.stdout:0/634: chown d0/d1a/d7b/d26 4 1 2024-03-18T14:43:20.590 INFO:tasks.workunit.client.1.smithi129.stdout:6/496: mknod d3/d30/de/d65/d93/c9d 0 2024-03-18T14:43:20.590 INFO:tasks.workunit.client.0.smithi087.stdout:3/681: getdents d0/de/d30/d46 0 2024-03-18T14:43:20.592 INFO:tasks.workunit.client.1.smithi129.stdout:2/484: creat d7/d3f/d5f/f8e x:0 0 0 2024-03-18T14:43:20.595 INFO:tasks.workunit.client.0.smithi087.stdout:4/600: dread d2/db/d7a/fbf [0,4194304] 0 2024-03-18T14:43:20.595 INFO:tasks.workunit.client.0.smithi087.stdout:2/663: mkdir d2/d4/d22/d2c/d3a/d40/d98/dd8 0 2024-03-18T14:43:20.596 INFO:tasks.workunit.client.1.smithi129.stdout:8/502: creat d9/d11/d18/fa2 x:0 0 0 2024-03-18T14:43:20.596 INFO:tasks.workunit.client.0.smithi087.stdout:8/638: truncate d1/d6/d9/d5d/d87/f8a 99866 0 2024-03-18T14:43:20.597 INFO:tasks.workunit.client.1.smithi129.stdout:1/467: dwrite d1/d2/d28/d65/d19/f4a [0,4194304] 0 2024-03-18T14:43:20.597 INFO:tasks.workunit.client.0.smithi087.stdout:2/664: chown d2/d4/d22/d2c/d3a/d68/f93 1 1 2024-03-18T14:43:20.598 INFO:tasks.workunit.client.1.smithi129.stdout:6/497: dwrite d3/f6a [0,4194304] 0 2024-03-18T14:43:20.600 INFO:tasks.workunit.client.1.smithi129.stdout:8/503: stat d9/d11/d1a/d32/d3a/d70 0 2024-03-18T14:43:20.601 INFO:tasks.workunit.client.0.smithi087.stdout:3/682: fdatasync d0/d1c/f39 0 2024-03-18T14:43:20.602 INFO:tasks.workunit.client.1.smithi129.stdout:2/485: dwrite d7/d1f/d20/d2a/f48 [0,4194304] 0 2024-03-18T14:43:20.602 INFO:tasks.workunit.client.1.smithi129.stdout:0/501: mknod d0/d14/d3a/c98 0 2024-03-18T14:43:20.602 INFO:tasks.workunit.client.1.smithi129.stdout:8/504: dread - d9/d11/d1a/d32/d3a/f8f zero size 2024-03-18T14:43:20.602 INFO:tasks.workunit.client.1.smithi129.stdout:3/431: fdatasync d4/d38/f1b 0 2024-03-18T14:43:20.604 INFO:tasks.workunit.client.0.smithi087.stdout:5/682: creat d13/d1b/d27/d35/dc6/fe8 x:0 0 0 2024-03-18T14:43:20.604 INFO:tasks.workunit.client.1.smithi129.stdout:3/432: dread - d4/d11/d1d/f7f zero size 2024-03-18T14:43:20.605 INFO:tasks.workunit.client.0.smithi087.stdout:9/740: creat db/d18/ff6 x:0 0 0 2024-03-18T14:43:20.606 INFO:tasks.workunit.client.0.smithi087.stdout:6/616: getdents d3/d7/d25/d62/d7c/da0/d96/d97 0 2024-03-18T14:43:20.607 INFO:tasks.workunit.client.0.smithi087.stdout:4/601: symlink d2/db/d24/d30/lc9 0 2024-03-18T14:43:20.608 INFO:tasks.workunit.client.1.smithi129.stdout:5/445: truncate d0/f67 1232385 0 2024-03-18T14:43:20.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/502: dwrite d0/d23/d35/d50/f52 [0,4194304] 0 2024-03-18T14:43:20.608 INFO:tasks.workunit.client.1.smithi129.stdout:9/450: truncate d0/db/d1f/d20/d4a/d3e/f66 779637 0 2024-03-18T14:43:20.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/693: sync 2024-03-18T14:43:20.609 INFO:tasks.workunit.client.0.smithi087.stdout:8/639: creat d1/d6/d2f/fd6 x:0 0 0 2024-03-18T14:43:20.609 INFO:tasks.workunit.client.1.smithi129.stdout:1/468: fdatasync d1/f5f 0 2024-03-18T14:43:20.610 INFO:tasks.workunit.client.0.smithi087.stdout:2/665: mkdir d2/d4/d22/d24/d65/d7f/dd9 0 2024-03-18T14:43:20.611 INFO:tasks.workunit.client.0.smithi087.stdout:0/635: fdatasync d0/d2/d4/d27/f55 0 2024-03-18T14:43:20.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/683: dread - d0/d1c/f84 zero size 2024-03-18T14:43:20.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/684: chown d0/l8 964452728 1 2024-03-18T14:43:20.613 INFO:tasks.workunit.client.0.smithi087.stdout:3/685: write d0/d3/df/f50 [852391,81096] 0 2024-03-18T14:43:20.614 INFO:tasks.workunit.client.0.smithi087.stdout:3/686: dread - d0/d3/d4f/d6e/fb0 zero size 2024-03-18T14:43:20.614 INFO:tasks.workunit.client.1.smithi129.stdout:3/433: mkdir d4/d11/d1d/d50/d91 0 2024-03-18T14:43:20.615 INFO:tasks.workunit.client.1.smithi129.stdout:3/434: write d4/d11/d1d/d27/f61 [8832645,124963] 0 2024-03-18T14:43:20.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/503: mknod d0/d23/d35/d3b/c99 0 2024-03-18T14:43:20.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/504: fdatasync d0/d14/d3a/f62 0 2024-03-18T14:43:20.618 INFO:tasks.workunit.client.1.smithi129.stdout:0/505: chown d0/f55 39931536 1 2024-03-18T14:43:20.620 INFO:tasks.workunit.client.1.smithi129.stdout:9/451: mknod d0/db/d1f/d20/d4a/d70/c8b 0 2024-03-18T14:43:20.620 INFO:tasks.workunit.client.1.smithi129.stdout:7/484: truncate d4/d7/d38/d49/f7a 4761861 0 2024-03-18T14:43:20.624 INFO:tasks.workunit.client.1.smithi129.stdout:2/486: link d7/d1f/d20/d2a/f5a d7/d1f/d81/f8f 0 2024-03-18T14:43:20.626 INFO:tasks.workunit.client.1.smithi129.stdout:0/506: dread d0/d23/d35/d50/f52 [0,4194304] 0 2024-03-18T14:43:20.626 INFO:tasks.workunit.client.0.smithi087.stdout:4/602: fdatasync d2/db/d3c/fa0 0 2024-03-18T14:43:20.627 INFO:tasks.workunit.client.0.smithi087.stdout:8/640: rename d1/d6/d2f/d44/d45/d72/lcf to d1/d6/d2f/d44/d45/d71/ld7 0 2024-03-18T14:43:20.627 INFO:tasks.workunit.client.0.smithi087.stdout:7/755: sync 2024-03-18T14:43:20.627 INFO:tasks.workunit.client.0.smithi087.stdout:1/694: write d3/f7c [676742,8441] 0 2024-03-18T14:43:20.628 INFO:tasks.workunit.client.0.smithi087.stdout:3/687: fsync d0/d1c/f59 0 2024-03-18T14:43:20.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/603: dread - d2/db/d82/f89 zero size 2024-03-18T14:43:20.629 INFO:tasks.workunit.client.0.smithi087.stdout:9/741: symlink db/d18/d1e/d28/d76/d80/lf7 0 2024-03-18T14:43:20.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/424: dread d0/d19/d46/d3e/d21/d4d/d70/f2c [0,4194304] 0 2024-03-18T14:43:20.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/505: creat d9/d11/d1a/d32/d41/fa3 x:0 0 0 2024-03-18T14:43:20.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/435: creat d4/dd/d41/f92 x:0 0 0 2024-03-18T14:43:20.632 INFO:tasks.workunit.client.1.smithi129.stdout:9/452: chown d0/db/d1f/d20/d4a/l83 15 1 2024-03-18T14:43:20.633 INFO:tasks.workunit.client.1.smithi129.stdout:0/507: creat d0/d23/d6b/f9a x:0 0 0 2024-03-18T14:43:20.633 INFO:tasks.workunit.client.1.smithi129.stdout:3/436: read - d4/dd/f45 zero size 2024-03-18T14:43:20.634 INFO:tasks.workunit.client.0.smithi087.stdout:6/617: write d3/d7/d25/d62/d7c/d29/d7d/f8c [2630834,91397] 0 2024-03-18T14:43:20.635 INFO:tasks.workunit.client.1.smithi129.stdout:9/453: fsync d0/db/d1f/d20/d26/d5f/f84 0 2024-03-18T14:43:20.637 INFO:tasks.workunit.client.1.smithi129.stdout:4/425: read d0/d9/d40/f71 [2313983,87927] 0 2024-03-18T14:43:20.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/618: dread d3/f45 [0,4194304] 0 2024-03-18T14:43:20.638 INFO:tasks.workunit.client.1.smithi129.stdout:5/446: rename d0/dc/l3f to d0/dc/d18/d2b/d71/l7f 0 2024-03-18T14:43:20.641 INFO:tasks.workunit.client.1.smithi129.stdout:0/508: mknod d0/d6c/c9b 0 2024-03-18T14:43:20.643 INFO:tasks.workunit.client.1.smithi129.stdout:6/498: dwrite d3/d5/f11 [0,4194304] 0 2024-03-18T14:43:20.643 INFO:tasks.workunit.client.1.smithi129.stdout:2/487: rename d7/d1c/d62/l7f to d7/d1f/d20/d2d/l90 0 2024-03-18T14:43:20.647 INFO:tasks.workunit.client.0.smithi087.stdout:2/666: creat d2/d4/d22/d24/db2/fda x:0 0 0 2024-03-18T14:43:20.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/447: truncate d0/dc/f4e 861566 0 2024-03-18T14:43:20.649 INFO:tasks.workunit.client.1.smithi129.stdout:5/448: stat d0/d32/d34/f70 0 2024-03-18T14:43:20.655 INFO:tasks.workunit.client.0.smithi087.stdout:0/636: truncate d0/d1a/d34/f5f 3052956 0 2024-03-18T14:43:20.656 INFO:tasks.workunit.client.0.smithi087.stdout:3/688: creat d0/d3/d10/fc1 x:0 0 0 2024-03-18T14:43:20.656 INFO:tasks.workunit.client.1.smithi129.stdout:0/509: unlink d0/d6c/c8c 0 2024-03-18T14:43:20.657 INFO:tasks.workunit.client.0.smithi087.stdout:4/604: creat d2/db/d84/fca x:0 0 0 2024-03-18T14:43:20.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/756: symlink d1/d6/d29/d2f/d68/d65/d60/l101 0 2024-03-18T14:43:20.660 INFO:tasks.workunit.client.0.smithi087.stdout:7/757: write d1/d6/d29/fe1 [415490,59732] 0 2024-03-18T14:43:20.661 INFO:tasks.workunit.client.0.smithi087.stdout:3/689: dwrite d0/d3/d10/f2c [0,4194304] 0 2024-03-18T14:43:20.662 INFO:tasks.workunit.client.0.smithi087.stdout:3/690: fsync d0/f1 0 2024-03-18T14:43:20.662 INFO:tasks.workunit.client.1.smithi129.stdout:8/506: rename d9/d11/d1a/d14/d60/d8a to d9/d11/d18/da4 0 2024-03-18T14:43:20.662 INFO:tasks.workunit.client.1.smithi129.stdout:2/488: mknod d7/d1c/d79/c91 0 2024-03-18T14:43:20.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/499: mkdir d3/d30/de/d6c/d9e 0 2024-03-18T14:43:20.663 INFO:tasks.workunit.client.0.smithi087.stdout:7/758: write d1/d6/da/d42/d67/fd6 [1964883,117944] 0 2024-03-18T14:43:20.663 INFO:tasks.workunit.client.0.smithi087.stdout:3/691: chown d0/de/d30/f7c 15144 1 2024-03-18T14:43:20.663 INFO:tasks.workunit.client.0.smithi087.stdout:3/692: chown d0/d1c/fb1 537 1 2024-03-18T14:43:20.671 INFO:tasks.workunit.client.1.smithi129.stdout:3/437: rename d4/d11/d1d/d27 to d4/d11/d1d/d50/d91/d93 0 2024-03-18T14:43:20.672 INFO:tasks.workunit.client.1.smithi129.stdout:8/507: creat d9/d11/d1a/d32/d3a/d5d/fa5 x:0 0 0 2024-03-18T14:43:20.672 INFO:tasks.workunit.client.1.smithi129.stdout:5/449: getdents d0/df 0 2024-03-18T14:43:20.673 INFO:tasks.workunit.client.1.smithi129.stdout:6/500: creat d3/d30/de/d6c/d9e/f9f x:0 0 0 2024-03-18T14:43:20.673 INFO:tasks.workunit.client.1.smithi129.stdout:5/450: write d0/df/f48 [1164520,84993] 0 2024-03-18T14:43:20.673 INFO:tasks.workunit.client.1.smithi129.stdout:8/508: dread - d9/d11/d1a/d32/d41/d4d/f9b zero size 2024-03-18T14:43:20.674 INFO:tasks.workunit.client.0.smithi087.stdout:5/683: link d13/d1b/d30/f67 d13/d1b/d30/d6e/d88/fe9 0 2024-03-18T14:43:20.674 INFO:tasks.workunit.client.1.smithi129.stdout:5/451: write d0/df/f44 [185265,82332] 0 2024-03-18T14:43:20.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/637: creat d0/d2/d4/d27/dc3/fe1 x:0 0 0 2024-03-18T14:43:20.675 INFO:tasks.workunit.client.0.smithi087.stdout:8/641: dwrite d1/d6/d9/f48 [0,4194304] 0 2024-03-18T14:43:20.676 INFO:tasks.workunit.client.1.smithi129.stdout:9/454: rename d0/db/d1f/d4c/l74 to d0/db/d2e/l8c 0 2024-03-18T14:43:20.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/638: stat d0/d1a/d7b/d2a/d85 0 2024-03-18T14:43:20.677 INFO:tasks.workunit.client.0.smithi087.stdout:1/695: mknod d3/d1d/d1f/d34/d38/dba/cda 0 2024-03-18T14:43:20.677 INFO:tasks.workunit.client.0.smithi087.stdout:8/642: fsync d1/d6/d9/d5d/d87/d88/fbd 0 2024-03-18T14:43:20.677 INFO:tasks.workunit.client.1.smithi129.stdout:3/438: readlink d4/dd/d1f/d5f/d31/d78/l88 0 2024-03-18T14:43:20.678 INFO:tasks.workunit.client.0.smithi087.stdout:9/742: mknod db/d18/d1e/d28/dc2/dec/cf8 0 2024-03-18T14:43:20.678 INFO:tasks.workunit.client.1.smithi129.stdout:3/439: write d4/dd/f4d [4324029,8644] 0 2024-03-18T14:43:20.680 INFO:tasks.workunit.client.0.smithi087.stdout:4/605: rename d2/db/f43 to d2/db/d24/d30/d7b/d7f/da5/fcb 0 2024-03-18T14:43:20.682 INFO:tasks.workunit.client.0.smithi087.stdout:9/743: dwrite db/d18/d1e/dde/dce/fa9 [0,4194304] 0 2024-03-18T14:43:20.684 INFO:tasks.workunit.client.0.smithi087.stdout:6/619: mkdir d3/dcd 0 2024-03-18T14:43:20.687 INFO:tasks.workunit.client.0.smithi087.stdout:7/759: creat d1/d6/d29/d2f/d68/d65/d60/f102 x:0 0 0 2024-03-18T14:43:20.687 INFO:tasks.workunit.client.1.smithi129.stdout:2/489: dwrite d7/f58 [0,4194304] 0 2024-03-18T14:43:20.688 INFO:tasks.workunit.client.1.smithi129.stdout:8/509: dread d9/f15 [0,4194304] 0 2024-03-18T14:43:20.689 INFO:tasks.workunit.client.1.smithi129.stdout:8/510: chown d9/d11/d1a/d14/l31 4861599 1 2024-03-18T14:43:20.690 INFO:tasks.workunit.client.1.smithi129.stdout:4/426: rename d0/d19/d46/d3e/d21/d4d/d70/f5a to d0/d19/d46/d2e/f82 0 2024-03-18T14:43:20.692 INFO:tasks.workunit.client.1.smithi129.stdout:1/469: sync 2024-03-18T14:43:20.693 INFO:tasks.workunit.client.1.smithi129.stdout:1/470: chown d1/d2/l31 47593810 1 2024-03-18T14:43:20.693 INFO:tasks.workunit.client.0.smithi087.stdout:4/606: dread d2/db/d67/f9c [0,4194304] 0 2024-03-18T14:43:20.694 INFO:tasks.workunit.client.0.smithi087.stdout:2/667: mknod d2/d4/d22/d2c/d3a/d76/dc3/cdb 0 2024-03-18T14:43:20.694 INFO:tasks.workunit.client.0.smithi087.stdout:4/607: write d2/db/d3c/d90/f93 [195578,123181] 0 2024-03-18T14:43:20.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/608: write d2/db/f20 [248246,46196] 0 2024-03-18T14:43:20.696 INFO:tasks.workunit.client.0.smithi087.stdout:5/684: fsync d13/d1b/d27/d28/f7f 0 2024-03-18T14:43:20.696 INFO:tasks.workunit.client.1.smithi129.stdout:3/440: dwrite d4/dd/d1f/d5f/d31/f49 [0,4194304] 0 2024-03-18T14:43:20.696 INFO:tasks.workunit.client.1.smithi129.stdout:9/455: mkdir d0/db/d1f/d20/d26/d19/d8d 0 2024-03-18T14:43:20.697 INFO:tasks.workunit.client.0.smithi087.stdout:5/685: dread - d13/d1b/d27/d28/d9a/faf zero size 2024-03-18T14:43:20.697 INFO:tasks.workunit.client.1.smithi129.stdout:3/441: chown d4/dd/d1f/c23 259656428 1 2024-03-18T14:43:20.699 INFO:tasks.workunit.client.1.smithi129.stdout:3/442: write d4/d11/d1d/d50/d91/d93/f61 [9466105,84161] 0 2024-03-18T14:43:20.699 INFO:tasks.workunit.client.1.smithi129.stdout:0/510: rename d0/d23/d35/d3b/l65 to d0/d23/d29/l9c 0 2024-03-18T14:43:20.699 INFO:tasks.workunit.client.1.smithi129.stdout:3/443: fdatasync d4/dd/d1f/d2f/f69 0 2024-03-18T14:43:20.701 INFO:tasks.workunit.client.1.smithi129.stdout:0/511: chown d0/d23/d35/d50/f77 52254253 1 2024-03-18T14:43:20.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/427: dread - d0/d19/d46/d3e/d33/f7d zero size 2024-03-18T14:43:20.703 INFO:tasks.workunit.client.1.smithi129.stdout:4/428: read d0/d19/f5e [375947,79956] 0 2024-03-18T14:43:20.704 INFO:tasks.workunit.client.1.smithi129.stdout:3/444: dread d4/dd/d1f/d5f/d31/f49 [0,4194304] 0 2024-03-18T14:43:20.705 INFO:tasks.workunit.client.0.smithi087.stdout:3/693: creat d0/d1c/d25/dba/fc2 x:0 0 0 2024-03-18T14:43:20.705 INFO:tasks.workunit.client.0.smithi087.stdout:6/620: write d3/d7/d25/d62/d7c/d29/d22/f32 [1234346,97326] 0 2024-03-18T14:43:20.706 INFO:tasks.workunit.client.1.smithi129.stdout:5/452: link d0/df/c54 d0/dc/d1a/c80 0 2024-03-18T14:43:20.707 INFO:tasks.workunit.client.1.smithi129.stdout:6/501: dwrite d3/d38/d57/f64 [4194304,4194304] 0 2024-03-18T14:43:20.707 INFO:tasks.workunit.client.1.smithi129.stdout:8/511: symlink d9/d11/d55/d6a/d6f/la6 0 2024-03-18T14:43:20.711 INFO:tasks.workunit.client.1.smithi129.stdout:9/456: rename d0/db/d1f/d20/d25/d59 to d0/db/d1f/d20/d25/d8e 0 2024-03-18T14:43:20.711 INFO:tasks.workunit.client.1.smithi129.stdout:9/457: readlink d0/db/l34 0 2024-03-18T14:43:20.713 INFO:tasks.workunit.client.1.smithi129.stdout:0/512: mknod d0/d23/d35/d50/c9d 0 2024-03-18T14:43:20.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/609: creat d2/db/de/fcc x:0 0 0 2024-03-18T14:43:20.717 INFO:tasks.workunit.client.1.smithi129.stdout:3/445: creat d4/d11/d1d/d50/d91/f94 x:0 0 0 2024-03-18T14:43:20.717 INFO:tasks.workunit.client.0.smithi087.stdout:8/643: rename d1/d6/d14/f79 to d1/d6/d8d/dc2/fd8 0 2024-03-18T14:43:20.719 INFO:tasks.workunit.client.1.smithi129.stdout:5/453: creat d0/dc/d18/d2b/f81 x:0 0 0 2024-03-18T14:43:20.719 INFO:tasks.workunit.client.1.smithi129.stdout:8/512: dread d9/d11/d1a/d32/d3a/d70/f8c [0,4194304] 0 2024-03-18T14:43:20.719 INFO:tasks.workunit.client.0.smithi087.stdout:7/760: creat d1/d6/d16/dc/ddc/f103 x:0 0 0 2024-03-18T14:43:20.720 INFO:tasks.workunit.client.1.smithi129.stdout:5/454: chown d0/l7 0 1 2024-03-18T14:43:20.722 INFO:tasks.workunit.client.1.smithi129.stdout:0/513: mkdir d0/d23/d35/d9e 0 2024-03-18T14:43:20.722 INFO:tasks.workunit.client.0.smithi087.stdout:3/694: mkdir d0/de/d30/d46/dc3 0 2024-03-18T14:43:20.722 INFO:tasks.workunit.client.0.smithi087.stdout:1/696: dwrite d3/d1d/d1e/f55 [0,4194304] 0 2024-03-18T14:43:20.725 INFO:tasks.workunit.client.1.smithi129.stdout:7/485: sync 2024-03-18T14:43:20.725 INFO:tasks.workunit.client.1.smithi129.stdout:2/490: dread d7/d1f/d34/f1a [0,4194304] 0 2024-03-18T14:43:20.725 INFO:tasks.workunit.client.1.smithi129.stdout:5/455: dwrite d0/d32/f79 [0,4194304] 0 2024-03-18T14:43:20.726 INFO:tasks.workunit.client.0.smithi087.stdout:4/610: symlink d2/db/d24/d30/d7b/lcd 0 2024-03-18T14:43:20.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/513: mknod d9/ca7 0 2024-03-18T14:43:20.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/514: fdatasync d9/d11/d1a/d32/d41/d4d/f4f 0 2024-03-18T14:43:20.728 INFO:tasks.workunit.client.0.smithi087.stdout:9/744: rename db/d18/d1c/d69/lb5 to db/d12/lf9 0 2024-03-18T14:43:20.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/668: dread d2/d4/d22/d2c/d3a/d40/d52/fae [0,4194304] 0 2024-03-18T14:43:20.729 INFO:tasks.workunit.client.0.smithi087.stdout:8/644: mknod d1/d6/d2f/d44/d4b/da5/cd9 0 2024-03-18T14:43:20.729 INFO:tasks.workunit.client.0.smithi087.stdout:0/639: dwrite d0/d7f/fd4 [0,4194304] 0 2024-03-18T14:43:20.731 INFO:tasks.workunit.client.0.smithi087.stdout:1/697: dwrite d3/d1d/d1f/f3f [4194304,4194304] 0 2024-03-18T14:43:20.731 INFO:tasks.workunit.client.1.smithi129.stdout:4/429: link d0/d19/d46/d3e/f42 d0/d19/d46/d3e/d21/d32/f83 0 2024-03-18T14:43:20.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/502: dwrite d3/d30/f20 [0,4194304] 0 2024-03-18T14:43:20.731 INFO:tasks.workunit.client.1.smithi129.stdout:1/471: getdents d1/d2/d28/d65/d19/d84 0 2024-03-18T14:43:20.732 INFO:tasks.workunit.client.0.smithi087.stdout:8/645: chown d1/d6/d9/f7a 1488055427 1 2024-03-18T14:43:20.734 INFO:tasks.workunit.client.1.smithi129.stdout:0/514: rename d0/d23/d35/d50/f52 to d0/d23/d71/f9f 0 2024-03-18T14:43:20.734 INFO:tasks.workunit.client.0.smithi087.stdout:6/621: mkdir d3/d7/d25/d62/d7c/d29/dce 0 2024-03-18T14:43:20.734 INFO:tasks.workunit.client.0.smithi087.stdout:5/686: link d13/d1b/d27/d28/l69 d13/d1b/d70/dce/lea 0 2024-03-18T14:43:20.735 INFO:tasks.workunit.client.1.smithi129.stdout:3/446: mkdir d4/d11/d34/d3c/d95 0 2024-03-18T14:43:20.735 INFO:tasks.workunit.client.0.smithi087.stdout:4/611: readlink d2/db/d24/d30/d49/d4f/l5a 0 2024-03-18T14:43:20.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/698: dwrite d3/d1d/d1e/d43/d50/d72/f9d [0,4194304] 0 2024-03-18T14:43:20.738 INFO:tasks.workunit.client.0.smithi087.stdout:1/699: chown d3/d1d/d79/f7f 579684696 1 2024-03-18T14:43:20.739 INFO:tasks.workunit.client.1.smithi129.stdout:7/486: creat d4/d7/d54/f94 x:0 0 0 2024-03-18T14:43:20.740 INFO:tasks.workunit.client.1.smithi129.stdout:5/456: symlink d0/d32/d3a/d52/d69/l82 0 2024-03-18T14:43:20.742 INFO:tasks.workunit.client.1.smithi129.stdout:9/458: creat d0/db/d1f/d20/f8f x:0 0 0 2024-03-18T14:43:20.744 INFO:tasks.workunit.client.1.smithi129.stdout:8/515: mknod d9/d11/d1a/d32/d41/d4d/d96/ca8 0 2024-03-18T14:43:20.744 INFO:tasks.workunit.client.1.smithi129.stdout:8/516: fsync d9/f4c 0 2024-03-18T14:43:20.745 INFO:tasks.workunit.client.1.smithi129.stdout:1/472: creat d1/d2/d28/d65/d19/d52/f90 x:0 0 0 2024-03-18T14:43:20.745 INFO:tasks.workunit.client.1.smithi129.stdout:8/517: chown d9/d11/d18/da4 122127836 1 2024-03-18T14:43:20.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/622: unlink d3/d7/d25/l5b 0 2024-03-18T14:43:20.751 INFO:tasks.workunit.client.0.smithi087.stdout:1/700: mknod d3/d3c/db8/d8f/d99/cdb 0 2024-03-18T14:43:20.751 INFO:tasks.workunit.client.0.smithi087.stdout:6/623: dwrite d3/d7/d25/d62/d7c/d29/f56 [0,4194304] 0 2024-03-18T14:43:20.752 INFO:tasks.workunit.client.1.smithi129.stdout:0/515: symlink d0/d14/d53/la0 0 2024-03-18T14:43:20.752 INFO:tasks.workunit.client.0.smithi087.stdout:1/701: readlink d3/d1d/d67/ld0 0 2024-03-18T14:43:20.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/624: readlink d3/d7/d25/d62/d7c/l63 0 2024-03-18T14:43:20.753 INFO:tasks.workunit.client.0.smithi087.stdout:1/702: write d3/d1d/d1e/d20/f52 [4297247,82875] 0 2024-03-18T14:43:20.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/703: rename d3/d1d/d67/d94 to d3/d1d/d67/d94/ddc 22 2024-03-18T14:43:20.755 INFO:tasks.workunit.client.0.smithi087.stdout:4/612: mkdir d2/dc2/dce 0 2024-03-18T14:43:20.755 INFO:tasks.workunit.client.0.smithi087.stdout:1/704: chown d3/d1d/d1e/d20/fd5 117679 1 2024-03-18T14:43:20.756 INFO:tasks.workunit.client.0.smithi087.stdout:4/613: write d2/db/de/fcc [691699,73119] 0 2024-03-18T14:43:20.756 INFO:tasks.workunit.client.0.smithi087.stdout:1/705: fsync d3/f93 0 2024-03-18T14:43:20.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/745: rmdir db/d18/d1e/df5 0 2024-03-18T14:43:20.757 INFO:tasks.workunit.client.0.smithi087.stdout:4/614: write d2/db/d24/d30/f6f [4318965,98634] 0 2024-03-18T14:43:20.758 INFO:tasks.workunit.client.0.smithi087.stdout:4/615: readlink d2/db/d24/d30/d56/l64 0 2024-03-18T14:43:20.761 INFO:tasks.workunit.client.1.smithi129.stdout:6/503: unlink d3/d30/d44/l7e 0 2024-03-18T14:43:20.764 INFO:tasks.workunit.client.1.smithi129.stdout:8/518: creat d9/d11/d1a/d32/d41/d4d/fa9 x:0 0 0 2024-03-18T14:43:20.765 INFO:tasks.workunit.client.1.smithi129.stdout:0/516: symlink d0/d23/d35/d3b/la1 0 2024-03-18T14:43:20.765 INFO:tasks.workunit.client.1.smithi129.stdout:0/517: chown d0/d14/f4d 29 1 2024-03-18T14:43:20.766 INFO:tasks.workunit.client.1.smithi129.stdout:2/491: creat d7/d1c/f92 x:0 0 0 2024-03-18T14:43:20.767 INFO:tasks.workunit.client.1.smithi129.stdout:2/492: write d7/f58 [486737,55593] 0 2024-03-18T14:43:20.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/447: creat d4/d11/d34/d3c/d95/f96 x:0 0 0 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/625: rmdir d3/d7/d25/d62/d8b 39 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.0.smithi087.stdout:3/695: getdents d0 0 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.0.smithi087.stdout:0/640: link d0/d2/l9d d0/d2/d4/d27/dc3/dd2/le2 0 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.1.smithi129.stdout:7/487: mknod d4/d2d/d2e/d42/c95 0 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.1.smithi129.stdout:5/457: mkdir d0/d32/d3a/d45/d83 0 2024-03-18T14:43:20.769 INFO:tasks.workunit.client.1.smithi129.stdout:7/488: dread - d4/d7/d38/d61/d6a/f92 zero size 2024-03-18T14:43:20.770 INFO:tasks.workunit.client.0.smithi087.stdout:1/706: chown d3/d1d/d1e/d43/d50/d72/cd2 31194586 1 2024-03-18T14:43:20.770 INFO:tasks.workunit.client.0.smithi087.stdout:0/641: write d0/d2/d4/d19/d24/da3/da8/fcc [616396,21131] 0 2024-03-18T14:43:20.771 INFO:tasks.workunit.client.1.smithi129.stdout:6/504: creat d3/d30/de/d65/d93/fa0 x:0 0 0 2024-03-18T14:43:20.771 INFO:tasks.workunit.client.0.smithi087.stdout:0/642: fsync d0/d2/d3c/d73/fbf 0 2024-03-18T14:43:20.771 INFO:tasks.workunit.client.0.smithi087.stdout:4/616: mkdir d2/db/d24/d30/d7b/dbe/dcf 0 2024-03-18T14:43:20.771 INFO:tasks.workunit.client.1.smithi129.stdout:6/505: dread - d3/d38/f70 zero size 2024-03-18T14:43:20.772 INFO:tasks.workunit.client.1.smithi129.stdout:4/430: truncate d0/d19/d46/d3e/f76 911292 0 2024-03-18T14:43:20.773 INFO:tasks.workunit.client.1.smithi129.stdout:0/518: read d0/d14/d3a/d4a/f70 [7476937,75414] 0 2024-03-18T14:43:20.774 INFO:tasks.workunit.client.1.smithi129.stdout:0/519: dread - d0/d23/d6b/f8b zero size 2024-03-18T14:43:20.775 INFO:tasks.workunit.client.0.smithi087.stdout:3/696: creat d0/d3/d4f/fc4 x:0 0 0 2024-03-18T14:43:20.776 INFO:tasks.workunit.client.0.smithi087.stdout:3/697: fdatasync d0/d72/f8a 0 2024-03-18T14:43:20.776 INFO:tasks.workunit.client.0.smithi087.stdout:1/707: chown d3/l14 0 1 2024-03-18T14:43:20.776 INFO:tasks.workunit.client.1.smithi129.stdout:2/493: rename d7/d1f/d34/c86 to d7/d1f/d20/d2b/d41/c93 0 2024-03-18T14:43:20.776 INFO:tasks.workunit.client.1.smithi129.stdout:2/494: write d7/d1c/f84 [1721982,28227] 0 2024-03-18T14:43:20.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/643: fsync d0/d1a/d80/d88/f64 0 2024-03-18T14:43:20.778 INFO:tasks.workunit.client.1.smithi129.stdout:3/448: mkdir d4/d11/d1d/d50/d91/d97 0 2024-03-18T14:43:20.778 INFO:tasks.workunit.client.1.smithi129.stdout:5/458: dread d0/d32/d3a/d45/f65 [0,4194304] 0 2024-03-18T14:43:20.779 INFO:tasks.workunit.client.1.smithi129.stdout:3/449: write d4/d38/f1b [3418781,16817] 0 2024-03-18T14:43:20.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/617: rename d2/db/d24/d30/fc5 to d2/dc2/fd0 0 2024-03-18T14:43:20.781 INFO:tasks.workunit.client.0.smithi087.stdout:0/644: read d0/f10 [3932951,59905] 0 2024-03-18T14:43:20.782 INFO:tasks.workunit.client.0.smithi087.stdout:1/708: mknod d3/d1d/d1e/d43/d50/d72/cdd 0 2024-03-18T14:43:20.783 INFO:tasks.workunit.client.1.smithi129.stdout:5/459: dread d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:20.783 INFO:tasks.workunit.client.1.smithi129.stdout:3/450: dread d4/dd/d1f/d5f/d31/f49 [0,4194304] 0 2024-03-18T14:43:20.783 INFO:tasks.workunit.client.0.smithi087.stdout:1/709: dread - d3/d1d/d1f/d34/f62 zero size 2024-03-18T14:43:20.784 INFO:tasks.workunit.client.0.smithi087.stdout:2/669: dread d2/d44/d72/f94 [0,4194304] 0 2024-03-18T14:43:20.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/451: read d4/f54 [284760,9739] 0 2024-03-18T14:43:20.784 INFO:tasks.workunit.client.0.smithi087.stdout:7/761: write d1/d6/da/f37 [397123,80329] 0 2024-03-18T14:43:20.786 INFO:tasks.workunit.client.0.smithi087.stdout:5/687: write d13/f57 [636280,101609] 0 2024-03-18T14:43:20.786 INFO:tasks.workunit.client.0.smithi087.stdout:7/762: fsync d1/d6/da/d42/d61/fd3 0 2024-03-18T14:43:20.786 INFO:tasks.workunit.client.0.smithi087.stdout:8/646: write d1/d6/f1e [375453,110737] 0 2024-03-18T14:43:20.788 INFO:tasks.workunit.client.1.smithi129.stdout:1/473: truncate d1/f88 186497 0 2024-03-18T14:43:20.788 INFO:tasks.workunit.client.0.smithi087.stdout:7/763: write d1/d6/d29/d2f/d68/d65/d60/f102 [309026,46572] 0 2024-03-18T14:43:20.789 INFO:tasks.workunit.client.0.smithi087.stdout:7/764: write d1/f31 [2962861,42904] 0 2024-03-18T14:43:20.790 INFO:tasks.workunit.client.1.smithi129.stdout:4/431: fdatasync d0/d19/f54 0 2024-03-18T14:43:20.791 INFO:tasks.workunit.client.1.smithi129.stdout:9/459: write d0/db/d53/f58 [84102,71356] 0 2024-03-18T14:43:20.792 INFO:tasks.workunit.client.0.smithi087.stdout:3/698: mkdir d0/de/d30/dc5 0 2024-03-18T14:43:20.792 INFO:tasks.workunit.client.0.smithi087.stdout:9/746: dread db/d18/d3a/f47 [0,4194304] 0 2024-03-18T14:43:20.793 INFO:tasks.workunit.client.1.smithi129.stdout:8/519: write d9/d11/d1a/d32/d3a/f49 [4716185,63685] 0 2024-03-18T14:43:20.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/626: dwrite d3/d7/d25/f41 [0,4194304] 0 2024-03-18T14:43:20.798 INFO:tasks.workunit.client.1.smithi129.stdout:0/520: rmdir d0/d14/d3a/d4a 39 2024-03-18T14:43:20.799 INFO:tasks.workunit.client.0.smithi087.stdout:8/647: stat d1/d6/f29 0 2024-03-18T14:43:20.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/645: creat d0/d2/da9/fe3 x:0 0 0 2024-03-18T14:43:20.800 INFO:tasks.workunit.client.1.smithi129.stdout:2/495: mknod d7/d1f/d34/c94 0 2024-03-18T14:43:20.803 INFO:tasks.workunit.client.0.smithi087.stdout:7/765: dread d1/d6/da/f25 [0,4194304] 0 2024-03-18T14:43:20.804 INFO:tasks.workunit.client.1.smithi129.stdout:2/496: dwrite d7/d1c/f92 [0,4194304] 0 2024-03-18T14:43:20.805 INFO:tasks.workunit.client.0.smithi087.stdout:4/618: dwrite d2/dc2/fd0 [0,4194304] 0 2024-03-18T14:43:20.805 INFO:tasks.workunit.client.0.smithi087.stdout:3/699: dwrite d0/d72/f99 [0,4194304] 0 2024-03-18T14:43:20.806 INFO:tasks.workunit.client.1.smithi129.stdout:6/506: symlink d3/d30/df/la1 0 2024-03-18T14:43:20.806 INFO:tasks.workunit.client.1.smithi129.stdout:8/520: symlink d9/d33/laa 0 2024-03-18T14:43:20.807 INFO:tasks.workunit.client.0.smithi087.stdout:8/648: mkdir d1/d6/d8d/dc2/dda 0 2024-03-18T14:43:20.808 INFO:tasks.workunit.client.0.smithi087.stdout:2/670: dwrite d2/d4/d22/d2c/d3a/d76/d9a/d9b/fa0 [0,4194304] 0 2024-03-18T14:43:20.808 INFO:tasks.workunit.client.1.smithi129.stdout:8/521: write d9/d11/d1a/d32/d41/d4d/f4f [974418,57344] 0 2024-03-18T14:43:20.809 INFO:tasks.workunit.client.0.smithi087.stdout:2/671: stat d2/d44/d72/f94 0 2024-03-18T14:43:20.812 INFO:tasks.workunit.client.0.smithi087.stdout:9/747: mknod db/d18/d51/d8f/cfa 0 2024-03-18T14:43:20.814 INFO:tasks.workunit.client.1.smithi129.stdout:8/522: read d9/d11/d18/f24 [2996439,88715] 0 2024-03-18T14:43:20.815 INFO:tasks.workunit.client.0.smithi087.stdout:3/700: creat d0/d1c/d25/fc6 x:0 0 0 2024-03-18T14:43:20.815 INFO:tasks.workunit.client.0.smithi087.stdout:8/649: dwrite d1/f9a [0,4194304] 0 2024-03-18T14:43:20.815 INFO:tasks.workunit.client.0.smithi087.stdout:4/619: creat d2/db/d24/d30/d8a/d95/fd1 x:0 0 0 2024-03-18T14:43:20.816 INFO:tasks.workunit.client.0.smithi087.stdout:2/672: dwrite d2/d4/d22/d2c/d3a/fc1 [0,4194304] 0 2024-03-18T14:43:20.817 INFO:tasks.workunit.client.0.smithi087.stdout:8/650: dread - d1/d6/f29 zero size 2024-03-18T14:43:20.818 INFO:tasks.workunit.client.1.smithi129.stdout:1/474: mkdir d1/d91 0 2024-03-18T14:43:20.818 INFO:tasks.workunit.client.0.smithi087.stdout:4/620: write d2/db/d24/f4c [841300,99629] 0 2024-03-18T14:43:20.819 INFO:tasks.workunit.client.1.smithi129.stdout:1/475: write d1/d2/d28/d65/d19/d52/f89 [450654,108680] 0 2024-03-18T14:43:20.820 INFO:tasks.workunit.client.0.smithi087.stdout:7/766: mknod d1/d6/da/de3/c104 0 2024-03-18T14:43:20.820 INFO:tasks.workunit.client.0.smithi087.stdout:5/688: dread d13/d1b/d7e/fa2 [0,4194304] 0 2024-03-18T14:43:20.822 INFO:tasks.workunit.client.0.smithi087.stdout:1/710: dread d3/d1d/d1e/d20/dbd/fcf [0,4194304] 0 2024-03-18T14:43:20.822 INFO:tasks.workunit.client.1.smithi129.stdout:6/507: chown d3/d5/f13 5 1 2024-03-18T14:43:20.822 INFO:tasks.workunit.client.1.smithi129.stdout:6/508: fsync d3/d30/f20 0 2024-03-18T14:43:20.824 INFO:tasks.workunit.client.1.smithi129.stdout:5/460: link d0/f14 d0/f84 0 2024-03-18T14:43:20.824 INFO:tasks.workunit.client.0.smithi087.stdout:6/627: dwrite d3/d7/d25/d62/d7c/d29/f5a [0,4194304] 0 2024-03-18T14:43:20.834 INFO:tasks.workunit.client.1.smithi129.stdout:3/452: truncate d4/dd/f8f 1009433 0 2024-03-18T14:43:20.834 INFO:tasks.workunit.client.1.smithi129.stdout:7/489: link d4/c23 d4/c96 0 2024-03-18T14:43:20.834 INFO:tasks.workunit.client.1.smithi129.stdout:4/432: rename d0/d9/d40/f71 to d0/d19/f84 0 2024-03-18T14:43:20.834 INFO:tasks.workunit.client.1.smithi129.stdout:0/521: truncate d0/f72 460096 0 2024-03-18T14:43:20.835 INFO:tasks.workunit.client.1.smithi129.stdout:7/490: stat d4/f66 0 2024-03-18T14:43:20.837 INFO:tasks.workunit.client.0.smithi087.stdout:8/651: fdatasync d1/d6/d2f/d44/d4b/f86 0 2024-03-18T14:43:20.838 INFO:tasks.workunit.client.0.smithi087.stdout:8/652: write d1/d6/d9/d5d/d87/d88/f9d [1229310,120881] 0 2024-03-18T14:43:20.839 INFO:tasks.workunit.client.0.smithi087.stdout:8/653: dread - d1/d6/d2f/d44/d45/d50/fd2 zero size 2024-03-18T14:43:20.841 INFO:tasks.workunit.client.1.smithi129.stdout:6/509: unlink d3/d38/d57/l7c 0 2024-03-18T14:43:20.841 INFO:tasks.workunit.client.1.smithi129.stdout:5/461: creat d0/d32/d34/f85 x:0 0 0 2024-03-18T14:43:20.841 INFO:tasks.workunit.client.0.smithi087.stdout:4/621: write d2/db/d24/f2b [991834,14510] 0 2024-03-18T14:43:20.842 INFO:tasks.workunit.client.0.smithi087.stdout:4/622: stat d2/db/d24/d30/d8a 0 2024-03-18T14:43:20.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/767: mkdir d1/d6/d29/d2f/d6b/d105 0 2024-03-18T14:43:20.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/462: read - d0/d32/d34/f4d zero size 2024-03-18T14:43:20.842 INFO:tasks.workunit.client.0.smithi087.stdout:7/768: chown d1/d6/d29/d2f/dea 31 1 2024-03-18T14:43:20.844 INFO:tasks.workunit.client.1.smithi129.stdout:4/433: mkdir d0/d9/d85 0 2024-03-18T14:43:20.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/453: creat d4/dd/d1f/d5f/d31/f98 x:0 0 0 2024-03-18T14:43:20.846 INFO:tasks.workunit.client.0.smithi087.stdout:3/701: symlink d0/de/d30/d46/dc3/lc7 0 2024-03-18T14:43:20.847 INFO:tasks.workunit.client.1.smithi129.stdout:7/491: creat d4/d7/d38/d61/f97 x:0 0 0 2024-03-18T14:43:20.847 INFO:tasks.workunit.client.0.smithi087.stdout:2/673: mkdir d2/d4/d22/d2c/d3a/d49/ddc 0 2024-03-18T14:43:20.847 INFO:tasks.workunit.client.1.smithi129.stdout:6/510: creat d3/d38/d57/fa2 x:0 0 0 2024-03-18T14:43:20.848 INFO:tasks.workunit.client.1.smithi129.stdout:1/476: link d1/d2/d28/d65/d19/c6b d1/d2/d28/d65/d19/d52/c92 0 2024-03-18T14:43:20.848 INFO:tasks.workunit.client.0.smithi087.stdout:6/628: dread d3/d7/d25/d62/f6a [0,4194304] 0 2024-03-18T14:43:20.848 INFO:tasks.workunit.client.0.smithi087.stdout:7/769: dread d1/f76 [0,4194304] 0 2024-03-18T14:43:20.850 INFO:tasks.workunit.client.1.smithi129.stdout:4/434: write d0/d19/d46/d2e/f82 [968003,12075] 0 2024-03-18T14:43:20.850 INFO:tasks.workunit.client.1.smithi129.stdout:0/522: dwrite d0/d23/d71/f9f [0,4194304] 0 2024-03-18T14:43:20.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/654: creat d1/d6/d2f/d44/d45/d71/daa/fdb x:0 0 0 2024-03-18T14:43:20.852 INFO:tasks.workunit.client.1.smithi129.stdout:5/463: creat d0/dc/d18/d5f/f86 x:0 0 0 2024-03-18T14:43:20.854 INFO:tasks.workunit.client.0.smithi087.stdout:5/689: fsync d13/d1b/d30/f67 0 2024-03-18T14:43:20.854 INFO:tasks.workunit.client.1.smithi129.stdout:9/460: rename d0/db/d1f/d20/d4a to d0/db/d90 0 2024-03-18T14:43:20.855 INFO:tasks.workunit.client.0.smithi087.stdout:0/646: dread d0/d2/d4/d19/f2f [0,4194304] 0 2024-03-18T14:43:20.855 INFO:tasks.workunit.client.1.smithi129.stdout:7/492: mknod d4/d7/d38/d61/d68/c98 0 2024-03-18T14:43:20.856 INFO:tasks.workunit.client.1.smithi129.stdout:7/493: write d4/d2d/d2e/d45/f4c [2486818,89938] 0 2024-03-18T14:43:20.858 INFO:tasks.workunit.client.1.smithi129.stdout:2/497: sync 2024-03-18T14:43:20.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/702: read d0/d3/d4f/f6f [200448,70318] 0 2024-03-18T14:43:20.860 INFO:tasks.workunit.client.0.smithi087.stdout:6/629: creat d3/d7/d25/d62/d7c/d29/d7d/fcf x:0 0 0 2024-03-18T14:43:20.861 INFO:tasks.workunit.client.1.smithi129.stdout:8/523: rename d9/d11/d1a/d79/c89 to d9/d11/d55/d6a/cab 0 2024-03-18T14:43:20.862 INFO:tasks.workunit.client.1.smithi129.stdout:8/524: dread - d9/d11/d1a/d32/d41/d4d/fa9 zero size 2024-03-18T14:43:20.863 INFO:tasks.workunit.client.0.smithi087.stdout:7/770: rename d1/d6/da/c24 to d1/d6/d29/d2f/c106 0 2024-03-18T14:43:20.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/525: write f8 [5082753,85670] 0 2024-03-18T14:43:20.865 INFO:tasks.workunit.client.1.smithi129.stdout:7/494: creat d4/d7/d54/d86/f99 x:0 0 0 2024-03-18T14:43:20.866 INFO:tasks.workunit.client.1.smithi129.stdout:7/495: dread - d4/d2d/d3a/f53 zero size 2024-03-18T14:43:20.869 INFO:tasks.workunit.client.0.smithi087.stdout:4/623: write d2/db/de/f2f [201129,58585] 0 2024-03-18T14:43:20.869 INFO:tasks.workunit.client.0.smithi087.stdout:4/624: readlink d2/d13/l59 0 2024-03-18T14:43:20.870 INFO:tasks.workunit.client.1.smithi129.stdout:7/496: dwrite d4/d2d/d2e/d42/f8f [0,4194304] 0 2024-03-18T14:43:20.870 INFO:tasks.workunit.client.0.smithi087.stdout:5/690: mknod d13/d1b/d30/d6e/d88/db4/ceb 0 2024-03-18T14:43:20.871 INFO:tasks.workunit.client.0.smithi087.stdout:1/711: link d3/d3c/la1 d3/d1d/d1e/d43/da3/dc3/lde 0 2024-03-18T14:43:20.872 INFO:tasks.workunit.client.0.smithi087.stdout:9/748: getdents db/d18/d1e/d28/dc2 0 2024-03-18T14:43:20.873 INFO:tasks.workunit.client.0.smithi087.stdout:9/749: write db/d31/f42 [3405035,15845] 0 2024-03-18T14:43:20.874 INFO:tasks.workunit.client.0.smithi087.stdout:9/750: readlink db/d12/l3b 0 2024-03-18T14:43:20.874 INFO:tasks.workunit.client.0.smithi087.stdout:6/630: mknod d3/d7/cd0 0 2024-03-18T14:43:20.875 INFO:tasks.workunit.client.0.smithi087.stdout:3/703: rename d0/d3/d10/d7f to d0/d3/d4f/d6e/dc8 0 2024-03-18T14:43:20.877 INFO:tasks.workunit.client.1.smithi129.stdout:4/435: write d0/d19/d46/d3e/d21/d32/f83 [3531151,105025] 0 2024-03-18T14:43:20.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/771: readlink d1/d6/d29/d2f/d68/d65/d96/lc3 0 2024-03-18T14:43:20.877 INFO:tasks.workunit.client.1.smithi129.stdout:3/454: dwrite d4/d11/d34/d53/f8e [0,4194304] 0 2024-03-18T14:43:20.878 INFO:tasks.workunit.client.1.smithi129.stdout:3/455: dread - d4/d11/d34/d53/f80 zero size 2024-03-18T14:43:20.879 INFO:tasks.workunit.client.0.smithi087.stdout:9/751: dwrite db/d18/d1e/fc3 [4194304,4194304] 0 2024-03-18T14:43:20.881 INFO:tasks.workunit.client.0.smithi087.stdout:9/752: chown db/d18/d1e/d28/d76/db7/fc1 237859447 1 2024-03-18T14:43:20.882 INFO:tasks.workunit.client.0.smithi087.stdout:9/753: read - db/d18/d1e/d28/d76/d80/fa5 zero size 2024-03-18T14:43:20.882 INFO:tasks.workunit.client.0.smithi087.stdout:5/691: dread d13/f5f [0,4194304] 0 2024-03-18T14:43:20.883 INFO:tasks.workunit.client.0.smithi087.stdout:5/692: chown d13/d1b/d27/d35/f43 2 1 2024-03-18T14:43:20.883 INFO:tasks.workunit.client.0.smithi087.stdout:9/754: write db/d18/d1e/ff4 [828640,115768] 0 2024-03-18T14:43:20.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/693: dread - d13/d1b/d30/d6e/d88/fca zero size 2024-03-18T14:43:20.884 INFO:tasks.workunit.client.1.smithi129.stdout:9/461: getdents d0/db/d90/d3e/d7e 0 2024-03-18T14:43:20.886 INFO:tasks.workunit.client.1.smithi129.stdout:2/498: symlink d7/d1f/d20/d2b/d41/l95 0 2024-03-18T14:43:20.886 INFO:tasks.workunit.client.1.smithi129.stdout:1/477: link d1/c1e d1/d2/d28/d65/d72/c93 0 2024-03-18T14:43:20.886 INFO:tasks.workunit.client.0.smithi087.stdout:6/631: mknod d3/d7/d25/d62/d7c/d29/d22/d61/cd1 0 2024-03-18T14:43:20.887 INFO:tasks.workunit.client.1.smithi129.stdout:6/511: truncate d3/d38/d57/fa2 639246 0 2024-03-18T14:43:20.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/526: rename d9/d11/d1a/d32/f38 to d9/d11/d55/d68/d72/fac 0 2024-03-18T14:43:20.890 INFO:tasks.workunit.client.1.smithi129.stdout:2/499: dwrite d7/d3f/d5f/f8e [0,4194304] 0 2024-03-18T14:43:20.892 INFO:tasks.workunit.client.0.smithi087.stdout:4/625: mknod d2/cd2 0 2024-03-18T14:43:20.892 INFO:tasks.workunit.client.0.smithi087.stdout:0/647: creat d0/d1a/d80/fe4 x:0 0 0 2024-03-18T14:43:20.892 INFO:tasks.workunit.client.0.smithi087.stdout:2/674: getdents d2/d4/d22/d2c/d3a/d76/d81 0 2024-03-18T14:43:20.892 INFO:tasks.workunit.client.0.smithi087.stdout:7/772: write d1/f76 [590194,7005] 0 2024-03-18T14:43:20.892 INFO:tasks.workunit.client.1.smithi129.stdout:0/523: sync 2024-03-18T14:43:20.893 INFO:tasks.workunit.client.0.smithi087.stdout:0/648: stat d0/d1a/d34/ld0 0 2024-03-18T14:43:20.894 INFO:tasks.workunit.client.1.smithi129.stdout:0/524: chown d0/d23/d71/f9f 14748635 1 2024-03-18T14:43:20.894 INFO:tasks.workunit.client.0.smithi087.stdout:9/755: creat db/d18/d1e/d28/dc2/dec/ffb x:0 0 0 2024-03-18T14:43:20.894 INFO:tasks.workunit.client.0.smithi087.stdout:2/675: fsync d2/d4/d22/d2c/d3a/d76/d81/f82 0 2024-03-18T14:43:20.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/649: readlink d0/d1a/d80/laf 0 2024-03-18T14:43:20.895 INFO:tasks.workunit.client.1.smithi129.stdout:5/464: truncate d0/d32/d34/f4d 388384 0 2024-03-18T14:43:20.895 INFO:tasks.workunit.client.1.smithi129.stdout:0/525: chown d0/d14/d53/l56 0 1 2024-03-18T14:43:20.896 INFO:tasks.workunit.client.1.smithi129.stdout:9/462: mknod d0/db/d1f/d20/d25/d8e/c91 0 2024-03-18T14:43:20.896 INFO:tasks.workunit.client.1.smithi129.stdout:4/436: fdatasync d0/d19/d46/d3e/f60 0 2024-03-18T14:43:20.896 INFO:tasks.workunit.client.1.smithi129.stdout:8/527: dwrite d9/d11/d1a/f77 [4194304,4194304] 0 2024-03-18T14:43:20.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/632: rename d3/d7/d25/d62 to d3/d7/d25/d62/d8b/dd2 22 2024-03-18T14:43:20.897 INFO:tasks.workunit.client.1.smithi129.stdout:5/465: read - d0/dc/d1a/f7a zero size 2024-03-18T14:43:20.898 INFO:tasks.workunit.client.1.smithi129.stdout:8/528: chown d9/d11/d1a/d32/d3a/l50 32512111 1 2024-03-18T14:43:20.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/626: mknod d2/db/d24/d30/d56/cd3 0 2024-03-18T14:43:20.899 INFO:tasks.workunit.client.1.smithi129.stdout:1/478: rmdir d1/d2/d28/d65/d19 39 2024-03-18T14:43:20.899 INFO:tasks.workunit.client.0.smithi087.stdout:5/694: dwrite d13/d1b/d30/d6e/d88/fe9 [0,4194304] 0 2024-03-18T14:43:20.900 INFO:tasks.workunit.client.1.smithi129.stdout:8/529: fsync d9/d11/d1a/d32/d41/d4d/f4f 0 2024-03-18T14:43:20.900 INFO:tasks.workunit.client.0.smithi087.stdout:4/627: write d2/db/d84/d87/f88 [911813,32304] 0 2024-03-18T14:43:20.902 INFO:tasks.workunit.client.1.smithi129.stdout:2/500: creat d7/d1c/d32/f96 x:0 0 0 2024-03-18T14:43:20.902 INFO:tasks.workunit.client.1.smithi129.stdout:9/463: dwrite d0/db/d53/f58 [0,4194304] 0 2024-03-18T14:43:20.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/633: dwrite d3/d7/d25/d62/d7c/d29/d22/d75/f9b [4194304,4194304] 0 2024-03-18T14:43:20.910 INFO:tasks.workunit.client.0.smithi087.stdout:3/704: truncate d0/de/d30/d46/da0/fb4 783198 0 2024-03-18T14:43:20.911 INFO:tasks.workunit.client.1.smithi129.stdout:7/497: dread f3 [0,4194304] 0 2024-03-18T14:43:20.915 INFO:tasks.workunit.client.0.smithi087.stdout:5/695: unlink d13/f37 0 2024-03-18T14:43:20.915 INFO:tasks.workunit.client.0.smithi087.stdout:4/628: unlink d2/db/c23 0 2024-03-18T14:43:20.916 INFO:tasks.workunit.client.1.smithi129.stdout:4/437: symlink d0/d19/d46/d3e/d21/d32/l86 0 2024-03-18T14:43:20.917 INFO:tasks.workunit.client.1.smithi129.stdout:1/479: chown d1/d2/d28/d65/d19/d52/f90 462 1 2024-03-18T14:43:20.917 INFO:tasks.workunit.client.0.smithi087.stdout:6/634: creat d3/d7/d25/d62/d7c/d46/fd3 x:0 0 0 2024-03-18T14:43:20.918 INFO:tasks.workunit.client.1.smithi129.stdout:6/512: unlink d3/d5/l33 0 2024-03-18T14:43:20.918 INFO:tasks.workunit.client.0.smithi087.stdout:6/635: write d3/d7/f43 [273272,112290] 0 2024-03-18T14:43:20.920 INFO:tasks.workunit.client.1.smithi129.stdout:2/501: mknod d7/d1c/d62/c97 0 2024-03-18T14:43:20.922 INFO:tasks.workunit.client.0.smithi087.stdout:0/650: dread d0/d2/d4/d19/d62/f70 [0,4194304] 0 2024-03-18T14:43:20.922 INFO:tasks.workunit.client.0.smithi087.stdout:3/705: symlink d0/de/d30/d8e/lc9 0 2024-03-18T14:43:20.923 INFO:tasks.workunit.client.1.smithi129.stdout:8/530: dwrite d9/d11/d55/d68/d72/fac [0,4194304] 0 2024-03-18T14:43:20.926 INFO:tasks.workunit.client.1.smithi129.stdout:9/464: rename d0/db/d90/d3e/f5c to d0/db/d1f/d20/d26/d19/d29/d36/f92 0 2024-03-18T14:43:20.926 INFO:tasks.workunit.client.1.smithi129.stdout:3/456: link d4/d11/c40 d4/d11/d1d/d50/d90/c99 0 2024-03-18T14:43:20.927 INFO:tasks.workunit.client.1.smithi129.stdout:0/526: unlink d0/d14/d3a/d4a/d7a/f8f 0 2024-03-18T14:43:20.928 INFO:tasks.workunit.client.1.smithi129.stdout:9/465: chown d0/db/d1f/d4c/d57/f63 11173236 1 2024-03-18T14:43:20.929 INFO:tasks.workunit.client.1.smithi129.stdout:4/438: write d0/f13 [857227,58319] 0 2024-03-18T14:43:20.930 INFO:tasks.workunit.client.1.smithi129.stdout:9/466: chown d0/db/d1f/d20/d25/f3d 9633 1 2024-03-18T14:43:20.932 INFO:tasks.workunit.client.0.smithi087.stdout:2/676: rmdir d2/d4/d22/d24/d65/d7f/dd9 0 2024-03-18T14:43:20.932 INFO:tasks.workunit.client.1.smithi129.stdout:3/457: dwrite d4/d38/f1c [0,4194304] 0 2024-03-18T14:43:20.933 INFO:tasks.workunit.client.1.smithi129.stdout:3/458: chown d4/d38/f1c 130664 1 2024-03-18T14:43:20.933 INFO:tasks.workunit.client.0.smithi087.stdout:7/773: dread d1/d6/d29/d2f/d68/d65/fb1 [0,4194304] 0 2024-03-18T14:43:20.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/502: mknod d7/d1f/d20/c98 0 2024-03-18T14:43:20.933 INFO:tasks.workunit.client.1.smithi129.stdout:8/531: symlink d9/d11/d1a/d79/lad 0 2024-03-18T14:43:20.934 INFO:tasks.workunit.client.0.smithi087.stdout:6/636: mknod d3/d7/cd4 0 2024-03-18T14:43:20.936 INFO:tasks.workunit.client.0.smithi087.stdout:0/651: unlink d0/d2/d4/d19/d62/c6f 0 2024-03-18T14:43:20.937 INFO:tasks.workunit.client.1.smithi129.stdout:1/480: rename d1/d2/d28/d65/f5a to d1/d35/d7a/f94 0 2024-03-18T14:43:20.937 INFO:tasks.workunit.client.0.smithi087.stdout:4/629: fsync d2/d13/d28/f70 0 2024-03-18T14:43:20.937 INFO:tasks.workunit.client.1.smithi129.stdout:1/481: fsync d1/f9 0 2024-03-18T14:43:20.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/630: write d2/db/d24/f2b [667721,118308] 0 2024-03-18T14:43:20.939 INFO:tasks.workunit.client.0.smithi087.stdout:8/655: sync 2024-03-18T14:43:20.945 INFO:tasks.workunit.client.1.smithi129.stdout:5/466: write d0/df/f37 [32615,74902] 0 2024-03-18T14:43:20.945 INFO:tasks.workunit.client.0.smithi087.stdout:7/774: rename d1/d6/da/d42/f7b to d1/d97/f107 0 2024-03-18T14:43:20.946 INFO:tasks.workunit.client.0.smithi087.stdout:7/775: dread - d1/d6/da/d42/d67/fe5 zero size 2024-03-18T14:43:20.947 INFO:tasks.workunit.client.0.smithi087.stdout:6/637: mknod d3/d7/d25/d62/d7c/da0/d96/d97/cd5 0 2024-03-18T14:43:20.947 INFO:tasks.workunit.client.1.smithi129.stdout:4/439: mknod d0/d19/d46/d3e/d21/d4d/c87 0 2024-03-18T14:43:20.948 INFO:tasks.workunit.client.1.smithi129.stdout:9/467: mkdir d0/db/d90/d70/d93 0 2024-03-18T14:43:20.949 INFO:tasks.workunit.client.0.smithi087.stdout:3/706: unlink d0/d3/d4f/d6e/ca4 0 2024-03-18T14:43:20.950 INFO:tasks.workunit.client.0.smithi087.stdout:3/707: readlink d0/d3/l9 0 2024-03-18T14:43:20.951 INFO:tasks.workunit.client.1.smithi129.stdout:6/513: sync 2024-03-18T14:43:20.952 INFO:tasks.workunit.client.0.smithi087.stdout:0/652: creat d0/d2/d6b/fe5 x:0 0 0 2024-03-18T14:43:20.954 INFO:tasks.workunit.client.0.smithi087.stdout:9/756: dread db/d18/f81 [0,4194304] 0 2024-03-18T14:43:20.954 INFO:tasks.workunit.client.1.smithi129.stdout:0/527: dread d0/d14/f2d [0,4194304] 0 2024-03-18T14:43:20.955 INFO:tasks.workunit.client.0.smithi087.stdout:9/757: dread - db/d18/d1c/d69/fbe zero size 2024-03-18T14:43:20.956 INFO:tasks.workunit.client.1.smithi129.stdout:8/532: rmdir d9/d11/d1a/d32/d3a/d5d 39 2024-03-18T14:43:20.960 INFO:tasks.workunit.client.0.smithi087.stdout:2/677: rename d2/d4 to d2/ddd 0 2024-03-18T14:43:20.960 INFO:tasks.workunit.client.1.smithi129.stdout:3/459: rename d4/l79 to d4/d11/d1d/d50/d90/l9a 0 2024-03-18T14:43:20.960 INFO:tasks.workunit.client.0.smithi087.stdout:2/678: chown d2/ddd/d22/d2c/d3a/d76/d81/f86 59948 1 2024-03-18T14:43:20.961 INFO:tasks.workunit.client.1.smithi129.stdout:2/503: dread d7/d1f/d20/d2d/f35 [0,4194304] 0 2024-03-18T14:43:20.961 INFO:tasks.workunit.client.0.smithi087.stdout:8/656: mkdir d1/d6/d2f/d44/d45/d72/d7f/ddc 0 2024-03-18T14:43:20.963 INFO:tasks.workunit.client.0.smithi087.stdout:8/657: read d1/f6d [874747,20872] 0 2024-03-18T14:43:20.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/482: unlink d1/f5f 0 2024-03-18T14:43:20.967 INFO:tasks.workunit.client.0.smithi087.stdout:9/758: creat db/d18/d1e/d28/d7c/ffc x:0 0 0 2024-03-18T14:43:20.968 INFO:tasks.workunit.client.0.smithi087.stdout:0/653: dread d0/d1a/d34/d3d/fc9 [0,4194304] 0 2024-03-18T14:43:20.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/440: unlink d0/d19/f75 0 2024-03-18T14:43:20.969 INFO:tasks.workunit.client.0.smithi087.stdout:9/759: write db/d31/f42 [985110,66889] 0 2024-03-18T14:43:20.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/441: stat d0/d19/d46/d3e/d21/c73 0 2024-03-18T14:43:20.971 INFO:tasks.workunit.client.1.smithi129.stdout:7/498: getdents d4/d2d/d2e/d79 0 2024-03-18T14:43:20.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/679: rename d2/d44/d72/c7d to d2/ddd/d22/d2c/cde 0 2024-03-18T14:43:20.974 INFO:tasks.workunit.client.0.smithi087.stdout:6/638: link d3/d7/d25/d62/d7c/d29/d22/d61/fc3 d3/d7/d25/d62/d7c/da0/dbe/fd6 0 2024-03-18T14:43:20.975 INFO:tasks.workunit.client.0.smithi087.stdout:3/708: symlink d0/d3/d10/da5/lca 0 2024-03-18T14:43:20.975 INFO:tasks.workunit.client.0.smithi087.stdout:6/639: readlink d3/d7/d25/d62/d7c/d29/d22/la4 0 2024-03-18T14:43:20.976 INFO:tasks.workunit.client.0.smithi087.stdout:7/776: dread d1/d6/da/f9f [0,4194304] 0 2024-03-18T14:43:20.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/709: chown d0/d3/d10/fc1 0 1 2024-03-18T14:43:20.976 INFO:tasks.workunit.client.0.smithi087.stdout:6/640: chown d3/d7/d25/c2f 4207 1 2024-03-18T14:43:20.977 INFO:tasks.workunit.client.0.smithi087.stdout:3/710: write d0/fb6 [2704311,118606] 0 2024-03-18T14:43:20.979 INFO:tasks.workunit.client.1.smithi129.stdout:0/528: creat d0/d14/d28/d63/fa2 x:0 0 0 2024-03-18T14:43:20.979 INFO:tasks.workunit.client.1.smithi129.stdout:8/533: fsync d9/d11/d18/f24 0 2024-03-18T14:43:20.979 INFO:tasks.workunit.client.0.smithi087.stdout:1/712: sync 2024-03-18T14:43:20.981 INFO:tasks.workunit.client.0.smithi087.stdout:7/777: dwrite d1/d6/da/d42/d67/fe4 [0,4194304] 0 2024-03-18T14:43:20.981 INFO:tasks.workunit.client.0.smithi087.stdout:4/631: truncate d2/db/d67/fbc 3538128 0 2024-03-18T14:43:20.982 INFO:tasks.workunit.client.1.smithi129.stdout:3/460: write d4/d11/d1d/f7f [574390,44013] 0 2024-03-18T14:43:20.982 INFO:tasks.workunit.client.0.smithi087.stdout:7/778: chown d1/d6/d29/d2f/d68/l5c 3 1 2024-03-18T14:43:20.983 INFO:tasks.workunit.client.1.smithi129.stdout:8/534: dread d9/d11/d1a/d32/d41/d4d/f5b [0,4194304] 0 2024-03-18T14:43:20.983 INFO:tasks.workunit.client.1.smithi129.stdout:2/504: symlink d7/d1f/d20/d2b/d41/l99 0 2024-03-18T14:43:20.983 INFO:tasks.workunit.client.0.smithi087.stdout:5/696: symlink d13/d1b/d27/d8f/dab/lec 0 2024-03-18T14:43:20.986 INFO:tasks.workunit.client.0.smithi087.stdout:2/680: readlink d2/ddd/d22/la4 0 2024-03-18T14:43:20.987 INFO:tasks.workunit.client.1.smithi129.stdout:7/499: rmdir d4/d2d/d2e/d42 39 2024-03-18T14:43:20.989 INFO:tasks.workunit.client.1.smithi129.stdout:6/514: rename d3/d30/l90 to d3/d30/la3 0 2024-03-18T14:43:20.989 INFO:tasks.workunit.client.1.smithi129.stdout:5/467: truncate d0/d32/d34/f4d 1070108 0 2024-03-18T14:43:20.990 INFO:tasks.workunit.client.0.smithi087.stdout:2/681: dwrite d2/ddd/d22/d2c/d3a/d76/d81/f82 [0,4194304] 0 2024-03-18T14:43:20.990 INFO:tasks.workunit.client.0.smithi087.stdout:6/641: symlink d3/d7/dbd/ld7 0 2024-03-18T14:43:20.990 INFO:tasks.workunit.client.1.smithi129.stdout:0/529: creat d0/d6c/fa3 x:0 0 0 2024-03-18T14:43:20.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/461: mkdir d4/d38/d9b 0 2024-03-18T14:43:20.991 INFO:tasks.workunit.client.1.smithi129.stdout:0/530: write d0/d23/d29/f38 [1933404,93973] 0 2024-03-18T14:43:20.992 INFO:tasks.workunit.client.1.smithi129.stdout:1/483: sync 2024-03-18T14:43:20.992 INFO:tasks.workunit.client.1.smithi129.stdout:8/535: mknod d9/d11/d53/d5f/cae 0 2024-03-18T14:43:20.992 INFO:tasks.workunit.client.0.smithi087.stdout:0/654: mkdir d0/d1a/de6 0 2024-03-18T14:43:20.993 INFO:tasks.workunit.client.1.smithi129.stdout:0/531: chown d0/d14/d28/d63/d8d/f97 27 1 2024-03-18T14:43:20.994 INFO:tasks.workunit.client.0.smithi087.stdout:1/713: creat d3/d1d/d1e/d20/d7a/db4/fdf x:0 0 0 2024-03-18T14:43:20.995 INFO:tasks.workunit.client.0.smithi087.stdout:4/632: creat d2/db/d24/d30/d7b/d7f/da5/fd4 x:0 0 0 2024-03-18T14:43:20.995 INFO:tasks.workunit.client.1.smithi129.stdout:4/442: write d0/d19/d46/d3e/d21/d4d/d70/f23 [2137146,56089] 0 2024-03-18T14:43:20.996 INFO:tasks.workunit.client.1.smithi129.stdout:3/462: dread d4/dd/d1f/f4b [0,4194304] 0 2024-03-18T14:43:20.997 INFO:tasks.workunit.client.1.smithi129.stdout:9/468: rmdir d0/db/d1f/d20/d26/d19/d29/d60 0 2024-03-18T14:43:20.998 INFO:tasks.workunit.client.1.smithi129.stdout:0/532: dwrite d0/d14/d3a/d4a/f70 [4194304,4194304] 0 2024-03-18T14:43:20.999 INFO:tasks.workunit.client.0.smithi087.stdout:9/760: rename db/d12/ld9 to db/d12/lfd 0 2024-03-18T14:43:21.003 INFO:tasks.workunit.client.1.smithi129.stdout:9/469: dwrite d0/db/d1f/d20/d26/d19/d29/d36/f47 [4194304,4194304] 0 2024-03-18T14:43:21.003 INFO:tasks.workunit.client.0.smithi087.stdout:3/711: link d0/d3/f7 d0/de/d30/d46/dc3/fcb 0 2024-03-18T14:43:21.004 INFO:tasks.workunit.client.1.smithi129.stdout:7/500: rename d4/f6 to d4/d7/d54/f9a 0 2024-03-18T14:43:21.006 INFO:tasks.workunit.client.1.smithi129.stdout:1/484: unlink d1/d2/d70/l79 0 2024-03-18T14:43:21.009 INFO:tasks.workunit.client.0.smithi087.stdout:8/658: truncate d1/d6/d9/f8c 93569 0 2024-03-18T14:43:21.013 INFO:tasks.workunit.client.1.smithi129.stdout:3/463: mknod d4/d11/d34/d4c/c9c 0 2024-03-18T14:43:21.014 INFO:tasks.workunit.client.1.smithi129.stdout:0/533: mknod d0/d14/d28/d63/ca4 0 2024-03-18T14:43:21.014 INFO:tasks.workunit.client.1.smithi129.stdout:9/470: readlink d0/db/d6f/l8a 0 2024-03-18T14:43:21.014 INFO:tasks.workunit.client.0.smithi087.stdout:4/633: mknod d2/db/d84/d87/cd5 0 2024-03-18T14:43:21.015 INFO:tasks.workunit.client.1.smithi129.stdout:5/468: dread d0/f11 [0,4194304] 0 2024-03-18T14:43:21.015 INFO:tasks.workunit.client.1.smithi129.stdout:9/471: read d0/db/d1f/d20/d25/f61 [33890,42507] 0 2024-03-18T14:43:21.016 INFO:tasks.workunit.client.0.smithi087.stdout:9/761: rmdir db/d18/d1e/d28/d76/db7 39 2024-03-18T14:43:21.016 INFO:tasks.workunit.client.1.smithi129.stdout:1/485: rmdir d1/d2/d28/d65/d7c/d7d 39 2024-03-18T14:43:21.017 INFO:tasks.workunit.client.0.smithi087.stdout:2/682: dread d2/ddd/f19 [0,4194304] 0 2024-03-18T14:43:21.017 INFO:tasks.workunit.client.0.smithi087.stdout:7/779: dwrite d1/d6/da/f50 [0,4194304] 0 2024-03-18T14:43:21.018 INFO:tasks.workunit.client.0.smithi087.stdout:3/712: rename d0/de/d30/c4c to d0/d3/d4f/d6e/dc8/ccc 0 2024-03-18T14:43:21.018 INFO:tasks.workunit.client.1.smithi129.stdout:6/515: sync 2024-03-18T14:43:21.019 INFO:tasks.workunit.client.1.smithi129.stdout:0/534: mkdir d0/d23/d35/d50/da5 0 2024-03-18T14:43:21.021 INFO:tasks.workunit.client.0.smithi087.stdout:8/659: creat d1/d6/d9/fdd x:0 0 0 2024-03-18T14:43:21.029 INFO:tasks.workunit.client.1.smithi129.stdout:5/469: mknod d0/dc/d18/d2b/d71/c87 0 2024-03-18T14:43:21.029 INFO:tasks.workunit.client.0.smithi087.stdout:6/642: creat d3/d7/d25/d62/d7c/d29/fd8 x:0 0 0 2024-03-18T14:43:21.030 INFO:tasks.workunit.client.1.smithi129.stdout:2/505: dwrite d7/d1f/d20/d2d/f3e [0,4194304] 0 2024-03-18T14:43:21.031 INFO:tasks.workunit.client.1.smithi129.stdout:2/506: write d7/f58 [308667,18734] 0 2024-03-18T14:43:21.031 INFO:tasks.workunit.client.1.smithi129.stdout:1/486: creat d1/d2/d70/d87/d8c/f95 x:0 0 0 2024-03-18T14:43:21.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/443: creat d0/f88 x:0 0 0 2024-03-18T14:43:21.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/516: creat d3/d30/de/d49/fa4 x:0 0 0 2024-03-18T14:43:21.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/517: read - d3/d30/f87 zero size 2024-03-18T14:43:21.035 INFO:tasks.workunit.client.1.smithi129.stdout:0/535: symlink d0/d14/d28/d63/la6 0 2024-03-18T14:43:21.037 INFO:tasks.workunit.client.0.smithi087.stdout:0/655: creat d0/d2/fe7 x:0 0 0 2024-03-18T14:43:21.037 INFO:tasks.workunit.client.0.smithi087.stdout:8/660: rmdir d1/d6/d2f/d44/d45/d72/db6 39 2024-03-18T14:43:21.038 INFO:tasks.workunit.client.1.smithi129.stdout:7/501: dread d4/d7/d8/f22 [0,4194304] 0 2024-03-18T14:43:21.038 INFO:tasks.workunit.client.1.smithi129.stdout:5/470: mknod d0/dc/d1a/c88 0 2024-03-18T14:43:21.039 INFO:tasks.workunit.client.1.smithi129.stdout:7/502: fdatasync d4/d2d/d2e/f30 0 2024-03-18T14:43:21.039 INFO:tasks.workunit.client.0.smithi087.stdout:5/697: link d13/d1b/d27/d28/c9f d13/d1b/d27/ced 0 2024-03-18T14:43:21.040 INFO:tasks.workunit.client.0.smithi087.stdout:4/634: creat d2/db/d24/d30/d7b/d7f/da5/dae/fd6 x:0 0 0 2024-03-18T14:43:21.040 INFO:tasks.workunit.client.1.smithi129.stdout:3/464: creat d4/d11/d34/d3c/f9d x:0 0 0 2024-03-18T14:43:21.040 INFO:tasks.workunit.client.1.smithi129.stdout:1/487: dread d1/d35/d7a/f94 [0,4194304] 0 2024-03-18T14:43:21.041 INFO:tasks.workunit.client.0.smithi087.stdout:5/698: chown d13/d1b/f3a 1 1 2024-03-18T14:43:21.041 INFO:tasks.workunit.client.0.smithi087.stdout:8/661: chown d1/d6/d2f/d44/d45/d72 1556 1 2024-03-18T14:43:21.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/656: chown d0/d2/d4/d19/d62/f70 131050 1 2024-03-18T14:43:21.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/507: truncate d7/d1f/d20/d36/f6d 2048712 0 2024-03-18T14:43:21.042 INFO:tasks.workunit.client.1.smithi129.stdout:3/465: dread - d4/d11/d34/d53/f80 zero size 2024-03-18T14:43:21.042 INFO:tasks.workunit.client.0.smithi087.stdout:0/657: dread - d0/d2/d4/d19/d24/fc2 zero size 2024-03-18T14:43:21.045 INFO:tasks.workunit.client.1.smithi129.stdout:3/466: dread d4/d11/d1d/d50/d91/d93/f2b [0,4194304] 0 2024-03-18T14:43:21.046 INFO:tasks.workunit.client.0.smithi087.stdout:5/699: dwrite d13/d1b/d70/fb0 [0,4194304] 0 2024-03-18T14:43:21.048 INFO:tasks.workunit.client.1.smithi129.stdout:8/536: truncate d9/d11/d1a/d32/d3a/d5d/f62 1466121 0 2024-03-18T14:43:21.051 INFO:tasks.workunit.client.1.smithi129.stdout:7/503: readlink d4/d7/d8/d3b/l3c 0 2024-03-18T14:43:21.054 INFO:tasks.workunit.client.1.smithi129.stdout:2/508: symlink d7/d1f/d20/d2a/d6b/l9a 0 2024-03-18T14:43:21.055 INFO:tasks.workunit.client.1.smithi129.stdout:2/509: write d7/d1f/d20/d2a/f7a [2017,25400] 0 2024-03-18T14:43:21.055 INFO:tasks.workunit.client.1.smithi129.stdout:3/467: creat d4/d11/d1d/f9e x:0 0 0 2024-03-18T14:43:21.057 INFO:tasks.workunit.client.1.smithi129.stdout:9/472: getdents d0/db/d1f/d20/d26/d19 0 2024-03-18T14:43:21.058 INFO:tasks.workunit.client.1.smithi129.stdout:7/504: creat d4/d8c/f9b x:0 0 0 2024-03-18T14:43:21.059 INFO:tasks.workunit.client.1.smithi129.stdout:4/444: mkdir d0/d3c/d6c/d89 0 2024-03-18T14:43:21.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/488: mkdir d1/d2/d28/d65/d19/d96 0 2024-03-18T14:43:21.061 INFO:tasks.workunit.client.1.smithi129.stdout:1/489: readlink d1/d2/d70/d87/d8c/l8d 0 2024-03-18T14:43:21.063 INFO:tasks.workunit.client.1.smithi129.stdout:2/510: write d7/d1c/f26 [1123929,35890] 0 2024-03-18T14:43:21.065 INFO:tasks.workunit.client.1.smithi129.stdout:2/511: fsync d7/d1c/f26 0 2024-03-18T14:43:21.066 INFO:tasks.workunit.client.1.smithi129.stdout:2/512: chown d7/d3f 6957896 1 2024-03-18T14:43:21.066 INFO:tasks.workunit.client.1.smithi129.stdout:0/536: link d0/f72 d0/d14/d28/d63/d8d/fa7 0 2024-03-18T14:43:21.067 INFO:tasks.workunit.client.1.smithi129.stdout:0/537: dread - d0/d23/d6b/f8b zero size 2024-03-18T14:43:21.067 INFO:tasks.workunit.client.1.smithi129.stdout:8/537: creat d9/d11/d1a/d32/d3a/faf x:0 0 0 2024-03-18T14:43:21.070 INFO:tasks.workunit.client.1.smithi129.stdout:1/490: dwrite d1/d35/f3f [0,4194304] 0 2024-03-18T14:43:21.071 INFO:tasks.workunit.client.1.smithi129.stdout:0/538: creat d0/d14/d28/fa8 x:0 0 0 2024-03-18T14:43:21.075 INFO:tasks.workunit.client.1.smithi129.stdout:1/491: dread d1/d2/f3b [0,4194304] 0 2024-03-18T14:43:21.076 INFO:tasks.workunit.client.1.smithi129.stdout:9/473: truncate d0/db/d53/f58 3961044 0 2024-03-18T14:43:21.076 INFO:tasks.workunit.client.1.smithi129.stdout:7/505: write d4/f4f [849701,57782] 0 2024-03-18T14:43:21.077 INFO:tasks.workunit.client.1.smithi129.stdout:7/506: fdatasync d4/d7/d38/d49/f62 0 2024-03-18T14:43:21.077 INFO:tasks.workunit.client.1.smithi129.stdout:8/538: symlink d9/d11/d1a/d14/d60/lb0 0 2024-03-18T14:43:21.078 INFO:tasks.workunit.client.1.smithi129.stdout:3/468: link d4/d11/d34/d4c/c58 d4/dd/d1f/d5f/d31/d78/c9f 0 2024-03-18T14:43:21.081 INFO:tasks.workunit.client.1.smithi129.stdout:2/513: creat d7/d1f/d20/d2b/d41/d65/d83/f9b x:0 0 0 2024-03-18T14:43:21.082 INFO:tasks.workunit.client.1.smithi129.stdout:0/539: creat d0/d23/d71/fa9 x:0 0 0 2024-03-18T14:43:21.082 INFO:tasks.workunit.client.1.smithi129.stdout:9/474: symlink d0/db/d2e/l94 0 2024-03-18T14:43:21.082 INFO:tasks.workunit.client.1.smithi129.stdout:8/539: creat d9/d11/d55/d6a/fb1 x:0 0 0 2024-03-18T14:43:21.083 INFO:tasks.workunit.client.1.smithi129.stdout:2/514: chown d7/d1f/d34/f1a 4978 1 2024-03-18T14:43:21.084 INFO:tasks.workunit.client.0.smithi087.stdout:7/780: dread d1/d6/d29/d2f/d6b/f7c [0,4194304] 0 2024-03-18T14:43:21.085 INFO:tasks.workunit.client.1.smithi129.stdout:0/540: readlink d0/d23/l4b 0 2024-03-18T14:43:21.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/658: dwrite d0/d2/d4/f4c [0,4194304] 0 2024-03-18T14:43:21.085 INFO:tasks.workunit.client.0.smithi087.stdout:9/762: write f3 [860086,28529] 0 2024-03-18T14:43:21.089 INFO:tasks.workunit.client.1.smithi129.stdout:6/518: sync 2024-03-18T14:43:21.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/714: dread d3/d1d/d1e/f37 [0,4194304] 0 2024-03-18T14:43:21.089 INFO:tasks.workunit.client.0.smithi087.stdout:4/635: truncate d2/fb6 1824141 0 2024-03-18T14:43:21.089 INFO:tasks.workunit.client.0.smithi087.stdout:1/715: fdatasync d3/f93 0 2024-03-18T14:43:21.090 INFO:tasks.workunit.client.0.smithi087.stdout:0/659: stat d0/d2/d4/f8d 0 2024-03-18T14:43:21.092 INFO:tasks.workunit.client.0.smithi087.stdout:9/763: creat db/d18/df1/ffe x:0 0 0 2024-03-18T14:43:21.093 INFO:tasks.workunit.client.1.smithi129.stdout:3/469: truncate d4/d38/f47 176103 0 2024-03-18T14:43:21.093 INFO:tasks.workunit.client.0.smithi087.stdout:3/713: dwrite d0/d72/d85/f90 [0,4194304] 0 2024-03-18T14:43:21.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/643: dwrite d3/f5e [0,4194304] 0 2024-03-18T14:43:21.096 INFO:tasks.workunit.client.0.smithi087.stdout:7/781: rename d1/d6/d29/d2f/d68/l5c to d1/d6/da/d59/dfe/l108 0 2024-03-18T14:43:21.096 INFO:tasks.workunit.client.1.smithi129.stdout:0/541: rename d0/d6c/fa3 to d0/d23/d71/faa 0 2024-03-18T14:43:21.097 INFO:tasks.workunit.client.1.smithi129.stdout:7/507: link d4/l2c d4/d7/l9c 0 2024-03-18T14:43:21.097 INFO:tasks.workunit.client.0.smithi087.stdout:1/716: mknod d3/d1d/d1e/d43/da3/ce0 0 2024-03-18T14:43:21.097 INFO:tasks.workunit.client.1.smithi129.stdout:7/508: write d4/d2d/f18 [1874736,88527] 0 2024-03-18T14:43:21.099 INFO:tasks.workunit.client.0.smithi087.stdout:9/764: mknod db/d18/d1e/d7e/dc7/cff 0 2024-03-18T14:43:21.100 INFO:tasks.workunit.client.0.smithi087.stdout:9/765: write db/d18/f81 [1847222,31581] 0 2024-03-18T14:43:21.100 INFO:tasks.workunit.client.0.smithi087.stdout:3/714: write d0/d1c/f2b [1386519,39782] 0 2024-03-18T14:43:21.100 INFO:tasks.workunit.client.0.smithi087.stdout:5/700: dread ff [4194304,4194304] 0 2024-03-18T14:43:21.101 INFO:tasks.workunit.client.0.smithi087.stdout:2/683: sync 2024-03-18T14:43:21.102 INFO:tasks.workunit.client.0.smithi087.stdout:3/715: stat d0/de/d30/dc5 0 2024-03-18T14:43:21.103 INFO:tasks.workunit.client.0.smithi087.stdout:0/660: rename d0/d2/d4/d19/d62 to d0/d2/d4/de8 0 2024-03-18T14:43:21.105 INFO:tasks.workunit.client.1.smithi129.stdout:0/542: creat d0/d23/d35/d50/fab x:0 0 0 2024-03-18T14:43:21.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/543: stat d0/d23/d6b/f9a 0 2024-03-18T14:43:21.106 INFO:tasks.workunit.client.1.smithi129.stdout:7/509: mknod d4/d7/d8/c9d 0 2024-03-18T14:43:21.106 INFO:tasks.workunit.client.1.smithi129.stdout:0/544: readlink d0/d23/d35/d3b/l2f 0 2024-03-18T14:43:21.107 INFO:tasks.workunit.client.0.smithi087.stdout:7/782: mkdir d1/d6/d29/d2f/d68/d65/d60/d109 0 2024-03-18T14:43:21.107 INFO:tasks.workunit.client.1.smithi129.stdout:8/540: creat d9/d11/d1a/fb2 x:0 0 0 2024-03-18T14:43:21.108 INFO:tasks.workunit.client.1.smithi129.stdout:0/545: write d0/d14/f20 [3402894,124625] 0 2024-03-18T14:43:21.108 INFO:tasks.workunit.client.0.smithi087.stdout:5/701: symlink d13/d1b/d27/d28/d9a/lee 0 2024-03-18T14:43:21.108 INFO:tasks.workunit.client.0.smithi087.stdout:7/783: read d1/d8e/d95/dae/ff0 [754620,82197] 0 2024-03-18T14:43:21.110 INFO:tasks.workunit.client.0.smithi087.stdout:5/702: dread - d13/d1b/d27/d35/d3b/fc4 zero size 2024-03-18T14:43:21.110 INFO:tasks.workunit.client.1.smithi129.stdout:8/541: dread - d9/d11/d1a/d32/d41/d4d/d96/fa0 zero size 2024-03-18T14:43:21.110 INFO:tasks.workunit.client.1.smithi129.stdout:6/519: dwrite d3/d5/d46/f55 [0,4194304] 0 2024-03-18T14:43:21.111 INFO:tasks.workunit.client.1.smithi129.stdout:9/475: getdents d0/d15 0 2024-03-18T14:43:21.112 INFO:tasks.workunit.client.1.smithi129.stdout:6/520: chown d3/d30/d44 0 1 2024-03-18T14:43:21.113 INFO:tasks.workunit.client.1.smithi129.stdout:6/521: readlink d3/d6/l1d 0 2024-03-18T14:43:21.114 INFO:tasks.workunit.client.1.smithi129.stdout:7/510: mkdir d4/d8c/d9e 0 2024-03-18T14:43:21.115 INFO:tasks.workunit.client.0.smithi087.stdout:2/684: dread d2/f32 [0,4194304] 0 2024-03-18T14:43:21.115 INFO:tasks.workunit.client.1.smithi129.stdout:2/515: write d7/d1f/d20/d2b/d41/f6f [518774,126177] 0 2024-03-18T14:43:21.115 INFO:tasks.workunit.client.1.smithi129.stdout:0/546: dwrite d0/d14/d3a/d4a/f70 [8388608,4194304] 0 2024-03-18T14:43:21.116 INFO:tasks.workunit.client.0.smithi087.stdout:0/661: symlink d0/d2/d4/d19/d24/d5d/d78/le9 0 2024-03-18T14:43:21.117 INFO:tasks.workunit.client.1.smithi129.stdout:4/445: sync 2024-03-18T14:43:21.117 INFO:tasks.workunit.client.1.smithi129.stdout:5/471: sync 2024-03-18T14:43:21.118 INFO:tasks.workunit.client.0.smithi087.stdout:6/644: mkdir d3/d7/d25/d62/d7c/d29/dce/dd9 0 2024-03-18T14:43:21.118 INFO:tasks.workunit.client.1.smithi129.stdout:5/472: rename d0 to d0/d32/d3a/d52/d69/d89 22 2024-03-18T14:43:21.118 INFO:tasks.workunit.client.0.smithi087.stdout:6/645: chown d3/d7/dbd/ld7 24571819 1 2024-03-18T14:43:21.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/703: rmdir d13/d1b/d30 39 2024-03-18T14:43:21.124 INFO:tasks.workunit.client.0.smithi087.stdout:5/704: dread - d13/d1b/fa9 zero size 2024-03-18T14:43:21.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/685: write d2/ddd/f59 [2072787,35618] 0 2024-03-18T14:43:21.125 INFO:tasks.workunit.client.1.smithi129.stdout:3/470: getdents d4 0 2024-03-18T14:43:21.125 INFO:tasks.workunit.client.1.smithi129.stdout:8/542: mkdir d9/d11/db3 0 2024-03-18T14:43:21.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/476: creat d0/db/d1f/d20/d26/d19/d8d/f95 x:0 0 0 2024-03-18T14:43:21.127 INFO:tasks.workunit.client.1.smithi129.stdout:3/471: read d4/dd/f3d [2953472,61369] 0 2024-03-18T14:43:21.127 INFO:tasks.workunit.client.1.smithi129.stdout:5/473: mkdir d0/d32/d3a/d52/d69/d8a 0 2024-03-18T14:43:21.127 INFO:tasks.workunit.client.0.smithi087.stdout:8/662: sync 2024-03-18T14:43:21.130 INFO:tasks.workunit.client.0.smithi087.stdout:4/636: dread d2/db/de/fa3 [0,4194304] 0 2024-03-18T14:43:21.130 INFO:tasks.workunit.client.1.smithi129.stdout:8/543: mkdir d9/d11/d1a/d32/d3a/d70/db4 0 2024-03-18T14:43:21.130 INFO:tasks.workunit.client.0.smithi087.stdout:6/646: creat d3/d7/d25/d62/d7c/d46/dc9/fda x:0 0 0 2024-03-18T14:43:21.131 INFO:tasks.workunit.client.0.smithi087.stdout:2/686: rmdir d2/ddd/d22/d2c/d3a/d40/d4a/d97 39 2024-03-18T14:43:21.131 INFO:tasks.workunit.client.1.smithi129.stdout:9/477: symlink d0/db/d1f/d4c/l96 0 2024-03-18T14:43:21.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/474: chown d0/d32/d34/f4d 3305460 1 2024-03-18T14:43:21.133 INFO:tasks.workunit.client.1.smithi129.stdout:3/472: symlink d4/d11/d34/d3c/d95/la0 0 2024-03-18T14:43:21.133 INFO:tasks.workunit.client.0.smithi087.stdout:1/717: rename d3/d1d/d1f/d34/c9c to d3/d1d/d1e/d43/d50/ce1 0 2024-03-18T14:43:21.134 INFO:tasks.workunit.client.0.smithi087.stdout:0/662: truncate d0/d2/d4/f65 226870 0 2024-03-18T14:43:21.136 INFO:tasks.workunit.client.1.smithi129.stdout:4/446: rename d0/d19/d46/d2e/l49 to d0/d19/d46/d3e/d21/d4d/d58/d61/l8a 0 2024-03-18T14:43:21.136 INFO:tasks.workunit.client.1.smithi129.stdout:2/516: truncate d7/d1f/d20/d2b/f51 893527 0 2024-03-18T14:43:21.140 INFO:tasks.workunit.client.0.smithi087.stdout:6/647: mkdir d3/dcd/ddb 0 2024-03-18T14:43:21.141 INFO:tasks.workunit.client.1.smithi129.stdout:0/547: getdents d0/d14/d28/d63 0 2024-03-18T14:43:21.142 INFO:tasks.workunit.client.1.smithi129.stdout:7/511: dwrite d4/d2d/d3a/f78 [0,4194304] 0 2024-03-18T14:43:21.142 INFO:tasks.workunit.client.1.smithi129.stdout:9/478: mkdir d0/db/d11/d97 0 2024-03-18T14:43:21.143 INFO:tasks.workunit.client.1.smithi129.stdout:7/512: chown d4/d2d/d2e/d45/f5e 581430 1 2024-03-18T14:43:21.143 INFO:tasks.workunit.client.1.smithi129.stdout:9/479: dread - d0/db/d2e/f7c zero size 2024-03-18T14:43:21.144 INFO:tasks.workunit.client.1.smithi129.stdout:7/513: chown d4/d2d/d2e/f41 285174 1 2024-03-18T14:43:21.144 INFO:tasks.workunit.client.0.smithi087.stdout:5/705: rename d13/d1b/d27/d8f/lcf to d13/d1b/d7e/lef 0 2024-03-18T14:43:21.144 INFO:tasks.workunit.client.1.smithi129.stdout:5/475: creat d0/dc/d1a/d61/f8b x:0 0 0 2024-03-18T14:43:21.145 INFO:tasks.workunit.client.1.smithi129.stdout:9/480: write d0/db/d1f/d20/d26/d19/d8d/f95 [474552,27460] 0 2024-03-18T14:43:21.145 INFO:tasks.workunit.client.0.smithi087.stdout:5/706: write d13/d1b/d27/d8f/dab/fd5 [974432,99996] 0 2024-03-18T14:43:21.147 INFO:tasks.workunit.client.1.smithi129.stdout:4/447: truncate d0/d19/f54 729249 0 2024-03-18T14:43:21.147 INFO:tasks.workunit.client.0.smithi087.stdout:9/766: truncate db/d18/d1c/d69/fea 2882583 0 2024-03-18T14:43:21.147 INFO:tasks.workunit.client.0.smithi087.stdout:9/767: fsync db/d18/d1e/db4/fc4 0 2024-03-18T14:43:21.148 INFO:tasks.workunit.client.1.smithi129.stdout:2/517: symlink d7/d1f/d20/l9c 0 2024-03-18T14:43:21.149 INFO:tasks.workunit.client.0.smithi087.stdout:2/687: creat d2/d44/d72/fdf x:0 0 0 2024-03-18T14:43:21.150 INFO:tasks.workunit.client.0.smithi087.stdout:2/688: chown d2/ddd/d22/d2c/c60 16280 1 2024-03-18T14:43:21.151 INFO:tasks.workunit.client.1.smithi129.stdout:4/448: dwrite d0/f80 [0,4194304] 0 2024-03-18T14:43:21.151 INFO:tasks.workunit.client.0.smithi087.stdout:8/663: dread d1/d6/d9/d5d/f64 [0,4194304] 0 2024-03-18T14:43:21.152 INFO:tasks.workunit.client.1.smithi129.stdout:4/449: chown d0/d19/d46/c2f 4801752 1 2024-03-18T14:43:21.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/768: dwrite db/d18/d1e/ff4 [0,4194304] 0 2024-03-18T14:43:21.153 INFO:tasks.workunit.client.0.smithi087.stdout:9/769: readlink db/d18/d3a/l78 0 2024-03-18T14:43:21.154 INFO:tasks.workunit.client.1.smithi129.stdout:3/473: write d4/dd/d1f/f26 [928131,106786] 0 2024-03-18T14:43:21.154 INFO:tasks.workunit.client.0.smithi087.stdout:0/663: rename d0/d2/d4/d19/d24 to d0/d2/d4/de8/dad/dea 0 2024-03-18T14:43:21.155 INFO:tasks.workunit.client.0.smithi087.stdout:4/637: getdents d2/db/d24/d30/d7b/d7f/da5/db4 0 2024-03-18T14:43:21.155 INFO:tasks.workunit.client.1.smithi129.stdout:0/548: truncate d0/d14/f49 18361 0 2024-03-18T14:43:21.156 INFO:tasks.workunit.client.0.smithi087.stdout:0/664: readlink d0/d1a/d7b/d2a/d85/l77 0 2024-03-18T14:43:21.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/716: truncate d0/d3/df/d42/fa6 912280 0 2024-03-18T14:43:21.158 INFO:tasks.workunit.client.1.smithi129.stdout:7/514: creat d4/d2d/d2e/d79/f9f x:0 0 0 2024-03-18T14:43:21.158 INFO:tasks.workunit.client.0.smithi087.stdout:7/784: truncate d1/d6/d16/dc/f26 6607400 0 2024-03-18T14:43:21.158 INFO:tasks.workunit.client.1.smithi129.stdout:7/515: write d4/d7/f31 [2290025,47342] 0 2024-03-18T14:43:21.159 INFO:tasks.workunit.client.1.smithi129.stdout:5/476: rmdir d0/d32/d34 39 2024-03-18T14:43:21.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/481: creat d0/db/d1f/d20/d26/d19/d8d/f98 x:0 0 0 2024-03-18T14:43:21.164 INFO:tasks.workunit.client.0.smithi087.stdout:1/718: dwrite d3/f19 [0,4194304] 0 2024-03-18T14:43:21.165 INFO:tasks.workunit.client.1.smithi129.stdout:3/474: creat d4/fa1 x:0 0 0 2024-03-18T14:43:21.166 INFO:tasks.workunit.client.0.smithi087.stdout:6/648: rename d3/d7/cd4 to d3/d7/d25/d62/d7c/da0/dbe/db6/cdc 0 2024-03-18T14:43:21.168 INFO:tasks.workunit.client.0.smithi087.stdout:7/785: mkdir d1/d8e/d95/d10a 0 2024-03-18T14:43:21.168 INFO:tasks.workunit.client.1.smithi129.stdout:1/492: sync 2024-03-18T14:43:21.169 INFO:tasks.workunit.client.0.smithi087.stdout:2/689: fsync d2/ddd/d22/d24/d65/f6b 0 2024-03-18T14:43:21.170 INFO:tasks.workunit.client.0.smithi087.stdout:2/690: chown d2/ddd/d22/d24/d65 15972 1 2024-03-18T14:43:21.170 INFO:tasks.workunit.client.0.smithi087.stdout:2/691: stat d2/ddd/d22/d24/db2 0 2024-03-18T14:43:21.170 INFO:tasks.workunit.client.0.smithi087.stdout:2/692: fsync d2/ddd/d22/d2c/f30 0 2024-03-18T14:43:21.171 INFO:tasks.workunit.client.0.smithi087.stdout:1/719: creat d3/d1d/d1e/d43/d50/d72/dc8/fe2 x:0 0 0 2024-03-18T14:43:21.171 INFO:tasks.workunit.client.0.smithi087.stdout:1/720: fdatasync d3/d1d/d45/fae 0 2024-03-18T14:43:21.173 INFO:tasks.workunit.client.0.smithi087.stdout:6/649: creat d3/d7/d25/d8e/fdd x:0 0 0 2024-03-18T14:43:21.174 INFO:tasks.workunit.client.1.smithi129.stdout:8/544: write d9/d11/d18/f34 [2445781,93510] 0 2024-03-18T14:43:21.176 INFO:tasks.workunit.client.0.smithi087.stdout:8/664: dread d1/d6/d2f/d44/d45/d71/daa/fb8 [0,4194304] 0 2024-03-18T14:43:21.179 INFO:tasks.workunit.client.0.smithi087.stdout:2/693: unlink d2/f85 0 2024-03-18T14:43:21.179 INFO:tasks.workunit.client.1.smithi129.stdout:8/545: dwrite d9/d11/d1a/d32/d3a/f9d [4194304,4194304] 0 2024-03-18T14:43:21.179 INFO:tasks.workunit.client.1.smithi129.stdout:7/516: mknod d4/d7/ca0 0 2024-03-18T14:43:21.180 INFO:tasks.workunit.client.1.smithi129.stdout:5/477: dread d0/dc/d22/f39 [0,4194304] 0 2024-03-18T14:43:21.180 INFO:tasks.workunit.client.1.smithi129.stdout:9/482: mkdir d0/db/d11/d97/d99 0 2024-03-18T14:43:21.182 INFO:tasks.workunit.client.1.smithi129.stdout:5/478: write d0/dc/f77 [81792,110549] 0 2024-03-18T14:43:21.184 INFO:tasks.workunit.client.1.smithi129.stdout:7/517: dwrite d4/d2d/d2e/d45/f55 [0,4194304] 0 2024-03-18T14:43:21.185 INFO:tasks.workunit.client.1.smithi129.stdout:6/522: sync 2024-03-18T14:43:21.186 INFO:tasks.workunit.client.1.smithi129.stdout:6/523: fsync d3/d30/df/d28/f8c 0 2024-03-18T14:43:21.187 INFO:tasks.workunit.client.0.smithi087.stdout:1/721: dread d3/d1d/d1f/f91 [0,4194304] 0 2024-03-18T14:43:21.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/483: creat d0/db/d1f/d20/d25/d8e/f9a x:0 0 0 2024-03-18T14:43:21.192 INFO:tasks.workunit.client.0.smithi087.stdout:9/770: rename db/c25 to db/d18/d51/c100 0 2024-03-18T14:43:21.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/665: dread d0/f6c [0,4194304] 0 2024-03-18T14:43:21.193 INFO:tasks.workunit.client.1.smithi129.stdout:9/484: creat d0/db/d1f/d20/d26/d19/f9b x:0 0 0 2024-03-18T14:43:21.193 INFO:tasks.workunit.client.0.smithi087.stdout:6/650: mkdir d3/d7/d25/d62/d7c/da0/dbe/db6/dde 0 2024-03-18T14:43:21.195 INFO:tasks.workunit.client.0.smithi087.stdout:6/651: stat d3/d7/d25/d62/d7c/d29/c6e 0 2024-03-18T14:43:21.196 INFO:tasks.workunit.client.0.smithi087.stdout:9/771: dwrite db/f10 [0,4194304] 0 2024-03-18T14:43:21.197 INFO:tasks.workunit.client.1.smithi129.stdout:1/493: truncate d1/d2/d28/f51 730067 0 2024-03-18T14:43:21.199 INFO:tasks.workunit.client.1.smithi129.stdout:3/475: dwrite d4/d11/d34/d53/d87/f85 [0,4194304] 0 2024-03-18T14:43:21.199 INFO:tasks.workunit.client.0.smithi087.stdout:6/652: dwrite d3/d7/f2e [4194304,4194304] 0 2024-03-18T14:43:21.200 INFO:tasks.workunit.client.1.smithi129.stdout:9/485: symlink d0/d15/l9c 0 2024-03-18T14:43:21.203 INFO:tasks.workunit.client.1.smithi129.stdout:4/450: dwrite d0/d19/d46/d3e/f76 [0,4194304] 0 2024-03-18T14:43:21.203 INFO:tasks.workunit.client.1.smithi129.stdout:3/476: dread - d4/d11/d1d/d36/f8a zero size 2024-03-18T14:43:21.203 INFO:tasks.workunit.client.1.smithi129.stdout:1/494: readlink d1/d2/d28/l4f 0 2024-03-18T14:43:21.205 INFO:tasks.workunit.client.1.smithi129.stdout:0/549: dwrite d0/d23/d6b/f89 [0,4194304] 0 2024-03-18T14:43:21.205 INFO:tasks.workunit.client.1.smithi129.stdout:7/518: dwrite d4/d2d/d2e/d42/d58/f67 [0,4194304] 0 2024-03-18T14:43:21.206 INFO:tasks.workunit.client.1.smithi129.stdout:7/519: chown d4/d2d/f3e 28171 1 2024-03-18T14:43:21.207 INFO:tasks.workunit.client.1.smithi129.stdout:9/486: mkdir d0/db/d2e/d9d 0 2024-03-18T14:43:21.208 INFO:tasks.workunit.client.0.smithi087.stdout:1/722: chown d3/d1d/d1e/l51 58925 1 2024-03-18T14:43:21.209 INFO:tasks.workunit.client.1.smithi129.stdout:4/451: creat d0/d19/d46/d3e/d33/f8b x:0 0 0 2024-03-18T14:43:21.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/723: dwrite d3/d1d/d1e/d43/d50/f58 [0,4194304] 0 2024-03-18T14:43:21.212 INFO:tasks.workunit.client.0.smithi087.stdout:4/638: rename d2/db/d24/d30/d56/l64 to d2/db/d24/d30/d7b/d7f/da5/db4/db7/ld7 0 2024-03-18T14:43:21.213 INFO:tasks.workunit.client.0.smithi087.stdout:5/707: write d13/f23 [707718,14198] 0 2024-03-18T14:43:21.213 INFO:tasks.workunit.client.1.smithi129.stdout:4/452: read d0/d19/d46/d3e/f42 [3391223,64839] 0 2024-03-18T14:43:21.214 INFO:tasks.workunit.client.1.smithi129.stdout:4/453: chown d0/d19/d46/d3e/d21/d4d/d58/d61 3454 1 2024-03-18T14:43:21.216 INFO:tasks.workunit.client.0.smithi087.stdout:6/653: read d3/d7/d25/f7b [3286369,120273] 0 2024-03-18T14:43:21.217 INFO:tasks.workunit.client.0.smithi087.stdout:3/717: dwrite d0/d3/d4f/f6f [0,4194304] 0 2024-03-18T14:43:21.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/654: dread - d3/d7/d25/d62/d7c/da0/dbe/db6/fa5 zero size 2024-03-18T14:43:21.220 INFO:tasks.workunit.client.1.smithi129.stdout:7/520: rename d4/d2d/d3a/c44 to d4/d2d/d2e/d45/ca1 0 2024-03-18T14:43:21.220 INFO:tasks.workunit.client.1.smithi129.stdout:1/495: rmdir d1/d2/d28/d65/d7c/d7d/d80 39 2024-03-18T14:43:21.221 INFO:tasks.workunit.client.1.smithi129.stdout:3/477: creat d4/d11/d1d/d50/d91/d97/fa2 x:0 0 0 2024-03-18T14:43:21.222 INFO:tasks.workunit.client.1.smithi129.stdout:7/521: chown d4/d7/d8/c9d 2414 1 2024-03-18T14:43:21.222 INFO:tasks.workunit.client.0.smithi087.stdout:6/655: dwrite d3/d7/d25/d62/d7c/d46/dc9/fda [0,4194304] 0 2024-03-18T14:43:21.222 INFO:tasks.workunit.client.1.smithi129.stdout:7/522: readlink d4/d2d/d2e/d42/l8e 0 2024-03-18T14:43:21.223 INFO:tasks.workunit.client.1.smithi129.stdout:7/523: chown d4/d2d/d2e/d45/f4c 40299 1 2024-03-18T14:43:21.223 INFO:tasks.workunit.client.0.smithi087.stdout:2/694: mkdir d2/d44/d72/de0 0 2024-03-18T14:43:21.224 INFO:tasks.workunit.client.1.smithi129.stdout:4/454: creat d0/d19/d5d/f8c x:0 0 0 2024-03-18T14:43:21.225 INFO:tasks.workunit.client.0.smithi087.stdout:2/695: write d2/ddd/d22/d2c/f30 [2541989,24447] 0 2024-03-18T14:43:21.227 INFO:tasks.workunit.client.0.smithi087.stdout:7/786: dwrite d1/d6/f2a [0,4194304] 0 2024-03-18T14:43:21.234 INFO:tasks.workunit.client.0.smithi087.stdout:0/666: mknod d0/d1a/ceb 0 2024-03-18T14:43:21.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/656: creat d3/d7/d25/d62/d7c/d46/dc9/fdf x:0 0 0 2024-03-18T14:43:21.236 INFO:tasks.workunit.client.0.smithi087.stdout:2/696: mkdir d2/ddd/d5a/de1 0 2024-03-18T14:43:21.237 INFO:tasks.workunit.client.1.smithi129.stdout:2/518: dread d7/d1f/d34/f82 [4194304,4194304] 0 2024-03-18T14:43:21.239 INFO:tasks.workunit.client.0.smithi087.stdout:1/724: mknod d3/d1d/d1f/ce3 0 2024-03-18T14:43:21.240 INFO:tasks.workunit.client.1.smithi129.stdout:3/478: mkdir d4/d38/da3 0 2024-03-18T14:43:21.241 INFO:tasks.workunit.client.1.smithi129.stdout:1/496: symlink d1/d2/d28/d65/d19/d96/l97 0 2024-03-18T14:43:21.242 INFO:tasks.workunit.client.0.smithi087.stdout:7/787: dread d1/fdb [0,4194304] 0 2024-03-18T14:43:21.242 INFO:tasks.workunit.client.1.smithi129.stdout:9/487: getdents d0/db/d6f 0 2024-03-18T14:43:21.244 INFO:tasks.workunit.client.0.smithi087.stdout:6/657: mknod d3/d7/d25/d62/d7c/d46/ce0 0 2024-03-18T14:43:21.245 INFO:tasks.workunit.client.1.smithi129.stdout:3/479: chown d4/d11/d1d/d50/d91/d93/l56 1786 1 2024-03-18T14:43:21.246 INFO:tasks.workunit.client.0.smithi087.stdout:5/708: truncate d13/d1b/d27/d35/d3b/fd2 755976 0 2024-03-18T14:43:21.247 INFO:tasks.workunit.client.1.smithi129.stdout:9/488: dwrite d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:21.248 INFO:tasks.workunit.client.1.smithi129.stdout:6/524: sync 2024-03-18T14:43:21.249 INFO:tasks.workunit.client.0.smithi087.stdout:4/639: creat d2/db/fd8 x:0 0 0 2024-03-18T14:43:21.250 INFO:tasks.workunit.client.0.smithi087.stdout:5/709: dwrite d13/d1b/d27/d35/f39 [0,4194304] 0 2024-03-18T14:43:21.251 INFO:tasks.workunit.client.1.smithi129.stdout:6/525: write d3/d30/de/f83 [373803,102560] 0 2024-03-18T14:43:21.252 INFO:tasks.workunit.client.1.smithi129.stdout:0/550: write d0/d23/f3f [2026344,48970] 0 2024-03-18T14:43:21.252 INFO:tasks.workunit.client.1.smithi129.stdout:3/480: dwrite d4/d11/d1d/f9e [0,4194304] 0 2024-03-18T14:43:21.253 INFO:tasks.workunit.client.0.smithi087.stdout:7/788: unlink d1/d6/d29/d2f/dac/lb8 0 2024-03-18T14:43:21.253 INFO:tasks.workunit.client.1.smithi129.stdout:0/551: dread - d0/d23/d71/f7f zero size 2024-03-18T14:43:21.253 INFO:tasks.workunit.client.1.smithi129.stdout:0/552: chown d0/d23/f3f 1 1 2024-03-18T14:43:21.255 INFO:tasks.workunit.client.0.smithi087.stdout:8/665: write d1/d6/d2f/d44/d45/d72/d7f/d83/f96 [1390599,79161] 0 2024-03-18T14:43:21.256 INFO:tasks.workunit.client.0.smithi087.stdout:0/667: symlink d0/d2/d4/d27/dc3/dd2/lec 0 2024-03-18T14:43:21.258 INFO:tasks.workunit.client.1.smithi129.stdout:0/553: dwrite d0/d23/d71/fa9 [0,4194304] 0 2024-03-18T14:43:21.258 INFO:tasks.workunit.client.0.smithi087.stdout:6/658: creat d3/d7/d25/d62/d7c/d29/dce/fe1 x:0 0 0 2024-03-18T14:43:21.260 INFO:tasks.workunit.client.1.smithi129.stdout:2/519: rename d7/d1c/f5b to d7/d1c/f9d 0 2024-03-18T14:43:21.261 INFO:tasks.workunit.client.0.smithi087.stdout:3/718: rename d0/d1c/l5c to d0/d3/lcd 0 2024-03-18T14:43:21.263 INFO:tasks.workunit.client.1.smithi129.stdout:7/524: dread d4/d2d/d2e/d42/f7c [0,4194304] 0 2024-03-18T14:43:21.265 INFO:tasks.workunit.client.0.smithi087.stdout:7/789: mknod d1/d97/c10b 0 2024-03-18T14:43:21.267 INFO:tasks.workunit.client.0.smithi087.stdout:3/719: dwrite d0/d3/d7a/f8f [0,4194304] 0 2024-03-18T14:43:21.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/710: dwrite d13/f17 [0,4194304] 0 2024-03-18T14:43:21.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/725: dread d3/d1d/d1f/d63/f6d [0,4194304] 0 2024-03-18T14:43:21.268 INFO:tasks.workunit.client.0.smithi087.stdout:8/666: unlink d1/d6/d14/c3e 0 2024-03-18T14:43:21.268 INFO:tasks.workunit.client.1.smithi129.stdout:6/526: symlink d3/d30/de/d65/la5 0 2024-03-18T14:43:21.269 INFO:tasks.workunit.client.0.smithi087.stdout:3/720: dread - d0/d1c/d25/fc6 zero size 2024-03-18T14:43:21.270 INFO:tasks.workunit.client.0.smithi087.stdout:1/726: chown d3/d1d/d1f/cb6 12205 1 2024-03-18T14:43:21.270 INFO:tasks.workunit.client.0.smithi087.stdout:3/721: stat d0/d3/d4f/fc4 0 2024-03-18T14:43:21.273 INFO:tasks.workunit.client.0.smithi087.stdout:0/668: unlink d0/d1a/d80/f92 0 2024-03-18T14:43:21.273 INFO:tasks.workunit.client.0.smithi087.stdout:5/711: dwrite d13/d1b/f2b [0,4194304] 0 2024-03-18T14:43:21.274 INFO:tasks.workunit.client.1.smithi129.stdout:1/497: link d1/d2/d28/d65/d19/f37 d1/d2/d28/d65/f98 0 2024-03-18T14:43:21.274 INFO:tasks.workunit.client.0.smithi087.stdout:5/712: dread - d13/d1b/d27/d35/d3b/fc4 zero size 2024-03-18T14:43:21.274 INFO:tasks.workunit.client.1.smithi129.stdout:1/498: readlink d1/d2/l31 0 2024-03-18T14:43:21.275 INFO:tasks.workunit.client.1.smithi129.stdout:8/546: dread d9/d11/d1a/f30 [0,4194304] 0 2024-03-18T14:43:21.275 INFO:tasks.workunit.client.0.smithi087.stdout:5/713: write d13/d1b/fa9 [756140,82426] 0 2024-03-18T14:43:21.275 INFO:tasks.workunit.client.0.smithi087.stdout:6/659: unlink d3/d7/d25/d62/d7c/d29/d22/d61/fc3 0 2024-03-18T14:43:21.276 INFO:tasks.workunit.client.1.smithi129.stdout:1/499: write d1/d2/d28/f7f [4016862,97448] 0 2024-03-18T14:43:21.276 INFO:tasks.workunit.client.1.smithi129.stdout:8/547: write d9/f4c [760118,81419] 0 2024-03-18T14:43:21.277 INFO:tasks.workunit.client.0.smithi087.stdout:4/640: mkdir d2/dc2/dce/dd9 0 2024-03-18T14:43:21.277 INFO:tasks.workunit.client.0.smithi087.stdout:6/660: chown d3/d7/d25/d62/d7c/d29/d22/d23/c7f 858474895 1 2024-03-18T14:43:21.277 INFO:tasks.workunit.client.1.smithi129.stdout:3/481: write d4/f21 [171310,23419] 0 2024-03-18T14:43:21.278 INFO:tasks.workunit.client.0.smithi087.stdout:6/661: chown d3/d7/d25/d62/d7c/d29/d22/d75/l93 921320 1 2024-03-18T14:43:21.282 INFO:tasks.workunit.client.1.smithi129.stdout:1/500: write d1/d2/d28/f68 [2310692,75743] 0 2024-03-18T14:43:21.283 INFO:tasks.workunit.client.0.smithi087.stdout:7/790: symlink d1/d97/l10c 0 2024-03-18T14:43:21.284 INFO:tasks.workunit.client.0.smithi087.stdout:8/667: chown d1/d6/d2f/d44/d45/d71/ld7 24496449 1 2024-03-18T14:43:21.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/669: creat d0/d1a/d7b/d26/fed x:0 0 0 2024-03-18T14:43:21.289 INFO:tasks.workunit.client.1.smithi129.stdout:8/548: rename d9/d11/d18/c3c to d9/d11/d53/d5f/cb5 0 2024-03-18T14:43:21.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/670: chown d0/d1a/d8c/fa4 132637057 1 2024-03-18T14:43:21.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/671: fsync d0/d1a/d34/d3d/fd9 0 2024-03-18T14:43:21.289 INFO:tasks.workunit.client.1.smithi129.stdout:5/479: dread d0/f14 [0,4194304] 0 2024-03-18T14:43:21.290 INFO:tasks.workunit.client.0.smithi087.stdout:5/714: mkdir d13/d1b/d27/d28/d9a/df0 0 2024-03-18T14:43:21.290 INFO:tasks.workunit.client.1.smithi129.stdout:5/480: chown d0/f4 17577 1 2024-03-18T14:43:21.291 INFO:tasks.workunit.client.1.smithi129.stdout:5/481: stat d0/df/f44 0 2024-03-18T14:43:21.291 INFO:tasks.workunit.client.1.smithi129.stdout:5/482: write d0/dc/d22/f1e [4720666,71726] 0 2024-03-18T14:43:21.292 INFO:tasks.workunit.client.0.smithi087.stdout:3/722: read d0/de/d30/f5d [941419,3991] 0 2024-03-18T14:43:21.292 INFO:tasks.workunit.client.0.smithi087.stdout:7/791: mkdir d1/d6/da/d59/dbe/d10d 0 2024-03-18T14:43:21.293 INFO:tasks.workunit.client.1.smithi129.stdout:7/525: creat d4/d2d/d2e/d42/fa2 x:0 0 0 2024-03-18T14:43:21.293 INFO:tasks.workunit.client.1.smithi129.stdout:3/482: mkdir d4/dd/d1f/d5f/d8c/da4 0 2024-03-18T14:43:21.293 INFO:tasks.workunit.client.1.smithi129.stdout:7/526: chown d4/d7/c2b 166036 1 2024-03-18T14:43:21.294 INFO:tasks.workunit.client.0.smithi087.stdout:1/727: mkdir d3/de4 0 2024-03-18T14:43:21.295 INFO:tasks.workunit.client.0.smithi087.stdout:0/672: symlink d0/d2/d6b/d7c/lee 0 2024-03-18T14:43:21.295 INFO:tasks.workunit.client.1.smithi129.stdout:5/483: mkdir d0/dc/d18/d2b/d8c 0 2024-03-18T14:43:21.297 INFO:tasks.workunit.client.1.smithi129.stdout:7/527: creat d4/d2d/d3a/fa3 x:0 0 0 2024-03-18T14:43:21.297 INFO:tasks.workunit.client.0.smithi087.stdout:2/697: rename d2/ddd/d22/d2c/f95 to d2/ddd/d22/fe2 0 2024-03-18T14:43:21.297 INFO:tasks.workunit.client.1.smithi129.stdout:1/501: creat d1/d2/d28/d65/f99 x:0 0 0 2024-03-18T14:43:21.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/641: mkdir d2/db/d24/d30/d7b/dbe/dcf/dda 0 2024-03-18T14:43:21.298 INFO:tasks.workunit.client.0.smithi087.stdout:4/642: chown d2/db/de/f44 309 1 2024-03-18T14:43:21.298 INFO:tasks.workunit.client.0.smithi087.stdout:6/662: symlink d3/d7/d25/d62/d7c/le2 0 2024-03-18T14:43:21.299 INFO:tasks.workunit.client.1.smithi129.stdout:1/502: read d1/f60 [490119,108400] 0 2024-03-18T14:43:21.300 INFO:tasks.workunit.client.1.smithi129.stdout:2/520: dread d7/d1f/d20/d2b/d41/f5e [0,4194304] 0 2024-03-18T14:43:21.302 INFO:tasks.workunit.client.0.smithi087.stdout:1/728: truncate d3/d1d/d1e/f37 1035692 0 2024-03-18T14:43:21.304 INFO:tasks.workunit.client.1.smithi129.stdout:8/549: link d9/d11/d53/f80 d9/d11/d1a/d32/fb6 0 2024-03-18T14:43:21.304 INFO:tasks.workunit.client.0.smithi087.stdout:5/715: read d13/d1b/d70/fbe [44679,74196] 0 2024-03-18T14:43:21.304 INFO:tasks.workunit.client.0.smithi087.stdout:1/729: chown d3/d1d/d1e/d43/d50 0 1 2024-03-18T14:43:21.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/673: symlink d0/d2/d4/d27/dc3/dd2/lef 0 2024-03-18T14:43:21.306 INFO:tasks.workunit.client.0.smithi087.stdout:3/723: dwrite d0/d1c/f5b [0,4194304] 0 2024-03-18T14:43:21.306 INFO:tasks.workunit.client.1.smithi129.stdout:2/521: creat d7/d1f/d20/d36/f9e x:0 0 0 2024-03-18T14:43:21.307 INFO:tasks.workunit.client.0.smithi087.stdout:2/698: symlink d2/ddd/d5a/le3 0 2024-03-18T14:43:21.308 INFO:tasks.workunit.client.1.smithi129.stdout:4/455: dread d0/d9/d4c/f6d [0,4194304] 0 2024-03-18T14:43:21.309 INFO:tasks.workunit.client.1.smithi129.stdout:5/484: getdents d0/dc/d22 0 2024-03-18T14:43:21.309 INFO:tasks.workunit.client.1.smithi129.stdout:4/456: readlink d0/d9/d4c/l56 0 2024-03-18T14:43:21.311 INFO:tasks.workunit.client.1.smithi129.stdout:1/503: creat d1/d2/d28/d65/d7c/d7d/d80/f9a x:0 0 0 2024-03-18T14:43:21.311 INFO:tasks.workunit.client.1.smithi129.stdout:8/550: dread d9/d11/d1a/d32/d41/d4d/f5b [0,4194304] 0 2024-03-18T14:43:21.311 INFO:tasks.workunit.client.1.smithi129.stdout:4/457: chown d0/f80 82676893 1 2024-03-18T14:43:21.312 INFO:tasks.workunit.client.0.smithi087.stdout:9/772: dwrite db/d31/f66 [0,4194304] 0 2024-03-18T14:43:21.312 INFO:tasks.workunit.client.1.smithi129.stdout:7/528: getdents d4/d7/d54/d86 0 2024-03-18T14:43:21.315 INFO:tasks.workunit.client.0.smithi087.stdout:4/643: unlink d2/db/de/f44 0 2024-03-18T14:43:21.315 INFO:tasks.workunit.client.0.smithi087.stdout:6/663: creat d3/d7/d25/fe3 x:0 0 0 2024-03-18T14:43:21.316 INFO:tasks.workunit.client.0.smithi087.stdout:4/644: read - d2/db/d24/d30/d7b/d7f/fb9 zero size 2024-03-18T14:43:21.318 INFO:tasks.workunit.client.1.smithi129.stdout:4/458: creat d0/d3c/d6c/f8d x:0 0 0 2024-03-18T14:43:21.318 INFO:tasks.workunit.client.1.smithi129.stdout:8/551: mkdir d9/d11/d1a/d14/db7 0 2024-03-18T14:43:21.319 INFO:tasks.workunit.client.1.smithi129.stdout:8/552: fdatasync d9/d11/d1a/f77 0 2024-03-18T14:43:21.319 INFO:tasks.workunit.client.1.smithi129.stdout:2/522: dread d7/f1d [0,4194304] 0 2024-03-18T14:43:21.319 INFO:tasks.workunit.client.0.smithi087.stdout:7/792: link d1/d6/d29/d2f/d68/dbf/fe8 d1/d97/db9/f10e 0 2024-03-18T14:43:21.320 INFO:tasks.workunit.client.0.smithi087.stdout:7/793: readlink d1/d6/d16/da6/lb5 0 2024-03-18T14:43:21.321 INFO:tasks.workunit.client.1.smithi129.stdout:8/553: dread - d9/d11/d1a/d32/d41/d4d/f9b zero size 2024-03-18T14:43:21.321 INFO:tasks.workunit.client.0.smithi087.stdout:5/716: rmdir d13/d1b/d27/d8f 39 2024-03-18T14:43:21.321 INFO:tasks.workunit.client.0.smithi087.stdout:5/717: chown d13/d1b/d70/fbb 7 1 2024-03-18T14:43:21.321 INFO:tasks.workunit.client.1.smithi129.stdout:2/523: write d7/d1f/d20/d2b/d41/d65/d83/f9b [52222,62451] 0 2024-03-18T14:43:21.322 INFO:tasks.workunit.client.0.smithi087.stdout:1/730: symlink d3/d3c/db8/le5 0 2024-03-18T14:43:21.323 INFO:tasks.workunit.client.1.smithi129.stdout:4/459: dread d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:21.323 INFO:tasks.workunit.client.0.smithi087.stdout:3/724: mkdir d0/d3/d10/da5/dce 0 2024-03-18T14:43:21.325 INFO:tasks.workunit.client.0.smithi087.stdout:5/718: dwrite d13/f23 [0,4194304] 0 2024-03-18T14:43:21.325 INFO:tasks.workunit.client.1.smithi129.stdout:9/489: dread d0/f35 [0,4194304] 0 2024-03-18T14:43:21.326 INFO:tasks.workunit.client.0.smithi087.stdout:5/719: write d13/d1b/d7e/f8e [417105,28026] 0 2024-03-18T14:43:21.327 INFO:tasks.workunit.client.0.smithi087.stdout:5/720: readlink d13/d1b/d70/la5 0 2024-03-18T14:43:21.328 INFO:tasks.workunit.client.1.smithi129.stdout:8/554: dwrite d9/d11/d1a/d32/d3a/f49 [4194304,4194304] 0 2024-03-18T14:43:21.329 INFO:tasks.workunit.client.0.smithi087.stdout:0/674: creat d0/d2/d4/de8/dad/dea/d5d/d78/ff0 x:0 0 0 2024-03-18T14:43:21.332 INFO:tasks.workunit.client.1.smithi129.stdout:0/554: dwrite d0/d14/f2d [0,4194304] 0 2024-03-18T14:43:21.332 INFO:tasks.workunit.client.1.smithi129.stdout:6/527: truncate d3/d6/f9b 1101895 0 2024-03-18T14:43:21.335 INFO:tasks.workunit.client.1.smithi129.stdout:2/524: fsync d7/d1f/d20/d2b/d41/d65/d83/f9b 0 2024-03-18T14:43:21.338 INFO:tasks.workunit.client.1.smithi129.stdout:6/528: dwrite d3/d30/de/d6c/d9e/f9f [0,4194304] 0 2024-03-18T14:43:21.342 INFO:tasks.workunit.client.0.smithi087.stdout:9/773: write db/d31/f74 [5095829,116439] 0 2024-03-18T14:43:21.342 INFO:tasks.workunit.client.1.smithi129.stdout:1/504: dread d1/d2/d70/f74 [0,4194304] 0 2024-03-18T14:43:21.343 INFO:tasks.workunit.client.0.smithi087.stdout:8/668: getdents d1/d6/d14 0 2024-03-18T14:43:21.344 INFO:tasks.workunit.client.1.smithi129.stdout:8/555: creat d9/d11/d1a/d14/d60/fb8 x:0 0 0 2024-03-18T14:43:21.346 INFO:tasks.workunit.client.1.smithi129.stdout:0/555: mkdir d0/d14/d53/dac 0 2024-03-18T14:43:21.346 INFO:tasks.workunit.client.0.smithi087.stdout:8/669: dwrite d1/d6/d9/f61 [4194304,4194304] 0 2024-03-18T14:43:21.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/670: write d1/d6/d9/d5d/d87/fb0 [434976,124201] 0 2024-03-18T14:43:21.348 INFO:tasks.workunit.client.1.smithi129.stdout:2/525: dread d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:21.349 INFO:tasks.workunit.client.1.smithi129.stdout:9/490: link d0/f35 d0/db/d11/d97/f9e 0 2024-03-18T14:43:21.350 INFO:tasks.workunit.client.1.smithi129.stdout:4/460: dread d0/d19/d46/d3e/d21/f5c [0,4194304] 0 2024-03-18T14:43:21.351 INFO:tasks.workunit.client.1.smithi129.stdout:8/556: symlink d9/d11/d1a/d79/lb9 0 2024-03-18T14:43:21.352 INFO:tasks.workunit.client.0.smithi087.stdout:8/671: dwrite d1/d6/d9/f48 [0,4194304] 0 2024-03-18T14:43:21.352 INFO:tasks.workunit.client.1.smithi129.stdout:3/483: sync 2024-03-18T14:43:21.354 INFO:tasks.workunit.client.1.smithi129.stdout:9/491: dwrite d0/db/f43 [0,4194304] 0 2024-03-18T14:43:21.356 INFO:tasks.workunit.client.1.smithi129.stdout:1/505: read d1/d2/d28/d65/f98 [68731,70110] 0 2024-03-18T14:43:21.357 INFO:tasks.workunit.client.1.smithi129.stdout:1/506: readlink d1/d2/d28/d65/d19/l2c 0 2024-03-18T14:43:21.358 INFO:tasks.workunit.client.1.smithi129.stdout:1/507: write d1/d2/d28/d65/d19/d52/f89 [735362,94876] 0 2024-03-18T14:43:21.359 INFO:tasks.workunit.client.1.smithi129.stdout:1/508: fdatasync d1/d2/d70/d87/f8f 0 2024-03-18T14:43:21.359 INFO:tasks.workunit.client.0.smithi087.stdout:7/794: mkdir d1/d6/d29/d2f/d68/d10f 0 2024-03-18T14:43:21.359 INFO:tasks.workunit.client.1.smithi129.stdout:1/509: chown d1/f1d 24762 1 2024-03-18T14:43:21.361 INFO:tasks.workunit.client.1.smithi129.stdout:5/485: truncate d0/d32/f79 2919357 0 2024-03-18T14:43:21.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/486: dread d0/f11 [0,4194304] 0 2024-03-18T14:43:21.363 INFO:tasks.workunit.client.1.smithi129.stdout:7/529: truncate d4/d7/d8/f47 2734696 0 2024-03-18T14:43:21.370 INFO:tasks.workunit.client.0.smithi087.stdout:1/731: stat d3/d1d/d1e/d43/cad 0 2024-03-18T14:43:21.370 INFO:tasks.workunit.client.0.smithi087.stdout:9/774: mknod db/d18/d3a/c101 0 2024-03-18T14:43:21.372 INFO:tasks.workunit.client.0.smithi087.stdout:9/775: write db/d31/f8a [1548333,62457] 0 2024-03-18T14:43:21.372 INFO:tasks.workunit.client.0.smithi087.stdout:9/776: chown db/f4b 573797619 1 2024-03-18T14:43:21.373 INFO:tasks.workunit.client.1.smithi129.stdout:5/487: write d0/d32/d34/f64 [260853,100926] 0 2024-03-18T14:43:21.375 INFO:tasks.workunit.client.1.smithi129.stdout:6/529: rename d3/d38/f73 to d3/d5/fa6 0 2024-03-18T14:43:21.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/672: unlink d1/d6/d14/l49 0 2024-03-18T14:43:21.375 INFO:tasks.workunit.client.0.smithi087.stdout:4/645: truncate d2/d13/d28/f40 122064 0 2024-03-18T14:43:21.378 INFO:tasks.workunit.client.1.smithi129.stdout:7/530: truncate d4/d7/d38/d61/d6a/f92 902147 0 2024-03-18T14:43:21.378 INFO:tasks.workunit.client.0.smithi087.stdout:7/795: mkdir d1/d6/d29/d2f/d68/d65/d110 0 2024-03-18T14:43:21.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/646: dread d2/db/de/fa3 [0,4194304] 0 2024-03-18T14:43:21.383 INFO:tasks.workunit.client.0.smithi087.stdout:9/777: creat db/d18/d51/d7b/f102 x:0 0 0 2024-03-18T14:43:21.383 INFO:tasks.workunit.client.0.smithi087.stdout:6/664: truncate d3/d7/d25/d62/d7c/f9e 327715 0 2024-03-18T14:43:21.384 INFO:tasks.workunit.client.1.smithi129.stdout:3/484: symlink d4/la5 0 2024-03-18T14:43:21.384 INFO:tasks.workunit.client.0.smithi087.stdout:9/778: stat db/d18/d1c/d69/d6f/c88 0 2024-03-18T14:43:21.384 INFO:tasks.workunit.client.0.smithi087.stdout:6/665: chown d3/d7/d25/d62/d7c/d29/d22/d23/f69 0 1 2024-03-18T14:43:21.386 INFO:tasks.workunit.client.0.smithi087.stdout:0/675: rename d0/d1a/d7b/d26/d79/l42 to d0/d1a/d80/lf1 0 2024-03-18T14:43:21.389 INFO:tasks.workunit.client.1.smithi129.stdout:6/530: dread d3/d38/d57/f75 [0,4194304] 0 2024-03-18T14:43:21.390 INFO:tasks.workunit.client.0.smithi087.stdout:5/721: write d13/d1b/d70/f87 [283773,35722] 0 2024-03-18T14:43:21.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/647: read d2/f63 [973897,122478] 0 2024-03-18T14:43:21.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/556: truncate d0/d14/f49 4939031 0 2024-03-18T14:43:21.392 INFO:tasks.workunit.client.1.smithi129.stdout:0/557: stat d0/fd 0 2024-03-18T14:43:21.392 INFO:tasks.workunit.client.1.smithi129.stdout:9/492: dread d0/f10 [0,4194304] 0 2024-03-18T14:43:21.393 INFO:tasks.workunit.client.0.smithi087.stdout:3/725: dwrite d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:21.394 INFO:tasks.workunit.client.1.smithi129.stdout:5/488: creat d0/dc/d18/f8d x:0 0 0 2024-03-18T14:43:21.394 INFO:tasks.workunit.client.0.smithi087.stdout:3/726: write d0/de/f81 [3562427,110925] 0 2024-03-18T14:43:21.394 INFO:tasks.workunit.client.1.smithi129.stdout:1/510: dread d1/d2/d28/d65/d19/f61 [0,4194304] 0 2024-03-18T14:43:21.395 INFO:tasks.workunit.client.0.smithi087.stdout:8/673: symlink d1/d6/d2f/d44/d45/d72/d7f/ddc/lde 0 2024-03-18T14:43:21.396 INFO:tasks.workunit.client.1.smithi129.stdout:7/531: unlink d4/d7/d54/f6e 0 2024-03-18T14:43:21.399 INFO:tasks.workunit.client.0.smithi087.stdout:1/732: rename d3/d1d/d1e/d20/d7a/fbe to d3/d1d/d1e/d43/da3/fe6 0 2024-03-18T14:43:21.400 INFO:tasks.workunit.client.0.smithi087.stdout:1/733: write d3/d1d/d1f/d34/f35 [919792,120724] 0 2024-03-18T14:43:21.401 INFO:tasks.workunit.client.1.smithi129.stdout:8/557: rmdir d9/d11/d1a/d32/d3a/d70/db4 0 2024-03-18T14:43:21.402 INFO:tasks.workunit.client.0.smithi087.stdout:1/734: write d3/d1d/d1e/d20/fd5 [263341,126126] 0 2024-03-18T14:43:21.402 INFO:tasks.workunit.client.0.smithi087.stdout:0/676: unlink d0/d1a/d8c/fa1 0 2024-03-18T14:43:21.403 INFO:tasks.workunit.client.0.smithi087.stdout:2/699: link d2/ce d2/ddd/d22/d2c/d3a/d40/d4a/d97/ce4 0 2024-03-18T14:43:21.404 INFO:tasks.workunit.client.0.smithi087.stdout:6/666: dread d3/d7/d25/d62/d7c/f1e [0,4194304] 0 2024-03-18T14:43:21.405 INFO:tasks.workunit.client.0.smithi087.stdout:6/667: fsync d3/d7/f43 0 2024-03-18T14:43:21.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/558: unlink d0/d14/d28/d63/d8d/f97 0 2024-03-18T14:43:21.407 INFO:tasks.workunit.client.0.smithi087.stdout:3/727: unlink d0/d1c/f59 0 2024-03-18T14:43:21.407 INFO:tasks.workunit.client.0.smithi087.stdout:1/735: dwrite d3/d1d/d45/f59 [4194304,4194304] 0 2024-03-18T14:43:21.408 INFO:tasks.workunit.client.0.smithi087.stdout:1/736: fdatasync d3/d1d/d1e/d20/f56 0 2024-03-18T14:43:21.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/674: symlink d1/d6/d2f/d44/d45/d72/d7f/d83/ldf 0 2024-03-18T14:43:21.409 INFO:tasks.workunit.client.1.smithi129.stdout:1/511: creat d1/d2/d70/d87/f9b x:0 0 0 2024-03-18T14:43:21.410 INFO:tasks.workunit.client.1.smithi129.stdout:7/532: mknod d4/d7/d54/ca4 0 2024-03-18T14:43:21.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/722: rename d13/d1b/d27/d98/dc2/ldc to d13/d1b/d27/d35/da7/lf1 0 2024-03-18T14:43:21.413 INFO:tasks.workunit.client.0.smithi087.stdout:5/723: write d13/d1b/d27/d28/f78 [3166130,54725] 0 2024-03-18T14:43:21.414 INFO:tasks.workunit.client.0.smithi087.stdout:8/675: dwrite d1/d6/d9/d5d/f8f [0,4194304] 0 2024-03-18T14:43:21.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/676: chown d1/d6/f1e 271081 1 2024-03-18T14:43:21.415 INFO:tasks.workunit.client.0.smithi087.stdout:8/677: readlink d1/d6/d2f/l3b 0 2024-03-18T14:43:21.416 INFO:tasks.workunit.client.0.smithi087.stdout:8/678: chown d1/d6/d9/f7a 24933 1 2024-03-18T14:43:21.418 INFO:tasks.workunit.client.0.smithi087.stdout:7/796: dread d1/d6/d16/dc/f32 [0,4194304] 0 2024-03-18T14:43:21.425 INFO:tasks.workunit.client.1.smithi129.stdout:2/526: link d7/d1f/d20/d2b/f51 d7/d1f/d20/d72/f9f 0 2024-03-18T14:43:21.427 INFO:tasks.workunit.client.0.smithi087.stdout:4/648: dwrite d2/d13/d28/f42 [0,4194304] 0 2024-03-18T14:43:21.428 INFO:tasks.workunit.client.0.smithi087.stdout:9/779: dwrite db/d18/d1c/d69/fea [0,4194304] 0 2024-03-18T14:43:21.430 INFO:tasks.workunit.client.1.smithi129.stdout:0/559: creat d0/d23/d35/d3b/fad x:0 0 0 2024-03-18T14:43:21.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/679: dread d1/f32 [0,4194304] 0 2024-03-18T14:43:21.431 INFO:tasks.workunit.client.0.smithi087.stdout:3/728: mknod d0/d1c/d25/dba/ccf 0 2024-03-18T14:43:21.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/729: chown d0/d3/d10/c3d 8559 1 2024-03-18T14:43:21.432 INFO:tasks.workunit.client.0.smithi087.stdout:1/737: dread - d3/d1d/d1e/d43/d50/d72/f84 zero size 2024-03-18T14:43:21.432 INFO:tasks.workunit.client.1.smithi129.stdout:4/461: rename d0/d19/d46/d3e/d21/c73 to d0/d9/d40/c8e 0 2024-03-18T14:43:21.433 INFO:tasks.workunit.client.0.smithi087.stdout:3/730: chown d0/d3/d10/fbe 7 1 2024-03-18T14:43:21.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/668: rename d3/d7/d25/d62/fc5 to d3/d7/d25/d62/d7c/d29/d22/d75/d92/fe4 0 2024-03-18T14:43:21.436 INFO:tasks.workunit.client.1.smithi129.stdout:9/493: write d0/db/d90/d3e/f66 [17104,13639] 0 2024-03-18T14:43:21.438 INFO:tasks.workunit.client.0.smithi087.stdout:5/724: fdatasync f11 0 2024-03-18T14:43:21.440 INFO:tasks.workunit.client.0.smithi087.stdout:7/797: creat d1/d6/da/d59/f111 x:0 0 0 2024-03-18T14:43:21.442 INFO:tasks.workunit.client.1.smithi129.stdout:6/531: truncate d3/d6/d82/f91 753540 0 2024-03-18T14:43:21.442 INFO:tasks.workunit.client.0.smithi087.stdout:0/677: unlink d0/d1a/d34/c97 0 2024-03-18T14:43:21.443 INFO:tasks.workunit.client.1.smithi129.stdout:0/560: chown d0/c13 8 1 2024-03-18T14:43:21.443 INFO:tasks.workunit.client.0.smithi087.stdout:0/678: stat d0/d1a/fdf 0 2024-03-18T14:43:21.443 INFO:tasks.workunit.client.1.smithi129.stdout:1/512: sync 2024-03-18T14:43:21.443 INFO:tasks.workunit.client.1.smithi129.stdout:8/558: sync 2024-03-18T14:43:21.444 INFO:tasks.workunit.client.1.smithi129.stdout:4/462: creat d0/d19/d46/d3e/d21/d4d/d58/f8f x:0 0 0 2024-03-18T14:43:21.445 INFO:tasks.workunit.client.1.smithi129.stdout:7/533: mknod d4/d7/d38/d61/d68/d6b/d81/ca5 0 2024-03-18T14:43:21.446 INFO:tasks.workunit.client.0.smithi087.stdout:8/680: read d1/d6/d2f/d44/d45/d50/d58/f76 [286912,73636] 0 2024-03-18T14:43:21.448 INFO:tasks.workunit.client.1.smithi129.stdout:6/532: mknod d3/d30/de/d49/ca7 0 2024-03-18T14:43:21.450 INFO:tasks.workunit.client.1.smithi129.stdout:5/489: rename d0/dc/f73 to d0/d32/d3a/d52/d69/f8e 0 2024-03-18T14:43:21.450 INFO:tasks.workunit.client.0.smithi087.stdout:3/731: dwrite d0/d3/d4f/d6e/dc8/f82 [0,4194304] 0 2024-03-18T14:43:21.452 INFO:tasks.workunit.client.1.smithi129.stdout:3/485: truncate d4/d38/f1b 3155828 0 2024-03-18T14:43:21.453 INFO:tasks.workunit.client.0.smithi087.stdout:6/669: rmdir d3/d7/d25/d62/d7c/d29 39 2024-03-18T14:43:21.454 INFO:tasks.workunit.client.1.smithi129.stdout:1/513: creat d1/d35/f9c x:0 0 0 2024-03-18T14:43:21.455 INFO:tasks.workunit.client.0.smithi087.stdout:5/725: mknod d13/d1b/d70/da8/cf2 0 2024-03-18T14:43:21.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/679: dread - d0/d1a/d7b/d2a/d85/f87 zero size 2024-03-18T14:43:21.457 INFO:tasks.workunit.client.1.smithi129.stdout:2/527: truncate d7/f1d 736982 0 2024-03-18T14:43:21.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/680: chown d0/d2/d4/d19/f72 1457649 1 2024-03-18T14:43:21.458 INFO:tasks.workunit.client.0.smithi087.stdout:0/681: fsync d0/d2/f84 0 2024-03-18T14:43:21.459 INFO:tasks.workunit.client.1.smithi129.stdout:8/559: creat d9/d11/d1a/d79/fba x:0 0 0 2024-03-18T14:43:21.460 INFO:tasks.workunit.client.0.smithi087.stdout:2/700: truncate d2/ddd/d22/d2c/d3a/f51 2397874 0 2024-03-18T14:43:21.460 INFO:tasks.workunit.client.1.smithi129.stdout:7/534: unlink d4/d7/d54/d86/f8a 0 2024-03-18T14:43:21.460 INFO:tasks.workunit.client.0.smithi087.stdout:2/701: readlink d2/ddd/d22/d2c/d3a/d40/d4a/l53 0 2024-03-18T14:43:21.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/702: write d2/f43 [2179294,21131] 0 2024-03-18T14:43:21.463 INFO:tasks.workunit.client.1.smithi129.stdout:6/533: mknod d3/d5/d46/ca8 0 2024-03-18T14:43:21.465 INFO:tasks.workunit.client.0.smithi087.stdout:7/798: dread d1/d6/da/d59/f5d [0,4194304] 0 2024-03-18T14:43:21.468 INFO:tasks.workunit.client.0.smithi087.stdout:4/649: write d2/fb6 [2327365,24391] 0 2024-03-18T14:43:21.468 INFO:tasks.workunit.client.0.smithi087.stdout:4/650: write d2/db/d84/fca [911105,110483] 0 2024-03-18T14:43:21.470 INFO:tasks.workunit.client.1.smithi129.stdout:1/514: creat d1/d2/d70/f9d x:0 0 0 2024-03-18T14:43:21.474 INFO:tasks.workunit.client.0.smithi087.stdout:2/703: mkdir d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5 0 2024-03-18T14:43:21.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/780: creat db/f103 x:0 0 0 2024-03-18T14:43:21.475 INFO:tasks.workunit.client.0.smithi087.stdout:9/781: readlink db/le 0 2024-03-18T14:43:21.476 INFO:tasks.workunit.client.1.smithi129.stdout:9/494: dwrite d0/db/d53/f58 [0,4194304] 0 2024-03-18T14:43:21.477 INFO:tasks.workunit.client.1.smithi129.stdout:6/534: mkdir d3/d30/de/da9 0 2024-03-18T14:43:21.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/490: creat d0/d32/d3a/d52/d69/d8a/f8f x:0 0 0 2024-03-18T14:43:21.479 INFO:tasks.workunit.client.0.smithi087.stdout:1/738: creat d3/fe7 x:0 0 0 2024-03-18T14:43:21.481 INFO:tasks.workunit.client.1.smithi129.stdout:4/463: truncate d0/d19/d46/d3e/d21/f72 1075475 0 2024-03-18T14:43:21.482 INFO:tasks.workunit.client.1.smithi129.stdout:0/561: truncate d0/d23/d6b/f9a 902818 0 2024-03-18T14:43:21.482 INFO:tasks.workunit.client.1.smithi129.stdout:2/528: dread d7/fa [4194304,4194304] 0 2024-03-18T14:43:21.484 INFO:tasks.workunit.client.1.smithi129.stdout:3/486: truncate d4/dd/f32 190956 0 2024-03-18T14:43:21.484 INFO:tasks.workunit.client.1.smithi129.stdout:3/487: dread - d4/dd/d1f/d2f/f69 zero size 2024-03-18T14:43:21.486 INFO:tasks.workunit.client.1.smithi129.stdout:5/491: rmdir d0/d32/d3a/d52 39 2024-03-18T14:43:21.488 INFO:tasks.workunit.client.0.smithi087.stdout:5/726: rename d13/d1b/d30/d6e/f80 to d13/d1b/d27/d35/da7/ff3 0 2024-03-18T14:43:21.489 INFO:tasks.workunit.client.1.smithi129.stdout:2/529: creat d7/d3f/fa0 x:0 0 0 2024-03-18T14:43:21.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/727: readlink d13/d1b/d27/d35/da7/le2 0 2024-03-18T14:43:21.489 INFO:tasks.workunit.client.0.smithi087.stdout:5/728: readlink d13/d1b/d70/l74 0 2024-03-18T14:43:21.491 INFO:tasks.workunit.client.0.smithi087.stdout:6/670: dread d3/d7/d25/d62/d7c/d29/d22/d61/f70 [0,4194304] 0 2024-03-18T14:43:21.492 INFO:tasks.workunit.client.1.smithi129.stdout:1/515: write d1/d2/f64 [2058628,65386] 0 2024-03-18T14:43:21.492 INFO:tasks.workunit.client.1.smithi129.stdout:1/516: chown d1/d2/d28/f7f 2 1 2024-03-18T14:43:21.492 INFO:tasks.workunit.client.1.smithi129.stdout:8/560: link d9/d11/d1a/d32/c37 d9/d11/d55/d68/d72/d90/cbb 0 2024-03-18T14:43:21.493 INFO:tasks.workunit.client.1.smithi129.stdout:7/535: truncate d4/d7/d38/d49/f65 906431 0 2024-03-18T14:43:21.494 INFO:tasks.workunit.client.0.smithi087.stdout:7/799: creat d1/d6/d29/d2f/d68/d65/d110/f112 x:0 0 0 2024-03-18T14:43:21.494 INFO:tasks.workunit.client.1.smithi129.stdout:7/536: fdatasync d4/d2d/d2e/f30 0 2024-03-18T14:43:21.494 INFO:tasks.workunit.client.0.smithi087.stdout:3/732: truncate d0/fb9 554190 0 2024-03-18T14:43:21.496 INFO:tasks.workunit.client.0.smithi087.stdout:3/733: write d0/d1c/f84 [716470,14336] 0 2024-03-18T14:43:21.497 INFO:tasks.workunit.client.0.smithi087.stdout:6/671: dwrite d3/d7/d25/d62/d7c/d46/dc9/fdf [0,4194304] 0 2024-03-18T14:43:21.497 INFO:tasks.workunit.client.0.smithi087.stdout:3/734: chown d0/d1c/d25/f6a 1850 1 2024-03-18T14:43:21.498 INFO:tasks.workunit.client.1.smithi129.stdout:5/492: fdatasync d0/dc/d22/f39 0 2024-03-18T14:43:21.498 INFO:tasks.workunit.client.0.smithi087.stdout:6/672: chown d3/f4 30 1 2024-03-18T14:43:21.498 INFO:tasks.workunit.client.0.smithi087.stdout:0/682: truncate d0/d1a/d34/d3d/fb8 2708658 0 2024-03-18T14:43:21.499 INFO:tasks.workunit.client.1.smithi129.stdout:7/537: dwrite d4/d2d/d2e/d42/f8f [0,4194304] 0 2024-03-18T14:43:21.500 INFO:tasks.workunit.client.0.smithi087.stdout:5/729: mknod d13/d1b/d27/d98/cf4 0 2024-03-18T14:43:21.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/704: mknod d2/ddd/d22/d24/d65/ce6 0 2024-03-18T14:43:21.502 INFO:tasks.workunit.client.1.smithi129.stdout:2/530: unlink d7/d1c/d62/l8b 0 2024-03-18T14:43:21.502 INFO:tasks.workunit.client.0.smithi087.stdout:8/681: getdents d1/d6/d2f/d44/d45/d72/d7f/ddc 0 2024-03-18T14:43:21.502 INFO:tasks.workunit.client.0.smithi087.stdout:2/705: read - d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fbe zero size 2024-03-18T14:43:21.503 INFO:tasks.workunit.client.0.smithi087.stdout:1/739: truncate d3/d1d/f33 1177654 0 2024-03-18T14:43:21.503 INFO:tasks.workunit.client.1.smithi129.stdout:1/517: symlink d1/d2/d70/d87/l9e 0 2024-03-18T14:43:21.504 INFO:tasks.workunit.client.0.smithi087.stdout:6/673: dwrite d3/d7/d25/d62/d7c/d29/d22/f32 [0,4194304] 0 2024-03-18T14:43:21.505 INFO:tasks.workunit.client.1.smithi129.stdout:8/561: mknod d9/d11/d1a/d32/d3a/d70/cbc 0 2024-03-18T14:43:21.507 INFO:tasks.workunit.client.1.smithi129.stdout:3/488: mkdir d4/dd/d1f/d5f/d82/da6 0 2024-03-18T14:43:21.508 INFO:tasks.workunit.client.0.smithi087.stdout:4/651: dwrite d2/db/d24/f33 [0,4194304] 0 2024-03-18T14:43:21.509 INFO:tasks.workunit.client.0.smithi087.stdout:4/652: chown d2/l47 120 1 2024-03-18T14:43:21.512 INFO:tasks.workunit.client.0.smithi087.stdout:0/683: rename d0/d7f/l8e to d0/d2/d6b/d7c/lf2 0 2024-03-18T14:43:21.513 INFO:tasks.workunit.client.0.smithi087.stdout:0/684: write d0/d2/f4a [7664451,105448] 0 2024-03-18T14:43:21.514 INFO:tasks.workunit.client.1.smithi129.stdout:6/535: creat d3/d30/df/faa x:0 0 0 2024-03-18T14:43:21.515 INFO:tasks.workunit.client.0.smithi087.stdout:9/782: unlink db/d18/d1e/d28/d76/db7/dd5/ce3 0 2024-03-18T14:43:21.517 INFO:tasks.workunit.client.0.smithi087.stdout:2/706: symlink d2/ddd/d22/d2c/d3a/d76/d9a/db5/le7 0 2024-03-18T14:43:21.520 INFO:tasks.workunit.client.0.smithi087.stdout:8/682: dwrite d1/d6/d2f/f39 [0,4194304] 0 2024-03-18T14:43:21.522 INFO:tasks.workunit.client.0.smithi087.stdout:8/683: readlink d1/d6/d2f/d44/d4b/l89 0 2024-03-18T14:43:21.523 INFO:tasks.workunit.client.0.smithi087.stdout:1/740: rename d3/d1d/d1f/c69 to d3/d1d/d1f/d34/d38/dba/ce8 0 2024-03-18T14:43:21.523 INFO:tasks.workunit.client.0.smithi087.stdout:8/684: dread - d1/d6/d2f/d44/d45/d72/fc3 zero size 2024-03-18T14:43:21.524 INFO:tasks.workunit.client.0.smithi087.stdout:2/707: dwrite d2/ddd/d22/d2c/d3a/d49/f8b [0,4194304] 0 2024-03-18T14:43:21.527 INFO:tasks.workunit.client.0.smithi087.stdout:9/783: rmdir db/d18/d1e/d28/d76/d80 39 2024-03-18T14:43:21.528 INFO:tasks.workunit.client.1.smithi129.stdout:0/562: truncate d0/d23/d35/d3b/f79 1095272 0 2024-03-18T14:43:21.528 INFO:tasks.workunit.client.1.smithi129.stdout:2/531: creat d7/d3f/fa1 x:0 0 0 2024-03-18T14:43:21.528 INFO:tasks.workunit.client.0.smithi087.stdout:9/784: readlink db/d18/d1c/l83 0 2024-03-18T14:43:21.529 INFO:tasks.workunit.client.0.smithi087.stdout:1/741: dwrite d3/d1d/d1e/f36 [8388608,4194304] 0 2024-03-18T14:43:21.530 INFO:tasks.workunit.client.1.smithi129.stdout:1/518: creat d1/d2/d70/f9f x:0 0 0 2024-03-18T14:43:21.530 INFO:tasks.workunit.client.1.smithi129.stdout:8/562: write d9/d11/d18/f3f [971242,66686] 0 2024-03-18T14:43:21.531 INFO:tasks.workunit.client.1.smithi129.stdout:9/495: getdents d0/db/d1f/d20/d25/d8e 0 2024-03-18T14:43:21.531 INFO:tasks.workunit.client.1.smithi129.stdout:8/563: chown d9/ca7 4 1 2024-03-18T14:43:21.531 INFO:tasks.workunit.client.0.smithi087.stdout:4/653: dread d2/d13/f3f [0,4194304] 0 2024-03-18T14:43:21.532 INFO:tasks.workunit.client.0.smithi087.stdout:9/785: creat db/d18/d1e/d28/d7c/f104 x:0 0 0 2024-03-18T14:43:21.532 INFO:tasks.workunit.client.1.smithi129.stdout:8/564: fsync d9/d11/d1a/d32/d41/d4d/f4f 0 2024-03-18T14:43:21.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/708: mkdir d2/ddd/d22/d24/de8 0 2024-03-18T14:43:21.533 INFO:tasks.workunit.client.1.smithi129.stdout:6/536: symlink d3/d38/d57/lab 0 2024-03-18T14:43:21.533 INFO:tasks.workunit.client.1.smithi129.stdout:8/565: write d9/d11/d1a/d32/d3a/d70/f86 [807451,102082] 0 2024-03-18T14:43:21.534 INFO:tasks.workunit.client.0.smithi087.stdout:8/685: mknod d1/d6/d2f/d9b/db1/ce0 0 2024-03-18T14:43:21.534 INFO:tasks.workunit.client.1.smithi129.stdout:6/537: chown d3/d5/d46/f55 64818 1 2024-03-18T14:43:21.535 INFO:tasks.workunit.client.0.smithi087.stdout:2/709: read - d2/ddd/d22/d2c/d3a/d68/f93 zero size 2024-03-18T14:43:21.535 INFO:tasks.workunit.client.1.smithi129.stdout:8/566: dread - d9/d11/d1a/d32/d3a/faf zero size 2024-03-18T14:43:21.537 INFO:tasks.workunit.client.0.smithi087.stdout:9/786: dwrite db/d18/d51/d7b/fab [0,4194304] 0 2024-03-18T14:43:21.537 INFO:tasks.workunit.client.1.smithi129.stdout:3/489: creat d4/dd/d1f/d5f/d82/da6/fa7 x:0 0 0 2024-03-18T14:43:21.538 INFO:tasks.workunit.client.1.smithi129.stdout:6/538: dwrite d3/d30/f26 [4194304,4194304] 0 2024-03-18T14:43:21.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/742: creat d3/de4/fe9 x:0 0 0 2024-03-18T14:43:21.540 INFO:tasks.workunit.client.0.smithi087.stdout:8/686: creat d1/d6/d14/db2/fe1 x:0 0 0 2024-03-18T14:43:21.540 INFO:tasks.workunit.client.1.smithi129.stdout:9/496: mkdir d0/db/d2e/d9f 0 2024-03-18T14:43:21.540 INFO:tasks.workunit.client.0.smithi087.stdout:2/710: symlink d2/ddd/d22/d2c/d3a/d76/d81/le9 0 2024-03-18T14:43:21.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/743: fdatasync d3/d1d/d1e/d43/fa5 0 2024-03-18T14:43:21.541 INFO:tasks.workunit.client.0.smithi087.stdout:9/787: creat db/d18/d1e/d7e/dc7/f105 x:0 0 0 2024-03-18T14:43:21.543 INFO:tasks.workunit.client.1.smithi129.stdout:0/563: fsync d0/d14/f5f 0 2024-03-18T14:43:21.544 INFO:tasks.workunit.client.1.smithi129.stdout:0/564: readlink d0/d14/d3a/d4a/l6d 0 2024-03-18T14:43:21.545 INFO:tasks.workunit.client.1.smithi129.stdout:9/497: dwrite d0/db/d90/d3e/f66 [0,4194304] 0 2024-03-18T14:43:21.546 INFO:tasks.workunit.client.1.smithi129.stdout:3/490: stat d4/d11/d34/d4c/c6e 0 2024-03-18T14:43:21.552 INFO:tasks.workunit.client.1.smithi129.stdout:6/539: dread d3/d30/df/f5f [0,4194304] 0 2024-03-18T14:43:21.553 INFO:tasks.workunit.client.1.smithi129.stdout:6/540: chown d3/d30/de/f2e 51 1 2024-03-18T14:43:21.556 INFO:tasks.workunit.client.0.smithi087.stdout:3/735: truncate d0/d3/f94 4244177 0 2024-03-18T14:43:21.556 INFO:tasks.workunit.client.0.smithi087.stdout:1/744: chown d3/d3c/db8/d8f/d99/lca 0 1 2024-03-18T14:43:21.557 INFO:tasks.workunit.client.1.smithi129.stdout:3/491: dread d4/dd/f8f [0,4194304] 0 2024-03-18T14:43:21.558 INFO:tasks.workunit.client.0.smithi087.stdout:8/687: rename d1/d6/d2f/d44/d4b/da5/cd9 to d1/d6/d2f/d9b/ce2 0 2024-03-18T14:43:21.558 INFO:tasks.workunit.client.1.smithi129.stdout:1/519: getdents d1/d2/d70/d87/d8c 0 2024-03-18T14:43:21.559 INFO:tasks.workunit.client.0.smithi087.stdout:6/674: dwrite d3/d7/d25/d62/d7c/d29/f1d [0,4194304] 0 2024-03-18T14:43:21.560 INFO:tasks.workunit.client.1.smithi129.stdout:3/492: mkdir d4/dd/d1f/da8 0 2024-03-18T14:43:21.560 INFO:tasks.workunit.client.0.smithi087.stdout:6/675: write d3/d7/d25/d62/d7c/f9a [1476545,40223] 0 2024-03-18T14:43:21.561 INFO:tasks.workunit.client.1.smithi129.stdout:6/541: mknod d3/d6/d82/d9a/cac 0 2024-03-18T14:43:21.561 INFO:tasks.workunit.client.1.smithi129.stdout:3/493: chown d4/dd/d1f/d2f/f69 15146 1 2024-03-18T14:43:21.561 INFO:tasks.workunit.client.1.smithi129.stdout:8/567: link d9/d11/c2d d9/d11/d1a/d32/d41/d4d/d96/cbd 0 2024-03-18T14:43:21.562 INFO:tasks.workunit.client.0.smithi087.stdout:6/676: chown d3/d7/d25/d62/d7c/d46/dc9/fdf 499905 1 2024-03-18T14:43:21.562 INFO:tasks.workunit.client.1.smithi129.stdout:6/542: chown d3/d30/df/d28/d79 48 1 2024-03-18T14:43:21.563 INFO:tasks.workunit.client.1.smithi129.stdout:8/568: write d9/d11/d1a/d32/d3a/faf [1038725,65670] 0 2024-03-18T14:43:21.563 INFO:tasks.workunit.client.1.smithi129.stdout:1/520: read d1/f88 [8530,115171] 0 2024-03-18T14:43:21.564 INFO:tasks.workunit.client.1.smithi129.stdout:1/521: dread - d1/d2/d28/d65/f99 zero size 2024-03-18T14:43:21.565 INFO:tasks.workunit.client.1.smithi129.stdout:1/522: write d1/d35/f45 [3918824,120090] 0 2024-03-18T14:43:21.566 INFO:tasks.workunit.client.1.smithi129.stdout:1/523: write d1/f1d [914502,119879] 0 2024-03-18T14:43:21.567 INFO:tasks.workunit.client.1.smithi129.stdout:4/464: truncate d0/d19/d46/d3e/d21/d4d/d70/f2c 2626557 0 2024-03-18T14:43:21.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/654: truncate d2/db/de/d8b/fa6 849755 0 2024-03-18T14:43:21.568 INFO:tasks.workunit.client.0.smithi087.stdout:4/655: chown d2/db/lb5 1281298 1 2024-03-18T14:43:21.570 INFO:tasks.workunit.client.1.smithi129.stdout:8/569: dread d9/d11/d1a/d32/d3a/d5d/f9e [0,4194304] 0 2024-03-18T14:43:21.570 INFO:tasks.workunit.client.1.smithi129.stdout:5/493: write d0/d32/f79 [2523554,72640] 0 2024-03-18T14:43:21.573 INFO:tasks.workunit.client.0.smithi087.stdout:8/688: symlink d1/d6/d2f/d44/d4b/le3 0 2024-03-18T14:43:21.574 INFO:tasks.workunit.client.0.smithi087.stdout:8/689: chown d1/d6/d9/d5d/d87/d88 0 1 2024-03-18T14:43:21.574 INFO:tasks.workunit.client.1.smithi129.stdout:2/532: rmdir d7/d3f 39 2024-03-18T14:43:21.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/538: dread d4/d7/d8/f3d [0,4194304] 0 2024-03-18T14:43:21.575 INFO:tasks.workunit.client.0.smithi087.stdout:8/690: dread - d1/d6/d2f/d44/d45/d71/daa/fdb zero size 2024-03-18T14:43:21.578 INFO:tasks.workunit.client.1.smithi129.stdout:6/543: unlink d3/f41 0 2024-03-18T14:43:21.578 INFO:tasks.workunit.client.0.smithi087.stdout:1/745: rename d3/d1d/d1e/d20/d7a/l8b to d3/d1d/d1f/d34/d38/dba/lea 0 2024-03-18T14:43:21.580 INFO:tasks.workunit.client.0.smithi087.stdout:4/656: mkdir d2/db/d24/d30/d7b/dbe/dcf/dda/ddb 0 2024-03-18T14:43:21.580 INFO:tasks.workunit.client.0.smithi087.stdout:4/657: stat d2/db/cd 0 2024-03-18T14:43:21.581 INFO:tasks.workunit.client.0.smithi087.stdout:8/691: creat d1/d6/d2f/d44/d45/d50/fe4 x:0 0 0 2024-03-18T14:43:21.581 INFO:tasks.workunit.client.1.smithi129.stdout:8/570: creat d9/d11/d1a/d14/d60/fbe x:0 0 0 2024-03-18T14:43:21.582 INFO:tasks.workunit.client.0.smithi087.stdout:0/685: dread d0/d2/d4/f98 [0,4194304] 0 2024-03-18T14:43:21.583 INFO:tasks.workunit.client.0.smithi087.stdout:9/788: dread db/d18/d3a/f9f [0,4194304] 0 2024-03-18T14:43:21.583 INFO:tasks.workunit.client.0.smithi087.stdout:4/658: mkdir d2/db/d24/d30/d7b/dbe/ddc 0 2024-03-18T14:43:21.584 INFO:tasks.workunit.client.1.smithi129.stdout:1/524: dread d1/d2/f3d [0,4194304] 0 2024-03-18T14:43:21.585 INFO:tasks.workunit.client.1.smithi129.stdout:1/525: write d1/f1d [5197662,17941] 0 2024-03-18T14:43:21.585 INFO:tasks.workunit.client.1.smithi129.stdout:7/539: rename d4/d7/d38/d61/d68/d6b/l80 to d4/d7/d38/d61/d68/d6b/d81/la6 0 2024-03-18T14:43:21.586 INFO:tasks.workunit.client.0.smithi087.stdout:8/692: creat d1/d6/d2f/d9b/db1/fe5 x:0 0 0 2024-03-18T14:43:21.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/526: chown d1/d2/d28/d65/d19/f61 64867 1 2024-03-18T14:43:21.586 INFO:tasks.workunit.client.0.smithi087.stdout:0/686: rmdir d0 39 2024-03-18T14:43:21.587 INFO:tasks.workunit.client.1.smithi129.stdout:6/544: rmdir d3/d30/df 39 2024-03-18T14:43:21.587 INFO:tasks.workunit.client.0.smithi087.stdout:7/800: dread d1/d6/d29/d2f/d68/d65/d60/d66/f6e [0,4194304] 0 2024-03-18T14:43:21.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/789: symlink db/d18/d1e/d28/dc2/l106 0 2024-03-18T14:43:21.589 INFO:tasks.workunit.client.1.smithi129.stdout:5/494: unlink d0/d32/d3a/f49 0 2024-03-18T14:43:21.589 INFO:tasks.workunit.client.1.smithi129.stdout:7/540: dread d4/d7/d54/f9a [0,4194304] 0 2024-03-18T14:43:21.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/533: unlink d7/d1f/l8d 0 2024-03-18T14:43:21.591 INFO:tasks.workunit.client.0.smithi087.stdout:8/693: dwrite d1/d6/d2f/fa8 [0,4194304] 0 2024-03-18T14:43:21.591 INFO:tasks.workunit.client.1.smithi129.stdout:1/527: fdatasync d1/d2/d70/f74 0 2024-03-18T14:43:21.591 INFO:tasks.workunit.client.1.smithi129.stdout:6/545: rmdir d3/d30/de/d65 39 2024-03-18T14:43:21.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/546: readlink d3/d6/l5b 0 2024-03-18T14:43:21.593 INFO:tasks.workunit.client.1.smithi129.stdout:2/534: symlink d7/d1f/d20/d36/la2 0 2024-03-18T14:43:21.594 INFO:tasks.workunit.client.1.smithi129.stdout:8/571: truncate d9/d11/d55/d6a/fb1 529693 0 2024-03-18T14:43:21.594 INFO:tasks.workunit.client.1.smithi129.stdout:4/465: dread d0/d19/d46/f36 [0,4194304] 0 2024-03-18T14:43:21.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/535: chown d7/d1c/d32/f96 28359 1 2024-03-18T14:43:21.595 INFO:tasks.workunit.client.0.smithi087.stdout:2/711: truncate d2/ddd/d22/d24/d65/f83 441298 0 2024-03-18T14:43:21.595 INFO:tasks.workunit.client.1.smithi129.stdout:0/565: truncate d0/d14/f5f 5724086 0 2024-03-18T14:43:21.601 INFO:tasks.workunit.client.0.smithi087.stdout:6/677: dwrite d3/d7/d25/d62/d7c/d29/f8a [0,4194304] 0 2024-03-18T14:43:21.601 INFO:tasks.workunit.client.1.smithi129.stdout:3/494: write d4/d11/d1d/f46 [3409727,6912] 0 2024-03-18T14:43:21.601 INFO:tasks.workunit.client.1.smithi129.stdout:9/498: sync 2024-03-18T14:43:21.601 INFO:tasks.workunit.client.0.smithi087.stdout:5/730: sync 2024-03-18T14:43:21.602 INFO:tasks.workunit.client.0.smithi087.stdout:5/731: write d13/d1b/d27/d28/f77 [2309195,91208] 0 2024-03-18T14:43:21.603 INFO:tasks.workunit.client.1.smithi129.stdout:5/495: creat d0/d32/d3a/d52/f90 x:0 0 0 2024-03-18T14:43:21.603 INFO:tasks.workunit.client.0.smithi087.stdout:1/746: write d3/d1d/d1f/d63/f7e [717307,31219] 0 2024-03-18T14:43:21.604 INFO:tasks.workunit.client.0.smithi087.stdout:9/790: dread db/d18/d1c/d69/f92 [0,4194304] 0 2024-03-18T14:43:21.604 INFO:tasks.workunit.client.0.smithi087.stdout:0/687: symlink d0/d2/d4/d27/dc3/lf3 0 2024-03-18T14:43:21.604 INFO:tasks.workunit.client.1.smithi129.stdout:6/547: mkdir d3/d6/d82/d9a/dad 0 2024-03-18T14:43:21.605 INFO:tasks.workunit.client.0.smithi087.stdout:9/791: write db/d18/d1e/d7e/dc7/fd2 [224165,125246] 0 2024-03-18T14:43:21.607 INFO:tasks.workunit.client.0.smithi087.stdout:8/694: rename d1/d6/d14/f5c to d1/d6/d8d/fe6 0 2024-03-18T14:43:21.608 INFO:tasks.workunit.client.0.smithi087.stdout:1/747: dwrite d3/d1d/d79/f8d [0,4194304] 0 2024-03-18T14:43:21.610 INFO:tasks.workunit.client.0.smithi087.stdout:2/712: creat d2/ddd/d22/d2c/d3a/d40/d4a/d97/fea x:0 0 0 2024-03-18T14:43:21.611 INFO:tasks.workunit.client.1.smithi129.stdout:4/466: creat d0/d9/d4c/f90 x:0 0 0 2024-03-18T14:43:21.612 INFO:tasks.workunit.client.1.smithi129.stdout:2/536: truncate d7/d1f/d34/f1a 1230041 0 2024-03-18T14:43:21.613 INFO:tasks.workunit.client.0.smithi087.stdout:1/748: dwrite d3/d1d/d1e/d43/fa5 [0,4194304] 0 2024-03-18T14:43:21.615 INFO:tasks.workunit.client.1.smithi129.stdout:3/495: mkdir d4/dd/d1f/d5f/d31/d78/da9 0 2024-03-18T14:43:21.615 INFO:tasks.workunit.client.0.smithi087.stdout:4/659: write d2/f96 [97601,44407] 0 2024-03-18T14:43:21.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/732: creat d13/d1b/d7e/ff5 x:0 0 0 2024-03-18T14:43:21.618 INFO:tasks.workunit.client.1.smithi129.stdout:5/496: mknod d0/c91 0 2024-03-18T14:43:21.619 INFO:tasks.workunit.client.1.smithi129.stdout:6/548: symlink d3/d6/d82/lae 0 2024-03-18T14:43:21.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/749: read d3/d1d/d1e/d43/d50/d71/fc1 [86145,15400] 0 2024-03-18T14:43:21.621 INFO:tasks.workunit.client.0.smithi087.stdout:4/660: dwrite d2/f16 [0,4194304] 0 2024-03-18T14:43:21.623 INFO:tasks.workunit.client.0.smithi087.stdout:8/695: creat d1/d6/d8d/fe7 x:0 0 0 2024-03-18T14:43:21.624 INFO:tasks.workunit.client.1.smithi129.stdout:4/467: write d0/d19/d46/d3e/f47 [1376493,123736] 0 2024-03-18T14:43:21.626 INFO:tasks.workunit.client.1.smithi129.stdout:1/528: link d1/d2/d28/d65/d19/f76 d1/d2/d28/fa0 0 2024-03-18T14:43:21.627 INFO:tasks.workunit.client.0.smithi087.stdout:3/736: sync 2024-03-18T14:43:21.628 INFO:tasks.workunit.client.1.smithi129.stdout:7/541: link d4/l2c d4/d2d/d2e/d45/la7 0 2024-03-18T14:43:21.630 INFO:tasks.workunit.client.1.smithi129.stdout:0/566: link d0/d6c/c9b d0/d23/d35/d3b/d42/cae 0 2024-03-18T14:43:21.631 INFO:tasks.workunit.client.1.smithi129.stdout:0/567: write d0/d23/f93 [487687,68958] 0 2024-03-18T14:43:21.635 INFO:tasks.workunit.client.0.smithi087.stdout:0/688: write d0/d1a/d34/d3d/fc9 [535027,101477] 0 2024-03-18T14:43:21.636 INFO:tasks.workunit.client.1.smithi129.stdout:8/572: sync 2024-03-18T14:43:21.636 INFO:tasks.workunit.client.1.smithi129.stdout:9/499: rename d0/db/d1f/d4c/c86 to d0/db/d1f/d20/d26/ca0 0 2024-03-18T14:43:21.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/496: creat d4/dd/d1f/da8/faa x:0 0 0 2024-03-18T14:43:21.638 INFO:tasks.workunit.client.1.smithi129.stdout:4/468: symlink d0/d9/d6a/l91 0 2024-03-18T14:43:21.639 INFO:tasks.workunit.client.1.smithi129.stdout:5/497: creat d0/dc/d18/d2b/d8c/f92 x:0 0 0 2024-03-18T14:43:21.640 INFO:tasks.workunit.client.1.smithi129.stdout:5/498: write d0/d32/d3a/d45/f74 [142367,111787] 0 2024-03-18T14:43:21.641 INFO:tasks.workunit.client.1.smithi129.stdout:1/529: rmdir d1/d2/d28/d65/d7c 39 2024-03-18T14:43:21.642 INFO:tasks.workunit.client.1.smithi129.stdout:6/549: mkdir d3/d30/df/d28/d79/daf 0 2024-03-18T14:43:21.644 INFO:tasks.workunit.client.1.smithi129.stdout:0/568: mknod d0/d14/d28/d63/d8d/caf 0 2024-03-18T14:43:21.647 INFO:tasks.workunit.client.1.smithi129.stdout:8/573: creat d9/d33/fbf x:0 0 0 2024-03-18T14:43:21.649 INFO:tasks.workunit.client.1.smithi129.stdout:3/497: symlink d4/dd/d1f/d5f/d31/lab 0 2024-03-18T14:43:21.650 INFO:tasks.workunit.client.1.smithi129.stdout:4/469: symlink d0/d3c/d6c/l92 0 2024-03-18T14:43:21.652 INFO:tasks.workunit.client.0.smithi087.stdout:1/750: creat d3/d1d/d79/feb x:0 0 0 2024-03-18T14:43:21.652 INFO:tasks.workunit.client.0.smithi087.stdout:2/713: dread d2/f99 [0,4194304] 0 2024-03-18T14:43:21.654 INFO:tasks.workunit.client.0.smithi087.stdout:9/792: link db/d18/d1e/d28/f4a db/d18/d1e/d28/d7c/f107 0 2024-03-18T14:43:21.655 INFO:tasks.workunit.client.0.smithi087.stdout:7/801: getdents d1/d6/da 0 2024-03-18T14:43:21.656 INFO:tasks.workunit.client.0.smithi087.stdout:0/689: chown d0/d2/d4/de8/dad/dea/d5d 155278 1 2024-03-18T14:43:21.657 INFO:tasks.workunit.client.0.smithi087.stdout:5/733: creat d13/d1b/d30/d6e/dc8/ff6 x:0 0 0 2024-03-18T14:43:21.659 INFO:tasks.workunit.client.0.smithi087.stdout:5/734: fsync d13/d1b/d27/d28/d9a/dae/fe1 0 2024-03-18T14:43:21.659 INFO:tasks.workunit.client.0.smithi087.stdout:1/751: symlink d3/d1d/d1e/d43/d50/d72/lec 0 2024-03-18T14:43:21.660 INFO:tasks.workunit.client.1.smithi129.stdout:7/542: symlink d4/d7/d38/d61/d6a/la8 0 2024-03-18T14:43:21.660 INFO:tasks.workunit.client.0.smithi087.stdout:6/678: getdents d3/d7/d25/d62/d7c/d29/d7d 0 2024-03-18T14:43:21.661 INFO:tasks.workunit.client.1.smithi129.stdout:6/550: symlink d3/d30/de/d49/lb0 0 2024-03-18T14:43:21.662 INFO:tasks.workunit.client.1.smithi129.stdout:2/537: getdents d7/d1f/d20/d2b/d41/d65/d88 0 2024-03-18T14:43:21.662 INFO:tasks.workunit.client.1.smithi129.stdout:6/551: write d3/d30/de/d6c/d9e/f9f [3442909,21957] 0 2024-03-18T14:43:21.663 INFO:tasks.workunit.client.0.smithi087.stdout:0/690: dwrite d0/d2/d4/de8/dad/dea/f40 [0,4194304] 0 2024-03-18T14:43:21.663 INFO:tasks.workunit.client.1.smithi129.stdout:6/552: stat d3/d6/d82/lae 0 2024-03-18T14:43:21.663 INFO:tasks.workunit.client.1.smithi129.stdout:3/498: write d4/d38/f2c [7706531,79694] 0 2024-03-18T14:43:21.665 INFO:tasks.workunit.client.0.smithi087.stdout:4/661: rename d2/db/d24/d30/d49/d4f/c5d to d2/d13/cdd 0 2024-03-18T14:43:21.666 INFO:tasks.workunit.client.1.smithi129.stdout:4/470: creat d0/d19/d46/d3e/d33/f93 x:0 0 0 2024-03-18T14:43:21.667 INFO:tasks.workunit.client.0.smithi087.stdout:2/714: mkdir d2/ddd/d22/d2c/d3a/d40/deb 0 2024-03-18T14:43:21.667 INFO:tasks.workunit.client.0.smithi087.stdout:3/737: dread d0/d3/df/f16 [0,4194304] 0 2024-03-18T14:43:21.668 INFO:tasks.workunit.client.1.smithi129.stdout:7/543: symlink d4/d7/d38/d61/d6a/la9 0 2024-03-18T14:43:21.668 INFO:tasks.workunit.client.0.smithi087.stdout:1/752: chown d3/d1d/d1e/d43/c6b 20278 1 2024-03-18T14:43:21.669 INFO:tasks.workunit.client.0.smithi087.stdout:5/735: dread d13/f1a [0,4194304] 0 2024-03-18T14:43:21.670 INFO:tasks.workunit.client.1.smithi129.stdout:5/499: truncate d0/df/f48 1954953 0 2024-03-18T14:43:21.672 INFO:tasks.workunit.client.0.smithi087.stdout:8/696: rename d1/d6/d2f/fd6 to d1/d6/d2f/d44/d45/d50/fe8 0 2024-03-18T14:43:21.672 INFO:tasks.workunit.client.0.smithi087.stdout:7/802: link d1/d6/d29/d2f/lec d1/d97/l113 0 2024-03-18T14:43:21.673 INFO:tasks.workunit.client.1.smithi129.stdout:2/538: creat d7/d1c/d79/fa3 x:0 0 0 2024-03-18T14:43:21.675 INFO:tasks.workunit.client.1.smithi129.stdout:3/499: mkdir d4/d11/d1d/d50/d90/dac 0 2024-03-18T14:43:21.675 INFO:tasks.workunit.client.0.smithi087.stdout:0/691: dread d0/d1a/d80/d88/f64 [0,4194304] 0 2024-03-18T14:43:21.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/692: write d0/d2/d4/de8/dad/dea/f71 [2479000,90837] 0 2024-03-18T14:43:21.677 INFO:tasks.workunit.client.0.smithi087.stdout:3/738: mknod d0/de/d30/d46/dc3/cd0 0 2024-03-18T14:43:21.677 INFO:tasks.workunit.client.1.smithi129.stdout:1/530: rename d1/d35/d7a/l85 to d1/d2/d28/d65/la1 0 2024-03-18T14:43:21.678 INFO:tasks.workunit.client.0.smithi087.stdout:0/693: write d0/d2/da9/fe3 [219827,126393] 0 2024-03-18T14:43:21.678 INFO:tasks.workunit.client.0.smithi087.stdout:3/739: write d0/d1c/d25/f7b [2601370,85870] 0 2024-03-18T14:43:21.678 INFO:tasks.workunit.client.1.smithi129.stdout:9/500: truncate d0/db/d1f/d20/d26/d19/f9b 764391 0 2024-03-18T14:43:21.679 INFO:tasks.workunit.client.1.smithi129.stdout:9/501: fdatasync d0/db/d1f/d20/d25/d8e/f9a 0 2024-03-18T14:43:21.679 INFO:tasks.workunit.client.0.smithi087.stdout:1/753: unlink d3/d1d/d1e/d20/f5f 0 2024-03-18T14:43:21.680 INFO:tasks.workunit.client.1.smithi129.stdout:9/502: write d0/db/d1f/f23 [2773109,20201] 0 2024-03-18T14:43:21.683 INFO:tasks.workunit.client.1.smithi129.stdout:2/539: symlink d7/d1f/d20/la4 0 2024-03-18T14:43:21.684 INFO:tasks.workunit.client.1.smithi129.stdout:3/500: unlink d4/d11/d1d/d50/d91/d93/f61 0 2024-03-18T14:43:21.686 INFO:tasks.workunit.client.1.smithi129.stdout:0/569: sync 2024-03-18T14:43:21.686 INFO:tasks.workunit.client.1.smithi129.stdout:5/500: symlink d0/dc/l93 0 2024-03-18T14:43:21.686 INFO:tasks.workunit.client.1.smithi129.stdout:5/501: readlink d0/d32/d34/d6c/l7c 0 2024-03-18T14:43:21.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/502: readlink d0/dc/d1a/l41 0 2024-03-18T14:43:21.687 INFO:tasks.workunit.client.1.smithi129.stdout:5/503: fdatasync d0/d32/d3a/f62 0 2024-03-18T14:43:21.689 INFO:tasks.workunit.client.1.smithi129.stdout:8/574: rename d9/d11/d1a/d79 to d9/d11/d1a/d14/dc0 0 2024-03-18T14:43:21.689 INFO:tasks.workunit.client.1.smithi129.stdout:8/575: dread - d9/d11/d1a/d14/dc0/fba zero size 2024-03-18T14:43:21.693 INFO:tasks.workunit.client.0.smithi087.stdout:9/793: rename db/d18/d1c/c44 to db/d18/d1e/dde/dce/c108 0 2024-03-18T14:43:21.696 INFO:tasks.workunit.client.0.smithi087.stdout:8/697: mknod d1/d6/d2f/d44/d45/d71/daa/ce9 0 2024-03-18T14:43:21.696 INFO:tasks.workunit.client.1.smithi129.stdout:2/540: rmdir d7/d1f/d20/d2a 39 2024-03-18T14:43:21.697 INFO:tasks.workunit.client.1.smithi129.stdout:2/541: chown d7/c68 6491765 1 2024-03-18T14:43:21.698 INFO:tasks.workunit.client.0.smithi087.stdout:7/803: mknod d1/d6/d29/d2f/d68/dbf/c114 0 2024-03-18T14:43:21.703 INFO:tasks.workunit.client.1.smithi129.stdout:1/531: fsync d1/d2/d28/f51 0 2024-03-18T14:43:21.704 INFO:tasks.workunit.client.1.smithi129.stdout:0/570: dread d0/d23/d71/f9f [0,4194304] 0 2024-03-18T14:43:21.704 INFO:tasks.workunit.client.1.smithi129.stdout:1/532: write d1/f9 [3774171,94564] 0 2024-03-18T14:43:21.704 INFO:tasks.workunit.client.1.smithi129.stdout:9/503: mkdir d0/da1 0 2024-03-18T14:43:21.704 INFO:tasks.workunit.client.1.smithi129.stdout:7/544: getdents d4/d83 0 2024-03-18T14:43:21.704 INFO:tasks.workunit.client.0.smithi087.stdout:5/736: write d13/d1b/d70/fbb [321328,1631] 0 2024-03-18T14:43:21.706 INFO:tasks.workunit.client.0.smithi087.stdout:2/715: dwrite d2/ddd/d22/d2c/d3a/d40/d52/f5c [0,4194304] 0 2024-03-18T14:43:21.707 INFO:tasks.workunit.client.0.smithi087.stdout:2/716: write d2/ddd/d22/d2c/f2e [3730262,115025] 0 2024-03-18T14:43:21.708 INFO:tasks.workunit.client.1.smithi129.stdout:3/501: link d4/dd/d1f/da8/faa d4/dd/d1f/d2f/fad 0 2024-03-18T14:43:21.709 INFO:tasks.workunit.client.1.smithi129.stdout:5/504: dwrite d0/dc/f5b [4194304,4194304] 0 2024-03-18T14:43:21.710 INFO:tasks.workunit.client.1.smithi129.stdout:3/502: dread - d4/d11/d34/d53/f80 zero size 2024-03-18T14:43:21.712 INFO:tasks.workunit.client.1.smithi129.stdout:6/553: rename d3/d30/df/l25 to d3/d38/d57/lb1 0 2024-03-18T14:43:21.713 INFO:tasks.workunit.client.0.smithi087.stdout:0/694: mknod d0/d1a/d7b/d2a/cf4 0 2024-03-18T14:43:21.713 INFO:tasks.workunit.client.1.smithi129.stdout:8/576: mkdir d9/d11/d1a/d14/db7/dc1 0 2024-03-18T14:43:21.714 INFO:tasks.workunit.client.0.smithi087.stdout:2/717: write d2/ddd/dbb/fbf [4587259,86588] 0 2024-03-18T14:43:21.714 INFO:tasks.workunit.client.0.smithi087.stdout:0/695: chown d0/d1a/cb7 2921 1 2024-03-18T14:43:21.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/542: dwrite d7/d1f/d20/d72/f9f [0,4194304] 0 2024-03-18T14:43:21.715 INFO:tasks.workunit.client.0.smithi087.stdout:0/696: chown d0/d2/d4/de8/dad/dea/f71 0 1 2024-03-18T14:43:21.716 INFO:tasks.workunit.client.0.smithi087.stdout:6/679: rename d3/d7/d25/d62/d7c/d46/fd3 to d3/dcd/fe5 0 2024-03-18T14:43:21.716 INFO:tasks.workunit.client.1.smithi129.stdout:2/543: readlink d7/lf 0 2024-03-18T14:43:21.716 INFO:tasks.workunit.client.1.smithi129.stdout:9/504: read - d0/db/d1f/d20/d26/d19/d29/f44 zero size 2024-03-18T14:43:21.717 INFO:tasks.workunit.client.1.smithi129.stdout:5/505: dwrite d0/fb [0,4194304] 0 2024-03-18T14:43:21.717 INFO:tasks.workunit.client.0.smithi087.stdout:7/804: symlink d1/d6/d29/d2f/d68/d65/d60/l115 0 2024-03-18T14:43:21.719 INFO:tasks.workunit.client.1.smithi129.stdout:3/503: mkdir d4/dd/d1f/d2f/dae 0 2024-03-18T14:43:21.719 INFO:tasks.workunit.client.0.smithi087.stdout:2/718: dwrite d2/d44/fb7 [0,4194304] 0 2024-03-18T14:43:21.722 INFO:tasks.workunit.client.1.smithi129.stdout:6/554: chown d3/d6/f9b 118625803 1 2024-03-18T14:43:21.722 INFO:tasks.workunit.client.1.smithi129.stdout:8/577: dwrite d9/d11/d1a/d32/d3a/faf [0,4194304] 0 2024-03-18T14:43:21.723 INFO:tasks.workunit.client.0.smithi087.stdout:4/662: getdents d2/db/d3c/d90 0 2024-03-18T14:43:21.723 INFO:tasks.workunit.client.0.smithi087.stdout:1/754: fdatasync d3/d1d/f33 0 2024-03-18T14:43:21.725 INFO:tasks.workunit.client.0.smithi087.stdout:9/794: rename db/d18/d51/l5f to db/d18/d1e/dde/l109 0 2024-03-18T14:43:21.725 INFO:tasks.workunit.client.1.smithi129.stdout:0/571: symlink d0/d14/lb0 0 2024-03-18T14:43:21.729 INFO:tasks.workunit.client.1.smithi129.stdout:5/506: mkdir d0/dc/d1a/d61/d94 0 2024-03-18T14:43:21.732 INFO:tasks.workunit.client.0.smithi087.stdout:2/719: mkdir d2/ddd/dca/dec 0 2024-03-18T14:43:21.733 INFO:tasks.workunit.client.0.smithi087.stdout:5/737: fsync d13/d1b/d30/fbd 0 2024-03-18T14:43:21.733 INFO:tasks.workunit.client.0.smithi087.stdout:3/740: link d0/d3/d4f/lc0 d0/d3/d4f/d6e/dc8/ld1 0 2024-03-18T14:43:21.733 INFO:tasks.workunit.client.1.smithi129.stdout:5/507: dwrite d0/d32/d3a/d52/f90 [0,4194304] 0 2024-03-18T14:43:21.734 INFO:tasks.workunit.client.1.smithi129.stdout:4/471: rename d0/d19/d46/d3e/d21/d4d/d70/f24 to d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/f94 0 2024-03-18T14:43:21.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/755: creat d3/de4/fed x:0 0 0 2024-03-18T14:43:21.737 INFO:tasks.workunit.client.0.smithi087.stdout:1/756: stat d3/d3c/db8/ld6 0 2024-03-18T14:43:21.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/741: dread d0/d3/d7a/f8f [0,4194304] 0 2024-03-18T14:43:21.737 INFO:tasks.workunit.client.0.smithi087.stdout:4/663: creat d2/db/d24/d30/d49/d4f/fde x:0 0 0 2024-03-18T14:43:21.739 INFO:tasks.workunit.client.0.smithi087.stdout:9/795: write db/d18/d1e/d28/d76/da7/fb6 [1684024,103356] 0 2024-03-18T14:43:21.740 INFO:tasks.workunit.client.0.smithi087.stdout:1/757: write d3/d1d/d1e/d20/d7a/db4/fdf [945259,95437] 0 2024-03-18T14:43:21.741 INFO:tasks.workunit.client.0.smithi087.stdout:6/680: dread d3/d7/d25/d62/d7c/d29/d22/f2c [0,4194304] 0 2024-03-18T14:43:21.742 INFO:tasks.workunit.client.0.smithi087.stdout:6/681: dread - d3/d7/d25/d62/d8b/fa1 zero size 2024-03-18T14:43:21.743 INFO:tasks.workunit.client.0.smithi087.stdout:3/742: dwrite d0/fb6 [0,4194304] 0 2024-03-18T14:43:21.744 INFO:tasks.workunit.client.1.smithi129.stdout:8/578: getdents d9/d11/db3 0 2024-03-18T14:43:21.744 INFO:tasks.workunit.client.1.smithi129.stdout:6/555: symlink d3/d30/de/da9/lb2 0 2024-03-18T14:43:21.744 INFO:tasks.workunit.client.0.smithi087.stdout:6/682: write d3/d7/d25/f41 [2403031,27986] 0 2024-03-18T14:43:21.744 INFO:tasks.workunit.client.0.smithi087.stdout:3/743: fdatasync d0/d1c/d25/f7b 0 2024-03-18T14:43:21.745 INFO:tasks.workunit.client.1.smithi129.stdout:5/508: symlink d0/dc/d18/d2b/d8c/l95 0 2024-03-18T14:43:21.745 INFO:tasks.workunit.client.0.smithi087.stdout:0/697: link d0/d2/d6b/fe5 d0/d1a/d7b/d26/ff5 0 2024-03-18T14:43:21.745 INFO:tasks.workunit.client.0.smithi087.stdout:2/720: mkdir d2/ddd/d5a/ded 0 2024-03-18T14:43:21.746 INFO:tasks.workunit.client.0.smithi087.stdout:0/698: write d0/d2/f84 [2746568,54004] 0 2024-03-18T14:43:21.749 INFO:tasks.workunit.client.1.smithi129.stdout:9/505: link d0/db/l34 d0/db/d2e/d9f/la2 0 2024-03-18T14:43:21.749 INFO:tasks.workunit.client.1.smithi129.stdout:4/472: mknod d0/d3c/d6c/c95 0 2024-03-18T14:43:21.749 INFO:tasks.workunit.client.1.smithi129.stdout:4/473: readlink d0/d3c/d6c/l92 0 2024-03-18T14:43:21.749 INFO:tasks.workunit.client.0.smithi087.stdout:1/758: readlink d3/d1d/d1e/l6f 0 2024-03-18T14:43:21.750 INFO:tasks.workunit.client.0.smithi087.stdout:2/721: dwrite d2/ddd/d5a/fa8 [0,4194304] 0 2024-03-18T14:43:21.751 INFO:tasks.workunit.client.1.smithi129.stdout:1/533: rename d1/d2/d28/d65/d19/f4e to d1/d2/d28/d65/d19/d52/fa2 0 2024-03-18T14:43:21.751 INFO:tasks.workunit.client.0.smithi087.stdout:9/796: creat db/d18/d1c/d69/d6f/f10a x:0 0 0 2024-03-18T14:43:21.751 INFO:tasks.workunit.client.1.smithi129.stdout:1/534: readlink d1/d2/d70/l5d 0 2024-03-18T14:43:21.752 INFO:tasks.workunit.client.1.smithi129.stdout:0/572: mknod d0/d23/cb1 0 2024-03-18T14:43:21.752 INFO:tasks.workunit.client.1.smithi129.stdout:1/535: write d1/d2/d70/d56/f6f [991967,28606] 0 2024-03-18T14:43:21.752 INFO:tasks.workunit.client.0.smithi087.stdout:2/722: write d2/ddd/d22/d2c/d3a/d76/d81/f86 [4244774,63185] 0 2024-03-18T14:43:21.754 INFO:tasks.workunit.client.1.smithi129.stdout:8/579: read d9/f1f [3225615,42424] 0 2024-03-18T14:43:21.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/744: mkdir d0/d1c/d25/dd2 0 2024-03-18T14:43:21.757 INFO:tasks.workunit.client.1.smithi129.stdout:8/580: dread d9/d11/d55/d68/d72/fac [4194304,4194304] 0 2024-03-18T14:43:21.760 INFO:tasks.workunit.client.0.smithi087.stdout:0/699: dwrite d0/d1a/d80/d88/f2b [0,4194304] 0 2024-03-18T14:43:21.762 INFO:tasks.workunit.client.1.smithi129.stdout:7/545: dwrite d4/d7/d8/f3f [0,4194304] 0 2024-03-18T14:43:21.762 INFO:tasks.workunit.client.0.smithi087.stdout:5/738: dread d13/d1b/d7e/fa2 [0,4194304] 0 2024-03-18T14:43:21.764 INFO:tasks.workunit.client.1.smithi129.stdout:2/544: truncate d7/d1f/d20/d2b/f39 1485631 0 2024-03-18T14:43:21.765 INFO:tasks.workunit.client.0.smithi087.stdout:9/797: unlink db/f22 0 2024-03-18T14:43:21.765 INFO:tasks.workunit.client.0.smithi087.stdout:2/723: creat d2/ddd/d22/d24/d65/fee x:0 0 0 2024-03-18T14:43:21.766 INFO:tasks.workunit.client.0.smithi087.stdout:9/798: fsync db/d18/d1e/fc3 0 2024-03-18T14:43:21.768 INFO:tasks.workunit.client.0.smithi087.stdout:5/739: creat d13/d1b/d7e/ff7 x:0 0 0 2024-03-18T14:43:21.769 INFO:tasks.workunit.client.0.smithi087.stdout:5/740: readlink l4 0 2024-03-18T14:43:21.771 INFO:tasks.workunit.client.0.smithi087.stdout:4/664: dread d2/db/de/f2f [0,4194304] 0 2024-03-18T14:43:21.772 INFO:tasks.workunit.client.1.smithi129.stdout:5/509: fdatasync d0/dc/d18/d2b/f57 0 2024-03-18T14:43:21.773 INFO:tasks.workunit.client.0.smithi087.stdout:2/724: dwrite d2/ddd/d22/d2c/d3a/d76/f7e [0,4194304] 0 2024-03-18T14:43:21.773 INFO:tasks.workunit.client.0.smithi087.stdout:7/805: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:21.773 INFO:tasks.workunit.client.1.smithi129.stdout:9/506: creat d0/db/d1f/d4c/d57/fa3 x:0 0 0 2024-03-18T14:43:21.776 INFO:tasks.workunit.client.0.smithi087.stdout:9/799: creat db/d18/d1e/d28/d76/db7/dbf/f10b x:0 0 0 2024-03-18T14:43:21.776 INFO:tasks.workunit.client.0.smithi087.stdout:3/745: rename d0/d1c/d25/l6b to d0/de/ld3 0 2024-03-18T14:43:21.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/700: rename d0/d2/d4/de8 to d0/d2/d4/de8/dad/dea/d5d/d78/df6 22 2024-03-18T14:43:21.777 INFO:tasks.workunit.client.1.smithi129.stdout:4/474: rmdir d0/d9/d40/d5f 39 2024-03-18T14:43:21.777 INFO:tasks.workunit.client.1.smithi129.stdout:1/536: fdatasync d1/d2/d28/d65/f30 0 2024-03-18T14:43:21.778 INFO:tasks.workunit.client.1.smithi129.stdout:1/537: write d1/f6c [199715,88542] 0 2024-03-18T14:43:21.778 INFO:tasks.workunit.client.1.smithi129.stdout:3/504: sync 2024-03-18T14:43:21.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/665: symlink d2/db/de/ldf 0 2024-03-18T14:43:21.780 INFO:tasks.workunit.client.0.smithi087.stdout:1/759: dread d3/d1d/d1e/d20/d7a/db4/fdf [0,4194304] 0 2024-03-18T14:43:21.780 INFO:tasks.workunit.client.1.smithi129.stdout:8/581: mkdir d9/d33/dc2 0 2024-03-18T14:43:21.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/760: chown d3/d1d/d1e/d20/dbd/fcf 428881 1 2024-03-18T14:43:21.781 INFO:tasks.workunit.client.0.smithi087.stdout:9/800: rmdir db/d18/d1e/dde/dce 39 2024-03-18T14:43:21.781 INFO:tasks.workunit.client.1.smithi129.stdout:2/545: mkdir d7/d1f/d34/da5 0 2024-03-18T14:43:21.786 INFO:tasks.workunit.client.1.smithi129.stdout:6/556: mkdir d3/d30/de/db3 0 2024-03-18T14:43:21.786 INFO:tasks.workunit.client.1.smithi129.stdout:5/510: symlink d0/dc/d18/d5f/l96 0 2024-03-18T14:43:21.786 INFO:tasks.workunit.client.1.smithi129.stdout:9/507: fsync d0/db/d11/d97/f9e 0 2024-03-18T14:43:21.787 INFO:tasks.workunit.client.0.smithi087.stdout:7/806: rename d1/d8e/d95/lef to d1/d6/d29/d2f/d68/d10f/l116 0 2024-03-18T14:43:21.787 INFO:tasks.workunit.client.0.smithi087.stdout:3/746: rmdir d0/de/d30/d46/dc3 39 2024-03-18T14:43:21.788 INFO:tasks.workunit.client.1.smithi129.stdout:0/573: rename d0/d23/c48 to d0/d14/d28/d63/d8d/cb2 0 2024-03-18T14:43:21.789 INFO:tasks.workunit.client.1.smithi129.stdout:4/475: creat d0/d19/d46/d3e/d21/d4d/d58/f96 x:0 0 0 2024-03-18T14:43:21.790 INFO:tasks.workunit.client.1.smithi129.stdout:1/538: mknod d1/d2/d28/d65/d19/d84/ca3 0 2024-03-18T14:43:21.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/683: dread d3/d7/d25/d62/d7c/d29/f27 [0,4194304] 0 2024-03-18T14:43:21.790 INFO:tasks.workunit.client.0.smithi087.stdout:8/698: sync 2024-03-18T14:43:21.793 INFO:tasks.workunit.client.1.smithi129.stdout:5/511: dwrite d0/d32/d3a/d45/f74 [0,4194304] 0 2024-03-18T14:43:21.793 INFO:tasks.workunit.client.1.smithi129.stdout:8/582: mknod d9/d11/d1a/d32/d41/d4d/d96/cc3 0 2024-03-18T14:43:21.793 INFO:tasks.workunit.client.1.smithi129.stdout:2/546: rmdir d7/d1f/d34 39 2024-03-18T14:43:21.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/725: creat d2/ddd/d22/d2c/d3a/d40/d98/dd8/fef x:0 0 0 2024-03-18T14:43:21.794 INFO:tasks.workunit.client.1.smithi129.stdout:2/547: write d7/f59 [341962,106044] 0 2024-03-18T14:43:21.797 INFO:tasks.workunit.client.1.smithi129.stdout:6/557: truncate d3/d30/de/d6c/f53 3540476 0 2024-03-18T14:43:21.800 INFO:tasks.workunit.client.1.smithi129.stdout:7/546: write d4/d7/d8/d3b/f6d [4376552,17931] 0 2024-03-18T14:43:21.801 INFO:tasks.workunit.client.1.smithi129.stdout:7/547: chown d4/d7/f64 32 1 2024-03-18T14:43:21.803 INFO:tasks.workunit.client.0.smithi087.stdout:9/801: fdatasync db/d18/d3a/f9f 0 2024-03-18T14:43:21.803 INFO:tasks.workunit.client.1.smithi129.stdout:7/548: dread d4/d7/d8/f3d [0,4194304] 0 2024-03-18T14:43:21.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/726: dread d2/ddd/d22/d2c/d3a/d40/f84 [0,4194304] 0 2024-03-18T14:43:21.804 INFO:tasks.workunit.client.1.smithi129.stdout:7/549: write d4/d2d/d2e/d42/d58/f7f [191182,123979] 0 2024-03-18T14:43:21.805 INFO:tasks.workunit.client.0.smithi087.stdout:1/761: dread d3/d1d/d1e/f36 [0,4194304] 0 2024-03-18T14:43:21.805 INFO:tasks.workunit.client.0.smithi087.stdout:5/741: link d13/d1b/d27/d35/dc6/fe8 d13/ff8 0 2024-03-18T14:43:21.806 INFO:tasks.workunit.client.1.smithi129.stdout:4/476: mkdir d0/d19/d46/d3e/d21/d97 0 2024-03-18T14:43:21.809 INFO:tasks.workunit.client.1.smithi129.stdout:1/539: creat d1/d2/d28/d65/d19/d96/fa4 x:0 0 0 2024-03-18T14:43:21.810 INFO:tasks.workunit.client.0.smithi087.stdout:3/747: rmdir d0/d3/d4f/d6e/dc8 39 2024-03-18T14:43:21.811 INFO:tasks.workunit.client.1.smithi129.stdout:1/540: chown d1/f9 1 1 2024-03-18T14:43:21.811 INFO:tasks.workunit.client.1.smithi129.stdout:5/512: rename d0/dc/d1a/c88 to d0/d32/d34/d6c/c97 0 2024-03-18T14:43:21.811 INFO:tasks.workunit.client.1.smithi129.stdout:7/550: dwrite d4/d7/d8/f1c [0,4194304] 0 2024-03-18T14:43:21.813 INFO:tasks.workunit.client.1.smithi129.stdout:1/541: stat d1/d2/d70/d56 0 2024-03-18T14:43:21.814 INFO:tasks.workunit.client.1.smithi129.stdout:0/574: dread d0/d23/d35/f36 [4194304,4194304] 0 2024-03-18T14:43:21.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/807: creat d1/d6/d29/d2f/d68/d65/f117 x:0 0 0 2024-03-18T14:43:21.814 INFO:tasks.workunit.client.0.smithi087.stdout:4/666: dread d2/fb2 [0,4194304] 0 2024-03-18T14:43:21.814 INFO:tasks.workunit.client.0.smithi087.stdout:0/701: mknod d0/d1a/d7b/d2a/dbb/cf7 0 2024-03-18T14:43:21.815 INFO:tasks.workunit.client.1.smithi129.stdout:4/477: dwrite d0/d19/d46/d3e/d33/f7d [0,4194304] 0 2024-03-18T14:43:21.815 INFO:tasks.workunit.client.1.smithi129.stdout:0/575: dread - d0/d14/d28/d63/fa2 zero size 2024-03-18T14:43:21.815 INFO:tasks.workunit.client.0.smithi087.stdout:6/684: creat d3/d7/d25/d62/d7c/da0/d96/d97/dc6/fe6 x:0 0 0 2024-03-18T14:43:21.816 INFO:tasks.workunit.client.1.smithi129.stdout:3/505: truncate d4/dd/f4d 2782656 0 2024-03-18T14:43:21.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/506: chown d4/d11/d1d/d50/d90 1 1 2024-03-18T14:43:21.817 INFO:tasks.workunit.client.0.smithi087.stdout:6/685: write d3/d7/d25/d62/d7c/d29/d22/d23/da9/fc1 [530310,2640] 0 2024-03-18T14:43:21.818 INFO:tasks.workunit.client.0.smithi087.stdout:8/699: rename d1/d6/d2f/d44/d45/d50/fe8 to d1/d6/d2f/d9b/db1/fea 0 2024-03-18T14:43:21.818 INFO:tasks.workunit.client.1.smithi129.stdout:3/507: write d4/dd/d1f/d5f/d82/da6/fa7 [66474,83632] 0 2024-03-18T14:43:21.819 INFO:tasks.workunit.client.0.smithi087.stdout:6/686: fsync d3/f6c 0 2024-03-18T14:43:21.820 INFO:tasks.workunit.client.0.smithi087.stdout:2/727: write d2/ddd/d22/f4d [2447782,89134] 0 2024-03-18T14:43:21.821 INFO:tasks.workunit.client.1.smithi129.stdout:9/508: truncate d0/db/d1f/d20/d25/d8e/f9a 1409 0 2024-03-18T14:43:21.821 INFO:tasks.workunit.client.1.smithi129.stdout:9/509: chown d0/db/d1f/d4c/d57/f63 118874863 1 2024-03-18T14:43:21.821 INFO:tasks.workunit.client.0.smithi087.stdout:4/667: dwrite d2/db/d24/d30/f91 [0,4194304] 0 2024-03-18T14:43:21.821 INFO:tasks.workunit.client.0.smithi087.stdout:7/808: symlink d1/d6/d29/d2f/d68/d65/d60/l118 0 2024-03-18T14:43:21.822 INFO:tasks.workunit.client.0.smithi087.stdout:0/702: creat d0/d1a/d80/d88/ff8 x:0 0 0 2024-03-18T14:43:21.823 INFO:tasks.workunit.client.0.smithi087.stdout:6/687: write d3/d7/d25/d62/d7c/d46/dc9/fdf [3225892,7221] 0 2024-03-18T14:43:21.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/548: rename d7/d1f/d20/d2b/d41/d65/d83 to d7/d1f/d20/d2b/d41/da6 0 2024-03-18T14:43:21.824 INFO:tasks.workunit.client.0.smithi087.stdout:7/809: dread - d1/d6/d29/d2f/d68/d65/d110/f112 zero size 2024-03-18T14:43:21.825 INFO:tasks.workunit.client.1.smithi129.stdout:9/510: dwrite d0/db/d11/f27 [0,4194304] 0 2024-03-18T14:43:21.825 INFO:tasks.workunit.client.0.smithi087.stdout:0/703: chown d0/d1a/d7b/d26/d79/l91 14 1 2024-03-18T14:43:21.826 INFO:tasks.workunit.client.1.smithi129.stdout:7/551: creat d4/d8c/faa x:0 0 0 2024-03-18T14:43:21.827 INFO:tasks.workunit.client.0.smithi087.stdout:7/810: stat d1/d6/d29/d2f/d68/d65/d60/l115 0 2024-03-18T14:43:21.827 INFO:tasks.workunit.client.0.smithi087.stdout:1/762: write d3/d1d/d1e/d43/d50/d72/f84 [740371,7332] 0 2024-03-18T14:43:21.827 INFO:tasks.workunit.client.1.smithi129.stdout:5/513: creat d0/d32/d34/d6c/f98 x:0 0 0 2024-03-18T14:43:21.829 INFO:tasks.workunit.client.0.smithi087.stdout:4/668: dwrite d2/f7e [0,4194304] 0 2024-03-18T14:43:21.831 INFO:tasks.workunit.client.0.smithi087.stdout:6/688: dwrite d3/f6c [4194304,4194304] 0 2024-03-18T14:43:21.831 INFO:tasks.workunit.client.0.smithi087.stdout:4/669: write d2/d13/d28/f42 [4017641,111711] 0 2024-03-18T14:43:21.833 INFO:tasks.workunit.client.0.smithi087.stdout:8/700: mknod d1/ceb 0 2024-03-18T14:43:21.833 INFO:tasks.workunit.client.1.smithi129.stdout:3/508: dread d4/d11/d34/d3c/d3f/f63 [4194304,4194304] 0 2024-03-18T14:43:21.834 INFO:tasks.workunit.client.0.smithi087.stdout:6/689: read - d3/d7/d25/d62/d7c/d29/d22/d61/fb3 zero size 2024-03-18T14:43:21.835 INFO:tasks.workunit.client.0.smithi087.stdout:1/763: dwrite d3/f93 [0,4194304] 0 2024-03-18T14:43:21.836 INFO:tasks.workunit.client.0.smithi087.stdout:5/742: mknod d13/cf9 0 2024-03-18T14:43:21.837 INFO:tasks.workunit.client.0.smithi087.stdout:4/670: dread d2/d13/d28/f42 [0,4194304] 0 2024-03-18T14:43:21.838 INFO:tasks.workunit.client.0.smithi087.stdout:4/671: dread - d2/db/d82/fc7 zero size 2024-03-18T14:43:21.840 INFO:tasks.workunit.client.1.smithi129.stdout:6/558: rename d3/d38 to d3/d6/d7f/db4 0 2024-03-18T14:43:21.840 INFO:tasks.workunit.client.1.smithi129.stdout:9/511: symlink d0/db/d11/la4 0 2024-03-18T14:43:21.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/514: mknod d0/dc/d1a/c99 0 2024-03-18T14:43:21.843 INFO:tasks.workunit.client.0.smithi087.stdout:3/748: symlink d0/d3/df/ld4 0 2024-03-18T14:43:21.845 INFO:tasks.workunit.client.1.smithi129.stdout:8/583: truncate f4 2982173 0 2024-03-18T14:43:21.846 INFO:tasks.workunit.client.0.smithi087.stdout:0/704: rmdir d0/d1a/d80/d88/dbd 39 2024-03-18T14:43:21.848 INFO:tasks.workunit.client.1.smithi129.stdout:0/576: symlink d0/d14/d3a/lb3 0 2024-03-18T14:43:21.850 INFO:tasks.workunit.client.1.smithi129.stdout:4/478: link d0/d19/d46/d3e/d21/d32/f57 d0/d19/d46/d3e/d21/d4d/d58/d61/f98 0 2024-03-18T14:43:21.851 INFO:tasks.workunit.client.0.smithi087.stdout:9/802: rename db/d18/d1e/d28/l3f to db/d18/d1e/d28/dc2/l10c 0 2024-03-18T14:43:21.852 INFO:tasks.workunit.client.0.smithi087.stdout:5/743: read f11 [2001267,25656] 0 2024-03-18T14:43:21.853 INFO:tasks.workunit.client.1.smithi129.stdout:6/559: unlink d3/d30/de/da9/lb2 0 2024-03-18T14:43:21.855 INFO:tasks.workunit.client.1.smithi129.stdout:8/584: creat d9/d33/fc4 x:0 0 0 2024-03-18T14:43:21.855 INFO:tasks.workunit.client.0.smithi087.stdout:8/701: truncate d1/d6/d2f/f41 23001 0 2024-03-18T14:43:21.857 INFO:tasks.workunit.client.1.smithi129.stdout:4/479: symlink d0/d19/d46/l99 0 2024-03-18T14:43:21.858 INFO:tasks.workunit.client.1.smithi129.stdout:6/560: write d3/d5/fa6 [1421078,94268] 0 2024-03-18T14:43:21.858 INFO:tasks.workunit.client.1.smithi129.stdout:5/515: dwrite d0/df/f59 [0,4194304] 0 2024-03-18T14:43:21.859 INFO:tasks.workunit.client.1.smithi129.stdout:1/542: creat d1/d2/d28/d65/d7c/d7d/fa5 x:0 0 0 2024-03-18T14:43:21.860 INFO:tasks.workunit.client.1.smithi129.stdout:0/577: getdents d0/d23/d35/d50/da5 0 2024-03-18T14:43:21.862 INFO:tasks.workunit.client.1.smithi129.stdout:2/549: rename d7/d1f/d20/d2d/f3e to d7/d1f/fa7 0 2024-03-18T14:43:21.863 INFO:tasks.workunit.client.0.smithi087.stdout:2/728: mknod d2/ddd/d22/d2c/d3a/d49/ddc/cf0 0 2024-03-18T14:43:21.864 INFO:tasks.workunit.client.1.smithi129.stdout:4/480: chown d0/l41 103773134 1 2024-03-18T14:43:21.868 INFO:tasks.workunit.client.1.smithi129.stdout:2/550: creat d7/d1f/d20/d36/fa8 x:0 0 0 2024-03-18T14:43:21.869 INFO:tasks.workunit.client.1.smithi129.stdout:8/585: getdents d9/d11/d1a/d32/d3a/d9a 0 2024-03-18T14:43:21.869 INFO:tasks.workunit.client.1.smithi129.stdout:2/551: readlink d7/l8 0 2024-03-18T14:43:21.870 INFO:tasks.workunit.client.1.smithi129.stdout:8/586: write d9/d11/d53/fa1 [12675,62370] 0 2024-03-18T14:43:21.870 INFO:tasks.workunit.client.1.smithi129.stdout:4/481: write d0/d19/d46/d3e/d21/d32/f57 [3417961,79831] 0 2024-03-18T14:43:21.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/690: mkdir d3/d7/d25/d62/d7c/d29/de7 0 2024-03-18T14:43:21.871 INFO:tasks.workunit.client.1.smithi129.stdout:4/482: chown d0/l41 28 1 2024-03-18T14:43:21.872 INFO:tasks.workunit.client.0.smithi087.stdout:2/729: rename d2/ddd/f1a to d2/ddd/d22/d2c/d3a/ff1 0 2024-03-18T14:43:21.874 INFO:tasks.workunit.client.1.smithi129.stdout:2/552: mkdir d7/d1f/d20/d36/da9 0 2024-03-18T14:43:21.875 INFO:tasks.workunit.client.1.smithi129.stdout:8/587: creat d9/d33/fc5 x:0 0 0 2024-03-18T14:43:21.875 INFO:tasks.workunit.client.1.smithi129.stdout:2/553: write d7/d1f/d20/d36/fa8 [686712,67810] 0 2024-03-18T14:43:21.875 INFO:tasks.workunit.client.1.smithi129.stdout:4/483: readlink d0/d19/d46/d3e/d21/d32/l55 0 2024-03-18T14:43:21.876 INFO:tasks.workunit.client.0.smithi087.stdout:5/744: truncate d13/f1e 1082784 0 2024-03-18T14:43:21.876 INFO:tasks.workunit.client.1.smithi129.stdout:2/554: fsync d7/d1c/d79/fa3 0 2024-03-18T14:43:21.878 INFO:tasks.workunit.client.0.smithi087.stdout:6/691: creat d3/d7/d25/d62/d7c/d46/dc9/fe8 x:0 0 0 2024-03-18T14:43:21.878 INFO:tasks.workunit.client.0.smithi087.stdout:0/705: link d0/d1a/d7b/l8a d0/d2/d4/d8b/lf9 0 2024-03-18T14:43:21.879 INFO:tasks.workunit.client.1.smithi129.stdout:7/552: rename d4/d2d/f18 to d4/d7/fab 0 2024-03-18T14:43:21.880 INFO:tasks.workunit.client.0.smithi087.stdout:2/730: dread d2/f32 [0,4194304] 0 2024-03-18T14:43:21.880 INFO:tasks.workunit.client.0.smithi087.stdout:9/803: creat db/f10d x:0 0 0 2024-03-18T14:43:21.881 INFO:tasks.workunit.client.1.smithi129.stdout:6/561: link d3/d30/de/d65/d80/f98 d3/d6/d7f/db4/fb5 0 2024-03-18T14:43:21.882 INFO:tasks.workunit.client.1.smithi129.stdout:0/578: getdents d0/d14/d3a/d4a/d7a 0 2024-03-18T14:43:21.883 INFO:tasks.workunit.client.0.smithi087.stdout:1/764: dread d3/d1d/d79/f7f [4194304,4194304] 0 2024-03-18T14:43:21.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/804: dwrite db/d18/d1e/ff4 [0,4194304] 0 2024-03-18T14:43:21.885 INFO:tasks.workunit.client.1.smithi129.stdout:2/555: fdatasync d7/d1f/d20/d2a/f7a 0 2024-03-18T14:43:21.885 INFO:tasks.workunit.client.0.smithi087.stdout:9/805: write db/f4b [711674,37362] 0 2024-03-18T14:43:21.887 INFO:tasks.workunit.client.1.smithi129.stdout:4/484: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:21.889 INFO:tasks.workunit.client.0.smithi087.stdout:7/811: dwrite d1/d6/d29/d2f/d68/d65/d60/f7a [0,4194304] 0 2024-03-18T14:43:21.890 INFO:tasks.workunit.client.0.smithi087.stdout:0/706: fdatasync d0/d1a/d80/f95 0 2024-03-18T14:43:21.892 INFO:tasks.workunit.client.1.smithi129.stdout:4/485: dwrite d0/d9/f15 [0,4194304] 0 2024-03-18T14:43:21.892 INFO:tasks.workunit.client.0.smithi087.stdout:3/749: dwrite d0/d3/df/f33 [0,4194304] 0 2024-03-18T14:43:21.894 INFO:tasks.workunit.client.0.smithi087.stdout:4/672: dwrite d2/db/d67/fbc [0,4194304] 0 2024-03-18T14:43:21.898 INFO:tasks.workunit.client.0.smithi087.stdout:1/765: stat d3/c13 0 2024-03-18T14:43:21.900 INFO:tasks.workunit.client.0.smithi087.stdout:2/731: read d2/d44/f45 [4963744,19371] 0 2024-03-18T14:43:21.902 INFO:tasks.workunit.client.1.smithi129.stdout:1/543: truncate d1/d35/f3f 4735084 0 2024-03-18T14:43:21.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/732: dwrite d2/ddd/d22/d24/f8e [0,4194304] 0 2024-03-18T14:43:21.905 INFO:tasks.workunit.client.0.smithi087.stdout:7/812: creat d1/d6/da/d42/d67/f119 x:0 0 0 2024-03-18T14:43:21.907 INFO:tasks.workunit.client.0.smithi087.stdout:0/707: creat d0/d2/d4/ffa x:0 0 0 2024-03-18T14:43:21.908 INFO:tasks.workunit.client.0.smithi087.stdout:4/673: rmdir d2/db/d67 39 2024-03-18T14:43:21.909 INFO:tasks.workunit.client.0.smithi087.stdout:0/708: chown d0/d2/d4/d19/d5a/f7d 26063512 1 2024-03-18T14:43:21.910 INFO:tasks.workunit.client.0.smithi087.stdout:4/674: write d2/db/f20 [781555,77522] 0 2024-03-18T14:43:21.910 INFO:tasks.workunit.client.0.smithi087.stdout:2/733: dwrite d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fbe [0,4194304] 0 2024-03-18T14:43:21.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/516: rename d0/dc/d22/l5d to d0/dc/d18/d5f/l9a 0 2024-03-18T14:43:21.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/709: stat d0/d1a/d7b/d26/l31 0 2024-03-18T14:43:21.911 INFO:tasks.workunit.client.1.smithi129.stdout:4/486: creat d0/d9/f9a x:0 0 0 2024-03-18T14:43:21.911 INFO:tasks.workunit.client.0.smithi087.stdout:8/702: sync 2024-03-18T14:43:21.911 INFO:tasks.workunit.client.0.smithi087.stdout:9/806: symlink db/d18/d1e/d28/d7c/dba/l10e 0 2024-03-18T14:43:21.912 INFO:tasks.workunit.client.0.smithi087.stdout:6/692: truncate d3/d7/d25/d8e/fae 614409 0 2024-03-18T14:43:21.915 INFO:tasks.workunit.client.1.smithi129.stdout:7/553: dread d4/d2d/d3a/f78 [0,4194304] 0 2024-03-18T14:43:21.917 INFO:tasks.workunit.client.1.smithi129.stdout:5/517: dwrite d0/dc/f7b [0,4194304] 0 2024-03-18T14:43:21.918 INFO:tasks.workunit.client.1.smithi129.stdout:4/487: dwrite d0/d19/d46/d2e/f82 [0,4194304] 0 2024-03-18T14:43:21.918 INFO:tasks.workunit.client.0.smithi087.stdout:7/813: rename d1/d8e to d1/d6/da/d59/dbe/d11a 0 2024-03-18T14:43:21.919 INFO:tasks.workunit.client.1.smithi129.stdout:3/509: sync 2024-03-18T14:43:21.923 INFO:tasks.workunit.client.1.smithi129.stdout:1/544: unlink d1/d2/d70/f74 0 2024-03-18T14:43:21.925 INFO:tasks.workunit.client.1.smithi129.stdout:8/588: getdents d9/d11/d1a/d14/dc0 0 2024-03-18T14:43:21.925 INFO:tasks.workunit.client.1.smithi129.stdout:6/562: dread d3/d30/df/f85 [0,4194304] 0 2024-03-18T14:43:21.927 INFO:tasks.workunit.client.0.smithi087.stdout:2/734: fsync d2/f99 0 2024-03-18T14:43:21.927 INFO:tasks.workunit.client.1.smithi129.stdout:0/579: dread d0/d23/d6b/f9a [0,4194304] 0 2024-03-18T14:43:21.927 INFO:tasks.workunit.client.0.smithi087.stdout:2/735: fsync d2/ddd/d22/d2c/d3a/d76/f7e 0 2024-03-18T14:43:21.928 INFO:tasks.workunit.client.0.smithi087.stdout:2/736: fdatasync d2/ddd/d22/d24/db2/fda 0 2024-03-18T14:43:21.930 INFO:tasks.workunit.client.1.smithi129.stdout:7/554: creat d4/d7/d38/d61/d68/d6b/d81/fac x:0 0 0 2024-03-18T14:43:21.930 INFO:tasks.workunit.client.0.smithi087.stdout:0/710: rmdir d0/d1a/d7b/d2a 39 2024-03-18T14:43:21.931 INFO:tasks.workunit.client.1.smithi129.stdout:3/510: chown d4/dd/f32 628 1 2024-03-18T14:43:21.935 INFO:tasks.workunit.client.0.smithi087.stdout:6/693: mkdir d3/d7/d25/d62/d7c/d29/d22/d75/d92/de9 0 2024-03-18T14:43:21.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/766: creat d3/d1d/fee x:0 0 0 2024-03-18T14:43:21.940 INFO:tasks.workunit.client.0.smithi087.stdout:2/737: mkdir d2/ddd/d22/d24/d65/df2 0 2024-03-18T14:43:21.942 INFO:tasks.workunit.client.0.smithi087.stdout:9/807: mknod db/d18/d1e/dde/dce/c10f 0 2024-03-18T14:43:21.945 INFO:tasks.workunit.client.0.smithi087.stdout:5/745: dwrite d13/d1b/d30/f5b [0,4194304] 0 2024-03-18T14:43:21.948 INFO:tasks.workunit.client.0.smithi087.stdout:3/750: getdents d0/de/d30/d8e 0 2024-03-18T14:43:21.949 INFO:tasks.workunit.client.0.smithi087.stdout:7/814: write d1/d6/da/f43 [1068836,56027] 0 2024-03-18T14:43:21.952 INFO:tasks.workunit.client.0.smithi087.stdout:1/767: chown d3/l60 538 1 2024-03-18T14:43:21.955 INFO:tasks.workunit.client.1.smithi129.stdout:1/545: rmdir d1/d2/d28/d65/d19 39 2024-03-18T14:43:21.955 INFO:tasks.workunit.client.1.smithi129.stdout:2/556: creat d7/d1f/d20/faa x:0 0 0 2024-03-18T14:43:21.955 INFO:tasks.workunit.client.1.smithi129.stdout:8/589: mknod d9/d33/cc6 0 2024-03-18T14:43:21.956 INFO:tasks.workunit.client.1.smithi129.stdout:7/555: symlink d4/d2d/d2e/d42/d58/lad 0 2024-03-18T14:43:21.957 INFO:tasks.workunit.client.1.smithi129.stdout:5/518: mkdir d0/d32/d3a/d45/d83/d9b 0 2024-03-18T14:43:21.957 INFO:tasks.workunit.client.0.smithi087.stdout:6/694: symlink d3/d7/d25/d62/lea 0 2024-03-18T14:43:21.958 INFO:tasks.workunit.client.0.smithi087.stdout:6/695: chown d3/d7/d25/d62/d7c/d29/d22/d75/f9b 26701671 1 2024-03-18T14:43:21.959 INFO:tasks.workunit.client.0.smithi087.stdout:4/675: rename d2/db/d67/c85 to d2/d13/d28/ce0 0 2024-03-18T14:43:21.960 INFO:tasks.workunit.client.0.smithi087.stdout:0/711: truncate d0/d2/d4/de8/dad/dea/d5d/d78/ff0 716914 0 2024-03-18T14:43:21.961 INFO:tasks.workunit.client.1.smithi129.stdout:0/580: truncate d0/d23/d29/f58 4828413 0 2024-03-18T14:43:21.961 INFO:tasks.workunit.client.1.smithi129.stdout:2/557: write d7/d3f/f87 [833895,25205] 0 2024-03-18T14:43:21.961 INFO:tasks.workunit.client.0.smithi087.stdout:2/738: mkdir d2/ddd/d5a/ded/df3 0 2024-03-18T14:43:21.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/768: truncate d3/d1d/d1f/f91 860190 0 2024-03-18T14:43:21.963 INFO:tasks.workunit.client.1.smithi129.stdout:6/563: dwrite d3/d5/f27 [4194304,4194304] 0 2024-03-18T14:43:21.963 INFO:tasks.workunit.client.0.smithi087.stdout:9/808: mknod db/d18/d1e/c110 0 2024-03-18T14:43:21.964 INFO:tasks.workunit.client.0.smithi087.stdout:8/703: truncate d1/d6/d2f/d44/d45/d72/db6/fca 35686 0 2024-03-18T14:43:21.965 INFO:tasks.workunit.client.0.smithi087.stdout:3/751: dread d0/de/d30/f5d [0,4194304] 0 2024-03-18T14:43:21.966 INFO:tasks.workunit.client.0.smithi087.stdout:4/676: dwrite d2/db/d24/d30/d7b/d7f/fb9 [0,4194304] 0 2024-03-18T14:43:21.970 INFO:tasks.workunit.client.0.smithi087.stdout:1/769: symlink d3/d1d/d1f/d34/d38/lef 0 2024-03-18T14:43:21.971 INFO:tasks.workunit.client.1.smithi129.stdout:6/564: mkdir d3/d30/de/d6c/d9e/db6 0 2024-03-18T14:43:21.971 INFO:tasks.workunit.client.1.smithi129.stdout:2/558: dread d7/d1c/f84 [0,4194304] 0 2024-03-18T14:43:21.971 INFO:tasks.workunit.client.0.smithi087.stdout:8/704: mkdir d1/d6/d2f/d44/d45/d71/dec 0 2024-03-18T14:43:21.972 INFO:tasks.workunit.client.0.smithi087.stdout:2/739: fdatasync d2/d44/d72/d79/fb0 0 2024-03-18T14:43:21.973 INFO:tasks.workunit.client.1.smithi129.stdout:3/511: truncate d4/d11/d1d/d36/f7d 846010 0 2024-03-18T14:43:21.973 INFO:tasks.workunit.client.0.smithi087.stdout:2/740: chown d2/ddd/d22/d2c/d3a/d40/f84 598 1 2024-03-18T14:43:21.974 INFO:tasks.workunit.client.0.smithi087.stdout:5/746: getdents d13/d1b/d27/d28 0 2024-03-18T14:43:21.975 INFO:tasks.workunit.client.1.smithi129.stdout:2/559: mkdir d7/d1f/d20/d2d/dab 0 2024-03-18T14:43:21.975 INFO:tasks.workunit.client.1.smithi129.stdout:1/546: link d1/d2/f3d d1/d2/d28/d65/d19/d52/fa6 0 2024-03-18T14:43:21.976 INFO:tasks.workunit.client.0.smithi087.stdout:6/696: rename d3/d7/d25/d62/d7c/d29/d22/d75/d92/f99 to d3/feb 0 2024-03-18T14:43:21.978 INFO:tasks.workunit.client.1.smithi129.stdout:9/512: sync 2024-03-18T14:43:21.978 INFO:tasks.workunit.client.1.smithi129.stdout:2/560: symlink d7/d3f/lac 0 2024-03-18T14:43:21.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/705: truncate d1/fd 4892436 0 2024-03-18T14:43:21.980 INFO:tasks.workunit.client.0.smithi087.stdout:8/706: dread - d1/d6/d2f/d44/d45/d71/daa/fdb zero size 2024-03-18T14:43:21.981 INFO:tasks.workunit.client.1.smithi129.stdout:5/519: truncate d0/df/f59 1177921 0 2024-03-18T14:43:21.981 INFO:tasks.workunit.client.1.smithi129.stdout:8/590: dread d9/d11/d1a/d32/d41/f7a [0,4194304] 0 2024-03-18T14:43:21.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/520: chown d0/df 603774 1 2024-03-18T14:43:21.982 INFO:tasks.workunit.client.1.smithi129.stdout:1/547: dwrite d1/d2/d70/d56/f6f [0,4194304] 0 2024-03-18T14:43:21.986 INFO:tasks.workunit.client.1.smithi129.stdout:0/581: getdents d0/d14/d28 0 2024-03-18T14:43:21.988 INFO:tasks.workunit.client.1.smithi129.stdout:6/565: dread d3/d30/de/d49/f50 [4194304,4194304] 0 2024-03-18T14:43:21.989 INFO:tasks.workunit.client.0.smithi087.stdout:1/770: dread d3/d1d/d1f/d34/f3e [0,4194304] 0 2024-03-18T14:43:21.990 INFO:tasks.workunit.client.0.smithi087.stdout:1/771: write d3/d1d/d1e/d20/f5c [4160582,101990] 0 2024-03-18T14:43:21.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/512: truncate d4/d11/d34/d53/f80 753189 0 2024-03-18T14:43:21.991 INFO:tasks.workunit.client.0.smithi087.stdout:1/772: dread - d3/d1d/d1e/d43/d50/d72/dc8/fe2 zero size 2024-03-18T14:43:21.991 INFO:tasks.workunit.client.1.smithi129.stdout:9/513: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:21.992 INFO:tasks.workunit.client.1.smithi129.stdout:2/561: read d7/d1f/d20/d2d/f2e [379000,80829] 0 2024-03-18T14:43:21.992 INFO:tasks.workunit.client.1.smithi129.stdout:9/514: stat d0/db 0 2024-03-18T14:43:21.994 INFO:tasks.workunit.client.1.smithi129.stdout:6/566: dread d3/d30/df/f85 [0,4194304] 0 2024-03-18T14:43:21.994 INFO:tasks.workunit.client.1.smithi129.stdout:1/548: unlink d1/d2/d28/f7f 0 2024-03-18T14:43:21.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/677: creat d2/db/fe1 x:0 0 0 2024-03-18T14:43:21.995 INFO:tasks.workunit.client.1.smithi129.stdout:0/582: creat d0/d23/d35/fb4 x:0 0 0 2024-03-18T14:43:21.995 INFO:tasks.workunit.client.0.smithi087.stdout:8/707: fdatasync d1/d6/d2f/d44/d4b/f54 0 2024-03-18T14:43:21.997 INFO:tasks.workunit.client.1.smithi129.stdout:5/521: mknod d0/d32/d3a/d45/d83/d9b/c9c 0 2024-03-18T14:43:21.997 INFO:tasks.workunit.client.0.smithi087.stdout:0/712: link d0/d1a/d7b/d2a/d9a/cb2 d0/d1a/d7b/d2a/cfb 0 2024-03-18T14:43:21.999 INFO:tasks.workunit.client.1.smithi129.stdout:3/513: symlink d4/d11/d34/d53/laf 0 2024-03-18T14:43:21.999 INFO:tasks.workunit.client.0.smithi087.stdout:2/741: mknod d2/d44/cf4 0 2024-03-18T14:43:22.000 INFO:tasks.workunit.client.0.smithi087.stdout:2/742: fdatasync d2/ddd/f46 0 2024-03-18T14:43:22.000 INFO:tasks.workunit.client.1.smithi129.stdout:2/562: creat d7/d1f/d20/d2b/d41/d65/fad x:0 0 0 2024-03-18T14:43:22.001 INFO:tasks.workunit.client.0.smithi087.stdout:5/747: symlink d13/d1b/d27/d28/d9a/df0/lfa 0 2024-03-18T14:43:22.004 INFO:tasks.workunit.client.1.smithi129.stdout:1/549: unlink d1/d2/d28/d65/d19/d52/f90 0 2024-03-18T14:43:22.004 INFO:tasks.workunit.client.0.smithi087.stdout:9/809: getdents db/d18/d1e/d7e 0 2024-03-18T14:43:22.004 INFO:tasks.workunit.client.0.smithi087.stdout:6/697: mknod d3/d7/d25/d62/d7c/d29/d22/cec 0 2024-03-18T14:43:22.005 INFO:tasks.workunit.client.1.smithi129.stdout:8/591: truncate d9/d33/fc5 743546 0 2024-03-18T14:43:22.005 INFO:tasks.workunit.client.1.smithi129.stdout:8/592: chown d9/c10 11790 1 2024-03-18T14:43:22.006 INFO:tasks.workunit.client.1.smithi129.stdout:5/522: creat d0/dc/d1a/d61/f9d x:0 0 0 2024-03-18T14:43:22.007 INFO:tasks.workunit.client.0.smithi087.stdout:0/713: creat d0/d1a/d7b/d2a/ffc x:0 0 0 2024-03-18T14:43:22.008 INFO:tasks.workunit.client.0.smithi087.stdout:9/810: dread db/d18/d3a/f6b [0,4194304] 0 2024-03-18T14:43:22.009 INFO:tasks.workunit.client.1.smithi129.stdout:6/567: mkdir d3/d30/df/d28/d79/daf/db7 0 2024-03-18T14:43:22.009 INFO:tasks.workunit.client.0.smithi087.stdout:1/773: symlink d3/d1d/d1e/d43/d9b/lf0 0 2024-03-18T14:43:22.010 INFO:tasks.workunit.client.0.smithi087.stdout:1/774: readlink d3/d3c/db8/le5 0 2024-03-18T14:43:22.011 INFO:tasks.workunit.client.0.smithi087.stdout:6/698: creat d3/d7/d25/d62/d7c/d29/dce/fed x:0 0 0 2024-03-18T14:43:22.012 INFO:tasks.workunit.client.1.smithi129.stdout:4/488: sync 2024-03-18T14:43:22.012 INFO:tasks.workunit.client.1.smithi129.stdout:7/556: sync 2024-03-18T14:43:22.012 INFO:tasks.workunit.client.0.smithi087.stdout:6/699: chown d3/d7/d25/d62/d7c/d29/f56 2 1 2024-03-18T14:43:22.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/714: creat d0/d2/d4/de8/dad/ffd x:0 0 0 2024-03-18T14:43:22.015 INFO:tasks.workunit.client.1.smithi129.stdout:0/583: creat d0/d14/d91/fb5 x:0 0 0 2024-03-18T14:43:22.016 INFO:tasks.workunit.client.0.smithi087.stdout:6/700: creat d3/d7/d25/d62/d8b/fee x:0 0 0 2024-03-18T14:43:22.017 INFO:tasks.workunit.client.0.smithi087.stdout:4/678: dread d2/db/d24/f4b [0,4194304] 0 2024-03-18T14:43:22.019 INFO:tasks.workunit.client.0.smithi087.stdout:1/775: rename d3/d1d/d1e/d43/da3/fe6 to d3/d1d/d1e/d43/d9b/ff1 0 2024-03-18T14:43:22.019 INFO:tasks.workunit.client.0.smithi087.stdout:0/715: dwrite d0/d2/d4/de8/dad/ffd [0,4194304] 0 2024-03-18T14:43:22.020 INFO:tasks.workunit.client.0.smithi087.stdout:2/743: dread d2/f10 [4194304,4194304] 0 2024-03-18T14:43:22.020 INFO:tasks.workunit.client.1.smithi129.stdout:3/514: mkdir d4/dd/db0 0 2024-03-18T14:43:22.021 INFO:tasks.workunit.client.1.smithi129.stdout:9/515: dwrite d0/db/d1f/d20/d25/d8e/f9a [0,4194304] 0 2024-03-18T14:43:22.021 INFO:tasks.workunit.client.1.smithi129.stdout:2/563: mknod d7/d1f/d81/cae 0 2024-03-18T14:43:22.023 INFO:tasks.workunit.client.0.smithi087.stdout:6/701: creat d3/d7/d25/d62/d7c/d29/d22/d75/d92/fef x:0 0 0 2024-03-18T14:43:22.023 INFO:tasks.workunit.client.1.smithi129.stdout:3/515: chown d4/d11/d1d/d50/d91/d93/l56 173644 1 2024-03-18T14:43:22.023 INFO:tasks.workunit.client.0.smithi087.stdout:9/811: getdents db/d18/d1e/dde 0 2024-03-18T14:43:22.023 INFO:tasks.workunit.client.1.smithi129.stdout:7/557: dread d4/d2d/f3e [0,4194304] 0 2024-03-18T14:43:22.024 INFO:tasks.workunit.client.0.smithi087.stdout:6/702: stat d3/d7/d25/d62/d7c/d29/de7 0 2024-03-18T14:43:22.024 INFO:tasks.workunit.client.1.smithi129.stdout:3/516: readlink d4/d11/d34/d53/d87/l6f 0 2024-03-18T14:43:22.024 INFO:tasks.workunit.client.1.smithi129.stdout:0/584: fsync d0/d23/d71/f7f 0 2024-03-18T14:43:22.025 INFO:tasks.workunit.client.1.smithi129.stdout:1/550: mkdir d1/d2/d28/da7 0 2024-03-18T14:43:22.025 INFO:tasks.workunit.client.1.smithi129.stdout:0/585: stat d0/d14/d28/f30 0 2024-03-18T14:43:22.025 INFO:tasks.workunit.client.1.smithi129.stdout:8/593: mknod d9/d11/d1a/d14/db7/dc1/cc7 0 2024-03-18T14:43:22.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/752: sync 2024-03-18T14:43:22.026 INFO:tasks.workunit.client.1.smithi129.stdout:1/551: chown d1/d2/d28/d65/d19/d84/ca3 666674 1 2024-03-18T14:43:22.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/753: write d0/d3/df/f14 [7612427,1605] 0 2024-03-18T14:43:22.029 INFO:tasks.workunit.client.1.smithi129.stdout:4/489: write d0/f1c [1247345,17586] 0 2024-03-18T14:43:22.029 INFO:tasks.workunit.client.1.smithi129.stdout:2/564: read d7/f1d [673830,35556] 0 2024-03-18T14:43:22.032 INFO:tasks.workunit.client.0.smithi087.stdout:1/776: dwrite d3/d1d/d1f/d34/f3e [4194304,4194304] 0 2024-03-18T14:43:22.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/744: symlink d2/ddd/d22/d24/lf5 0 2024-03-18T14:43:22.037 INFO:tasks.workunit.client.0.smithi087.stdout:0/716: symlink d0/d2/d6b/dca/lfe 0 2024-03-18T14:43:22.037 INFO:tasks.workunit.client.1.smithi129.stdout:5/523: rename d0/d32/d3a/c63 to d0/dc/c9e 0 2024-03-18T14:43:22.038 INFO:tasks.workunit.client.0.smithi087.stdout:4/679: creat d2/d13/fe2 x:0 0 0 2024-03-18T14:43:22.038 INFO:tasks.workunit.client.0.smithi087.stdout:4/680: readlink d2/l47 0 2024-03-18T14:43:22.040 INFO:tasks.workunit.client.0.smithi087.stdout:3/754: mknod d0/de/d30/d46/d76/cd5 0 2024-03-18T14:43:22.040 INFO:tasks.workunit.client.1.smithi129.stdout:3/517: truncate d4/dd/f4d 1300809 0 2024-03-18T14:43:22.041 INFO:tasks.workunit.client.1.smithi129.stdout:3/518: write d4/d11/d34/d53/f8e [4086912,2326] 0 2024-03-18T14:43:22.042 INFO:tasks.workunit.client.0.smithi087.stdout:1/777: creat d3/d3c/ff2 x:0 0 0 2024-03-18T14:43:22.043 INFO:tasks.workunit.client.0.smithi087.stdout:9/812: dwrite db/d18/d1e/d28/f4a [0,4194304] 0 2024-03-18T14:43:22.044 INFO:tasks.workunit.client.1.smithi129.stdout:6/568: getdents d3/d30 0 2024-03-18T14:43:22.045 INFO:tasks.workunit.client.0.smithi087.stdout:0/717: unlink d0/d1a/d7b/d2a/dbb/cf7 0 2024-03-18T14:43:22.045 INFO:tasks.workunit.client.0.smithi087.stdout:4/681: write d2/db/de/f2f [152279,56221] 0 2024-03-18T14:43:22.046 INFO:tasks.workunit.client.0.smithi087.stdout:0/718: write d0/d1a/d80/d88/f15 [1994610,115752] 0 2024-03-18T14:43:22.046 INFO:tasks.workunit.client.1.smithi129.stdout:7/558: rename d4/d7/ca0 to d4/d7/d38/d61/cae 0 2024-03-18T14:43:22.047 INFO:tasks.workunit.client.0.smithi087.stdout:3/755: mknod d0/d3/df/d42/dbc/cd6 0 2024-03-18T14:43:22.047 INFO:tasks.workunit.client.1.smithi129.stdout:5/524: mkdir d0/d32/d34/d9f 0 2024-03-18T14:43:22.048 INFO:tasks.workunit.client.0.smithi087.stdout:2/745: mkdir d2/ddd/d22/d24/de8/df6 0 2024-03-18T14:43:22.048 INFO:tasks.workunit.client.1.smithi129.stdout:2/565: mknod d7/d1f/d20/d2d/dab/caf 0 2024-03-18T14:43:22.049 INFO:tasks.workunit.client.1.smithi129.stdout:5/525: chown d0/dc/d1a/l41 18 1 2024-03-18T14:43:22.050 INFO:tasks.workunit.client.0.smithi087.stdout:9/813: mkdir db/d18/d1e/d28/d7c/dba/d111 0 2024-03-18T14:43:22.050 INFO:tasks.workunit.client.1.smithi129.stdout:6/569: dwrite d3/d6/d7f/db4/f9c [0,4194304] 0 2024-03-18T14:43:22.050 INFO:tasks.workunit.client.1.smithi129.stdout:5/526: fdatasync d0/dc/d18/d5f/f86 0 2024-03-18T14:43:22.051 INFO:tasks.workunit.client.1.smithi129.stdout:2/566: read - d7/d1f/d20/d2b/d41/d65/d88/f8a zero size 2024-03-18T14:43:22.052 INFO:tasks.workunit.client.1.smithi129.stdout:8/594: truncate d9/f4c 429808 0 2024-03-18T14:43:22.052 INFO:tasks.workunit.client.1.smithi129.stdout:9/516: truncate d0/db/d1f/d20/d26/d5f/f72 489750 0 2024-03-18T14:43:22.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/682: dwrite d2/db/d24/f33 [4194304,4194304] 0 2024-03-18T14:43:22.055 INFO:tasks.workunit.client.1.smithi129.stdout:0/586: rmdir d0/d23/d35/d9e 0 2024-03-18T14:43:22.055 INFO:tasks.workunit.client.0.smithi087.stdout:0/719: dwrite d0/d1a/d7b/d2a/f52 [0,4194304] 0 2024-03-18T14:43:22.055 INFO:tasks.workunit.client.0.smithi087.stdout:3/756: dwrite d0/f6d [0,4194304] 0 2024-03-18T14:43:22.055 INFO:tasks.workunit.client.1.smithi129.stdout:3/519: fsync d4/dd/f8f 0 2024-03-18T14:43:22.058 INFO:tasks.workunit.client.1.smithi129.stdout:1/552: rename d1/d2/d28/d65/c20 to d1/d35/d7a/ca8 0 2024-03-18T14:43:22.059 INFO:tasks.workunit.client.1.smithi129.stdout:7/559: mknod d4/d7/d8/d3b/caf 0 2024-03-18T14:43:22.059 INFO:tasks.workunit.client.0.smithi087.stdout:2/746: truncate d2/d44/f45 6380707 0 2024-03-18T14:43:22.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/757: rename d0/d3/df/f3f to d0/de/d30/d46/d76/fd7 0 2024-03-18T14:43:22.065 INFO:tasks.workunit.client.0.smithi087.stdout:2/747: creat d2/ddd/d22/d2c/d3a/d76/d9a/db5/ff7 x:0 0 0 2024-03-18T14:43:22.065 INFO:tasks.workunit.client.0.smithi087.stdout:3/758: write d0/fb6 [1644297,69837] 0 2024-03-18T14:43:22.067 INFO:tasks.workunit.client.1.smithi129.stdout:2/567: chown d7/d1f/d34 6 1 2024-03-18T14:43:22.074 INFO:tasks.workunit.client.1.smithi129.stdout:0/587: fsync d0/d23/d71/faa 0 2024-03-18T14:43:22.075 INFO:tasks.workunit.client.0.smithi087.stdout:1/778: write d3/f17 [1894698,68261] 0 2024-03-18T14:43:22.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/517: rename d0/db/d1f/d20/d6c/l75 to d0/db/d90/d70/d93/la5 0 2024-03-18T14:43:22.078 INFO:tasks.workunit.client.1.smithi129.stdout:9/518: dread - d0/db/d90/d3e/f81 zero size 2024-03-18T14:43:22.078 INFO:tasks.workunit.client.0.smithi087.stdout:1/779: creat d3/d1d/d1e/d43/d9b/ff3 x:0 0 0 2024-03-18T14:43:22.079 INFO:tasks.workunit.client.0.smithi087.stdout:1/780: chown d3/d1d/d1e/d20/f52 9 1 2024-03-18T14:43:22.080 INFO:tasks.workunit.client.0.smithi087.stdout:4/683: write d2/d13/d28/f70 [447147,129511] 0 2024-03-18T14:43:22.081 INFO:tasks.workunit.client.0.smithi087.stdout:0/720: write d0/d2/d4/d19/f41 [4782221,71651] 0 2024-03-18T14:43:22.081 INFO:tasks.workunit.client.0.smithi087.stdout:1/781: dread - d3/d1d/d45/fa6 zero size 2024-03-18T14:43:22.081 INFO:tasks.workunit.client.0.smithi087.stdout:9/814: dwrite db/d12/f5e [0,4194304] 0 2024-03-18T14:43:22.083 INFO:tasks.workunit.client.0.smithi087.stdout:9/815: read - db/d18/d1e/d7e/db8/fe7 zero size 2024-03-18T14:43:22.084 INFO:tasks.workunit.client.1.smithi129.stdout:8/595: dread d9/d11/d1a/f4b [0,4194304] 0 2024-03-18T14:43:22.084 INFO:tasks.workunit.client.1.smithi129.stdout:4/490: dwrite d0/d9/d40/d5f/f62 [0,4194304] 0 2024-03-18T14:43:22.084 INFO:tasks.workunit.client.1.smithi129.stdout:2/568: creat d7/d1f/d81/fb0 x:0 0 0 2024-03-18T14:43:22.085 INFO:tasks.workunit.client.0.smithi087.stdout:4/684: readlink d2/db/d3c/l62 0 2024-03-18T14:43:22.085 INFO:tasks.workunit.client.1.smithi129.stdout:9/519: dwrite d0/db/d1f/d20/f85 [0,4194304] 0 2024-03-18T14:43:22.086 INFO:tasks.workunit.client.0.smithi087.stdout:0/721: mkdir d0/d2/d4/d27/dc3/dd2/dff 0 2024-03-18T14:43:22.086 INFO:tasks.workunit.client.1.smithi129.stdout:4/491: dread - d0/d19/d46/d3e/d21/d4d/d58/f8f zero size 2024-03-18T14:43:22.087 INFO:tasks.workunit.client.1.smithi129.stdout:9/520: chown d0/db/d1f/d20/d25/d8e/c91 1889 1 2024-03-18T14:43:22.088 INFO:tasks.workunit.client.1.smithi129.stdout:3/520: mkdir d4/d38/da3/db1 0 2024-03-18T14:43:22.090 INFO:tasks.workunit.client.0.smithi087.stdout:4/685: mkdir d2/db/d24/d30/d7b/dbe/ddc/de3 0 2024-03-18T14:43:22.091 INFO:tasks.workunit.client.1.smithi129.stdout:2/569: dwrite d7/d3f/d5f/f8e [0,4194304] 0 2024-03-18T14:43:22.092 INFO:tasks.workunit.client.1.smithi129.stdout:7/560: dread d4/d7/d8/d3b/f59 [0,4194304] 0 2024-03-18T14:43:22.095 INFO:tasks.workunit.client.1.smithi129.stdout:9/521: creat d0/db/d90/d70/fa6 x:0 0 0 2024-03-18T14:43:22.095 INFO:tasks.workunit.client.1.smithi129.stdout:1/553: sync 2024-03-18T14:43:22.096 INFO:tasks.workunit.client.1.smithi129.stdout:0/588: rename d0/l68 to d0/d23/d35/lb6 0 2024-03-18T14:43:22.097 INFO:tasks.workunit.client.1.smithi129.stdout:8/596: mknod d9/d11/db3/cc8 0 2024-03-18T14:43:22.097 INFO:tasks.workunit.client.1.smithi129.stdout:0/589: chown d0/d14/d28/d63/ca4 219675 1 2024-03-18T14:43:22.100 INFO:tasks.workunit.client.0.smithi087.stdout:0/722: link d0/d2/d3c/f58 d0/d1a/d7b/d26/d79/f100 0 2024-03-18T14:43:22.101 INFO:tasks.workunit.client.1.smithi129.stdout:5/527: truncate d0/f2 2333000 0 2024-03-18T14:43:22.101 INFO:tasks.workunit.client.1.smithi129.stdout:8/597: dwrite d9/d11/d55/d68/f76 [0,4194304] 0 2024-03-18T14:43:22.102 INFO:tasks.workunit.client.1.smithi129.stdout:6/570: truncate d3/d30/df/d28/f54 627021 0 2024-03-18T14:43:22.103 INFO:tasks.workunit.client.0.smithi087.stdout:8/708: sync 2024-03-18T14:43:22.103 INFO:tasks.workunit.client.1.smithi129.stdout:8/598: chown d9/d11/d18/l43 2414 1 2024-03-18T14:43:22.104 INFO:tasks.workunit.client.0.smithi087.stdout:0/723: dwrite d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:22.105 INFO:tasks.workunit.client.1.smithi129.stdout:2/570: write d7/d1f/d34/f82 [6015506,16055] 0 2024-03-18T14:43:22.107 INFO:tasks.workunit.client.0.smithi087.stdout:8/709: creat d1/d6/d8d/fed x:0 0 0 2024-03-18T14:43:22.107 INFO:tasks.workunit.client.1.smithi129.stdout:6/571: dwrite d3/d30/d44/f77 [0,4194304] 0 2024-03-18T14:43:22.108 INFO:tasks.workunit.client.0.smithi087.stdout:9/816: dread db/d18/d1e/d28/d7c/f7d [0,4194304] 0 2024-03-18T14:43:22.108 INFO:tasks.workunit.client.1.smithi129.stdout:6/572: write d3/d30/de/d6c/f31 [2900619,59467] 0 2024-03-18T14:43:22.108 INFO:tasks.workunit.client.1.smithi129.stdout:1/554: fdatasync d1/f88 0 2024-03-18T14:43:22.110 INFO:tasks.workunit.client.0.smithi087.stdout:8/710: chown d1/d6/d2f/d44/d45/d71/cae 861794462 1 2024-03-18T14:43:22.111 INFO:tasks.workunit.client.1.smithi129.stdout:3/521: rename d4/d11/f43 to d4/dd/db0/fb2 0 2024-03-18T14:43:22.112 INFO:tasks.workunit.client.1.smithi129.stdout:5/528: mknod d0/dc/d1a/ca0 0 2024-03-18T14:43:22.113 INFO:tasks.workunit.client.1.smithi129.stdout:8/599: symlink d9/d11/db3/lc9 0 2024-03-18T14:43:22.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/600: readlink d9/d11/d1a/d14/l6d 0 2024-03-18T14:43:22.116 INFO:tasks.workunit.client.0.smithi087.stdout:8/711: unlink d1/cb5 0 2024-03-18T14:43:22.118 INFO:tasks.workunit.client.1.smithi129.stdout:9/522: creat d0/db/d2e/d9d/fa7 x:0 0 0 2024-03-18T14:43:22.119 INFO:tasks.workunit.client.1.smithi129.stdout:9/523: fdatasync d0/db/d1f/d4c/d57/f82 0 2024-03-18T14:43:22.121 INFO:tasks.workunit.client.0.smithi087.stdout:9/817: link db/d18/d3a/l86 db/d18/d51/d7b/l112 0 2024-03-18T14:43:22.122 INFO:tasks.workunit.client.0.smithi087.stdout:9/818: write db/d18/df1/ffe [564587,87017] 0 2024-03-18T14:43:22.123 INFO:tasks.workunit.client.1.smithi129.stdout:7/561: creat d4/d7/fb0 x:0 0 0 2024-03-18T14:43:22.124 INFO:tasks.workunit.client.1.smithi129.stdout:7/562: readlink d4/d7/l37 0 2024-03-18T14:43:22.125 INFO:tasks.workunit.client.1.smithi129.stdout:4/492: link d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/f94 d0/d3c/d6c/d89/f9b 0 2024-03-18T14:43:22.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/524: dwrite d0/db/d1f/f7b [0,4194304] 0 2024-03-18T14:43:22.128 INFO:tasks.workunit.client.1.smithi129.stdout:1/555: dwrite d1/d35/d7a/f94 [0,4194304] 0 2024-03-18T14:43:22.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/493: chown d0/d19/d46/d3e/d21/l69 3853 1 2024-03-18T14:43:22.130 INFO:tasks.workunit.client.1.smithi129.stdout:5/529: dwrite d0/f6 [4194304,4194304] 0 2024-03-18T14:43:22.131 INFO:tasks.workunit.client.1.smithi129.stdout:5/530: dread - d0/d32/d34/f85 zero size 2024-03-18T14:43:22.134 INFO:tasks.workunit.client.1.smithi129.stdout:4/494: dwrite d0/d19/d46/d3e/f29 [0,4194304] 0 2024-03-18T14:43:22.136 INFO:tasks.workunit.client.0.smithi087.stdout:6/703: sync 2024-03-18T14:43:22.136 INFO:tasks.workunit.client.0.smithi087.stdout:2/748: sync 2024-03-18T14:43:22.136 INFO:tasks.workunit.client.0.smithi087.stdout:8/712: rename d1/d6/d2f/d44/d45/d50/l5a to d1/d6/d2f/d44/d45/d72/d7f/lee 0 2024-03-18T14:43:22.136 INFO:tasks.workunit.client.1.smithi129.stdout:8/601: rename d9/d11/d55/d6a/fb1 to d9/d11/d1a/d32/d41/d4d/fca 0 2024-03-18T14:43:22.137 INFO:tasks.workunit.client.0.smithi087.stdout:2/749: chown d2/f99 198175665 1 2024-03-18T14:43:22.137 INFO:tasks.workunit.client.0.smithi087.stdout:9/819: write db/d18/d1e/d28/d76/d80/fa5 [364609,118507] 0 2024-03-18T14:43:22.137 INFO:tasks.workunit.client.1.smithi129.stdout:8/602: write d9/d11/d1a/d32/d3a/d70/f86 [1302057,68001] 0 2024-03-18T14:43:22.141 INFO:tasks.workunit.client.0.smithi087.stdout:1/782: read d3/d1d/d1e/d43/d50/d72/f86 [1186651,43615] 0 2024-03-18T14:43:22.142 INFO:tasks.workunit.client.1.smithi129.stdout:1/556: creat d1/d2/d70/d87/fa9 x:0 0 0 2024-03-18T14:43:22.142 INFO:tasks.workunit.client.1.smithi129.stdout:1/557: chown d1/d2/d70/l5b 1084 1 2024-03-18T14:43:22.143 INFO:tasks.workunit.client.0.smithi087.stdout:9/820: mkdir db/d18/d3a/d113 0 2024-03-18T14:43:22.147 INFO:tasks.workunit.client.1.smithi129.stdout:2/571: dwrite d7/f1d [0,4194304] 0 2024-03-18T14:43:22.150 INFO:tasks.workunit.client.1.smithi129.stdout:0/590: dwrite d0/d14/d3a/f4c [0,4194304] 0 2024-03-18T14:43:22.151 INFO:tasks.workunit.client.1.smithi129.stdout:0/591: chown d0/d14/d53/la0 58 1 2024-03-18T14:43:22.154 INFO:tasks.workunit.client.1.smithi129.stdout:5/531: fsync d0/dc/d18/d2b/f47 0 2024-03-18T14:43:22.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/573: link d3/d30/de/d6c/l5d d3/lb8 0 2024-03-18T14:43:22.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/495: mknod d0/d9/d40/d5f/c9c 0 2024-03-18T14:43:22.157 INFO:tasks.workunit.client.1.smithi129.stdout:8/603: mkdir d9/d11/d53/d5f/dcb 0 2024-03-18T14:43:22.158 INFO:tasks.workunit.client.1.smithi129.stdout:8/604: fdatasync d9/f1b 0 2024-03-18T14:43:22.159 INFO:tasks.workunit.client.1.smithi129.stdout:7/563: creat d4/d8c/d9e/fb1 x:0 0 0 2024-03-18T14:43:22.160 INFO:tasks.workunit.client.1.smithi129.stdout:9/525: creat d0/db/d1f/d20/d26/d19/d8d/fa8 x:0 0 0 2024-03-18T14:43:22.162 INFO:tasks.workunit.client.1.smithi129.stdout:1/558: rename d1/f60 to d1/d2/d28/d65/d19/d84/faa 0 2024-03-18T14:43:22.162 INFO:tasks.workunit.client.1.smithi129.stdout:8/605: chown d9/d11/d55/d6a/d6f/la6 319 1 2024-03-18T14:43:22.163 INFO:tasks.workunit.client.0.smithi087.stdout:1/783: dwrite d3/d1d/d1e/d20/f85 [0,4194304] 0 2024-03-18T14:43:22.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/526: read - d0/db/d1f/d20/d25/d8e/f67 zero size 2024-03-18T14:43:22.163 INFO:tasks.workunit.client.0.smithi087.stdout:9/821: write db/d12/fb2 [1485048,69791] 0 2024-03-18T14:43:22.164 INFO:tasks.workunit.client.1.smithi129.stdout:5/532: dwrite d0/dc/d1a/d61/f9d [0,4194304] 0 2024-03-18T14:43:22.164 INFO:tasks.workunit.client.1.smithi129.stdout:4/496: dwrite d0/d19/d46/d3e/f76 [4194304,4194304] 0 2024-03-18T14:43:22.167 INFO:tasks.workunit.client.1.smithi129.stdout:8/606: write d9/d11/d1a/d32/d3a/f8f [145877,107005] 0 2024-03-18T14:43:22.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/822: dwrite db/d12/fb2 [0,4194304] 0 2024-03-18T14:43:22.170 INFO:tasks.workunit.client.0.smithi087.stdout:9/823: creat db/d18/d1c/d69/d6f/f114 x:0 0 0 2024-03-18T14:43:22.170 INFO:tasks.workunit.client.1.smithi129.stdout:5/533: dwrite d0/d32/d34/d6c/f78 [0,4194304] 0 2024-03-18T14:43:22.174 INFO:tasks.workunit.client.0.smithi087.stdout:9/824: creat db/d18/d1c/d69/d6f/f115 x:0 0 0 2024-03-18T14:43:22.174 INFO:tasks.workunit.client.1.smithi129.stdout:5/534: dread d0/f6 [4194304,4194304] 0 2024-03-18T14:43:22.176 INFO:tasks.workunit.client.0.smithi087.stdout:3/759: sync 2024-03-18T14:43:22.177 INFO:tasks.workunit.client.1.smithi129.stdout:3/522: link d4/d11/d34/d53/f80 d4/fb3 0 2024-03-18T14:43:22.178 INFO:tasks.workunit.client.1.smithi129.stdout:5/535: dwrite d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:22.178 INFO:tasks.workunit.client.1.smithi129.stdout:3/523: read - d4/dd/f45 zero size 2024-03-18T14:43:22.179 INFO:tasks.workunit.client.1.smithi129.stdout:3/524: chown d4/d11/d34 3479 1 2024-03-18T14:43:22.182 INFO:tasks.workunit.client.1.smithi129.stdout:9/527: mkdir d0/db/d2e/da9 0 2024-03-18T14:43:22.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/825: rmdir db/d18/d1e/d28/dc2/dec 39 2024-03-18T14:43:22.182 INFO:tasks.workunit.client.0.smithi087.stdout:3/760: rmdir d0/de/d30/d46 39 2024-03-18T14:43:22.183 INFO:tasks.workunit.client.1.smithi129.stdout:9/528: stat d0/db/d11/c3f 0 2024-03-18T14:43:22.190 INFO:tasks.workunit.client.1.smithi129.stdout:8/607: mkdir d9/d11/d1a/d32/d41/d4d/d96/dcc 0 2024-03-18T14:43:22.193 INFO:tasks.workunit.client.1.smithi129.stdout:5/536: rmdir d0/dc/d18/d2b 39 2024-03-18T14:43:22.194 INFO:tasks.workunit.client.0.smithi087.stdout:4/686: truncate d2/db/d24/d30/d7b/dbe/fa8 2719230 0 2024-03-18T14:43:22.194 INFO:tasks.workunit.client.0.smithi087.stdout:8/713: sync 2024-03-18T14:43:22.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/687: readlink d2/db/d24/d30/d7b/dbe/lb1 0 2024-03-18T14:43:22.195 INFO:tasks.workunit.client.1.smithi129.stdout:8/608: dwrite d9/d11/d18/f34 [0,4194304] 0 2024-03-18T14:43:22.197 INFO:tasks.workunit.client.1.smithi129.stdout:2/572: creat d7/d1c/fb1 x:0 0 0 2024-03-18T14:43:22.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/724: truncate d0/d2/d3c/f69 511211 0 2024-03-18T14:43:22.199 INFO:tasks.workunit.client.0.smithi087.stdout:7/815: dread d1/d6/d16/dc/f32 [0,4194304] 0 2024-03-18T14:43:22.199 INFO:tasks.workunit.client.0.smithi087.stdout:0/725: chown d0/d2/d6b/dca 0 1 2024-03-18T14:43:22.200 INFO:tasks.workunit.client.0.smithi087.stdout:7/816: read - d1/d6/d29/d2f/d68/d65/d110/f112 zero size 2024-03-18T14:43:22.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/704: write d3/d7/d25/d62/d8b/fb7 [19074,61675] 0 2024-03-18T14:43:22.201 INFO:tasks.workunit.client.1.smithi129.stdout:5/537: symlink d0/dc/d18/d5f/la1 0 2024-03-18T14:43:22.203 INFO:tasks.workunit.client.0.smithi087.stdout:2/750: dread d2/ddd/d22/f62 [0,4194304] 0 2024-03-18T14:43:22.203 INFO:tasks.workunit.client.1.smithi129.stdout:0/592: link d0/l26 d0/d14/d3a/d4a/lb7 0 2024-03-18T14:43:22.204 INFO:tasks.workunit.client.0.smithi087.stdout:9/826: truncate db/d18/d1e/d7e/dc7/f105 960471 0 2024-03-18T14:43:22.205 INFO:tasks.workunit.client.0.smithi087.stdout:9/827: dread - db/d18/d1e/d28/d76/da7/fc5 zero size 2024-03-18T14:43:22.205 INFO:tasks.workunit.client.0.smithi087.stdout:3/761: getdents d0/d1c/d25 0 2024-03-18T14:43:22.205 INFO:tasks.workunit.client.1.smithi129.stdout:9/529: creat d0/db/d2e/d9f/faa x:0 0 0 2024-03-18T14:43:22.206 INFO:tasks.workunit.client.0.smithi087.stdout:3/762: chown d0/de/d30 18404 1 2024-03-18T14:43:22.206 INFO:tasks.workunit.client.1.smithi129.stdout:6/574: getdents d3/d6/d7f 0 2024-03-18T14:43:22.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/688: mknod d2/db/d7a/ce4 0 2024-03-18T14:43:22.207 INFO:tasks.workunit.client.1.smithi129.stdout:7/564: getdents d4/d7/d38/d49 0 2024-03-18T14:43:22.209 INFO:tasks.workunit.client.1.smithi129.stdout:5/538: symlink d0/dc/d22/la2 0 2024-03-18T14:43:22.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/609: truncate d9/d11/d1a/d32/d3a/d5d/f62 1515485 0 2024-03-18T14:43:22.209 INFO:tasks.workunit.client.1.smithi129.stdout:0/593: mknod d0/d23/d35/cb8 0 2024-03-18T14:43:22.211 INFO:tasks.workunit.client.1.smithi129.stdout:4/497: getdents d0/d3c/d6c 0 2024-03-18T14:43:22.211 INFO:tasks.workunit.client.1.smithi129.stdout:8/610: dread - d9/d11/d1a/d32/d41/f94 zero size 2024-03-18T14:43:22.211 INFO:tasks.workunit.client.1.smithi129.stdout:1/559: dread d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:22.211 INFO:tasks.workunit.client.0.smithi087.stdout:4/689: dwrite d2/db/d24/d30/d8a/d95/fbb [0,4194304] 0 2024-03-18T14:43:22.212 INFO:tasks.workunit.client.1.smithi129.stdout:1/560: write d1/d2/d28/d65/d19/d52/f89 [1651524,10688] 0 2024-03-18T14:43:22.213 INFO:tasks.workunit.client.1.smithi129.stdout:1/561: readlink d1/d2/d28/d65/d19/d52/l6d 0 2024-03-18T14:43:22.218 INFO:tasks.workunit.client.0.smithi087.stdout:3/763: chown d0/de/d30/d46/dc3/lc7 0 1 2024-03-18T14:43:22.218 INFO:tasks.workunit.client.0.smithi087.stdout:5/748: dread fb [0,4194304] 0 2024-03-18T14:43:22.222 INFO:tasks.workunit.client.0.smithi087.stdout:5/749: dwrite d13/d1b/d27/d35/fc1 [0,4194304] 0 2024-03-18T14:43:22.226 INFO:tasks.workunit.client.0.smithi087.stdout:4/690: rmdir d2/db/d84 39 2024-03-18T14:43:22.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/726: rename d0/d2/l37 to d0/d1a/l101 0 2024-03-18T14:43:22.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/727: chown d0/d2/d4/de8/dad/dea/l4f 0 1 2024-03-18T14:43:22.230 INFO:tasks.workunit.client.0.smithi087.stdout:0/728: chown d0/d2/d4/f8d 12092 1 2024-03-18T14:43:22.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/729: read d0/d2/d4/d19/f41 [3244491,24771] 0 2024-03-18T14:43:22.234 INFO:tasks.workunit.client.1.smithi129.stdout:1/562: write d1/d2/d28/d65/d7c/d7d/d80/f9a [428777,64612] 0 2024-03-18T14:43:22.235 INFO:tasks.workunit.client.0.smithi087.stdout:2/751: dread d2/d44/f45 [4194304,4194304] 0 2024-03-18T14:43:22.238 INFO:tasks.workunit.client.1.smithi129.stdout:9/530: dwrite d0/db/d1f/d20/d26/d19/d29/d36/f92 [0,4194304] 0 2024-03-18T14:43:22.238 INFO:tasks.workunit.client.0.smithi087.stdout:6/705: rename d3/d7/d25/d62/d7c/da0/dbe/fc2 to d3/d7/d25/d62/d7c/ff0 0 2024-03-18T14:43:22.239 INFO:tasks.workunit.client.1.smithi129.stdout:9/531: dread - d0/db/d1f/d20/d26/d19/d29/f44 zero size 2024-03-18T14:43:22.239 INFO:tasks.workunit.client.1.smithi129.stdout:7/565: symlink d4/lb2 0 2024-03-18T14:43:22.240 INFO:tasks.workunit.client.1.smithi129.stdout:2/573: getdents d7/d1f/d20/d2d/dab 0 2024-03-18T14:43:22.241 INFO:tasks.workunit.client.0.smithi087.stdout:1/784: write d3/f4e [970362,117195] 0 2024-03-18T14:43:22.245 INFO:tasks.workunit.client.1.smithi129.stdout:3/525: dread d4/dd/d1f/d5f/d31/f5c [0,4194304] 0 2024-03-18T14:43:22.245 INFO:tasks.workunit.client.0.smithi087.stdout:8/714: truncate d1/d6/d2f/d44/f52 1984604 0 2024-03-18T14:43:22.246 INFO:tasks.workunit.client.1.smithi129.stdout:4/498: mkdir d0/d9/d6a/d7b/d9d 0 2024-03-18T14:43:22.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/715: write d1/d6/d2f/d44/d45/d72/d7f/fc1 [984876,107932] 0 2024-03-18T14:43:22.248 INFO:tasks.workunit.client.0.smithi087.stdout:7/817: dwrite d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:22.249 INFO:tasks.workunit.client.0.smithi087.stdout:9/828: write db/d18/d1c/d69/f8c [1676775,77234] 0 2024-03-18T14:43:22.249 INFO:tasks.workunit.client.1.smithi129.stdout:9/532: symlink d0/db/d1f/d20/d26/d19/d29/d36/lab 0 2024-03-18T14:43:22.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/730: creat d0/d2/d4/de8/dad/dea/dcb/f102 x:0 0 0 2024-03-18T14:43:22.250 INFO:tasks.workunit.client.0.smithi087.stdout:7/818: chown d1/f76 36658154 1 2024-03-18T14:43:22.250 INFO:tasks.workunit.client.1.smithi129.stdout:2/574: creat d7/d1f/d20/d2a/d6b/fb2 x:0 0 0 2024-03-18T14:43:22.251 INFO:tasks.workunit.client.1.smithi129.stdout:3/526: fsync d4/f9 0 2024-03-18T14:43:22.253 INFO:tasks.workunit.client.1.smithi129.stdout:1/563: mknod d1/d2/d28/d65/d7c/cab 0 2024-03-18T14:43:22.254 INFO:tasks.workunit.client.1.smithi129.stdout:9/533: mknod d0/db/d2e/cac 0 2024-03-18T14:43:22.256 INFO:tasks.workunit.client.1.smithi129.stdout:9/534: dread - d0/db/d1f/d20/d25/d8e/f67 zero size 2024-03-18T14:43:22.258 INFO:tasks.workunit.client.1.smithi129.stdout:4/499: dwrite d0/d19/d46/d3e/d21/d4d/d70/f25 [0,4194304] 0 2024-03-18T14:43:22.259 INFO:tasks.workunit.client.0.smithi087.stdout:5/750: truncate d13/f16 4432862 0 2024-03-18T14:43:22.259 INFO:tasks.workunit.client.1.smithi129.stdout:3/527: mknod d4/d11/d1d/d50/d91/d97/cb4 0 2024-03-18T14:43:22.260 INFO:tasks.workunit.client.0.smithi087.stdout:1/785: truncate d3/d3c/f8c 461370 0 2024-03-18T14:43:22.260 INFO:tasks.workunit.client.1.smithi129.stdout:4/500: fdatasync d0/d19/d46/d3e/d21/d4d/d58/d61/f98 0 2024-03-18T14:43:22.261 INFO:tasks.workunit.client.1.smithi129.stdout:4/501: read d0/d9/f20 [58087,131007] 0 2024-03-18T14:43:22.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/786: dwrite d3/d1d/d45/f49 [0,4194304] 0 2024-03-18T14:43:22.264 INFO:tasks.workunit.client.1.smithi129.stdout:8/611: dread d9/f1b [0,4194304] 0 2024-03-18T14:43:22.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/535: mkdir d0/db/d1f/d20/d25/dad 0 2024-03-18T14:43:22.264 INFO:tasks.workunit.client.0.smithi087.stdout:1/787: dread - d3/d1d/d79/fd7 zero size 2024-03-18T14:43:22.265 INFO:tasks.workunit.client.0.smithi087.stdout:1/788: readlink d3/d1d/d1e/l6f 0 2024-03-18T14:43:22.266 INFO:tasks.workunit.client.1.smithi129.stdout:6/575: write d3/d30/df/d28/f54 [1618732,23205] 0 2024-03-18T14:43:22.267 INFO:tasks.workunit.client.1.smithi129.stdout:6/576: readlink d3/d30/de/d6c/l5d 0 2024-03-18T14:43:22.270 INFO:tasks.workunit.client.1.smithi129.stdout:1/564: link d1/d35/f9c d1/d2/d70/fac 0 2024-03-18T14:43:22.271 INFO:tasks.workunit.client.0.smithi087.stdout:7/819: unlink d1/d6/da/d59/l88 0 2024-03-18T14:43:22.271 INFO:tasks.workunit.client.1.smithi129.stdout:0/594: dwrite d0/d14/f49 [0,4194304] 0 2024-03-18T14:43:22.272 INFO:tasks.workunit.client.0.smithi087.stdout:2/752: dread d2/ddd/d22/d2c/d3a/d40/d98/fd0 [0,4194304] 0 2024-03-18T14:43:22.273 INFO:tasks.workunit.client.1.smithi129.stdout:0/595: write d0/d23/d35/d50/fab [468553,6353] 0 2024-03-18T14:43:22.273 INFO:tasks.workunit.client.0.smithi087.stdout:5/751: symlink d13/d1b/d70/lfb 0 2024-03-18T14:43:22.274 INFO:tasks.workunit.client.1.smithi129.stdout:3/528: creat d4/d11/d1d/fb5 x:0 0 0 2024-03-18T14:43:22.275 INFO:tasks.workunit.client.1.smithi129.stdout:9/536: mkdir d0/db/d1f/dae 0 2024-03-18T14:43:22.275 INFO:tasks.workunit.client.1.smithi129.stdout:8/612: creat d9/d11/d55/d68/fcd x:0 0 0 2024-03-18T14:43:22.275 INFO:tasks.workunit.client.1.smithi129.stdout:7/566: dread d4/d7/f64 [0,4194304] 0 2024-03-18T14:43:22.277 INFO:tasks.workunit.client.0.smithi087.stdout:5/752: dwrite d13/d1b/d27/d35/fc1 [0,4194304] 0 2024-03-18T14:43:22.278 INFO:tasks.workunit.client.0.smithi087.stdout:5/753: chown d13/d1b/d27/d28 14213803 1 2024-03-18T14:43:22.279 INFO:tasks.workunit.client.1.smithi129.stdout:5/539: sync 2024-03-18T14:43:22.280 INFO:tasks.workunit.client.0.smithi087.stdout:7/820: creat d1/d6/d29/d2f/dac/f11b x:0 0 0 2024-03-18T14:43:22.280 INFO:tasks.workunit.client.1.smithi129.stdout:3/529: dwrite d4/dd/d1f/f26 [0,4194304] 0 2024-03-18T14:43:22.283 INFO:tasks.workunit.client.1.smithi129.stdout:2/575: dread d7/f58 [0,4194304] 0 2024-03-18T14:43:22.285 INFO:tasks.workunit.client.1.smithi129.stdout:5/540: dwrite d0/dc/d18/d5f/f86 [0,4194304] 0 2024-03-18T14:43:22.287 INFO:tasks.workunit.client.1.smithi129.stdout:2/576: dwrite d7/d1c/d32/f60 [0,4194304] 0 2024-03-18T14:43:22.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/577: write d7/d3f/d5f/f7d [824111,26704] 0 2024-03-18T14:43:22.288 INFO:tasks.workunit.client.0.smithi087.stdout:0/731: creat d0/d1a/f103 x:0 0 0 2024-03-18T14:43:22.290 INFO:tasks.workunit.client.1.smithi129.stdout:8/613: mkdir d9/d11/d1a/d32/d41/d4d/dce 0 2024-03-18T14:43:22.290 INFO:tasks.workunit.client.1.smithi129.stdout:4/502: truncate d0/d3c/d6c/f8d 474648 0 2024-03-18T14:43:22.290 INFO:tasks.workunit.client.1.smithi129.stdout:6/577: truncate d3/d30/df/d28/f8c 61656 0 2024-03-18T14:43:22.291 INFO:tasks.workunit.client.1.smithi129.stdout:7/567: creat d4/d7/d38/d61/d68/fb3 x:0 0 0 2024-03-18T14:43:22.292 INFO:tasks.workunit.client.1.smithi129.stdout:3/530: creat d4/d11/d1d/d50/d90/fb6 x:0 0 0 2024-03-18T14:43:22.292 INFO:tasks.workunit.client.1.smithi129.stdout:7/568: stat d4/d7/d8/d3b 0 2024-03-18T14:43:22.293 INFO:tasks.workunit.client.0.smithi087.stdout:3/764: rename d0/d3/d10/f5e to d0/d1c/fd8 0 2024-03-18T14:43:22.300 INFO:tasks.workunit.client.1.smithi129.stdout:9/537: creat d0/db/d1f/dae/faf x:0 0 0 2024-03-18T14:43:22.300 INFO:tasks.workunit.client.1.smithi129.stdout:0/596: creat d0/d14/fb9 x:0 0 0 2024-03-18T14:43:22.302 INFO:tasks.workunit.client.0.smithi087.stdout:6/706: getdents d3/d7/d25/d62/d7c/d29/d22/d23 0 2024-03-18T14:43:22.302 INFO:tasks.workunit.client.0.smithi087.stdout:5/754: mkdir d13/d1b/d7e/dfc 0 2024-03-18T14:43:22.302 INFO:tasks.workunit.client.1.smithi129.stdout:6/578: chown d3/d6/d7f/db4/d57/fa2 2 1 2024-03-18T14:43:22.303 INFO:tasks.workunit.client.0.smithi087.stdout:7/821: fsync d1/d6/da/f25 0 2024-03-18T14:43:22.303 INFO:tasks.workunit.client.0.smithi087.stdout:2/753: truncate d2/ddd/d22/d2c/d3a/f51 2713097 0 2024-03-18T14:43:22.303 INFO:tasks.workunit.client.0.smithi087.stdout:0/732: rmdir d0/dab 39 2024-03-18T14:43:22.304 INFO:tasks.workunit.client.1.smithi129.stdout:4/503: mknod d0/d3c/d6c/d89/c9e 0 2024-03-18T14:43:22.305 INFO:tasks.workunit.client.0.smithi087.stdout:4/691: rename d2/db/f20 to d2/db/d24/d30/d7b/dbe/fe5 0 2024-03-18T14:43:22.305 INFO:tasks.workunit.client.1.smithi129.stdout:3/531: fsync d4/d11/d1d/d36/f7d 0 2024-03-18T14:43:22.305 INFO:tasks.workunit.client.1.smithi129.stdout:2/578: dwrite d7/d1f/d20/d2b/d41/f5e [0,4194304] 0 2024-03-18T14:43:22.307 INFO:tasks.workunit.client.1.smithi129.stdout:3/532: chown d4/d11/d34/d3c/l3e 5467207 1 2024-03-18T14:43:22.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/533: chown d4/dd/d1f/d5f/d82/da6/fa7 3955 1 2024-03-18T14:43:22.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/534: fsync d4/d11/d1d/f7f 0 2024-03-18T14:43:22.309 INFO:tasks.workunit.client.0.smithi087.stdout:5/755: unlink d13/d1b/d30/fbd 0 2024-03-18T14:43:22.309 INFO:tasks.workunit.client.0.smithi087.stdout:2/754: fsync d2/ddd/d22/f62 0 2024-03-18T14:43:22.310 INFO:tasks.workunit.client.0.smithi087.stdout:2/755: fsync d2/d44/d72/d79/f9c 0 2024-03-18T14:43:22.311 INFO:tasks.workunit.client.1.smithi129.stdout:6/579: symlink d3/d30/df/lb9 0 2024-03-18T14:43:22.312 INFO:tasks.workunit.client.0.smithi087.stdout:0/733: mknod d0/d2/d4/de8/c104 0 2024-03-18T14:43:22.313 INFO:tasks.workunit.client.0.smithi087.stdout:0/734: readlink d0/d1a/d34/ld0 0 2024-03-18T14:43:22.313 INFO:tasks.workunit.client.1.smithi129.stdout:0/597: rename d0/d23/c78 to d0/d23/d35/d3b/cba 0 2024-03-18T14:43:22.314 INFO:tasks.workunit.client.1.smithi129.stdout:2/579: creat d7/d1c/d32/fb3 x:0 0 0 2024-03-18T14:43:22.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/756: dwrite d2/ddd/dbb/fbf [0,4194304] 0 2024-03-18T14:43:22.315 INFO:tasks.workunit.client.0.smithi087.stdout:2/757: readlink d2/ddd/l9 0 2024-03-18T14:43:22.316 INFO:tasks.workunit.client.1.smithi129.stdout:4/504: mknod d0/c9f 0 2024-03-18T14:43:22.316 INFO:tasks.workunit.client.0.smithi087.stdout:9/829: rename db/d31/f8d to db/d18/d1e/d7e/db8/f116 0 2024-03-18T14:43:22.318 INFO:tasks.workunit.client.0.smithi087.stdout:5/756: fsync d13/d1b/d27/d35/f9c 0 2024-03-18T14:43:22.318 INFO:tasks.workunit.client.0.smithi087.stdout:4/692: write d2/db/d24/d30/d7b/d7f/f68 [1533423,83339] 0 2024-03-18T14:43:22.318 INFO:tasks.workunit.client.0.smithi087.stdout:2/758: fdatasync d2/ddd/d22/d2c/d3a/d49/d58/f63 0 2024-03-18T14:43:22.319 INFO:tasks.workunit.client.1.smithi129.stdout:3/535: symlink d4/d11/lb7 0 2024-03-18T14:43:22.321 INFO:tasks.workunit.client.0.smithi087.stdout:0/735: dwrite d0/d2/d4/d27/dc3/fe1 [0,4194304] 0 2024-03-18T14:43:22.321 INFO:tasks.workunit.client.1.smithi129.stdout:4/505: dwrite d0/d19/d46/d3e/d21/d4d/d58/f8f [0,4194304] 0 2024-03-18T14:43:22.322 INFO:tasks.workunit.client.1.smithi129.stdout:4/506: write d0/d19/d46/d3e/d33/f7d [1312278,53265] 0 2024-03-18T14:43:22.323 INFO:tasks.workunit.client.0.smithi087.stdout:7/822: mknod d1/d6/d29/d2f/d68/d65/d60/d66/c11c 0 2024-03-18T14:43:22.323 INFO:tasks.workunit.client.1.smithi129.stdout:4/507: chown d0/d19/d46/d3e/d33/f93 24421728 1 2024-03-18T14:43:22.324 INFO:tasks.workunit.client.1.smithi129.stdout:4/508: write d0/d19/d46/d3e/f76 [279241,120302] 0 2024-03-18T14:43:22.325 INFO:tasks.workunit.client.0.smithi087.stdout:8/716: rename d1/d6/d14/db2/fb7 to d1/d6/d9/d5d/d87/d88/fef 0 2024-03-18T14:43:22.326 INFO:tasks.workunit.client.1.smithi129.stdout:2/580: creat d7/d1f/d20/d36/da9/fb4 x:0 0 0 2024-03-18T14:43:22.326 INFO:tasks.workunit.client.0.smithi087.stdout:8/717: read - d1/faf zero size 2024-03-18T14:43:22.326 INFO:tasks.workunit.client.0.smithi087.stdout:7/823: dwrite d1/d6/da/f25 [0,4194304] 0 2024-03-18T14:43:22.327 INFO:tasks.workunit.client.0.smithi087.stdout:7/824: chown d1/d6/da/d59/dbe/lcc 3881 1 2024-03-18T14:43:22.329 INFO:tasks.workunit.client.1.smithi129.stdout:4/509: dwrite d0/d19/d46/d3e/d21/d4d/d70/f23 [0,4194304] 0 2024-03-18T14:43:22.330 INFO:tasks.workunit.client.0.smithi087.stdout:2/759: creat d2/ddd/d22/d24/d91/ff8 x:0 0 0 2024-03-18T14:43:22.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/536: mknod d4/dd/cb8 0 2024-03-18T14:43:22.330 INFO:tasks.workunit.client.1.smithi129.stdout:3/537: write d4/d38/f2c [5141231,42104] 0 2024-03-18T14:43:22.335 INFO:tasks.workunit.client.0.smithi087.stdout:9/830: mknod db/d18/d1e/d28/d76/c117 0 2024-03-18T14:43:22.337 INFO:tasks.workunit.client.1.smithi129.stdout:1/565: dwrite d1/d2/d28/d65/d19/d84/faa [0,4194304] 0 2024-03-18T14:43:22.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/825: rmdir d1/d6/da/de3 39 2024-03-18T14:43:22.338 INFO:tasks.workunit.client.0.smithi087.stdout:4/693: creat d2/dc2/dce/dd9/fe6 x:0 0 0 2024-03-18T14:43:22.339 INFO:tasks.workunit.client.0.smithi087.stdout:4/694: chown d2/db/d3c/f50 124437 1 2024-03-18T14:43:22.339 INFO:tasks.workunit.client.0.smithi087.stdout:6/707: dread d3/d7/d25/d62/d7c/d29/d22/f32 [0,4194304] 0 2024-03-18T14:43:22.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/708: write d3/d7/d25/d62/d7c/d29/fd8 [1006361,129709] 0 2024-03-18T14:43:22.342 INFO:tasks.workunit.client.1.smithi129.stdout:9/538: dread d0/db/d90/d3e/f66 [0,4194304] 0 2024-03-18T14:43:22.342 INFO:tasks.workunit.client.1.smithi129.stdout:3/538: rename d4/d11/d1d/d50/d91/d93/l57 to d4/dd/d1f/d5f/d31/d78/lb9 0 2024-03-18T14:43:22.343 INFO:tasks.workunit.client.0.smithi087.stdout:8/718: mkdir d1/d6/d9/d5d/d87/da2/df0 0 2024-03-18T14:43:22.345 INFO:tasks.workunit.client.1.smithi129.stdout:8/614: dread d9/f1f [0,4194304] 0 2024-03-18T14:43:22.347 INFO:tasks.workunit.client.0.smithi087.stdout:4/695: readlink d2/db/l2a 0 2024-03-18T14:43:22.348 INFO:tasks.workunit.client.1.smithi129.stdout:9/539: dwrite d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:22.348 INFO:tasks.workunit.client.0.smithi087.stdout:8/719: write d1/d6/d2f/d44/d45/d50/fd5 [245460,19183] 0 2024-03-18T14:43:22.349 INFO:tasks.workunit.client.0.smithi087.stdout:8/720: stat d1/d6/d2f/d44/d4b/fc9 0 2024-03-18T14:43:22.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/826: mknod d1/d6/d29/d2f/d68/d65/d96/c11d 0 2024-03-18T14:43:22.350 INFO:tasks.workunit.client.0.smithi087.stdout:7/827: chown d1/d6/d16/dc/l19 447070243 1 2024-03-18T14:43:22.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/789: truncate d3/d1d/d1f/f7d 3125685 0 2024-03-18T14:43:22.355 INFO:tasks.workunit.client.1.smithi129.stdout:1/566: rename d1/d2/d28/d65/l75 to d1/d2/d70/d56/lad 0 2024-03-18T14:43:22.356 INFO:tasks.workunit.client.1.smithi129.stdout:1/567: write d1/d2/d70/d56/f82 [569550,39756] 0 2024-03-18T14:43:22.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/615: stat d9/d11/d55/d6a/d6f/l99 0 2024-03-18T14:43:22.358 INFO:tasks.workunit.client.1.smithi129.stdout:8/616: dread - d9/d11/d1a/d32/d41/d4d/fa9 zero size 2024-03-18T14:43:22.359 INFO:tasks.workunit.client.1.smithi129.stdout:9/540: symlink d0/db/d90/d70/d93/lb0 0 2024-03-18T14:43:22.360 INFO:tasks.workunit.client.1.smithi129.stdout:9/541: chown d0/db/d1f/d20/d25/d8e/f80 76 1 2024-03-18T14:43:22.360 INFO:tasks.workunit.client.1.smithi129.stdout:9/542: rename d0/db/d1f to d0/db/d1f/d20/d6c/db1 22 2024-03-18T14:43:22.361 INFO:tasks.workunit.client.1.smithi129.stdout:8/617: creat d9/d11/d18/da4/fcf x:0 0 0 2024-03-18T14:43:22.362 INFO:tasks.workunit.client.1.smithi129.stdout:1/568: fsync d1/d2/f4b 0 2024-03-18T14:43:22.362 INFO:tasks.workunit.client.0.smithi087.stdout:3/765: dwrite d0/de/d30/d67/f79 [0,4194304] 0 2024-03-18T14:43:22.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/541: write d0/f14 [196143,58490] 0 2024-03-18T14:43:22.364 INFO:tasks.workunit.client.1.smithi129.stdout:8/618: creat d9/d11/d18/da4/fd0 x:0 0 0 2024-03-18T14:43:22.365 INFO:tasks.workunit.client.1.smithi129.stdout:8/619: chown d9/d11/d1a/d32/d41/d4d/d96/dcc 75775793 1 2024-03-18T14:43:22.366 INFO:tasks.workunit.client.0.smithi087.stdout:0/736: dread d0/d1a/d34/d3d/fb8 [0,4194304] 0 2024-03-18T14:43:22.367 INFO:tasks.workunit.client.1.smithi129.stdout:9/543: mkdir d0/db/d11/d97/d99/db2 0 2024-03-18T14:43:22.367 INFO:tasks.workunit.client.1.smithi129.stdout:7/569: write d4/d7/d8/f29 [1085660,36494] 0 2024-03-18T14:43:22.368 INFO:tasks.workunit.client.1.smithi129.stdout:7/570: dread - d4/d83/f8b zero size 2024-03-18T14:43:22.369 INFO:tasks.workunit.client.1.smithi129.stdout:5/542: mkdir d0/d32/d34/d6c/da3 0 2024-03-18T14:43:22.369 INFO:tasks.workunit.client.1.smithi129.stdout:7/571: readlink d4/d2d/d2e/d42/d58/lad 0 2024-03-18T14:43:22.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/543: read d0/d32/d34/f4d [691451,64073] 0 2024-03-18T14:43:22.371 INFO:tasks.workunit.client.1.smithi129.stdout:8/620: read d9/d11/d1a/d32/d3a/d70/f8c [165492,54502] 0 2024-03-18T14:43:22.371 INFO:tasks.workunit.client.0.smithi087.stdout:5/757: dwrite d13/d1b/d30/d6e/d88/db4/fc7 [0,4194304] 0 2024-03-18T14:43:22.372 INFO:tasks.workunit.client.1.smithi129.stdout:9/544: creat d0/db/d1f/d20/d26/d19/d29/fb3 x:0 0 0 2024-03-18T14:43:22.373 INFO:tasks.workunit.client.0.smithi087.stdout:4/696: rename d2/db/d24/ca2 to d2/db/d24/d30/d7b/d7f/da5/ce7 0 2024-03-18T14:43:22.374 INFO:tasks.workunit.client.1.smithi129.stdout:7/572: creat d4/d7/d38/d61/d68/fb4 x:0 0 0 2024-03-18T14:43:22.374 INFO:tasks.workunit.client.1.smithi129.stdout:7/573: fdatasync d4/d2d/d2e/d42/fa2 0 2024-03-18T14:43:22.374 INFO:tasks.workunit.client.1.smithi129.stdout:1/569: creat d1/d2/d28/d65/fae x:0 0 0 2024-03-18T14:43:22.374 INFO:tasks.workunit.client.0.smithi087.stdout:9/831: getdents db/d18 0 2024-03-18T14:43:22.375 INFO:tasks.workunit.client.0.smithi087.stdout:9/832: chown db/d18/d3a/c101 551824 1 2024-03-18T14:43:22.379 INFO:tasks.workunit.client.0.smithi087.stdout:1/790: symlink d3/d1d/d1f/dab/lf4 0 2024-03-18T14:43:22.379 INFO:tasks.workunit.client.0.smithi087.stdout:1/791: stat d3/d3c/db8 0 2024-03-18T14:43:22.380 INFO:tasks.workunit.client.0.smithi087.stdout:2/760: write d2/ddd/d22/d24/d65/f6b [922589,26943] 0 2024-03-18T14:43:22.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/709: write d3/d7/d25/d62/d7c/d29/f27 [3900733,6668] 0 2024-03-18T14:43:22.381 INFO:tasks.workunit.client.1.smithi129.stdout:7/574: symlink d4/d7/d8/lb5 0 2024-03-18T14:43:22.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/710: stat d3/d7/d25/d62/d7c/d29/d22/d75/c8d 0 2024-03-18T14:43:22.383 INFO:tasks.workunit.client.1.smithi129.stdout:1/570: creat d1/d35/d7a/faf x:0 0 0 2024-03-18T14:43:22.383 INFO:tasks.workunit.client.0.smithi087.stdout:6/711: write d3/d7/d25/d62/d7c/d29/d22/f5f [755417,74790] 0 2024-03-18T14:43:22.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/828: getdents d1/d6/d29/d2f/d68/d65/d72 0 2024-03-18T14:43:22.387 INFO:tasks.workunit.client.0.smithi087.stdout:6/712: dwrite d3/d7/d25/d8e/fdd [0,4194304] 0 2024-03-18T14:43:22.387 INFO:tasks.workunit.client.1.smithi129.stdout:6/580: write d3/d30/de/f22 [1699156,129569] 0 2024-03-18T14:43:22.388 INFO:tasks.workunit.client.0.smithi087.stdout:5/758: write d13/d1b/d27/d8f/dab/fe0 [756718,54695] 0 2024-03-18T14:43:22.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/759: chown d13/d1b/d27/d35/f39 293252 1 2024-03-18T14:43:22.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/697: rename d2/d13/d28/cc8 to d2/dc2/dce/dd9/ce8 0 2024-03-18T14:43:22.391 INFO:tasks.workunit.client.0.smithi087.stdout:3/766: dread d0/de/d30/d46/f89 [0,4194304] 0 2024-03-18T14:43:22.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/598: dwrite d0/f72 [0,4194304] 0 2024-03-18T14:43:22.391 INFO:tasks.workunit.client.0.smithi087.stdout:4/698: write d2/db/d24/f58 [4854933,44062] 0 2024-03-18T14:43:22.393 INFO:tasks.workunit.client.1.smithi129.stdout:3/539: rmdir d4/d11/d1d 39 2024-03-18T14:43:22.393 INFO:tasks.workunit.client.0.smithi087.stdout:9/833: symlink db/d18/d1e/d28/d76/da7/l118 0 2024-03-18T14:43:22.394 INFO:tasks.workunit.client.1.smithi129.stdout:0/599: read d0/f8e [328096,55239] 0 2024-03-18T14:43:22.394 INFO:tasks.workunit.client.1.smithi129.stdout:3/540: dread - d4/dd/d1f/d2f/f69 zero size 2024-03-18T14:43:22.394 INFO:tasks.workunit.client.1.smithi129.stdout:0/600: write d0/d14/d3a/f62 [1516714,103386] 0 2024-03-18T14:43:22.395 INFO:tasks.workunit.client.1.smithi129.stdout:2/581: truncate d7/fa 8056238 0 2024-03-18T14:43:22.395 INFO:tasks.workunit.client.0.smithi087.stdout:1/792: unlink d3/d1d/d45/f59 0 2024-03-18T14:43:22.396 INFO:tasks.workunit.client.0.smithi087.stdout:1/793: chown d3/d1d/d1e/d20/f52 1455 1 2024-03-18T14:43:22.396 INFO:tasks.workunit.client.1.smithi129.stdout:0/601: write d0/d23/d29/f38 [2554360,77266] 0 2024-03-18T14:43:22.396 INFO:tasks.workunit.client.1.smithi129.stdout:2/582: readlink d7/d1f/d20/la4 0 2024-03-18T14:43:22.396 INFO:tasks.workunit.client.0.smithi087.stdout:2/761: mknod d2/ddd/d22/d2c/d3a/d40/d98/dd8/cf9 0 2024-03-18T14:43:22.399 INFO:tasks.workunit.client.1.smithi129.stdout:4/510: dwrite d0/f13 [0,4194304] 0 2024-03-18T14:43:22.400 INFO:tasks.workunit.client.0.smithi087.stdout:2/762: dwrite d2/ddd/dbb/fbf [0,4194304] 0 2024-03-18T14:43:22.402 INFO:tasks.workunit.client.0.smithi087.stdout:0/737: link d0/d2/fe7 d0/d2/d4/de8/dad/f105 0 2024-03-18T14:43:22.403 INFO:tasks.workunit.client.1.smithi129.stdout:5/544: write d0/d32/d34/f51 [44279,31696] 0 2024-03-18T14:43:22.404 INFO:tasks.workunit.client.1.smithi129.stdout:1/571: stat d1/d2/d28/d65/la1 0 2024-03-18T14:43:22.404 INFO:tasks.workunit.client.0.smithi087.stdout:8/721: creat d1/d6/d2f/d44/d45/d72/ff1 x:0 0 0 2024-03-18T14:43:22.407 INFO:tasks.workunit.client.0.smithi087.stdout:5/760: symlink d13/d1b/d27/d35/lfd 0 2024-03-18T14:43:22.411 INFO:tasks.workunit.client.0.smithi087.stdout:4/699: rmdir d2/db/d3c/d90 39 2024-03-18T14:43:22.412 INFO:tasks.workunit.client.0.smithi087.stdout:4/700: stat d2/c9d 0 2024-03-18T14:43:22.412 INFO:tasks.workunit.client.1.smithi129.stdout:7/575: symlink d4/d2d/d3a/lb6 0 2024-03-18T14:43:22.413 INFO:tasks.workunit.client.0.smithi087.stdout:9/834: mknod db/d18/df1/c119 0 2024-03-18T14:43:22.413 INFO:tasks.workunit.client.1.smithi129.stdout:7/576: dread - d4/d2d/d2e/f5a zero size 2024-03-18T14:43:22.415 INFO:tasks.workunit.client.0.smithi087.stdout:1/794: fsync d3/d1d/d1e/d43/d50/d72/f86 0 2024-03-18T14:43:22.415 INFO:tasks.workunit.client.0.smithi087.stdout:1/795: chown d3/d1d/d1e 1 1 2024-03-18T14:43:22.416 INFO:tasks.workunit.client.0.smithi087.stdout:1/796: write d3/fa7 [290313,17981] 0 2024-03-18T14:43:22.417 INFO:tasks.workunit.client.0.smithi087.stdout:4/701: dread d2/db/d24/d30/d56/f74 [0,4194304] 0 2024-03-18T14:43:22.417 INFO:tasks.workunit.client.1.smithi129.stdout:2/583: dwrite d7/f1e [0,4194304] 0 2024-03-18T14:43:22.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/738: read d0/d2/d4/d19/f72 [2674509,70160] 0 2024-03-18T14:43:22.420 INFO:tasks.workunit.client.1.smithi129.stdout:9/545: getdents d0/db/d1f/d20/d6c 0 2024-03-18T14:43:22.420 INFO:tasks.workunit.client.1.smithi129.stdout:6/581: rename d3/d5/c3a to d3/d6/d82/cba 0 2024-03-18T14:43:22.422 INFO:tasks.workunit.client.0.smithi087.stdout:5/761: dread d13/d1b/d27/d8f/dab/fd5 [0,4194304] 0 2024-03-18T14:43:22.423 INFO:tasks.workunit.client.0.smithi087.stdout:8/722: dread d1/d6/d2f/d44/d4b/f86 [0,4194304] 0 2024-03-18T14:43:22.425 INFO:tasks.workunit.client.1.smithi129.stdout:9/546: dwrite d0/db/d1f/d20/d25/d8e/f9a [0,4194304] 0 2024-03-18T14:43:22.427 INFO:tasks.workunit.client.1.smithi129.stdout:8/621: dread d9/d11/d18/f3f [0,4194304] 0 2024-03-18T14:43:22.428 INFO:tasks.workunit.client.1.smithi129.stdout:7/577: fdatasync d4/d2d/f2a 0 2024-03-18T14:43:22.429 INFO:tasks.workunit.client.1.smithi129.stdout:4/511: truncate d0/d19/d46/d3e/d21/d4d/d70/f2c 2022303 0 2024-03-18T14:43:22.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/829: mkdir d1/d6/d29/d2f/d6b/d105/d11e 0 2024-03-18T14:43:22.430 INFO:tasks.workunit.client.0.smithi087.stdout:7/830: readlink d1/la4 0 2024-03-18T14:43:22.431 INFO:tasks.workunit.client.1.smithi129.stdout:1/572: dread d1/d2/d28/d65/d19/d52/fa6 [0,4194304] 0 2024-03-18T14:43:22.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/767: creat d0/de/d30/dc5/fd9 x:0 0 0 2024-03-18T14:43:22.434 INFO:tasks.workunit.client.0.smithi087.stdout:9/835: mkdir db/d18/d1c/d69/d11a 0 2024-03-18T14:43:22.434 INFO:tasks.workunit.client.1.smithi129.stdout:6/582: truncate d3/d6/d7f/db4/fb5 488040 0 2024-03-18T14:43:22.435 INFO:tasks.workunit.client.0.smithi087.stdout:4/702: chown d2/db/d24/d30/d49/cc3 2 1 2024-03-18T14:43:22.440 INFO:tasks.workunit.client.1.smithi129.stdout:2/584: creat d7/d1f/d20/fb5 x:0 0 0 2024-03-18T14:43:22.441 INFO:tasks.workunit.client.0.smithi087.stdout:8/723: unlink d1/d6/d2f/d44/d45/d71/ld7 0 2024-03-18T14:43:22.441 INFO:tasks.workunit.client.0.smithi087.stdout:8/724: chown d1/d6/f43 2 1 2024-03-18T14:43:22.442 INFO:tasks.workunit.client.0.smithi087.stdout:8/725: write d1/d6/d9/f60 [5144850,61993] 0 2024-03-18T14:43:22.444 INFO:tasks.workunit.client.1.smithi129.stdout:2/585: dwrite d7/d1c/fb1 [0,4194304] 0 2024-03-18T14:43:22.444 INFO:tasks.workunit.client.0.smithi087.stdout:9/836: symlink db/d18/d1e/db4/l11b 0 2024-03-18T14:43:22.445 INFO:tasks.workunit.client.0.smithi087.stdout:0/739: creat d0/d2/d4/d27/dc3/dd2/dff/f106 x:0 0 0 2024-03-18T14:43:22.447 INFO:tasks.workunit.client.1.smithi129.stdout:6/583: link d3/d30/f26 d3/d30/df/d28/fbb 0 2024-03-18T14:43:22.447 INFO:tasks.workunit.client.1.smithi129.stdout:4/512: dread d0/d19/d46/d3e/d21/f72 [0,4194304] 0 2024-03-18T14:43:22.447 INFO:tasks.workunit.client.1.smithi129.stdout:7/578: getdents d4/d7/d54 0 2024-03-18T14:43:22.449 INFO:tasks.workunit.client.1.smithi129.stdout:2/586: mknod d7/d1f/d20/d2b/d41/d65/d88/cb6 0 2024-03-18T14:43:22.449 INFO:tasks.workunit.client.1.smithi129.stdout:4/513: write d0/f13 [4843011,128640] 0 2024-03-18T14:43:22.449 INFO:tasks.workunit.client.1.smithi129.stdout:7/579: write d4/d7/f25 [3531679,74533] 0 2024-03-18T14:43:22.449 INFO:tasks.workunit.client.1.smithi129.stdout:6/584: write d3/d30/de/d6c/d9e/f9f [2796309,66145] 0 2024-03-18T14:43:22.450 INFO:tasks.workunit.client.1.smithi129.stdout:4/514: dread - d0/f88 zero size 2024-03-18T14:43:22.454 INFO:tasks.workunit.client.0.smithi087.stdout:1/797: truncate d3/d1d/d1e/d43/d50/d72/dc8/fd9 226300 0 2024-03-18T14:43:22.454 INFO:tasks.workunit.client.1.smithi129.stdout:5/545: dread d0/dc/d22/f35 [4194304,4194304] 0 2024-03-18T14:43:22.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/587: dwrite d7/d1f/d20/fb5 [0,4194304] 0 2024-03-18T14:43:22.454 INFO:tasks.workunit.client.0.smithi087.stdout:9/837: readlink db/d12/lf9 0 2024-03-18T14:43:22.455 INFO:tasks.workunit.client.0.smithi087.stdout:9/838: dread - db/d18/d1c/d69/d6f/fd4 zero size 2024-03-18T14:43:22.456 INFO:tasks.workunit.client.0.smithi087.stdout:9/839: stat db/d18/d1e/fd0 0 2024-03-18T14:43:22.456 INFO:tasks.workunit.client.0.smithi087.stdout:7/831: truncate d1/d6/d29/d2f/d68/d65/f117 635380 0 2024-03-18T14:43:22.456 INFO:tasks.workunit.client.1.smithi129.stdout:3/541: dread d4/d11/d1d/d36/f4a [0,4194304] 0 2024-03-18T14:43:22.456 INFO:tasks.workunit.client.0.smithi087.stdout:9/840: chown db/d18/d3a/f9f 185268 1 2024-03-18T14:43:22.457 INFO:tasks.workunit.client.1.smithi129.stdout:0/602: truncate d0/d14/f4d 2647809 0 2024-03-18T14:43:22.459 INFO:tasks.workunit.client.0.smithi087.stdout:3/768: creat d0/d3/fda x:0 0 0 2024-03-18T14:43:22.461 INFO:tasks.workunit.client.0.smithi087.stdout:2/763: sync 2024-03-18T14:43:22.461 INFO:tasks.workunit.client.1.smithi129.stdout:0/603: dwrite d0/d14/d3a/f62 [0,4194304] 0 2024-03-18T14:43:22.463 INFO:tasks.workunit.client.1.smithi129.stdout:8/622: write d9/d11/d1a/f30 [4788556,113125] 0 2024-03-18T14:43:22.463 INFO:tasks.workunit.client.1.smithi129.stdout:9/547: truncate d0/db/d1f/f4e 1296379 0 2024-03-18T14:43:22.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/713: dwrite d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:22.464 INFO:tasks.workunit.client.1.smithi129.stdout:1/573: truncate d1/d2/d28/d65/d19/f4a 4812579 0 2024-03-18T14:43:22.465 INFO:tasks.workunit.client.1.smithi129.stdout:4/515: mknod d0/d19/d46/d3e/d21/ca0 0 2024-03-18T14:43:22.465 INFO:tasks.workunit.client.0.smithi087.stdout:6/714: fsync d3/d7/d25/d62/d8b/fa1 0 2024-03-18T14:43:22.466 INFO:tasks.workunit.client.0.smithi087.stdout:4/703: write f1 [4749687,4281] 0 2024-03-18T14:43:22.467 INFO:tasks.workunit.client.0.smithi087.stdout:5/762: truncate d13/d1b/d27/d28/f78 1353227 0 2024-03-18T14:43:22.467 INFO:tasks.workunit.client.1.smithi129.stdout:1/574: write d1/d2/d28/f81 [403334,94834] 0 2024-03-18T14:43:22.468 INFO:tasks.workunit.client.0.smithi087.stdout:4/704: fdatasync d2/db/d24/d30/d49/d4f/f8f 0 2024-03-18T14:43:22.468 INFO:tasks.workunit.client.0.smithi087.stdout:5/763: write d13/d1b/d7e/ff7 [310135,13082] 0 2024-03-18T14:43:22.469 INFO:tasks.workunit.client.1.smithi129.stdout:0/604: dwrite d0/d23/d71/f96 [0,4194304] 0 2024-03-18T14:43:22.469 INFO:tasks.workunit.client.0.smithi087.stdout:0/740: mkdir d0/d1a/d107 0 2024-03-18T14:43:22.470 INFO:tasks.workunit.client.0.smithi087.stdout:4/705: write d2/db/d3c/f81 [1232490,83104] 0 2024-03-18T14:43:22.471 INFO:tasks.workunit.client.0.smithi087.stdout:5/764: chown d13/d1b/d27/d28/l85 137354 1 2024-03-18T14:43:22.471 INFO:tasks.workunit.client.1.smithi129.stdout:8/623: dwrite d9/d33/fc4 [0,4194304] 0 2024-03-18T14:43:22.472 INFO:tasks.workunit.client.1.smithi129.stdout:6/585: rename d3/d30/de/d65/l6e to d3/d30/de/da9/lbc 0 2024-03-18T14:43:22.472 INFO:tasks.workunit.client.0.smithi087.stdout:8/726: dwrite d1/d6/f7b [0,4194304] 0 2024-03-18T14:43:22.473 INFO:tasks.workunit.client.0.smithi087.stdout:9/841: mkdir db/d18/d1e/d28/d76/d80/d11c 0 2024-03-18T14:43:22.474 INFO:tasks.workunit.client.1.smithi129.stdout:2/588: link d7/f1d d7/d1f/d20/d2d/fb7 0 2024-03-18T14:43:22.474 INFO:tasks.workunit.client.0.smithi087.stdout:3/769: mkdir d0/de/d30/d60/ddb 0 2024-03-18T14:43:22.474 INFO:tasks.workunit.client.0.smithi087.stdout:9/842: dread - db/d18/d1e/d28/d76/da7/fc5 zero size 2024-03-18T14:43:22.476 INFO:tasks.workunit.client.1.smithi129.stdout:8/624: dread d9/d11/d1a/f4b [0,4194304] 0 2024-03-18T14:43:22.477 INFO:tasks.workunit.client.0.smithi087.stdout:6/715: creat d3/d7/ff1 x:0 0 0 2024-03-18T14:43:22.478 INFO:tasks.workunit.client.0.smithi087.stdout:7/832: getdents d1/d6/d29/d2f/dea 0 2024-03-18T14:43:22.479 INFO:tasks.workunit.client.0.smithi087.stdout:4/706: chown d2/db/d84/d87/f88 3802 1 2024-03-18T14:43:22.482 INFO:tasks.workunit.client.0.smithi087.stdout:0/741: dread d0/d2/d4/de8/dad/dea/da3/da8/fcc [0,4194304] 0 2024-03-18T14:43:22.485 INFO:tasks.workunit.client.0.smithi087.stdout:8/727: dread d1/f5 [0,4194304] 0 2024-03-18T14:43:22.486 INFO:tasks.workunit.client.0.smithi087.stdout:8/728: chown d1/d6/d2f/d44/d45/d50/f73 7 1 2024-03-18T14:43:22.487 INFO:tasks.workunit.client.0.smithi087.stdout:2/764: mknod d2/ddd/d22/d2c/d3a/d40/d4a/cfa 0 2024-03-18T14:43:22.488 INFO:tasks.workunit.client.0.smithi087.stdout:2/765: chown d2/ddd/d22/d2c 90027 1 2024-03-18T14:43:22.490 INFO:tasks.workunit.client.0.smithi087.stdout:6/716: creat d3/d7/d25/d62/d7c/da0/d96/d97/ff2 x:0 0 0 2024-03-18T14:43:22.490 INFO:tasks.workunit.client.1.smithi129.stdout:0/605: mknod d0/d23/d71/cbb 0 2024-03-18T14:43:22.491 INFO:tasks.workunit.client.1.smithi129.stdout:4/516: rename d0/d19/d46/c67 to d0/d19/d46/d3e/d21/d32/ca1 0 2024-03-18T14:43:22.491 INFO:tasks.workunit.client.1.smithi129.stdout:6/586: symlink d3/d6/d7f/lbd 0 2024-03-18T14:43:22.491 INFO:tasks.workunit.client.0.smithi087.stdout:4/707: symlink d2/db/d82/le9 0 2024-03-18T14:43:22.491 INFO:tasks.workunit.client.0.smithi087.stdout:8/729: dwrite d1/d6/d2f/d44/d45/d71/daa/fdb [0,4194304] 0 2024-03-18T14:43:22.492 INFO:tasks.workunit.client.1.smithi129.stdout:6/587: fdatasync d3/d6/f8a 0 2024-03-18T14:43:22.492 INFO:tasks.workunit.client.1.smithi129.stdout:4/517: write d0/d19/d46/d3e/d21/f5c [836170,76708] 0 2024-03-18T14:43:22.492 INFO:tasks.workunit.client.1.smithi129.stdout:3/542: link d4/dd/d1f/d5f/d31/l48 d4/d11/d1d/d36/lba 0 2024-03-18T14:43:22.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/766: dread d2/ddd/f19 [0,4194304] 0 2024-03-18T14:43:22.501 INFO:tasks.workunit.client.0.smithi087.stdout:2/767: stat d2/ddd 0 2024-03-18T14:43:22.502 INFO:tasks.workunit.client.0.smithi087.stdout:2/768: chown d2/ddd/d22/d2c/d3a/d40/d4a 7 1 2024-03-18T14:43:22.509 INFO:tasks.workunit.client.0.smithi087.stdout:3/770: dread d0/d1c/d25/f7b [0,4194304] 0 2024-03-18T14:43:22.511 INFO:tasks.workunit.client.1.smithi129.stdout:7/580: sync 2024-03-18T14:43:22.527 INFO:tasks.workunit.client.0.smithi087.stdout:2/769: dread d2/ddd/d22/fe2 [0,4194304] 0 2024-03-18T14:43:22.531 INFO:tasks.workunit.client.0.smithi087.stdout:2/770: dwrite d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fbe [0,4194304] 0 2024-03-18T14:43:22.566 INFO:tasks.workunit.client.1.smithi129.stdout:8/625: creat d9/d11/d18/fd1 x:0 0 0 2024-03-18T14:43:22.567 INFO:tasks.workunit.client.1.smithi129.stdout:1/575: fdatasync d1/d35/f4c 0 2024-03-18T14:43:22.567 INFO:tasks.workunit.client.1.smithi129.stdout:1/576: chown d1/d2/d70/l5b 62 1 2024-03-18T14:43:22.569 INFO:tasks.workunit.client.1.smithi129.stdout:6/588: mkdir d3/d6/d82/d9a/dbe 0 2024-03-18T14:43:22.570 INFO:tasks.workunit.client.0.smithi087.stdout:1/798: link d3/d1d/d1f/d34/d38/c4c d3/d1d/d67/d94/cf5 0 2024-03-18T14:43:22.571 INFO:tasks.workunit.client.0.smithi087.stdout:7/833: creat d1/d6/d29/d2f/dea/f11f x:0 0 0 2024-03-18T14:43:22.575 INFO:tasks.workunit.client.0.smithi087.stdout:1/799: dwrite d3/d1d/d1f/d34/f35 [0,4194304] 0 2024-03-18T14:43:22.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/581: creat d4/d2d/d2e/d42/d58/fb7 x:0 0 0 2024-03-18T14:43:22.576 INFO:tasks.workunit.client.1.smithi129.stdout:7/582: stat d4/d7/f63 0 2024-03-18T14:43:22.576 INFO:tasks.workunit.client.0.smithi087.stdout:1/800: dread - d3/fb5 zero size 2024-03-18T14:43:22.576 INFO:tasks.workunit.client.1.smithi129.stdout:7/583: dread - d4/d7/d38/f77 zero size 2024-03-18T14:43:22.577 INFO:tasks.workunit.client.0.smithi087.stdout:4/708: dwrite d2/db/d67/fbc [0,4194304] 0 2024-03-18T14:43:22.579 INFO:tasks.workunit.client.1.smithi129.stdout:9/548: getdents d0/db/d2e 0 2024-03-18T14:43:22.580 INFO:tasks.workunit.client.1.smithi129.stdout:9/549: chown d0/d15/l5b 249 1 2024-03-18T14:43:22.580 INFO:tasks.workunit.client.1.smithi129.stdout:1/577: truncate d1/d2/d28/f51 603194 0 2024-03-18T14:43:22.581 INFO:tasks.workunit.client.0.smithi087.stdout:5/765: rename d13/d1b/f94 to d13/d1b/d27/ffe 0 2024-03-18T14:43:22.581 INFO:tasks.workunit.client.0.smithi087.stdout:3/771: write d0/d3/df/f4d [1218203,64876] 0 2024-03-18T14:43:22.582 INFO:tasks.workunit.client.0.smithi087.stdout:6/717: symlink d3/d7/d25/d62/lf3 0 2024-03-18T14:43:22.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/550: write d0/db/d90/d70/fa6 [48353,106799] 0 2024-03-18T14:43:22.582 INFO:tasks.workunit.client.1.smithi129.stdout:2/589: truncate d7/d1f/d34/f15 2910824 0 2024-03-18T14:43:22.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/730: dwrite d1/d6/d2f/d44/f81 [0,4194304] 0 2024-03-18T14:43:22.583 INFO:tasks.workunit.client.1.smithi129.stdout:3/543: mkdir d4/d11/dbb 0 2024-03-18T14:43:22.583 INFO:tasks.workunit.client.1.smithi129.stdout:2/590: write d7/d1f/d34/f82 [4496550,6799] 0 2024-03-18T14:43:22.583 INFO:tasks.workunit.client.0.smithi087.stdout:7/834: symlink d1/d6/d29/d2f/d6b/d105/l120 0 2024-03-18T14:43:22.584 INFO:tasks.workunit.client.0.smithi087.stdout:8/731: fsync d1/d6/d2f/d44/d45/d71/daa/fdb 0 2024-03-18T14:43:22.585 INFO:tasks.workunit.client.0.smithi087.stdout:8/732: read - d1/d6/d2f/d44/d4b/fc9 zero size 2024-03-18T14:43:22.586 INFO:tasks.workunit.client.1.smithi129.stdout:3/544: dread - d4/dd/d1f/d5f/d31/f77 zero size 2024-03-18T14:43:22.586 INFO:tasks.workunit.client.1.smithi129.stdout:4/518: rename d0/d9/d40/c8e to d0/d19/d46/d3e/d21/d7f/ca2 0 2024-03-18T14:43:22.586 INFO:tasks.workunit.client.1.smithi129.stdout:1/578: dwrite d1/d2/d28/d65/f99 [0,4194304] 0 2024-03-18T14:43:22.586 INFO:tasks.workunit.client.1.smithi129.stdout:5/546: link d0/d32/d34/c4a d0/dc/d18/d2b/ca4 0 2024-03-18T14:43:22.587 INFO:tasks.workunit.client.0.smithi087.stdout:4/709: creat d2/db/d24/d30/d7b/dbe/fea x:0 0 0 2024-03-18T14:43:22.587 INFO:tasks.workunit.client.1.smithi129.stdout:4/519: write d0/f88 [556663,42975] 0 2024-03-18T14:43:22.591 INFO:tasks.workunit.client.0.smithi087.stdout:9/843: rename db/d18/d51/f5c to db/d18/d1e/d28/d76/da7/f11d 0 2024-03-18T14:43:22.594 INFO:tasks.workunit.client.0.smithi087.stdout:3/772: dread d0/d1c/fd8 [0,4194304] 0 2024-03-18T14:43:22.596 INFO:tasks.workunit.client.0.smithi087.stdout:0/742: getdents d0/d1a/d7b 0 2024-03-18T14:43:22.598 INFO:tasks.workunit.client.0.smithi087.stdout:5/766: mknod d13/d1b/cff 0 2024-03-18T14:43:22.598 INFO:tasks.workunit.client.1.smithi129.stdout:8/626: unlink d9/d11/d1a/d32/c37 0 2024-03-18T14:43:22.598 INFO:tasks.workunit.client.1.smithi129.stdout:0/606: link d0/d23/d29/c64 d0/d6c/cbc 0 2024-03-18T14:43:22.599 INFO:tasks.workunit.client.1.smithi129.stdout:8/627: chown d9/d11/d1a/d32/d41/d4d/d96/dcc 5188425 1 2024-03-18T14:43:22.600 INFO:tasks.workunit.client.1.smithi129.stdout:6/589: creat d3/d30/de/d6c/d9e/db6/fbf x:0 0 0 2024-03-18T14:43:22.601 INFO:tasks.workunit.client.0.smithi087.stdout:7/835: rename d1/d97/l10c to d1/d6/da/d59/dfe/l121 0 2024-03-18T14:43:22.602 INFO:tasks.workunit.client.0.smithi087.stdout:2/771: getdents d2/ddd/d22/d2c/d3a/d49/d58/d78 0 2024-03-18T14:43:22.602 INFO:tasks.workunit.client.1.smithi129.stdout:2/591: rmdir d7/d1f/d20/d2b/d41/da6 39 2024-03-18T14:43:22.603 INFO:tasks.workunit.client.1.smithi129.stdout:3/545: fdatasync d4/dd/f32 0 2024-03-18T14:43:22.605 INFO:tasks.workunit.client.0.smithi087.stdout:8/733: truncate d1/d6/d9/f8c 1084611 0 2024-03-18T14:43:22.606 INFO:tasks.workunit.client.1.smithi129.stdout:4/520: unlink d0/d9/d40/d5f/f62 0 2024-03-18T14:43:22.607 INFO:tasks.workunit.client.0.smithi087.stdout:2/772: dwrite d2/ddd/d22/d2c/d3a/d40/d52/f5c [0,4194304] 0 2024-03-18T14:43:22.608 INFO:tasks.workunit.client.1.smithi129.stdout:0/607: mkdir d0/d14/d3a/d4a/d7a/dbd 0 2024-03-18T14:43:22.608 INFO:tasks.workunit.client.1.smithi129.stdout:8/628: mkdir d9/d11/d18/da4/dd2 0 2024-03-18T14:43:22.609 INFO:tasks.workunit.client.1.smithi129.stdout:9/551: mkdir d0/db/d1f/d20/d26/db4 0 2024-03-18T14:43:22.610 INFO:tasks.workunit.client.0.smithi087.stdout:9/844: rename db/d18/d51/c61 to db/d18/d1e/d28/d76/db7/dd5/c11e 0 2024-03-18T14:43:22.611 INFO:tasks.workunit.client.0.smithi087.stdout:6/718: getdents d3/d7/d25/d62/d7c/d29/d22/d23 0 2024-03-18T14:43:22.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/773: dwrite d2/ddd/d22/d2c/d3a/fc1 [4194304,4194304] 0 2024-03-18T14:43:22.612 INFO:tasks.workunit.client.1.smithi129.stdout:6/590: rename d3/d30/df/d28/d79/l84 to d3/d30/df/d28/d79/daf/lc0 0 2024-03-18T14:43:22.612 INFO:tasks.workunit.client.1.smithi129.stdout:7/584: dread d4/d7/d8/d3b/f6d [0,4194304] 0 2024-03-18T14:43:22.612 INFO:tasks.workunit.client.0.smithi087.stdout:9/845: dread - db/d18/d1e/d28/d76/da7/fc5 zero size 2024-03-18T14:43:22.613 INFO:tasks.workunit.client.0.smithi087.stdout:3/773: symlink d0/d3/d4f/d6e/ldc 0 2024-03-18T14:43:22.614 INFO:tasks.workunit.client.0.smithi087.stdout:7/836: truncate d1/d6/d29/d2f/d68/d65/d60/f94 594333 0 2024-03-18T14:43:22.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/710: link d2/db/d24/f33 d2/db/d24/feb 0 2024-03-18T14:43:22.621 INFO:tasks.workunit.client.1.smithi129.stdout:2/592: mknod d7/d1f/d20/d2b/cb8 0 2024-03-18T14:43:22.623 INFO:tasks.workunit.client.0.smithi087.stdout:2/774: creat d2/ddd/d22/d24/d65/d7f/ffb x:0 0 0 2024-03-18T14:43:22.624 INFO:tasks.workunit.client.1.smithi129.stdout:3/546: symlink d4/d38/da3/lbc 0 2024-03-18T14:43:22.624 INFO:tasks.workunit.client.0.smithi087.stdout:2/775: chown d2/ddd/fd 427 1 2024-03-18T14:43:22.624 INFO:tasks.workunit.client.0.smithi087.stdout:3/774: rmdir d0/d3/d40 39 2024-03-18T14:43:22.626 INFO:tasks.workunit.client.0.smithi087.stdout:3/775: read d0/d3/d95/fae [3036962,20406] 0 2024-03-18T14:43:22.627 INFO:tasks.workunit.client.1.smithi129.stdout:5/547: dwrite d0/f11 [0,4194304] 0 2024-03-18T14:43:22.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/548: write d0/df/f68 [1445367,111402] 0 2024-03-18T14:43:22.628 INFO:tasks.workunit.client.0.smithi087.stdout:0/743: dread d0/d1a/d80/d88/dbd/fc7 [0,4194304] 0 2024-03-18T14:43:22.631 INFO:tasks.workunit.client.1.smithi129.stdout:3/547: dwrite d4/d11/d1d/d50/d90/fb6 [0,4194304] 0 2024-03-18T14:43:22.632 INFO:tasks.workunit.client.1.smithi129.stdout:3/548: read - d4/d11/d1d/d50/d91/d97/fa2 zero size 2024-03-18T14:43:22.632 INFO:tasks.workunit.client.1.smithi129.stdout:4/521: creat d0/d3c/d6c/fa3 x:0 0 0 2024-03-18T14:43:22.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/629: fsync d9/f15 0 2024-03-18T14:43:22.633 INFO:tasks.workunit.client.1.smithi129.stdout:4/522: dread - d0/d9/d4c/f90 zero size 2024-03-18T14:43:22.635 INFO:tasks.workunit.client.0.smithi087.stdout:1/801: dwrite d3/d1d/d1e/d20/d7a/f83 [0,4194304] 0 2024-03-18T14:43:22.635 INFO:tasks.workunit.client.0.smithi087.stdout:5/767: write d13/d1b/d27/d8f/dab/fd5 [742300,27744] 0 2024-03-18T14:43:22.636 INFO:tasks.workunit.client.1.smithi129.stdout:0/608: unlink d0/d14/d28/d63/fa2 0 2024-03-18T14:43:22.637 INFO:tasks.workunit.client.0.smithi087.stdout:6/719: dread d3/d7/d25/f41 [0,4194304] 0 2024-03-18T14:43:22.639 INFO:tasks.workunit.client.1.smithi129.stdout:9/552: dwrite d0/db/d90/d3e/f66 [0,4194304] 0 2024-03-18T14:43:22.641 INFO:tasks.workunit.client.1.smithi129.stdout:6/591: creat d3/d5/d46/fc1 x:0 0 0 2024-03-18T14:43:22.641 INFO:tasks.workunit.client.1.smithi129.stdout:6/592: stat d3/d6/d82/d9a 0 2024-03-18T14:43:22.644 INFO:tasks.workunit.client.1.smithi129.stdout:2/593: dread d7/d1c/f26 [0,4194304] 0 2024-03-18T14:43:22.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/744: dread d0/f6c [0,4194304] 0 2024-03-18T14:43:22.644 INFO:tasks.workunit.client.0.smithi087.stdout:0/745: chown d0/d2/d4/de8/dad/dea 1 1 2024-03-18T14:43:22.648 INFO:tasks.workunit.client.1.smithi129.stdout:1/579: creat d1/d2/d28/d65/fb0 x:0 0 0 2024-03-18T14:43:22.649 INFO:tasks.workunit.client.1.smithi129.stdout:2/594: dwrite d7/d1f/d20/d36/da9/fb4 [0,4194304] 0 2024-03-18T14:43:22.649 INFO:tasks.workunit.client.1.smithi129.stdout:3/549: fsync d4/dd/d1f/d5f/f5b 0 2024-03-18T14:43:22.651 INFO:tasks.workunit.client.1.smithi129.stdout:8/630: mknod d9/d33/cd3 0 2024-03-18T14:43:22.654 INFO:tasks.workunit.client.1.smithi129.stdout:9/553: unlink d0/db/d90/d3e/f66 0 2024-03-18T14:43:22.655 INFO:tasks.workunit.client.1.smithi129.stdout:6/593: rmdir d3/d5 39 2024-03-18T14:43:22.655 INFO:tasks.workunit.client.1.smithi129.stdout:8/631: dwrite d9/d11/d18/f8d [0,4194304] 0 2024-03-18T14:43:22.661 INFO:tasks.workunit.client.1.smithi129.stdout:3/550: chown d4/d11/d1d/d36/lba 146403 1 2024-03-18T14:43:22.663 INFO:tasks.workunit.client.1.smithi129.stdout:4/523: unlink d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/f94 0 2024-03-18T14:43:22.664 INFO:tasks.workunit.client.1.smithi129.stdout:9/554: fdatasync d0/db/d11/d97/f9e 0 2024-03-18T14:43:22.665 INFO:tasks.workunit.client.1.smithi129.stdout:6/594: symlink d3/d6/d82/lc2 0 2024-03-18T14:43:22.667 INFO:tasks.workunit.client.1.smithi129.stdout:8/632: rename d9/ca7 to d9/d11/d1a/d14/cd4 0 2024-03-18T14:43:22.667 INFO:tasks.workunit.client.1.smithi129.stdout:4/524: dwrite d0/f88 [0,4194304] 0 2024-03-18T14:43:22.668 INFO:tasks.workunit.client.1.smithi129.stdout:7/585: link d4/d2d/d3a/lb6 d4/d7/d38/d61/d68/lb8 0 2024-03-18T14:43:22.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/551: rmdir d4/dd/d41 39 2024-03-18T14:43:22.672 INFO:tasks.workunit.client.1.smithi129.stdout:7/586: dwrite d4/d7/d38/d61/f97 [0,4194304] 0 2024-03-18T14:43:22.676 INFO:tasks.workunit.client.0.smithi087.stdout:4/711: rmdir d2/db/d24/d30/d7b/dbe/dcf 39 2024-03-18T14:43:22.677 INFO:tasks.workunit.client.1.smithi129.stdout:0/609: write d0/d6c/f85 [4030846,49229] 0 2024-03-18T14:43:22.677 INFO:tasks.workunit.client.0.smithi087.stdout:9/846: rmdir db/d18/d1e/d28/dc2/dec 39 2024-03-18T14:43:22.678 INFO:tasks.workunit.client.1.smithi129.stdout:0/610: dread - d0/d14/fb9 zero size 2024-03-18T14:43:22.680 INFO:tasks.workunit.client.0.smithi087.stdout:8/734: creat d1/d6/ff2 x:0 0 0 2024-03-18T14:43:22.683 INFO:tasks.workunit.client.0.smithi087.stdout:1/802: fsync d3/d1d/d67/f88 0 2024-03-18T14:43:22.684 INFO:tasks.workunit.client.1.smithi129.stdout:1/580: dwrite d1/d2/f4b [0,4194304] 0 2024-03-18T14:43:22.685 INFO:tasks.workunit.client.0.smithi087.stdout:5/768: creat d13/d1b/d27/d98/dc2/f100 x:0 0 0 2024-03-18T14:43:22.685 INFO:tasks.workunit.client.1.smithi129.stdout:8/633: rmdir d9/d11 39 2024-03-18T14:43:22.686 INFO:tasks.workunit.client.1.smithi129.stdout:1/581: read d1/d2/d28/d65/d7c/d7d/d80/f83 [2721160,43314] 0 2024-03-18T14:43:22.687 INFO:tasks.workunit.client.1.smithi129.stdout:1/582: fsync d1/d2/d28/d65/fae 0 2024-03-18T14:43:22.688 INFO:tasks.workunit.client.0.smithi087.stdout:0/746: rename d0/f10 to d0/d1a/d34/d3d/dd6/f108 0 2024-03-18T14:43:22.689 INFO:tasks.workunit.client.1.smithi129.stdout:5/549: getdents d0/d32/d34/d6c 0 2024-03-18T14:43:22.689 INFO:tasks.workunit.client.1.smithi129.stdout:2/595: truncate d7/f6e 506151 0 2024-03-18T14:43:22.691 INFO:tasks.workunit.client.1.smithi129.stdout:4/525: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:22.697 INFO:tasks.workunit.client.1.smithi129.stdout:9/555: dread d0/f5 [4194304,4194304] 0 2024-03-18T14:43:22.697 INFO:tasks.workunit.client.1.smithi129.stdout:9/556: fsync d0/db/d90/d3e/f81 0 2024-03-18T14:43:22.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/596: fdatasync d7/d1f/d20/d2d/fb7 0 2024-03-18T14:43:22.704 INFO:tasks.workunit.client.1.smithi129.stdout:7/587: mknod d4/cb9 0 2024-03-18T14:43:22.706 INFO:tasks.workunit.client.1.smithi129.stdout:8/634: creat d9/d11/d1a/d14/d60/fd5 x:0 0 0 2024-03-18T14:43:22.706 INFO:tasks.workunit.client.0.smithi087.stdout:6/720: dwrite d3/d7/d25/d62/d7c/d29/d22/d61/fb8 [0,4194304] 0 2024-03-18T14:43:22.707 INFO:tasks.workunit.client.1.smithi129.stdout:6/595: dread d3/d30/de/d6c/f53 [0,4194304] 0 2024-03-18T14:43:22.708 INFO:tasks.workunit.client.0.smithi087.stdout:3/776: creat d0/d3/d4f/d6e/dc8/fdd x:0 0 0 2024-03-18T14:43:22.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/747: mkdir d0/d2/d4/d8b/d109 0 2024-03-18T14:43:22.711 INFO:tasks.workunit.client.1.smithi129.stdout:8/635: dwrite d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:22.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/748: write d0/d2/d4/de8/dad/dea/da3/da8/fb3 [170737,92085] 0 2024-03-18T14:43:22.712 INFO:tasks.workunit.client.0.smithi087.stdout:0/749: chown d0/d2/d4/lb 4170 1 2024-03-18T14:43:22.712 INFO:tasks.workunit.client.1.smithi129.stdout:2/597: creat d7/d1f/d20/d36/fb9 x:0 0 0 2024-03-18T14:43:22.713 INFO:tasks.workunit.client.0.smithi087.stdout:0/750: chown d0/d1a/d7b/d26/fed 1650 1 2024-03-18T14:43:22.713 INFO:tasks.workunit.client.0.smithi087.stdout:2/776: truncate d2/ddd/d22/d2c/d3a/d40/d52/fae 4535882 0 2024-03-18T14:43:22.714 INFO:tasks.workunit.client.1.smithi129.stdout:0/611: link d0/c7e d0/d23/d6b/cbe 0 2024-03-18T14:43:22.715 INFO:tasks.workunit.client.1.smithi129.stdout:7/588: dread d4/d7/d38/d61/d68/f75 [0,4194304] 0 2024-03-18T14:43:22.718 INFO:tasks.workunit.client.0.smithi087.stdout:7/837: getdents d1/d6/d29/d2f/d68/d65/d60 0 2024-03-18T14:43:22.720 INFO:tasks.workunit.client.1.smithi129.stdout:2/598: rename d7/d1f/d81/fb0 to d7/d1f/d20/d2b/d41/d65/fba 0 2024-03-18T14:43:22.721 INFO:tasks.workunit.client.1.smithi129.stdout:2/599: chown d7/d1c/d32 235962 1 2024-03-18T14:43:22.723 INFO:tasks.workunit.client.0.smithi087.stdout:4/712: truncate d2/db/d24/f26 3498616 0 2024-03-18T14:43:22.724 INFO:tasks.workunit.client.1.smithi129.stdout:9/557: creat d0/db/fb5 x:0 0 0 2024-03-18T14:43:22.724 INFO:tasks.workunit.client.1.smithi129.stdout:6/596: mkdir d3/d30/df/d28/d79/daf/db7/dc3 0 2024-03-18T14:43:22.725 INFO:tasks.workunit.client.1.smithi129.stdout:5/550: write d0/dc/d22/f1e [1592607,25779] 0 2024-03-18T14:43:22.726 INFO:tasks.workunit.client.1.smithi129.stdout:4/526: truncate d0/d19/d46/f63 3716195 0 2024-03-18T14:43:22.728 INFO:tasks.workunit.client.1.smithi129.stdout:4/527: fsync d0/d9/d4c/f6d 0 2024-03-18T14:43:22.728 INFO:tasks.workunit.client.0.smithi087.stdout:3/777: unlink d0/d3/d4f/d6e/laf 0 2024-03-18T14:43:22.728 INFO:tasks.workunit.client.1.smithi129.stdout:3/552: dwrite d4/f54 [0,4194304] 0 2024-03-18T14:43:22.729 INFO:tasks.workunit.client.1.smithi129.stdout:7/589: mkdir d4/d7/d38/d61/d6a/dba 0 2024-03-18T14:43:22.730 INFO:tasks.workunit.client.1.smithi129.stdout:3/553: write d4/fa1 [870706,88561] 0 2024-03-18T14:43:22.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/769: rename d13/c36 to d13/d1b/d27/d35/d3b/c101 0 2024-03-18T14:43:22.731 INFO:tasks.workunit.client.0.smithi087.stdout:9/847: link db/d12/c17 db/d18/d1e/d28/d7c/dba/c11f 0 2024-03-18T14:43:22.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/597: chown d3/d30/de/d65/d80/f98 773 1 2024-03-18T14:43:22.733 INFO:tasks.workunit.client.0.smithi087.stdout:6/721: write d3/d7/d25/f4d [1060887,100221] 0 2024-03-18T14:43:22.735 INFO:tasks.workunit.client.0.smithi087.stdout:1/803: truncate d3/d1d/d1e/d43/d50/d72/f9d 1260406 0 2024-03-18T14:43:22.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/722: write d3/d7/d25/d62/d7c/d29/dce/fe1 [593808,66166] 0 2024-03-18T14:43:22.735 INFO:tasks.workunit.client.1.smithi129.stdout:4/528: mknod d0/d19/d46/d3e/d21/d7f/ca4 0 2024-03-18T14:43:22.736 INFO:tasks.workunit.client.1.smithi129.stdout:2/600: creat d7/d1f/d34/da5/fbb x:0 0 0 2024-03-18T14:43:22.736 INFO:tasks.workunit.client.0.smithi087.stdout:1/804: write d3/d1d/d1e/d43/d50/f58 [4083987,107187] 0 2024-03-18T14:43:22.736 INFO:tasks.workunit.client.1.smithi129.stdout:6/598: dwrite d3/d30/de/d65/d93/f97 [0,4194304] 0 2024-03-18T14:43:22.737 INFO:tasks.workunit.client.0.smithi087.stdout:7/838: mknod d1/d6/d29/d2f/d68/c122 0 2024-03-18T14:43:22.737 INFO:tasks.workunit.client.0.smithi087.stdout:1/805: write d3/d1d/d1e/d43/d50/d72/f86 [3695787,78319] 0 2024-03-18T14:43:22.738 INFO:tasks.workunit.client.1.smithi129.stdout:7/590: creat d4/d83/fbb x:0 0 0 2024-03-18T14:43:22.738 INFO:tasks.workunit.client.0.smithi087.stdout:4/713: rmdir d2 39 2024-03-18T14:43:22.738 INFO:tasks.workunit.client.0.smithi087.stdout:0/751: dread d0/d1a/fd1 [0,4194304] 0 2024-03-18T14:43:22.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/778: mknod d0/d3/d10/da5/cde 0 2024-03-18T14:43:22.740 INFO:tasks.workunit.client.0.smithi087.stdout:7/839: read d1/d6/d29/d2f/d68/d65/fb1 [2249153,14155] 0 2024-03-18T14:43:22.740 INFO:tasks.workunit.client.0.smithi087.stdout:3/779: write d0/d1c/d25/f7b [1726314,4801] 0 2024-03-18T14:43:22.743 INFO:tasks.workunit.client.0.smithi087.stdout:2/777: symlink d2/ddd/d22/d24/d91/dd7/lfc 0 2024-03-18T14:43:22.743 INFO:tasks.workunit.client.0.smithi087.stdout:5/770: rmdir d13/d1b/d30/d6e/d88 39 2024-03-18T14:43:22.743 INFO:tasks.workunit.client.1.smithi129.stdout:7/591: dwrite d4/d2d/d2e/d42/d58/f7f [0,4194304] 0 2024-03-18T14:43:22.744 INFO:tasks.workunit.client.1.smithi129.stdout:7/592: readlink d4/d7/d8/l26 0 2024-03-18T14:43:22.746 INFO:tasks.workunit.client.0.smithi087.stdout:6/723: mkdir d3/d7/d25/df4 0 2024-03-18T14:43:22.746 INFO:tasks.workunit.client.0.smithi087.stdout:9/848: creat db/d18/d1c/d69/f120 x:0 0 0 2024-03-18T14:43:22.746 INFO:tasks.workunit.client.1.smithi129.stdout:6/599: mkdir d3/d30/df/d28/d79/dc4 0 2024-03-18T14:43:22.746 INFO:tasks.workunit.client.1.smithi129.stdout:4/529: symlink d0/d9/d85/la5 0 2024-03-18T14:43:22.747 INFO:tasks.workunit.client.0.smithi087.stdout:6/724: write d3/d7/f57 [614476,117027] 0 2024-03-18T14:43:22.749 INFO:tasks.workunit.client.1.smithi129.stdout:6/600: write d3/d30/de/d6c/f31 [1973525,80769] 0 2024-03-18T14:43:22.750 INFO:tasks.workunit.client.1.smithi129.stdout:0/612: link d0/c8 d0/d23/cbf 0 2024-03-18T14:43:22.751 INFO:tasks.workunit.client.1.smithi129.stdout:9/558: getdents d0/db/d2e/d9f 0 2024-03-18T14:43:22.752 INFO:tasks.workunit.client.0.smithi087.stdout:8/735: getdents d1/d6/d14/db2 0 2024-03-18T14:43:22.752 INFO:tasks.workunit.client.1.smithi129.stdout:8/636: dread d9/d11/d1a/d32/d3a/f49 [4194304,4194304] 0 2024-03-18T14:43:22.752 INFO:tasks.workunit.client.0.smithi087.stdout:0/752: truncate d0/d1a/d8c/fa4 1441273 0 2024-03-18T14:43:22.753 INFO:tasks.workunit.client.0.smithi087.stdout:0/753: chown d0/d1a/d7b/d2a 20666 1 2024-03-18T14:43:22.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/593: dwrite d4/d7/d38/f77 [0,4194304] 0 2024-03-18T14:43:22.753 INFO:tasks.workunit.client.0.smithi087.stdout:7/840: mkdir d1/d6/d29/d2f/d68/d65/d96/d123 0 2024-03-18T14:43:22.754 INFO:tasks.workunit.client.0.smithi087.stdout:0/754: chown d0/d1a/d7b/d26/fed 6592 1 2024-03-18T14:43:22.755 INFO:tasks.workunit.client.1.smithi129.stdout:3/554: dwrite d4/dd/d1f/f4b [4194304,4194304] 0 2024-03-18T14:43:22.755 INFO:tasks.workunit.client.1.smithi129.stdout:7/594: stat d4/d8c/d9e 0 2024-03-18T14:43:22.756 INFO:tasks.workunit.client.0.smithi087.stdout:5/771: rmdir d13/d1b/d27/d35/dc6 39 2024-03-18T14:43:22.757 INFO:tasks.workunit.client.1.smithi129.stdout:7/595: fdatasync d4/d2d/d2e/d42/d58/fb7 0 2024-03-18T14:43:22.758 INFO:tasks.workunit.client.0.smithi087.stdout:2/778: mknod d2/d44/d72/d8a/cfd 0 2024-03-18T14:43:22.759 INFO:tasks.workunit.client.1.smithi129.stdout:0/613: dwrite d0/d23/d35/d3b/f33 [0,4194304] 0 2024-03-18T14:43:22.760 INFO:tasks.workunit.client.0.smithi087.stdout:6/725: mknod d3/d7/d25/d62/d7c/da0/d96/d97/cf5 0 2024-03-18T14:43:22.760 INFO:tasks.workunit.client.1.smithi129.stdout:0/614: readlink d0/l2e 0 2024-03-18T14:43:22.760 INFO:tasks.workunit.client.1.smithi129.stdout:5/551: dread d0/df/f66 [0,4194304] 0 2024-03-18T14:43:22.761 INFO:tasks.workunit.client.0.smithi087.stdout:4/714: truncate d2/db/d24/d30/d7b/d7f/f57 589996 0 2024-03-18T14:43:22.763 INFO:tasks.workunit.client.1.smithi129.stdout:6/601: symlink d3/d30/de/da9/lc5 0 2024-03-18T14:43:22.766 INFO:tasks.workunit.client.1.smithi129.stdout:3/555: mknod d4/d11/d1d/d50/d91/d93/cbd 0 2024-03-18T14:43:22.766 INFO:tasks.workunit.client.0.smithi087.stdout:2/779: creat d2/ddd/d22/d2c/ffe x:0 0 0 2024-03-18T14:43:22.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/556: write d4/d11/d34/d3c/d95/f96 [188726,37590] 0 2024-03-18T14:43:22.768 INFO:tasks.workunit.client.0.smithi087.stdout:3/780: link d0/d3/d95/fae d0/de/d30/d67/fdf 0 2024-03-18T14:43:22.773 INFO:tasks.workunit.client.1.smithi129.stdout:0/615: mkdir d0/d23/d35/d3b/d42/dc0 0 2024-03-18T14:43:22.773 INFO:tasks.workunit.client.1.smithi129.stdout:5/552: dread d0/f14 [0,4194304] 0 2024-03-18T14:43:22.774 INFO:tasks.workunit.client.1.smithi129.stdout:0/616: readlink d0/d14/d3a/d4a/d7a/l87 0 2024-03-18T14:43:22.774 INFO:tasks.workunit.client.0.smithi087.stdout:7/841: creat d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f124 x:0 0 0 2024-03-18T14:43:22.775 INFO:tasks.workunit.client.1.smithi129.stdout:0/617: write d0/d6c/f85 [982434,47882] 0 2024-03-18T14:43:22.775 INFO:tasks.workunit.client.1.smithi129.stdout:4/530: unlink d0/d19/d46/d3e/d21/d4d/d70/l3f 0 2024-03-18T14:43:22.777 INFO:tasks.workunit.client.1.smithi129.stdout:4/531: chown d0/d9/d4c/f90 1167 1 2024-03-18T14:43:22.777 INFO:tasks.workunit.client.1.smithi129.stdout:7/596: symlink d4/d2d/d2e/lbc 0 2024-03-18T14:43:22.779 INFO:tasks.workunit.client.1.smithi129.stdout:5/553: dwrite d0/dc/f7b [0,4194304] 0 2024-03-18T14:43:22.779 INFO:tasks.workunit.client.1.smithi129.stdout:1/583: sync 2024-03-18T14:43:22.779 INFO:tasks.workunit.client.1.smithi129.stdout:1/584: stat d1/f9 0 2024-03-18T14:43:22.780 INFO:tasks.workunit.client.1.smithi129.stdout:1/585: readlink d1/d2/d70/d87/l9e 0 2024-03-18T14:43:22.781 INFO:tasks.workunit.client.1.smithi129.stdout:3/557: creat d4/d11/d34/d3c/d3f/fbe x:0 0 0 2024-03-18T14:43:22.781 INFO:tasks.workunit.client.0.smithi087.stdout:1/806: dwrite d3/d1d/d1e/d43/d50/d71/fc1 [0,4194304] 0 2024-03-18T14:43:22.783 INFO:tasks.workunit.client.0.smithi087.stdout:5/772: write fb [369432,6368] 0 2024-03-18T14:43:22.784 INFO:tasks.workunit.client.0.smithi087.stdout:2/780: rmdir d2/ddd/d22/d2c/d3a/d49/d58 39 2024-03-18T14:43:22.784 INFO:tasks.workunit.client.1.smithi129.stdout:2/601: dwrite d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:22.788 INFO:tasks.workunit.client.0.smithi087.stdout:0/755: truncate d0/d2/d4/ffa 17310 0 2024-03-18T14:43:22.790 INFO:tasks.workunit.client.0.smithi087.stdout:7/842: mknod d1/d6/d29/d2f/d68/d65/d96/c125 0 2024-03-18T14:43:22.791 INFO:tasks.workunit.client.0.smithi087.stdout:9/849: getdents db/d18/d1e/d28/d7c/dba 0 2024-03-18T14:43:22.792 INFO:tasks.workunit.client.1.smithi129.stdout:0/618: creat d0/d14/d3a/d4a/fc1 x:0 0 0 2024-03-18T14:43:22.794 INFO:tasks.workunit.client.1.smithi129.stdout:2/602: creat d7/d1f/d20/d36/da9/fbc x:0 0 0 2024-03-18T14:43:22.797 INFO:tasks.workunit.client.1.smithi129.stdout:1/586: symlink d1/d2/d28/lb1 0 2024-03-18T14:43:22.798 INFO:tasks.workunit.client.1.smithi129.stdout:6/602: getdents d3/d6 0 2024-03-18T14:43:22.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/773: mknod d13/d1b/d30/d6e/dc8/c102 0 2024-03-18T14:43:22.800 INFO:tasks.workunit.client.1.smithi129.stdout:2/603: mknod d7/d1f/d34/da5/cbd 0 2024-03-18T14:43:22.800 INFO:tasks.workunit.client.1.smithi129.stdout:4/532: dread d0/d19/d46/d3e/d21/d32/f57 [0,4194304] 0 2024-03-18T14:43:22.800 INFO:tasks.workunit.client.1.smithi129.stdout:7/597: truncate d4/d7/f5f 529201 0 2024-03-18T14:43:22.802 INFO:tasks.workunit.client.1.smithi129.stdout:2/604: write d7/d1f/d20/d36/fa8 [464549,36295] 0 2024-03-18T14:43:22.802 INFO:tasks.workunit.client.0.smithi087.stdout:9/850: mknod db/d18/d1e/dde/c121 0 2024-03-18T14:43:22.803 INFO:tasks.workunit.client.0.smithi087.stdout:1/807: mknod d3/dbf/cf6 0 2024-03-18T14:43:22.804 INFO:tasks.workunit.client.1.smithi129.stdout:9/559: sync 2024-03-18T14:43:22.804 INFO:tasks.workunit.client.0.smithi087.stdout:5/774: dwrite d13/d1b/d70/da8/fb2 [0,4194304] 0 2024-03-18T14:43:22.804 INFO:tasks.workunit.client.0.smithi087.stdout:4/715: getdents d2/dc2/dce 0 2024-03-18T14:43:22.805 INFO:tasks.workunit.client.1.smithi129.stdout:1/587: dread d1/d2/d28/d65/f8e [0,4194304] 0 2024-03-18T14:43:22.806 INFO:tasks.workunit.client.0.smithi087.stdout:5/775: write d13/d1b/d7e/ff7 [253325,98162] 0 2024-03-18T14:43:22.806 INFO:tasks.workunit.client.1.smithi129.stdout:4/533: creat d0/d9/d6a/d7b/fa6 x:0 0 0 2024-03-18T14:43:22.807 INFO:tasks.workunit.client.1.smithi129.stdout:6/603: creat d3/d30/df/d28/d79/dc4/fc6 x:0 0 0 2024-03-18T14:43:22.808 INFO:tasks.workunit.client.1.smithi129.stdout:6/604: write d3/d30/de/d6c/f31 [2733499,106628] 0 2024-03-18T14:43:22.809 INFO:tasks.workunit.client.1.smithi129.stdout:1/588: chown d1/c13 13587420 1 2024-03-18T14:43:22.809 INFO:tasks.workunit.client.0.smithi087.stdout:0/756: dread d0/d2/d4/d19/d5a/f9e [0,4194304] 0 2024-03-18T14:43:22.810 INFO:tasks.workunit.client.0.smithi087.stdout:1/808: dread d3/d1d/d1e/d43/d9b/fb7 [0,4194304] 0 2024-03-18T14:43:22.810 INFO:tasks.workunit.client.0.smithi087.stdout:0/757: chown d0/d2/d4/de8/dad/dea/f96 451050 1 2024-03-18T14:43:22.811 INFO:tasks.workunit.client.1.smithi129.stdout:7/598: symlink d4/d2d/d2e/lbd 0 2024-03-18T14:43:22.811 INFO:tasks.workunit.client.0.smithi087.stdout:9/851: unlink db/d18/cad 0 2024-03-18T14:43:22.813 INFO:tasks.workunit.client.0.smithi087.stdout:2/781: creat d2/ddd/fff x:0 0 0 2024-03-18T14:43:22.814 INFO:tasks.workunit.client.0.smithi087.stdout:2/782: write d2/ddd/d22/d2c/d3a/d76/d81/f82 [297166,61555] 0 2024-03-18T14:43:22.815 INFO:tasks.workunit.client.0.smithi087.stdout:4/716: rmdir d2/db/d84 39 2024-03-18T14:43:22.818 INFO:tasks.workunit.client.1.smithi129.stdout:1/589: mkdir d1/db2 0 2024-03-18T14:43:22.818 INFO:tasks.workunit.client.0.smithi087.stdout:2/783: dwrite d2/ddd/d22/d2c/f2e [0,4194304] 0 2024-03-18T14:43:22.819 INFO:tasks.workunit.client.0.smithi087.stdout:7/843: link d1/d6/d29/d2f/d68/d65/d72/cb4 d1/d6/d29/d2f/c126 0 2024-03-18T14:43:22.820 INFO:tasks.workunit.client.0.smithi087.stdout:6/726: dread d3/d7/d25/d62/d7c/d46/f6d [0,4194304] 0 2024-03-18T14:43:22.820 INFO:tasks.workunit.client.0.smithi087.stdout:1/809: readlink d3/d1d/d1e/l2d 0 2024-03-18T14:43:22.820 INFO:tasks.workunit.client.0.smithi087.stdout:3/781: sync 2024-03-18T14:43:22.820 INFO:tasks.workunit.client.0.smithi087.stdout:8/736: sync 2024-03-18T14:43:22.821 INFO:tasks.workunit.client.1.smithi129.stdout:4/534: rename d0/d3c/d6c/fa3 to d0/fa7 0 2024-03-18T14:43:22.821 INFO:tasks.workunit.client.0.smithi087.stdout:0/758: fdatasync d0/d2/d4/d19/d5a/f9e 0 2024-03-18T14:43:22.823 INFO:tasks.workunit.client.1.smithi129.stdout:7/599: creat d4/d2d/d3a/fbe x:0 0 0 2024-03-18T14:43:22.823 INFO:tasks.workunit.client.1.smithi129.stdout:7/600: readlink d4/d7/d8/d3b/l3c 0 2024-03-18T14:43:22.825 INFO:tasks.workunit.client.1.smithi129.stdout:4/535: mknod d0/d19/d46/d3e/d21/ca8 0 2024-03-18T14:43:22.825 INFO:tasks.workunit.client.0.smithi087.stdout:1/810: dread d3/d1d/d67/d94/fbb [0,4194304] 0 2024-03-18T14:43:22.827 INFO:tasks.workunit.client.1.smithi129.stdout:1/590: mknod d1/d2/d28/cb3 0 2024-03-18T14:43:22.827 INFO:tasks.workunit.client.0.smithi087.stdout:0/759: dwrite d0/d2/d4/d27/dc3/dd2/dff/f106 [0,4194304] 0 2024-03-18T14:43:22.829 INFO:tasks.workunit.client.1.smithi129.stdout:5/554: dread d0/df/f44 [0,4194304] 0 2024-03-18T14:43:22.829 INFO:tasks.workunit.client.0.smithi087.stdout:5/776: creat d13/d1b/d7e/dfc/f103 x:0 0 0 2024-03-18T14:43:22.831 INFO:tasks.workunit.client.1.smithi129.stdout:8/637: write d9/d33/fc5 [1345125,92201] 0 2024-03-18T14:43:22.833 INFO:tasks.workunit.client.0.smithi087.stdout:3/782: mknod d0/d3/df/d42/ce0 0 2024-03-18T14:43:22.834 INFO:tasks.workunit.client.1.smithi129.stdout:3/558: write d4/d38/f1b [901330,66906] 0 2024-03-18T14:43:22.835 INFO:tasks.workunit.client.0.smithi087.stdout:8/737: creat d1/d6/d2f/d44/d45/d72/d7f/ff3 x:0 0 0 2024-03-18T14:43:22.837 INFO:tasks.workunit.client.1.smithi129.stdout:9/560: dread d0/f8 [4194304,4194304] 0 2024-03-18T14:43:22.838 INFO:tasks.workunit.client.0.smithi087.stdout:1/811: mkdir d3/d1d/d1e/d43/d50/d71/df7 0 2024-03-18T14:43:22.838 INFO:tasks.workunit.client.1.smithi129.stdout:0/619: dwrite d0/d23/d6b/f9a [0,4194304] 0 2024-03-18T14:43:22.838 INFO:tasks.workunit.client.0.smithi087.stdout:1/812: read - d3/d1d/d1e/d20/d7a/db4/fcc zero size 2024-03-18T14:43:22.840 INFO:tasks.workunit.client.1.smithi129.stdout:3/559: dwrite d4/d11/d34/d53/f8e [0,4194304] 0 2024-03-18T14:43:22.841 INFO:tasks.workunit.client.1.smithi129.stdout:3/560: readlink d4/dd/l1a 0 2024-03-18T14:43:22.842 INFO:tasks.workunit.client.1.smithi129.stdout:2/605: truncate d7/d1f/d20/d2b/d41/f6f 91394 0 2024-03-18T14:43:22.842 INFO:tasks.workunit.client.1.smithi129.stdout:3/561: chown d4/dd/d1f/d5f/d31/d78/l8b 288482573 1 2024-03-18T14:43:22.843 INFO:tasks.workunit.client.1.smithi129.stdout:4/536: symlink d0/d9/la9 0 2024-03-18T14:43:22.844 INFO:tasks.workunit.client.0.smithi087.stdout:4/717: dread d2/f63 [0,4194304] 0 2024-03-18T14:43:22.846 INFO:tasks.workunit.client.0.smithi087.stdout:7/844: write d1/d97/db9/f10e [1012886,77530] 0 2024-03-18T14:43:22.849 INFO:tasks.workunit.client.0.smithi087.stdout:8/738: symlink d1/d6/d14/lf4 0 2024-03-18T14:43:22.850 INFO:tasks.workunit.client.0.smithi087.stdout:8/739: write d1/d6/d2f/d44/d4b/fc9 [152442,5586] 0 2024-03-18T14:43:22.850 INFO:tasks.workunit.client.0.smithi087.stdout:1/813: symlink d3/d3c/db8/lf8 0 2024-03-18T14:43:22.851 INFO:tasks.workunit.client.0.smithi087.stdout:1/814: fdatasync d3/d1d/f21 0 2024-03-18T14:43:22.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/852: read - db/d18/d1e/d28/d7c/fcc zero size 2024-03-18T14:43:22.858 INFO:tasks.workunit.client.0.smithi087.stdout:2/784: dwrite d2/ddd/d22/d24/f2a [0,4194304] 0 2024-03-18T14:43:22.859 INFO:tasks.workunit.client.0.smithi087.stdout:2/785: chown d2/ddd/d22/d2c/d3a/d40/fbc 2493 1 2024-03-18T14:43:22.860 INFO:tasks.workunit.client.0.smithi087.stdout:6/727: mknod d3/d7/d25/d62/d7c/da0/dbe/db6/dde/cf6 0 2024-03-18T14:43:22.860 INFO:tasks.workunit.client.0.smithi087.stdout:3/783: truncate d0/fb9 1040826 0 2024-03-18T14:43:22.861 INFO:tasks.workunit.client.0.smithi087.stdout:3/784: write d0/f52 [6576729,118213] 0 2024-03-18T14:43:22.862 INFO:tasks.workunit.client.0.smithi087.stdout:3/785: chown d0/de/d30/d46/d76 926950 1 2024-03-18T14:43:22.862 INFO:tasks.workunit.client.0.smithi087.stdout:0/760: rename d0/d2/d4/d27/dc3/fe1 to d0/d1a/f10a 0 2024-03-18T14:43:22.864 INFO:tasks.workunit.client.1.smithi129.stdout:1/591: fsync d1/d2/d28/d65/d19/f76 0 2024-03-18T14:43:22.865 INFO:tasks.workunit.client.1.smithi129.stdout:8/638: creat d9/d11/d1a/d32/d3a/d70/fd6 x:0 0 0 2024-03-18T14:43:22.866 INFO:tasks.workunit.client.0.smithi087.stdout:3/786: dwrite d0/d3/df/f33 [0,4194304] 0 2024-03-18T14:43:22.867 INFO:tasks.workunit.client.1.smithi129.stdout:7/601: write d4/d7/d8/d3b/f4d [1000258,92040] 0 2024-03-18T14:43:22.868 INFO:tasks.workunit.client.1.smithi129.stdout:8/639: write d9/d11/d18/f24 [82760,116182] 0 2024-03-18T14:43:22.869 INFO:tasks.workunit.client.1.smithi129.stdout:7/602: write d4/d8c/f76 [498581,56724] 0 2024-03-18T14:43:22.871 INFO:tasks.workunit.client.1.smithi129.stdout:2/606: dwrite d7/d1f/d34/da5/fbb [0,4194304] 0 2024-03-18T14:43:22.872 INFO:tasks.workunit.client.1.smithi129.stdout:2/607: stat d7/d1f/d81/cae 0 2024-03-18T14:43:22.872 INFO:tasks.workunit.client.1.smithi129.stdout:7/603: chown d4/d2d/d2e/d42/fa2 1 1 2024-03-18T14:43:22.872 INFO:tasks.workunit.client.0.smithi087.stdout:9/853: unlink db/d18/d1e/d7e/dc7/cff 0 2024-03-18T14:43:22.873 INFO:tasks.workunit.client.0.smithi087.stdout:5/777: rmdir d13/d1b/d27/d35/dc6/dd6 39 2024-03-18T14:43:22.873 INFO:tasks.workunit.client.0.smithi087.stdout:9/854: readlink db/d18/d1e/d28/d76/d80/lf7 0 2024-03-18T14:43:22.875 INFO:tasks.workunit.client.1.smithi129.stdout:2/608: write d7/d1f/d20/fb5 [4417379,32798] 0 2024-03-18T14:43:22.875 INFO:tasks.workunit.client.1.smithi129.stdout:3/562: dwrite d4/d11/d1d/d36/f4a [0,4194304] 0 2024-03-18T14:43:22.875 INFO:tasks.workunit.client.0.smithi087.stdout:9/855: write db/d18/d1e/d28/d7c/fcc [296833,22823] 0 2024-03-18T14:43:22.877 INFO:tasks.workunit.client.0.smithi087.stdout:7/845: dread d1/d6/f2a [0,4194304] 0 2024-03-18T14:43:22.877 INFO:tasks.workunit.client.1.smithi129.stdout:5/555: fsync d0/dc/f4e 0 2024-03-18T14:43:22.877 INFO:tasks.workunit.client.1.smithi129.stdout:4/537: creat d0/d9/d4c/faa x:0 0 0 2024-03-18T14:43:22.879 INFO:tasks.workunit.client.1.smithi129.stdout:5/556: stat d0/dc/d18/d2b 0 2024-03-18T14:43:22.880 INFO:tasks.workunit.client.1.smithi129.stdout:7/604: dwrite d4/d2d/d2e/d79/f9f [0,4194304] 0 2024-03-18T14:43:22.880 INFO:tasks.workunit.client.1.smithi129.stdout:8/640: fsync d9/f1d 0 2024-03-18T14:43:22.880 INFO:tasks.workunit.client.1.smithi129.stdout:4/538: write d0/d19/d46/d3e/f76 [1077945,71498] 0 2024-03-18T14:43:22.881 INFO:tasks.workunit.client.1.smithi129.stdout:6/605: sync 2024-03-18T14:43:22.882 INFO:tasks.workunit.client.0.smithi087.stdout:4/718: dread d2/f21 [0,4194304] 0 2024-03-18T14:43:22.883 INFO:tasks.workunit.client.1.smithi129.stdout:1/592: truncate d1/d2/d28/d65/d19/d52/fa6 44175 0 2024-03-18T14:43:22.883 INFO:tasks.workunit.client.1.smithi129.stdout:7/605: read - d4/d7/d38/d49/f62 zero size 2024-03-18T14:43:22.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/740: link d1/d6/d2f/d44/d45/d72/d7f/ff3 d1/d6/d9/d5d/d87/da2/df0/ff5 0 2024-03-18T14:43:22.884 INFO:tasks.workunit.client.1.smithi129.stdout:0/620: dread d0/d23/d35/d3b/d42/f7b [0,4194304] 0 2024-03-18T14:43:22.886 INFO:tasks.workunit.client.0.smithi087.stdout:1/815: rmdir d3 39 2024-03-18T14:43:22.887 INFO:tasks.workunit.client.0.smithi087.stdout:5/778: dwrite d13/d1b/d30/d6e/d88/fca [0,4194304] 0 2024-03-18T14:43:22.888 INFO:tasks.workunit.client.1.smithi129.stdout:7/606: dwrite d4/d2d/d2e/f5a [0,4194304] 0 2024-03-18T14:43:22.889 INFO:tasks.workunit.client.1.smithi129.stdout:7/607: stat d4/d2d/d2e 0 2024-03-18T14:43:22.891 INFO:tasks.workunit.client.1.smithi129.stdout:5/557: truncate d0/d32/d3a/d45/f65 123467 0 2024-03-18T14:43:22.893 INFO:tasks.workunit.client.0.smithi087.stdout:2/786: mkdir d2/ddd/d22/d2c/d3a/d49/d58/d78/d100 0 2024-03-18T14:43:22.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/846: mkdir d1/d6/da/d42/d61/d74/d127 0 2024-03-18T14:43:22.895 INFO:tasks.workunit.client.0.smithi087.stdout:7/847: chown d1/d6/d29/d2f/d68/d65/d72 14 1 2024-03-18T14:43:22.896 INFO:tasks.workunit.client.1.smithi129.stdout:0/621: unlink d0/d14/d28/d63/l5b 0 2024-03-18T14:43:22.902 INFO:tasks.workunit.client.0.smithi087.stdout:5/779: symlink d13/d1b/d27/d28/d9a/dae/l104 0 2024-03-18T14:43:22.904 INFO:tasks.workunit.client.1.smithi129.stdout:9/561: sync 2024-03-18T14:43:22.904 INFO:tasks.workunit.client.0.smithi087.stdout:2/787: unlink d2/ddd/d22/d2c/c56 0 2024-03-18T14:43:22.905 INFO:tasks.workunit.client.1.smithi129.stdout:3/563: creat d4/d38/da3/db1/fbf x:0 0 0 2024-03-18T14:43:22.905 INFO:tasks.workunit.client.1.smithi129.stdout:1/593: creat d1/d91/fb4 x:0 0 0 2024-03-18T14:43:22.905 INFO:tasks.workunit.client.1.smithi129.stdout:8/641: mkdir d9/d11/d1a/d32/d3a/d9a/dd7 0 2024-03-18T14:43:22.906 INFO:tasks.workunit.client.1.smithi129.stdout:7/608: dread - d4/d2d/d3a/f53 zero size 2024-03-18T14:43:22.906 INFO:tasks.workunit.client.1.smithi129.stdout:3/564: chown d4/d11/lb7 0 1 2024-03-18T14:43:22.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/787: creat d0/de/d30/fe1 x:0 0 0 2024-03-18T14:43:22.907 INFO:tasks.workunit.client.0.smithi087.stdout:3/788: fsync d0/f28 0 2024-03-18T14:43:22.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/789: write d0/de/f81 [2546762,16570] 0 2024-03-18T14:43:22.909 INFO:tasks.workunit.client.0.smithi087.stdout:9/856: mknod db/d18/d1c/d69/d11a/c122 0 2024-03-18T14:43:22.910 INFO:tasks.workunit.client.0.smithi087.stdout:9/857: chown db/d31/f6d 63108 1 2024-03-18T14:43:22.910 INFO:tasks.workunit.client.1.smithi129.stdout:1/594: dread d1/d2/d70/d56/f82 [0,4194304] 0 2024-03-18T14:43:22.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/761: getdents d0/d2/d4/d27/dc3/dd2/dff 0 2024-03-18T14:43:22.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/790: dwrite d0/d3/df/f14 [4194304,4194304] 0 2024-03-18T14:43:22.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/788: rename d2/ddd/dbb to d2/d44/d72/d79/d101 0 2024-03-18T14:43:22.915 INFO:tasks.workunit.client.1.smithi129.stdout:2/609: creat d7/d1c/fbe x:0 0 0 2024-03-18T14:43:22.917 INFO:tasks.workunit.client.0.smithi087.stdout:2/789: dwrite d2/ddd/d22/f4d [4194304,4194304] 0 2024-03-18T14:43:22.918 INFO:tasks.workunit.client.0.smithi087.stdout:4/719: creat d2/d13/fec x:0 0 0 2024-03-18T14:43:22.918 INFO:tasks.workunit.client.1.smithi129.stdout:0/622: rename d0/d14/d3a to d0/d23/d71/dc2 0 2024-03-18T14:43:22.919 INFO:tasks.workunit.client.0.smithi087.stdout:1/816: symlink d3/d1d/d1e/d20/lf9 0 2024-03-18T14:43:22.925 INFO:tasks.workunit.client.0.smithi087.stdout:6/728: truncate d3/d7/d25/d62/d7c/d29/f5a 1278387 0 2024-03-18T14:43:22.929 INFO:tasks.workunit.client.0.smithi087.stdout:8/741: sync 2024-03-18T14:43:22.930 INFO:tasks.workunit.client.0.smithi087.stdout:7/848: truncate d1/d6/d29/d2f/d68/dbf/fe8 1440417 0 2024-03-18T14:43:22.932 INFO:tasks.workunit.client.1.smithi129.stdout:4/539: creat d0/fab x:0 0 0 2024-03-18T14:43:22.932 INFO:tasks.workunit.client.1.smithi129.stdout:9/562: stat d0/db/d1f/d20/d26/d19/f6a 0 2024-03-18T14:43:22.932 INFO:tasks.workunit.client.1.smithi129.stdout:8/642: creat d9/d11/d1a/d32/d3a/d70/fd8 x:0 0 0 2024-03-18T14:43:22.935 INFO:tasks.workunit.client.1.smithi129.stdout:6/606: link d3/d30/de/c12 d3/d30/df/d28/d79/daf/cc7 0 2024-03-18T14:43:22.935 INFO:tasks.workunit.client.1.smithi129.stdout:2/610: unlink d7/d1c/d32/f6c 0 2024-03-18T14:43:22.938 INFO:tasks.workunit.client.0.smithi087.stdout:8/742: rmdir d1/d6/d2f/d44/d45/d71 39 2024-03-18T14:43:22.938 INFO:tasks.workunit.client.1.smithi129.stdout:4/540: mknod d0/d19/d46/d3e/d21/d7f/cac 0 2024-03-18T14:43:22.940 INFO:tasks.workunit.client.1.smithi129.stdout:6/607: write d3/d30/df/f85 [2596208,4197] 0 2024-03-18T14:43:22.940 INFO:tasks.workunit.client.1.smithi129.stdout:5/558: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:22.941 INFO:tasks.workunit.client.1.smithi129.stdout:9/563: rename d0/db/d2e/d9f/la2 to d0/da1/lb6 0 2024-03-18T14:43:22.941 INFO:tasks.workunit.client.1.smithi129.stdout:3/565: dread d4/d11/d34/d3c/f81 [0,4194304] 0 2024-03-18T14:43:22.943 INFO:tasks.workunit.client.1.smithi129.stdout:8/643: mkdir d9/d11/d53/d5f/dcb/dd9 0 2024-03-18T14:43:22.944 INFO:tasks.workunit.client.1.smithi129.stdout:9/564: dread - d0/db/d1f/d20/d26/d19/d8d/f98 zero size 2024-03-18T14:43:22.944 INFO:tasks.workunit.client.1.smithi129.stdout:2/611: dwrite d7/d1f/d34/f18 [4194304,4194304] 0 2024-03-18T14:43:22.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/790: dwrite d2/ddd/f59 [4194304,4194304] 0 2024-03-18T14:43:22.945 INFO:tasks.workunit.client.1.smithi129.stdout:9/565: stat d0/f77 0 2024-03-18T14:43:22.945 INFO:tasks.workunit.client.0.smithi087.stdout:8/743: dread d1/d6/d2f/d44/d45/d72/d7f/d83/f96 [0,4194304] 0 2024-03-18T14:43:22.946 INFO:tasks.workunit.client.1.smithi129.stdout:2/612: chown d7/d1c/f26 1127 1 2024-03-18T14:43:22.946 INFO:tasks.workunit.client.1.smithi129.stdout:5/559: stat d0/df/c54 0 2024-03-18T14:43:22.946 INFO:tasks.workunit.client.0.smithi087.stdout:0/762: mkdir d0/d2/d4/de8/dad/dea/d5d/d10b 0 2024-03-18T14:43:22.947 INFO:tasks.workunit.client.1.smithi129.stdout:1/595: getdents d1/d2/d28/d65/d19/d52 0 2024-03-18T14:43:22.948 INFO:tasks.workunit.client.0.smithi087.stdout:0/763: write d0/d2/d4/d19/d5a/fde [828875,117810] 0 2024-03-18T14:43:22.949 INFO:tasks.workunit.client.1.smithi129.stdout:1/596: chown d1/d2/d28/d65/d19/d84/faa 605 1 2024-03-18T14:43:22.950 INFO:tasks.workunit.client.0.smithi087.stdout:6/729: mknod d3/d7/d25/d62/d7c/cf7 0 2024-03-18T14:43:22.951 INFO:tasks.workunit.client.1.smithi129.stdout:9/566: dwrite d0/db/d1f/d20/d25/d8e/f9a [0,4194304] 0 2024-03-18T14:43:22.952 INFO:tasks.workunit.client.1.smithi129.stdout:0/623: truncate d0/d23/d71/dc2/f62 2331034 0 2024-03-18T14:43:22.953 INFO:tasks.workunit.client.1.smithi129.stdout:0/624: fsync d0/d23/d71/f7f 0 2024-03-18T14:43:22.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/744: stat d1/d6/d9/f6e 0 2024-03-18T14:43:22.955 INFO:tasks.workunit.client.1.smithi129.stdout:4/541: rename d0/d19/d46/d3e/f60 to d0/d19/d5d/fad 0 2024-03-18T14:43:22.955 INFO:tasks.workunit.client.1.smithi129.stdout:6/608: read d3/d5/d46/f89 [637657,117675] 0 2024-03-18T14:43:22.957 INFO:tasks.workunit.client.1.smithi129.stdout:8/644: creat d9/d11/d55/d68/d72/fda x:0 0 0 2024-03-18T14:43:22.958 INFO:tasks.workunit.client.0.smithi087.stdout:5/780: getdents d13/d1b/d7e/dfc 0 2024-03-18T14:43:22.958 INFO:tasks.workunit.client.0.smithi087.stdout:9/858: truncate db/f10d 660142 0 2024-03-18T14:43:22.958 INFO:tasks.workunit.client.0.smithi087.stdout:9/859: readlink db/d12/lf9 0 2024-03-18T14:43:22.961 INFO:tasks.workunit.client.0.smithi087.stdout:6/730: dread d3/d7/d25/d62/d7c/d29/d22/f5f [0,4194304] 0 2024-03-18T14:43:22.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/731: readlink d3/d7/d25/d62/d7c/d46/l54 0 2024-03-18T14:43:22.965 INFO:tasks.workunit.client.0.smithi087.stdout:0/764: unlink d0/d1a/d7b/d26/d79/f44 0 2024-03-18T14:43:22.965 INFO:tasks.workunit.client.0.smithi087.stdout:7/849: rmdir d1/d6/da/d59/dbe/d11a/d95/d10a 0 2024-03-18T14:43:22.965 INFO:tasks.workunit.client.1.smithi129.stdout:9/567: creat d0/db/d90/d70/fb7 x:0 0 0 2024-03-18T14:43:22.965 INFO:tasks.workunit.client.1.smithi129.stdout:3/566: mkdir d4/d11/d34/dc0 0 2024-03-18T14:43:22.965 INFO:tasks.workunit.client.1.smithi129.stdout:0/625: rename d0/d14/d28/d63/f7c to d0/d23/d71/fc3 0 2024-03-18T14:43:22.966 INFO:tasks.workunit.client.0.smithi087.stdout:0/765: chown d0/d1a/d7b/d2a/cf4 0 1 2024-03-18T14:43:22.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/850: chown d1/d6/da/d42/d67/fe5 207 1 2024-03-18T14:43:22.966 INFO:tasks.workunit.client.1.smithi129.stdout:4/542: creat d0/d9/d6a/d7b/fae x:0 0 0 2024-03-18T14:43:22.967 INFO:tasks.workunit.client.0.smithi087.stdout:8/745: symlink d1/d6/d2f/d44/d45/d72/d7f/d83/lf6 0 2024-03-18T14:43:22.968 INFO:tasks.workunit.client.0.smithi087.stdout:8/746: write d1/d6/d9/d5d/d87/d88/fc5 [557298,76652] 0 2024-03-18T14:43:22.968 INFO:tasks.workunit.client.1.smithi129.stdout:5/560: dread d0/d32/d3a/d45/f65 [0,4194304] 0 2024-03-18T14:43:22.969 INFO:tasks.workunit.client.1.smithi129.stdout:8/645: truncate d9/f1f 685449 0 2024-03-18T14:43:22.969 INFO:tasks.workunit.client.1.smithi129.stdout:5/561: read - d0/d32/d34/d6c/f98 zero size 2024-03-18T14:43:22.969 INFO:tasks.workunit.client.1.smithi129.stdout:6/609: read d3/d30/df/d28/f8c [19633,56276] 0 2024-03-18T14:43:22.969 INFO:tasks.workunit.client.0.smithi087.stdout:3/791: getdents d0/d3/d4f 0 2024-03-18T14:43:22.970 INFO:tasks.workunit.client.0.smithi087.stdout:9/860: creat db/d18/df1/f123 x:0 0 0 2024-03-18T14:43:22.971 INFO:tasks.workunit.client.1.smithi129.stdout:7/609: sync 2024-03-18T14:43:22.971 INFO:tasks.workunit.client.1.smithi129.stdout:8/646: dread - d9/d11/d1a/d32/d3a/d70/fd6 zero size 2024-03-18T14:43:22.971 INFO:tasks.workunit.client.1.smithi129.stdout:9/568: rmdir d0/db/d1f/dae 39 2024-03-18T14:43:22.972 INFO:tasks.workunit.client.1.smithi129.stdout:3/567: dread d4/f9 [0,4194304] 0 2024-03-18T14:43:22.972 INFO:tasks.workunit.client.1.smithi129.stdout:9/569: fsync d0/db/d1f/f7b 0 2024-03-18T14:43:22.972 INFO:tasks.workunit.client.0.smithi087.stdout:4/720: dwrite d2/f5b [0,4194304] 0 2024-03-18T14:43:22.973 INFO:tasks.workunit.client.0.smithi087.stdout:1/817: truncate d3/f7c 409598 0 2024-03-18T14:43:22.973 INFO:tasks.workunit.client.0.smithi087.stdout:4/721: stat d2/db/d24/d30/d7b/dbe/fea 0 2024-03-18T14:43:22.973 INFO:tasks.workunit.client.1.smithi129.stdout:9/570: chown d0/f35 108961 1 2024-03-18T14:43:22.974 INFO:tasks.workunit.client.1.smithi129.stdout:2/613: creat d7/d1f/fbf x:0 0 0 2024-03-18T14:43:22.975 INFO:tasks.workunit.client.0.smithi087.stdout:4/722: write d2/db/d3c/f50 [2288669,48938] 0 2024-03-18T14:43:22.975 INFO:tasks.workunit.client.1.smithi129.stdout:3/568: chown d4/dd/d1f/d5f/d8c/f8d 88155 1 2024-03-18T14:43:22.976 INFO:tasks.workunit.client.1.smithi129.stdout:2/614: readlink d7/d1c/d32/l47 0 2024-03-18T14:43:22.976 INFO:tasks.workunit.client.1.smithi129.stdout:6/610: creat d3/d6/d7f/db4/fc8 x:0 0 0 2024-03-18T14:43:22.978 INFO:tasks.workunit.client.1.smithi129.stdout:3/569: write d4/d38/f1b [1304407,46414] 0 2024-03-18T14:43:22.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/610: dwrite d4/d2d/d2e/f5a [0,4194304] 0 2024-03-18T14:43:22.979 INFO:tasks.workunit.client.1.smithi129.stdout:0/626: dwrite d0/d23/d35/d3b/d42/f7b [0,4194304] 0 2024-03-18T14:43:22.979 INFO:tasks.workunit.client.1.smithi129.stdout:2/615: write d7/d1f/d20/d72/f9f [4966443,117330] 0 2024-03-18T14:43:22.980 INFO:tasks.workunit.client.0.smithi087.stdout:7/851: chown d1/d6/d29/d2f/d68/d65/d60/d66/lb2 92 1 2024-03-18T14:43:22.984 INFO:tasks.workunit.client.1.smithi129.stdout:1/597: dwrite d1/f88 [0,4194304] 0 2024-03-18T14:43:22.984 INFO:tasks.workunit.client.0.smithi087.stdout:8/747: dwrite d1/d6/d2f/d44/d45/d71/fc8 [0,4194304] 0 2024-03-18T14:43:22.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/781: link d13/d1b/d27/d8f/dab/fd5 d13/d1b/d27/d98/dc2/f105 0 2024-03-18T14:43:22.987 INFO:tasks.workunit.client.0.smithi087.stdout:6/732: mknod d3/d7/d25/d62/cf8 0 2024-03-18T14:43:22.991 INFO:tasks.workunit.client.0.smithi087.stdout:8/748: dread d1/d6/d2f/f91 [0,4194304] 0 2024-03-18T14:43:22.991 INFO:tasks.workunit.client.1.smithi129.stdout:6/611: fsync d3/d30/f26 0 2024-03-18T14:43:22.992 INFO:tasks.workunit.client.1.smithi129.stdout:6/612: fsync d3/d6/d7f/db4/d57/f64 0 2024-03-18T14:43:22.994 INFO:tasks.workunit.client.1.smithi129.stdout:3/570: creat d4/d11/d1d/d50/d91/d97/fc1 x:0 0 0 2024-03-18T14:43:22.995 INFO:tasks.workunit.client.1.smithi129.stdout:7/611: fdatasync d4/d7/d8/d3b/f6d 0 2024-03-18T14:43:22.996 INFO:tasks.workunit.client.1.smithi129.stdout:7/612: write d4/d7/d8/f29 [357496,130560] 0 2024-03-18T14:43:23.001 INFO:tasks.workunit.client.1.smithi129.stdout:9/571: unlink d0/db/d90/l83 0 2024-03-18T14:43:23.002 INFO:tasks.workunit.client.1.smithi129.stdout:6/613: mkdir d3/d6/d7f/db4/dc9 0 2024-03-18T14:43:23.002 INFO:tasks.workunit.client.1.smithi129.stdout:4/543: truncate d0/d19/d46/d2e/f82 2997501 0 2024-03-18T14:43:23.002 INFO:tasks.workunit.client.0.smithi087.stdout:2/791: getdents d2/ddd/d22/d2c/d3a/d76/d9a 0 2024-03-18T14:43:23.005 INFO:tasks.workunit.client.1.smithi129.stdout:5/562: dwrite d0/df/f59 [0,4194304] 0 2024-03-18T14:43:23.006 INFO:tasks.workunit.client.0.smithi087.stdout:3/792: mknod d0/d3/d10/da5/dce/ce2 0 2024-03-18T14:43:23.006 INFO:tasks.workunit.client.1.smithi129.stdout:4/544: dread d0/f88 [0,4194304] 0 2024-03-18T14:43:23.007 INFO:tasks.workunit.client.0.smithi087.stdout:3/793: dread - d0/d1c/d25/dba/fc2 zero size 2024-03-18T14:43:23.007 INFO:tasks.workunit.client.0.smithi087.stdout:9/861: mknod db/d18/d1e/d28/d76/d80/d11c/c124 0 2024-03-18T14:43:23.008 INFO:tasks.workunit.client.1.smithi129.stdout:4/545: chown d0/d19/d46/d3e/d21/d4d/d58/d61/f98 8123266 1 2024-03-18T14:43:23.010 INFO:tasks.workunit.client.1.smithi129.stdout:5/563: dwrite d0/d32/d34/f51 [0,4194304] 0 2024-03-18T14:43:23.010 INFO:tasks.workunit.client.1.smithi129.stdout:3/571: symlink d4/d38/lc2 0 2024-03-18T14:43:23.012 INFO:tasks.workunit.client.0.smithi087.stdout:5/782: creat d13/d1b/d70/dce/f106 x:0 0 0 2024-03-18T14:43:23.014 INFO:tasks.workunit.client.0.smithi087.stdout:8/749: mknod d1/d6/d2f/d44/d45/d72/db6/cf7 0 2024-03-18T14:43:23.015 INFO:tasks.workunit.client.1.smithi129.stdout:8/647: read f4 [77480,87262] 0 2024-03-18T14:43:23.015 INFO:tasks.workunit.client.1.smithi129.stdout:1/598: mkdir d1/d2/d28/da7/db5 0 2024-03-18T14:43:23.016 INFO:tasks.workunit.client.1.smithi129.stdout:8/648: dread - d9/d11/d1a/d32/fb6 zero size 2024-03-18T14:43:23.016 INFO:tasks.workunit.client.0.smithi087.stdout:4/723: creat d2/db/d84/d87/fed x:0 0 0 2024-03-18T14:43:23.017 INFO:tasks.workunit.client.1.smithi129.stdout:1/599: write d1/d2/d28/d65/d19/d96/fa4 [916819,13384] 0 2024-03-18T14:43:23.021 INFO:tasks.workunit.client.0.smithi087.stdout:5/783: mkdir d13/d1b/d70/dce/d107 0 2024-03-18T14:43:23.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/784: chown d13/d1b/d27 593755 1 2024-03-18T14:43:23.022 INFO:tasks.workunit.client.0.smithi087.stdout:5/785: stat d13/ff8 0 2024-03-18T14:43:23.022 INFO:tasks.workunit.client.1.smithi129.stdout:7/613: getdents d4/d7/d38/d61/d6a/dba 0 2024-03-18T14:43:23.022 INFO:tasks.workunit.client.0.smithi087.stdout:1/818: truncate d3/d1d/d1f/fb0 386253 0 2024-03-18T14:43:23.023 INFO:tasks.workunit.client.0.smithi087.stdout:8/750: symlink d1/d6/d14/db2/lf8 0 2024-03-18T14:43:23.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/819: write d3/d1d/d1e/d20/f52 [980320,94144] 0 2024-03-18T14:43:23.025 INFO:tasks.workunit.client.0.smithi087.stdout:3/794: fsync d0/fb9 0 2024-03-18T14:43:23.026 INFO:tasks.workunit.client.0.smithi087.stdout:3/795: chown d0/d1c/d25/la8 179 1 2024-03-18T14:43:23.026 INFO:tasks.workunit.client.0.smithi087.stdout:9/862: creat db/d18/d3a/f125 x:0 0 0 2024-03-18T14:43:23.027 INFO:tasks.workunit.client.1.smithi129.stdout:8/649: readlink d9/l7e 0 2024-03-18T14:43:23.028 INFO:tasks.workunit.client.1.smithi129.stdout:9/572: mkdir d0/db/d1f/dae/db8 0 2024-03-18T14:43:23.028 INFO:tasks.workunit.client.0.smithi087.stdout:6/733: dread d3/d7/d25/d62/d7c/d46/dc9/fdf [0,4194304] 0 2024-03-18T14:43:23.029 INFO:tasks.workunit.client.1.smithi129.stdout:6/614: symlink d3/d30/df/lca 0 2024-03-18T14:43:23.029 INFO:tasks.workunit.client.0.smithi087.stdout:8/751: dread d1/d6/d8d/dc2/fd8 [0,4194304] 0 2024-03-18T14:43:23.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/615: dread - d3/d6/d7f/db4/f70 zero size 2024-03-18T14:43:23.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/616: fsync d3/d30/de/f58 0 2024-03-18T14:43:23.031 INFO:tasks.workunit.client.0.smithi087.stdout:4/724: dread d2/db/d24/d30/d7b/dbe/fe5 [0,4194304] 0 2024-03-18T14:43:23.032 INFO:tasks.workunit.client.0.smithi087.stdout:6/734: read d3/d7/d25/d62/d7c/d29/d22/f32 [3438350,41318] 0 2024-03-18T14:43:23.032 INFO:tasks.workunit.client.1.smithi129.stdout:5/564: symlink d0/dc/d1a/d61/d94/la5 0 2024-03-18T14:43:23.032 INFO:tasks.workunit.client.0.smithi087.stdout:3/796: stat d0/de/d30/d60/l70 0 2024-03-18T14:43:23.033 INFO:tasks.workunit.client.1.smithi129.stdout:7/614: creat d4/d7/d54/fbf x:0 0 0 2024-03-18T14:43:23.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/863: dwrite db/d18/d3a/f59 [0,4194304] 0 2024-03-18T14:43:23.034 INFO:tasks.workunit.client.1.smithi129.stdout:1/600: dwrite d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:23.035 INFO:tasks.workunit.client.1.smithi129.stdout:7/615: fdatasync d4/d7/d8/d3b/f6f 0 2024-03-18T14:43:23.037 INFO:tasks.workunit.client.1.smithi129.stdout:0/627: sync 2024-03-18T14:43:23.038 INFO:tasks.workunit.client.0.smithi087.stdout:0/766: write d0/d2/d3c/f69 [1526426,72291] 0 2024-03-18T14:43:23.039 INFO:tasks.workunit.client.0.smithi087.stdout:2/792: dread d2/ddd/d22/d2c/d3a/fc1 [0,4194304] 0 2024-03-18T14:43:23.039 INFO:tasks.workunit.client.1.smithi129.stdout:2/616: truncate d7/d1f/d20/d2b/d41/f5e 4834117 0 2024-03-18T14:43:23.040 INFO:tasks.workunit.client.1.smithi129.stdout:5/565: dwrite d0/dc/d1a/d61/f6d [0,4194304] 0 2024-03-18T14:43:23.041 INFO:tasks.workunit.client.0.smithi087.stdout:2/793: chown d2/ddd/d5a/de1 2051488 1 2024-03-18T14:43:23.042 INFO:tasks.workunit.client.0.smithi087.stdout:7/852: dwrite d1/d6/da/d59/dbe/d11a/d95/dae/ff0 [0,4194304] 0 2024-03-18T14:43:23.042 INFO:tasks.workunit.client.1.smithi129.stdout:4/546: truncate d0/f88 2517646 0 2024-03-18T14:43:23.043 INFO:tasks.workunit.client.0.smithi087.stdout:7/853: write d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f124 [693819,18467] 0 2024-03-18T14:43:23.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/572: dwrite d4/dd/f8f [0,4194304] 0 2024-03-18T14:43:23.045 INFO:tasks.workunit.client.0.smithi087.stdout:7/854: write d1/d6/d29/d2f/dac/f11b [935464,46648] 0 2024-03-18T14:43:23.046 INFO:tasks.workunit.client.0.smithi087.stdout:7/855: write d1/d6/d29/d2f/d68/d65/d60/d66/ffd [246766,48788] 0 2024-03-18T14:43:23.047 INFO:tasks.workunit.client.0.smithi087.stdout:5/786: dread d13/d1b/d27/d35/f39 [0,4194304] 0 2024-03-18T14:43:23.049 INFO:tasks.workunit.client.1.smithi129.stdout:8/650: getdents d9/d33/dc2 0 2024-03-18T14:43:23.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/617: mkdir d7/d1f/d20/d36/dc0 0 2024-03-18T14:43:23.052 INFO:tasks.workunit.client.0.smithi087.stdout:3/797: symlink d0/d3/df/d9a/le3 0 2024-03-18T14:43:23.053 INFO:tasks.workunit.client.1.smithi129.stdout:7/616: dread d4/d2d/d2e/d42/f7c [0,4194304] 0 2024-03-18T14:43:23.055 INFO:tasks.workunit.client.0.smithi087.stdout:9/864: symlink db/d18/d1c/d69/l126 0 2024-03-18T14:43:23.055 INFO:tasks.workunit.client.0.smithi087.stdout:1/820: write d3/d1d/d1f/fb0 [1224468,25242] 0 2024-03-18T14:43:23.055 INFO:tasks.workunit.client.1.smithi129.stdout:9/573: dread d0/db/d1f/d20/d26/d19/d29/f2d [0,4194304] 0 2024-03-18T14:43:23.055 INFO:tasks.workunit.client.1.smithi129.stdout:5/566: rename d0/dc/d18/d5f/l96 to d0/d32/d3a/d52/d6e/la6 0 2024-03-18T14:43:23.056 INFO:tasks.workunit.client.1.smithi129.stdout:9/574: dread - d0/db/d1f/d20/d26/d19/d8d/f98 zero size 2024-03-18T14:43:23.056 INFO:tasks.workunit.client.1.smithi129.stdout:3/573: mkdir d4/dd/db0/dc3 0 2024-03-18T14:43:23.057 INFO:tasks.workunit.client.1.smithi129.stdout:3/574: chown d4/d11/d1d/d50/f67 0 1 2024-03-18T14:43:23.059 INFO:tasks.workunit.client.1.smithi129.stdout:0/628: unlink d0/d23/d71/dc2/f62 0 2024-03-18T14:43:23.059 INFO:tasks.workunit.client.1.smithi129.stdout:0/629: stat d0/l44 0 2024-03-18T14:43:23.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/725: dread d2/db/d7a/fbf [0,4194304] 0 2024-03-18T14:43:23.060 INFO:tasks.workunit.client.0.smithi087.stdout:7/856: symlink d1/d6/d29/d2f/d68/d65/d110/l128 0 2024-03-18T14:43:23.060 INFO:tasks.workunit.client.1.smithi129.stdout:8/651: mkdir d9/d11/d1a/d32/d41/d4d/ddb 0 2024-03-18T14:43:23.061 INFO:tasks.workunit.client.0.smithi087.stdout:5/787: creat d13/d1b/d7e/dfc/f108 x:0 0 0 2024-03-18T14:43:23.061 INFO:tasks.workunit.client.1.smithi129.stdout:8/652: dread - d9/d11/d1a/d32/d41/fa3 zero size 2024-03-18T14:43:23.061 INFO:tasks.workunit.client.0.smithi087.stdout:5/788: write d13/d1b/d7e/dfc/f103 [638215,43153] 0 2024-03-18T14:43:23.062 INFO:tasks.workunit.client.0.smithi087.stdout:5/789: chown d13/d1b/d30/c58 1375889 1 2024-03-18T14:43:23.063 INFO:tasks.workunit.client.0.smithi087.stdout:5/790: fdatasync d13/d1b/d27/d35/f4b 0 2024-03-18T14:43:23.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/752: creat d1/d6/d2f/d44/ff9 x:0 0 0 2024-03-18T14:43:23.065 INFO:tasks.workunit.client.1.smithi129.stdout:5/567: creat d0/d32/d3a/d52/d69/d8a/fa7 x:0 0 0 2024-03-18T14:43:23.066 INFO:tasks.workunit.client.0.smithi087.stdout:9/865: symlink db/d18/d1e/d7e/l127 0 2024-03-18T14:43:23.066 INFO:tasks.workunit.client.1.smithi129.stdout:6/617: dread d3/d30/d44/f77 [0,4194304] 0 2024-03-18T14:43:23.067 INFO:tasks.workunit.client.1.smithi129.stdout:9/575: mknod d0/d15/cb9 0 2024-03-18T14:43:23.068 INFO:tasks.workunit.client.1.smithi129.stdout:9/576: chown d0/db/d1f/d20 6639084 1 2024-03-18T14:43:23.069 INFO:tasks.workunit.client.1.smithi129.stdout:0/630: mknod d0/d14/d91/cc4 0 2024-03-18T14:43:23.069 INFO:tasks.workunit.client.1.smithi129.stdout:7/617: getdents d4/d7/d38/d49 0 2024-03-18T14:43:23.069 INFO:tasks.workunit.client.0.smithi087.stdout:4/726: creat d2/db/d24/d30/d7b/d7f/fee x:0 0 0 2024-03-18T14:43:23.070 INFO:tasks.workunit.client.1.smithi129.stdout:9/577: stat d0/db/d1f/d20/d26/d19/d29/d36/f47 0 2024-03-18T14:43:23.070 INFO:tasks.workunit.client.1.smithi129.stdout:1/601: getdents d1/d2/d28/d65/d72 0 2024-03-18T14:43:23.075 INFO:tasks.workunit.client.0.smithi087.stdout:5/791: symlink d13/d1b/d30/d6e/dc8/l109 0 2024-03-18T14:43:23.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/798: mknod d0/de/d30/d60/ddb/ce4 0 2024-03-18T14:43:23.077 INFO:tasks.workunit.client.1.smithi129.stdout:4/547: write d0/d19/d46/d3e/d21/d32/f83 [4011017,59886] 0 2024-03-18T14:43:23.077 INFO:tasks.workunit.client.0.smithi087.stdout:8/753: mkdir d1/d6/d14/db2/dbc/dfa 0 2024-03-18T14:43:23.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/754: readlink d1/d6/d2f/d44/d45/d72/d7f/lc7 0 2024-03-18T14:43:23.078 INFO:tasks.workunit.client.1.smithi129.stdout:6/618: rmdir d3/d30/de/d65 39 2024-03-18T14:43:23.079 INFO:tasks.workunit.client.1.smithi129.stdout:6/619: stat d3/d30/de/d6c/f60 0 2024-03-18T14:43:23.080 INFO:tasks.workunit.client.1.smithi129.stdout:6/620: read - d3/d30/f95 zero size 2024-03-18T14:43:23.080 INFO:tasks.workunit.client.1.smithi129.stdout:6/621: stat d3/d6/d82/d9a/dad 0 2024-03-18T14:43:23.081 INFO:tasks.workunit.client.0.smithi087.stdout:2/794: truncate d2/fb 270316 0 2024-03-18T14:43:23.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/755: dwrite d1/d6/d2f/d44/d45/d50/fe4 [0,4194304] 0 2024-03-18T14:43:23.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/735: dread d3/d7/d25/d62/d7c/d29/d22/f7a [0,4194304] 0 2024-03-18T14:43:23.084 INFO:tasks.workunit.client.0.smithi087.stdout:1/821: link d3/d1d/d1e/d43/d50/d72/dc8/fe2 d3/d1d/d1e/d43/da3/ffa 0 2024-03-18T14:43:23.084 INFO:tasks.workunit.client.1.smithi129.stdout:8/653: mkdir d9/d33/dc2/ddc 0 2024-03-18T14:43:23.085 INFO:tasks.workunit.client.0.smithi087.stdout:0/767: truncate d0/d2/d4/de8/dad/dea/dcb/f102 236605 0 2024-03-18T14:43:23.086 INFO:tasks.workunit.client.0.smithi087.stdout:1/822: write d3/d1d/f21 [9178134,70368] 0 2024-03-18T14:43:23.086 INFO:tasks.workunit.client.0.smithi087.stdout:5/792: mknod d13/d1b/d70/dce/c10a 0 2024-03-18T14:43:23.086 INFO:tasks.workunit.client.1.smithi129.stdout:1/602: mknod d1/d2/d70/d87/d8c/cb6 0 2024-03-18T14:43:23.087 INFO:tasks.workunit.client.0.smithi087.stdout:6/736: fsync d3/d7/d25/d62/d7c/da0/d96/d97/faf 0 2024-03-18T14:43:23.087 INFO:tasks.workunit.client.1.smithi129.stdout:1/603: dread - d1/d2/d28/d65/fb0 zero size 2024-03-18T14:43:23.087 INFO:tasks.workunit.client.0.smithi087.stdout:3/799: symlink d0/de/d30/dc5/le5 0 2024-03-18T14:43:23.088 INFO:tasks.workunit.client.1.smithi129.stdout:1/604: chown d1/d2/d70/d87 2870318 1 2024-03-18T14:43:23.089 INFO:tasks.workunit.client.0.smithi087.stdout:9/866: mknod db/d18/d51/d7b/c128 0 2024-03-18T14:43:23.089 INFO:tasks.workunit.client.0.smithi087.stdout:2/795: rmdir d2/ddd/d22/d2c/d3a/d76/d9a/d9b 39 2024-03-18T14:43:23.091 INFO:tasks.workunit.client.1.smithi129.stdout:1/605: read d1/f9 [1704651,69046] 0 2024-03-18T14:43:23.091 INFO:tasks.workunit.client.1.smithi129.stdout:6/622: truncate d3/d5/d46/f89 264366 0 2024-03-18T14:43:23.092 INFO:tasks.workunit.client.1.smithi129.stdout:0/631: dread d0/d23/f67 [0,4194304] 0 2024-03-18T14:43:23.092 INFO:tasks.workunit.client.1.smithi129.stdout:1/606: chown d1/d2/f3b 1307 1 2024-03-18T14:43:23.092 INFO:tasks.workunit.client.1.smithi129.stdout:9/578: dread d0/db/d1f/d20/d25/f3d [0,4194304] 0 2024-03-18T14:43:23.093 INFO:tasks.workunit.client.1.smithi129.stdout:8/654: unlink f4 0 2024-03-18T14:43:23.097 INFO:tasks.workunit.client.1.smithi129.stdout:3/575: link d4/c7 d4/d38/d9b/cc4 0 2024-03-18T14:43:23.097 INFO:tasks.workunit.client.1.smithi129.stdout:5/568: dread d0/f2 [0,4194304] 0 2024-03-18T14:43:23.098 INFO:tasks.workunit.client.1.smithi129.stdout:3/576: stat d4/d11/d34/d3c/f81 0 2024-03-18T14:43:23.098 INFO:tasks.workunit.client.1.smithi129.stdout:6/623: fsync d3/d5/f11 0 2024-03-18T14:43:23.099 INFO:tasks.workunit.client.1.smithi129.stdout:1/607: symlink d1/d35/lb7 0 2024-03-18T14:43:23.100 INFO:tasks.workunit.client.1.smithi129.stdout:6/624: write d3/d6/d7f/db4/d57/f64 [8120726,13739] 0 2024-03-18T14:43:23.101 INFO:tasks.workunit.client.0.smithi087.stdout:0/768: creat d0/d2/d4/de8/dad/dea/da3/f10c x:0 0 0 2024-03-18T14:43:23.102 INFO:tasks.workunit.client.0.smithi087.stdout:6/737: creat d3/d7/d25/d8e/ff9 x:0 0 0 2024-03-18T14:43:23.102 INFO:tasks.workunit.client.1.smithi129.stdout:9/579: creat d0/db/d2e/d9d/fba x:0 0 0 2024-03-18T14:43:23.102 INFO:tasks.workunit.client.1.smithi129.stdout:5/569: dread d0/dc/d18/d2b/f57 [0,4194304] 0 2024-03-18T14:43:23.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/580: write d0/db/d2e/d9f/faa [240254,66606] 0 2024-03-18T14:43:23.108 INFO:tasks.workunit.client.1.smithi129.stdout:3/577: chown d4/d38/f47 142 1 2024-03-18T14:43:23.109 INFO:tasks.workunit.client.1.smithi129.stdout:4/548: dwrite d0/d19/d46/f63 [0,4194304] 0 2024-03-18T14:43:23.111 INFO:tasks.workunit.client.1.smithi129.stdout:0/632: creat d0/d23/d35/d3b/d42/dc0/fc5 x:0 0 0 2024-03-18T14:43:23.112 INFO:tasks.workunit.client.1.smithi129.stdout:1/608: mkdir d1/d35/db8 0 2024-03-18T14:43:23.119 INFO:tasks.workunit.client.1.smithi129.stdout:8/655: write d9/d11/f3b [63268,23220] 0 2024-03-18T14:43:23.120 INFO:tasks.workunit.client.1.smithi129.stdout:2/618: sync 2024-03-18T14:43:23.121 INFO:tasks.workunit.client.0.smithi087.stdout:8/756: getdents d1/d6/d8d/dcd 0 2024-03-18T14:43:23.121 INFO:tasks.workunit.client.0.smithi087.stdout:2/796: fdatasync d2/ddd/d22/d2c/d3a/d49/d58/f9e 0 2024-03-18T14:43:23.122 INFO:tasks.workunit.client.1.smithi129.stdout:1/609: creat d1/d2/d70/fb9 x:0 0 0 2024-03-18T14:43:23.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/793: write d13/d1b/d27/d28/f78 [730576,20459] 0 2024-03-18T14:43:23.123 INFO:tasks.workunit.client.1.smithi129.stdout:6/625: mknod d3/d6/d82/d9a/dbe/ccb 0 2024-03-18T14:43:23.124 INFO:tasks.workunit.client.0.smithi087.stdout:2/797: write d2/f32 [189876,54090] 0 2024-03-18T14:43:23.125 INFO:tasks.workunit.client.1.smithi129.stdout:5/570: symlink d0/dc/d18/la8 0 2024-03-18T14:43:23.126 INFO:tasks.workunit.client.1.smithi129.stdout:9/581: fsync d0/db/d1f/f4e 0 2024-03-18T14:43:23.126 INFO:tasks.workunit.client.0.smithi087.stdout:1/823: rename d3/d1d/d1e/d43/d50/d72 to d3/d1d/d1e/d43/dfb 0 2024-03-18T14:43:23.127 INFO:tasks.workunit.client.0.smithi087.stdout:8/757: dwrite d1/d6/d8d/fe7 [0,4194304] 0 2024-03-18T14:43:23.129 INFO:tasks.workunit.client.1.smithi129.stdout:6/626: dread d3/d30/de/f83 [0,4194304] 0 2024-03-18T14:43:23.129 INFO:tasks.workunit.client.0.smithi087.stdout:8/758: readlink d1/d6/d2f/d44/d45/d71/l78 0 2024-03-18T14:43:23.129 INFO:tasks.workunit.client.0.smithi087.stdout:8/759: stat d1/d6/d14/l42 0 2024-03-18T14:43:23.129 INFO:tasks.workunit.client.0.smithi087.stdout:0/769: link d0/d2/f4a d0/d2/d4/d19/f10d 0 2024-03-18T14:43:23.130 INFO:tasks.workunit.client.1.smithi129.stdout:0/633: dread d0/d14/f24 [0,4194304] 0 2024-03-18T14:43:23.130 INFO:tasks.workunit.client.1.smithi129.stdout:0/634: write d0/d23/d35/fb4 [536869,104113] 0 2024-03-18T14:43:23.131 INFO:tasks.workunit.client.0.smithi087.stdout:5/794: chown d13/d1b/d27/d28/c9f 20509031 1 2024-03-18T14:43:23.132 INFO:tasks.workunit.client.1.smithi129.stdout:4/549: link d0/d19/d46/d3e/d21/d32/f83 d0/d19/d46/d3e/d21/d4d/faf 0 2024-03-18T14:43:23.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/760: dread d1/d6/d2f/d44/f81 [0,4194304] 0 2024-03-18T14:43:23.134 INFO:tasks.workunit.client.0.smithi087.stdout:9/867: rename db/d18/d3a/f125 to db/d18/d51/d8f/f129 0 2024-03-18T14:43:23.135 INFO:tasks.workunit.client.0.smithi087.stdout:1/824: fdatasync d3/d1d/d1e/d43/da3/ffa 0 2024-03-18T14:43:23.135 INFO:tasks.workunit.client.1.smithi129.stdout:2/619: rename d7/d1f/d34 to d7/d1f/d20/d36/da9/dc1 0 2024-03-18T14:43:23.136 INFO:tasks.workunit.client.0.smithi087.stdout:6/738: creat d3/d7/d25/d62/d7c/ffa x:0 0 0 2024-03-18T14:43:23.136 INFO:tasks.workunit.client.0.smithi087.stdout:9/868: read db/d18/d1c/d69/f8c [8135163,81781] 0 2024-03-18T14:43:23.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/795: truncate d13/d1b/f5c 3218803 0 2024-03-18T14:43:23.139 INFO:tasks.workunit.client.1.smithi129.stdout:9/582: mkdir d0/db/d2e/d9d/dbb 0 2024-03-18T14:43:23.139 INFO:tasks.workunit.client.0.smithi087.stdout:5/796: write d13/d1b/d27/d35/f4b [307614,37173] 0 2024-03-18T14:43:23.140 INFO:tasks.workunit.client.0.smithi087.stdout:5/797: chown d13/d1b/d27/d35/da7 803 1 2024-03-18T14:43:23.140 INFO:tasks.workunit.client.1.smithi129.stdout:3/578: link d4/d11/d34/d53/f80 d4/dd/d1f/d2f/fc5 0 2024-03-18T14:43:23.141 INFO:tasks.workunit.client.0.smithi087.stdout:2/798: link d2/f99 d2/ddd/d22/d24/d65/df2/f102 0 2024-03-18T14:43:23.142 INFO:tasks.workunit.client.1.smithi129.stdout:8/656: write d9/d11/d1a/d32/d41/d4d/fa9 [843825,13276] 0 2024-03-18T14:43:23.146 INFO:tasks.workunit.client.1.smithi129.stdout:6/627: truncate d3/d30/f26 5886161 0 2024-03-18T14:43:23.146 INFO:tasks.workunit.client.1.smithi129.stdout:4/550: creat d0/d3c/fb0 x:0 0 0 2024-03-18T14:43:23.147 INFO:tasks.workunit.client.1.smithi129.stdout:3/579: dread d4/d11/d34/d4c/f5d [0,4194304] 0 2024-03-18T14:43:23.147 INFO:tasks.workunit.client.1.smithi129.stdout:2/620: mknod d7/d1c/d79/cc2 0 2024-03-18T14:43:23.148 INFO:tasks.workunit.client.1.smithi129.stdout:1/610: creat d1/d2/d70/d71/fba x:0 0 0 2024-03-18T14:43:23.149 INFO:tasks.workunit.client.0.smithi087.stdout:1/825: mkdir d3/d3c/db8/d8f/d99/dfc 0 2024-03-18T14:43:23.149 INFO:tasks.workunit.client.0.smithi087.stdout:0/770: dwrite d0/d2/d4/de8/dad/dea/f96 [0,4194304] 0 2024-03-18T14:43:23.150 INFO:tasks.workunit.client.1.smithi129.stdout:9/583: unlink d0/db/d90/d70/d93/lb0 0 2024-03-18T14:43:23.150 INFO:tasks.workunit.client.1.smithi129.stdout:0/635: dread d0/d14/d28/f30 [0,4194304] 0 2024-03-18T14:43:23.150 INFO:tasks.workunit.client.0.smithi087.stdout:6/739: write d3/d7/d25/d62/d7c/f1e [4632047,120383] 0 2024-03-18T14:43:23.152 INFO:tasks.workunit.client.0.smithi087.stdout:9/869: mkdir db/d18/d1e/d28/d12a 0 2024-03-18T14:43:23.152 INFO:tasks.workunit.client.1.smithi129.stdout:6/628: mknod d3/d30/de/d6c/d9e/db6/ccc 0 2024-03-18T14:43:23.153 INFO:tasks.workunit.client.0.smithi087.stdout:5/798: creat d13/d1b/d27/d35/d3b/f10b x:0 0 0 2024-03-18T14:43:23.153 INFO:tasks.workunit.client.0.smithi087.stdout:0/771: dread d0/d2/d4/d27/f55 [0,4194304] 0 2024-03-18T14:43:23.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/551: mkdir d0/d9/d6a/db1 0 2024-03-18T14:43:23.154 INFO:tasks.workunit.client.1.smithi129.stdout:4/552: fdatasync d0/d9/f9a 0 2024-03-18T14:43:23.154 INFO:tasks.workunit.client.0.smithi087.stdout:8/761: creat d1/d6/d9/d5d/d87/da2/df0/ffb x:0 0 0 2024-03-18T14:43:23.155 INFO:tasks.workunit.client.0.smithi087.stdout:0/772: dread - d0/d2/d4/de8/dad/dea/da3/fc0 zero size 2024-03-18T14:43:23.157 INFO:tasks.workunit.client.0.smithi087.stdout:1/826: chown d3/d1d/d1e/c78 1084765504 1 2024-03-18T14:43:23.157 INFO:tasks.workunit.client.1.smithi129.stdout:0/636: unlink d0/d23/d71/dc2/d4a/d61/f76 0 2024-03-18T14:43:23.158 INFO:tasks.workunit.client.0.smithi087.stdout:6/740: mkdir d3/d7/d25/dfb 0 2024-03-18T14:43:23.159 INFO:tasks.workunit.client.1.smithi129.stdout:4/553: unlink d0/d19/f5e 0 2024-03-18T14:43:23.160 INFO:tasks.workunit.client.0.smithi087.stdout:7/857: sync 2024-03-18T14:43:23.162 INFO:tasks.workunit.client.1.smithi129.stdout:7/618: sync 2024-03-18T14:43:23.162 INFO:tasks.workunit.client.0.smithi087.stdout:5/799: creat d13/d1b/d70/da8/f10c x:0 0 0 2024-03-18T14:43:23.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/800: readlink d13/d1b/d27/d28/d9a/lbc 0 2024-03-18T14:43:23.163 INFO:tasks.workunit.client.0.smithi087.stdout:5/801: fsync d13/d1b/d27/d35/d3b/fc4 0 2024-03-18T14:43:23.164 INFO:tasks.workunit.client.0.smithi087.stdout:0/773: creat d0/d2/d4/d27/dc3/f10e x:0 0 0 2024-03-18T14:43:23.165 INFO:tasks.workunit.client.1.smithi129.stdout:6/629: symlink d3/d5/lcd 0 2024-03-18T14:43:23.165 INFO:tasks.workunit.client.1.smithi129.stdout:4/554: dread d0/d19/d46/d3e/d21/f72 [0,4194304] 0 2024-03-18T14:43:23.166 INFO:tasks.workunit.client.1.smithi129.stdout:4/555: chown d0/d19/d46/d3e/d21/d32/l59 475 1 2024-03-18T14:43:23.166 INFO:tasks.workunit.client.0.smithi087.stdout:9/870: fdatasync db/d18/d1e/dde/dce/fa9 0 2024-03-18T14:43:23.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/871: write f7 [1121369,4440] 0 2024-03-18T14:43:23.167 INFO:tasks.workunit.client.0.smithi087.stdout:2/799: link d2/ddd/d22/d2c/d3a/lc6 d2/ddd/d22/d2c/d3a/d40/d98/dd8/l103 0 2024-03-18T14:43:23.169 INFO:tasks.workunit.client.0.smithi087.stdout:8/762: mkdir d1/d6/d2f/d44/dfc 0 2024-03-18T14:43:23.169 INFO:tasks.workunit.client.0.smithi087.stdout:0/774: dread d0/d2/d4/d19/d5a/fde [0,4194304] 0 2024-03-18T14:43:23.170 INFO:tasks.workunit.client.1.smithi129.stdout:4/556: dwrite d0/d9/d6a/d7b/fa6 [0,4194304] 0 2024-03-18T14:43:23.170 INFO:tasks.workunit.client.0.smithi087.stdout:5/802: mkdir d13/d1b/d27/d8f/dab/d10d 0 2024-03-18T14:43:23.172 INFO:tasks.workunit.client.0.smithi087.stdout:5/803: chown d13/d1b/d70/fdf 66284589 1 2024-03-18T14:43:23.172 INFO:tasks.workunit.client.1.smithi129.stdout:0/637: rename d0/d14/d53/c5a to d0/d23/d71/dc2/d4a/d7a/dbd/cc6 0 2024-03-18T14:43:23.174 INFO:tasks.workunit.client.1.smithi129.stdout:2/621: write d7/d3f/f50 [284760,56336] 0 2024-03-18T14:43:23.174 INFO:tasks.workunit.client.1.smithi129.stdout:3/580: write d4/dd/d1f/d5f/f5b [3077727,10640] 0 2024-03-18T14:43:23.174 INFO:tasks.workunit.client.0.smithi087.stdout:2/800: dwrite d2/ddd/d22/d24/f8e [4194304,4194304] 0 2024-03-18T14:43:23.174 INFO:tasks.workunit.client.0.smithi087.stdout:7/858: dread d1/d6/d29/d2f/d68/d65/d60/f93 [0,4194304] 0 2024-03-18T14:43:23.175 INFO:tasks.workunit.client.0.smithi087.stdout:7/859: chown d1/d6/da/d42/d61/d74/d127 68933532 1 2024-03-18T14:43:23.176 INFO:tasks.workunit.client.0.smithi087.stdout:7/860: write d1/d6/d16/dc/ddc/f103 [600790,17060] 0 2024-03-18T14:43:23.177 INFO:tasks.workunit.client.0.smithi087.stdout:7/861: read - d1/d6/da/d42/d61/fd3 zero size 2024-03-18T14:43:23.180 INFO:tasks.workunit.client.0.smithi087.stdout:1/827: write d3/d1d/f28 [1746371,85121] 0 2024-03-18T14:43:23.180 INFO:tasks.workunit.client.1.smithi129.stdout:9/584: creat d0/db/d1f/d20/fbc x:0 0 0 2024-03-18T14:43:23.180 INFO:tasks.workunit.client.1.smithi129.stdout:8/657: link d9/d33/cc6 d9/d11/d55/d68/cdd 0 2024-03-18T14:43:23.181 INFO:tasks.workunit.client.1.smithi129.stdout:9/585: write d0/db/d1f/d20/d26/d19/d29/f44 [832483,58541] 0 2024-03-18T14:43:23.181 INFO:tasks.workunit.client.1.smithi129.stdout:6/630: fdatasync d3/d30/df/d28/f8c 0 2024-03-18T14:43:23.185 INFO:tasks.workunit.client.1.smithi129.stdout:0/638: creat d0/d14/d91/fc7 x:0 0 0 2024-03-18T14:43:23.185 INFO:tasks.workunit.client.1.smithi129.stdout:0/639: chown d0/d23/d6b/f8b 20283591 1 2024-03-18T14:43:23.186 INFO:tasks.workunit.client.1.smithi129.stdout:3/581: creat d4/dd/d1f/da8/fc6 x:0 0 0 2024-03-18T14:43:23.187 INFO:tasks.workunit.client.0.smithi087.stdout:9/872: rename db/d18/d1c/d69/d6f/c88 to db/d18/d1c/d69/c12b 0 2024-03-18T14:43:23.189 INFO:tasks.workunit.client.1.smithi129.stdout:8/658: unlink d9/d11/d55/d68/d72/fac 0 2024-03-18T14:43:23.189 INFO:tasks.workunit.client.0.smithi087.stdout:0/775: rmdir d0/d1a/d7b/d26/d79 39 2024-03-18T14:43:23.190 INFO:tasks.workunit.client.1.smithi129.stdout:9/586: rmdir d0/db/d11 39 2024-03-18T14:43:23.192 INFO:tasks.workunit.client.1.smithi129.stdout:4/557: symlink d0/d9/d6a/db1/lb2 0 2024-03-18T14:43:23.192 INFO:tasks.workunit.client.0.smithi087.stdout:1/828: stat d3/f7c 0 2024-03-18T14:43:23.193 INFO:tasks.workunit.client.1.smithi129.stdout:2/622: symlink d7/d1f/d20/d2b/d41/lc3 0 2024-03-18T14:43:23.194 INFO:tasks.workunit.client.1.smithi129.stdout:3/582: readlink d4/l6b 0 2024-03-18T14:43:23.194 INFO:tasks.workunit.client.1.smithi129.stdout:8/659: dwrite d9/d11/d1a/d32/d41/d4d/f9b [0,4194304] 0 2024-03-18T14:43:23.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/727: sync 2024-03-18T14:43:23.195 INFO:tasks.workunit.client.1.smithi129.stdout:4/558: write d0/d19/d46/d3e/d33/f8b [383176,41714] 0 2024-03-18T14:43:23.195 INFO:tasks.workunit.client.0.smithi087.stdout:4/728: dread - d2/db/fd8 zero size 2024-03-18T14:43:23.197 INFO:tasks.workunit.client.0.smithi087.stdout:6/741: creat d3/d7/d25/d62/d7c/d29/d22/ffc x:0 0 0 2024-03-18T14:43:23.199 INFO:tasks.workunit.client.1.smithi129.stdout:7/619: truncate d4/d2d/d2e/d42/f7c 1103069 0 2024-03-18T14:43:23.200 INFO:tasks.workunit.client.0.smithi087.stdout:8/763: creat d1/d6/d9/d5d/d87/dd1/ffd x:0 0 0 2024-03-18T14:43:23.200 INFO:tasks.workunit.client.0.smithi087.stdout:9/873: rmdir db/d18/d1e/d28/d76 39 2024-03-18T14:43:23.201 INFO:tasks.workunit.client.1.smithi129.stdout:6/631: creat d3/d6/d7f/d8f/fce x:0 0 0 2024-03-18T14:43:23.202 INFO:tasks.workunit.client.0.smithi087.stdout:8/764: stat d1/d6/d2f/ca9 0 2024-03-18T14:43:23.203 INFO:tasks.workunit.client.0.smithi087.stdout:5/804: truncate d13/d1b/f47 1140526 0 2024-03-18T14:43:23.203 INFO:tasks.workunit.client.1.smithi129.stdout:8/660: rmdir d9/d33/dc2 39 2024-03-18T14:43:23.203 INFO:tasks.workunit.client.0.smithi087.stdout:7/862: dwrite d1/d6/d29/d2f/fca [4194304,4194304] 0 2024-03-18T14:43:23.204 INFO:tasks.workunit.client.1.smithi129.stdout:2/623: mkdir d7/d1f/d20/d36/da9/dc1/da5/dc4 0 2024-03-18T14:43:23.205 INFO:tasks.workunit.client.0.smithi087.stdout:5/805: stat d13/d1b/d30/f49 0 2024-03-18T14:43:23.205 INFO:tasks.workunit.client.0.smithi087.stdout:1/829: mknod d3/d1d/d1e/d43/dfb/cfd 0 2024-03-18T14:43:23.205 INFO:tasks.workunit.client.1.smithi129.stdout:2/624: chown d7/d1f/d20/d2a/f5a 48156 1 2024-03-18T14:43:23.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/806: read - d13/d1b/d70/fdf zero size 2024-03-18T14:43:23.206 INFO:tasks.workunit.client.1.smithi129.stdout:4/559: mknod d0/d19/d46/d3e/d33/cb3 0 2024-03-18T14:43:23.206 INFO:tasks.workunit.client.0.smithi087.stdout:5/807: dread - d13/d1b/d27/d28/d9a/dae/fe1 zero size 2024-03-18T14:43:23.207 INFO:tasks.workunit.client.0.smithi087.stdout:4/729: dread d2/db/d24/f4c [0,4194304] 0 2024-03-18T14:43:23.208 INFO:tasks.workunit.client.0.smithi087.stdout:9/874: readlink db/d18/d51/d7b/l112 0 2024-03-18T14:43:23.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/776: dread d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:23.208 INFO:tasks.workunit.client.0.smithi087.stdout:4/730: chown d2/fb6 8647110 1 2024-03-18T14:43:23.209 INFO:tasks.workunit.client.0.smithi087.stdout:4/731: chown d2/d13/fec 57179 1 2024-03-18T14:43:23.210 INFO:tasks.workunit.client.0.smithi087.stdout:7/863: dread d1/d6/d29/d2f/d68/d65/d60/f84 [0,4194304] 0 2024-03-18T14:43:23.211 INFO:tasks.workunit.client.1.smithi129.stdout:9/587: symlink d0/db/d11/d97/lbd 0 2024-03-18T14:43:23.211 INFO:tasks.workunit.client.0.smithi087.stdout:1/830: fdatasync d3/d1d/d67/f88 0 2024-03-18T14:43:23.212 INFO:tasks.workunit.client.1.smithi129.stdout:7/620: creat d4/d7/d38/d61/d68/d6b/fc0 x:0 0 0 2024-03-18T14:43:23.212 INFO:tasks.workunit.client.0.smithi087.stdout:6/742: getdents d3/dcd/ddb 0 2024-03-18T14:43:23.212 INFO:tasks.workunit.client.0.smithi087.stdout:1/831: dread - d3/de4/fed zero size 2024-03-18T14:43:23.213 INFO:tasks.workunit.client.1.smithi129.stdout:7/621: fsync d4/d2d/d2e/d42/d58/f7f 0 2024-03-18T14:43:23.213 INFO:tasks.workunit.client.1.smithi129.stdout:6/632: creat d3/d30/de/da9/fcf x:0 0 0 2024-03-18T14:43:23.214 INFO:tasks.workunit.client.0.smithi087.stdout:9/875: mknod db/d18/d1c/d69/c12c 0 2024-03-18T14:43:23.214 INFO:tasks.workunit.client.0.smithi087.stdout:1/832: fsync d3/d1d/d1e/d20/f56 0 2024-03-18T14:43:23.215 INFO:tasks.workunit.client.0.smithi087.stdout:7/864: dwrite d1/d6/da/d42/d67/fe4 [0,4194304] 0 2024-03-18T14:43:23.215 INFO:tasks.workunit.client.1.smithi129.stdout:6/633: read - d3/d6/f51 zero size 2024-03-18T14:43:23.215 INFO:tasks.workunit.client.1.smithi129.stdout:3/583: creat d4/dd/d41/fc7 x:0 0 0 2024-03-18T14:43:23.215 INFO:tasks.workunit.client.1.smithi129.stdout:9/588: dwrite d0/db/d1f/d4c/d57/f82 [0,4194304] 0 2024-03-18T14:43:23.216 INFO:tasks.workunit.client.1.smithi129.stdout:8/661: rmdir d9/d11/d1a/d14/db7/dc1 39 2024-03-18T14:43:23.216 INFO:tasks.workunit.client.0.smithi087.stdout:1/833: dread d3/d1d/d67/d94/fbb [0,4194304] 0 2024-03-18T14:43:23.216 INFO:tasks.workunit.client.0.smithi087.stdout:0/777: creat d0/d1a/d80/d88/dbd/f10f x:0 0 0 2024-03-18T14:43:23.216 INFO:tasks.workunit.client.1.smithi129.stdout:3/584: readlink d4/d11/d34/d3c/d95/la0 0 2024-03-18T14:43:23.217 INFO:tasks.workunit.client.1.smithi129.stdout:6/634: chown d3/d30/de/d6c/f53 647949 1 2024-03-18T14:43:23.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/589: fsync d0/db/d1f/d20/f8f 0 2024-03-18T14:43:23.220 INFO:tasks.workunit.client.0.smithi087.stdout:7/865: dwrite d1/d6/da/d42/d61/d74/fe2 [0,4194304] 0 2024-03-18T14:43:23.223 INFO:tasks.workunit.client.0.smithi087.stdout:4/732: read d2/db/d3c/d90/f93 [220079,113257] 0 2024-03-18T14:43:23.224 INFO:tasks.workunit.client.0.smithi087.stdout:4/733: chown d2/db/d24/d30/d56/l5f 0 1 2024-03-18T14:43:23.227 INFO:tasks.workunit.client.0.smithi087.stdout:3/800: sync 2024-03-18T14:43:23.229 INFO:tasks.workunit.client.0.smithi087.stdout:8/765: write d1/d6/d9/f8c [1504611,123987] 0 2024-03-18T14:43:23.231 INFO:tasks.workunit.client.0.smithi087.stdout:1/834: rmdir d3/d1d/d1e/d43/d9b 39 2024-03-18T14:43:23.234 INFO:tasks.workunit.client.0.smithi087.stdout:2/801: link d2/ddd/c21 d2/d44/d72/c104 0 2024-03-18T14:43:23.235 INFO:tasks.workunit.client.0.smithi087.stdout:7/866: fsync d1/d97/fb7 0 2024-03-18T14:43:23.236 INFO:tasks.workunit.client.0.smithi087.stdout:7/867: chown d1/d6/da/d59/dbe/d11a/lf8 27512355 1 2024-03-18T14:43:23.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/808: creat d13/d1b/f10e x:0 0 0 2024-03-18T14:43:23.236 INFO:tasks.workunit.client.1.smithi129.stdout:5/571: sync 2024-03-18T14:43:23.238 INFO:tasks.workunit.client.1.smithi129.stdout:3/585: readlink d4/l33 0 2024-03-18T14:43:23.239 INFO:tasks.workunit.client.1.smithi129.stdout:6/635: dread - d3/d30/de/d65/d80/f8e zero size 2024-03-18T14:43:23.239 INFO:tasks.workunit.client.0.smithi087.stdout:3/801: symlink d0/de/d30/d8e/le6 0 2024-03-18T14:43:23.240 INFO:tasks.workunit.client.1.smithi129.stdout:6/636: readlink d3/d30/de/d49/lb0 0 2024-03-18T14:43:23.242 INFO:tasks.workunit.client.1.smithi129.stdout:4/560: dwrite d0/d19/d46/d3e/f42 [0,4194304] 0 2024-03-18T14:43:23.243 INFO:tasks.workunit.client.1.smithi129.stdout:9/590: creat d0/db/d90/d3e/d7e/fbe x:0 0 0 2024-03-18T14:43:23.244 INFO:tasks.workunit.client.1.smithi129.stdout:8/662: link d9/d33/c40 d9/d11/d1a/d66/cde 0 2024-03-18T14:43:23.244 INFO:tasks.workunit.client.1.smithi129.stdout:9/591: write d0/f4 [2948387,44066] 0 2024-03-18T14:43:23.245 INFO:tasks.workunit.client.0.smithi087.stdout:4/734: mkdir d2/db/d24/d30/d7b/dbe/dcf/def 0 2024-03-18T14:43:23.245 INFO:tasks.workunit.client.1.smithi129.stdout:3/586: dread d4/dd/d1f/d2f/fc5 [0,4194304] 0 2024-03-18T14:43:23.246 INFO:tasks.workunit.client.1.smithi129.stdout:6/637: rmdir d3/d6/d82 39 2024-03-18T14:43:23.246 INFO:tasks.workunit.client.0.smithi087.stdout:0/778: write d0/d2/f4a [6124167,118630] 0 2024-03-18T14:43:23.247 INFO:tasks.workunit.client.1.smithi129.stdout:3/587: write d4/d11/d1d/d50/d91/d97/fc1 [254046,83292] 0 2024-03-18T14:43:23.250 INFO:tasks.workunit.client.0.smithi087.stdout:1/835: creat d3/d3c/db8/d8f/dc2/ffe x:0 0 0 2024-03-18T14:43:23.250 INFO:tasks.workunit.client.1.smithi129.stdout:8/663: rmdir d9/d11/d55/d68/d72 39 2024-03-18T14:43:23.250 INFO:tasks.workunit.client.1.smithi129.stdout:6/638: dwrite d3/d30/de/d65/d93/fa0 [0,4194304] 0 2024-03-18T14:43:23.252 INFO:tasks.workunit.client.0.smithi087.stdout:6/743: truncate d3/f6c 2105512 0 2024-03-18T14:43:23.252 INFO:tasks.workunit.client.0.smithi087.stdout:9/876: write db/d12/f33 [340924,5161] 0 2024-03-18T14:43:23.252 INFO:tasks.workunit.client.1.smithi129.stdout:9/592: mknod d0/db/d53/cbf 0 2024-03-18T14:43:23.252 INFO:tasks.workunit.client.1.smithi129.stdout:6/639: fsync d3/d5/f11 0 2024-03-18T14:43:23.253 INFO:tasks.workunit.client.0.smithi087.stdout:6/744: write d3/d7/d25/d62/d7c/da0/d96/d97/ff2 [916705,96305] 0 2024-03-18T14:43:23.255 INFO:tasks.workunit.client.0.smithi087.stdout:5/809: mknod d13/d1b/d30/d6e/c10f 0 2024-03-18T14:43:23.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/779: mknod d0/d2/d6b/c110 0 2024-03-18T14:43:23.258 INFO:tasks.workunit.client.1.smithi129.stdout:6/640: rename d3/d6/d7f/db4/dc9 to d3/d30/de/d65/d93/dd0 0 2024-03-18T14:43:23.258 INFO:tasks.workunit.client.0.smithi087.stdout:0/780: read d0/d2/d4/d27/dc3/dd2/dff/f106 [168723,85737] 0 2024-03-18T14:43:23.259 INFO:tasks.workunit.client.0.smithi087.stdout:3/802: creat d0/d1c/d25/dd2/fe7 x:0 0 0 2024-03-18T14:43:23.259 INFO:tasks.workunit.client.1.smithi129.stdout:9/593: creat d0/db/d11/d97/d99/db2/fc0 x:0 0 0 2024-03-18T14:43:23.262 INFO:tasks.workunit.client.0.smithi087.stdout:9/877: creat db/d31/f12d x:0 0 0 2024-03-18T14:43:23.263 INFO:tasks.workunit.client.1.smithi129.stdout:8/664: dread d9/d11/d1a/d32/d41/d4d/fa9 [0,4194304] 0 2024-03-18T14:43:23.263 INFO:tasks.workunit.client.1.smithi129.stdout:0/640: sync 2024-03-18T14:43:23.263 INFO:tasks.workunit.client.1.smithi129.stdout:1/611: sync 2024-03-18T14:43:23.263 INFO:tasks.workunit.client.1.smithi129.stdout:1/612: chown d1/d2/l66 4383 1 2024-03-18T14:43:23.264 INFO:tasks.workunit.client.0.smithi087.stdout:6/745: symlink d3/dcd/lfd 0 2024-03-18T14:43:23.264 INFO:tasks.workunit.client.0.smithi087.stdout:2/802: link d2/ddd/d22/d2c/f74 d2/ddd/d22/d2c/d3a/d40/deb/f105 0 2024-03-18T14:43:23.264 INFO:tasks.workunit.client.1.smithi129.stdout:5/572: truncate d0/d32/d34/d6c/f78 3350920 0 2024-03-18T14:43:23.265 INFO:tasks.workunit.client.0.smithi087.stdout:2/803: dread - d2/ddd/d22/d2c/fa9 zero size 2024-03-18T14:43:23.265 INFO:tasks.workunit.client.1.smithi129.stdout:5/573: write d0/dc/d22/f1e [2714838,73276] 0 2024-03-18T14:43:23.266 INFO:tasks.workunit.client.0.smithi087.stdout:4/735: truncate d2/db/d24/f26 741248 0 2024-03-18T14:43:23.266 INFO:tasks.workunit.client.0.smithi087.stdout:2/804: write d2/ddd/d22/d2c/d3a/d68/f93 [925062,45064] 0 2024-03-18T14:43:23.267 INFO:tasks.workunit.client.1.smithi129.stdout:5/574: chown d0/d32/d34/d6c/c6a 683019 1 2024-03-18T14:43:23.268 INFO:tasks.workunit.client.0.smithi087.stdout:2/805: write d2/ddd/d22/d2c/f30 [1297841,47180] 0 2024-03-18T14:43:23.268 INFO:tasks.workunit.client.0.smithi087.stdout:0/781: creat d0/d2/d4/f111 x:0 0 0 2024-03-18T14:43:23.269 INFO:tasks.workunit.client.1.smithi129.stdout:8/665: creat d9/d11/d53/d5f/fdf x:0 0 0 2024-03-18T14:43:23.269 INFO:tasks.workunit.client.1.smithi129.stdout:5/575: chown d0/d32/d34 1074741 1 2024-03-18T14:43:23.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/766: getdents d1/d6/d9/d5d/d87/d88 0 2024-03-18T14:43:23.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/767: chown d1 58 1 2024-03-18T14:43:23.270 INFO:tasks.workunit.client.1.smithi129.stdout:0/641: rmdir d0/d23/d71/dc2/d4a/d7a/dbd 39 2024-03-18T14:43:23.272 INFO:tasks.workunit.client.0.smithi087.stdout:3/803: dread d0/f1 [0,4194304] 0 2024-03-18T14:43:23.272 INFO:tasks.workunit.client.0.smithi087.stdout:7/868: getdents d1/d6/da/d59/dbe/d11a 0 2024-03-18T14:43:23.272 INFO:tasks.workunit.client.1.smithi129.stdout:1/613: dwrite d1/d2/d70/fb9 [0,4194304] 0 2024-03-18T14:43:23.272 INFO:tasks.workunit.client.1.smithi129.stdout:2/625: dread d7/d3f/d5f/f8e [0,4194304] 0 2024-03-18T14:43:23.273 INFO:tasks.workunit.client.1.smithi129.stdout:9/594: write d0/db/d1f/d20/d26/d19/d29/f2d [6776036,78086] 0 2024-03-18T14:43:23.274 INFO:tasks.workunit.client.1.smithi129.stdout:3/588: dwrite d4/d11/d34/d53/f80 [0,4194304] 0 2024-03-18T14:43:23.274 INFO:tasks.workunit.client.1.smithi129.stdout:0/642: chown d0/d23/d6b/c73 196 1 2024-03-18T14:43:23.275 INFO:tasks.workunit.client.1.smithi129.stdout:6/641: creat d3/fd1 x:0 0 0 2024-03-18T14:43:23.276 INFO:tasks.workunit.client.1.smithi129.stdout:3/589: fsync d4/d11/f62 0 2024-03-18T14:43:23.278 INFO:tasks.workunit.client.1.smithi129.stdout:8/666: unlink d9/d11/d1a/d32/c57 0 2024-03-18T14:43:23.279 INFO:tasks.workunit.client.1.smithi129.stdout:5/576: creat d0/dc/d18/d2b/d71/fa9 x:0 0 0 2024-03-18T14:43:23.280 INFO:tasks.workunit.client.1.smithi129.stdout:1/614: creat d1/d2/d70/fbb x:0 0 0 2024-03-18T14:43:23.281 INFO:tasks.workunit.client.1.smithi129.stdout:0/643: chown d0/d23/cbf 3161 1 2024-03-18T14:43:23.285 INFO:tasks.workunit.client.1.smithi129.stdout:2/626: creat d7/d1f/d20/d36/da9/dc1/fc5 x:0 0 0 2024-03-18T14:43:23.286 INFO:tasks.workunit.client.1.smithi129.stdout:4/561: dread d0/f13 [0,4194304] 0 2024-03-18T14:43:23.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/836: dwrite d3/d1d/d1e/f37 [0,4194304] 0 2024-03-18T14:43:23.288 INFO:tasks.workunit.client.1.smithi129.stdout:9/595: rename d0/db/d1f/d20/d26/db4 to d0/da1/dc1 0 2024-03-18T14:43:23.290 INFO:tasks.workunit.client.0.smithi087.stdout:9/878: getdents db/d18/d1e/d28/d7c/dba/d111 0 2024-03-18T14:43:23.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/768: dread d1/d6/d8d/dc2/fd8 [0,4194304] 0 2024-03-18T14:43:23.292 INFO:tasks.workunit.client.0.smithi087.stdout:9/879: fdatasync db/d18/df1/f123 0 2024-03-18T14:43:23.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/577: mknod d0/d32/d3a/d52/d6e/caa 0 2024-03-18T14:43:23.292 INFO:tasks.workunit.client.1.smithi129.stdout:0/644: rmdir d0/d23/d6b 39 2024-03-18T14:43:23.293 INFO:tasks.workunit.client.0.smithi087.stdout:6/746: dread d3/d7/f21 [0,4194304] 0 2024-03-18T14:43:23.294 INFO:tasks.workunit.client.1.smithi129.stdout:2/627: creat d7/d1f/d20/d2d/dab/fc6 x:0 0 0 2024-03-18T14:43:23.295 INFO:tasks.workunit.client.1.smithi129.stdout:7/622: sync 2024-03-18T14:43:23.296 INFO:tasks.workunit.client.0.smithi087.stdout:6/747: dread d3/d7/d25/d62/f6a [0,4194304] 0 2024-03-18T14:43:23.296 INFO:tasks.workunit.client.1.smithi129.stdout:1/615: read d1/d2/f1f [2666571,75225] 0 2024-03-18T14:43:23.296 INFO:tasks.workunit.client.1.smithi129.stdout:1/616: dread - d1/d91/fb4 zero size 2024-03-18T14:43:23.298 INFO:tasks.workunit.client.0.smithi087.stdout:9/880: mkdir db/d18/d1c/d69/d11a/d12e 0 2024-03-18T14:43:23.298 INFO:tasks.workunit.client.1.smithi129.stdout:3/590: rename d4/d11/d1d/d50/d91/d93/f2b to d4/d38/da3/fc8 0 2024-03-18T14:43:23.299 INFO:tasks.workunit.client.1.smithi129.stdout:9/596: dwrite d0/f8 [0,4194304] 0 2024-03-18T14:43:23.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/591: readlink d4/l33 0 2024-03-18T14:43:23.299 INFO:tasks.workunit.client.0.smithi087.stdout:2/806: creat d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/f106 x:0 0 0 2024-03-18T14:43:23.300 INFO:tasks.workunit.client.0.smithi087.stdout:2/807: write d2/f2f [3281341,84677] 0 2024-03-18T14:43:23.301 INFO:tasks.workunit.client.0.smithi087.stdout:1/837: link d3/d1d/d1f/d34/f62 d3/d1d/d1f/d63/fff 0 2024-03-18T14:43:23.301 INFO:tasks.workunit.client.1.smithi129.stdout:2/628: creat d7/d1f/d20/d2b/d41/d65/fc7 x:0 0 0 2024-03-18T14:43:23.302 INFO:tasks.workunit.client.1.smithi129.stdout:9/597: read - d0/db/d90/d70/fb7 zero size 2024-03-18T14:43:23.305 INFO:tasks.workunit.client.0.smithi087.stdout:7/869: rename d1/l2d to d1/d6/d16/l129 0 2024-03-18T14:43:23.305 INFO:tasks.workunit.client.1.smithi129.stdout:8/667: dwrite d9/f1f [0,4194304] 0 2024-03-18T14:43:23.306 INFO:tasks.workunit.client.0.smithi087.stdout:4/736: getdents d2/db/d67 0 2024-03-18T14:43:23.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/737: write d2/db/d84/fca [1332481,81206] 0 2024-03-18T14:43:23.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/738: dread - d2/db/fe1 zero size 2024-03-18T14:43:23.308 INFO:tasks.workunit.client.1.smithi129.stdout:5/578: symlink d0/d32/lab 0 2024-03-18T14:43:23.309 INFO:tasks.workunit.client.1.smithi129.stdout:5/579: chown d0/d32/d34/d6c/l7c 183273951 1 2024-03-18T14:43:23.310 INFO:tasks.workunit.client.1.smithi129.stdout:5/580: chown d0/dc/d1a/f7a 2 1 2024-03-18T14:43:23.310 INFO:tasks.workunit.client.0.smithi087.stdout:5/810: truncate d13/d1b/d7e/dfc/f103 718172 0 2024-03-18T14:43:23.310 INFO:tasks.workunit.client.1.smithi129.stdout:5/581: chown d0/dc/d22/f35 556 1 2024-03-18T14:43:23.312 INFO:tasks.workunit.client.0.smithi087.stdout:3/804: getdents d0/d72 0 2024-03-18T14:43:23.313 INFO:tasks.workunit.client.0.smithi087.stdout:8/769: dread d1/d6/d9/f77 [0,4194304] 0 2024-03-18T14:43:23.313 INFO:tasks.workunit.client.1.smithi129.stdout:4/562: write d0/d19/f38 [2195348,7427] 0 2024-03-18T14:43:23.315 INFO:tasks.workunit.client.0.smithi087.stdout:1/838: creat d3/dbf/f100 x:0 0 0 2024-03-18T14:43:23.315 INFO:tasks.workunit.client.1.smithi129.stdout:6/642: link d3/d6/d7f/db4/d57/lb1 d3/d30/de/da9/ld2 0 2024-03-18T14:43:23.316 INFO:tasks.workunit.client.0.smithi087.stdout:0/782: dread d0/d1a/d34/f5f [0,4194304] 0 2024-03-18T14:43:23.316 INFO:tasks.workunit.client.1.smithi129.stdout:3/592: dread d4/dd/db0/fb2 [0,4194304] 0 2024-03-18T14:43:23.317 INFO:tasks.workunit.client.1.smithi129.stdout:3/593: write d4/d38/f1b [446438,90565] 0 2024-03-18T14:43:23.317 INFO:tasks.workunit.client.1.smithi129.stdout:2/629: unlink d7/d1c/f26 0 2024-03-18T14:43:23.318 INFO:tasks.workunit.client.0.smithi087.stdout:8/770: dwrite d1/d6/d14/db2/fe1 [0,4194304] 0 2024-03-18T14:43:23.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/771: chown d1/d6/d2f/d44/d45/d71/daa/fdb 958241263 1 2024-03-18T14:43:23.319 INFO:tasks.workunit.client.0.smithi087.stdout:8/772: chown d1/d6/d14/l98 6 1 2024-03-18T14:43:23.320 INFO:tasks.workunit.client.0.smithi087.stdout:9/881: creat db/d18/d1e/d28/d76/db7/dd5/f12f x:0 0 0 2024-03-18T14:43:23.320 INFO:tasks.workunit.client.1.smithi129.stdout:8/668: unlink d9/d11/db3/lc9 0 2024-03-18T14:43:23.321 INFO:tasks.workunit.client.0.smithi087.stdout:9/882: chown db/d12/f5e 2122 1 2024-03-18T14:43:23.322 INFO:tasks.workunit.client.0.smithi087.stdout:2/808: symlink d2/ddd/l107 0 2024-03-18T14:43:23.322 INFO:tasks.workunit.client.1.smithi129.stdout:7/623: link d4/d2d/d3a/fbe d4/d7/d8/d3b/fc1 0 2024-03-18T14:43:23.324 INFO:tasks.workunit.client.1.smithi129.stdout:5/582: symlink d0/d32/d34/lac 0 2024-03-18T14:43:23.325 INFO:tasks.workunit.client.1.smithi129.stdout:5/583: write d0/d32/d3a/d52/d69/d8a/f8f [929940,69495] 0 2024-03-18T14:43:23.327 INFO:tasks.workunit.client.0.smithi087.stdout:1/839: creat d3/de4/f101 x:0 0 0 2024-03-18T14:43:23.328 INFO:tasks.workunit.client.0.smithi087.stdout:1/840: dread - d3/d1d/d1e/fa2 zero size 2024-03-18T14:43:23.330 INFO:tasks.workunit.client.0.smithi087.stdout:4/739: mknod d2/db/d24/d30/d7b/dbe/ddc/de3/cf0 0 2024-03-18T14:43:23.330 INFO:tasks.workunit.client.0.smithi087.stdout:3/805: dwrite d0/d3/d40/f97 [0,4194304] 0 2024-03-18T14:43:23.330 INFO:tasks.workunit.client.1.smithi129.stdout:4/563: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:23.331 INFO:tasks.workunit.client.1.smithi129.stdout:6/643: read d3/d5/d46/f89 [42760,93777] 0 2024-03-18T14:43:23.331 INFO:tasks.workunit.client.0.smithi087.stdout:3/806: stat d0/de/d30/d8e/lc9 0 2024-03-18T14:43:23.334 INFO:tasks.workunit.client.0.smithi087.stdout:2/809: mkdir d2/ddd/d22/d2c/d3a/d68/d108 0 2024-03-18T14:43:23.336 INFO:tasks.workunit.client.1.smithi129.stdout:3/594: rename d4/dd/d1f/d5f/d31/d78 to d4/d38/da3/dc9 0 2024-03-18T14:43:23.337 INFO:tasks.workunit.client.0.smithi087.stdout:7/870: write d1/d6/d29/f34 [4809503,13995] 0 2024-03-18T14:43:23.338 INFO:tasks.workunit.client.1.smithi129.stdout:8/669: symlink d9/d11/d1a/d32/d3a/d70/le0 0 2024-03-18T14:43:23.340 INFO:tasks.workunit.client.1.smithi129.stdout:1/617: creat d1/d2/fbc x:0 0 0 2024-03-18T14:43:23.341 INFO:tasks.workunit.client.1.smithi129.stdout:5/584: symlink d0/df/lad 0 2024-03-18T14:43:23.341 INFO:tasks.workunit.client.0.smithi087.stdout:5/811: write d13/d1b/d27/d35/f9c [322240,35765] 0 2024-03-18T14:43:23.342 INFO:tasks.workunit.client.0.smithi087.stdout:1/841: creat d3/d1d/d1e/d43/d50/d71/f102 x:0 0 0 2024-03-18T14:43:23.342 INFO:tasks.workunit.client.0.smithi087.stdout:6/748: dread d3/d7/d25/d62/d7c/d29/f8a [0,4194304] 0 2024-03-18T14:43:23.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/740: chown d2/l4e 3 1 2024-03-18T14:43:23.343 INFO:tasks.workunit.client.0.smithi087.stdout:0/783: truncate d0/d2/d4/de8/dad/dea/dcb/f102 733705 0 2024-03-18T14:43:23.343 INFO:tasks.workunit.client.0.smithi087.stdout:4/741: write d2/fb6 [1019307,77929] 0 2024-03-18T14:43:23.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/842: chown d3/d1d/d1e/d43/dfb/cdd 12281430 1 2024-03-18T14:43:23.344 INFO:tasks.workunit.client.1.smithi129.stdout:9/598: truncate d0/db/d2e/d9f/faa 452833 0 2024-03-18T14:43:23.345 INFO:tasks.workunit.client.1.smithi129.stdout:9/599: chown d0/db/d1f/d20/d26/d19/d29/f2d 669 1 2024-03-18T14:43:23.345 INFO:tasks.workunit.client.1.smithi129.stdout:2/630: mknod d7/d1f/d20/d2d/d7e/cc8 0 2024-03-18T14:43:23.346 INFO:tasks.workunit.client.1.smithi129.stdout:2/631: stat d7/d1c/fbe 0 2024-03-18T14:43:23.346 INFO:tasks.workunit.client.1.smithi129.stdout:4/564: chown d0/c2a 168703 1 2024-03-18T14:43:23.346 INFO:tasks.workunit.client.1.smithi129.stdout:0/645: sync 2024-03-18T14:43:23.348 INFO:tasks.workunit.client.1.smithi129.stdout:3/595: symlink d4/d11/d1d/d50/d91/d97/lca 0 2024-03-18T14:43:23.348 INFO:tasks.workunit.client.1.smithi129.stdout:6/644: read d3/d30/df/f42 [360767,36481] 0 2024-03-18T14:43:23.350 INFO:tasks.workunit.client.1.smithi129.stdout:9/600: dwrite d0/db/f43 [0,4194304] 0 2024-03-18T14:43:23.351 INFO:tasks.workunit.client.1.smithi129.stdout:1/618: rename d1/d2/d28/d65/d19/d84/faa to d1/d35/fbd 0 2024-03-18T14:43:23.353 INFO:tasks.workunit.client.1.smithi129.stdout:1/619: write d1/d2/d28/d65/d19/d52/f6a [3463893,2492] 0 2024-03-18T14:43:23.372 INFO:tasks.workunit.client.0.smithi087.stdout:2/810: symlink d2/ddd/d22/d2c/d3a/d40/d52/l109 0 2024-03-18T14:43:23.373 INFO:tasks.workunit.client.0.smithi087.stdout:3/807: write d0/de/d30/d46/f89 [4326509,23909] 0 2024-03-18T14:43:23.374 INFO:tasks.workunit.client.1.smithi129.stdout:2/632: mkdir d7/d1f/d20/d2d/dc9 0 2024-03-18T14:43:23.374 INFO:tasks.workunit.client.0.smithi087.stdout:6/749: write d3/d7/d25/d62/d7c/d29/d22/f5d [3773727,121288] 0 2024-03-18T14:43:23.375 INFO:tasks.workunit.client.1.smithi129.stdout:8/670: creat d9/d11/d1a/d32/d41/d4d/dce/fe1 x:0 0 0 2024-03-18T14:43:23.375 INFO:tasks.workunit.client.1.smithi129.stdout:7/624: creat d4/fc2 x:0 0 0 2024-03-18T14:43:23.375 INFO:tasks.workunit.client.1.smithi129.stdout:4/565: mknod d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/cb4 0 2024-03-18T14:43:23.376 INFO:tasks.workunit.client.0.smithi087.stdout:0/784: write d0/d2/d4/d19/f5e [1428024,20047] 0 2024-03-18T14:43:23.376 INFO:tasks.workunit.client.0.smithi087.stdout:8/773: getdents d1/d6 0 2024-03-18T14:43:23.376 INFO:tasks.workunit.client.1.smithi129.stdout:9/601: truncate d0/db/d1f/f4e 1258688 0 2024-03-18T14:43:23.376 INFO:tasks.workunit.client.1.smithi129.stdout:5/585: rename d0/dc/d1a/d61/f9d to d0/dc/d1a/d61/d94/fae 0 2024-03-18T14:43:23.377 INFO:tasks.workunit.client.0.smithi087.stdout:9/883: getdents db/d18/d1c/d69/d6f 0 2024-03-18T14:43:23.377 INFO:tasks.workunit.client.0.smithi087.stdout:5/812: symlink d13/l110 0 2024-03-18T14:43:23.378 INFO:tasks.workunit.client.1.smithi129.stdout:8/671: fdatasync d9/d11/d1a/d32/d3a/d70/fd6 0 2024-03-18T14:43:23.378 INFO:tasks.workunit.client.1.smithi129.stdout:9/602: chown d0/db/d1f/d20/d26/c3a 7961 1 2024-03-18T14:43:23.378 INFO:tasks.workunit.client.1.smithi129.stdout:5/586: write d0/df/f59 [1527074,81022] 0 2024-03-18T14:43:23.379 INFO:tasks.workunit.client.0.smithi087.stdout:4/742: mknod d2/db/d24/d30/d8a/cf1 0 2024-03-18T14:43:23.379 INFO:tasks.workunit.client.0.smithi087.stdout:0/785: dread - d0/d1a/d80/d88/dbd/f10f zero size 2024-03-18T14:43:23.380 INFO:tasks.workunit.client.0.smithi087.stdout:1/843: creat d3/d1d/d1e/d43/dfb/f103 x:0 0 0 2024-03-18T14:43:23.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/750: write d3/d7/d25/d62/d7c/d29/d22/d75/f9b [6137357,58252] 0 2024-03-18T14:43:23.380 INFO:tasks.workunit.client.1.smithi129.stdout:3/596: mknod d4/d38/da3/dc9/da9/ccb 0 2024-03-18T14:43:23.381 INFO:tasks.workunit.client.1.smithi129.stdout:2/633: symlink d7/d1f/d20/d2d/dab/lca 0 2024-03-18T14:43:23.382 INFO:tasks.workunit.client.0.smithi087.stdout:2/811: symlink d2/ddd/d22/d2c/d3a/d40/d52/l10a 0 2024-03-18T14:43:23.382 INFO:tasks.workunit.client.1.smithi129.stdout:9/603: write d0/db/d1f/d20/d25/d8e/f9a [1799166,54004] 0 2024-03-18T14:43:23.382 INFO:tasks.workunit.client.0.smithi087.stdout:2/812: chown d2/f43 23976805 1 2024-03-18T14:43:23.383 INFO:tasks.workunit.client.1.smithi129.stdout:4/566: creat d0/d19/d46/d2e/fb5 x:0 0 0 2024-03-18T14:43:23.383 INFO:tasks.workunit.client.0.smithi087.stdout:8/774: symlink d1/d6/d9/d5d/d87/da2/df0/lfe 0 2024-03-18T14:43:23.384 INFO:tasks.workunit.client.1.smithi129.stdout:7/625: dwrite d4/d7/d54/f69 [0,4194304] 0 2024-03-18T14:43:23.384 INFO:tasks.workunit.client.0.smithi087.stdout:8/775: dread - d1/d6/d8d/fed zero size 2024-03-18T14:43:23.385 INFO:tasks.workunit.client.0.smithi087.stdout:5/813: creat d13/d1b/d30/d6e/d88/f111 x:0 0 0 2024-03-18T14:43:23.385 INFO:tasks.workunit.client.1.smithi129.stdout:8/672: creat d9/d11/d18/da4/fe2 x:0 0 0 2024-03-18T14:43:23.386 INFO:tasks.workunit.client.0.smithi087.stdout:2/813: dwrite d2/d44/fb7 [0,4194304] 0 2024-03-18T14:43:23.386 INFO:tasks.workunit.client.1.smithi129.stdout:9/604: write d0/db/d1f/d20/d26/d19/d29/d36/f5e [113948,72794] 0 2024-03-18T14:43:23.387 INFO:tasks.workunit.client.0.smithi087.stdout:5/814: write d13/d1b/d70/da8/fb2 [2688164,105439] 0 2024-03-18T14:43:23.389 INFO:tasks.workunit.client.0.smithi087.stdout:4/743: creat d2/db/d24/d30/d7b/ff2 x:0 0 0 2024-03-18T14:43:23.390 INFO:tasks.workunit.client.1.smithi129.stdout:5/587: creat d0/dc/d1a/d61/faf x:0 0 0 2024-03-18T14:43:23.390 INFO:tasks.workunit.client.1.smithi129.stdout:5/588: chown d0/dc/d18/c33 300 1 2024-03-18T14:43:23.394 INFO:tasks.workunit.client.1.smithi129.stdout:1/620: link d1/d2/d28/d65/d7c/d7d/d80/f9a d1/fbe 0 2024-03-18T14:43:23.395 INFO:tasks.workunit.client.0.smithi087.stdout:3/808: truncate d0/fb6 979628 0 2024-03-18T14:43:23.396 INFO:tasks.workunit.client.1.smithi129.stdout:4/567: rename d0/d9/f15 to d0/d19/d46/d3e/d21/d32/fb6 0 2024-03-18T14:43:23.396 INFO:tasks.workunit.client.1.smithi129.stdout:2/634: dread d7/d1f/d20/d36/da9/dc1/f1a [0,4194304] 0 2024-03-18T14:43:23.397 INFO:tasks.workunit.client.1.smithi129.stdout:0/646: link d0/c39 d0/d23/d71/dc2/cc8 0 2024-03-18T14:43:23.397 INFO:tasks.workunit.client.1.smithi129.stdout:4/568: stat d0/d19/d46/d3e/d21/d4d/d58/d61 0 2024-03-18T14:43:23.398 INFO:tasks.workunit.client.1.smithi129.stdout:0/647: fsync d0/d14/d28/d63/d8d/fa7 0 2024-03-18T14:43:23.400 INFO:tasks.workunit.client.0.smithi087.stdout:5/815: symlink d13/d1b/d7e/l112 0 2024-03-18T14:43:23.400 INFO:tasks.workunit.client.1.smithi129.stdout:9/605: unlink d0/db/d11/f27 0 2024-03-18T14:43:23.401 INFO:tasks.workunit.client.0.smithi087.stdout:6/751: dread d3/d7/f85 [0,4194304] 0 2024-03-18T14:43:23.402 INFO:tasks.workunit.client.1.smithi129.stdout:5/589: mknod d0/d32/d3a/d52/cb0 0 2024-03-18T14:43:23.403 INFO:tasks.workunit.client.0.smithi087.stdout:2/814: rename d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fa0 to d2/ddd/d22/d2c/d3a/d40/d98/f10b 0 2024-03-18T14:43:23.408 INFO:tasks.workunit.client.0.smithi087.stdout:8/776: mknod d1/d6/d2f/d44/dfc/cff 0 2024-03-18T14:43:23.408 INFO:tasks.workunit.client.1.smithi129.stdout:0/648: rename d0/d14/d53/dac to d0/d14/d53/dc9 0 2024-03-18T14:43:23.408 INFO:tasks.workunit.client.1.smithi129.stdout:4/569: dwrite d0/d19/d46/d3e/d21/d32/fb6 [0,4194304] 0 2024-03-18T14:43:23.409 INFO:tasks.workunit.client.0.smithi087.stdout:3/809: creat d0/de/d30/d60/fe8 x:0 0 0 2024-03-18T14:43:23.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/816: symlink d13/d1b/d70/da8/l113 0 2024-03-18T14:43:23.413 INFO:tasks.workunit.client.1.smithi129.stdout:9/606: mknod d0/db/d1f/d20/d25/cc2 0 2024-03-18T14:43:23.414 INFO:tasks.workunit.client.1.smithi129.stdout:9/607: dread - d0/db/d90/d3e/d7e/fbe zero size 2024-03-18T14:43:23.415 INFO:tasks.workunit.client.0.smithi087.stdout:4/744: symlink d2/d13/lf3 0 2024-03-18T14:43:23.415 INFO:tasks.workunit.client.0.smithi087.stdout:9/884: link db/d31/c67 db/d18/d1e/d28/d7c/dba/d111/c130 0 2024-03-18T14:43:23.416 INFO:tasks.workunit.client.0.smithi087.stdout:9/885: dread - db/d18/d1e/d28/d76/de0/fe4 zero size 2024-03-18T14:43:23.417 INFO:tasks.workunit.client.0.smithi087.stdout:8/777: mknod d1/d6/d2f/c100 0 2024-03-18T14:43:23.417 INFO:tasks.workunit.client.0.smithi087.stdout:0/786: getdents d0/d2/d4/de8/dad 0 2024-03-18T14:43:23.418 INFO:tasks.workunit.client.0.smithi087.stdout:0/787: stat d0/d1a/ceb 0 2024-03-18T14:43:23.418 INFO:tasks.workunit.client.0.smithi087.stdout:3/810: write d0/de/d30/f7c [4021360,61512] 0 2024-03-18T14:43:23.421 INFO:tasks.workunit.client.1.smithi129.stdout:1/621: mkdir d1/dbf 0 2024-03-18T14:43:23.422 INFO:tasks.workunit.client.0.smithi087.stdout:5/817: rmdir d13/d1b/d27 39 2024-03-18T14:43:23.423 INFO:tasks.workunit.client.1.smithi129.stdout:7/626: link d4/d7/d38/d61/f97 d4/d7/fc3 0 2024-03-18T14:43:23.428 INFO:tasks.workunit.client.1.smithi129.stdout:6/645: sync 2024-03-18T14:43:23.430 INFO:tasks.workunit.client.0.smithi087.stdout:3/811: rename d0/d72/f8a to d0/de/d30/d60/ddb/fe9 0 2024-03-18T14:43:23.432 INFO:tasks.workunit.client.1.smithi129.stdout:0/649: fdatasync d0/d23/d71/fc3 0 2024-03-18T14:43:23.433 INFO:tasks.workunit.client.0.smithi087.stdout:6/752: creat d3/d7/d25/d62/d7c/d29/ffe x:0 0 0 2024-03-18T14:43:23.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/570: write d0/fa7 [768876,6393] 0 2024-03-18T14:43:23.434 INFO:tasks.workunit.client.0.smithi087.stdout:4/745: dwrite d2/db/d24/f33 [4194304,4194304] 0 2024-03-18T14:43:23.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/571: read d0/d19/d46/d3e/d21/d32/f83 [3014894,23357] 0 2024-03-18T14:43:23.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/608: truncate d0/db/d1f/d20/d26/d19/f6a 956957 0 2024-03-18T14:43:23.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/597: getdents d4/d38/da3/db1 0 2024-03-18T14:43:23.437 INFO:tasks.workunit.client.0.smithi087.stdout:2/815: creat d2/ddd/d22/d24/f10c x:0 0 0 2024-03-18T14:43:23.437 INFO:tasks.workunit.client.0.smithi087.stdout:3/812: rmdir d0/d72 39 2024-03-18T14:43:23.437 INFO:tasks.workunit.client.1.smithi129.stdout:3/598: write d4/dd/f45 [323566,56693] 0 2024-03-18T14:43:23.437 INFO:tasks.workunit.client.0.smithi087.stdout:5/818: mknod d13/d1b/d27/d98/dc2/c114 0 2024-03-18T14:43:23.439 INFO:tasks.workunit.client.0.smithi087.stdout:6/753: symlink d3/d7/d25/d62/d7c/d29/d22/d23/lff 0 2024-03-18T14:43:23.440 INFO:tasks.workunit.client.1.smithi129.stdout:8/673: getdents d9/d11/d1a/d32/d41/d4d 0 2024-03-18T14:43:23.440 INFO:tasks.workunit.client.0.smithi087.stdout:4/746: creat d2/db/d24/d30/d7b/dbe/dcf/ff4 x:0 0 0 2024-03-18T14:43:23.441 INFO:tasks.workunit.client.0.smithi087.stdout:4/747: readlink d2/db/lb5 0 2024-03-18T14:43:23.443 INFO:tasks.workunit.client.0.smithi087.stdout:0/788: truncate d0/d2/d3c/d73/fc6 492747 0 2024-03-18T14:43:23.443 INFO:tasks.workunit.client.1.smithi129.stdout:3/599: mknod d4/dd/d1f/d5f/ccc 0 2024-03-18T14:43:23.444 INFO:tasks.workunit.client.0.smithi087.stdout:2/816: dwrite d2/ddd/f6a [0,4194304] 0 2024-03-18T14:43:23.444 INFO:tasks.workunit.client.0.smithi087.stdout:3/813: dread d0/d3/df/f50 [0,4194304] 0 2024-03-18T14:43:23.444 INFO:tasks.workunit.client.1.smithi129.stdout:3/600: write d4/d11/d34/d53/f80 [3627948,118084] 0 2024-03-18T14:43:23.445 INFO:tasks.workunit.client.0.smithi087.stdout:4/748: write d2/db/d24/d30/d7b/ff2 [429593,67184] 0 2024-03-18T14:43:23.445 INFO:tasks.workunit.client.1.smithi129.stdout:7/627: link d4/d2d/d2e/d42/d58/f60 d4/d2d/d2e/d45/fc4 0 2024-03-18T14:43:23.445 INFO:tasks.workunit.client.0.smithi087.stdout:5/819: dwrite d13/d1b/d27/d28/f77 [0,4194304] 0 2024-03-18T14:43:23.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/749: write d2/d13/fe2 [130884,84868] 0 2024-03-18T14:43:23.447 INFO:tasks.workunit.client.1.smithi129.stdout:2/635: sync 2024-03-18T14:43:23.448 INFO:tasks.workunit.client.1.smithi129.stdout:2/636: chown d7/d1c/d32/f75 20 1 2024-03-18T14:43:23.449 INFO:tasks.workunit.client.1.smithi129.stdout:9/609: dread d0/db/fd [0,4194304] 0 2024-03-18T14:43:23.449 INFO:tasks.workunit.client.0.smithi087.stdout:9/886: link db/d31/c67 db/d18/d1c/d69/c131 0 2024-03-18T14:43:23.450 INFO:tasks.workunit.client.0.smithi087.stdout:9/887: chown db/f68 429 1 2024-03-18T14:43:23.451 INFO:tasks.workunit.client.1.smithi129.stdout:7/628: dread d4/d2d/d2e/f5a [0,4194304] 0 2024-03-18T14:43:23.451 INFO:tasks.workunit.client.1.smithi129.stdout:2/637: stat d7/d1f/d20/d36/da9/dc1/da5 0 2024-03-18T14:43:23.451 INFO:tasks.workunit.client.1.smithi129.stdout:7/629: stat d4/d8c/c7d 0 2024-03-18T14:43:23.451 INFO:tasks.workunit.client.0.smithi087.stdout:3/814: mkdir d0/d3/d7a/dea 0 2024-03-18T14:43:23.454 INFO:tasks.workunit.client.1.smithi129.stdout:2/638: dwrite d7/d1f/d20/d2b/d41/d65/d88/f8a [0,4194304] 0 2024-03-18T14:43:23.456 INFO:tasks.workunit.client.0.smithi087.stdout:7/871: sync 2024-03-18T14:43:23.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/844: sync 2024-03-18T14:43:23.456 INFO:tasks.workunit.client.1.smithi129.stdout:5/590: truncate d0/dc/f5b 2497865 0 2024-03-18T14:43:23.457 INFO:tasks.workunit.client.1.smithi129.stdout:6/646: truncate d3/d5/fa6 2125842 0 2024-03-18T14:43:23.457 INFO:tasks.workunit.client.1.smithi129.stdout:0/650: mkdir d0/d14/dca 0 2024-03-18T14:43:23.458 INFO:tasks.workunit.client.0.smithi087.stdout:0/789: creat d0/d2/d4/d27/dc3/dd2/f112 x:0 0 0 2024-03-18T14:43:23.460 INFO:tasks.workunit.client.1.smithi129.stdout:3/601: symlink d4/d11/d34/d53/d87/lcd 0 2024-03-18T14:43:23.461 INFO:tasks.workunit.client.0.smithi087.stdout:0/790: read d0/d2/d4/de8/dad/dea/f40 [3232313,13239] 0 2024-03-18T14:43:23.461 INFO:tasks.workunit.client.0.smithi087.stdout:0/791: chown d0/d2/d4/d19/f25 10441 1 2024-03-18T14:43:23.463 INFO:tasks.workunit.client.0.smithi087.stdout:5/820: dwrite d13/d1b/d7e/fa2 [0,4194304] 0 2024-03-18T14:43:23.463 INFO:tasks.workunit.client.0.smithi087.stdout:0/792: chown d0/d2/d4/d19/d5a/fde 4 1 2024-03-18T14:43:23.464 INFO:tasks.workunit.client.0.smithi087.stdout:5/821: write d13/d1b/d70/fb0 [5206029,101418] 0 2024-03-18T14:43:23.464 INFO:tasks.workunit.client.0.smithi087.stdout:4/750: mkdir d2/db/de/df5 0 2024-03-18T14:43:23.464 INFO:tasks.workunit.client.0.smithi087.stdout:6/754: unlink d3/d7/d25/l60 0 2024-03-18T14:43:23.465 INFO:tasks.workunit.client.1.smithi129.stdout:9/610: mknod d0/db/d2e/cc3 0 2024-03-18T14:43:23.465 INFO:tasks.workunit.client.0.smithi087.stdout:5/822: stat d13/d1b/d27/ffe 0 2024-03-18T14:43:23.465 INFO:tasks.workunit.client.0.smithi087.stdout:4/751: readlink d2/db/d24/d30/d49/d4f/l5a 0 2024-03-18T14:43:23.466 INFO:tasks.workunit.client.0.smithi087.stdout:9/888: rename db/d18/d3a/c101 to db/d18/d1e/d28/d76/db7/dd5/c132 0 2024-03-18T14:43:23.467 INFO:tasks.workunit.client.0.smithi087.stdout:3/815: fdatasync d0/d3/df/f7d 0 2024-03-18T14:43:23.467 INFO:tasks.workunit.client.1.smithi129.stdout:2/639: rename d7/d1f/d20/d36/fb9 to d7/d3f/fcb 0 2024-03-18T14:43:23.468 INFO:tasks.workunit.client.0.smithi087.stdout:9/889: stat db/d18/d1c/f50 0 2024-03-18T14:43:23.468 INFO:tasks.workunit.client.1.smithi129.stdout:5/591: rename d0/d32/d34/d6c to d0/d32/d34/d6c/db1 22 2024-03-18T14:43:23.468 INFO:tasks.workunit.client.1.smithi129.stdout:6/647: read - d3/d5/f71 zero size 2024-03-18T14:43:23.469 INFO:tasks.workunit.client.0.smithi087.stdout:7/872: mkdir d1/d6/da/d42/d12a 0 2024-03-18T14:43:23.469 INFO:tasks.workunit.client.1.smithi129.stdout:0/651: creat d0/d23/d71/dc2/d4a/d61/fcb x:0 0 0 2024-03-18T14:43:23.473 INFO:tasks.workunit.client.1.smithi129.stdout:4/572: truncate d0/d9/d4c/f6d 1215723 0 2024-03-18T14:43:23.474 INFO:tasks.workunit.client.1.smithi129.stdout:1/622: getdents d1/d2/d28/d65/d7c 0 2024-03-18T14:43:23.474 INFO:tasks.workunit.client.1.smithi129.stdout:4/573: fsync d0/d9/d4c/f90 0 2024-03-18T14:43:23.474 INFO:tasks.workunit.client.0.smithi087.stdout:6/755: mkdir d3/d7/d25/d100 0 2024-03-18T14:43:23.475 INFO:tasks.workunit.client.1.smithi129.stdout:3/602: creat d4/dd/d1f/fce x:0 0 0 2024-03-18T14:43:23.475 INFO:tasks.workunit.client.0.smithi087.stdout:4/752: mknod d2/db/d24/d30/d7b/dbe/ddc/cf6 0 2024-03-18T14:43:23.475 INFO:tasks.workunit.client.0.smithi087.stdout:6/756: chown d3/d7/d25/d62/d7c/d46/cbf 101 1 2024-03-18T14:43:23.476 INFO:tasks.workunit.client.1.smithi129.stdout:1/623: read - d1/d2/d70/fbb zero size 2024-03-18T14:43:23.476 INFO:tasks.workunit.client.1.smithi129.stdout:3/603: chown d4/d11/d1d/d50/d91 640995 1 2024-03-18T14:43:23.477 INFO:tasks.workunit.client.1.smithi129.stdout:1/624: fsync d1/d2/d70/f9f 0 2024-03-18T14:43:23.478 INFO:tasks.workunit.client.1.smithi129.stdout:1/625: write d1/d2/d70/f9f [530351,9421] 0 2024-03-18T14:43:23.479 INFO:tasks.workunit.client.0.smithi087.stdout:8/778: sync 2024-03-18T14:43:23.479 INFO:tasks.workunit.client.0.smithi087.stdout:7/873: creat d1/d6/da/d59/dbe/d11a/d95/f12b x:0 0 0 2024-03-18T14:43:23.480 INFO:tasks.workunit.client.0.smithi087.stdout:8/779: write d1/d6/d8d/fed [578177,105202] 0 2024-03-18T14:43:23.480 INFO:tasks.workunit.client.0.smithi087.stdout:3/816: dread d0/de/d30/d46/f61 [0,4194304] 0 2024-03-18T14:43:23.483 INFO:tasks.workunit.client.1.smithi129.stdout:7/630: dread d4/d2d/d2e/f73 [0,4194304] 0 2024-03-18T14:43:23.484 INFO:tasks.workunit.client.1.smithi129.stdout:7/631: fdatasync d4/d83/fbb 0 2024-03-18T14:43:23.484 INFO:tasks.workunit.client.1.smithi129.stdout:9/611: mknod d0/db/d1f/dae/cc4 0 2024-03-18T14:43:23.486 INFO:tasks.workunit.client.1.smithi129.stdout:2/640: creat d7/d1f/d81/fcc x:0 0 0 2024-03-18T14:43:23.487 INFO:tasks.workunit.client.1.smithi129.stdout:6/648: dread d3/d30/f66 [0,4194304] 0 2024-03-18T14:43:23.488 INFO:tasks.workunit.client.0.smithi087.stdout:2/817: rmdir d2/ddd/d5a/ded/df3 0 2024-03-18T14:43:23.488 INFO:tasks.workunit.client.1.smithi129.stdout:2/641: stat d7/c68 0 2024-03-18T14:43:23.489 INFO:tasks.workunit.client.0.smithi087.stdout:1/845: dwrite d3/d1d/f3d [0,4194304] 0 2024-03-18T14:43:23.491 INFO:tasks.workunit.client.1.smithi129.stdout:8/674: link d9/f1b d9/d33/dc2/ddc/fe3 0 2024-03-18T14:43:23.491 INFO:tasks.workunit.client.1.smithi129.stdout:9/612: symlink d0/db/d1f/d20/d25/lc5 0 2024-03-18T14:43:23.493 INFO:tasks.workunit.client.1.smithi129.stdout:5/592: dwrite d0/f67 [0,4194304] 0 2024-03-18T14:43:23.493 INFO:tasks.workunit.client.0.smithi087.stdout:9/890: dread db/d18/d1e/d28/d7c/f107 [0,4194304] 0 2024-03-18T14:43:23.493 INFO:tasks.workunit.client.0.smithi087.stdout:9/891: fsync db/d18/d51/d8f/fdb 0 2024-03-18T14:43:23.494 INFO:tasks.workunit.client.1.smithi129.stdout:8/675: write d9/f1f [4857803,50306] 0 2024-03-18T14:43:23.494 INFO:tasks.workunit.client.0.smithi087.stdout:0/793: mkdir d0/dab/d113 0 2024-03-18T14:43:23.495 INFO:tasks.workunit.client.0.smithi087.stdout:4/753: mknod d2/db/d84/cf7 0 2024-03-18T14:43:23.496 INFO:tasks.workunit.client.1.smithi129.stdout:9/613: read d0/f10 [2087321,5326] 0 2024-03-18T14:43:23.497 INFO:tasks.workunit.client.1.smithi129.stdout:5/593: write d0/dc/d22/f1e [174900,118192] 0 2024-03-18T14:43:23.498 INFO:tasks.workunit.client.1.smithi129.stdout:7/632: truncate d4/d2d/d2e/d45/f5e 588761 0 2024-03-18T14:43:23.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/874: creat d1/d6/da/d42/d61/f12c x:0 0 0 2024-03-18T14:43:23.498 INFO:tasks.workunit.client.1.smithi129.stdout:6/649: dwrite d3/d30/de/f2e [0,4194304] 0 2024-03-18T14:43:23.499 INFO:tasks.workunit.client.0.smithi087.stdout:0/794: dwrite d0/d1a/d80/d88/f15 [0,4194304] 0 2024-03-18T14:43:23.499 INFO:tasks.workunit.client.0.smithi087.stdout:3/817: mknod d0/de/d30/dc5/ceb 0 2024-03-18T14:43:23.500 INFO:tasks.workunit.client.1.smithi129.stdout:2/642: dwrite d7/d1c/fb1 [0,4194304] 0 2024-03-18T14:43:23.502 INFO:tasks.workunit.client.1.smithi129.stdout:7/633: stat d4/d7/d38/d61/d6a/la9 0 2024-03-18T14:43:23.502 INFO:tasks.workunit.client.0.smithi087.stdout:1/846: symlink d3/d1d/d1f/d63/l104 0 2024-03-18T14:43:23.504 INFO:tasks.workunit.client.0.smithi087.stdout:5/823: truncate d13/d1b/d27/d28/d9a/fcb 752340 0 2024-03-18T14:43:23.506 INFO:tasks.workunit.client.1.smithi129.stdout:1/626: dwrite d1/d35/f4c [0,4194304] 0 2024-03-18T14:43:23.506 INFO:tasks.workunit.client.1.smithi129.stdout:0/652: sync 2024-03-18T14:43:23.506 INFO:tasks.workunit.client.0.smithi087.stdout:9/892: symlink db/d18/d1e/d28/d76/db7/dd5/l133 0 2024-03-18T14:43:23.507 INFO:tasks.workunit.client.1.smithi129.stdout:6/650: creat d3/d6/d7f/fd3 x:0 0 0 2024-03-18T14:43:23.507 INFO:tasks.workunit.client.1.smithi129.stdout:8/676: dwrite d9/f1f [0,4194304] 0 2024-03-18T14:43:23.508 INFO:tasks.workunit.client.1.smithi129.stdout:1/627: readlink d1/d2/d28/d65/d19/l57 0 2024-03-18T14:43:23.510 INFO:tasks.workunit.client.1.smithi129.stdout:5/594: rename d0/dc/d22/l42 to d0/dc/d4c/lb2 0 2024-03-18T14:43:23.510 INFO:tasks.workunit.client.1.smithi129.stdout:4/574: link d0/d19/d46/d3e/d21/d4d/c87 d0/d19/d46/d3e/d21/d4d/d70/cb7 0 2024-03-18T14:43:23.510 INFO:tasks.workunit.client.1.smithi129.stdout:9/614: dwrite d0/db/d1f/d4c/d57/fa3 [0,4194304] 0 2024-03-18T14:43:23.511 INFO:tasks.workunit.client.0.smithi087.stdout:4/754: creat d2/db/d24/d30/d8a/ff8 x:0 0 0 2024-03-18T14:43:23.512 INFO:tasks.workunit.client.0.smithi087.stdout:7/875: mkdir d1/d6/d16/dc/ddc/d12d 0 2024-03-18T14:43:23.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/595: stat d0/d32/d3a/d52 0 2024-03-18T14:43:23.513 INFO:tasks.workunit.client.0.smithi087.stdout:8/780: symlink d1/d6/d2f/d44/d45/d71/dec/l101 0 2024-03-18T14:43:23.513 INFO:tasks.workunit.client.0.smithi087.stdout:7/876: write d1/d6/da/d42/d67/fd6 [1605739,12582] 0 2024-03-18T14:43:23.513 INFO:tasks.workunit.client.1.smithi129.stdout:9/615: write d0/db/f1d [1007992,80429] 0 2024-03-18T14:43:23.515 INFO:tasks.workunit.client.1.smithi129.stdout:2/643: dwrite d7/d3f/d5f/f8e [4194304,4194304] 0 2024-03-18T14:43:23.516 INFO:tasks.workunit.client.1.smithi129.stdout:0/653: rename d0/d6c/l75 to d0/d6c/lcc 0 2024-03-18T14:43:23.517 INFO:tasks.workunit.client.1.smithi129.stdout:0/654: fsync d0/d23/d35/d50/f7d 0 2024-03-18T14:43:23.518 INFO:tasks.workunit.client.0.smithi087.stdout:1/847: creat d3/d1d/d1f/dab/f105 x:0 0 0 2024-03-18T14:43:23.518 INFO:tasks.workunit.client.0.smithi087.stdout:5/824: symlink d13/d1b/d7e/dfc/l115 0 2024-03-18T14:43:23.521 INFO:tasks.workunit.client.0.smithi087.stdout:2/818: dread d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fbe [0,4194304] 0 2024-03-18T14:43:23.522 INFO:tasks.workunit.client.1.smithi129.stdout:3/604: dread d4/d11/d1d/d50/d90/fb6 [0,4194304] 0 2024-03-18T14:43:23.524 INFO:tasks.workunit.client.1.smithi129.stdout:6/651: rename d3/d30/de/f22 to d3/d30/fd4 0 2024-03-18T14:43:23.526 INFO:tasks.workunit.client.0.smithi087.stdout:8/781: creat d1/d6/d8d/dc2/f102 x:0 0 0 2024-03-18T14:43:23.526 INFO:tasks.workunit.client.0.smithi087.stdout:1/848: creat d3/dbf/f106 x:0 0 0 2024-03-18T14:43:23.527 INFO:tasks.workunit.client.0.smithi087.stdout:4/755: symlink d2/db/d3c/lf9 0 2024-03-18T14:43:23.529 INFO:tasks.workunit.client.1.smithi129.stdout:7/634: read d4/d7/d8/f3d [1961873,105475] 0 2024-03-18T14:43:23.530 INFO:tasks.workunit.client.1.smithi129.stdout:2/644: mkdir d7/d1f/d20/d36/da9/dcd 0 2024-03-18T14:43:23.531 INFO:tasks.workunit.client.1.smithi129.stdout:2/645: readlink d7/d1c/d32/l47 0 2024-03-18T14:43:23.532 INFO:tasks.workunit.client.0.smithi087.stdout:2/819: rename d2/ddd/d22/d2c/d3a/fcf to d2/d44/d72/d8a/f10d 0 2024-03-18T14:43:23.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/655: mkdir d0/d23/d71/dcd 0 2024-03-18T14:43:23.533 INFO:tasks.workunit.client.1.smithi129.stdout:0/656: write d0/d14/f20 [3729096,15876] 0 2024-03-18T14:43:23.534 INFO:tasks.workunit.client.0.smithi087.stdout:7/877: truncate d1/d97/db9/ff5 919548 0 2024-03-18T14:43:23.535 INFO:tasks.workunit.client.1.smithi129.stdout:5/596: link d0/f9 d0/dc/d18/d2b/fb3 0 2024-03-18T14:43:23.535 INFO:tasks.workunit.client.0.smithi087.stdout:7/878: write d1/d6/d29/d2f/d68/d65/d60/f102 [805553,18301] 0 2024-03-18T14:43:23.537 INFO:tasks.workunit.client.1.smithi129.stdout:7/635: mknod d4/d7/d38/d61/cc5 0 2024-03-18T14:43:23.538 INFO:tasks.workunit.client.1.smithi129.stdout:5/597: dread d0/df/f44 [0,4194304] 0 2024-03-18T14:43:23.539 INFO:tasks.workunit.client.1.smithi129.stdout:2/646: symlink d7/d1f/d20/d2b/lce 0 2024-03-18T14:43:23.539 INFO:tasks.workunit.client.1.smithi129.stdout:5/598: readlink d0/dc/d18/l2a 0 2024-03-18T14:43:23.542 INFO:tasks.workunit.client.1.smithi129.stdout:5/599: read d0/d32/d34/f4d [829964,116853] 0 2024-03-18T14:43:23.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/849: fsync d3/d1d/d1e/d43/dfb/dc8/fd9 0 2024-03-18T14:43:23.543 INFO:tasks.workunit.client.1.smithi129.stdout:0/657: creat d0/d14/d53/fce x:0 0 0 2024-03-18T14:43:23.545 INFO:tasks.workunit.client.1.smithi129.stdout:1/628: getdents d1 0 2024-03-18T14:43:23.545 INFO:tasks.workunit.client.0.smithi087.stdout:5/825: dread d13/d1b/d27/f34 [0,4194304] 0 2024-03-18T14:43:23.546 INFO:tasks.workunit.client.1.smithi129.stdout:5/600: dread d0/dc/f4e [0,4194304] 0 2024-03-18T14:43:23.546 INFO:tasks.workunit.client.0.smithi087.stdout:2/820: symlink d2/ddd/d22/d2c/d3a/d40/d4a/l10e 0 2024-03-18T14:43:23.546 INFO:tasks.workunit.client.1.smithi129.stdout:5/601: chown d0/df/l10 1168 1 2024-03-18T14:43:23.547 INFO:tasks.workunit.client.0.smithi087.stdout:1/850: fdatasync d3/d1d/d1f/f5d 0 2024-03-18T14:43:23.551 INFO:tasks.workunit.client.0.smithi087.stdout:2/821: unlink d2/f1d 0 2024-03-18T14:43:23.552 INFO:tasks.workunit.client.0.smithi087.stdout:9/893: sync 2024-03-18T14:43:23.553 INFO:tasks.workunit.client.0.smithi087.stdout:3/818: dread d0/de/d30/f7c [0,4194304] 0 2024-03-18T14:43:23.555 INFO:tasks.workunit.client.1.smithi129.stdout:8/677: dread d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:23.556 INFO:tasks.workunit.client.0.smithi087.stdout:2/822: dwrite d2/ddd/d22/d2c/d3a/d40/fbc [0,4194304] 0 2024-03-18T14:43:23.557 INFO:tasks.workunit.client.1.smithi129.stdout:1/629: dwrite d1/d2/d28/d65/d7c/d7d/d80/f83 [0,4194304] 0 2024-03-18T14:43:23.557 INFO:tasks.workunit.client.1.smithi129.stdout:1/630: readlink d1/d2/d28/l47 0 2024-03-18T14:43:23.558 INFO:tasks.workunit.client.0.smithi087.stdout:6/757: truncate d3/d7/d25/d62/d7c/d29/d22/f2c 934420 0 2024-03-18T14:43:23.559 INFO:tasks.workunit.client.1.smithi129.stdout:5/602: truncate d0/dc/d18/d2b/f81 663093 0 2024-03-18T14:43:23.560 INFO:tasks.workunit.client.1.smithi129.stdout:5/603: dread - d0/dc/d18/d2b/d8c/f92 zero size 2024-03-18T14:43:23.560 INFO:tasks.workunit.client.0.smithi087.stdout:5/826: mknod d13/d1b/d7e/c116 0 2024-03-18T14:43:23.562 INFO:tasks.workunit.client.0.smithi087.stdout:5/827: dread d13/f16 [0,4194304] 0 2024-03-18T14:43:23.563 INFO:tasks.workunit.client.0.smithi087.stdout:0/795: write d0/d2/d4/de8/dad/dea/da3/da8/fcc [1402699,121930] 0 2024-03-18T14:43:23.564 INFO:tasks.workunit.client.0.smithi087.stdout:5/828: chown d13/d1b/d27/d28/d9a/df0/lfa 24899478 1 2024-03-18T14:43:23.564 INFO:tasks.workunit.client.0.smithi087.stdout:0/796: chown d0/d2/d4/d27/dc3/f10e 38 1 2024-03-18T14:43:23.565 INFO:tasks.workunit.client.0.smithi087.stdout:5/829: write d13/d1b/d27/d35/fb3 [1992610,24386] 0 2024-03-18T14:43:23.565 INFO:tasks.workunit.client.0.smithi087.stdout:0/797: chown d0/d2/d4/f4c 711053277 1 2024-03-18T14:43:23.566 INFO:tasks.workunit.client.1.smithi129.stdout:4/575: dwrite d0/d19/d46/d3e/d21/d32/f83 [0,4194304] 0 2024-03-18T14:43:23.567 INFO:tasks.workunit.client.1.smithi129.stdout:7/636: rename d4/d7 to d4/d2d/d2e/d79/dc6 0 2024-03-18T14:43:23.569 INFO:tasks.workunit.client.0.smithi087.stdout:8/782: dwrite d1/d6/d2f/d44/f75 [0,4194304] 0 2024-03-18T14:43:23.569 INFO:tasks.workunit.client.1.smithi129.stdout:0/658: truncate d0/d23/d35/d3b/d42/f7b 1926773 0 2024-03-18T14:43:23.572 INFO:tasks.workunit.client.1.smithi129.stdout:4/576: dwrite d0/d9/d6a/d7b/fa6 [0,4194304] 0 2024-03-18T14:43:23.572 INFO:tasks.workunit.client.1.smithi129.stdout:1/631: mkdir d1/d2/d70/d87/dc0 0 2024-03-18T14:43:23.572 INFO:tasks.workunit.client.0.smithi087.stdout:7/879: dwrite d1/d97/db9/f10e [0,4194304] 0 2024-03-18T14:43:23.573 INFO:tasks.workunit.client.1.smithi129.stdout:5/604: dread d0/df/f66 [0,4194304] 0 2024-03-18T14:43:23.575 INFO:tasks.workunit.client.0.smithi087.stdout:9/894: rmdir db/d18/d1e/d28/d76/d80 39 2024-03-18T14:43:23.575 INFO:tasks.workunit.client.1.smithi129.stdout:7/637: write f3 [429939,122304] 0 2024-03-18T14:43:23.576 INFO:tasks.workunit.client.0.smithi087.stdout:3/819: creat d0/de/d30/d67/fec x:0 0 0 2024-03-18T14:43:23.577 INFO:tasks.workunit.client.1.smithi129.stdout:4/577: mknod d0/d3c/cb8 0 2024-03-18T14:43:23.578 INFO:tasks.workunit.client.0.smithi087.stdout:2/823: mkdir d2/ddd/d5a/d10f 0 2024-03-18T14:43:23.579 INFO:tasks.workunit.client.0.smithi087.stdout:4/756: sync 2024-03-18T14:43:23.580 INFO:tasks.workunit.client.1.smithi129.stdout:0/659: symlink d0/d23/d71/dc2/d4a/d7a/lcf 0 2024-03-18T14:43:23.580 INFO:tasks.workunit.client.0.smithi087.stdout:4/757: write d2/db/d84/d87/f9a [357303,91188] 0 2024-03-18T14:43:23.580 INFO:tasks.workunit.client.0.smithi087.stdout:4/758: stat d2/db/l83 0 2024-03-18T14:43:23.581 INFO:tasks.workunit.client.1.smithi129.stdout:7/638: creat d4/d2d/d2e/d79/dc6/d8/d3b/fc7 x:0 0 0 2024-03-18T14:43:23.582 INFO:tasks.workunit.client.0.smithi087.stdout:6/758: dread - d3/d7/d25/d62/d7c/da0/dbe/fd6 zero size 2024-03-18T14:43:23.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/647: dread d7/d1f/d20/d36/da9/fb4 [0,4194304] 0 2024-03-18T14:43:23.585 INFO:tasks.workunit.client.1.smithi129.stdout:0/660: dwrite d0/d14/d91/fc7 [0,4194304] 0 2024-03-18T14:43:23.587 INFO:tasks.workunit.client.1.smithi129.stdout:5/605: rename d0/f14 to d0/d32/d3a/fb4 0 2024-03-18T14:43:23.588 INFO:tasks.workunit.client.1.smithi129.stdout:7/639: symlink d4/d2d/d2e/d42/d58/lc8 0 2024-03-18T14:43:23.588 INFO:tasks.workunit.client.0.smithi087.stdout:7/880: read d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f124 [605279,109285] 0 2024-03-18T14:43:23.588 INFO:tasks.workunit.client.0.smithi087.stdout:0/798: creat d0/d2/d4/d8b/f114 x:0 0 0 2024-03-18T14:43:23.590 INFO:tasks.workunit.client.0.smithi087.stdout:8/783: mkdir d1/d6/d103 0 2024-03-18T14:43:23.594 INFO:tasks.workunit.client.0.smithi087.stdout:9/895: mknod db/d12/c134 0 2024-03-18T14:43:23.595 INFO:tasks.workunit.client.1.smithi129.stdout:8/678: dwrite d9/d11/d1a/d32/d41/f52 [0,4194304] 0 2024-03-18T14:43:23.595 INFO:tasks.workunit.client.1.smithi129.stdout:1/632: getdents d1/d2/d70/d87/d8c 0 2024-03-18T14:43:23.596 INFO:tasks.workunit.client.1.smithi129.stdout:1/633: stat d1/c13 0 2024-03-18T14:43:23.597 INFO:tasks.workunit.client.0.smithi087.stdout:4/759: mknod d2/db/d67/cfa 0 2024-03-18T14:43:23.597 INFO:tasks.workunit.client.1.smithi129.stdout:3/605: sync 2024-03-18T14:43:23.598 INFO:tasks.workunit.client.1.smithi129.stdout:9/616: sync 2024-03-18T14:43:23.600 INFO:tasks.workunit.client.0.smithi087.stdout:4/760: dread d2/f21 [0,4194304] 0 2024-03-18T14:43:23.600 INFO:tasks.workunit.client.1.smithi129.stdout:2/648: creat d7/d3f/d5f/fcf x:0 0 0 2024-03-18T14:43:23.603 INFO:tasks.workunit.client.1.smithi129.stdout:5/606: creat d0/fb5 x:0 0 0 2024-03-18T14:43:23.604 INFO:tasks.workunit.client.1.smithi129.stdout:7/640: mknod d4/d2d/d2e/d79/cc9 0 2024-03-18T14:43:23.605 INFO:tasks.workunit.client.1.smithi129.stdout:6/652: getdents d3/d30/de/da9 0 2024-03-18T14:43:23.606 INFO:tasks.workunit.client.1.smithi129.stdout:1/634: symlink d1/d35/d7a/lc1 0 2024-03-18T14:43:23.606 INFO:tasks.workunit.client.0.smithi087.stdout:2/824: symlink d2/ddd/d22/d2c/d3a/d49/l110 0 2024-03-18T14:43:23.607 INFO:tasks.workunit.client.1.smithi129.stdout:3/606: creat d4/dd/d1f/d5f/d31/fcf x:0 0 0 2024-03-18T14:43:23.607 INFO:tasks.workunit.client.0.smithi087.stdout:3/820: symlink d0/d72/d85/led 0 2024-03-18T14:43:23.608 INFO:tasks.workunit.client.1.smithi129.stdout:9/617: creat d0/db/d1f/d20/d6c/fc6 x:0 0 0 2024-03-18T14:43:23.608 INFO:tasks.workunit.client.0.smithi087.stdout:4/761: mkdir d2/db/de/dfb 0 2024-03-18T14:43:23.609 INFO:tasks.workunit.client.0.smithi087.stdout:4/762: stat d2/db/d24/d30/d56/l9f 0 2024-03-18T14:43:23.609 INFO:tasks.workunit.client.0.smithi087.stdout:0/799: fsync d0/f16 0 2024-03-18T14:43:23.610 INFO:tasks.workunit.client.0.smithi087.stdout:2/825: write d2/ddd/d22/d2c/d3a/d49/fa3 [4173170,80479] 0 2024-03-18T14:43:23.611 INFO:tasks.workunit.client.0.smithi087.stdout:5/830: dread d13/d1b/d70/fad [0,4194304] 0 2024-03-18T14:43:23.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/821: dread d0/d3/df/f4d [0,4194304] 0 2024-03-18T14:43:23.612 INFO:tasks.workunit.client.1.smithi129.stdout:0/661: write d0/d14/d91/fc7 [4123648,95421] 0 2024-03-18T14:43:23.612 INFO:tasks.workunit.client.0.smithi087.stdout:3/822: chown d0/d1c 10657902 1 2024-03-18T14:43:23.612 INFO:tasks.workunit.client.0.smithi087.stdout:2/826: dread - d2/ddd/d22/d2c/d3a/d40/d98/dd8/fef zero size 2024-03-18T14:43:23.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/759: rename d3/f6 to d3/d7/d25/d62/d7c/da0/dbe/f101 0 2024-03-18T14:43:23.616 INFO:tasks.workunit.client.1.smithi129.stdout:2/649: creat d7/d1f/d20/d2b/d41/d65/d88/fd0 x:0 0 0 2024-03-18T14:43:23.617 INFO:tasks.workunit.client.1.smithi129.stdout:2/650: read - d7/d1f/d20/d2b/d41/d65/fc7 zero size 2024-03-18T14:43:23.618 INFO:tasks.workunit.client.0.smithi087.stdout:2/827: dwrite d2/ddd/d22/d2c/d3a/d40/f8f [0,4194304] 0 2024-03-18T14:43:23.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/635: dread d1/d2/d70/f9f [0,4194304] 0 2024-03-18T14:43:23.620 INFO:tasks.workunit.client.0.smithi087.stdout:0/800: rmdir d0/d2/d4/d27/dc3/dd2 39 2024-03-18T14:43:23.621 INFO:tasks.workunit.client.1.smithi129.stdout:6/653: fsync d3/d30/f7d 0 2024-03-18T14:43:23.622 INFO:tasks.workunit.client.1.smithi129.stdout:4/578: write d0/d3c/d6c/d89/f9b [4291596,127678] 0 2024-03-18T14:43:23.622 INFO:tasks.workunit.client.1.smithi129.stdout:6/654: read d3/d30/de/d6c/f60 [23497,58717] 0 2024-03-18T14:43:23.623 INFO:tasks.workunit.client.1.smithi129.stdout:4/579: dread - d0/d9/f9a zero size 2024-03-18T14:43:23.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/896: dread db/d18/f2a [0,4194304] 0 2024-03-18T14:43:23.625 INFO:tasks.workunit.client.0.smithi087.stdout:9/897: stat db/d18/d1c 0 2024-03-18T14:43:23.625 INFO:tasks.workunit.client.0.smithi087.stdout:1/851: truncate d3/d1d/d1e/d20/f52 5561962 0 2024-03-18T14:43:23.626 INFO:tasks.workunit.client.1.smithi129.stdout:8/679: creat d9/fe4 x:0 0 0 2024-03-18T14:43:23.626 INFO:tasks.workunit.client.0.smithi087.stdout:1/852: dread - d3/fb5 zero size 2024-03-18T14:43:23.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/618: getdents d0/db/d2e/da9 0 2024-03-18T14:43:23.630 INFO:tasks.workunit.client.1.smithi129.stdout:0/662: symlink d0/d23/d71/dcd/ld0 0 2024-03-18T14:43:23.632 INFO:tasks.workunit.client.1.smithi129.stdout:2/651: mkdir d7/d1f/dd1 0 2024-03-18T14:43:23.634 INFO:tasks.workunit.client.1.smithi129.stdout:4/580: unlink d0/d19/d46/d2e/fb5 0 2024-03-18T14:43:23.635 INFO:tasks.workunit.client.1.smithi129.stdout:9/619: write d0/db/d2e/f4b [2828340,87219] 0 2024-03-18T14:43:23.637 INFO:tasks.workunit.client.0.smithi087.stdout:3/823: rename d0/d3/d7a/f8f to d0/de/d30/d46/dc3/fee 0 2024-03-18T14:43:23.637 INFO:tasks.workunit.client.0.smithi087.stdout:7/881: dread d1/d6/da/d42/d61/d74/f8d [0,4194304] 0 2024-03-18T14:43:23.638 INFO:tasks.workunit.client.0.smithi087.stdout:3/824: chown d0/f28 8469271 1 2024-03-18T14:43:23.639 INFO:tasks.workunit.client.0.smithi087.stdout:5/831: dread d13/d1b/d30/f5b [0,4194304] 0 2024-03-18T14:43:23.639 INFO:tasks.workunit.client.1.smithi129.stdout:6/655: mkdir d3/d6/dd5 0 2024-03-18T14:43:23.639 INFO:tasks.workunit.client.1.smithi129.stdout:9/620: dwrite d0/db/d1f/d20/fbc [0,4194304] 0 2024-03-18T14:43:23.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/828: write d2/ddd/f34 [2002849,21412] 0 2024-03-18T14:43:23.641 INFO:tasks.workunit.client.0.smithi087.stdout:5/832: write d13/d1b/d70/dce/f106 [341154,36701] 0 2024-03-18T14:43:23.641 INFO:tasks.workunit.client.1.smithi129.stdout:5/607: getdents d0 0 2024-03-18T14:43:23.641 INFO:tasks.workunit.client.1.smithi129.stdout:7/641: truncate d4/f4f 1911945 0 2024-03-18T14:43:23.642 INFO:tasks.workunit.client.1.smithi129.stdout:1/636: write d1/d2/d28/d65/f30 [4268313,128370] 0 2024-03-18T14:43:23.642 INFO:tasks.workunit.client.0.smithi087.stdout:7/882: dwrite d1/d6/d29/d2f/d68/dbf/fe8 [0,4194304] 0 2024-03-18T14:43:23.642 INFO:tasks.workunit.client.1.smithi129.stdout:9/621: stat d0/db/d90/l65 0 2024-03-18T14:43:23.643 INFO:tasks.workunit.client.1.smithi129.stdout:5/608: dread - d0/d32/d3a/f62 zero size 2024-03-18T14:43:23.644 INFO:tasks.workunit.client.1.smithi129.stdout:3/607: truncate d4/d38/f2c 5550887 0 2024-03-18T14:43:23.647 INFO:tasks.workunit.client.1.smithi129.stdout:0/663: creat d0/d14/d91/fd1 x:0 0 0 2024-03-18T14:43:23.648 INFO:tasks.workunit.client.1.smithi129.stdout:5/609: dwrite d0/d32/d3a/d52/d69/d8a/fa7 [0,4194304] 0 2024-03-18T14:43:23.648 INFO:tasks.workunit.client.0.smithi087.stdout:7/883: dread d1/d6/d29/d2f/dac/f11b [0,4194304] 0 2024-03-18T14:43:23.649 INFO:tasks.workunit.client.1.smithi129.stdout:0/664: write d0/d23/d35/d3b/fad [707336,112343] 0 2024-03-18T14:43:23.649 INFO:tasks.workunit.client.1.smithi129.stdout:0/665: chown d0/f95 37648 1 2024-03-18T14:43:23.652 INFO:tasks.workunit.client.1.smithi129.stdout:7/642: mkdir d4/d2d/d2e/d45/dca 0 2024-03-18T14:43:23.653 INFO:tasks.workunit.client.1.smithi129.stdout:1/637: chown d1/d2/d28/c44 1958694901 1 2024-03-18T14:43:23.656 INFO:tasks.workunit.client.1.smithi129.stdout:2/652: mknod d7/d1f/d20/d36/dc0/cd2 0 2024-03-18T14:43:23.657 INFO:tasks.workunit.client.1.smithi129.stdout:2/653: write d7/d1c/fb1 [2497047,87879] 0 2024-03-18T14:43:23.657 INFO:tasks.workunit.client.1.smithi129.stdout:5/610: creat d0/d32/d3a/d52/d6e/fb6 x:0 0 0 2024-03-18T14:43:23.658 INFO:tasks.workunit.client.0.smithi087.stdout:7/884: dread d1/d6/da/f9f [0,4194304] 0 2024-03-18T14:43:23.658 INFO:tasks.workunit.client.1.smithi129.stdout:5/611: chown d0/f2 3601 1 2024-03-18T14:43:23.659 INFO:tasks.workunit.client.0.smithi087.stdout:7/885: chown d1/d6/d29/d2f/d68/d65/c38 2683 1 2024-03-18T14:43:23.659 INFO:tasks.workunit.client.1.smithi129.stdout:0/666: write d0/d23/f3f [300251,101085] 0 2024-03-18T14:43:23.661 INFO:tasks.workunit.client.1.smithi129.stdout:7/643: readlink d4/d2d/d2e/d45/la7 0 2024-03-18T14:43:23.662 INFO:tasks.workunit.client.1.smithi129.stdout:1/638: write d1/d2/d28/d65/d19/d52/fa2 [88453,61877] 0 2024-03-18T14:43:23.662 INFO:tasks.workunit.client.1.smithi129.stdout:9/622: truncate d0/db/d1f/d20/d26/d5f/f72 82109 0 2024-03-18T14:43:23.663 INFO:tasks.workunit.client.0.smithi087.stdout:7/886: dwrite d1/d6/da/d59/dbe/fd8 [0,4194304] 0 2024-03-18T14:43:23.663 INFO:tasks.workunit.client.1.smithi129.stdout:2/654: dwrite d7/d1f/d20/d2a/d6b/fb2 [0,4194304] 0 2024-03-18T14:43:23.666 INFO:tasks.workunit.client.1.smithi129.stdout:4/581: rmdir d0/d9/d6a/d7b/d9d 0 2024-03-18T14:43:23.667 INFO:tasks.workunit.client.0.smithi087.stdout:7/887: dwrite d1/d6/d29/d2f/d68/d65/d60/f7a [0,4194304] 0 2024-03-18T14:43:23.671 INFO:tasks.workunit.client.1.smithi129.stdout:5/612: dwrite d0/dc/d22/f35 [4194304,4194304] 0 2024-03-18T14:43:23.671 INFO:tasks.workunit.client.1.smithi129.stdout:4/582: dwrite d0/d19/d46/d3e/d33/f93 [0,4194304] 0 2024-03-18T14:43:23.673 INFO:tasks.workunit.client.1.smithi129.stdout:8/680: truncate d9/d11/d1a/d32/d3a/f8f 1292996 0 2024-03-18T14:43:23.674 INFO:tasks.workunit.client.0.smithi087.stdout:4/763: creat d2/db/ffc x:0 0 0 2024-03-18T14:43:23.674 INFO:tasks.workunit.client.0.smithi087.stdout:9/898: chown db/d18/d1e/d28/dc2/l10c 60 1 2024-03-18T14:43:23.675 INFO:tasks.workunit.client.0.smithi087.stdout:4/764: fsync f1 0 2024-03-18T14:43:23.675 INFO:tasks.workunit.client.0.smithi087.stdout:2/829: write d2/ddd/f19 [2373168,9346] 0 2024-03-18T14:43:23.677 INFO:tasks.workunit.client.0.smithi087.stdout:2/830: dread - d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/f106 zero size 2024-03-18T14:43:23.682 INFO:tasks.workunit.client.1.smithi129.stdout:6/656: creat d3/d6/fd6 x:0 0 0 2024-03-18T14:43:23.683 INFO:tasks.workunit.client.1.smithi129.stdout:7/644: symlink d4/d8c/lcb 0 2024-03-18T14:43:23.684 INFO:tasks.workunit.client.1.smithi129.stdout:9/623: chown d0/db/d1f/d20/d26/d19/c49 4 1 2024-03-18T14:43:23.685 INFO:tasks.workunit.client.0.smithi087.stdout:4/765: mknod d2/dc2/cfd 0 2024-03-18T14:43:23.686 INFO:tasks.workunit.client.1.smithi129.stdout:2/655: symlink d7/d3f/ld3 0 2024-03-18T14:43:23.689 INFO:tasks.workunit.client.0.smithi087.stdout:2/831: dwrite d2/ddd/d22/d2c/d3a/fc1 [0,4194304] 0 2024-03-18T14:43:23.691 INFO:tasks.workunit.client.1.smithi129.stdout:5/613: truncate d0/dc/f4e 1769119 0 2024-03-18T14:43:23.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/681: symlink d9/d11/d1a/d14/dc0/le5 0 2024-03-18T14:43:23.694 INFO:tasks.workunit.client.1.smithi129.stdout:8/682: dread - d9/d11/d1a/d32/d3a/d70/fd8 zero size 2024-03-18T14:43:23.694 INFO:tasks.workunit.client.0.smithi087.stdout:1/853: rename d3/d1d/d1f/d34/d38/dba to d3/d1d/d1f/d107 0 2024-03-18T14:43:23.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/899: symlink db/d18/d1e/l135 0 2024-03-18T14:43:23.695 INFO:tasks.workunit.client.0.smithi087.stdout:9/900: dread - db/d18/d3a/fdc zero size 2024-03-18T14:43:23.696 INFO:tasks.workunit.client.0.smithi087.stdout:9/901: write db/d18/d1e/dde/dce/fa9 [2959074,39143] 0 2024-03-18T14:43:23.697 INFO:tasks.workunit.client.0.smithi087.stdout:1/854: read d3/d1d/d1f/d34/f3e [7421542,51676] 0 2024-03-18T14:43:23.699 INFO:tasks.workunit.client.0.smithi087.stdout:4/766: unlink d2/db/d24/d30/d7b/ff2 0 2024-03-18T14:43:23.699 INFO:tasks.workunit.client.0.smithi087.stdout:8/784: rmdir d1/d6/d14/db2/dbc/dfa 0 2024-03-18T14:43:23.700 INFO:tasks.workunit.client.1.smithi129.stdout:9/624: fsync d0/d15/f42 0 2024-03-18T14:43:23.702 INFO:tasks.workunit.client.0.smithi087.stdout:0/801: sync 2024-03-18T14:43:23.702 INFO:tasks.workunit.client.0.smithi087.stdout:3/825: getdents d0/d1c/d25 0 2024-03-18T14:43:23.703 INFO:tasks.workunit.client.0.smithi087.stdout:4/767: dwrite d2/db/d24/d30/f91 [0,4194304] 0 2024-03-18T14:43:23.703 INFO:tasks.workunit.client.1.smithi129.stdout:4/583: link d0/d9/f51 d0/d19/d46/d3e/d21/d32/fb9 0 2024-03-18T14:43:23.704 INFO:tasks.workunit.client.0.smithi087.stdout:2/832: mkdir d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111 0 2024-03-18T14:43:23.705 INFO:tasks.workunit.client.1.smithi129.stdout:5/614: mkdir d0/dc/d1a/d61/d94/db7 0 2024-03-18T14:43:23.705 INFO:tasks.workunit.client.1.smithi129.stdout:9/625: dwrite d0/db/d1f/d20/d26/d19/d29/fb3 [0,4194304] 0 2024-03-18T14:43:23.706 INFO:tasks.workunit.client.1.smithi129.stdout:5/615: chown d0/d32/l56 2 1 2024-03-18T14:43:23.707 INFO:tasks.workunit.client.1.smithi129.stdout:5/616: write d0/dc/d22/f1e [96091,112130] 0 2024-03-18T14:43:23.707 INFO:tasks.workunit.client.0.smithi087.stdout:1/855: rename d3/l14 to d3/d1d/d1f/d107/l108 0 2024-03-18T14:43:23.708 INFO:tasks.workunit.client.0.smithi087.stdout:4/768: dwrite d2/db/d24/f58 [0,4194304] 0 2024-03-18T14:43:23.708 INFO:tasks.workunit.client.1.smithi129.stdout:5/617: read d0/df/f48 [2742857,55704] 0 2024-03-18T14:43:23.708 INFO:tasks.workunit.client.0.smithi087.stdout:8/785: creat d1/d6/d14/db2/f104 x:0 0 0 2024-03-18T14:43:23.708 INFO:tasks.workunit.client.0.smithi087.stdout:7/888: getdents d1/d97/db9 0 2024-03-18T14:43:23.709 INFO:tasks.workunit.client.0.smithi087.stdout:4/769: write d2/db/d84/d87/f88 [931877,109320] 0 2024-03-18T14:43:23.710 INFO:tasks.workunit.client.0.smithi087.stdout:0/802: chown d0/d2/d4/d27/dc3/dd2/lec 0 1 2024-03-18T14:43:23.711 INFO:tasks.workunit.client.0.smithi087.stdout:0/803: chown d0/d1a/d7b/f22 248149 1 2024-03-18T14:43:23.714 INFO:tasks.workunit.client.0.smithi087.stdout:3/826: dwrite d0/de/d30/f5d [0,4194304] 0 2024-03-18T14:43:23.715 INFO:tasks.workunit.client.1.smithi129.stdout:2/656: dread d7/d1f/d20/d36/f38 [0,4194304] 0 2024-03-18T14:43:23.715 INFO:tasks.workunit.client.0.smithi087.stdout:2/833: creat d2/ddd/d22/d2c/d3a/d40/d52/f112 x:0 0 0 2024-03-18T14:43:23.716 INFO:tasks.workunit.client.0.smithi087.stdout:2/834: dread - d2/ddd/d22/d2c/d3a/d40/d52/f112 zero size 2024-03-18T14:43:23.720 INFO:tasks.workunit.client.1.smithi129.stdout:3/608: truncate d4/d38/f2c 3161904 0 2024-03-18T14:43:23.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/657: unlink d3/d6/d82/lc2 0 2024-03-18T14:43:23.721 INFO:tasks.workunit.client.1.smithi129.stdout:6/658: stat d3/c32 0 2024-03-18T14:43:23.722 INFO:tasks.workunit.client.1.smithi129.stdout:3/609: write d4/dd/d1f/d5f/d31/f77 [466919,55841] 0 2024-03-18T14:43:23.724 INFO:tasks.workunit.client.1.smithi129.stdout:0/667: dwrite d0/d23/d35/d3b/f79 [0,4194304] 0 2024-03-18T14:43:23.724 INFO:tasks.workunit.client.1.smithi129.stdout:3/610: write d4/dd/d1f/d5f/d8c/f8d [502116,25322] 0 2024-03-18T14:43:23.724 INFO:tasks.workunit.client.1.smithi129.stdout:8/683: symlink d9/d11/d1a/d14/db7/le6 0 2024-03-18T14:43:23.725 INFO:tasks.workunit.client.1.smithi129.stdout:9/626: mknod d0/db/d2e/d9d/cc7 0 2024-03-18T14:43:23.727 INFO:tasks.workunit.client.1.smithi129.stdout:1/639: truncate d1/d2/f33 1131532 0 2024-03-18T14:43:23.729 INFO:tasks.workunit.client.0.smithi087.stdout:5/833: sync 2024-03-18T14:43:23.730 INFO:tasks.workunit.client.0.smithi087.stdout:6/760: write d3/d7/d25/d62/d7c/d29/f90 [1452040,70587] 0 2024-03-18T14:43:23.734 INFO:tasks.workunit.client.0.smithi087.stdout:6/761: dwrite d3/d7/f2e [0,4194304] 0 2024-03-18T14:43:23.734 INFO:tasks.workunit.client.1.smithi129.stdout:2/657: write d7/d1f/fa7 [3607937,48916] 0 2024-03-18T14:43:23.734 INFO:tasks.workunit.client.1.smithi129.stdout:6/659: stat d3/d30/l56 0 2024-03-18T14:43:23.735 INFO:tasks.workunit.client.0.smithi087.stdout:6/762: stat d3/d7/d25/d62/d7c/d29/cb2 0 2024-03-18T14:43:23.736 INFO:tasks.workunit.client.1.smithi129.stdout:4/584: symlink d0/d19/d46/d3e/lba 0 2024-03-18T14:43:23.739 INFO:tasks.workunit.client.1.smithi129.stdout:2/658: dwrite d7/d1c/fb1 [0,4194304] 0 2024-03-18T14:43:23.740 INFO:tasks.workunit.client.1.smithi129.stdout:2/659: stat d7/d1f/d20/d36/da9/dc1/c94 0 2024-03-18T14:43:23.740 INFO:tasks.workunit.client.1.smithi129.stdout:2/660: chown d7/l19 0 1 2024-03-18T14:43:23.742 INFO:tasks.workunit.client.1.smithi129.stdout:7/645: truncate d4/d2d/d2e/d79/dc6/f31 1767423 0 2024-03-18T14:43:23.744 INFO:tasks.workunit.client.0.smithi087.stdout:1/856: chown d3/f7 3 1 2024-03-18T14:43:23.744 INFO:tasks.workunit.client.0.smithi087.stdout:8/786: chown d1/d6/d2f/d44/d45/f70 786182960 1 2024-03-18T14:43:23.745 INFO:tasks.workunit.client.0.smithi087.stdout:4/770: mkdir d2/db/d24/d30/d7b/d7f/da5/db4/dfe 0 2024-03-18T14:43:23.750 INFO:tasks.workunit.client.1.smithi129.stdout:8/684: symlink d9/d11/db3/le7 0 2024-03-18T14:43:23.750 INFO:tasks.workunit.client.1.smithi129.stdout:3/611: creat d4/dd/d1f/d5f/d31/fd0 x:0 0 0 2024-03-18T14:43:23.750 INFO:tasks.workunit.client.1.smithi129.stdout:9/627: unlink d0/db/d1f/d20/d26/d19/d29/d36/f5e 0 2024-03-18T14:43:23.750 INFO:tasks.workunit.client.0.smithi087.stdout:6/763: chown d3/d7/l78 94073 1 2024-03-18T14:43:23.751 INFO:tasks.workunit.client.1.smithi129.stdout:3/612: read - d4/d11/d1d/d50/d91/f94 zero size 2024-03-18T14:43:23.753 INFO:tasks.workunit.client.1.smithi129.stdout:2/661: fsync d7/d3f/fcb 0 2024-03-18T14:43:23.753 INFO:tasks.workunit.client.1.smithi129.stdout:7/646: rmdir d4/d2d/d2e/d79/dc6/d38/d49 39 2024-03-18T14:43:23.754 INFO:tasks.workunit.client.0.smithi087.stdout:9/902: link db/d18/d1c/f93 db/d18/d1e/d28/d76/f136 0 2024-03-18T14:43:23.756 INFO:tasks.workunit.client.1.smithi129.stdout:8/685: write d9/d11/d1a/f4b [5174928,106937] 0 2024-03-18T14:43:23.758 INFO:tasks.workunit.client.0.smithi087.stdout:8/787: symlink d1/d6/d2f/d44/d4b/da5/l105 0 2024-03-18T14:43:23.759 INFO:tasks.workunit.client.1.smithi129.stdout:5/618: write d0/d32/d3a/d45/f65 [50404,58688] 0 2024-03-18T14:43:23.761 INFO:tasks.workunit.client.1.smithi129.stdout:9/628: mknod d0/db/d11/cc8 0 2024-03-18T14:43:23.762 INFO:tasks.workunit.client.1.smithi129.stdout:0/668: dread d0/d23/d71/fa9 [0,4194304] 0 2024-03-18T14:43:23.763 INFO:tasks.workunit.client.0.smithi087.stdout:0/804: dwrite d0/f16 [0,4194304] 0 2024-03-18T14:43:23.763 INFO:tasks.workunit.client.0.smithi087.stdout:1/857: write d3/d1d/f33 [1188756,43387] 0 2024-03-18T14:43:23.763 INFO:tasks.workunit.client.0.smithi087.stdout:0/805: stat d0 0 2024-03-18T14:43:23.763 INFO:tasks.workunit.client.1.smithi129.stdout:2/662: mkdir d7/d1f/d81/dd4 0 2024-03-18T14:43:23.764 INFO:tasks.workunit.client.1.smithi129.stdout:2/663: chown d7/d1c/d62 1 1 2024-03-18T14:43:23.765 INFO:tasks.workunit.client.1.smithi129.stdout:2/664: chown d7/d1f/d20/d2a/d6b/fb2 13 1 2024-03-18T14:43:23.765 INFO:tasks.workunit.client.1.smithi129.stdout:2/665: stat d7/d1f/d20/d2d/d7e 0 2024-03-18T14:43:23.765 INFO:tasks.workunit.client.1.smithi129.stdout:7/647: creat d4/d8c/fcc x:0 0 0 2024-03-18T14:43:23.766 INFO:tasks.workunit.client.0.smithi087.stdout:2/835: mknod d2/ddd/d22/d2c/d3a/d40/d4a/c113 0 2024-03-18T14:43:23.767 INFO:tasks.workunit.client.1.smithi129.stdout:1/640: creat d1/d2/d28/d65/fc2 x:0 0 0 2024-03-18T14:43:23.769 INFO:tasks.workunit.client.0.smithi087.stdout:6/764: stat d3/d7/d25/c81 0 2024-03-18T14:43:23.769 INFO:tasks.workunit.client.0.smithi087.stdout:0/806: dwrite d0/d2/d4/de8/dad/dea/da3/da8/fb3 [0,4194304] 0 2024-03-18T14:43:23.771 INFO:tasks.workunit.client.0.smithi087.stdout:3/827: truncate d0/d72/f99 3268678 0 2024-03-18T14:43:23.772 INFO:tasks.workunit.client.0.smithi087.stdout:5/834: write d13/d1b/f47 [2016550,41973] 0 2024-03-18T14:43:23.772 INFO:tasks.workunit.client.1.smithi129.stdout:6/660: truncate d3/d6/d7f/db4/d57/f64 3457017 0 2024-03-18T14:43:23.772 INFO:tasks.workunit.client.0.smithi087.stdout:5/835: chown d13/d1b/d7e/f8e 423138186 1 2024-03-18T14:43:23.773 INFO:tasks.workunit.client.0.smithi087.stdout:8/788: symlink d1/d6/d14/db2/l106 0 2024-03-18T14:43:23.773 INFO:tasks.workunit.client.0.smithi087.stdout:7/889: link d1/d6/d29/d2f/d68/d65/d60/l118 d1/d6/da/d59/dbe/d11a/d95/l12e 0 2024-03-18T14:43:23.774 INFO:tasks.workunit.client.1.smithi129.stdout:5/619: fsync d0/f2 0 2024-03-18T14:43:23.774 INFO:tasks.workunit.client.1.smithi129.stdout:6/661: write d3/d6/d7f/db4/f9c [4626384,105115] 0 2024-03-18T14:43:23.774 INFO:tasks.workunit.client.1.smithi129.stdout:6/662: fsync d3/d6/d7f/db4/fc8 0 2024-03-18T14:43:23.775 INFO:tasks.workunit.client.1.smithi129.stdout:3/613: fsync d4/d38/da3/fc8 0 2024-03-18T14:43:23.775 INFO:tasks.workunit.client.1.smithi129.stdout:6/663: write d3/d6/d7f/fd3 [638201,12382] 0 2024-03-18T14:43:23.775 INFO:tasks.workunit.client.1.smithi129.stdout:3/614: chown d4/dd/db0 9268703 1 2024-03-18T14:43:23.777 INFO:tasks.workunit.client.0.smithi087.stdout:1/858: creat d3/d1d/d1f/d63/f109 x:0 0 0 2024-03-18T14:43:23.777 INFO:tasks.workunit.client.1.smithi129.stdout:4/585: creat d0/fbb x:0 0 0 2024-03-18T14:43:23.777 INFO:tasks.workunit.client.1.smithi129.stdout:4/586: chown d0/d19/d46 0 1 2024-03-18T14:43:23.779 INFO:tasks.workunit.client.1.smithi129.stdout:4/587: write d0/d19/d46/d3e/d21/d4d/d58/f8f [1831325,126201] 0 2024-03-18T14:43:23.779 INFO:tasks.workunit.client.1.smithi129.stdout:4/588: stat d0/d9/d6a/l91 0 2024-03-18T14:43:23.780 INFO:tasks.workunit.client.1.smithi129.stdout:4/589: write d0/f5 [4065389,119929] 0 2024-03-18T14:43:23.780 INFO:tasks.workunit.client.1.smithi129.stdout:8/686: mkdir d9/d11/d1a/d32/de8 0 2024-03-18T14:43:23.783 INFO:tasks.workunit.client.0.smithi087.stdout:2/836: rename d2/ddd/d22/d2c/d3a/d49/d58/d78/ccd to d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/c114 0 2024-03-18T14:43:23.787 INFO:tasks.workunit.client.0.smithi087.stdout:1/859: symlink d3/d3c/db8/d8f/d99/l10a 0 2024-03-18T14:43:23.787 INFO:tasks.workunit.client.0.smithi087.stdout:4/771: link d2/db/d24/d30/d49/d4f/l73 d2/db/d24/d30/d7b/dbe/dcf/dda/lff 0 2024-03-18T14:43:23.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/772: write d2/db/ffc [750383,69877] 0 2024-03-18T14:43:23.789 INFO:tasks.workunit.client.0.smithi087.stdout:4/773: chown d2/db/d67/fbc 51 1 2024-03-18T14:43:23.792 INFO:tasks.workunit.client.0.smithi087.stdout:6/765: write d3/d7/d25/d62/f6a [707604,11099] 0 2024-03-18T14:43:23.793 INFO:tasks.workunit.client.0.smithi087.stdout:3/828: symlink d0/lef 0 2024-03-18T14:43:23.793 INFO:tasks.workunit.client.0.smithi087.stdout:3/829: chown d0/de 31 1 2024-03-18T14:43:23.794 INFO:tasks.workunit.client.0.smithi087.stdout:2/837: mkdir d2/d44/d72/d79/d101/d115 0 2024-03-18T14:43:23.794 INFO:tasks.workunit.client.0.smithi087.stdout:9/903: getdents db/d18/d1e/d28/d7c/dba 0 2024-03-18T14:43:23.795 INFO:tasks.workunit.client.0.smithi087.stdout:3/830: chown d0/de/d30/d46/dc3 194 1 2024-03-18T14:43:23.796 INFO:tasks.workunit.client.0.smithi087.stdout:8/789: stat d1/d6/d9/d5d/d87/f8a 0 2024-03-18T14:43:23.796 INFO:tasks.workunit.client.0.smithi087.stdout:0/807: dwrite d0/f50 [0,4194304] 0 2024-03-18T14:43:23.799 INFO:tasks.workunit.client.0.smithi087.stdout:1/860: rename d3/dbf/cf6 to d3/d1d/d1e/d20/d7a/c10b 0 2024-03-18T14:43:23.799 INFO:tasks.workunit.client.0.smithi087.stdout:1/861: fdatasync d3/d1d/fee 0 2024-03-18T14:43:23.800 INFO:tasks.workunit.client.0.smithi087.stdout:1/862: chown d3/de4 2438080 1 2024-03-18T14:43:23.803 INFO:tasks.workunit.client.0.smithi087.stdout:5/836: truncate d13/d1b/d27/d35/f39 775068 0 2024-03-18T14:43:23.806 INFO:tasks.workunit.client.0.smithi087.stdout:3/831: stat d0/d3/f94 0 2024-03-18T14:43:23.807 INFO:tasks.workunit.client.0.smithi087.stdout:2/838: creat d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/f116 x:0 0 0 2024-03-18T14:43:23.809 INFO:tasks.workunit.client.1.smithi129.stdout:3/615: write d4/d11/d34/d3c/f81 [4895330,26165] 0 2024-03-18T14:43:23.809 INFO:tasks.workunit.client.1.smithi129.stdout:9/629: write d0/db/d2e/f50 [443350,39315] 0 2024-03-18T14:43:23.809 INFO:tasks.workunit.client.1.smithi129.stdout:2/666: truncate d7/f59 133198 0 2024-03-18T14:43:23.809 INFO:tasks.workunit.client.1.smithi129.stdout:1/641: mkdir d1/db2/dc3 0 2024-03-18T14:43:23.810 INFO:tasks.workunit.client.1.smithi129.stdout:7/648: symlink d4/d2d/d2e/d79/dc6/d38/lcd 0 2024-03-18T14:43:23.811 INFO:tasks.workunit.client.1.smithi129.stdout:3/616: write d4/d11/d34/d53/d87/f85 [1100474,58111] 0 2024-03-18T14:43:23.813 INFO:tasks.workunit.client.0.smithi087.stdout:1/863: rename d3/d1d/d1e/d43/cad to d3/d1d/d1f/d107/c10c 0 2024-03-18T14:43:23.815 INFO:tasks.workunit.client.1.smithi129.stdout:2/667: mkdir d7/d1c/d79/dd5 0 2024-03-18T14:43:23.816 INFO:tasks.workunit.client.0.smithi087.stdout:6/766: symlink d3/d7/d25/d62/d7c/d29/d22/l102 0 2024-03-18T14:43:23.817 INFO:tasks.workunit.client.1.smithi129.stdout:7/649: dwrite d4/d8c/d9e/fb1 [0,4194304] 0 2024-03-18T14:43:23.817 INFO:tasks.workunit.client.1.smithi129.stdout:3/617: fsync d4/fb 0 2024-03-18T14:43:23.817 INFO:tasks.workunit.client.0.smithi087.stdout:8/790: write d1/d6/d2f/d44/d45/d50/f5e [1843368,128968] 0 2024-03-18T14:43:23.817 INFO:tasks.workunit.client.0.smithi087.stdout:1/864: dwrite d3/f4e [0,4194304] 0 2024-03-18T14:43:23.818 INFO:tasks.workunit.client.0.smithi087.stdout:6/767: stat d3/d7/d25/d62/d7c/d29/d22/f5d 0 2024-03-18T14:43:23.820 INFO:tasks.workunit.client.0.smithi087.stdout:9/904: fdatasync db/d18/f2c 0 2024-03-18T14:43:23.820 INFO:tasks.workunit.client.1.smithi129.stdout:7/650: creat d4/d8c/d9e/fce x:0 0 0 2024-03-18T14:43:23.821 INFO:tasks.workunit.client.0.smithi087.stdout:3/832: creat d0/de/d30/d67/ff0 x:0 0 0 2024-03-18T14:43:23.823 INFO:tasks.workunit.client.1.smithi129.stdout:2/668: dwrite d7/d1f/d20/d2a/d6b/fb2 [0,4194304] 0 2024-03-18T14:43:23.824 INFO:tasks.workunit.client.0.smithi087.stdout:9/905: write db/d31/f42 [2319401,11741] 0 2024-03-18T14:43:23.824 INFO:tasks.workunit.client.1.smithi129.stdout:3/618: rename d4/f54 to d4/dd/d1f/d5f/d31/fd1 0 2024-03-18T14:43:23.825 INFO:tasks.workunit.client.1.smithi129.stdout:1/642: getdents d1/d2/d70/d87 0 2024-03-18T14:43:23.826 INFO:tasks.workunit.client.0.smithi087.stdout:1/865: dwrite d3/d1d/d45/fa6 [0,4194304] 0 2024-03-18T14:43:23.826 INFO:tasks.workunit.client.1.smithi129.stdout:3/619: dread - d4/d11/d34/d3c/f9d zero size 2024-03-18T14:43:23.827 INFO:tasks.workunit.client.0.smithi087.stdout:4/774: dwrite d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:23.828 INFO:tasks.workunit.client.1.smithi129.stdout:9/630: write d0/f1b [1322265,52568] 0 2024-03-18T14:43:23.828 INFO:tasks.workunit.client.0.smithi087.stdout:1/866: write d3/d1d/d79/feb [175944,52839] 0 2024-03-18T14:43:23.829 INFO:tasks.workunit.client.1.smithi129.stdout:0/669: dread d0/d23/d29/f58 [0,4194304] 0 2024-03-18T14:43:23.829 INFO:tasks.workunit.client.1.smithi129.stdout:9/631: write d0/db/d1f/d20/d25/d8e/f67 [182521,6869] 0 2024-03-18T14:43:23.830 INFO:tasks.workunit.client.0.smithi087.stdout:2/839: dwrite d2/ddd/d22/d2c/d3a/d49/d58/f9e [0,4194304] 0 2024-03-18T14:43:23.830 INFO:tasks.workunit.client.0.smithi087.stdout:1/867: write d3/d1d/d1f/fb0 [1134786,30888] 0 2024-03-18T14:43:23.830 INFO:tasks.workunit.client.1.smithi129.stdout:9/632: write d0/db/f43 [4124327,76446] 0 2024-03-18T14:43:23.831 INFO:tasks.workunit.client.0.smithi087.stdout:1/868: stat d3/d1d/d67/d94/cf5 0 2024-03-18T14:43:23.831 INFO:tasks.workunit.client.1.smithi129.stdout:7/651: rename d4/d2d/d2e/d79/dc6/d8/f22 to d4/d2d/d2e/d79/dc6/d8/fcf 0 2024-03-18T14:43:23.832 INFO:tasks.workunit.client.1.smithi129.stdout:5/620: dread d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:23.832 INFO:tasks.workunit.client.1.smithi129.stdout:7/652: readlink d4/d2d/d2e/l7e 0 2024-03-18T14:43:23.832 INFO:tasks.workunit.client.1.smithi129.stdout:5/621: read d0/f67 [2051939,4325] 0 2024-03-18T14:43:23.834 INFO:tasks.workunit.client.1.smithi129.stdout:5/622: write d0/df/f59 [1396524,109201] 0 2024-03-18T14:43:23.834 INFO:tasks.workunit.client.1.smithi129.stdout:4/590: dread d0/d19/d46/d3e/d33/f7d [0,4194304] 0 2024-03-18T14:43:23.834 INFO:tasks.workunit.client.1.smithi129.stdout:1/643: mkdir d1/d2/d70/d87/d8c/dc4 0 2024-03-18T14:43:23.835 INFO:tasks.workunit.client.0.smithi087.stdout:0/808: getdents d0/d1a/d7b/d26 0 2024-03-18T14:43:23.836 INFO:tasks.workunit.client.0.smithi087.stdout:7/890: sync 2024-03-18T14:43:23.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/670: creat d0/d23/d71/fd2 x:0 0 0 2024-03-18T14:43:23.837 INFO:tasks.workunit.client.0.smithi087.stdout:5/837: rename d13/f57 to d13/d1b/d27/d35/dc6/dd6/f117 0 2024-03-18T14:43:23.839 INFO:tasks.workunit.client.0.smithi087.stdout:3/833: creat d0/d3/d7a/ff1 x:0 0 0 2024-03-18T14:43:23.840 INFO:tasks.workunit.client.1.smithi129.stdout:2/669: creat d7/d1c/d7b/fd6 x:0 0 0 2024-03-18T14:43:23.840 INFO:tasks.workunit.client.1.smithi129.stdout:9/633: symlink d0/db/d90/lc9 0 2024-03-18T14:43:23.841 INFO:tasks.workunit.client.1.smithi129.stdout:9/634: readlink d0/d15/l5b 0 2024-03-18T14:43:23.842 INFO:tasks.workunit.client.1.smithi129.stdout:9/635: write d0/db/d2e/f50 [1381717,91415] 0 2024-03-18T14:43:23.844 INFO:tasks.workunit.client.0.smithi087.stdout:9/906: dwrite db/d18/d1e/d28/f4a [0,4194304] 0 2024-03-18T14:43:23.844 INFO:tasks.workunit.client.1.smithi129.stdout:7/653: creat d4/d2d/d2e/d45/fd0 x:0 0 0 2024-03-18T14:43:23.844 INFO:tasks.workunit.client.1.smithi129.stdout:5/623: symlink d0/d32/d34/d6c/lb8 0 2024-03-18T14:43:23.846 INFO:tasks.workunit.client.1.smithi129.stdout:1/644: creat d1/d2/d28/d65/d19/d52/fc5 x:0 0 0 2024-03-18T14:43:23.847 INFO:tasks.workunit.client.1.smithi129.stdout:1/645: write d1/d2/d28/d65/d19/d52/f89 [465537,86383] 0 2024-03-18T14:43:23.848 INFO:tasks.workunit.client.0.smithi087.stdout:4/775: creat d2/db/d24/d30/f100 x:0 0 0 2024-03-18T14:43:23.848 INFO:tasks.workunit.client.0.smithi087.stdout:1/869: creat d3/d1d/d1f/dab/f10d x:0 0 0 2024-03-18T14:43:23.849 INFO:tasks.workunit.client.0.smithi087.stdout:1/870: fdatasync d3/d1d/d1e/d43/d50/d71/f102 0 2024-03-18T14:43:23.851 INFO:tasks.workunit.client.0.smithi087.stdout:6/768: rename d3/d7/d25/d62/cf8 to d3/dcd/c103 0 2024-03-18T14:43:23.852 INFO:tasks.workunit.client.0.smithi087.stdout:7/891: rmdir d1/d6/da/d59/dbe/d11a/d95 39 2024-03-18T14:43:23.853 INFO:tasks.workunit.client.0.smithi087.stdout:5/838: symlink d13/d1b/d27/d28/d9a/df0/l118 0 2024-03-18T14:43:23.855 INFO:tasks.workunit.client.0.smithi087.stdout:5/839: stat d13/d1b/d27/d98/dc2/f105 0 2024-03-18T14:43:23.855 INFO:tasks.workunit.client.0.smithi087.stdout:9/907: mknod db/d18/d1c/d69/d6f/c137 0 2024-03-18T14:43:23.855 INFO:tasks.workunit.client.0.smithi087.stdout:1/871: dwrite d3/d1d/d1e/d43/d50/d71/fc1 [4194304,4194304] 0 2024-03-18T14:43:23.857 INFO:tasks.workunit.client.0.smithi087.stdout:1/872: readlink d3/d1d/d1f/dab/lf4 0 2024-03-18T14:43:23.857 INFO:tasks.workunit.client.0.smithi087.stdout:5/840: readlink d13/d1b/d27/d35/da7/le2 0 2024-03-18T14:43:23.858 INFO:tasks.workunit.client.1.smithi129.stdout:0/671: write d0/d23/d35/f36 [6689994,43692] 0 2024-03-18T14:43:23.859 INFO:tasks.workunit.client.0.smithi087.stdout:3/834: dwrite d0/d3/d40/f97 [0,4194304] 0 2024-03-18T14:43:23.859 INFO:tasks.workunit.client.0.smithi087.stdout:4/776: creat d2/db/d24/d30/d7b/d7f/da5/db4/f101 x:0 0 0 2024-03-18T14:43:23.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/791: sync 2024-03-18T14:43:23.864 INFO:tasks.workunit.client.1.smithi129.stdout:9/636: mknod d0/db/d1f/d20/d26/d19/d29/d36/cca 0 2024-03-18T14:43:23.865 INFO:tasks.workunit.client.1.smithi129.stdout:3/620: creat d4/d11/d34/d3c/fd2 x:0 0 0 2024-03-18T14:43:23.877 INFO:tasks.workunit.client.0.smithi087.stdout:9/908: creat db/d18/d1e/d28/d7c/dba/f138 x:0 0 0 2024-03-18T14:43:23.877 INFO:tasks.workunit.client.0.smithi087.stdout:1/873: readlink d3/d1d/d1e/d43/d50/l87 0 2024-03-18T14:43:23.878 INFO:tasks.workunit.client.1.smithi129.stdout:9/637: mkdir d0/db/d2e/d9f/dcb 0 2024-03-18T14:43:23.879 INFO:tasks.workunit.client.1.smithi129.stdout:9/638: chown d0/db/d1f/d20/d25/d8e/f80 3256716 1 2024-03-18T14:43:23.879 INFO:tasks.workunit.client.0.smithi087.stdout:3/835: creat d0/d72/ff2 x:0 0 0 2024-03-18T14:43:23.880 INFO:tasks.workunit.client.0.smithi087.stdout:4/777: fsync d2/f36 0 2024-03-18T14:43:23.880 INFO:tasks.workunit.client.1.smithi129.stdout:9/639: chown d0/db/d2e/d9d/fa7 47 1 2024-03-18T14:43:23.880 INFO:tasks.workunit.client.1.smithi129.stdout:3/621: unlink d4/dd/d1f/d5f/f5b 0 2024-03-18T14:43:23.881 INFO:tasks.workunit.client.1.smithi129.stdout:6/664: sync 2024-03-18T14:43:23.882 INFO:tasks.workunit.client.1.smithi129.stdout:0/672: rename d0/c7e to d0/d23/d71/dc2/d4a/cd3 0 2024-03-18T14:43:23.884 INFO:tasks.workunit.client.1.smithi129.stdout:1/646: dread d1/d2/d28/d65/f30 [0,4194304] 0 2024-03-18T14:43:23.884 INFO:tasks.workunit.client.0.smithi087.stdout:5/841: mkdir d13/d1b/d27/d119 0 2024-03-18T14:43:23.884 INFO:tasks.workunit.client.1.smithi129.stdout:1/647: chown d1/d35/db8 59449058 1 2024-03-18T14:43:23.884 INFO:tasks.workunit.client.0.smithi087.stdout:9/909: rmdir db/d18/d1e/dde 39 2024-03-18T14:43:23.885 INFO:tasks.workunit.client.1.smithi129.stdout:3/622: fsync d4/dd/f3d 0 2024-03-18T14:43:23.885 INFO:tasks.workunit.client.0.smithi087.stdout:1/874: chown d3/d1d/d1e/d43/d9b/lf0 10144793 1 2024-03-18T14:43:23.886 INFO:tasks.workunit.client.0.smithi087.stdout:1/875: read - d3/d1d/d1e/d20/d7a/db4/fb9 zero size 2024-03-18T14:43:23.887 INFO:tasks.workunit.client.1.smithi129.stdout:0/673: symlink d0/ld4 0 2024-03-18T14:43:23.888 INFO:tasks.workunit.client.1.smithi129.stdout:0/674: dread - d0/d14/fb9 zero size 2024-03-18T14:43:23.888 INFO:tasks.workunit.client.0.smithi087.stdout:2/840: rename d2/f10 to d2/d44/d72/f117 0 2024-03-18T14:43:23.889 INFO:tasks.workunit.client.1.smithi129.stdout:0/675: read - d0/d23/d71/fc3 zero size 2024-03-18T14:43:23.889 INFO:tasks.workunit.client.0.smithi087.stdout:3/836: mknod d0/d3/d40/cf3 0 2024-03-18T14:43:23.890 INFO:tasks.workunit.client.0.smithi087.stdout:3/837: dread - d0/d3/d4f/fc4 zero size 2024-03-18T14:43:23.893 INFO:tasks.workunit.client.0.smithi087.stdout:4/778: mkdir d2/db/d3c/d90/d102 0 2024-03-18T14:43:23.894 INFO:tasks.workunit.client.1.smithi129.stdout:0/676: dwrite d0/d23/d35/d3b/f33 [0,4194304] 0 2024-03-18T14:43:23.894 INFO:tasks.workunit.client.0.smithi087.stdout:0/809: link d0/d2/d3c/f61 d0/d2/d3c/d73/f115 0 2024-03-18T14:43:23.895 INFO:tasks.workunit.client.1.smithi129.stdout:7/654: write d4/d2d/d2e/f5a [5069903,72005] 0 2024-03-18T14:43:23.896 INFO:tasks.workunit.client.1.smithi129.stdout:0/677: write d0/d14/d28/fa8 [776530,47565] 0 2024-03-18T14:43:23.896 INFO:tasks.workunit.client.0.smithi087.stdout:0/810: write d0/d2/d4/f111 [158973,19733] 0 2024-03-18T14:43:23.896 INFO:tasks.workunit.client.1.smithi129.stdout:2/670: dread d7/d1f/d20/d2a/f48 [0,4194304] 0 2024-03-18T14:43:23.897 INFO:tasks.workunit.client.1.smithi129.stdout:0/678: write d0/d23/d35/d3b/f79 [2163933,19219] 0 2024-03-18T14:43:23.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/779: dwrite d2/db/d84/fca [0,4194304] 0 2024-03-18T14:43:23.899 INFO:tasks.workunit.client.1.smithi129.stdout:0/679: chown d0/f8e 343783 1 2024-03-18T14:43:23.901 INFO:tasks.workunit.client.0.smithi087.stdout:6/769: dwrite d3/f6c [0,4194304] 0 2024-03-18T14:43:23.901 INFO:tasks.workunit.client.0.smithi087.stdout:4/780: chown d2/db/d67/f78 215639438 1 2024-03-18T14:43:23.901 INFO:tasks.workunit.client.0.smithi087.stdout:5/842: creat d13/d1b/d27/d98/dc2/f11a x:0 0 0 2024-03-18T14:43:23.901 INFO:tasks.workunit.client.1.smithi129.stdout:6/665: dread d3/d30/fd [0,4194304] 0 2024-03-18T14:43:23.902 INFO:tasks.workunit.client.1.smithi129.stdout:6/666: write d3/f6a [4782311,92238] 0 2024-03-18T14:43:23.904 INFO:tasks.workunit.client.0.smithi087.stdout:0/811: rmdir d0/d2/d4/de8 39 2024-03-18T14:43:23.905 INFO:tasks.workunit.client.1.smithi129.stdout:3/623: rmdir d4/d11/d1d 39 2024-03-18T14:43:23.906 INFO:tasks.workunit.client.0.smithi087.stdout:8/792: dwrite d1/d6/d2f/f91 [0,4194304] 0 2024-03-18T14:43:23.906 INFO:tasks.workunit.client.0.smithi087.stdout:7/892: getdents d1/d97 0 2024-03-18T14:43:23.906 INFO:tasks.workunit.client.0.smithi087.stdout:0/812: fsync d0/d2/d4/d27/fd3 0 2024-03-18T14:43:23.908 INFO:tasks.workunit.client.0.smithi087.stdout:0/813: chown d0/d1a/d7b/lda 1288411856 1 2024-03-18T14:43:23.909 INFO:tasks.workunit.client.0.smithi087.stdout:7/893: chown d1/d6/d29/d2f/d68/d65/d96/lc3 786132756 1 2024-03-18T14:43:23.909 INFO:tasks.workunit.client.0.smithi087.stdout:1/876: dread d3/d1d/d1f/f3f [4194304,4194304] 0 2024-03-18T14:43:23.909 INFO:tasks.workunit.client.0.smithi087.stdout:0/814: dread - d0/d2/d4/d8b/f114 zero size 2024-03-18T14:43:23.911 INFO:tasks.workunit.client.0.smithi087.stdout:2/841: symlink d2/d44/l118 0 2024-03-18T14:43:23.911 INFO:tasks.workunit.client.0.smithi087.stdout:0/815: stat d0/d2/d4/lb 0 2024-03-18T14:43:23.912 INFO:tasks.workunit.client.1.smithi129.stdout:1/648: mkdir d1/d35/db8/dc6 0 2024-03-18T14:43:23.912 INFO:tasks.workunit.client.0.smithi087.stdout:0/816: dread - d0/d2/d4/d27/dc3/dd2/f112 zero size 2024-03-18T14:43:23.913 INFO:tasks.workunit.client.0.smithi087.stdout:0/817: write d0/d1a/d80/d88/f2e [7344175,52626] 0 2024-03-18T14:43:23.914 INFO:tasks.workunit.client.1.smithi129.stdout:4/591: sync 2024-03-18T14:43:23.914 INFO:tasks.workunit.client.1.smithi129.stdout:8/687: sync 2024-03-18T14:43:23.917 INFO:tasks.workunit.client.1.smithi129.stdout:1/649: dwrite d1/d2/d28/d65/d7c/d7d/d80/f83 [4194304,4194304] 0 2024-03-18T14:43:23.917 INFO:tasks.workunit.client.0.smithi087.stdout:6/770: creat d3/d7/d25/d62/d7c/d29/d22/d75/d92/f104 x:0 0 0 2024-03-18T14:43:23.918 INFO:tasks.workunit.client.0.smithi087.stdout:9/910: truncate db/d18/d3a/fdc 763970 0 2024-03-18T14:43:23.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/911: chown db/d18/d1e/d28/d7c 20260 1 2024-03-18T14:43:23.919 INFO:tasks.workunit.client.0.smithi087.stdout:9/912: fsync db/d18/d1e/ff4 0 2024-03-18T14:43:23.920 INFO:tasks.workunit.client.0.smithi087.stdout:5/843: creat d13/dd8/f11b x:0 0 0 2024-03-18T14:43:23.922 INFO:tasks.workunit.client.1.smithi129.stdout:1/650: dwrite d1/d2/d70/d87/d8c/f95 [0,4194304] 0 2024-03-18T14:43:23.922 INFO:tasks.workunit.client.1.smithi129.stdout:8/688: mknod d9/d11/d53/ce9 0 2024-03-18T14:43:23.922 INFO:tasks.workunit.client.0.smithi087.stdout:8/793: rename d1/d6/d2f/d9b/db1 to d1/d6/d2f/d44/dfc/d107 0 2024-03-18T14:43:23.924 INFO:tasks.workunit.client.1.smithi129.stdout:7/655: creat d4/fd1 x:0 0 0 2024-03-18T14:43:23.925 INFO:tasks.workunit.client.0.smithi087.stdout:7/894: readlink d1/d6/d29/d2f/d68/d10f/l116 0 2024-03-18T14:43:23.925 INFO:tasks.workunit.client.1.smithi129.stdout:9/640: truncate d0/db/d1f/d20/d26/d19/d29/f2d 5980203 0 2024-03-18T14:43:23.927 INFO:tasks.workunit.client.1.smithi129.stdout:1/651: dread d1/d2/d28/d65/f30 [0,4194304] 0 2024-03-18T14:43:23.928 INFO:tasks.workunit.client.0.smithi087.stdout:3/838: creat d0/de/ff4 x:0 0 0 2024-03-18T14:43:23.928 INFO:tasks.workunit.client.0.smithi087.stdout:4/781: symlink d2/db/d24/d30/d7b/dbe/dcf/def/l103 0 2024-03-18T14:43:23.929 INFO:tasks.workunit.client.0.smithi087.stdout:6/771: symlink d3/d7/d25/d62/d7c/d29/d22/d61/l105 0 2024-03-18T14:43:23.930 INFO:tasks.workunit.client.1.smithi129.stdout:7/656: dwrite d4/d2d/d2e/d79/dc6/d8/d3b/f6f [0,4194304] 0 2024-03-18T14:43:23.933 INFO:tasks.workunit.client.1.smithi129.stdout:0/680: rename d0/d23/d71/f9f to d0/d14/fd5 0 2024-03-18T14:43:23.934 INFO:tasks.workunit.client.1.smithi129.stdout:6/667: link d3/d30/d44/f77 d3/d6/d82/d9a/fd7 0 2024-03-18T14:43:23.935 INFO:tasks.workunit.client.1.smithi129.stdout:6/668: chown d3/d6/d7f/db4/f7b 86241 1 2024-03-18T14:43:23.935 INFO:tasks.workunit.client.1.smithi129.stdout:6/669: chown d3/c21 627 1 2024-03-18T14:43:23.938 INFO:tasks.workunit.client.1.smithi129.stdout:8/689: creat d9/d11/d1a/d32/d41/d4d/dce/fea x:0 0 0 2024-03-18T14:43:23.939 INFO:tasks.workunit.client.1.smithi129.stdout:1/652: stat d1/d2/d28/d65/d19/f4a 0 2024-03-18T14:43:23.941 INFO:tasks.workunit.client.0.smithi087.stdout:9/913: unlink db/d18/d51/d7b/fab 0 2024-03-18T14:43:23.941 INFO:tasks.workunit.client.1.smithi129.stdout:2/671: getdents d7/d1f/d20/d2d/d7e 0 2024-03-18T14:43:23.941 INFO:tasks.workunit.client.0.smithi087.stdout:9/914: write db/d18/d51/d8f/fdb [905866,84200] 0 2024-03-18T14:43:23.942 INFO:tasks.workunit.client.0.smithi087.stdout:5/844: mkdir d13/d1b/d27/d8f/d11c 0 2024-03-18T14:43:23.942 INFO:tasks.workunit.client.1.smithi129.stdout:3/624: dread d4/d11/d34/d53/f8e [0,4194304] 0 2024-03-18T14:43:23.942 INFO:tasks.workunit.client.1.smithi129.stdout:7/657: dread - d4/d2d/d2e/d79/dc6/d38/d49/f62 zero size 2024-03-18T14:43:23.943 INFO:tasks.workunit.client.1.smithi129.stdout:7/658: chown d4/d2d/d2e/f30 24 1 2024-03-18T14:43:23.945 INFO:tasks.workunit.client.1.smithi129.stdout:9/641: rename d0/db/d1f/d20/f8f to d0/da1/fcc 0 2024-03-18T14:43:23.945 INFO:tasks.workunit.client.0.smithi087.stdout:1/877: rename d3/d1d/d1f/d34/lc0 to d3/d1d/d1e/d43/dfb/l10e 0 2024-03-18T14:43:23.946 INFO:tasks.workunit.client.0.smithi087.stdout:9/915: dwrite db/d18/d1c/d69/d6f/fd4 [0,4194304] 0 2024-03-18T14:43:23.946 INFO:tasks.workunit.client.0.smithi087.stdout:8/794: creat d1/d6/d2f/d44/d4b/f108 x:0 0 0 2024-03-18T14:43:23.947 INFO:tasks.workunit.client.1.smithi129.stdout:5/624: sync 2024-03-18T14:43:23.947 INFO:tasks.workunit.client.0.smithi087.stdout:0/818: mknod d0/c116 0 2024-03-18T14:43:23.948 INFO:tasks.workunit.client.1.smithi129.stdout:8/690: rmdir d9/d11/d1a/d32/d3a 39 2024-03-18T14:43:23.948 INFO:tasks.workunit.client.0.smithi087.stdout:4/782: mkdir d2/db/d24/d30/d7b/dbe/dcf/def/d104 0 2024-03-18T14:43:23.948 INFO:tasks.workunit.client.0.smithi087.stdout:7/895: write d1/d6/d29/d2f/d68/d65/fb1 [2406624,30273] 0 2024-03-18T14:43:23.948 INFO:tasks.workunit.client.1.smithi129.stdout:8/691: dread - d9/d11/d1a/d14/f8b zero size 2024-03-18T14:43:23.949 INFO:tasks.workunit.client.0.smithi087.stdout:6/772: mkdir d3/d7/d25/d62/d8b/d106 0 2024-03-18T14:43:23.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/625: chown d4/d11/d1d/d36/c39 3529259 1 2024-03-18T14:43:23.950 INFO:tasks.workunit.client.0.smithi087.stdout:1/878: read d3/d1d/d1e/d43/fa5 [3344308,39375] 0 2024-03-18T14:43:23.950 INFO:tasks.workunit.client.0.smithi087.stdout:0/819: write d0/d2/d4/d19/f5e [1776549,78337] 0 2024-03-18T14:43:23.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/896: chown d1/l7d 271388377 1 2024-03-18T14:43:23.950 INFO:tasks.workunit.client.1.smithi129.stdout:7/659: symlink d4/d2d/d2e/d79/dc6/d54/ld2 0 2024-03-18T14:43:23.950 INFO:tasks.workunit.client.0.smithi087.stdout:7/897: readlink d1/l3c 0 2024-03-18T14:43:23.953 INFO:tasks.workunit.client.1.smithi129.stdout:9/642: symlink d0/db/d1f/d20/d25/lcd 0 2024-03-18T14:43:23.954 INFO:tasks.workunit.client.0.smithi087.stdout:2/842: truncate d2/ddd/d22/d2c/d3a/d40/d52/f112 156351 0 2024-03-18T14:43:23.956 INFO:tasks.workunit.client.1.smithi129.stdout:4/592: getdents d0/d9/d6a/d7b 0 2024-03-18T14:43:23.958 INFO:tasks.workunit.client.1.smithi129.stdout:2/672: dread d7/d1f/d20/d2d/f35 [0,4194304] 0 2024-03-18T14:43:23.962 INFO:tasks.workunit.client.1.smithi129.stdout:0/681: truncate d0/d14/f5f 1127935 0 2024-03-18T14:43:23.963 INFO:tasks.workunit.client.1.smithi129.stdout:6/670: fsync d3/d5/fa6 0 2024-03-18T14:43:23.964 INFO:tasks.workunit.client.1.smithi129.stdout:5/625: mkdir d0/dc/d1a/db9 0 2024-03-18T14:43:23.967 INFO:tasks.workunit.client.0.smithi087.stdout:8/795: write d1/d6/d2f/d44/d4b/f86 [565151,126595] 0 2024-03-18T14:43:23.970 INFO:tasks.workunit.client.1.smithi129.stdout:9/643: creat d0/db/d2e/d9f/fce x:0 0 0 2024-03-18T14:43:23.970 INFO:tasks.workunit.client.1.smithi129.stdout:9/644: dread - d0/db/fb5 zero size 2024-03-18T14:43:23.971 INFO:tasks.workunit.client.1.smithi129.stdout:4/593: mknod d0/d9/d40/d5f/cbc 0 2024-03-18T14:43:23.972 INFO:tasks.workunit.client.0.smithi087.stdout:8/796: dwrite d1/d6/d2f/d44/d45/d72/ff1 [0,4194304] 0 2024-03-18T14:43:23.973 INFO:tasks.workunit.client.1.smithi129.stdout:3/626: dread d4/d11/d1d/f46 [0,4194304] 0 2024-03-18T14:43:23.973 INFO:tasks.workunit.client.1.smithi129.stdout:9/645: write d0/db/d90/d70/fa6 [547502,126349] 0 2024-03-18T14:43:23.973 INFO:tasks.workunit.client.1.smithi129.stdout:6/671: creat d3/d6/d7f/db4/fd8 x:0 0 0 2024-03-18T14:43:23.975 INFO:tasks.workunit.client.1.smithi129.stdout:6/672: stat d3/d30/de/d6c/f60 0 2024-03-18T14:43:23.975 INFO:tasks.workunit.client.1.smithi129.stdout:9/646: write d0/db/d2e/f50 [206615,83980] 0 2024-03-18T14:43:23.975 INFO:tasks.workunit.client.1.smithi129.stdout:3/627: dread d4/dd/db0/fb2 [0,4194304] 0 2024-03-18T14:43:23.975 INFO:tasks.workunit.client.1.smithi129.stdout:8/692: mkdir d9/d11/d1a/d14/db7/dc1/deb 0 2024-03-18T14:43:23.976 INFO:tasks.workunit.client.0.smithi087.stdout:2/843: fdatasync d2/f99 0 2024-03-18T14:43:23.976 INFO:tasks.workunit.client.1.smithi129.stdout:7/660: truncate d4/d2d/d2e/d79/dc6/f5f 220570 0 2024-03-18T14:43:23.977 INFO:tasks.workunit.client.1.smithi129.stdout:3/628: fdatasync d4/fa1 0 2024-03-18T14:43:23.977 INFO:tasks.workunit.client.1.smithi129.stdout:9/647: chown d0/f10 3 1 2024-03-18T14:43:23.977 INFO:tasks.workunit.client.0.smithi087.stdout:6/773: dread d3/d7/d25/d62/d7c/d29/f16 [4194304,4194304] 0 2024-03-18T14:43:23.979 INFO:tasks.workunit.client.0.smithi087.stdout:9/916: creat db/d18/d1e/d28/d76/d80/d11c/f139 x:0 0 0 2024-03-18T14:43:23.979 INFO:tasks.workunit.client.0.smithi087.stdout:4/783: fdatasync d2/db/de/d8b/fa6 0 2024-03-18T14:43:23.980 INFO:tasks.workunit.client.1.smithi129.stdout:2/673: truncate d7/f6e 1233793 0 2024-03-18T14:43:23.982 INFO:tasks.workunit.client.1.smithi129.stdout:3/629: dwrite d4/dd/d1f/d2f/fc5 [0,4194304] 0 2024-03-18T14:43:23.984 INFO:tasks.workunit.client.1.smithi129.stdout:6/673: creat d3/d30/de/d65/d80/fd9 x:0 0 0 2024-03-18T14:43:23.985 INFO:tasks.workunit.client.0.smithi087.stdout:5/845: creat d13/f11d x:0 0 0 2024-03-18T14:43:23.986 INFO:tasks.workunit.client.0.smithi087.stdout:8/797: mknod d1/d6/d2f/c109 0 2024-03-18T14:43:23.988 INFO:tasks.workunit.client.1.smithi129.stdout:9/648: rename d0/d15/c1c to d0/db/d1f/d20/d26/d19/d29/d36/ccf 0 2024-03-18T14:43:23.989 INFO:tasks.workunit.client.0.smithi087.stdout:7/898: creat d1/d6/da/d42/d61/d74/d127/f12f x:0 0 0 2024-03-18T14:43:23.989 INFO:tasks.workunit.client.1.smithi129.stdout:5/626: dread d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:23.990 INFO:tasks.workunit.client.1.smithi129.stdout:1/653: sync 2024-03-18T14:43:23.990 INFO:tasks.workunit.client.1.smithi129.stdout:5/627: readlink d0/dc/d18/la8 0 2024-03-18T14:43:23.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/844: unlink d2/ddd/d5a/fa8 0 2024-03-18T14:43:23.994 INFO:tasks.workunit.client.1.smithi129.stdout:0/682: truncate d0/d23/d71/dc2/f4c 1298882 0 2024-03-18T14:43:23.994 INFO:tasks.workunit.client.1.smithi129.stdout:9/649: dread d0/db/d2e/f50 [0,4194304] 0 2024-03-18T14:43:23.994 INFO:tasks.workunit.client.0.smithi087.stdout:6/774: mknod d3/dcd/c107 0 2024-03-18T14:43:23.995 INFO:tasks.workunit.client.1.smithi129.stdout:2/674: symlink d7/d1f/d20/d36/da9/dc1/ld7 0 2024-03-18T14:43:23.995 INFO:tasks.workunit.client.1.smithi129.stdout:7/661: dread d4/f66 [0,4194304] 0 2024-03-18T14:43:23.996 INFO:tasks.workunit.client.0.smithi087.stdout:2/845: dwrite d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/f116 [0,4194304] 0 2024-03-18T14:43:23.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/820: write d0/d1a/d7b/d26/d79/f100 [714134,80533] 0 2024-03-18T14:43:23.996 INFO:tasks.workunit.client.1.smithi129.stdout:3/630: symlink d4/dd/d1f/d5f/d82/da6/ld3 0 2024-03-18T14:43:23.997 INFO:tasks.workunit.client.0.smithi087.stdout:2/846: dread - d2/ddd/d22/d24/db2/fda zero size 2024-03-18T14:43:23.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/784: mkdir d2/dc2/d105 0 2024-03-18T14:43:23.998 INFO:tasks.workunit.client.0.smithi087.stdout:2/847: readlink d2/ddd/d22/d2c/d3a/d40/d4a/l53 0 2024-03-18T14:43:23.998 INFO:tasks.workunit.client.0.smithi087.stdout:4/785: chown d2/db/f80 2592918 1 2024-03-18T14:43:23.998 INFO:tasks.workunit.client.0.smithi087.stdout:5/846: symlink d13/d1b/d27/d8f/l11e 0 2024-03-18T14:43:23.999 INFO:tasks.workunit.client.0.smithi087.stdout:2/848: fdatasync d2/ddd/fff 0 2024-03-18T14:43:23.999 INFO:tasks.workunit.client.0.smithi087.stdout:4/786: readlink d2/db/d82/le9 0 2024-03-18T14:43:24.000 INFO:tasks.workunit.client.0.smithi087.stdout:8/798: symlink d1/d6/d2f/d44/d45/d72/d7f/d83/l10a 0 2024-03-18T14:43:24.000 INFO:tasks.workunit.client.1.smithi129.stdout:3/631: dread d4/dd/f32 [0,4194304] 0 2024-03-18T14:43:24.000 INFO:tasks.workunit.client.1.smithi129.stdout:0/683: dwrite d0/d23/d71/fc3 [0,4194304] 0 2024-03-18T14:43:24.002 INFO:tasks.workunit.client.1.smithi129.stdout:4/594: creat d0/d9/d40/fbd x:0 0 0 2024-03-18T14:43:24.003 INFO:tasks.workunit.client.1.smithi129.stdout:4/595: chown d0/d19/d46/d3e/d33/f8b 1978441893 1 2024-03-18T14:43:24.004 INFO:tasks.workunit.client.1.smithi129.stdout:5/628: unlink d0/fb 0 2024-03-18T14:43:24.005 INFO:tasks.workunit.client.0.smithi087.stdout:9/917: creat db/d18/d3a/d113/f13a x:0 0 0 2024-03-18T14:43:24.005 INFO:tasks.workunit.client.1.smithi129.stdout:0/684: dwrite d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:24.005 INFO:tasks.workunit.client.1.smithi129.stdout:5/629: stat d0/d32/d3a/d52/f90 0 2024-03-18T14:43:24.007 INFO:tasks.workunit.client.1.smithi129.stdout:8/693: truncate d9/d11/d1a/f4b 1586420 0 2024-03-18T14:43:24.009 INFO:tasks.workunit.client.1.smithi129.stdout:2/675: creat d7/d1c/d7b/fd8 x:0 0 0 2024-03-18T14:43:24.010 INFO:tasks.workunit.client.1.smithi129.stdout:6/674: unlink d3/d6/d82/f91 0 2024-03-18T14:43:24.011 INFO:tasks.workunit.client.0.smithi087.stdout:5/847: mknod d13/d1b/d27/d8f/dab/c11f 0 2024-03-18T14:43:24.011 INFO:tasks.workunit.client.1.smithi129.stdout:0/685: dwrite d0/d23/d71/dc2/d4a/f70 [8388608,4194304] 0 2024-03-18T14:43:24.015 INFO:tasks.workunit.client.1.smithi129.stdout:7/662: chown d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/la6 5472731 1 2024-03-18T14:43:24.015 INFO:tasks.workunit.client.1.smithi129.stdout:6/675: dwrite d3/d6/d7f/db4/f9c [0,4194304] 0 2024-03-18T14:43:24.020 INFO:tasks.workunit.client.0.smithi087.stdout:7/899: truncate d1/d6/d29/d2f/d68/dbf/ff6 455229 0 2024-03-18T14:43:24.022 INFO:tasks.workunit.client.0.smithi087.stdout:6/775: creat d3/f108 x:0 0 0 2024-03-18T14:43:24.022 INFO:tasks.workunit.client.0.smithi087.stdout:9/918: getdents db/d18/d1e/d28/dc2/deb 0 2024-03-18T14:43:24.023 INFO:tasks.workunit.client.1.smithi129.stdout:3/632: mkdir d4/d38/da3/dc9/da9/dd4 0 2024-03-18T14:43:24.023 INFO:tasks.workunit.client.1.smithi129.stdout:5/630: fsync d0/f2 0 2024-03-18T14:43:24.024 INFO:tasks.workunit.client.0.smithi087.stdout:0/821: truncate d0/d1a/d7b/d26/d79/fd7 5080322 0 2024-03-18T14:43:24.025 INFO:tasks.workunit.client.0.smithi087.stdout:7/900: read d1/d6/d16/f1e [578539,98171] 0 2024-03-18T14:43:24.026 INFO:tasks.workunit.client.0.smithi087.stdout:0/822: dread - d0/d1a/d80/d88/ff8 zero size 2024-03-18T14:43:24.027 INFO:tasks.workunit.client.1.smithi129.stdout:6/676: rmdir d3/d30/de/d6c/d9e/db6 39 2024-03-18T14:43:24.027 INFO:tasks.workunit.client.0.smithi087.stdout:6/776: mknod d3/d7/d25/d62/d7c/d29/d22/d61/c109 0 2024-03-18T14:43:24.028 INFO:tasks.workunit.client.1.smithi129.stdout:6/677: chown d3/d30/de/d65/d93/c9d 3 1 2024-03-18T14:43:24.028 INFO:tasks.workunit.client.0.smithi087.stdout:9/919: dwrite db/d18/d1e/d28/d7c/f104 [0,4194304] 0 2024-03-18T14:43:24.029 INFO:tasks.workunit.client.1.smithi129.stdout:8/694: dread d9/d11/d1a/d32/d3a/d70/f8c [0,4194304] 0 2024-03-18T14:43:24.030 INFO:tasks.workunit.client.0.smithi087.stdout:7/901: creat d1/d6/d29/d2f/d68/d65/d110/f130 x:0 0 0 2024-03-18T14:43:24.031 INFO:tasks.workunit.client.1.smithi129.stdout:1/654: write d1/d2/d28/d65/d19/f4a [1718101,19046] 0 2024-03-18T14:43:24.032 INFO:tasks.workunit.client.1.smithi129.stdout:1/655: dread - d1/d2/d70/fac zero size 2024-03-18T14:43:24.032 INFO:tasks.workunit.client.0.smithi087.stdout:0/823: creat d0/d1a/de6/f117 x:0 0 0 2024-03-18T14:43:24.032 INFO:tasks.workunit.client.0.smithi087.stdout:3/839: sync 2024-03-18T14:43:24.033 INFO:tasks.workunit.client.0.smithi087.stdout:3/840: dread - d0/d3/d7a/ff1 zero size 2024-03-18T14:43:24.034 INFO:tasks.workunit.client.0.smithi087.stdout:9/920: rename db/d18/d1e/d28/d76/db7/ccf to db/d18/d1e/d7e/db8/c13b 0 2024-03-18T14:43:24.034 INFO:tasks.workunit.client.1.smithi129.stdout:5/631: stat d0/f84 0 2024-03-18T14:43:24.035 INFO:tasks.workunit.client.0.smithi087.stdout:0/824: chown d0/d2/d4/de8 37343 1 2024-03-18T14:43:24.035 INFO:tasks.workunit.client.0.smithi087.stdout:9/921: readlink db/d18/d1e/d28/d76/db7/dd5/l133 0 2024-03-18T14:43:24.037 INFO:tasks.workunit.client.1.smithi129.stdout:9/650: rename d0/db/d1f/d20/d26/d19/d29/d36/f6d to d0/db/d1f/d20/fd0 0 2024-03-18T14:43:24.039 INFO:tasks.workunit.client.0.smithi087.stdout:9/922: symlink db/d18/d51/d8f/l13c 0 2024-03-18T14:43:24.042 INFO:tasks.workunit.client.1.smithi129.stdout:9/651: dwrite d0/db/d1f/d20/d26/d19/d29/fb3 [0,4194304] 0 2024-03-18T14:43:24.042 INFO:tasks.workunit.client.0.smithi087.stdout:9/923: rename db/fb9 to db/d18/d1e/d7e/db8/f13d 0 2024-03-18T14:43:24.043 INFO:tasks.workunit.client.1.smithi129.stdout:1/656: dread d1/d2/d28/d65/d19/f61 [0,4194304] 0 2024-03-18T14:43:24.045 INFO:tasks.workunit.client.0.smithi087.stdout:9/924: rename db/c3e to db/d18/d1e/d28/d76/d80/d11c/c13e 0 2024-03-18T14:43:24.045 INFO:tasks.workunit.client.0.smithi087.stdout:9/925: chown db/d18/d3a/f6b 43638957 1 2024-03-18T14:43:24.046 INFO:tasks.workunit.client.0.smithi087.stdout:9/926: chown db/d18/d3a/faf 393 1 2024-03-18T14:43:24.046 INFO:tasks.workunit.client.0.smithi087.stdout:4/787: truncate d2/d13/d28/f42 3427293 0 2024-03-18T14:43:24.052 INFO:tasks.workunit.client.0.smithi087.stdout:5/848: dwrite d13/d1b/d27/d28/f7f [0,4194304] 0 2024-03-18T14:43:24.054 INFO:tasks.workunit.client.0.smithi087.stdout:4/788: dread d2/db/d24/f58 [4194304,4194304] 0 2024-03-18T14:43:24.055 INFO:tasks.workunit.client.0.smithi087.stdout:8/799: dwrite d1/d6/d8d/f94 [0,4194304] 0 2024-03-18T14:43:24.056 INFO:tasks.workunit.client.0.smithi087.stdout:8/800: write d1/d6/d2f/d44/d4b/f108 [976679,68556] 0 2024-03-18T14:43:24.056 INFO:tasks.workunit.client.0.smithi087.stdout:9/927: creat db/d18/d1e/d28/d7c/dba/f13f x:0 0 0 2024-03-18T14:43:24.057 INFO:tasks.workunit.client.1.smithi129.stdout:7/663: write d4/d2d/d3a/f90 [830807,31967] 0 2024-03-18T14:43:24.058 INFO:tasks.workunit.client.0.smithi087.stdout:9/928: stat db/d31/f12d 0 2024-03-18T14:43:24.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/676: truncate d7/d1f/d20/d36/f9e 180306 0 2024-03-18T14:43:24.058 INFO:tasks.workunit.client.1.smithi129.stdout:4/596: dwrite d0/d19/d46/d2e/f82 [0,4194304] 0 2024-03-18T14:43:24.061 INFO:tasks.workunit.client.0.smithi087.stdout:5/849: creat d13/d1b/d27/d28/d9a/dae/f120 x:0 0 0 2024-03-18T14:43:24.062 INFO:tasks.workunit.client.1.smithi129.stdout:8/695: write d9/d11/d1a/d32/fb6 [530297,40499] 0 2024-03-18T14:43:24.062 INFO:tasks.workunit.client.0.smithi087.stdout:2/849: sync 2024-03-18T14:43:24.062 INFO:tasks.workunit.client.0.smithi087.stdout:1/879: sync 2024-03-18T14:43:24.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/841: dwrite d0/d3/d7a/fa7 [0,4194304] 0 2024-03-18T14:43:24.063 INFO:tasks.workunit.client.1.smithi129.stdout:8/696: chown d9/fe4 2 1 2024-03-18T14:43:24.063 INFO:tasks.workunit.client.0.smithi087.stdout:0/825: dwrite d0/d2/d3c/d73/fc6 [0,4194304] 0 2024-03-18T14:43:24.064 INFO:tasks.workunit.client.0.smithi087.stdout:8/801: creat d1/d6/d14/db2/f10b x:0 0 0 2024-03-18T14:43:24.065 INFO:tasks.workunit.client.1.smithi129.stdout:1/657: truncate d1/d2/d70/f9f 905422 0 2024-03-18T14:43:24.068 INFO:tasks.workunit.client.1.smithi129.stdout:5/632: dread d0/dc/d1a/d61/f6d [0,4194304] 0 2024-03-18T14:43:24.068 INFO:tasks.workunit.client.1.smithi129.stdout:6/678: unlink d3/d6/d82/cba 0 2024-03-18T14:43:24.069 INFO:tasks.workunit.client.1.smithi129.stdout:6/679: dread - d3/d6/d7f/db4/fd8 zero size 2024-03-18T14:43:24.070 INFO:tasks.workunit.client.1.smithi129.stdout:0/686: rename d0/d23/d35/d3b/cba to d0/d14/d91/cd6 0 2024-03-18T14:43:24.071 INFO:tasks.workunit.client.1.smithi129.stdout:3/633: truncate d4/dd/d1f/d5f/d31/fcf 142394 0 2024-03-18T14:43:24.072 INFO:tasks.workunit.client.1.smithi129.stdout:3/634: dread - d4/d11/d34/d3c/f9d zero size 2024-03-18T14:43:24.074 INFO:tasks.workunit.client.0.smithi087.stdout:9/929: getdents db/d18/d1e/d28/dc2/deb 0 2024-03-18T14:43:24.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/789: truncate d2/db/d82/fc7 965575 0 2024-03-18T14:43:24.076 INFO:tasks.workunit.client.1.smithi129.stdout:1/658: creat d1/d2/d28/d65/d19/d84/fc7 x:0 0 0 2024-03-18T14:43:24.076 INFO:tasks.workunit.client.1.smithi129.stdout:0/687: dwrite d0/d23/d71/dc2/d4a/fc1 [0,4194304] 0 2024-03-18T14:43:24.077 INFO:tasks.workunit.client.1.smithi129.stdout:4/597: dwrite d0/d19/d5d/fad [0,4194304] 0 2024-03-18T14:43:24.079 INFO:tasks.workunit.client.0.smithi087.stdout:6/777: sync 2024-03-18T14:43:24.079 INFO:tasks.workunit.client.0.smithi087.stdout:7/902: sync 2024-03-18T14:43:24.080 INFO:tasks.workunit.client.1.smithi129.stdout:4/598: dread - d0/d19/d5d/f8c zero size 2024-03-18T14:43:24.080 INFO:tasks.workunit.client.0.smithi087.stdout:6/778: fsync d3/f108 0 2024-03-18T14:43:24.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/903: dread - d1/d6/d29/d2f/d68/d65/d110/f130 zero size 2024-03-18T14:43:24.081 INFO:tasks.workunit.client.0.smithi087.stdout:9/930: dread db/d18/d1e/d7e/dc7/f105 [0,4194304] 0 2024-03-18T14:43:24.081 INFO:tasks.workunit.client.0.smithi087.stdout:5/850: creat d13/d1b/f121 x:0 0 0 2024-03-18T14:43:24.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/790: chown d2/db/d24/d30/d49/d4f/l73 36803 1 2024-03-18T14:43:24.086 INFO:tasks.workunit.client.0.smithi087.stdout:9/931: dwrite db/d18/d51/d8f/fdb [0,4194304] 0 2024-03-18T14:43:24.086 INFO:tasks.workunit.client.1.smithi129.stdout:2/677: rename d7/d1f/d20/d2b/d41/d65/d88/f8a to d7/d1f/d20/d36/da9/dc1/da5/dc4/fd9 0 2024-03-18T14:43:24.090 INFO:tasks.workunit.client.1.smithi129.stdout:8/697: link d9/d11/d1a/d32/d41/fa3 d9/d11/d1a/d32/d41/d4d/ddb/fec 0 2024-03-18T14:43:24.093 INFO:tasks.workunit.client.0.smithi087.stdout:1/880: dwrite d3/d1d/d1e/d43/dfb/dc8/fd9 [0,4194304] 0 2024-03-18T14:43:24.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/779: mknod d3/d7/d25/d62/d8b/c10a 0 2024-03-18T14:43:24.095 INFO:tasks.workunit.client.0.smithi087.stdout:5/851: write d13/d1b/d30/f5b [2329189,68078] 0 2024-03-18T14:43:24.096 INFO:tasks.workunit.client.0.smithi087.stdout:5/852: write d13/d1b/d27/d35/dc6/fdb [1043881,1192] 0 2024-03-18T14:43:24.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/826: write d0/d2/d4/d8b/fa6 [718791,122585] 0 2024-03-18T14:43:24.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/827: stat d0/d2 0 2024-03-18T14:43:24.098 INFO:tasks.workunit.client.1.smithi129.stdout:4/599: rmdir d0/d9 39 2024-03-18T14:43:24.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/828: write d0/d1a/de6/f117 [354787,114796] 0 2024-03-18T14:43:24.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/802: getdents d1/d6/d2f/d44/d45/d50 0 2024-03-18T14:43:24.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/803: stat d1/d6/d9/l33 0 2024-03-18T14:43:24.104 INFO:tasks.workunit.client.1.smithi129.stdout:7/664: getdents d4 0 2024-03-18T14:43:24.105 INFO:tasks.workunit.client.1.smithi129.stdout:8/698: symlink d9/d11/d1a/d14/d60/led 0 2024-03-18T14:43:24.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/600: creat d0/d19/d46/d3e/d33/fbe x:0 0 0 2024-03-18T14:43:24.108 INFO:tasks.workunit.client.0.smithi087.stdout:1/881: creat d3/d1d/d1e/d43/dfb/dc8/f10f x:0 0 0 2024-03-18T14:43:24.110 INFO:tasks.workunit.client.1.smithi129.stdout:6/680: getdents d3/d6/d7f/db4/d57 0 2024-03-18T14:43:24.110 INFO:tasks.workunit.client.0.smithi087.stdout:5/853: fsync d13/f16 0 2024-03-18T14:43:24.113 INFO:tasks.workunit.client.1.smithi129.stdout:4/601: write d0/d9/d4c/faa [91716,28146] 0 2024-03-18T14:43:24.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/681: symlink d3/d6/d7f/db4/d57/lda 0 2024-03-18T14:43:24.115 INFO:tasks.workunit.client.0.smithi087.stdout:7/904: creat d1/d6/d29/d2f/d68/d65/d60/d66/f131 x:0 0 0 2024-03-18T14:43:24.116 INFO:tasks.workunit.client.1.smithi129.stdout:8/699: dwrite d9/d11/d1a/d32/d41/fa3 [0,4194304] 0 2024-03-18T14:43:24.117 INFO:tasks.workunit.client.1.smithi129.stdout:3/635: dread d4/dd/d1f/f26 [0,4194304] 0 2024-03-18T14:43:24.121 INFO:tasks.workunit.client.0.smithi087.stdout:5/854: creat d13/d1b/d27/d98/dc2/f122 x:0 0 0 2024-03-18T14:43:24.121 INFO:tasks.workunit.client.0.smithi087.stdout:5/855: chown d13/d1b/d30/f67 24 1 2024-03-18T14:43:24.122 INFO:tasks.workunit.client.0.smithi087.stdout:0/829: symlink d0/d2/l118 0 2024-03-18T14:43:24.123 INFO:tasks.workunit.client.1.smithi129.stdout:9/652: dwrite d0/db/d1f/d20/fd0 [0,4194304] 0 2024-03-18T14:43:24.123 INFO:tasks.workunit.client.1.smithi129.stdout:4/602: mknod d0/d3c/d6c/cbf 0 2024-03-18T14:43:24.125 INFO:tasks.workunit.client.0.smithi087.stdout:1/882: creat d3/d1d/d1e/d43/d50/d71/df7/f110 x:0 0 0 2024-03-18T14:43:24.125 INFO:tasks.workunit.client.1.smithi129.stdout:5/633: dwrite d0/dc/f5b [0,4194304] 0 2024-03-18T14:43:24.127 INFO:tasks.workunit.client.1.smithi129.stdout:2/678: truncate d7/d1f/d20/d2b/d41/d65/fba 513619 0 2024-03-18T14:43:24.127 INFO:tasks.workunit.client.0.smithi087.stdout:6/780: rename d3/d7/d25/d62/d7c/f1e to d3/d7/d25/d62/f10b 0 2024-03-18T14:43:24.128 INFO:tasks.workunit.client.1.smithi129.stdout:5/634: readlink d0/dc/l29 0 2024-03-18T14:43:24.128 INFO:tasks.workunit.client.0.smithi087.stdout:2/850: dread d2/d44/d72/d79/d101/fbf [0,4194304] 0 2024-03-18T14:43:24.128 INFO:tasks.workunit.client.1.smithi129.stdout:4/603: chown d0/d19/d46/d3e/d21/d4d/l7a 0 1 2024-03-18T14:43:24.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/883: dwrite d3/d1d/f28 [0,4194304] 0 2024-03-18T14:43:24.130 INFO:tasks.workunit.client.1.smithi129.stdout:1/659: dwrite d1/d2/f1f [4194304,4194304] 0 2024-03-18T14:43:24.130 INFO:tasks.workunit.client.1.smithi129.stdout:3/636: unlink d4/dd/db0/fb2 0 2024-03-18T14:43:24.131 INFO:tasks.workunit.client.1.smithi129.stdout:0/688: dwrite d0/d23/d29/f58 [4194304,4194304] 0 2024-03-18T14:43:24.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/884: stat d3/f17 0 2024-03-18T14:43:24.131 INFO:tasks.workunit.client.0.smithi087.stdout:2/851: fdatasync d2/ddd/d22/d2c/d3a/d49/d58/f9e 0 2024-03-18T14:43:24.132 INFO:tasks.workunit.client.1.smithi129.stdout:5/635: write d0/d32/d34/f3b [2564045,103855] 0 2024-03-18T14:43:24.132 INFO:tasks.workunit.client.0.smithi087.stdout:9/932: getdents db/d18/d51/d8f 0 2024-03-18T14:43:24.133 INFO:tasks.workunit.client.1.smithi129.stdout:1/660: write d1/d2/d70/fb9 [740403,127367] 0 2024-03-18T14:43:24.134 INFO:tasks.workunit.client.0.smithi087.stdout:1/885: chown d3/d1d/d1f/d34/d38/lef 3 1 2024-03-18T14:43:24.134 INFO:tasks.workunit.client.0.smithi087.stdout:4/791: write d2/db/d84/fca [4962436,5809] 0 2024-03-18T14:43:24.135 INFO:tasks.workunit.client.0.smithi087.stdout:3/842: dwrite d0/de/d30/d46/dc3/fee [4194304,4194304] 0 2024-03-18T14:43:24.135 INFO:tasks.workunit.client.0.smithi087.stdout:5/856: creat d13/d1b/d27/d28/d9a/f123 x:0 0 0 2024-03-18T14:43:24.136 INFO:tasks.workunit.client.0.smithi087.stdout:4/792: write d2/dc2/fd0 [3982976,103262] 0 2024-03-18T14:43:24.136 INFO:tasks.workunit.client.0.smithi087.stdout:0/830: symlink d0/d1a/d34/d3d/dd6/l119 0 2024-03-18T14:43:24.137 INFO:tasks.workunit.client.0.smithi087.stdout:5/857: chown d13/d1b/d30/c33 41473 1 2024-03-18T14:43:24.137 INFO:tasks.workunit.client.1.smithi129.stdout:4/604: dread d0/d9/d6a/d7b/fa6 [0,4194304] 0 2024-03-18T14:43:24.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/831: stat d0/d2/d4/d27/dc3/dd2/dff 0 2024-03-18T14:43:24.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/832: chown d0/d2/d4/d27 104749379 1 2024-03-18T14:43:24.139 INFO:tasks.workunit.client.1.smithi129.stdout:7/665: dread d4/d2d/d2e/d45/f4c [0,4194304] 0 2024-03-18T14:43:24.139 INFO:tasks.workunit.client.1.smithi129.stdout:1/661: dwrite d1/f40 [4194304,4194304] 0 2024-03-18T14:43:24.140 INFO:tasks.workunit.client.1.smithi129.stdout:1/662: stat d1/d2/d28/f81 0 2024-03-18T14:43:24.141 INFO:tasks.workunit.client.1.smithi129.stdout:9/653: rename d0/db/d1f/d20 to d0/db/d11/d97/dd1 0 2024-03-18T14:43:24.141 INFO:tasks.workunit.client.0.smithi087.stdout:4/793: dwrite d2/db/d24/d30/f100 [0,4194304] 0 2024-03-18T14:43:24.141 INFO:tasks.workunit.client.0.smithi087.stdout:7/905: creat d1/d6/d29/d2f/d68/d65/d60/d109/f132 x:0 0 0 2024-03-18T14:43:24.144 INFO:tasks.workunit.client.0.smithi087.stdout:2/852: mknod d2/d44/d72/d8a/c119 0 2024-03-18T14:43:24.150 INFO:tasks.workunit.client.1.smithi129.stdout:3/637: creat d4/d38/da3/db1/fd5 x:0 0 0 2024-03-18T14:43:24.150 INFO:tasks.workunit.client.0.smithi087.stdout:3/843: mkdir d0/d3/d10/da5/df5 0 2024-03-18T14:43:24.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/636: unlink d0/f67 0 2024-03-18T14:43:24.151 INFO:tasks.workunit.client.0.smithi087.stdout:0/833: readlink d0/d1a/l101 0 2024-03-18T14:43:24.154 INFO:tasks.workunit.client.0.smithi087.stdout:1/886: read d3/d1d/d1e/d43/d9b/fb7 [422865,10784] 0 2024-03-18T14:43:24.155 INFO:tasks.workunit.client.0.smithi087.stdout:3/844: dwrite d0/d1c/d25/fc6 [0,4194304] 0 2024-03-18T14:43:24.156 INFO:tasks.workunit.client.0.smithi087.stdout:1/887: write d3/d1d/d1e/d20/d7a/db4/fc9 [247058,69013] 0 2024-03-18T14:43:24.157 INFO:tasks.workunit.client.1.smithi129.stdout:4/605: chown d0/d19/f84 1 1 2024-03-18T14:43:24.159 INFO:tasks.workunit.client.1.smithi129.stdout:0/689: rename d0/c8 to d0/d23/d35/d50/cd7 0 2024-03-18T14:43:24.160 INFO:tasks.workunit.client.0.smithi087.stdout:4/794: rename d2/db/de/f2c to d2/db/d7a/f106 0 2024-03-18T14:43:24.161 INFO:tasks.workunit.client.1.smithi129.stdout:0/690: write d0/d23/d35/d3b/d42/dc0/fc5 [49960,99762] 0 2024-03-18T14:43:24.161 INFO:tasks.workunit.client.0.smithi087.stdout:4/795: readlink d2/db/d24/d30/d49/d4f/l73 0 2024-03-18T14:43:24.163 INFO:tasks.workunit.client.1.smithi129.stdout:3/638: read d4/dd/d1f/d5f/d31/f49 [3866917,36121] 0 2024-03-18T14:43:24.165 INFO:tasks.workunit.client.1.smithi129.stdout:7/666: mknod d4/d2d/d2e/cd3 0 2024-03-18T14:43:24.165 INFO:tasks.workunit.client.0.smithi087.stdout:8/804: truncate d1/d6/d14/db2/fe1 1256165 0 2024-03-18T14:43:24.166 INFO:tasks.workunit.client.0.smithi087.stdout:8/805: fsync d1/d6/d9/fdd 0 2024-03-18T14:43:24.166 INFO:tasks.workunit.client.1.smithi129.stdout:9/654: symlink d0/db/d1f/dae/db8/ld2 0 2024-03-18T14:43:24.166 INFO:tasks.workunit.client.0.smithi087.stdout:2/853: mkdir d2/ddd/d22/d2c/d3a/d40/d52/d11a 0 2024-03-18T14:43:24.167 INFO:tasks.workunit.client.0.smithi087.stdout:9/933: readlink db/d18/d1e/dde/lf3 0 2024-03-18T14:43:24.167 INFO:tasks.workunit.client.1.smithi129.stdout:3/639: rmdir d4/d11/d1d 39 2024-03-18T14:43:24.167 INFO:tasks.workunit.client.0.smithi087.stdout:5/858: fdatasync d13/f5f 0 2024-03-18T14:43:24.168 INFO:tasks.workunit.client.0.smithi087.stdout:5/859: write d13/d1b/d70/da8/f10c [298184,58961] 0 2024-03-18T14:43:24.168 INFO:tasks.workunit.client.1.smithi129.stdout:4/606: mkdir d0/d19/d46/d3e/dc0 0 2024-03-18T14:43:24.169 INFO:tasks.workunit.client.0.smithi087.stdout:0/834: symlink d0/d2/d4/d27/dc3/dd2/l11a 0 2024-03-18T14:43:24.170 INFO:tasks.workunit.client.0.smithi087.stdout:6/781: creat d3/d7/d25/d62/d7c/da0/f10c x:0 0 0 2024-03-18T14:43:24.170 INFO:tasks.workunit.client.1.smithi129.stdout:7/667: creat d4/d2d/d2e/d79/dc6/d38/d49/fd4 x:0 0 0 2024-03-18T14:43:24.171 INFO:tasks.workunit.client.0.smithi087.stdout:7/906: rmdir d1/d6/da/de3 39 2024-03-18T14:43:24.171 INFO:tasks.workunit.client.0.smithi087.stdout:6/782: fdatasync d3/d7/d25/d62/d7c/d29/d7d/fb1 0 2024-03-18T14:43:24.171 INFO:tasks.workunit.client.1.smithi129.stdout:9/655: symlink d0/db/d90/d70/d93/ld3 0 2024-03-18T14:43:24.172 INFO:tasks.workunit.client.1.smithi129.stdout:3/640: mknod d4/dd/d1f/da8/cd6 0 2024-03-18T14:43:24.174 INFO:tasks.workunit.client.1.smithi129.stdout:7/668: fdatasync d4/d2d/d2e/d79/dc6/d8/d3b/f40 0 2024-03-18T14:43:24.178 INFO:tasks.workunit.client.1.smithi129.stdout:9/656: mkdir d0/db/d11/d97/dd1/d6c/dd4 0 2024-03-18T14:43:24.179 INFO:tasks.workunit.client.1.smithi129.stdout:9/657: read d0/db/d11/d97/dd1/fd0 [889010,43116] 0 2024-03-18T14:43:24.180 INFO:tasks.workunit.client.1.smithi129.stdout:0/691: getdents d0/d14/d28/d63/d8d 0 2024-03-18T14:43:24.182 INFO:tasks.workunit.client.0.smithi087.stdout:9/934: unlink db/d18/d1c/d69/d6f/ca0 0 2024-03-18T14:43:24.182 INFO:tasks.workunit.client.0.smithi087.stdout:5/860: fsync d13/d1b/d30/f49 0 2024-03-18T14:43:24.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/835: mkdir d0/d2/d4/de8/dad/dea/da3/da8/d11b 0 2024-03-18T14:43:24.184 INFO:tasks.workunit.client.0.smithi087.stdout:7/907: creat d1/d6/d16/dc/f133 x:0 0 0 2024-03-18T14:43:24.185 INFO:tasks.workunit.client.0.smithi087.stdout:9/935: dread - db/d18/d1e/d28/d76/db7/dd5/f12f zero size 2024-03-18T14:43:24.185 INFO:tasks.workunit.client.1.smithi129.stdout:3/641: creat d4/d11/d1d/d50/d90/dac/fd7 x:0 0 0 2024-03-18T14:43:24.186 INFO:tasks.workunit.client.1.smithi129.stdout:9/658: mkdir d0/db/d11/d97/dd1/d26/d19/dd5 0 2024-03-18T14:43:24.188 INFO:tasks.workunit.client.0.smithi087.stdout:9/936: read db/d18/d1e/d7e/db8/f13d [417380,85775] 0 2024-03-18T14:43:24.188 INFO:tasks.workunit.client.0.smithi087.stdout:5/861: write d13/d1b/d27/fa0 [3307003,4709] 0 2024-03-18T14:43:24.188 INFO:tasks.workunit.client.0.smithi087.stdout:6/783: dwrite d3/d7/d25/d8e/fdd [0,4194304] 0 2024-03-18T14:43:24.189 INFO:tasks.workunit.client.0.smithi087.stdout:0/836: mknod d0/d2/d4/de8/dad/dea/da3/c11c 0 2024-03-18T14:43:24.191 INFO:tasks.workunit.client.0.smithi087.stdout:0/837: write d0/d2/d3c/f69 [901022,65163] 0 2024-03-18T14:43:24.191 INFO:tasks.workunit.client.1.smithi129.stdout:9/659: mknod d0/da1/dc1/cd6 0 2024-03-18T14:43:24.191 INFO:tasks.workunit.client.0.smithi087.stdout:7/908: dread d1/d97/db9/f10e [0,4194304] 0 2024-03-18T14:43:24.191 INFO:tasks.workunit.client.0.smithi087.stdout:8/806: getdents d1/d6/d2f/d44/d45/d72/d7f/d83 0 2024-03-18T14:43:24.192 INFO:tasks.workunit.client.1.smithi129.stdout:7/669: dread d4/d2d/d2e/d79/dc6/d54/f9a [0,4194304] 0 2024-03-18T14:43:24.193 INFO:tasks.workunit.client.0.smithi087.stdout:7/909: write d1/d6/da/fcf [1381971,31585] 0 2024-03-18T14:43:24.193 INFO:tasks.workunit.client.1.smithi129.stdout:6/682: dwrite d3/d30/f26 [4194304,4194304] 0 2024-03-18T14:43:24.193 INFO:tasks.workunit.client.1.smithi129.stdout:0/692: getdents d0/d23 0 2024-03-18T14:43:24.194 INFO:tasks.workunit.client.1.smithi129.stdout:3/642: link d4/dd/d1f/d5f/d31/f49 d4/dd/d1f/d5f/d82/da6/fd8 0 2024-03-18T14:43:24.195 INFO:tasks.workunit.client.1.smithi129.stdout:0/693: write d0/d23/d71/faa [772185,124298] 0 2024-03-18T14:43:24.195 INFO:tasks.workunit.client.1.smithi129.stdout:2/679: write d7/d1f/d20/d2a/f5a [2603719,115784] 0 2024-03-18T14:43:24.196 INFO:tasks.workunit.client.1.smithi129.stdout:0/694: write d0/d23/d6b/f8b [298366,28892] 0 2024-03-18T14:43:24.199 INFO:tasks.workunit.client.0.smithi087.stdout:5/862: creat d13/d1b/d70/dce/f124 x:0 0 0 2024-03-18T14:43:24.200 INFO:tasks.workunit.client.0.smithi087.stdout:5/863: stat d13/d1b/d27/d35/f4f 0 2024-03-18T14:43:24.200 INFO:tasks.workunit.client.1.smithi129.stdout:9/660: unlink d0/db/d2e/d9d/cc7 0 2024-03-18T14:43:24.201 INFO:tasks.workunit.client.1.smithi129.stdout:6/683: chown d3/d30/df/d28/c8b 27783775 1 2024-03-18T14:43:24.202 INFO:tasks.workunit.client.1.smithi129.stdout:8/700: truncate d9/d33/fc5 980086 0 2024-03-18T14:43:24.206 INFO:tasks.workunit.client.1.smithi129.stdout:3/643: stat d4/dd/f4d 0 2024-03-18T14:43:24.207 INFO:tasks.workunit.client.0.smithi087.stdout:3/845: dread d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:24.207 INFO:tasks.workunit.client.1.smithi129.stdout:9/661: mkdir d0/d15/dd7 0 2024-03-18T14:43:24.208 INFO:tasks.workunit.client.1.smithi129.stdout:9/662: read - d0/db/d2e/d9d/fba zero size 2024-03-18T14:43:24.209 INFO:tasks.workunit.client.1.smithi129.stdout:6/684: mkdir d3/d30/de/d6c/ddb 0 2024-03-18T14:43:24.211 INFO:tasks.workunit.client.0.smithi087.stdout:1/888: truncate d3/d1d/d1e/d43/d50/f58 5793498 0 2024-03-18T14:43:24.212 INFO:tasks.workunit.client.0.smithi087.stdout:4/796: write d2/db/d24/d30/f5c [4156667,15974] 0 2024-03-18T14:43:24.213 INFO:tasks.workunit.client.1.smithi129.stdout:2/680: mkdir d7/d1f/d20/dda 0 2024-03-18T14:43:24.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/681: readlink d7/d1f/d20/d36/da9/dc1/l13 0 2024-03-18T14:43:24.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/682: chown d7/d1c/d7b 3779155 1 2024-03-18T14:43:24.216 INFO:tasks.workunit.client.0.smithi087.stdout:4/797: dwrite d2/db/d24/d30/d7b/d7f/fee [0,4194304] 0 2024-03-18T14:43:24.217 INFO:tasks.workunit.client.1.smithi129.stdout:8/701: dread d9/d11/d1a/d32/d3a/f20 [0,4194304] 0 2024-03-18T14:43:24.219 INFO:tasks.workunit.client.1.smithi129.stdout:1/663: dwrite d1/d2/d70/d56/f6f [4194304,4194304] 0 2024-03-18T14:43:24.222 INFO:tasks.workunit.client.1.smithi129.stdout:5/637: write d0/f36 [2672379,33419] 0 2024-03-18T14:43:24.222 INFO:tasks.workunit.client.1.smithi129.stdout:5/638: stat d0/dc/d1a/ca0 0 2024-03-18T14:43:24.223 INFO:tasks.workunit.client.0.smithi087.stdout:7/910: rmdir d1 39 2024-03-18T14:43:24.227 INFO:tasks.workunit.client.1.smithi129.stdout:4/607: dwrite d0/f88 [0,4194304] 0 2024-03-18T14:43:24.229 INFO:tasks.workunit.client.1.smithi129.stdout:7/670: write d4/d2d/d3a/f78 [5184965,5126] 0 2024-03-18T14:43:24.229 INFO:tasks.workunit.client.1.smithi129.stdout:0/695: truncate d0/d23/d35/d3b/f79 1959305 0 2024-03-18T14:43:24.230 INFO:tasks.workunit.client.0.smithi087.stdout:8/807: rename d1/d6/d14/db2/f104 to d1/d6/d8d/dcd/f10c 0 2024-03-18T14:43:24.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/846: creat d0/de/d30/d67/ff6 x:0 0 0 2024-03-18T14:43:24.231 INFO:tasks.workunit.client.1.smithi129.stdout:7/671: dread - d4/d2d/d2e/d79/dc6/d54/fbf zero size 2024-03-18T14:43:24.231 INFO:tasks.workunit.client.0.smithi087.stdout:8/808: stat d1/d6/d9/f7a 0 2024-03-18T14:43:24.231 INFO:tasks.workunit.client.1.smithi129.stdout:9/663: symlink d0/db/d1f/ld8 0 2024-03-18T14:43:24.232 INFO:tasks.workunit.client.1.smithi129.stdout:3/644: truncate d4/d11/f62 3091473 0 2024-03-18T14:43:24.233 INFO:tasks.workunit.client.0.smithi087.stdout:0/838: creat d0/dab/d113/f11d x:0 0 0 2024-03-18T14:43:24.234 INFO:tasks.workunit.client.1.smithi129.stdout:2/683: rename d7/d1f/d20/d2b/cb8 to d7/d1f/d20/d2d/d7e/cdb 0 2024-03-18T14:43:24.236 INFO:tasks.workunit.client.0.smithi087.stdout:8/809: read d1/d6/d9/f60 [2124154,130671] 0 2024-03-18T14:43:24.238 INFO:tasks.workunit.client.1.smithi129.stdout:6/685: creat d3/fdc x:0 0 0 2024-03-18T14:43:24.239 INFO:tasks.workunit.client.1.smithi129.stdout:0/696: rmdir d0/d23/d71/dc2/d4a/d7a 39 2024-03-18T14:43:24.239 INFO:tasks.workunit.client.0.smithi087.stdout:9/937: getdents db/d18/d51 0 2024-03-18T14:43:24.240 INFO:tasks.workunit.client.1.smithi129.stdout:7/672: write d4/d2d/d2e/d79/dc6/d8/fcf [1778521,26709] 0 2024-03-18T14:43:24.242 INFO:tasks.workunit.client.0.smithi087.stdout:3/847: mknod d0/de/d30/d46/d76/cf7 0 2024-03-18T14:43:24.244 INFO:tasks.workunit.client.1.smithi129.stdout:3/645: readlink d4/d11/d1d/d50/d90/l9a 0 2024-03-18T14:43:24.245 INFO:tasks.workunit.client.0.smithi087.stdout:6/784: getdents d3/dcd 0 2024-03-18T14:43:24.245 INFO:tasks.workunit.client.1.smithi129.stdout:7/673: dwrite d4/d2d/d2e/d45/f55 [4194304,4194304] 0 2024-03-18T14:43:24.246 INFO:tasks.workunit.client.0.smithi087.stdout:2/854: sync 2024-03-18T14:43:24.246 INFO:tasks.workunit.client.0.smithi087.stdout:3/848: dwrite d0/d3/df/f33 [0,4194304] 0 2024-03-18T14:43:24.247 INFO:tasks.workunit.client.0.smithi087.stdout:3/849: chown d0/d1c/f39 28354 1 2024-03-18T14:43:24.248 INFO:tasks.workunit.client.0.smithi087.stdout:8/810: mknod d1/d6/d9/d5d/d87/dd1/c10d 0 2024-03-18T14:43:24.248 INFO:tasks.workunit.client.1.smithi129.stdout:4/608: rename d0/d19/d46/d3e/d21/d4d/d70/f23 to d0/d3c/fc1 0 2024-03-18T14:43:24.250 INFO:tasks.workunit.client.1.smithi129.stdout:9/664: dread d0/db/d11/d97/dd1/d26/f2a [0,4194304] 0 2024-03-18T14:43:24.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/864: getdents d13/d1b/d30/d6e/dc8 0 2024-03-18T14:43:24.256 INFO:tasks.workunit.client.1.smithi129.stdout:1/664: mkdir d1/db2/dc3/dc8 0 2024-03-18T14:43:24.259 INFO:tasks.workunit.client.1.smithi129.stdout:0/697: dread d0/f72 [0,4194304] 0 2024-03-18T14:43:24.261 INFO:tasks.workunit.client.1.smithi129.stdout:7/674: mkdir d4/d8c/dd5 0 2024-03-18T14:43:24.262 INFO:tasks.workunit.client.1.smithi129.stdout:3/646: symlink d4/d38/da3/dc9/da9/ld9 0 2024-03-18T14:43:24.263 INFO:tasks.workunit.client.0.smithi087.stdout:9/938: dread db/d31/fd3 [0,4194304] 0 2024-03-18T14:43:24.264 INFO:tasks.workunit.client.0.smithi087.stdout:6/785: symlink d3/d7/d25/d8e/l10d 0 2024-03-18T14:43:24.265 INFO:tasks.workunit.client.0.smithi087.stdout:0/839: rename d0/d1a/d7b/ldb to d0/d1a/l11e 0 2024-03-18T14:43:24.265 INFO:tasks.workunit.client.1.smithi129.stdout:3/647: dread - d4/d11/d1d/fb5 zero size 2024-03-18T14:43:24.265 INFO:tasks.workunit.client.1.smithi129.stdout:7/675: dread d4/d2d/d2e/d79/dc6/d54/f9a [4194304,4194304] 0 2024-03-18T14:43:24.265 INFO:tasks.workunit.client.1.smithi129.stdout:7/676: stat d4/d2d/d2e/d79/dc6/d54/c91 0 2024-03-18T14:43:24.266 INFO:tasks.workunit.client.0.smithi087.stdout:6/786: read d3/d7/d25/d62/f10b [4296575,122665] 0 2024-03-18T14:43:24.269 INFO:tasks.workunit.client.0.smithi087.stdout:4/798: write d2/db/de/d8b/fa6 [339595,37241] 0 2024-03-18T14:43:24.269 INFO:tasks.workunit.client.0.smithi087.stdout:3/850: dwrite d0/de/d30/f7c [0,4194304] 0 2024-03-18T14:43:24.269 INFO:tasks.workunit.client.1.smithi129.stdout:7/677: dwrite d4/d8c/f9b [0,4194304] 0 2024-03-18T14:43:24.269 INFO:tasks.workunit.client.1.smithi129.stdout:9/665: mkdir d0/db/d2e/dd9 0 2024-03-18T14:43:24.270 INFO:tasks.workunit.client.0.smithi087.stdout:8/811: dread d1/fd [4194304,4194304] 0 2024-03-18T14:43:24.271 INFO:tasks.workunit.client.0.smithi087.stdout:5/865: rename d13/d1b/l63 to d13/d1b/d27/d28/d9a/dae/l125 0 2024-03-18T14:43:24.272 INFO:tasks.workunit.client.0.smithi087.stdout:0/840: creat d0/d2/d4/d19/d5a/f11f x:0 0 0 2024-03-18T14:43:24.274 INFO:tasks.workunit.client.1.smithi129.stdout:8/702: getdents d9/d11/d18 0 2024-03-18T14:43:24.275 INFO:tasks.workunit.client.0.smithi087.stdout:6/787: mkdir d3/d7/d25/d10e 0 2024-03-18T14:43:24.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/698: creat d0/d23/d35/d3b/fd8 x:0 0 0 2024-03-18T14:43:24.275 INFO:tasks.workunit.client.1.smithi129.stdout:3/648: mknod d4/d11/d1d/d50/d91/d93/cda 0 2024-03-18T14:43:24.276 INFO:tasks.workunit.client.0.smithi087.stdout:4/799: creat d2/db/d3c/d90/f107 x:0 0 0 2024-03-18T14:43:24.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/889: dread d3/f93 [0,4194304] 0 2024-03-18T14:43:24.277 INFO:tasks.workunit.client.1.smithi129.stdout:6/686: dread d3/d30/de/d6c/f31 [0,4194304] 0 2024-03-18T14:43:24.278 INFO:tasks.workunit.client.0.smithi087.stdout:2/855: dread d2/d44/d72/d79/f9c [0,4194304] 0 2024-03-18T14:43:24.278 INFO:tasks.workunit.client.0.smithi087.stdout:7/911: truncate d1/d6/da/f25 2980208 0 2024-03-18T14:43:24.279 INFO:tasks.workunit.client.0.smithi087.stdout:4/800: chown d2/db/d24/d30/d7b/d7f/f68 12 1 2024-03-18T14:43:24.280 INFO:tasks.workunit.client.0.smithi087.stdout:2/856: chown d2/ddd/d22/d2c/d3a/d40/f84 506 1 2024-03-18T14:43:24.281 INFO:tasks.workunit.client.0.smithi087.stdout:2/857: readlink d2/l14 0 2024-03-18T14:43:24.281 INFO:tasks.workunit.client.1.smithi129.stdout:5/639: sync 2024-03-18T14:43:24.281 INFO:tasks.workunit.client.1.smithi129.stdout:9/666: dread - d0/db/d1f/d4c/d57/f63 zero size 2024-03-18T14:43:24.282 INFO:tasks.workunit.client.1.smithi129.stdout:9/667: write d0/db/d11/d97/d99/db2/fc0 [219111,60969] 0 2024-03-18T14:43:24.283 INFO:tasks.workunit.client.1.smithi129.stdout:4/609: creat d0/d3c/d6c/d89/fc2 x:0 0 0 2024-03-18T14:43:24.283 INFO:tasks.workunit.client.1.smithi129.stdout:2/684: write d7/d1f/d20/d2b/d41/f6f [664329,22408] 0 2024-03-18T14:43:24.284 INFO:tasks.workunit.client.1.smithi129.stdout:4/610: chown d0/d9/d40/d5f/cbc 807391 1 2024-03-18T14:43:24.284 INFO:tasks.workunit.client.0.smithi087.stdout:2/858: chown d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/f116 0 1 2024-03-18T14:43:24.284 INFO:tasks.workunit.client.0.smithi087.stdout:7/912: dwrite d1/f31 [0,4194304] 0 2024-03-18T14:43:24.285 INFO:tasks.workunit.client.0.smithi087.stdout:9/939: dwrite db/d18/d3a/f47 [0,4194304] 0 2024-03-18T14:43:24.285 INFO:tasks.workunit.client.0.smithi087.stdout:1/890: unlink d3/d1d/d1f/d34/f53 0 2024-03-18T14:43:24.285 INFO:tasks.workunit.client.0.smithi087.stdout:5/866: mknod d13/d1b/d70/dce/d107/c126 0 2024-03-18T14:43:24.287 INFO:tasks.workunit.client.0.smithi087.stdout:5/867: chown d13/d1b/d70/dce/f106 66 1 2024-03-18T14:43:24.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/685: dwrite d7/d1f/d81/fcc [0,4194304] 0 2024-03-18T14:43:24.289 INFO:tasks.workunit.client.1.smithi129.stdout:1/665: rename d1/d2/d70 to d1/d2/d28/d65/d19/dc9 0 2024-03-18T14:43:24.290 INFO:tasks.workunit.client.0.smithi087.stdout:6/788: rename d3/d7/d25/d62/d7c/d29/d22/f80 to d3/d7/d25/d62/d7c/d29/dce/dd9/f10f 0 2024-03-18T14:43:24.290 INFO:tasks.workunit.client.0.smithi087.stdout:4/801: chown d2/db/d24/d30/d7b/d7f/da5/db4/db7/ld7 4044 1 2024-03-18T14:43:24.290 INFO:tasks.workunit.client.1.smithi129.stdout:7/678: dread d4/d2d/d2e/f41 [0,4194304] 0 2024-03-18T14:43:24.290 INFO:tasks.workunit.client.0.smithi087.stdout:6/789: chown d3/d7/d25/d62/d7c/l63 185533 1 2024-03-18T14:43:24.291 INFO:tasks.workunit.client.0.smithi087.stdout:8/812: link d1/d6/d2f/d44/d45/d71/fc8 d1/d6/d2f/d44/d4b/da5/f10e 0 2024-03-18T14:43:24.295 INFO:tasks.workunit.client.1.smithi129.stdout:2/686: write d7/d1f/d20/d2b/d41/da6/f9b [1051479,11940] 0 2024-03-18T14:43:24.296 INFO:tasks.workunit.client.1.smithi129.stdout:7/679: dwrite d4/d2d/d3a/f53 [0,4194304] 0 2024-03-18T14:43:24.296 INFO:tasks.workunit.client.1.smithi129.stdout:8/703: dwrite d9/f1b [0,4194304] 0 2024-03-18T14:43:24.296 INFO:tasks.workunit.client.1.smithi129.stdout:7/680: stat d4/f87 0 2024-03-18T14:43:24.297 INFO:tasks.workunit.client.1.smithi129.stdout:0/699: rename d0/d14/d91/fd1 to d0/d23/d71/dcd/fd9 0 2024-03-18T14:43:24.300 INFO:tasks.workunit.client.1.smithi129.stdout:4/611: mkdir d0/d19/d46/d3e/d21/d4d/d70/dc3 0 2024-03-18T14:43:24.300 INFO:tasks.workunit.client.1.smithi129.stdout:4/612: dread - d0/d9/d6a/d7b/fae zero size 2024-03-18T14:43:24.303 INFO:tasks.workunit.client.1.smithi129.stdout:2/687: chown d7/d1c/l8c 23 1 2024-03-18T14:43:24.303 INFO:tasks.workunit.client.0.smithi087.stdout:2/859: rmdir d2/ddd/d22/d24/d91 39 2024-03-18T14:43:24.304 INFO:tasks.workunit.client.0.smithi087.stdout:9/940: mkdir db/d18/d1c/d69/d6f/d140 0 2024-03-18T14:43:24.305 INFO:tasks.workunit.client.1.smithi129.stdout:2/688: fdatasync d7/d1f/d20/d2b/d41/d65/d88/fd0 0 2024-03-18T14:43:24.305 INFO:tasks.workunit.client.1.smithi129.stdout:2/689: readlink d7/l64 0 2024-03-18T14:43:24.305 INFO:tasks.workunit.client.0.smithi087.stdout:6/790: rename d3/f45 to d3/d7/d25/d8e/f110 0 2024-03-18T14:43:24.305 INFO:tasks.workunit.client.0.smithi087.stdout:5/868: write d13/d1b/d70/fdf [310817,32488] 0 2024-03-18T14:43:24.305 INFO:tasks.workunit.client.1.smithi129.stdout:2/690: read - d7/d1f/d20/d2b/d41/d65/d88/fd0 zero size 2024-03-18T14:43:24.306 INFO:tasks.workunit.client.1.smithi129.stdout:3/649: link d4/dd/d1f/d5f/d31/f49 d4/dd/d1f/d5f/fdb 0 2024-03-18T14:43:24.306 INFO:tasks.workunit.client.0.smithi087.stdout:5/869: write d13/d1b/d27/d28/f77 [3702807,127218] 0 2024-03-18T14:43:24.309 INFO:tasks.workunit.client.0.smithi087.stdout:4/802: dread d2/f36 [0,4194304] 0 2024-03-18T14:43:24.309 INFO:tasks.workunit.client.0.smithi087.stdout:3/851: dwrite d0/d3/f7 [0,4194304] 0 2024-03-18T14:43:24.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/913: mkdir d1/d6/da/d59/dbe/d11a/dd4/d134 0 2024-03-18T14:43:24.316 INFO:tasks.workunit.client.0.smithi087.stdout:2/860: mknod d2/d44/d72/d79/d101/c11b 0 2024-03-18T14:43:24.316 INFO:tasks.workunit.client.0.smithi087.stdout:5/870: creat d13/d1b/d27/d35/d3b/f127 x:0 0 0 2024-03-18T14:43:24.317 INFO:tasks.workunit.client.0.smithi087.stdout:4/803: chown d2/d13/d28/c54 51038 1 2024-03-18T14:43:24.318 INFO:tasks.workunit.client.0.smithi087.stdout:5/871: write d13/d1b/d27/d98/fd9 [354490,68202] 0 2024-03-18T14:43:24.318 INFO:tasks.workunit.client.0.smithi087.stdout:4/804: dread - d2/db/d24/d30/d56/fab zero size 2024-03-18T14:43:24.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/872: write d13/d1b/f10e [725687,98943] 0 2024-03-18T14:43:24.319 INFO:tasks.workunit.client.0.smithi087.stdout:3/852: mkdir d0/de/d30/d67/df8 0 2024-03-18T14:43:24.319 INFO:tasks.workunit.client.0.smithi087.stdout:4/805: dread - d2/d13/fec zero size 2024-03-18T14:43:24.324 INFO:tasks.workunit.client.0.smithi087.stdout:6/791: getdents d3/dcd/ddb 0 2024-03-18T14:43:24.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/861: symlink d2/ddd/d22/d2c/d3a/d49/d58/l11c 0 2024-03-18T14:43:24.326 INFO:tasks.workunit.client.0.smithi087.stdout:0/841: truncate d0/d2/d4/de8/dad/ffd 2044074 0 2024-03-18T14:43:24.327 INFO:tasks.workunit.client.1.smithi129.stdout:1/666: creat d1/d2/d28/d65/d19/fca x:0 0 0 2024-03-18T14:43:24.327 INFO:tasks.workunit.client.1.smithi129.stdout:7/681: creat d4/d2d/d3a/fd6 x:0 0 0 2024-03-18T14:43:24.328 INFO:tasks.workunit.client.1.smithi129.stdout:5/640: truncate d0/dc/d18/f1d 3009597 0 2024-03-18T14:43:24.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/873: creat d13/d1b/d70/f128 x:0 0 0 2024-03-18T14:43:24.328 INFO:tasks.workunit.client.1.smithi129.stdout:8/704: getdents d9/d33/dc2 0 2024-03-18T14:43:24.331 INFO:tasks.workunit.client.0.smithi087.stdout:9/941: write db/f3d [1565860,75702] 0 2024-03-18T14:43:24.332 INFO:tasks.workunit.client.1.smithi129.stdout:1/667: symlink d1/d35/db8/lcb 0 2024-03-18T14:43:24.333 INFO:tasks.workunit.client.0.smithi087.stdout:9/942: dread - db/d18/d1e/d28/d76/de0/fe4 zero size 2024-03-18T14:43:24.333 INFO:tasks.workunit.client.0.smithi087.stdout:3/853: mknod d0/de/d30/d46/d76/cf9 0 2024-03-18T14:43:24.334 INFO:tasks.workunit.client.1.smithi129.stdout:3/650: rename d4/dd/d1f/d2f/c72 to d4/d11/d1d/d50/d91/d93/cdc 0 2024-03-18T14:43:24.334 INFO:tasks.workunit.client.0.smithi087.stdout:8/813: dwrite d1/d6/d2f/d44/d45/d72/d7f/ff3 [0,4194304] 0 2024-03-18T14:43:24.335 INFO:tasks.workunit.client.0.smithi087.stdout:9/943: write db/d18/d1c/d69/fbe [492679,68720] 0 2024-03-18T14:43:24.336 INFO:tasks.workunit.client.0.smithi087.stdout:4/806: rename d2/f21 to d2/db/d24/d30/d7b/dbe/dcf/dda/ddb/f108 0 2024-03-18T14:43:24.336 INFO:tasks.workunit.client.0.smithi087.stdout:6/792: fdatasync d3/f74 0 2024-03-18T14:43:24.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/842: readlink d0/d1a/lb4 0 2024-03-18T14:43:24.338 INFO:tasks.workunit.client.1.smithi129.stdout:5/641: creat d0/d32/d34/fba x:0 0 0 2024-03-18T14:43:24.339 INFO:tasks.workunit.client.1.smithi129.stdout:8/705: write d9/d11/d18/f3f [562242,98478] 0 2024-03-18T14:43:24.339 INFO:tasks.workunit.client.1.smithi129.stdout:5/642: chown d0/dc/f5b 1271039989 1 2024-03-18T14:43:24.342 INFO:tasks.workunit.client.0.smithi087.stdout:4/807: dwrite d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:24.342 INFO:tasks.workunit.client.1.smithi129.stdout:2/691: truncate d7/f58 3430179 0 2024-03-18T14:43:24.342 INFO:tasks.workunit.client.0.smithi087.stdout:5/874: dread d13/d1b/d27/d28/f78 [0,4194304] 0 2024-03-18T14:43:24.343 INFO:tasks.workunit.client.0.smithi087.stdout:5/875: fsync d13/d1b/d27/d28/d9a/dae/f120 0 2024-03-18T14:43:24.344 INFO:tasks.workunit.client.1.smithi129.stdout:7/682: write d4/d2d/d2e/d79/dc6/fc3 [2977203,63239] 0 2024-03-18T14:43:24.344 INFO:tasks.workunit.client.0.smithi087.stdout:8/814: unlink d1/d6/d9/f77 0 2024-03-18T14:43:24.345 INFO:tasks.workunit.client.0.smithi087.stdout:2/862: mkdir d2/d44/d72/de0/d11d 0 2024-03-18T14:43:24.346 INFO:tasks.workunit.client.0.smithi087.stdout:8/815: write d1/d6/d2f/d44/d45/d50/fd5 [4910299,95426] 0 2024-03-18T14:43:24.347 INFO:tasks.workunit.client.0.smithi087.stdout:1/891: sync 2024-03-18T14:43:24.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/668: creat d1/dbf/fcc x:0 0 0 2024-03-18T14:43:24.348 INFO:tasks.workunit.client.0.smithi087.stdout:3/854: rename d0/d3/d40/f78 to d0/d3/d4f/d6e/dc8/ffa 0 2024-03-18T14:43:24.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/944: chown db/d18/d1e/d28/dc2/dec/cf8 198 1 2024-03-18T14:43:24.350 INFO:tasks.workunit.client.1.smithi129.stdout:2/692: dread d7/d1f/d20/d2d/f2e [0,4194304] 0 2024-03-18T14:43:24.350 INFO:tasks.workunit.client.1.smithi129.stdout:7/683: mknod d4/d2d/d2e/d79/dc6/d38/d49/cd7 0 2024-03-18T14:43:24.350 INFO:tasks.workunit.client.1.smithi129.stdout:2/693: readlink d7/d1c/l8c 0 2024-03-18T14:43:24.350 INFO:tasks.workunit.client.1.smithi129.stdout:7/684: chown d4/d83 33233883 1 2024-03-18T14:43:24.354 INFO:tasks.workunit.client.1.smithi129.stdout:5/643: creat d0/dc/d1a/d61/d94/db7/fbb x:0 0 0 2024-03-18T14:43:24.354 INFO:tasks.workunit.client.1.smithi129.stdout:3/651: creat d4/d11/d34/fdd x:0 0 0 2024-03-18T14:43:24.355 INFO:tasks.workunit.client.1.smithi129.stdout:7/685: write d4/d2d/d2e/d79/dc6/f64 [4198460,61962] 0 2024-03-18T14:43:24.356 INFO:tasks.workunit.client.1.smithi129.stdout:7/686: stat d4/d8c/fcc 0 2024-03-18T14:43:24.356 INFO:tasks.workunit.client.1.smithi129.stdout:1/669: mknod d1/d2/d28/d65/d19/dc9/d87/dc0/ccd 0 2024-03-18T14:43:24.356 INFO:tasks.workunit.client.1.smithi129.stdout:7/687: write d4/fd1 [573269,24286] 0 2024-03-18T14:43:24.357 INFO:tasks.workunit.client.0.smithi087.stdout:7/914: getdents d1/d6 0 2024-03-18T14:43:24.358 INFO:tasks.workunit.client.1.smithi129.stdout:5/644: creat d0/dc/d22/fbc x:0 0 0 2024-03-18T14:43:24.358 INFO:tasks.workunit.client.1.smithi129.stdout:2/694: truncate d7/d1f/d20/d36/da9/dc1/f15 3891674 0 2024-03-18T14:43:24.359 INFO:tasks.workunit.client.0.smithi087.stdout:5/876: fsync d13/d1b/d30/f7d 0 2024-03-18T14:43:24.360 INFO:tasks.workunit.client.1.smithi129.stdout:2/695: read d7/d1f/f4c [60552,94730] 0 2024-03-18T14:43:24.360 INFO:tasks.workunit.client.1.smithi129.stdout:1/670: mkdir d1/dbf/dce 0 2024-03-18T14:43:24.361 INFO:tasks.workunit.client.1.smithi129.stdout:7/688: rmdir d4/d2d/d2e/d42/d58 39 2024-03-18T14:43:24.361 INFO:tasks.workunit.client.1.smithi129.stdout:7/689: stat d4/c5b 0 2024-03-18T14:43:24.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/645: creat d0/dc/d1a/fbd x:0 0 0 2024-03-18T14:43:24.363 INFO:tasks.workunit.client.0.smithi087.stdout:1/892: creat d3/d1d/d1e/d43/da3/f111 x:0 0 0 2024-03-18T14:43:24.363 INFO:tasks.workunit.client.1.smithi129.stdout:5/646: fdatasync d0/d32/d3a/d52/f90 0 2024-03-18T14:43:24.364 INFO:tasks.workunit.client.0.smithi087.stdout:1/893: stat d3/d1d/d1e/d43/dfb/cdd 0 2024-03-18T14:43:24.364 INFO:tasks.workunit.client.0.smithi087.stdout:4/808: dread d2/d13/d28/f70 [0,4194304] 0 2024-03-18T14:43:24.365 INFO:tasks.workunit.client.0.smithi087.stdout:2/863: rename d2/ddd/d22/d2c/d3a/d40/d52/c90 to d2/d44/d72/d79/c11e 0 2024-03-18T14:43:24.366 INFO:tasks.workunit.client.0.smithi087.stdout:9/945: creat db/d18/d3a/d113/f141 x:0 0 0 2024-03-18T14:43:24.367 INFO:tasks.workunit.client.0.smithi087.stdout:7/915: dread d1/d6/d16/f4e [0,4194304] 0 2024-03-18T14:43:24.370 INFO:tasks.workunit.client.1.smithi129.stdout:7/690: creat d4/fd8 x:0 0 0 2024-03-18T14:43:24.372 INFO:tasks.workunit.client.1.smithi129.stdout:1/671: link d1/d2/d28/d65/d19/d52/fa2 d1/d35/d7a/fcf 0 2024-03-18T14:43:24.372 INFO:tasks.workunit.client.0.smithi087.stdout:5/877: mkdir d13/d1b/d30/d6e/d88/db4/d129 0 2024-03-18T14:43:24.374 INFO:tasks.workunit.client.1.smithi129.stdout:5/647: creat d0/dc/d1a/fbe x:0 0 0 2024-03-18T14:43:24.374 INFO:tasks.workunit.client.0.smithi087.stdout:1/894: rmdir d3/d1d/d1f/dab 39 2024-03-18T14:43:24.375 INFO:tasks.workunit.client.0.smithi087.stdout:1/895: chown d3/d1d/d1e/f37 13 1 2024-03-18T14:43:24.376 INFO:tasks.workunit.client.0.smithi087.stdout:4/809: creat d2/db/d3c/d90/f109 x:0 0 0 2024-03-18T14:43:24.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/810: stat d2/db/d24/d30/d7b/dbe/dcf 0 2024-03-18T14:43:24.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/811: chown d2/db/l48 391 1 2024-03-18T14:43:24.378 INFO:tasks.workunit.client.0.smithi087.stdout:0/843: link d0/d1a/d34/d3d/c67 d0/d2/d4/de8/c120 0 2024-03-18T14:43:24.380 INFO:tasks.workunit.client.1.smithi129.stdout:5/648: rmdir d0/dc/d18/d2b/d8c 39 2024-03-18T14:43:24.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/668: sync 2024-03-18T14:43:24.380 INFO:tasks.workunit.client.1.smithi129.stdout:6/687: sync 2024-03-18T14:43:24.380 INFO:tasks.workunit.client.1.smithi129.stdout:2/696: truncate d7/d1f/d20/d2b/d41/d65/fad 505460 0 2024-03-18T14:43:24.382 INFO:tasks.workunit.client.1.smithi129.stdout:7/691: write d4/fd1 [822332,109294] 0 2024-03-18T14:43:24.382 INFO:tasks.workunit.client.1.smithi129.stdout:1/672: mkdir d1/db2/dc3/dc8/dd0 0 2024-03-18T14:43:24.382 INFO:tasks.workunit.client.0.smithi087.stdout:2/864: dread d2/ddd/d22/d2c/d3a/d76/d81/f82 [0,4194304] 0 2024-03-18T14:43:24.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/793: truncate d3/d7/d25/d62/d7c/d29/d22/d61/f70 8335136 0 2024-03-18T14:43:24.383 INFO:tasks.workunit.client.1.smithi129.stdout:5/649: unlink d0/ce 0 2024-03-18T14:43:24.386 INFO:tasks.workunit.client.0.smithi087.stdout:7/916: rename d1/d6/d29/d2f/dac to d1/d6/d29/d2f/d68/d65/d110/d135 0 2024-03-18T14:43:24.387 INFO:tasks.workunit.client.0.smithi087.stdout:8/816: creat d1/d6/d2f/d44/d45/d72/f10f x:0 0 0 2024-03-18T14:43:24.388 INFO:tasks.workunit.client.1.smithi129.stdout:5/650: dwrite d0/d32/d3a/d52/d69/d8a/fa7 [0,4194304] 0 2024-03-18T14:43:24.388 INFO:tasks.workunit.client.1.smithi129.stdout:6/688: rename d3/d30/de/d49/f50 to d3/d30/de/da9/fdd 0 2024-03-18T14:43:24.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/878: creat d13/d1b/d27/d35/da7/f12a x:0 0 0 2024-03-18T14:43:24.389 INFO:tasks.workunit.client.0.smithi087.stdout:1/896: mkdir d3/d1d/d1e/d43/dfb/d112 0 2024-03-18T14:43:24.390 INFO:tasks.workunit.client.1.smithi129.stdout:9/669: fdatasync d0/db/d2e/d9f/faa 0 2024-03-18T14:43:24.390 INFO:tasks.workunit.client.0.smithi087.stdout:9/946: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:24.395 INFO:tasks.workunit.client.0.smithi087.stdout:1/897: dread d3/d1d/d1f/f5d [0,4194304] 0 2024-03-18T14:43:24.395 INFO:tasks.workunit.client.0.smithi087.stdout:4/812: dread d2/db/d24/d30/d7b/dbe/fa8 [0,4194304] 0 2024-03-18T14:43:24.396 INFO:tasks.workunit.client.1.smithi129.stdout:7/692: unlink d4/d2d/d2e/d79/dc6/d8/d3b/fc7 0 2024-03-18T14:43:24.396 INFO:tasks.workunit.client.0.smithi087.stdout:5/879: creat d13/d1b/d70/f12b x:0 0 0 2024-03-18T14:43:24.397 INFO:tasks.workunit.client.1.smithi129.stdout:7/693: dread - d4/d2d/d2e/d42/fa2 zero size 2024-03-18T14:43:24.397 INFO:tasks.workunit.client.1.smithi129.stdout:9/670: mkdir d0/db/d6f/dda 0 2024-03-18T14:43:24.397 INFO:tasks.workunit.client.0.smithi087.stdout:0/844: dread d0/d2/d4/de8/dad/dea/f96 [0,4194304] 0 2024-03-18T14:43:24.398 INFO:tasks.workunit.client.0.smithi087.stdout:2/865: mknod d2/ddd/d22/d2c/d3a/d49/c11f 0 2024-03-18T14:43:24.399 INFO:tasks.workunit.client.1.smithi129.stdout:5/651: symlink d0/dc/d1a/db9/lbf 0 2024-03-18T14:43:24.399 INFO:tasks.workunit.client.1.smithi129.stdout:5/652: chown d0/dc/d1a/d61/d94/la5 483628 1 2024-03-18T14:43:24.399 INFO:tasks.workunit.client.1.smithi129.stdout:6/689: symlink d3/d30/lde 0 2024-03-18T14:43:24.400 INFO:tasks.workunit.client.1.smithi129.stdout:1/673: truncate d1/d2/d28/d65/d7c/d7d/fa5 877785 0 2024-03-18T14:43:24.401 INFO:tasks.workunit.client.0.smithi087.stdout:0/845: dwrite d0/d2/d3c/f69 [0,4194304] 0 2024-03-18T14:43:24.402 INFO:tasks.workunit.client.0.smithi087.stdout:8/817: unlink d1/d6/lcb 0 2024-03-18T14:43:24.402 INFO:tasks.workunit.client.1.smithi129.stdout:2/697: getdents d7/d1c/d32 0 2024-03-18T14:43:24.404 INFO:tasks.workunit.client.1.smithi129.stdout:7/694: unlink d4/d2d/d2e/d42/c95 0 2024-03-18T14:43:24.405 INFO:tasks.workunit.client.0.smithi087.stdout:3/855: sync 2024-03-18T14:43:24.405 INFO:tasks.workunit.client.1.smithi129.stdout:9/671: symlink d0/db/d11/d97/ldb 0 2024-03-18T14:43:24.406 INFO:tasks.workunit.client.1.smithi129.stdout:8/706: sync 2024-03-18T14:43:24.406 INFO:tasks.workunit.client.1.smithi129.stdout:0/700: sync 2024-03-18T14:43:24.406 INFO:tasks.workunit.client.1.smithi129.stdout:4/613: sync 2024-03-18T14:43:24.406 INFO:tasks.workunit.client.1.smithi129.stdout:6/690: write d3/d30/de/d65/d80/fd9 [139826,101757] 0 2024-03-18T14:43:24.409 INFO:tasks.workunit.client.0.smithi087.stdout:7/917: write d1/d6/d29/d2f/d68/d65/d60/d66/f90 [1794385,129532] 0 2024-03-18T14:43:24.410 INFO:tasks.workunit.client.1.smithi129.stdout:5/653: creat d0/d32/d3a/d45/d83/d9b/fc0 x:0 0 0 2024-03-18T14:43:24.410 INFO:tasks.workunit.client.1.smithi129.stdout:9/672: dwrite d0/db/d2e/d9d/fa7 [0,4194304] 0 2024-03-18T14:43:24.412 INFO:tasks.workunit.client.1.smithi129.stdout:1/674: rmdir d1/d2/d28/d65/d19/dc9/d87 39 2024-03-18T14:43:24.412 INFO:tasks.workunit.client.0.smithi087.stdout:6/794: rename d3/d7/d25/d62/d7c/f9a to d3/d7/d25/d62/f111 0 2024-03-18T14:43:24.415 INFO:tasks.workunit.client.1.smithi129.stdout:2/698: rmdir d7/d1f/d20/d2b/d41/da6 39 2024-03-18T14:43:24.416 INFO:tasks.workunit.client.1.smithi129.stdout:7/695: readlink d4/d8c/l89 0 2024-03-18T14:43:24.416 INFO:tasks.workunit.client.0.smithi087.stdout:3/856: creat d0/de/d30/dc5/ffb x:0 0 0 2024-03-18T14:43:24.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/880: getdents d13/d1b/d30/d6e/d88/db4/d129 0 2024-03-18T14:43:24.417 INFO:tasks.workunit.client.0.smithi087.stdout:5/881: chown d13/d1b/d27 322036309 1 2024-03-18T14:43:24.418 INFO:tasks.workunit.client.1.smithi129.stdout:0/701: creat d0/d23/d35/d50/fda x:0 0 0 2024-03-18T14:43:24.421 INFO:tasks.workunit.client.1.smithi129.stdout:9/673: creat d0/d15/fdc x:0 0 0 2024-03-18T14:43:24.423 INFO:tasks.workunit.client.0.smithi087.stdout:9/947: truncate db/d31/fd3 2580115 0 2024-03-18T14:43:24.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/948: readlink db/d12/lfd 0 2024-03-18T14:43:24.425 INFO:tasks.workunit.client.1.smithi129.stdout:5/654: rename d0/dc/d1a/d61/d94/fae to d0/dc/d1a/d61/d94/fc1 0 2024-03-18T14:43:24.426 INFO:tasks.workunit.client.0.smithi087.stdout:6/795: creat d3/d7/d25/d62/d7c/da0/d96/d97/dc6/f112 x:0 0 0 2024-03-18T14:43:24.426 INFO:tasks.workunit.client.0.smithi087.stdout:9/949: fdatasync db/d18/d1c/f50 0 2024-03-18T14:43:24.428 INFO:tasks.workunit.client.0.smithi087.stdout:3/857: mkdir d0/d3/df/d42/dfc 0 2024-03-18T14:43:24.429 INFO:tasks.workunit.client.0.smithi087.stdout:5/882: creat d13/d1b/d70/da8/f12c x:0 0 0 2024-03-18T14:43:24.430 INFO:tasks.workunit.client.0.smithi087.stdout:1/898: dwrite d3/d1d/d67/f88 [0,4194304] 0 2024-03-18T14:43:24.430 INFO:tasks.workunit.client.0.smithi087.stdout:8/818: dwrite d1/f2 [0,4194304] 0 2024-03-18T14:43:24.430 INFO:tasks.workunit.client.0.smithi087.stdout:9/950: write db/d18/d1e/d7e/db8/fe7 [631276,122796] 0 2024-03-18T14:43:24.431 INFO:tasks.workunit.client.0.smithi087.stdout:0/846: rename d0/dab/cc1 to d0/d2/d4/d8b/c121 0 2024-03-18T14:43:24.432 INFO:tasks.workunit.client.0.smithi087.stdout:2/866: rmdir d2/ddd/dca/dec 0 2024-03-18T14:43:24.433 INFO:tasks.workunit.client.0.smithi087.stdout:0/847: write d0/d1a/d34/d3d/fc9 [525458,109298] 0 2024-03-18T14:43:24.437 INFO:tasks.workunit.client.0.smithi087.stdout:6/796: creat d3/d7/d25/d62/d7c/d29/d22/d75/d92/f113 x:0 0 0 2024-03-18T14:43:24.443 INFO:tasks.workunit.client.0.smithi087.stdout:1/899: mkdir d3/d1d/d79/d113 0 2024-03-18T14:43:24.444 INFO:tasks.workunit.client.1.smithi129.stdout:6/691: creat d3/d30/d44/fdf x:0 0 0 2024-03-18T14:43:24.444 INFO:tasks.workunit.client.1.smithi129.stdout:0/702: creat d0/d23/d35/d3b/d42/dc0/fdb x:0 0 0 2024-03-18T14:43:24.445 INFO:tasks.workunit.client.1.smithi129.stdout:9/674: creat d0/db/d11/d97/dd1/d25/fdd x:0 0 0 2024-03-18T14:43:24.445 INFO:tasks.workunit.client.0.smithi087.stdout:1/900: dread - d3/d1d/d79/fd7 zero size 2024-03-18T14:43:24.446 INFO:tasks.workunit.client.0.smithi087.stdout:8/819: dread - d1/d6/d2f/d44/d45/d50/fd2 zero size 2024-03-18T14:43:24.446 INFO:tasks.workunit.client.0.smithi087.stdout:4/813: dread d2/db/d24/feb [4194304,4194304] 0 2024-03-18T14:43:24.446 INFO:tasks.workunit.client.1.smithi129.stdout:2/699: creat d7/d1f/d20/d72/fdc x:0 0 0 2024-03-18T14:43:24.446 INFO:tasks.workunit.client.1.smithi129.stdout:8/707: truncate d9/d11/d1a/f77 2499002 0 2024-03-18T14:43:24.447 INFO:tasks.workunit.client.0.smithi087.stdout:4/814: dread - d2/db/d3c/d90/f107 zero size 2024-03-18T14:43:24.447 INFO:tasks.workunit.client.0.smithi087.stdout:7/918: truncate d1/d6/da/ff 8613571 0 2024-03-18T14:43:24.447 INFO:tasks.workunit.client.1.smithi129.stdout:3/652: sync 2024-03-18T14:43:24.449 INFO:tasks.workunit.client.1.smithi129.stdout:4/614: write d0/f13 [1645451,85217] 0 2024-03-18T14:43:24.450 INFO:tasks.workunit.client.0.smithi087.stdout:1/901: dwrite d3/d1d/d67/f88 [0,4194304] 0 2024-03-18T14:43:24.452 INFO:tasks.workunit.client.0.smithi087.stdout:6/797: mkdir d3/d7/d25/d114 0 2024-03-18T14:43:24.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/675: rename d1/d2/d28/l4d to d1/d2/d28/d65/d19/dc9/d87/ld1 0 2024-03-18T14:43:24.453 INFO:tasks.workunit.client.0.smithi087.stdout:3/858: creat d0/d3/ffd x:0 0 0 2024-03-18T14:43:24.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/676: chown d1/c6e 121 1 2024-03-18T14:43:24.454 INFO:tasks.workunit.client.0.smithi087.stdout:8/820: stat d1/d6/l4e 0 2024-03-18T14:43:24.454 INFO:tasks.workunit.client.1.smithi129.stdout:9/675: mknod d0/db/d11/d97/d99/cde 0 2024-03-18T14:43:24.454 INFO:tasks.workunit.client.0.smithi087.stdout:4/815: dwrite d2/db/d84/d87/f88 [0,4194304] 0 2024-03-18T14:43:24.455 INFO:tasks.workunit.client.1.smithi129.stdout:7/696: dread d4/d2d/d2e/d42/d58/f67 [0,4194304] 0 2024-03-18T14:43:24.455 INFO:tasks.workunit.client.1.smithi129.stdout:9/676: write d0/db/f1d [3445927,40809] 0 2024-03-18T14:43:24.458 INFO:tasks.workunit.client.0.smithi087.stdout:1/902: symlink d3/de4/l114 0 2024-03-18T14:43:24.459 INFO:tasks.workunit.client.0.smithi087.stdout:1/903: stat d3/f93 0 2024-03-18T14:43:24.461 INFO:tasks.workunit.client.0.smithi087.stdout:9/951: creat db/d18/f142 x:0 0 0 2024-03-18T14:43:24.463 INFO:tasks.workunit.client.0.smithi087.stdout:2/867: dread d2/ddd/f6a [0,4194304] 0 2024-03-18T14:43:24.464 INFO:tasks.workunit.client.1.smithi129.stdout:3/653: symlink d4/d38/da3/dc9/lde 0 2024-03-18T14:43:24.466 INFO:tasks.workunit.client.1.smithi129.stdout:1/677: symlink d1/d35/db8/ld2 0 2024-03-18T14:43:24.466 INFO:tasks.workunit.client.1.smithi129.stdout:2/700: creat d7/d1f/d81/dd4/fdd x:0 0 0 2024-03-18T14:43:24.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/708: mknod d9/cee 0 2024-03-18T14:43:24.467 INFO:tasks.workunit.client.1.smithi129.stdout:8/709: stat d9/f1b 0 2024-03-18T14:43:24.468 INFO:tasks.workunit.client.1.smithi129.stdout:8/710: dread - d9/d11/d18/da4/fcf zero size 2024-03-18T14:43:24.469 INFO:tasks.workunit.client.1.smithi129.stdout:4/615: dwrite d0/f1c [0,4194304] 0 2024-03-18T14:43:24.469 INFO:tasks.workunit.client.0.smithi087.stdout:1/904: creat d3/d1d/d67/d94/f115 x:0 0 0 2024-03-18T14:43:24.469 INFO:tasks.workunit.client.1.smithi129.stdout:8/711: stat d9/d11/d1a/d32/de8 0 2024-03-18T14:43:24.470 INFO:tasks.workunit.client.1.smithi129.stdout:4/616: chown d0/d9/d6a/db1 1001226 1 2024-03-18T14:43:24.470 INFO:tasks.workunit.client.0.smithi087.stdout:0/848: getdents d0/d2/da9 0 2024-03-18T14:43:24.471 INFO:tasks.workunit.client.1.smithi129.stdout:9/677: rename d0/db/d11/d97/dd1/c24 to d0/db/d11/cdf 0 2024-03-18T14:43:24.471 INFO:tasks.workunit.client.0.smithi087.stdout:0/849: write d0/d2/d4/d27/dc3/dd2/f112 [979200,96627] 0 2024-03-18T14:43:24.472 INFO:tasks.workunit.client.1.smithi129.stdout:5/655: symlink d0/d32/lc2 0 2024-03-18T14:43:24.473 INFO:tasks.workunit.client.1.smithi129.stdout:4/617: dread d0/d19/d5d/fad [0,4194304] 0 2024-03-18T14:43:24.473 INFO:tasks.workunit.client.0.smithi087.stdout:8/821: dread d1/d6/f1e [0,4194304] 0 2024-03-18T14:43:24.474 INFO:tasks.workunit.client.1.smithi129.stdout:0/703: symlink d0/d23/d71/dc2/d4a/d7a/ldc 0 2024-03-18T14:43:24.477 INFO:tasks.workunit.client.1.smithi129.stdout:7/697: creat d4/d8c/dd5/fd9 x:0 0 0 2024-03-18T14:43:24.477 INFO:tasks.workunit.client.0.smithi087.stdout:1/905: dread d3/d1d/d1e/d43/dfb/f84 [0,4194304] 0 2024-03-18T14:43:24.477 INFO:tasks.workunit.client.1.smithi129.stdout:7/698: chown d4/d2d/d2e/d79/dc6/d8 7 1 2024-03-18T14:43:24.479 INFO:tasks.workunit.client.0.smithi087.stdout:6/798: mkdir d3/d7/d25/d10e/d115 0 2024-03-18T14:43:24.479 INFO:tasks.workunit.client.1.smithi129.stdout:6/692: write d3/d5/f13 [1587049,3447] 0 2024-03-18T14:43:24.481 INFO:tasks.workunit.client.0.smithi087.stdout:3/859: fsync d0/d3/df/d42/fa6 0 2024-03-18T14:43:24.481 INFO:tasks.workunit.client.0.smithi087.stdout:3/860: readlink d0/d3/d4f/l9e 0 2024-03-18T14:43:24.485 INFO:tasks.workunit.client.0.smithi087.stdout:7/919: dread d1/d6/da/d59/dbe/fd8 [0,4194304] 0 2024-03-18T14:43:24.486 INFO:tasks.workunit.client.0.smithi087.stdout:0/850: rmdir d0/d2/d4/de8/dad/dea/da3 39 2024-03-18T14:43:24.488 INFO:tasks.workunit.client.0.smithi087.stdout:8/822: dread - d1/d6/d9/d5d/d87/fb9 zero size 2024-03-18T14:43:24.491 INFO:tasks.workunit.client.1.smithi129.stdout:3/654: write d4/d38/da3/fc8 [1769537,91803] 0 2024-03-18T14:43:24.491 INFO:tasks.workunit.client.1.smithi129.stdout:1/678: write d1/d35/f9c [176074,130928] 0 2024-03-18T14:43:24.493 INFO:tasks.workunit.client.1.smithi129.stdout:2/701: getdents d7/d1c/d79/dd5 0 2024-03-18T14:43:24.495 INFO:tasks.workunit.client.0.smithi087.stdout:3/861: unlink d0/d3/d7a/ff1 0 2024-03-18T14:43:24.496 INFO:tasks.workunit.client.0.smithi087.stdout:9/952: dread db/d18/d3a/f59 [0,4194304] 0 2024-03-18T14:43:24.497 INFO:tasks.workunit.client.0.smithi087.stdout:4/816: rename d2/db/d82/le9 to d2/db/d3c/l10a 0 2024-03-18T14:43:24.497 INFO:tasks.workunit.client.1.smithi129.stdout:4/618: symlink d0/lc4 0 2024-03-18T14:43:24.498 INFO:tasks.workunit.client.0.smithi087.stdout:1/906: write d3/d1d/f28 [4513954,112633] 0 2024-03-18T14:43:24.499 INFO:tasks.workunit.client.0.smithi087.stdout:2/868: truncate d2/ddd/d22/d2c/d3a/d40/d52/fae 198817 0 2024-03-18T14:43:24.501 INFO:tasks.workunit.client.1.smithi129.stdout:7/699: link d4/d2d/d2e/d45/fd0 d4/d8c/fda 0 2024-03-18T14:43:24.501 INFO:tasks.workunit.client.0.smithi087.stdout:4/817: dread d2/db/d24/d30/d7b/dbe/fa8 [0,4194304] 0 2024-03-18T14:43:24.501 INFO:tasks.workunit.client.0.smithi087.stdout:7/920: rmdir d1/d6/d29/d2f/d6b 39 2024-03-18T14:43:24.502 INFO:tasks.workunit.client.1.smithi129.stdout:5/656: dread d0/dc/d18/d2b/fb3 [0,4194304] 0 2024-03-18T14:43:24.506 INFO:tasks.workunit.client.0.smithi087.stdout:5/883: sync 2024-03-18T14:43:24.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/884: write d13/d1b/f10e [1444424,85112] 0 2024-03-18T14:43:24.510 INFO:tasks.workunit.client.0.smithi087.stdout:6/799: truncate d3/d7/d25/d62/d7c/d46/dc9/fda 3831395 0 2024-03-18T14:43:24.511 INFO:tasks.workunit.client.1.smithi129.stdout:6/693: rename d3/d30/f26 to d3/d30/de/d65/d80/fe0 0 2024-03-18T14:43:24.511 INFO:tasks.workunit.client.1.smithi129.stdout:9/678: write d0/db/d1f/f4e [462010,25004] 0 2024-03-18T14:43:24.512 INFO:tasks.workunit.client.1.smithi129.stdout:8/712: creat d9/d33/fef x:0 0 0 2024-03-18T14:43:24.512 INFO:tasks.workunit.client.1.smithi129.stdout:4/619: rmdir d0/d19/d46/d3e/d33 39 2024-03-18T14:43:24.513 INFO:tasks.workunit.client.1.smithi129.stdout:3/655: fdatasync d4/dd/d1f/d5f/d31/f49 0 2024-03-18T14:43:24.514 INFO:tasks.workunit.client.1.smithi129.stdout:0/704: link d0/d14/f5f d0/d14/d53/dc9/fdd 0 2024-03-18T14:43:24.514 INFO:tasks.workunit.client.0.smithi087.stdout:7/921: creat d1/d6/d16/dc/ddc/f136 x:0 0 0 2024-03-18T14:43:24.515 INFO:tasks.workunit.client.0.smithi087.stdout:8/823: creat d1/d6/d14/f110 x:0 0 0 2024-03-18T14:43:24.516 INFO:tasks.workunit.client.1.smithi129.stdout:0/705: readlink d0/d23/d71/dc2/d4a/d7a/lcf 0 2024-03-18T14:43:24.516 INFO:tasks.workunit.client.0.smithi087.stdout:3/862: creat d0/de/d30/d67/df8/ffe x:0 0 0 2024-03-18T14:43:24.518 INFO:tasks.workunit.client.0.smithi087.stdout:9/953: mknod db/d18/d1e/d28/d76/de0/c143 0 2024-03-18T14:43:24.519 INFO:tasks.workunit.client.1.smithi129.stdout:5/657: dwrite d0/dc/d18/d2b/d71/fa9 [0,4194304] 0 2024-03-18T14:43:24.519 INFO:tasks.workunit.client.1.smithi129.stdout:6/694: creat d3/d5/d46/fe1 x:0 0 0 2024-03-18T14:43:24.519 INFO:tasks.workunit.client.0.smithi087.stdout:5/885: symlink d13/d1b/d70/dce/l12d 0 2024-03-18T14:43:24.520 INFO:tasks.workunit.client.1.smithi129.stdout:2/702: write d7/d1f/d20/d2b/d41/f5e [2342467,70840] 0 2024-03-18T14:43:24.522 INFO:tasks.workunit.client.1.smithi129.stdout:3/656: chown d4/c5 18 1 2024-03-18T14:43:24.523 INFO:tasks.workunit.client.0.smithi087.stdout:0/851: truncate d0/d1a/d7b/d2a/ffc 837688 0 2024-03-18T14:43:24.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/620: symlink d0/d19/d46/d3e/d21/lc5 0 2024-03-18T14:43:24.524 INFO:tasks.workunit.client.1.smithi129.stdout:4/621: write d0/d9/d40/fbd [148336,112405] 0 2024-03-18T14:43:24.526 INFO:tasks.workunit.client.0.smithi087.stdout:8/824: rename d1/d6/d2f/d44/d45/d72/d7f/d83 to d1/d6/d14/db2/dbc/d111 0 2024-03-18T14:43:24.527 INFO:tasks.workunit.client.1.smithi129.stdout:3/657: dwrite d4/dd/d1f/d2f/f69 [0,4194304] 0 2024-03-18T14:43:24.527 INFO:tasks.workunit.client.1.smithi129.stdout:5/658: creat d0/d32/d3a/d52/d6e/fc3 x:0 0 0 2024-03-18T14:43:24.530 INFO:tasks.workunit.client.1.smithi129.stdout:7/700: dread d4/d2d/d2e/d79/dc6/d8/f3f [0,4194304] 0 2024-03-18T14:43:24.530 INFO:tasks.workunit.client.1.smithi129.stdout:2/703: creat d7/d1f/d20/d2d/dab/fde x:0 0 0 2024-03-18T14:43:24.531 INFO:tasks.workunit.client.1.smithi129.stdout:7/701: readlink d4/d2d/d2e/d42/l8e 0 2024-03-18T14:43:24.531 INFO:tasks.workunit.client.1.smithi129.stdout:7/702: stat d4/d2d/d2e/cd3 0 2024-03-18T14:43:24.531 INFO:tasks.workunit.client.0.smithi087.stdout:7/922: write d1/fdb [1465778,51097] 0 2024-03-18T14:43:24.532 INFO:tasks.workunit.client.0.smithi087.stdout:7/923: read - d1/d6/d16/dc/ddc/f136 zero size 2024-03-18T14:43:24.532 INFO:tasks.workunit.client.1.smithi129.stdout:6/695: write d3/d30/f95 [601989,106835] 0 2024-03-18T14:43:24.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/863: mkdir d0/de/d30/d60/ddb/dff 0 2024-03-18T14:43:24.535 INFO:tasks.workunit.client.1.smithi129.stdout:3/658: mknod d4/dd/db0/dc3/cdf 0 2024-03-18T14:43:24.536 INFO:tasks.workunit.client.1.smithi129.stdout:3/659: write d4/d38/f1c [3533582,36694] 0 2024-03-18T14:43:24.538 INFO:tasks.workunit.client.1.smithi129.stdout:6/696: unlink d3/d6/d7f/db4/c39 0 2024-03-18T14:43:24.540 INFO:tasks.workunit.client.0.smithi087.stdout:1/907: link d3/d1d/d1f/c31 d3/d1d/d1e/d43/d50/d71/c116 0 2024-03-18T14:43:24.541 INFO:tasks.workunit.client.0.smithi087.stdout:4/818: creat d2/db/f10b x:0 0 0 2024-03-18T14:43:24.544 INFO:tasks.workunit.client.0.smithi087.stdout:2/869: link d2/ddd/d22/d2c/d3a/d40/f84 d2/ddd/d22/d24/d91/f120 0 2024-03-18T14:43:24.544 INFO:tasks.workunit.client.1.smithi129.stdout:4/622: creat d0/d19/d46/d3e/d21/d4d/d70/fc6 x:0 0 0 2024-03-18T14:43:24.545 INFO:tasks.workunit.client.0.smithi087.stdout:6/800: write d3/d7/d25/d62/d7c/f9e [862482,55221] 0 2024-03-18T14:43:24.545 INFO:tasks.workunit.client.0.smithi087.stdout:2/870: chown d2/ddd/d22/d2c/c64 4 1 2024-03-18T14:43:24.546 INFO:tasks.workunit.client.0.smithi087.stdout:4/819: dwrite d2/db/d24/d30/d7b/d7f/da5/db4/f101 [0,4194304] 0 2024-03-18T14:43:24.546 INFO:tasks.workunit.client.1.smithi129.stdout:2/704: creat d7/d1f/d20/fdf x:0 0 0 2024-03-18T14:43:24.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/852: creat d0/d1a/d7b/d26/f122 x:0 0 0 2024-03-18T14:43:24.548 INFO:tasks.workunit.client.1.smithi129.stdout:3/660: creat d4/d11/d1d/d50/d91/d93/fe0 x:0 0 0 2024-03-18T14:43:24.550 INFO:tasks.workunit.client.0.smithi087.stdout:8/825: unlink d1/d6/d9/d5d/d87/da2/df0/lfe 0 2024-03-18T14:43:24.550 INFO:tasks.workunit.client.0.smithi087.stdout:7/924: chown d1/d6/d29/d2f/c77 935 1 2024-03-18T14:43:24.551 INFO:tasks.workunit.client.0.smithi087.stdout:8/826: chown d1/d6/d14/l47 702010 1 2024-03-18T14:43:24.552 INFO:tasks.workunit.client.0.smithi087.stdout:3/864: symlink d0/d3/d4f/d6e/dc8/l100 0 2024-03-18T14:43:24.552 INFO:tasks.workunit.client.1.smithi129.stdout:8/713: dread d9/d11/d1a/d32/d41/d4d/f5b [0,4194304] 0 2024-03-18T14:43:24.553 INFO:tasks.workunit.client.0.smithi087.stdout:9/954: creat db/d18/d1c/d69/f144 x:0 0 0 2024-03-18T14:43:24.555 INFO:tasks.workunit.client.1.smithi129.stdout:2/705: fdatasync d7/f59 0 2024-03-18T14:43:24.555 INFO:tasks.workunit.client.0.smithi087.stdout:2/871: creat d2/d44/d72/de0/f121 x:0 0 0 2024-03-18T14:43:24.556 INFO:tasks.workunit.client.0.smithi087.stdout:7/925: dwrite d1/d6/d29/d2f/d68/d65/d60/d66/f131 [0,4194304] 0 2024-03-18T14:43:24.556 INFO:tasks.workunit.client.0.smithi087.stdout:6/801: symlink d3/d7/d25/d62/d7c/d46/dc9/l116 0 2024-03-18T14:43:24.556 INFO:tasks.workunit.client.1.smithi129.stdout:6/697: truncate d3/fdc 256374 0 2024-03-18T14:43:24.556 INFO:tasks.workunit.client.1.smithi129.stdout:5/659: dread d0/dc/d1a/d61/d94/fc1 [0,4194304] 0 2024-03-18T14:43:24.557 INFO:tasks.workunit.client.1.smithi129.stdout:0/706: dread d0/d23/d71/f96 [0,4194304] 0 2024-03-18T14:43:24.557 INFO:tasks.workunit.client.0.smithi087.stdout:4/820: creat d2/db/d24/d30/d7b/d7f/f10c x:0 0 0 2024-03-18T14:43:24.558 INFO:tasks.workunit.client.1.smithi129.stdout:5/660: chown d0/dc/d18/d5f/f86 266 1 2024-03-18T14:43:24.558 INFO:tasks.workunit.client.0.smithi087.stdout:4/821: fsync d2/d13/fec 0 2024-03-18T14:43:24.558 INFO:tasks.workunit.client.1.smithi129.stdout:5/661: stat d0/d32/d3a/d52/d69 0 2024-03-18T14:43:24.559 INFO:tasks.workunit.client.0.smithi087.stdout:4/822: write d2/d13/d28/f2d [3811224,64843] 0 2024-03-18T14:43:24.560 INFO:tasks.workunit.client.0.smithi087.stdout:8/827: stat d1/d6/d8d/dc2/fd8 0 2024-03-18T14:43:24.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/865: mkdir d0/d3/d7a/d101 0 2024-03-18T14:43:24.563 INFO:tasks.workunit.client.1.smithi129.stdout:9/679: truncate d0/f1b 1033096 0 2024-03-18T14:43:24.563 INFO:tasks.workunit.client.0.smithi087.stdout:3/866: fsync d0/de/d30/f7c 0 2024-03-18T14:43:24.564 INFO:tasks.workunit.client.1.smithi129.stdout:3/661: rmdir d4/dd 39 2024-03-18T14:43:24.567 INFO:tasks.workunit.client.1.smithi129.stdout:7/703: dwrite d4/d2d/d2e/d79/dc6/ff [0,4194304] 0 2024-03-18T14:43:24.567 INFO:tasks.workunit.client.0.smithi087.stdout:6/802: dread d3/d7/d25/d62/d7c/d29/d7d/fb1 [0,4194304] 0 2024-03-18T14:43:24.569 INFO:tasks.workunit.client.1.smithi129.stdout:5/662: mkdir d0/d32/d3a/d45/d83/d9b/dc4 0 2024-03-18T14:43:24.569 INFO:tasks.workunit.client.0.smithi087.stdout:5/886: getdents d13/d1b/d27/d28 0 2024-03-18T14:43:24.569 INFO:tasks.workunit.client.1.smithi129.stdout:5/663: write d0/d32/d34/fba [266051,79009] 0 2024-03-18T14:43:24.571 INFO:tasks.workunit.client.0.smithi087.stdout:6/803: dwrite d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:24.572 INFO:tasks.workunit.client.0.smithi087.stdout:7/926: chown d1/d6/d16/dc/l41 3492 1 2024-03-18T14:43:24.572 INFO:tasks.workunit.client.1.smithi129.stdout:1/679: sync 2024-03-18T14:43:24.574 INFO:tasks.workunit.client.0.smithi087.stdout:0/853: dread d0/d2/d4/de8/dad/ffd [0,4194304] 0 2024-03-18T14:43:24.575 INFO:tasks.workunit.client.1.smithi129.stdout:8/714: truncate d9/d11/d1a/d14/d60/fd5 792212 0 2024-03-18T14:43:24.575 INFO:tasks.workunit.client.1.smithi129.stdout:6/698: dwrite d3/d30/d44/f4a [4194304,4194304] 0 2024-03-18T14:43:24.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/854: chown d0/d1a/d7b/d2a/f68 2038836558 1 2024-03-18T14:43:24.576 INFO:tasks.workunit.client.0.smithi087.stdout:0/855: write d0/d1a/d80/d88/ff8 [445093,108763] 0 2024-03-18T14:43:24.578 INFO:tasks.workunit.client.0.smithi087.stdout:8/828: symlink d1/d6/d9/d5d/d87/d88/l112 0 2024-03-18T14:43:24.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/704: symlink d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/ldb 0 2024-03-18T14:43:24.579 INFO:tasks.workunit.client.1.smithi129.stdout:8/715: dread - d9/d11/d1a/d32/d41/d4d/dce/fe1 zero size 2024-03-18T14:43:24.581 INFO:tasks.workunit.client.1.smithi129.stdout:3/662: dwrite d4/dd/d41/fc7 [0,4194304] 0 2024-03-18T14:43:24.581 INFO:tasks.workunit.client.0.smithi087.stdout:1/908: truncate d3/d1d/d79/fd7 744273 0 2024-03-18T14:43:24.582 INFO:tasks.workunit.client.1.smithi129.stdout:1/680: dwrite d1/d2/f64 [0,4194304] 0 2024-03-18T14:43:24.584 INFO:tasks.workunit.client.1.smithi129.stdout:2/706: dwrite d7/f58 [0,4194304] 0 2024-03-18T14:43:24.584 INFO:tasks.workunit.client.0.smithi087.stdout:6/804: chown d3/d7/d25/d62/d7c/d29/d22/d23/da9/lb9 26 1 2024-03-18T14:43:24.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/707: chown d7/d1f/dd1 137 1 2024-03-18T14:43:24.585 INFO:tasks.workunit.client.1.smithi129.stdout:9/680: rename d0/db/d11/d97/dd1/d26/d19/d29/d36 to d0/db/d2e/d9f/dcb/de0 0 2024-03-18T14:43:24.586 INFO:tasks.workunit.client.1.smithi129.stdout:6/699: unlink d3/d30/de/f2e 0 2024-03-18T14:43:24.587 INFO:tasks.workunit.client.1.smithi129.stdout:7/705: chown d4/l2c 64 1 2024-03-18T14:43:24.588 INFO:tasks.workunit.client.0.smithi087.stdout:9/955: sync 2024-03-18T14:43:24.589 INFO:tasks.workunit.client.1.smithi129.stdout:5/664: symlink d0/dc/d18/d2b/lc5 0 2024-03-18T14:43:24.590 INFO:tasks.workunit.client.0.smithi087.stdout:0/856: unlink d0/d2/d4/d27/dc3/dd2/lef 0 2024-03-18T14:43:24.590 INFO:tasks.workunit.client.0.smithi087.stdout:7/927: creat d1/d97/f137 x:0 0 0 2024-03-18T14:43:24.590 INFO:tasks.workunit.client.1.smithi129.stdout:3/663: fdatasync d4/d11/d34/d4c/f5d 0 2024-03-18T14:43:24.591 INFO:tasks.workunit.client.0.smithi087.stdout:3/867: symlink d0/d3/df/d42/dfc/l102 0 2024-03-18T14:43:24.594 INFO:tasks.workunit.client.1.smithi129.stdout:5/665: dwrite d0/d32/d34/f85 [0,4194304] 0 2024-03-18T14:43:24.596 INFO:tasks.workunit.client.0.smithi087.stdout:5/887: rename d13/f1a to d13/dd8/f12e 0 2024-03-18T14:43:24.596 INFO:tasks.workunit.client.1.smithi129.stdout:0/707: dwrite d0/d23/d6b/f89 [0,4194304] 0 2024-03-18T14:43:24.597 INFO:tasks.workunit.client.1.smithi129.stdout:2/708: creat d7/d1c/d32/fe0 x:0 0 0 2024-03-18T14:43:24.597 INFO:tasks.workunit.client.1.smithi129.stdout:9/681: rmdir d0/db/d11/d97/dd1/d26 39 2024-03-18T14:43:24.598 INFO:tasks.workunit.client.1.smithi129.stdout:4/623: sync 2024-03-18T14:43:24.599 INFO:tasks.workunit.client.1.smithi129.stdout:6/700: creat d3/d30/de/d65/d93/fe2 x:0 0 0 2024-03-18T14:43:24.600 INFO:tasks.workunit.client.1.smithi129.stdout:8/716: fdatasync d9/f4c 0 2024-03-18T14:43:24.601 INFO:tasks.workunit.client.0.smithi087.stdout:0/857: dwrite d0/d2/d4/d27/dc3/dd2/dff/f106 [0,4194304] 0 2024-03-18T14:43:24.605 INFO:tasks.workunit.client.1.smithi129.stdout:8/717: dwrite d9/d11/d18/da4/fe2 [0,4194304] 0 2024-03-18T14:43:24.607 INFO:tasks.workunit.client.0.smithi087.stdout:3/868: creat d0/de/d30/d60/ddb/f103 x:0 0 0 2024-03-18T14:43:24.608 INFO:tasks.workunit.client.0.smithi087.stdout:3/869: chown d0/de/d30/dc5/fd9 9961 1 2024-03-18T14:43:24.608 INFO:tasks.workunit.client.0.smithi087.stdout:3/870: chown d0/de/d30/d46/dc3 166061297 1 2024-03-18T14:43:24.609 INFO:tasks.workunit.client.0.smithi087.stdout:1/909: unlink d3/d1d/d1f/d34/la8 0 2024-03-18T14:43:24.609 INFO:tasks.workunit.client.1.smithi129.stdout:2/709: symlink d7/d1f/d20/d36/da9/dc1/le1 0 2024-03-18T14:43:24.611 INFO:tasks.workunit.client.0.smithi087.stdout:2/872: getdents d2/ddd 0 2024-03-18T14:43:24.613 INFO:tasks.workunit.client.0.smithi087.stdout:3/871: dwrite d0/de/d30/f5d [0,4194304] 0 2024-03-18T14:43:24.615 INFO:tasks.workunit.client.0.smithi087.stdout:6/805: rename d3/d7/d25/d62/d7c/da0/dbe/fd6 to d3/d7/d25/d62/d7c/da0/d96/d97/f117 0 2024-03-18T14:43:24.615 INFO:tasks.workunit.client.0.smithi087.stdout:5/888: creat d13/d1b/d30/d6e/d88/f12f x:0 0 0 2024-03-18T14:43:24.617 INFO:tasks.workunit.client.0.smithi087.stdout:5/889: write d13/d1b/d70/fb0 [1283698,117994] 0 2024-03-18T14:43:24.620 INFO:tasks.workunit.client.0.smithi087.stdout:8/829: creat d1/d6/d2f/d44/d45/f113 x:0 0 0 2024-03-18T14:43:24.620 INFO:tasks.workunit.client.0.smithi087.stdout:1/910: read d3/d1d/d79/f8d [313934,118854] 0 2024-03-18T14:43:24.622 INFO:tasks.workunit.client.0.smithi087.stdout:8/830: dread - d1/d6/d9/d5d/d87/da2/df0/ffb zero size 2024-03-18T14:43:24.625 INFO:tasks.workunit.client.0.smithi087.stdout:3/872: symlink d0/d72/l104 0 2024-03-18T14:43:24.627 INFO:tasks.workunit.client.0.smithi087.stdout:7/928: rename d1/d6/da/d59/c98 to d1/d6/da/d42/c138 0 2024-03-18T14:43:24.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/682: creat d0/db/d11/d97/dd1/d25/fe1 x:0 0 0 2024-03-18T14:43:24.629 INFO:tasks.workunit.client.1.smithi129.stdout:6/701: symlink d3/d6/d7f/db4/d57/le3 0 2024-03-18T14:43:24.630 INFO:tasks.workunit.client.1.smithi129.stdout:5/666: dread d0/dc/f77 [0,4194304] 0 2024-03-18T14:43:24.631 INFO:tasks.workunit.client.1.smithi129.stdout:9/683: write d0/db/d11/d97/dd1/fbc [1611855,21111] 0 2024-03-18T14:43:24.635 INFO:tasks.workunit.client.0.smithi087.stdout:4/823: truncate d2/db/d84/d87/f9a 534244 0 2024-03-18T14:43:24.636 INFO:tasks.workunit.client.1.smithi129.stdout:6/702: unlink d3/d30/de/d65/la5 0 2024-03-18T14:43:24.637 INFO:tasks.workunit.client.0.smithi087.stdout:5/890: read d13/d1b/d27/d28/f54 [3211984,19298] 0 2024-03-18T14:43:24.641 INFO:tasks.workunit.client.1.smithi129.stdout:8/718: link d9/d11/d1a/d32/d41/d4d/fa9 d9/d11/d18/da4/ff0 0 2024-03-18T14:43:24.641 INFO:tasks.workunit.client.1.smithi129.stdout:5/667: mknod d0/d32/d3a/d52/d69/cc6 0 2024-03-18T14:43:24.642 INFO:tasks.workunit.client.0.smithi087.stdout:9/956: dwrite db/d18/d1e/d7e/dc7/f105 [0,4194304] 0 2024-03-18T14:43:24.642 INFO:tasks.workunit.client.1.smithi129.stdout:9/684: symlink d0/db/d2e/d9f/dcb/de0/le2 0 2024-03-18T14:43:24.642 INFO:tasks.workunit.client.1.smithi129.stdout:3/664: link d4/dd/d41/c5a d4/dd/d1f/d5f/d82/ce1 0 2024-03-18T14:43:24.643 INFO:tasks.workunit.client.1.smithi129.stdout:4/624: creat d0/d19/fc7 x:0 0 0 2024-03-18T14:43:24.644 INFO:tasks.workunit.client.1.smithi129.stdout:4/625: write d0/d19/d46/f63 [4921953,59259] 0 2024-03-18T14:43:24.645 INFO:tasks.workunit.client.1.smithi129.stdout:6/703: creat d3/d30/de/d49/fe4 x:0 0 0 2024-03-18T14:43:24.647 INFO:tasks.workunit.client.1.smithi129.stdout:3/665: mkdir d4/dd/d1f/d5f/de2 0 2024-03-18T14:43:24.648 INFO:tasks.workunit.client.1.smithi129.stdout:9/685: creat d0/db/d2e/d9f/dcb/de0/fe3 x:0 0 0 2024-03-18T14:43:24.648 INFO:tasks.workunit.client.1.smithi129.stdout:9/686: chown d0/db/d53/f58 170 1 2024-03-18T14:43:24.651 INFO:tasks.workunit.client.1.smithi129.stdout:4/626: mknod d0/d9/d4c/cc8 0 2024-03-18T14:43:24.652 INFO:tasks.workunit.client.1.smithi129.stdout:4/627: chown d0/d9/d4c 0 1 2024-03-18T14:43:24.653 INFO:tasks.workunit.client.1.smithi129.stdout:4/628: fdatasync d0/d19/d46/d3e/d21/f5c 0 2024-03-18T14:43:24.654 INFO:tasks.workunit.client.1.smithi129.stdout:4/629: write d0/d19/f38 [1977726,89317] 0 2024-03-18T14:43:24.654 INFO:tasks.workunit.client.1.smithi129.stdout:8/719: symlink d9/d11/d1a/d14/db7/lf1 0 2024-03-18T14:43:24.654 INFO:tasks.workunit.client.1.smithi129.stdout:4/630: chown d0/d9/d6a 7 1 2024-03-18T14:43:24.655 INFO:tasks.workunit.client.0.smithi087.stdout:7/929: dread d1/d6/d29/d2f/d68/d65/d60/f102 [0,4194304] 0 2024-03-18T14:43:24.655 INFO:tasks.workunit.client.1.smithi129.stdout:8/720: dread - d9/d11/d1a/d32/d3a/d70/fd8 zero size 2024-03-18T14:43:24.657 INFO:tasks.workunit.client.1.smithi129.stdout:3/666: unlink d4/dd/db0/dc3/cdf 0 2024-03-18T14:43:24.659 INFO:tasks.workunit.client.1.smithi129.stdout:6/704: symlink d3/d30/df/d28/le5 0 2024-03-18T14:43:24.663 INFO:tasks.workunit.client.1.smithi129.stdout:6/705: mkdir d3/d30/de/d65/d93/dd0/de6 0 2024-03-18T14:43:24.667 INFO:tasks.workunit.client.1.smithi129.stdout:1/681: dread d1/d35/d7a/f94 [0,4194304] 0 2024-03-18T14:43:24.667 INFO:tasks.workunit.client.1.smithi129.stdout:3/667: dread d4/dd/f45 [0,4194304] 0 2024-03-18T14:43:24.667 INFO:tasks.workunit.client.1.smithi129.stdout:7/706: write d4/d2d/d2e/d79/dc6/d38/d61/d6a/f92 [1339821,86970] 0 2024-03-18T14:43:24.671 INFO:tasks.workunit.client.1.smithi129.stdout:0/708: dwrite d0/d14/f2d [0,4194304] 0 2024-03-18T14:43:24.672 INFO:tasks.workunit.client.1.smithi129.stdout:2/710: write d7/d1f/d20/d2b/f39 [957617,91904] 0 2024-03-18T14:43:24.673 INFO:tasks.workunit.client.1.smithi129.stdout:0/709: read d0/d23/f67 [269257,6625] 0 2024-03-18T14:43:24.674 INFO:tasks.workunit.client.1.smithi129.stdout:0/710: fsync d0/d14/d28/d63/d8d/fa7 0 2024-03-18T14:43:24.676 INFO:tasks.workunit.client.0.smithi087.stdout:0/858: write d0/d1a/d7b/d26/f2c [3194716,104530] 0 2024-03-18T14:43:24.677 INFO:tasks.workunit.client.1.smithi129.stdout:9/687: write d0/db/d11/d97/f9e [112679,94867] 0 2024-03-18T14:43:24.677 INFO:tasks.workunit.client.0.smithi087.stdout:8/831: chown d1/d6/d2f/d9b/ce2 3892 1 2024-03-18T14:43:24.677 INFO:tasks.workunit.client.0.smithi087.stdout:0/859: write d0/d1a/f103 [560503,33096] 0 2024-03-18T14:43:24.678 INFO:tasks.workunit.client.0.smithi087.stdout:0/860: stat d0/d1a/d34/d3d/dd6 0 2024-03-18T14:43:24.678 INFO:tasks.workunit.client.0.smithi087.stdout:8/832: write d1/d6/d9/d5d/d87/da2/df0/ffb [500911,20679] 0 2024-03-18T14:43:24.679 INFO:tasks.workunit.client.1.smithi129.stdout:5/668: dwrite d0/dc/d18/f1d [0,4194304] 0 2024-03-18T14:43:24.681 INFO:tasks.workunit.client.1.smithi129.stdout:8/721: unlink d9/cb 0 2024-03-18T14:43:24.681 INFO:tasks.workunit.client.0.smithi087.stdout:2/873: link d2/d44/d72/d79/d101/fbf d2/d44/d72/de0/d11d/f122 0 2024-03-18T14:43:24.683 INFO:tasks.workunit.client.1.smithi129.stdout:6/706: rename d3/d30/de/d6c/f60 to d3/d30/d44/fe7 0 2024-03-18T14:43:24.683 INFO:tasks.workunit.client.0.smithi087.stdout:3/873: mknod d0/d3/d4f/d6e/dc8/c105 0 2024-03-18T14:43:24.685 INFO:tasks.workunit.client.1.smithi129.stdout:7/707: unlink d4/d8c/dd5/fd9 0 2024-03-18T14:43:24.685 INFO:tasks.workunit.client.0.smithi087.stdout:1/911: rename d3/d1d/fee to d3/d1d/d1e/d43/da3/f117 0 2024-03-18T14:43:24.686 INFO:tasks.workunit.client.0.smithi087.stdout:2/874: dwrite d2/ddd/d22/d2c/f3d [0,4194304] 0 2024-03-18T14:43:24.687 INFO:tasks.workunit.client.0.smithi087.stdout:1/912: fdatasync d3/d1d/d1e/f55 0 2024-03-18T14:43:24.687 INFO:tasks.workunit.client.1.smithi129.stdout:0/711: mkdir d0/d23/d35/dde 0 2024-03-18T14:43:24.690 INFO:tasks.workunit.client.0.smithi087.stdout:5/891: mknod d13/d1b/d27/d35/da7/c130 0 2024-03-18T14:43:24.690 INFO:tasks.workunit.client.0.smithi087.stdout:4/824: dread d2/db/d84/d87/f9b [0,4194304] 0 2024-03-18T14:43:24.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/892: stat d13/d1b/d30/l6d 0 2024-03-18T14:43:24.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/893: dread - d13/d1b/d30/d6e/d88/f111 zero size 2024-03-18T14:43:24.691 INFO:tasks.workunit.client.1.smithi129.stdout:0/712: dread d0/d23/d71/dc2/d4a/fc1 [0,4194304] 0 2024-03-18T14:43:24.691 INFO:tasks.workunit.client.1.smithi129.stdout:7/708: write d4/fc2 [658084,28728] 0 2024-03-18T14:43:24.692 INFO:tasks.workunit.client.1.smithi129.stdout:4/631: getdents d0/d19/d46/d2e/d66 0 2024-03-18T14:43:24.692 INFO:tasks.workunit.client.1.smithi129.stdout:0/713: write d0/d23/f3f [2218027,52951] 0 2024-03-18T14:43:24.692 INFO:tasks.workunit.client.0.smithi087.stdout:7/930: unlink d1/d6/d29/d2f/d68/d65/c51 0 2024-03-18T14:43:24.693 INFO:tasks.workunit.client.1.smithi129.stdout:5/669: rmdir d0/df 39 2024-03-18T14:43:24.693 INFO:tasks.workunit.client.1.smithi129.stdout:0/714: fsync d0/d23/d6b/f9a 0 2024-03-18T14:43:24.695 INFO:tasks.workunit.client.1.smithi129.stdout:1/682: dread d1/d2/d28/f68 [0,4194304] 0 2024-03-18T14:43:24.695 INFO:tasks.workunit.client.1.smithi129.stdout:0/715: write d0/d14/f8a [930992,52100] 0 2024-03-18T14:43:24.695 INFO:tasks.workunit.client.0.smithi087.stdout:8/833: mkdir d1/d6/d2f/d44/d4b/da5/d114 0 2024-03-18T14:43:24.696 INFO:tasks.workunit.client.1.smithi129.stdout:1/683: chown d1/d2/d28/d65/d19/d52 1367 1 2024-03-18T14:43:24.696 INFO:tasks.workunit.client.1.smithi129.stdout:0/716: write d0/fd [5061804,29312] 0 2024-03-18T14:43:24.696 INFO:tasks.workunit.client.1.smithi129.stdout:9/688: dread d0/f1e [0,4194304] 0 2024-03-18T14:43:24.696 INFO:tasks.workunit.client.1.smithi129.stdout:2/711: truncate d7/d1c/d32/fe0 247307 0 2024-03-18T14:43:24.698 INFO:tasks.workunit.client.1.smithi129.stdout:0/717: read d0/d14/d28/d63/d8d/fa7 [3353862,98202] 0 2024-03-18T14:43:24.698 INFO:tasks.workunit.client.1.smithi129.stdout:4/632: chown d0/d19/d46/d3e/d33/f7d 11 1 2024-03-18T14:43:24.698 INFO:tasks.workunit.client.1.smithi129.stdout:9/689: dread - d0/db/d2e/d9f/fce zero size 2024-03-18T14:43:24.701 INFO:tasks.workunit.client.1.smithi129.stdout:8/722: truncate d9/d11/d18/fd1 663153 0 2024-03-18T14:43:24.701 INFO:tasks.workunit.client.1.smithi129.stdout:5/670: rmdir d0/dc/d18/d2b 39 2024-03-18T14:43:24.702 INFO:tasks.workunit.client.1.smithi129.stdout:3/668: getdents d4/dd/d1f/d5f/d31 0 2024-03-18T14:43:24.703 INFO:tasks.workunit.client.1.smithi129.stdout:2/712: creat d7/d1f/d20/d36/fe2 x:0 0 0 2024-03-18T14:43:24.703 INFO:tasks.workunit.client.1.smithi129.stdout:3/669: chown d4/dd/d1f/d5f/c4e 2780 1 2024-03-18T14:43:24.704 INFO:tasks.workunit.client.1.smithi129.stdout:2/713: chown d7/d1f/d20/d36/da9/dc1/f18 1260453036 1 2024-03-18T14:43:24.706 INFO:tasks.workunit.client.1.smithi129.stdout:4/633: read d0/d3c/d6c/f8d [162795,85038] 0 2024-03-18T14:43:24.723 INFO:tasks.workunit.client.1.smithi129.stdout:7/709: dread d4/d2d/d2e/f30 [0,4194304] 0 2024-03-18T14:43:24.724 INFO:tasks.workunit.client.1.smithi129.stdout:7/710: write d4/d8c/d9e/fce [875929,107286] 0 2024-03-18T14:43:24.759 INFO:tasks.workunit.client.1.smithi129.stdout:1/684: rename d1/d2/d28/d65/d19/dc9/d87/d8c/f95 to d1/d2/d28/d65/d19/dc9/d56/fd3 0 2024-03-18T14:43:24.766 INFO:tasks.workunit.client.1.smithi129.stdout:4/634: sync 2024-03-18T14:43:24.767 INFO:tasks.workunit.client.1.smithi129.stdout:3/670: creat d4/d38/da3/dc9/fe3 x:0 0 0 2024-03-18T14:43:24.769 INFO:tasks.workunit.client.0.smithi087.stdout:2/875: sync 2024-03-18T14:43:24.769 INFO:tasks.workunit.client.1.smithi129.stdout:2/714: unlink d7/c4e 0 2024-03-18T14:43:24.771 INFO:tasks.workunit.client.1.smithi129.stdout:7/711: fdatasync d4/d2d/d2e/d79/dc6/d8/f20 0 2024-03-18T14:43:24.771 INFO:tasks.workunit.client.1.smithi129.stdout:0/718: getdents d0/d14/dca 0 2024-03-18T14:43:24.773 INFO:tasks.workunit.client.1.smithi129.stdout:7/712: write d4/d2d/d3a/f78 [3111262,35289] 0 2024-03-18T14:43:24.774 INFO:tasks.workunit.client.1.smithi129.stdout:2/715: dwrite d7/d1f/d20/d36/f73 [0,4194304] 0 2024-03-18T14:43:24.775 INFO:tasks.workunit.client.0.smithi087.stdout:2/876: dread d2/ddd/d22/d24/fce [0,4194304] 0 2024-03-18T14:43:24.777 INFO:tasks.workunit.client.1.smithi129.stdout:1/685: rename d1/d2/d28/d65/d19/dc9/d87/f8f to d1/d2/d28/d65/d7c/fd4 0 2024-03-18T14:43:24.779 INFO:tasks.workunit.client.1.smithi129.stdout:2/716: dwrite d7/d1f/d20/d2b/d41/f5d [0,4194304] 0 2024-03-18T14:43:24.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/877: dwrite d2/ddd/d22/d2c/d3a/d40/d98/dd8/fef [0,4194304] 0 2024-03-18T14:43:24.780 INFO:tasks.workunit.client.1.smithi129.stdout:6/707: truncate d3/d6/d7f/db4/f7b 1200619 0 2024-03-18T14:43:24.785 INFO:tasks.workunit.client.1.smithi129.stdout:6/708: dwrite d3/d30/d44/f4a [4194304,4194304] 0 2024-03-18T14:43:24.794 INFO:tasks.workunit.client.0.smithi087.stdout:6/806: truncate d3/d7/d25/d62/d7c/da0/d96/d97/ff2 382752 0 2024-03-18T14:43:24.795 INFO:tasks.workunit.client.0.smithi087.stdout:3/874: readlink d0/d3/df/d9a/lbb 0 2024-03-18T14:43:24.796 INFO:tasks.workunit.client.0.smithi087.stdout:6/807: write d3/d7/d25/d62/d7c/d29/d22/d75/f9b [6189486,40093] 0 2024-03-18T14:43:24.801 INFO:tasks.workunit.client.0.smithi087.stdout:0/861: write d0/d2/d4/de8/dad/dea/f40 [2448697,112834] 0 2024-03-18T14:43:24.815 INFO:tasks.workunit.client.1.smithi129.stdout:2/717: dread d7/d1c/d32/f60 [0,4194304] 0 2024-03-18T14:43:24.816 INFO:tasks.workunit.client.1.smithi129.stdout:7/713: sync 2024-03-18T14:43:24.832 INFO:tasks.workunit.client.1.smithi129.stdout:5/671: write d0/d32/d3a/fb4 [2113611,11307] 0 2024-03-18T14:43:24.833 INFO:tasks.workunit.client.1.smithi129.stdout:8/723: write d9/d11/d1a/d32/d3a/d5d/f9e [1166645,130632] 0 2024-03-18T14:43:24.852 INFO:tasks.workunit.client.0.smithi087.stdout:9/957: rename db/d18/d3a/f63 to db/d18/d1c/d69/d6f/d140/f145 0 2024-03-18T14:43:24.856 INFO:tasks.workunit.client.0.smithi087.stdout:1/913: creat d3/de4/f118 x:0 0 0 2024-03-18T14:43:24.857 INFO:tasks.workunit.client.0.smithi087.stdout:4/825: fdatasync d2/db/d67/f6a 0 2024-03-18T14:43:24.858 INFO:tasks.workunit.client.1.smithi129.stdout:4/635: mkdir d0/d19/d46/d3e/d21/dc9 0 2024-03-18T14:43:24.858 INFO:tasks.workunit.client.1.smithi129.stdout:3/671: mknod d4/dd/d1f/d5f/d82/da6/ce4 0 2024-03-18T14:43:24.858 INFO:tasks.workunit.client.0.smithi087.stdout:5/894: truncate d13/d1b/d70/fba 302710 0 2024-03-18T14:43:24.859 INFO:tasks.workunit.client.0.smithi087.stdout:5/895: write d13/d1b/d27/d98/dc2/f100 [912315,42770] 0 2024-03-18T14:43:24.861 INFO:tasks.workunit.client.0.smithi087.stdout:5/896: write d13/d1b/d27/d28/d9a/f123 [321160,97857] 0 2024-03-18T14:43:24.861 INFO:tasks.workunit.client.0.smithi087.stdout:7/931: mknod d1/d6/d16/dc/c139 0 2024-03-18T14:43:24.862 INFO:tasks.workunit.client.0.smithi087.stdout:5/897: chown d13/d1b/d27/d35/dc6/fcc 962588 1 2024-03-18T14:43:24.862 INFO:tasks.workunit.client.0.smithi087.stdout:8/834: fdatasync d1/d6/d8d/fac 0 2024-03-18T14:43:24.864 INFO:tasks.workunit.client.1.smithi129.stdout:0/719: mkdir d0/d6c/ddf 0 2024-03-18T14:43:24.864 INFO:tasks.workunit.client.1.smithi129.stdout:9/690: link d0/db/d11/d97/dd1/d6c/fc6 d0/fe4 0 2024-03-18T14:43:24.867 INFO:tasks.workunit.client.1.smithi129.stdout:1/686: rename d1/d2/l66 to d1/d2/d28/da7/db5/ld5 0 2024-03-18T14:43:24.869 INFO:tasks.workunit.client.0.smithi087.stdout:6/808: fsync d3/d7/f24 0 2024-03-18T14:43:24.883 INFO:tasks.workunit.client.1.smithi129.stdout:2/718: dread d7/fa [4194304,4194304] 0 2024-03-18T14:43:24.887 INFO:tasks.workunit.client.1.smithi129.stdout:2/719: dwrite d7/f1e [4194304,4194304] 0 2024-03-18T14:43:24.888 INFO:tasks.workunit.client.1.smithi129.stdout:2/720: chown d7/d1c/d32/f4f 53163868 1 2024-03-18T14:43:24.889 INFO:tasks.workunit.client.1.smithi129.stdout:3/672: write d4/dd/d1f/d5f/d82/da6/fd8 [1785795,50618] 0 2024-03-18T14:43:24.890 INFO:tasks.workunit.client.1.smithi129.stdout:4/636: dread d0/d19/d46/d3e/d21/d4d/d70/f2c [0,4194304] 0 2024-03-18T14:43:24.892 INFO:tasks.workunit.client.1.smithi129.stdout:4/637: read d0/d19/d46/d3e/d21/d4d/faf [1915229,34918] 0 2024-03-18T14:43:24.893 INFO:tasks.workunit.client.0.smithi087.stdout:3/875: rmdir d0/d3/d10 39 2024-03-18T14:43:24.900 INFO:tasks.workunit.client.1.smithi129.stdout:0/720: mkdir d0/d23/d35/d3b/de0 0 2024-03-18T14:43:24.904 INFO:tasks.workunit.client.1.smithi129.stdout:7/714: mkdir d4/d2d/d2e/d79/dc6/ddc 0 2024-03-18T14:43:24.906 INFO:tasks.workunit.client.0.smithi087.stdout:9/958: dwrite db/d12/f20 [0,4194304] 0 2024-03-18T14:43:24.907 INFO:tasks.workunit.client.0.smithi087.stdout:9/959: write db/d18/d1c/d69/d6f/f115 [1036419,28345] 0 2024-03-18T14:43:24.907 INFO:tasks.workunit.client.0.smithi087.stdout:9/960: chown db/d12 4 1 2024-03-18T14:43:24.908 INFO:tasks.workunit.client.0.smithi087.stdout:5/898: truncate d13/d1b/f3a 2247712 0 2024-03-18T14:43:24.909 INFO:tasks.workunit.client.0.smithi087.stdout:8/835: fsync d1/d6/d9/f40 0 2024-03-18T14:43:24.910 INFO:tasks.workunit.client.1.smithi129.stdout:9/691: dwrite d0/f1e [0,4194304] 0 2024-03-18T14:43:24.911 INFO:tasks.workunit.client.1.smithi129.stdout:9/692: chown d0/db/d11/d97/dd1/d25/d8e/c91 37 1 2024-03-18T14:43:24.912 INFO:tasks.workunit.client.1.smithi129.stdout:2/721: mknod d7/d1f/d20/d36/da9/ce3 0 2024-03-18T14:43:24.912 INFO:tasks.workunit.client.0.smithi087.stdout:2/878: creat d2/d44/d72/de0/d11d/f123 x:0 0 0 2024-03-18T14:43:24.915 INFO:tasks.workunit.client.0.smithi087.stdout:3/876: mkdir d0/d3/df/d42/dfc/d106 0 2024-03-18T14:43:24.916 INFO:tasks.workunit.client.1.smithi129.stdout:0/721: rmdir d0/d6c 39 2024-03-18T14:43:24.918 INFO:tasks.workunit.client.0.smithi087.stdout:7/932: mknod d1/d6/d29/d2f/d6b/d105/c13a 0 2024-03-18T14:43:24.918 INFO:tasks.workunit.client.1.smithi129.stdout:1/687: mkdir d1/d2/d28/d65/dd6 0 2024-03-18T14:43:24.918 INFO:tasks.workunit.client.1.smithi129.stdout:4/638: dwrite d0/d19/d46/f36 [4194304,4194304] 0 2024-03-18T14:43:24.920 INFO:tasks.workunit.client.1.smithi129.stdout:6/709: rmdir d3/d30/de/d6c/ddb 0 2024-03-18T14:43:24.920 INFO:tasks.workunit.client.0.smithi087.stdout:9/961: stat db/d18/d3a/fdc 0 2024-03-18T14:43:24.920 INFO:tasks.workunit.client.1.smithi129.stdout:7/715: fsync f3 0 2024-03-18T14:43:24.921 INFO:tasks.workunit.client.1.smithi129.stdout:5/672: fsync d0/dc/d18/d2b/f57 0 2024-03-18T14:43:24.923 INFO:tasks.workunit.client.0.smithi087.stdout:5/899: unlink d13/d1b/d27/d28/d9a/lbc 0 2024-03-18T14:43:24.924 INFO:tasks.workunit.client.1.smithi129.stdout:4/639: dwrite d0/d19/d46/d3e/d21/d4d/d58/d61/f98 [0,4194304] 0 2024-03-18T14:43:24.926 INFO:tasks.workunit.client.1.smithi129.stdout:8/724: creat d9/d11/d1a/d14/db7/ff2 x:0 0 0 2024-03-18T14:43:24.926 INFO:tasks.workunit.client.0.smithi087.stdout:8/836: rename d1/d6/d2f/d9b/ce2 to d1/d6/d2f/d44/d4b/da5/c115 0 2024-03-18T14:43:24.929 INFO:tasks.workunit.client.1.smithi129.stdout:2/722: creat d7/d3f/d5f/fe4 x:0 0 0 2024-03-18T14:43:24.929 INFO:tasks.workunit.client.0.smithi087.stdout:2/879: rmdir d2/ddd/d22/d24/de8 39 2024-03-18T14:43:24.930 INFO:tasks.workunit.client.1.smithi129.stdout:2/723: write d7/d1f/d20/d36/da9/dc1/da5/fbb [1523767,118642] 0 2024-03-18T14:43:24.931 INFO:tasks.workunit.client.0.smithi087.stdout:1/914: creat d3/d1d/d1e/d43/f119 x:0 0 0 2024-03-18T14:43:24.931 INFO:tasks.workunit.client.1.smithi129.stdout:0/722: rmdir d0/d14/d28 39 2024-03-18T14:43:24.932 INFO:tasks.workunit.client.1.smithi129.stdout:1/688: rmdir d1/d2/d28/d65/d19 39 2024-03-18T14:43:24.932 INFO:tasks.workunit.client.0.smithi087.stdout:4/826: creat d2/d13/f10d x:0 0 0 2024-03-18T14:43:24.934 INFO:tasks.workunit.client.0.smithi087.stdout:2/880: dread d2/ddd/d22/f62 [0,4194304] 0 2024-03-18T14:43:24.934 INFO:tasks.workunit.client.0.smithi087.stdout:9/962: read db/d18/d3a/fe1 [47597,1163] 0 2024-03-18T14:43:24.934 INFO:tasks.workunit.client.0.smithi087.stdout:5/900: symlink d13/d1b/d7e/l131 0 2024-03-18T14:43:24.935 INFO:tasks.workunit.client.0.smithi087.stdout:0/862: getdents d0/d1a/d7b/d2a/dbb 0 2024-03-18T14:43:24.936 INFO:tasks.workunit.client.0.smithi087.stdout:9/963: chown db/d18/d3a/l9c 110123764 1 2024-03-18T14:43:24.937 INFO:tasks.workunit.client.0.smithi087.stdout:1/915: mkdir d3/d1d/d1e/d43/d50/d71/d11a 0 2024-03-18T14:43:24.938 INFO:tasks.workunit.client.0.smithi087.stdout:1/916: dread - d3/d1d/d1f/d34/f62 zero size 2024-03-18T14:43:24.941 INFO:tasks.workunit.client.1.smithi129.stdout:4/640: dread d0/d19/f54 [0,4194304] 0 2024-03-18T14:43:24.941 INFO:tasks.workunit.client.0.smithi087.stdout:5/901: dread d13/d1b/d27/d35/d3b/fd2 [0,4194304] 0 2024-03-18T14:43:24.942 INFO:tasks.workunit.client.1.smithi129.stdout:3/673: truncate d4/dd/d1f/fce 889683 0 2024-03-18T14:43:24.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/827: dread d2/db/d84/d87/f9a [0,4194304] 0 2024-03-18T14:43:24.943 INFO:tasks.workunit.client.1.smithi129.stdout:3/674: write d4/dd/d1f/d2f/fc5 [4440266,68514] 0 2024-03-18T14:43:24.943 INFO:tasks.workunit.client.0.smithi087.stdout:4/828: chown d2/db/d24/d30/d7b/dbe/dc6 46842 1 2024-03-18T14:43:24.945 INFO:tasks.workunit.client.1.smithi129.stdout:6/710: creat d3/d6/d82/d9a/dad/fe8 x:0 0 0 2024-03-18T14:43:24.945 INFO:tasks.workunit.client.0.smithi087.stdout:6/809: truncate d3/d7/d25/d62/d7c/d29/d22/d23/f30 594876 0 2024-03-18T14:43:24.947 INFO:tasks.workunit.client.1.smithi129.stdout:5/673: creat d0/d32/d34/d6c/da3/fc7 x:0 0 0 2024-03-18T14:43:24.948 INFO:tasks.workunit.client.1.smithi129.stdout:4/641: mkdir d0/d9/d4c/dca 0 2024-03-18T14:43:24.949 INFO:tasks.workunit.client.1.smithi129.stdout:4/642: fdatasync d0/d19/d46/d3e/d21/d32/fb6 0 2024-03-18T14:43:24.951 INFO:tasks.workunit.client.0.smithi087.stdout:8/837: rename d1/f7d to d1/d6/d2f/d44/d45/d72/f116 0 2024-03-18T14:43:24.951 INFO:tasks.workunit.client.1.smithi129.stdout:6/711: rmdir d3/d30/de/d65/d93/dd0 39 2024-03-18T14:43:24.955 INFO:tasks.workunit.client.0.smithi087.stdout:5/902: dread - d13/d1b/f46 zero size 2024-03-18T14:43:24.955 INFO:tasks.workunit.client.0.smithi087.stdout:3/877: sync 2024-03-18T14:43:24.955 INFO:tasks.workunit.client.1.smithi129.stdout:6/712: dwrite d3/d6/f51 [0,4194304] 0 2024-03-18T14:43:24.956 INFO:tasks.workunit.client.1.smithi129.stdout:0/723: truncate d0/fd 3580299 0 2024-03-18T14:43:24.957 INFO:tasks.workunit.client.0.smithi087.stdout:4/829: mkdir d2/db/d24/d30/d7b/dbe/dcf/dda/ddb/d10e 0 2024-03-18T14:43:24.957 INFO:tasks.workunit.client.0.smithi087.stdout:0/863: mknod d0/d2/c123 0 2024-03-18T14:43:24.958 INFO:tasks.workunit.client.1.smithi129.stdout:0/724: write d0/d23/d35/d3b/d42/dc0/fc5 [604477,83606] 0 2024-03-18T14:43:24.959 INFO:tasks.workunit.client.1.smithi129.stdout:8/725: rmdir d9/d11/d1a/d32/d3a/d9a/dd7 0 2024-03-18T14:43:24.960 INFO:tasks.workunit.client.1.smithi129.stdout:0/725: readlink d0/d23/d6b/l82 0 2024-03-18T14:43:24.960 INFO:tasks.workunit.client.1.smithi129.stdout:3/675: dwrite d4/dd/d1f/da8/faa [0,4194304] 0 2024-03-18T14:43:24.961 INFO:tasks.workunit.client.0.smithi087.stdout:2/881: link d2/ddd/d22/d2c/d3a/d76/d9a/d9b/fbe d2/d44/d72/de0/d11d/f124 0 2024-03-18T14:43:24.961 INFO:tasks.workunit.client.0.smithi087.stdout:9/964: creat db/d18/d1c/d69/d11a/d12e/f146 x:0 0 0 2024-03-18T14:43:24.962 INFO:tasks.workunit.client.0.smithi087.stdout:6/810: dread d3/f74 [0,4194304] 0 2024-03-18T14:43:24.962 INFO:tasks.workunit.client.0.smithi087.stdout:1/917: fdatasync d3/d1d/d1e/d20/f52 0 2024-03-18T14:43:24.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/643: creat d0/d9/d6a/fcb x:0 0 0 2024-03-18T14:43:24.964 INFO:tasks.workunit.client.1.smithi129.stdout:7/716: getdents d4/d2d/d2e/d79/dc6/d38/d61 0 2024-03-18T14:43:24.964 INFO:tasks.workunit.client.1.smithi129.stdout:4/644: write d0/d19/d46/d3e/f29 [4200092,73588] 0 2024-03-18T14:43:24.964 INFO:tasks.workunit.client.1.smithi129.stdout:1/689: mknod d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/cd7 0 2024-03-18T14:43:24.969 INFO:tasks.workunit.client.1.smithi129.stdout:9/693: getdents d0/db/d11/d97/dd1/d26/d19 0 2024-03-18T14:43:24.970 INFO:tasks.workunit.client.1.smithi129.stdout:4/645: dwrite d0/d19/d46/d3e/d21/d4d/d58/d61/f98 [0,4194304] 0 2024-03-18T14:43:24.970 INFO:tasks.workunit.client.1.smithi129.stdout:2/724: link d7/d1f/d20/d36/f9e d7/d1f/d20/d2d/dab/fe5 0 2024-03-18T14:43:24.973 INFO:tasks.workunit.client.1.smithi129.stdout:3/676: creat d4/d11/d1d/d50/d91/d97/fe5 x:0 0 0 2024-03-18T14:43:24.976 INFO:tasks.workunit.client.1.smithi129.stdout:7/717: creat d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/fdd x:0 0 0 2024-03-18T14:43:24.976 INFO:tasks.workunit.client.1.smithi129.stdout:4/646: dwrite d0/d9/d6a/d7b/fae [0,4194304] 0 2024-03-18T14:43:24.978 INFO:tasks.workunit.client.1.smithi129.stdout:6/713: rename d3/d30/fd4 to d3/d30/de/da9/fe9 0 2024-03-18T14:43:24.980 INFO:tasks.workunit.client.1.smithi129.stdout:6/714: fsync d3/d6/d7f/d8f/fce 0 2024-03-18T14:43:24.982 INFO:tasks.workunit.client.1.smithi129.stdout:5/674: truncate d0/fb5 697384 0 2024-03-18T14:43:24.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/864: symlink d0/d2/d4/de8/dad/dea/dcb/l124 0 2024-03-18T14:43:24.983 INFO:tasks.workunit.client.0.smithi087.stdout:1/918: stat d3/d1d/d1e/d43/d9b 0 2024-03-18T14:43:24.983 INFO:tasks.workunit.client.0.smithi087.stdout:8/838: mkdir d1/d6/d8d/dc2/dda/d117 0 2024-03-18T14:43:24.984 INFO:tasks.workunit.client.1.smithi129.stdout:3/677: fdatasync d4/d11/d1d/d50/f67 0 2024-03-18T14:43:24.985 INFO:tasks.workunit.client.0.smithi087.stdout:3/878: write d0/fb9 [945453,64492] 0 2024-03-18T14:43:24.985 INFO:tasks.workunit.client.0.smithi087.stdout:8/839: write d1/d6/d8d/f94 [4367681,39587] 0 2024-03-18T14:43:24.985 INFO:tasks.workunit.client.0.smithi087.stdout:4/830: write d2/db/d67/f6a [733434,78351] 0 2024-03-18T14:43:24.986 INFO:tasks.workunit.client.0.smithi087.stdout:8/840: write d1/d6/d2f/d44/d45/d72/fc3 [243244,79806] 0 2024-03-18T14:43:24.990 INFO:tasks.workunit.client.0.smithi087.stdout:8/841: dwrite d1/f9a [0,4194304] 0 2024-03-18T14:43:24.991 INFO:tasks.workunit.client.0.smithi087.stdout:2/882: mkdir d2/ddd/d22/d2c/d3a/d49/d125 0 2024-03-18T14:43:24.993 INFO:tasks.workunit.client.1.smithi129.stdout:8/726: creat d9/d11/ff3 x:0 0 0 2024-03-18T14:43:24.994 INFO:tasks.workunit.client.1.smithi129.stdout:8/727: write d9/d11/d1a/d32/d3a/d70/f86 [4168238,109299] 0 2024-03-18T14:43:24.995 INFO:tasks.workunit.client.0.smithi087.stdout:7/933: sync 2024-03-18T14:43:24.995 INFO:tasks.workunit.client.1.smithi129.stdout:8/728: readlink d9/d33/laa 0 2024-03-18T14:43:24.996 INFO:tasks.workunit.client.0.smithi087.stdout:0/865: rename d0/d2/d6b/dca to d0/d2/d4/de8/dad/dea/d5d/d10b/d125 0 2024-03-18T14:43:24.997 INFO:tasks.workunit.client.1.smithi129.stdout:0/726: truncate d0/d23/d71/fd2 942970 0 2024-03-18T14:43:24.997 INFO:tasks.workunit.client.1.smithi129.stdout:1/690: dread d1/d35/fbd [0,4194304] 0 2024-03-18T14:43:25.001 INFO:tasks.workunit.client.1.smithi129.stdout:9/694: unlink d0/db/d2e/d9f/dcb/de0/ccf 0 2024-03-18T14:43:25.002 INFO:tasks.workunit.client.0.smithi087.stdout:6/811: write d3/d7/d25/d8e/fae [1519536,50596] 0 2024-03-18T14:43:25.002 INFO:tasks.workunit.client.1.smithi129.stdout:5/675: mkdir d0/d32/d3a/d45/d83/dc8 0 2024-03-18T14:43:25.004 INFO:tasks.workunit.client.0.smithi087.stdout:6/812: read d3/d7/d25/d62/f10b [2771573,68575] 0 2024-03-18T14:43:25.004 INFO:tasks.workunit.client.1.smithi129.stdout:0/727: dwrite d0/d23/d35/d3b/d42/dc0/fc5 [0,4194304] 0 2024-03-18T14:43:25.004 INFO:tasks.workunit.client.1.smithi129.stdout:8/729: readlink d9/d11/d1a/d32/d3a/d5d/l91 0 2024-03-18T14:43:25.005 INFO:tasks.workunit.client.1.smithi129.stdout:1/691: dwrite d1/d35/d7a/faf [0,4194304] 0 2024-03-18T14:43:25.006 INFO:tasks.workunit.client.0.smithi087.stdout:1/919: link d3/d1d/d1f/d63/f6d d3/d1d/d1f/d107/f11b 0 2024-03-18T14:43:25.006 INFO:tasks.workunit.client.1.smithi129.stdout:8/730: write d9/d33/fbf [675686,61847] 0 2024-03-18T14:43:25.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/647: dread d0/d19/d46/d3e/f47 [0,4194304] 0 2024-03-18T14:43:25.009 INFO:tasks.workunit.client.0.smithi087.stdout:8/842: write d1/d6/d14/f1c [5083636,4376] 0 2024-03-18T14:43:25.011 INFO:tasks.workunit.client.1.smithi129.stdout:7/718: write d4/d2d/d2e/d42/d58/f60 [1149088,12001] 0 2024-03-18T14:43:25.012 INFO:tasks.workunit.client.1.smithi129.stdout:7/719: write d4/d2d/d2e/d79/dc6/d8/d3b/f4d [1428428,698] 0 2024-03-18T14:43:25.013 INFO:tasks.workunit.client.1.smithi129.stdout:2/725: getdents d7/d1f/d20/d36/da9/dc1/da5 0 2024-03-18T14:43:25.014 INFO:tasks.workunit.client.1.smithi129.stdout:2/726: stat d7/d1f/d20/d2d/dab/fc6 0 2024-03-18T14:43:25.014 INFO:tasks.workunit.client.1.smithi129.stdout:1/692: symlink d1/d35/ld8 0 2024-03-18T14:43:25.015 INFO:tasks.workunit.client.0.smithi087.stdout:9/965: dread db/d18/d1e/dde/fa8 [0,4194304] 0 2024-03-18T14:43:25.015 INFO:tasks.workunit.client.0.smithi087.stdout:3/879: creat d0/f107 x:0 0 0 2024-03-18T14:43:25.016 INFO:tasks.workunit.client.0.smithi087.stdout:1/920: chown d3/d1d/d1f/d107/ce8 1788090757 1 2024-03-18T14:43:25.017 INFO:tasks.workunit.client.0.smithi087.stdout:1/921: chown d3/fa7 275080531 1 2024-03-18T14:43:25.018 INFO:tasks.workunit.client.0.smithi087.stdout:8/843: symlink d1/d6/d14/db2/dbc/d111/l118 0 2024-03-18T14:43:25.019 INFO:tasks.workunit.client.0.smithi087.stdout:4/831: truncate d2/db/fd8 892824 0 2024-03-18T14:43:25.019 INFO:tasks.workunit.client.1.smithi129.stdout:4/648: symlink d0/d19/d46/d3e/d21/lcc 0 2024-03-18T14:43:25.020 INFO:tasks.workunit.client.1.smithi129.stdout:7/720: symlink d4/d2d/d2e/d79/lde 0 2024-03-18T14:43:25.022 INFO:tasks.workunit.client.0.smithi087.stdout:9/966: creat db/d18/d1e/d7e/db8/f147 x:0 0 0 2024-03-18T14:43:25.023 INFO:tasks.workunit.client.0.smithi087.stdout:3/880: fsync d0/de/d30/d46/f68 0 2024-03-18T14:43:25.024 INFO:tasks.workunit.client.0.smithi087.stdout:1/922: symlink d3/d1d/d1e/d43/da3/dd3/l11c 0 2024-03-18T14:43:25.024 INFO:tasks.workunit.client.1.smithi129.stdout:4/649: write d0/d19/d46/d3e/d33/f7d [3126805,78114] 0 2024-03-18T14:43:25.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/727: getdents d7/d1f/d20/d36/da9/dcd 0 2024-03-18T14:43:25.025 INFO:tasks.workunit.client.0.smithi087.stdout:8/844: fdatasync d1/d6/d2f/d44/d45/d50/f73 0 2024-03-18T14:43:25.025 INFO:tasks.workunit.client.0.smithi087.stdout:1/923: fsync d3/d1d/d1e/d20/dbd/fcf 0 2024-03-18T14:43:25.025 INFO:tasks.workunit.client.1.smithi129.stdout:7/721: rmdir d4/d2d/d2e/d79/dc6/d54/d86 39 2024-03-18T14:43:25.025 INFO:tasks.workunit.client.0.smithi087.stdout:4/832: write d2/db/d7a/f106 [1267343,112008] 0 2024-03-18T14:43:25.027 INFO:tasks.workunit.client.0.smithi087.stdout:7/934: rename d1/c89 to d1/d6/da/d59/dbe/d11a/c13b 0 2024-03-18T14:43:25.028 INFO:tasks.workunit.client.1.smithi129.stdout:0/728: rename d0/d23/d71/dc2/d4a/d7a/dbd/cc6 to d0/d23/d35/dde/ce1 0 2024-03-18T14:43:25.028 INFO:tasks.workunit.client.0.smithi087.stdout:7/935: chown d1/d6/d29/d2f/d68/dbf/fe8 5796 1 2024-03-18T14:43:25.029 INFO:tasks.workunit.client.0.smithi087.stdout:7/936: fsync d1/d6/da/d42/d67/fe5 0 2024-03-18T14:43:25.030 INFO:tasks.workunit.client.1.smithi129.stdout:2/728: dread d7/d3f/d5f/f7d [0,4194304] 0 2024-03-18T14:43:25.030 INFO:tasks.workunit.client.0.smithi087.stdout:6/813: link d3/d7/d25/d62/d7c/d29/d22/d23/da9/fc1 d3/f118 0 2024-03-18T14:43:25.031 INFO:tasks.workunit.client.1.smithi129.stdout:6/715: write d3/d6/d7f/db4/fb5 [90410,114559] 0 2024-03-18T14:43:25.032 INFO:tasks.workunit.client.1.smithi129.stdout:6/716: write d3/d30/de/f58 [333750,120091] 0 2024-03-18T14:43:25.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/883: truncate d2/ddd/d22/d2c/d3a/d40/f8f 451188 0 2024-03-18T14:43:25.033 INFO:tasks.workunit.client.0.smithi087.stdout:2/884: stat d2/ddd/d22/d2c/d3a/d40/d52 0 2024-03-18T14:43:25.035 INFO:tasks.workunit.client.1.smithi129.stdout:9/695: truncate d0/f1e 3812175 0 2024-03-18T14:43:25.037 INFO:tasks.workunit.client.1.smithi129.stdout:8/731: write d9/d11/d1a/f63 [1255483,58428] 0 2024-03-18T14:43:25.038 INFO:tasks.workunit.client.1.smithi129.stdout:5/676: dwrite d0/df/f48 [0,4194304] 0 2024-03-18T14:43:25.038 INFO:tasks.workunit.client.1.smithi129.stdout:8/732: fsync d9/d11/d53/d5f/fdf 0 2024-03-18T14:43:25.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/885: dwrite d2/ddd/d22/d2c/d3a/d76/d9a/db5/ff7 [0,4194304] 0 2024-03-18T14:43:25.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/729: creat d7/d1f/d20/d2b/d41/d65/d88/fe6 x:0 0 0 2024-03-18T14:43:25.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/730: chown d7/d3f 0 1 2024-03-18T14:43:25.044 INFO:tasks.workunit.client.1.smithi129.stdout:8/733: dwrite d9/d11/d1a/d32/d3a/f9d [4194304,4194304] 0 2024-03-18T14:43:25.046 INFO:tasks.workunit.client.1.smithi129.stdout:1/693: truncate d1/d2/d28/d65/d19/d84/fc7 95378 0 2024-03-18T14:43:25.047 INFO:tasks.workunit.client.1.smithi129.stdout:4/650: dwrite d0/d19/d46/d3e/d21/d4d/d70/f2c [0,4194304] 0 2024-03-18T14:43:25.048 INFO:tasks.workunit.client.0.smithi087.stdout:5/903: sync 2024-03-18T14:43:25.051 INFO:tasks.workunit.client.0.smithi087.stdout:8/845: creat d1/d6/d2f/d44/d4b/f119 x:0 0 0 2024-03-18T14:43:25.051 INFO:tasks.workunit.client.1.smithi129.stdout:6/717: creat d3/d30/de/d6c/d9e/db6/fea x:0 0 0 2024-03-18T14:43:25.052 INFO:tasks.workunit.client.0.smithi087.stdout:1/924: truncate d3/d1d/d1f/f70 4245435 0 2024-03-18T14:43:25.052 INFO:tasks.workunit.client.0.smithi087.stdout:8/846: write d1/d6/d2f/d44/d4b/f119 [487975,58113] 0 2024-03-18T14:43:25.053 INFO:tasks.workunit.client.1.smithi129.stdout:2/731: write d7/d1f/f52 [1051357,96041] 0 2024-03-18T14:43:25.053 INFO:tasks.workunit.client.1.smithi129.stdout:6/718: write d3/d30/de/d65/d80/fd9 [1209865,297] 0 2024-03-18T14:43:25.053 INFO:tasks.workunit.client.1.smithi129.stdout:9/696: symlink d0/db/d11/d97/dd1/d26/d19/dd5/le5 0 2024-03-18T14:43:25.056 INFO:tasks.workunit.client.1.smithi129.stdout:3/678: sync 2024-03-18T14:43:25.058 INFO:tasks.workunit.client.1.smithi129.stdout:6/719: dwrite d3/d6/d7f/d8f/fce [0,4194304] 0 2024-03-18T14:43:25.058 INFO:tasks.workunit.client.1.smithi129.stdout:1/694: creat d1/d91/fd9 x:0 0 0 2024-03-18T14:43:25.059 INFO:tasks.workunit.client.1.smithi129.stdout:6/720: readlink d3/d6/d7f/db4/d57/lab 0 2024-03-18T14:43:25.059 INFO:tasks.workunit.client.0.smithi087.stdout:4/833: symlink d2/db/d24/d30/d8a/d95/l10f 0 2024-03-18T14:43:25.059 INFO:tasks.workunit.client.0.smithi087.stdout:9/967: dread db/d18/d1e/d7e/db8/f116 [0,4194304] 0 2024-03-18T14:43:25.060 INFO:tasks.workunit.client.0.smithi087.stdout:4/834: readlink d2/l47 0 2024-03-18T14:43:25.061 INFO:tasks.workunit.client.1.smithi129.stdout:4/651: mknod d0/d9/d6a/db1/ccd 0 2024-03-18T14:43:25.061 INFO:tasks.workunit.client.1.smithi129.stdout:0/729: creat d0/fe2 x:0 0 0 2024-03-18T14:43:25.061 INFO:tasks.workunit.client.0.smithi087.stdout:3/881: stat d0/d3/d10/da5/lb2 0 2024-03-18T14:43:25.062 INFO:tasks.workunit.client.1.smithi129.stdout:2/732: dread - d7/d1c/f74 zero size 2024-03-18T14:43:25.062 INFO:tasks.workunit.client.0.smithi087.stdout:3/882: read - d0/de/d30/dc5/ffb zero size 2024-03-18T14:43:25.063 INFO:tasks.workunit.client.1.smithi129.stdout:9/697: symlink d0/db/d2e/le6 0 2024-03-18T14:43:25.063 INFO:tasks.workunit.client.1.smithi129.stdout:8/734: creat d9/d11/d1a/d32/d41/d4d/d96/dcc/ff4 x:0 0 0 2024-03-18T14:43:25.064 INFO:tasks.workunit.client.1.smithi129.stdout:9/698: fdatasync d0/db/d11/d97/f9e 0 2024-03-18T14:43:25.064 INFO:tasks.workunit.client.1.smithi129.stdout:9/699: fdatasync d0/db/d90/d70/fb7 0 2024-03-18T14:43:25.065 INFO:tasks.workunit.client.1.smithi129.stdout:9/700: chown d0/db/d90/c5a 189816670 1 2024-03-18T14:43:25.065 INFO:tasks.workunit.client.0.smithi087.stdout:1/925: creat d3/d1d/d1e/d43/dfb/f11d x:0 0 0 2024-03-18T14:43:25.069 INFO:tasks.workunit.client.0.smithi087.stdout:0/866: rename d0/d2/d3c/d73/f115 to d0/d2/d4/de8/dad/f126 0 2024-03-18T14:43:25.071 INFO:tasks.workunit.client.0.smithi087.stdout:9/968: rmdir db/d18/d1c/d69 39 2024-03-18T14:43:25.076 INFO:tasks.workunit.client.0.smithi087.stdout:7/937: link d1/d6/da/f43 d1/d6/d29/d2f/d68/d65/d96/d123/f13c 0 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.0.smithi087.stdout:6/814: mknod d3/d7/d25/d62/d8b/d106/c119 0 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.0.smithi087.stdout:7/938: rename d1/d6/d29 to d1/d6/d29/d2f/dea/d13d 22 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.1.smithi129.stdout:9/701: read d0/db/d11/d97/dd1/d25/d8e/f9a [1458364,79514] 0 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.1.smithi129.stdout:3/679: symlink d4/d11/d34/d4c/le6 0 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.1.smithi129.stdout:1/695: unlink d1/d35/f4c 0 2024-03-18T14:43:25.077 INFO:tasks.workunit.client.1.smithi129.stdout:2/733: creat d7/d1f/d81/dd4/fe7 x:0 0 0 2024-03-18T14:43:25.078 INFO:tasks.workunit.client.0.smithi087.stdout:8/847: mknod d1/d6/d2f/d44/d4b/da5/d114/c11a 0 2024-03-18T14:43:25.079 INFO:tasks.workunit.client.1.smithi129.stdout:3/680: chown d4/dd/d1f/da8/fc6 1465 1 2024-03-18T14:43:25.079 INFO:tasks.workunit.client.0.smithi087.stdout:1/926: stat d3/d1d/d1f/l57 0 2024-03-18T14:43:25.080 INFO:tasks.workunit.client.0.smithi087.stdout:8/848: chown d1/d6/d2f/d44/d45/d72/d7f/ddc 42135544 1 2024-03-18T14:43:25.081 INFO:tasks.workunit.client.1.smithi129.stdout:3/681: chown d4/d11/d1d/d50/d91/d97/fc1 941806 1 2024-03-18T14:43:25.081 INFO:tasks.workunit.client.1.smithi129.stdout:5/677: dwrite d0/dc/d18/d2b/f5e [0,4194304] 0 2024-03-18T14:43:25.082 INFO:tasks.workunit.client.0.smithi087.stdout:7/939: dwrite d1/d6/da/d42/d61/fa2 [0,4194304] 0 2024-03-18T14:43:25.082 INFO:tasks.workunit.client.0.smithi087.stdout:4/835: creat d2/db/d24/d30/d7b/dbe/dcf/def/d104/f110 x:0 0 0 2024-03-18T14:43:25.083 INFO:tasks.workunit.client.1.smithi129.stdout:5/678: read - d0/d32/d3a/d52/d6e/fb6 zero size 2024-03-18T14:43:25.083 INFO:tasks.workunit.client.1.smithi129.stdout:5/679: fdatasync d0/d32/d34/f64 0 2024-03-18T14:43:25.083 INFO:tasks.workunit.client.1.smithi129.stdout:4/652: mknod d0/d19/d46/d3e/d21/d4d/d70/dc3/cce 0 2024-03-18T14:43:25.084 INFO:tasks.workunit.client.0.smithi087.stdout:4/836: chown d2/db/de/ldf 286057 1 2024-03-18T14:43:25.084 INFO:tasks.workunit.client.1.smithi129.stdout:9/702: symlink d0/db/d11/d97/dd1/d26/d19/le7 0 2024-03-18T14:43:25.085 INFO:tasks.workunit.client.0.smithi087.stdout:6/815: rename d3/d7/d25/d62/d7c/d29/d22/d23/f69 to d3/dcd/f11a 0 2024-03-18T14:43:25.085 INFO:tasks.workunit.client.1.smithi129.stdout:2/734: mknod d7/d1f/d20/d36/dc0/ce8 0 2024-03-18T14:43:25.086 INFO:tasks.workunit.client.0.smithi087.stdout:9/969: creat db/d18/d1e/d28/d12a/f148 x:0 0 0 2024-03-18T14:43:25.086 INFO:tasks.workunit.client.0.smithi087.stdout:0/867: dwrite d0/d2/d4/de8/dad/dea/da3/da8/fcc [0,4194304] 0 2024-03-18T14:43:25.089 INFO:tasks.workunit.client.1.smithi129.stdout:8/735: mkdir d9/d11/d1a/d32/d41/df5 0 2024-03-18T14:43:25.090 INFO:tasks.workunit.client.1.smithi129.stdout:8/736: readlink d9/d11/d1a/d14/l47 0 2024-03-18T14:43:25.090 INFO:tasks.workunit.client.1.smithi129.stdout:2/735: dwrite d7/d1c/d32/f96 [0,4194304] 0 2024-03-18T14:43:25.095 INFO:tasks.workunit.client.1.smithi129.stdout:1/696: dread d1/d2/d28/d65/f98 [0,4194304] 0 2024-03-18T14:43:25.096 INFO:tasks.workunit.client.1.smithi129.stdout:8/737: dwrite d9/d11/ff3 [0,4194304] 0 2024-03-18T14:43:25.096 INFO:tasks.workunit.client.1.smithi129.stdout:6/721: getdents d3/d6/d7f 0 2024-03-18T14:43:25.097 INFO:tasks.workunit.client.0.smithi087.stdout:2/886: truncate d2/ddd/f6a 5133768 0 2024-03-18T14:43:25.098 INFO:tasks.workunit.client.0.smithi087.stdout:9/970: chown db/d18/d1c/d69 1962 1 2024-03-18T14:43:25.098 INFO:tasks.workunit.client.0.smithi087.stdout:2/887: chown d2/ddd/d22 153 1 2024-03-18T14:43:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:8/738: fdatasync d9/d11/d18/f3f 0 2024-03-18T14:43:25.099 INFO:tasks.workunit.client.1.smithi129.stdout:6/722: write d3/d5/f71 [342387,46135] 0 2024-03-18T14:43:25.100 INFO:tasks.workunit.client.1.smithi129.stdout:2/736: rmdir d7/d1f/d20/d2b/d41/d65/d88 39 2024-03-18T14:43:25.101 INFO:tasks.workunit.client.0.smithi087.stdout:8/849: read d1/d6/d2f/d44/d45/d72/f116 [912291,59295] 0 2024-03-18T14:43:25.103 INFO:tasks.workunit.client.0.smithi087.stdout:7/940: mkdir d1/d6/da/d13e 0 2024-03-18T14:43:25.104 INFO:tasks.workunit.client.1.smithi129.stdout:8/739: dwrite d9/d11/d18/da4/f9c [0,4194304] 0 2024-03-18T14:43:25.104 INFO:tasks.workunit.client.0.smithi087.stdout:7/941: readlink d1/d6/d29/d2f/d68/d65/d60/d66/lb2 0 2024-03-18T14:43:25.104 INFO:tasks.workunit.client.0.smithi087.stdout:6/816: creat d3/d7/d25/d62/d7c/da0/d96/d97/dbc/f11b x:0 0 0 2024-03-18T14:43:25.105 INFO:tasks.workunit.client.0.smithi087.stdout:9/971: chown db/c23 16 1 2024-03-18T14:43:25.108 INFO:tasks.workunit.client.0.smithi087.stdout:4/837: link d2/db/d84/d87/cd5 d2/db/d82/c111 0 2024-03-18T14:43:25.108 INFO:tasks.workunit.client.0.smithi087.stdout:4/838: write f1 [4891183,50805] 0 2024-03-18T14:43:25.112 INFO:tasks.workunit.client.1.smithi129.stdout:5/680: link d0/f84 d0/d32/d3a/d52/d69/d8a/fc9 0 2024-03-18T14:43:25.114 INFO:tasks.workunit.client.1.smithi129.stdout:8/740: symlink d9/d11/d1a/d14/db7/dc1/lf6 0 2024-03-18T14:43:25.115 INFO:tasks.workunit.client.1.smithi129.stdout:8/741: fsync d9/d11/f3b 0 2024-03-18T14:43:25.115 INFO:tasks.workunit.client.1.smithi129.stdout:8/742: dread - d9/d11/d1a/d32/d41/d4d/d96/fa0 zero size 2024-03-18T14:43:25.116 INFO:tasks.workunit.client.0.smithi087.stdout:4/839: mkdir d2/db/d24/d30/d7b/d7f/d112 0 2024-03-18T14:43:25.117 INFO:tasks.workunit.client.0.smithi087.stdout:6/817: symlink d3/d7/d25/d62/d7c/d29/d22/l11c 0 2024-03-18T14:43:25.118 INFO:tasks.workunit.client.0.smithi087.stdout:6/818: dread - d3/d7/d25/d62/d7c/d29/d7d/fc8 zero size 2024-03-18T14:43:25.119 INFO:tasks.workunit.client.1.smithi129.stdout:4/653: getdents d0/d19/d46/d3e/d21/d32 0 2024-03-18T14:43:25.120 INFO:tasks.workunit.client.1.smithi129.stdout:2/737: symlink d7/d1c/le9 0 2024-03-18T14:43:25.120 INFO:tasks.workunit.client.0.smithi087.stdout:6/819: dread - d3/d7/d25/fe3 zero size 2024-03-18T14:43:25.120 INFO:tasks.workunit.client.0.smithi087.stdout:4/840: mkdir d2/db/d24/d30/d7b/d7f/da5/d113 0 2024-03-18T14:43:25.120 INFO:tasks.workunit.client.1.smithi129.stdout:5/681: mknod d0/dc/d1a/db9/cca 0 2024-03-18T14:43:25.121 INFO:tasks.workunit.client.0.smithi087.stdout:1/927: write d3/d1d/d1f/d63/f6d [7380310,32931] 0 2024-03-18T14:43:25.121 INFO:tasks.workunit.client.0.smithi087.stdout:1/928: write d3/dbf/f100 [414324,135] 0 2024-03-18T14:43:25.122 INFO:tasks.workunit.client.1.smithi129.stdout:9/703: dwrite d0/db/d11/d97/dd1/d25/f61 [0,4194304] 0 2024-03-18T14:43:25.122 INFO:tasks.workunit.client.1.smithi129.stdout:2/738: write d7/d3f/d5f/fcf [587941,73982] 0 2024-03-18T14:43:25.123 INFO:tasks.workunit.client.0.smithi087.stdout:6/820: mkdir d3/d7/d25/d62/d7c/d29/d11d 0 2024-03-18T14:43:25.124 INFO:tasks.workunit.client.1.smithi129.stdout:8/743: dwrite d9/d11/d18/da4/fe2 [0,4194304] 0 2024-03-18T14:43:25.125 INFO:tasks.workunit.client.0.smithi087.stdout:4/841: symlink d2/db/d24/d30/d7b/d7f/d112/l114 0 2024-03-18T14:43:25.125 INFO:tasks.workunit.client.1.smithi129.stdout:4/654: truncate d0/fab 65334 0 2024-03-18T14:43:25.126 INFO:tasks.workunit.client.1.smithi129.stdout:4/655: dread - d0/d19/d46/d3e/d21/d4d/d70/fc6 zero size 2024-03-18T14:43:25.126 INFO:tasks.workunit.client.1.smithi129.stdout:5/682: symlink d0/dc/d18/d2b/lcb 0 2024-03-18T14:43:25.127 INFO:tasks.workunit.client.1.smithi129.stdout:4/656: readlink d0/d9/d4c/l4f 0 2024-03-18T14:43:25.127 INFO:tasks.workunit.client.0.smithi087.stdout:5/904: sync 2024-03-18T14:43:25.127 INFO:tasks.workunit.client.0.smithi087.stdout:3/883: sync 2024-03-18T14:43:25.128 INFO:tasks.workunit.client.0.smithi087.stdout:7/942: dread d1/d97/f107 [0,4194304] 0 2024-03-18T14:43:25.128 INFO:tasks.workunit.client.1.smithi129.stdout:2/739: mkdir d7/d3f/d5f/dea 0 2024-03-18T14:43:25.128 INFO:tasks.workunit.client.1.smithi129.stdout:2/740: write d7/d1c/fbe [55307,90460] 0 2024-03-18T14:43:25.129 INFO:tasks.workunit.client.1.smithi129.stdout:8/744: fdatasync d9/d11/f78 0 2024-03-18T14:43:25.130 INFO:tasks.workunit.client.0.smithi087.stdout:1/929: fsync d3/d1d/d1f/f70 0 2024-03-18T14:43:25.130 INFO:tasks.workunit.client.0.smithi087.stdout:4/842: fsync d2/db/d24/f58 0 2024-03-18T14:43:25.130 INFO:tasks.workunit.client.0.smithi087.stdout:6/821: truncate d3/f108 123354 0 2024-03-18T14:43:25.130 INFO:tasks.workunit.client.0.smithi087.stdout:3/884: symlink d0/d1c/d25/l108 0 2024-03-18T14:43:25.131 INFO:tasks.workunit.client.1.smithi129.stdout:9/704: mkdir d0/db/d2e/dd9/de8 0 2024-03-18T14:43:25.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/930: write d3/d1d/d1f/fd1 [2177586,69633] 0 2024-03-18T14:43:25.132 INFO:tasks.workunit.client.1.smithi129.stdout:9/705: chown d0/db/d1f/c38 3 1 2024-03-18T14:43:25.132 INFO:tasks.workunit.client.0.smithi087.stdout:4/843: write d2/db/d24/d30/d7b/d7f/da5/dae/fd6 [457161,97092] 0 2024-03-18T14:43:25.133 INFO:tasks.workunit.client.1.smithi129.stdout:8/745: dread d9/d11/d18/da4/fe2 [0,4194304] 0 2024-03-18T14:43:25.134 INFO:tasks.workunit.client.0.smithi087.stdout:6/822: unlink d3/d7/f57 0 2024-03-18T14:43:25.135 INFO:tasks.workunit.client.1.smithi129.stdout:5/683: symlink d0/dc/lcc 0 2024-03-18T14:43:25.136 INFO:tasks.workunit.client.0.smithi087.stdout:5/905: rename d13/d1b/d27/d35/d3b/c101 to d13/d1b/d27/d98/c132 0 2024-03-18T14:43:25.137 INFO:tasks.workunit.client.0.smithi087.stdout:1/931: chown d3/l5 1 1 2024-03-18T14:43:25.139 INFO:tasks.workunit.client.1.smithi129.stdout:4/657: read d0/d19/f38 [1080650,112973] 0 2024-03-18T14:43:25.140 INFO:tasks.workunit.client.1.smithi129.stdout:4/658: stat d0/d9/d40/d5f/d77 0 2024-03-18T14:43:25.141 INFO:tasks.workunit.client.0.smithi087.stdout:3/885: mkdir d0/d3/df/d109 0 2024-03-18T14:43:25.141 INFO:tasks.workunit.client.0.smithi087.stdout:4/844: stat d2/db/d3c/c51 0 2024-03-18T14:43:25.141 INFO:tasks.workunit.client.0.smithi087.stdout:6/823: symlink d3/d7/d25/d62/d7c/d29/d22/d61/l11e 0 2024-03-18T14:43:25.146 INFO:tasks.workunit.client.1.smithi129.stdout:8/746: dread d9/d11/d18/f3f [0,4194304] 0 2024-03-18T14:43:25.147 INFO:tasks.workunit.client.1.smithi129.stdout:5/684: dwrite d0/dc/d1a/d61/d94/fc1 [0,4194304] 0 2024-03-18T14:43:25.149 INFO:tasks.workunit.client.1.smithi129.stdout:5/685: fdatasync d0/d32/d3a/d52/d6e/fb6 0 2024-03-18T14:43:25.150 INFO:tasks.workunit.client.1.smithi129.stdout:2/741: rmdir d7/d1f/dd1 0 2024-03-18T14:43:25.150 INFO:tasks.workunit.client.0.smithi087.stdout:9/972: truncate db/d18/d1e/d7e/dc7/f105 1664764 0 2024-03-18T14:43:25.151 INFO:tasks.workunit.client.1.smithi129.stdout:2/742: write d7/d1f/d20/fdf [87140,32164] 0 2024-03-18T14:43:25.152 INFO:tasks.workunit.client.1.smithi129.stdout:1/697: dread d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:25.153 INFO:tasks.workunit.client.1.smithi129.stdout:6/723: dread d3/d30/de/d65/d93/fa0 [0,4194304] 0 2024-03-18T14:43:25.154 INFO:tasks.workunit.client.0.smithi087.stdout:4/845: read d2/f5b [1380034,121982] 0 2024-03-18T14:43:25.154 INFO:tasks.workunit.client.0.smithi087.stdout:8/850: dread d1/d6/d14/f5b [0,4194304] 0 2024-03-18T14:43:25.155 INFO:tasks.workunit.client.0.smithi087.stdout:4/846: fsync d2/db/d84/d87/fed 0 2024-03-18T14:43:25.156 INFO:tasks.workunit.client.0.smithi087.stdout:3/886: creat d0/d3/df/d42/dfc/f10a x:0 0 0 2024-03-18T14:43:25.157 INFO:tasks.workunit.client.0.smithi087.stdout:3/887: dread - d0/de/d30/d60/ddb/f103 zero size 2024-03-18T14:43:25.157 INFO:tasks.workunit.client.0.smithi087.stdout:5/906: truncate d13/d1b/d27/d35/dc6/fe8 296807 0 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.1.smithi129.stdout:7/722: sync 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.1.smithi129.stdout:0/730: sync 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.0.smithi087.stdout:7/943: truncate d1/d6/d29/d2f/d68/d65/d60/d109/f132 797043 0 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.0.smithi087.stdout:1/932: symlink d3/d1d/d1e/d20/l11e 0 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.0.smithi087.stdout:9/973: creat db/d18/d1e/d28/d76/d80/f149 x:0 0 0 2024-03-18T14:43:25.162 INFO:tasks.workunit.client.0.smithi087.stdout:6/824: symlink d3/d7/d25/df4/l11f 0 2024-03-18T14:43:25.163 INFO:tasks.workunit.client.0.smithi087.stdout:0/868: sync 2024-03-18T14:43:25.163 INFO:tasks.workunit.client.1.smithi129.stdout:0/731: read d0/d14/f49 [3650103,35778] 0 2024-03-18T14:43:25.164 INFO:tasks.workunit.client.0.smithi087.stdout:9/974: chown db/d18/d3a/c4e 42016 1 2024-03-18T14:43:25.164 INFO:tasks.workunit.client.0.smithi087.stdout:6/825: write d3/d7/d25/fe3 [738304,34599] 0 2024-03-18T14:43:25.164 INFO:tasks.workunit.client.0.smithi087.stdout:4/847: symlink d2/db/d24/d30/d7b/dbe/dcf/def/d104/l115 0 2024-03-18T14:43:25.164 INFO:tasks.workunit.client.1.smithi129.stdout:0/732: write d0/d14/f5f [574335,114486] 0 2024-03-18T14:43:25.168 INFO:tasks.workunit.client.1.smithi129.stdout:2/743: dread - d7/d1f/d20/d2b/d41/d65/d88/fe6 zero size 2024-03-18T14:43:25.168 INFO:tasks.workunit.client.0.smithi087.stdout:1/933: dwrite d3/d1d/d45/fae [0,4194304] 0 2024-03-18T14:43:25.169 INFO:tasks.workunit.client.1.smithi129.stdout:8/747: dwrite d9/d11/d1a/d14/d60/fbe [4194304,4194304] 0 2024-03-18T14:43:25.170 INFO:tasks.workunit.client.1.smithi129.stdout:9/706: dread d0/f10 [0,4194304] 0 2024-03-18T14:43:25.171 INFO:tasks.workunit.client.1.smithi129.stdout:0/733: mkdir d0/de3 0 2024-03-18T14:43:25.172 INFO:tasks.workunit.client.1.smithi129.stdout:0/734: fdatasync d0/d14/f2d 0 2024-03-18T14:43:25.175 INFO:tasks.workunit.client.0.smithi087.stdout:5/907: write d13/d1b/fb7 [786374,63411] 0 2024-03-18T14:43:25.176 INFO:tasks.workunit.client.0.smithi087.stdout:5/908: dread - d13/d1b/d27/d28/d9a/dae/f120 zero size 2024-03-18T14:43:25.177 INFO:tasks.workunit.client.1.smithi129.stdout:9/707: unlink d0/d15/c64 0 2024-03-18T14:43:25.177 INFO:tasks.workunit.client.1.smithi129.stdout:4/659: dread d0/d19/d46/d2e/f82 [0,4194304] 0 2024-03-18T14:43:25.180 INFO:tasks.workunit.client.1.smithi129.stdout:7/723: truncate d4/d2d/d2e/d79/dc6/d38/d61/d68/fb4 749122 0 2024-03-18T14:43:25.181 INFO:tasks.workunit.client.0.smithi087.stdout:0/869: rename d0/d2/d4/d19/f2f to d0/d2/d4/de8/dad/dea/dcb/f127 0 2024-03-18T14:43:25.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/851: link d1/d6/d8d/dc2/cce d1/d6/d2f/d44/d45/d72/d7f/c11b 0 2024-03-18T14:43:25.182 INFO:tasks.workunit.client.0.smithi087.stdout:0/870: chown d0/d1a/d34/c74 1 1 2024-03-18T14:43:25.182 INFO:tasks.workunit.client.1.smithi129.stdout:1/698: creat d1/d2/d28/d65/d7c/d7d/fda x:0 0 0 2024-03-18T14:43:25.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/871: chown d0/d1a/d7b/d2a/d85/l77 60 1 2024-03-18T14:43:25.183 INFO:tasks.workunit.client.0.smithi087.stdout:0/872: fdatasync d0/d2/d3c/f58 0 2024-03-18T14:43:25.184 INFO:tasks.workunit.client.1.smithi129.stdout:9/708: readlink d0/db/d11/d97/dd1/d26/d19/le7 0 2024-03-18T14:43:25.184 INFO:tasks.workunit.client.0.smithi087.stdout:9/975: truncate db/d18/d1c/d69/f92 147229 0 2024-03-18T14:43:25.185 INFO:tasks.workunit.client.1.smithi129.stdout:4/660: symlink d0/d19/d46/d3e/d21/lcf 0 2024-03-18T14:43:25.186 INFO:tasks.workunit.client.0.smithi087.stdout:9/976: write db/d18/d1e/d28/d76/db7/fc1 [244835,27145] 0 2024-03-18T14:43:25.187 INFO:tasks.workunit.client.0.smithi087.stdout:4/848: getdents d2/db/de/df5 0 2024-03-18T14:43:25.187 INFO:tasks.workunit.client.0.smithi087.stdout:4/849: stat d2/db/d67/f6a 0 2024-03-18T14:43:25.189 INFO:tasks.workunit.client.0.smithi087.stdout:4/850: write d2/db/d24/d30/d49/d4f/fde [669626,67317] 0 2024-03-18T14:43:25.189 INFO:tasks.workunit.client.1.smithi129.stdout:9/709: chown d0/db/d90/l71 3867349 1 2024-03-18T14:43:25.190 INFO:tasks.workunit.client.0.smithi087.stdout:5/909: write d13/f17 [1477668,105376] 0 2024-03-18T14:43:25.190 INFO:tasks.workunit.client.0.smithi087.stdout:4/851: fsync d2/db/fe1 0 2024-03-18T14:43:25.190 INFO:tasks.workunit.client.0.smithi087.stdout:2/888: sync 2024-03-18T14:43:25.191 INFO:tasks.workunit.client.0.smithi087.stdout:5/910: write d13/d1b/d70/fdf [1116849,75856] 0 2024-03-18T14:43:25.191 INFO:tasks.workunit.client.0.smithi087.stdout:6/826: truncate d3/d7/d25/d62/d7c/d29/d22/d23/f30 370655 0 2024-03-18T14:43:25.192 INFO:tasks.workunit.client.0.smithi087.stdout:5/911: fdatasync d13/d1b/d27/d35/d3b/fc4 0 2024-03-18T14:43:25.193 INFO:tasks.workunit.client.1.smithi129.stdout:2/744: getdents d7/d1f/d20/d36/da9 0 2024-03-18T14:43:25.193 INFO:tasks.workunit.client.0.smithi087.stdout:0/873: truncate d0/d1a/d34/d3d/fb8 2295270 0 2024-03-18T14:43:25.193 INFO:tasks.workunit.client.0.smithi087.stdout:0/874: readlink d0/d2/l118 0 2024-03-18T14:43:25.194 INFO:tasks.workunit.client.0.smithi087.stdout:1/934: mkdir d3/d1d/d1f/dab/d11f 0 2024-03-18T14:43:25.195 INFO:tasks.workunit.client.1.smithi129.stdout:1/699: link d1/d2/d28/d65/d19/d52/f6a d1/d2/d28/d65/d7c/d7d/d80/fdb 0 2024-03-18T14:43:25.197 INFO:tasks.workunit.client.0.smithi087.stdout:9/977: creat db/d18/d1c/d69/d11a/d12e/f14a x:0 0 0 2024-03-18T14:43:25.198 INFO:tasks.workunit.client.1.smithi129.stdout:3/682: sync 2024-03-18T14:43:25.198 INFO:tasks.workunit.client.1.smithi129.stdout:3/683: fsync d4/fb 0 2024-03-18T14:43:25.200 INFO:tasks.workunit.client.1.smithi129.stdout:3/684: write d4/d11/d1d/f7f [338166,19548] 0 2024-03-18T14:43:25.200 INFO:tasks.workunit.client.1.smithi129.stdout:0/735: link d0/d23/d71/dc2/d4a/cd3 d0/d23/d35/d3b/d42/ce4 0 2024-03-18T14:43:25.202 INFO:tasks.workunit.client.1.smithi129.stdout:8/748: dread d9/d11/d1a/d14/f5e [0,4194304] 0 2024-03-18T14:43:25.202 INFO:tasks.workunit.client.1.smithi129.stdout:4/661: dwrite d0/d9/d6a/d7b/fa6 [0,4194304] 0 2024-03-18T14:43:25.203 INFO:tasks.workunit.client.0.smithi087.stdout:4/852: creat d2/db/d24/d30/d49/d4f/f116 x:0 0 0 2024-03-18T14:43:25.203 INFO:tasks.workunit.client.1.smithi129.stdout:2/745: mkdir d7/d1f/d20/d2b/deb 0 2024-03-18T14:43:25.203 INFO:tasks.workunit.client.1.smithi129.stdout:4/662: stat d0/d9 0 2024-03-18T14:43:25.205 INFO:tasks.workunit.client.1.smithi129.stdout:7/724: getdents d4/d2d/d2e/d79/dc6/d54 0 2024-03-18T14:43:25.205 INFO:tasks.workunit.client.1.smithi129.stdout:4/663: chown d0/d19/d5d/fad 493345 1 2024-03-18T14:43:25.205 INFO:tasks.workunit.client.0.smithi087.stdout:7/944: getdents d1/d6/d29/d2f/d68/d65/d96 0 2024-03-18T14:43:25.205 INFO:tasks.workunit.client.0.smithi087.stdout:6/827: mkdir d3/d7/d25/dfb/d120 0 2024-03-18T14:43:25.206 INFO:tasks.workunit.client.1.smithi129.stdout:6/724: dread d3/d30/f1e [0,4194304] 0 2024-03-18T14:43:25.207 INFO:tasks.workunit.client.0.smithi087.stdout:7/945: write d1/d6/da/f37 [2568770,65602] 0 2024-03-18T14:43:25.207 INFO:tasks.workunit.client.1.smithi129.stdout:9/710: mknod d0/db/d11/d97/dd1/d6c/dd4/ce9 0 2024-03-18T14:43:25.210 INFO:tasks.workunit.client.1.smithi129.stdout:2/746: rmdir d7/d1f/d81/dd4 39 2024-03-18T14:43:25.211 INFO:tasks.workunit.client.0.smithi087.stdout:2/889: dread d2/ddd/f19 [0,4194304] 0 2024-03-18T14:43:25.211 INFO:tasks.workunit.client.0.smithi087.stdout:8/852: dread d1/d6/d8d/f94 [0,4194304] 0 2024-03-18T14:43:25.212 INFO:tasks.workunit.client.1.smithi129.stdout:4/664: readlink d0/d19/d46/d3e/d21/d4d/d58/d61/l8a 0 2024-03-18T14:43:25.213 INFO:tasks.workunit.client.1.smithi129.stdout:3/685: read d4/d38/f2c [670382,43517] 0 2024-03-18T14:43:25.215 INFO:tasks.workunit.client.1.smithi129.stdout:0/736: mknod d0/d23/d71/dc2/d4a/d7a/ce5 0 2024-03-18T14:43:25.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/853: dread d1/d6/d2f/d44/d45/d72/fc3 [0,4194304] 0 2024-03-18T14:43:25.216 INFO:tasks.workunit.client.0.smithi087.stdout:4/853: creat d2/db/d24/d30/d8a/d95/f117 x:0 0 0 2024-03-18T14:43:25.216 INFO:tasks.workunit.client.0.smithi087.stdout:5/912: dread d13/d1b/d27/d28/f7f [0,4194304] 0 2024-03-18T14:43:25.217 INFO:tasks.workunit.client.1.smithi129.stdout:6/725: getdents d3/d30/df/d28/d79/daf/db7/dc3 0 2024-03-18T14:43:25.217 INFO:tasks.workunit.client.0.smithi087.stdout:0/875: mkdir d0/d128 0 2024-03-18T14:43:25.217 INFO:tasks.workunit.client.0.smithi087.stdout:8/854: dread - d1/d6/d9/d5d/d87/dd1/ffd zero size 2024-03-18T14:43:25.218 INFO:tasks.workunit.client.1.smithi129.stdout:3/686: write d4/dd/f45 [559070,66143] 0 2024-03-18T14:43:25.218 INFO:tasks.workunit.client.1.smithi129.stdout:4/665: dwrite d0/d3c/d6c/d89/fc2 [0,4194304] 0 2024-03-18T14:43:25.219 INFO:tasks.workunit.client.0.smithi087.stdout:5/913: read d13/d1b/d7e/fa2 [3541619,80281] 0 2024-03-18T14:43:25.220 INFO:tasks.workunit.client.1.smithi129.stdout:9/711: truncate d0/db/fb5 630839 0 2024-03-18T14:43:25.221 INFO:tasks.workunit.client.0.smithi087.stdout:2/890: symlink d2/ddd/d22/d24/d65/d7f/l126 0 2024-03-18T14:43:25.222 INFO:tasks.workunit.client.1.smithi129.stdout:9/712: dread - d0/db/d2e/d9d/fba zero size 2024-03-18T14:43:25.223 INFO:tasks.workunit.client.0.smithi087.stdout:4/854: symlink d2/db/de/l118 0 2024-03-18T14:43:25.224 INFO:tasks.workunit.client.1.smithi129.stdout:5/686: sync 2024-03-18T14:43:25.224 INFO:tasks.workunit.client.1.smithi129.stdout:2/747: dwrite d7/d1f/d20/d2d/f35 [0,4194304] 0 2024-03-18T14:43:25.224 INFO:tasks.workunit.client.1.smithi129.stdout:0/737: getdents d0 0 2024-03-18T14:43:25.225 INFO:tasks.workunit.client.0.smithi087.stdout:2/891: dwrite d2/ddd/d22/d2c/d3a/d49/f8b [0,4194304] 0 2024-03-18T14:43:25.226 INFO:tasks.workunit.client.1.smithi129.stdout:8/749: write d9/d11/d18/da4/ff0 [461320,52251] 0 2024-03-18T14:43:25.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/725: dread d4/f66 [0,4194304] 0 2024-03-18T14:43:25.228 INFO:tasks.workunit.client.1.smithi129.stdout:4/666: dread d0/d19/d46/d3e/d21/d4d/d58/d61/f98 [0,4194304] 0 2024-03-18T14:43:25.228 INFO:tasks.workunit.client.1.smithi129.stdout:7/726: stat d4/d2d/d2e/lbd 0 2024-03-18T14:43:25.228 INFO:tasks.workunit.client.0.smithi087.stdout:0/876: mknod d0/d2/d6b/c129 0 2024-03-18T14:43:25.230 INFO:tasks.workunit.client.1.smithi129.stdout:9/713: creat d0/db/d90/fea x:0 0 0 2024-03-18T14:43:25.230 INFO:tasks.workunit.client.0.smithi087.stdout:3/888: sync 2024-03-18T14:43:25.232 INFO:tasks.workunit.client.0.smithi087.stdout:8/855: rename d1/d6/d14/db2/f10b to d1/d6/d2f/d44/dfc/f11c 0 2024-03-18T14:43:25.233 INFO:tasks.workunit.client.1.smithi129.stdout:6/726: getdents d3/d6/d7f/db4/d57 0 2024-03-18T14:43:25.235 INFO:tasks.workunit.client.1.smithi129.stdout:7/727: dwrite d4/d2d/d2e/d79/dc6/d54/f94 [0,4194304] 0 2024-03-18T14:43:25.236 INFO:tasks.workunit.client.0.smithi087.stdout:5/914: mkdir d13/d1b/d7e/dfc/d133 0 2024-03-18T14:43:25.236 INFO:tasks.workunit.client.1.smithi129.stdout:2/748: dwrite d7/d1c/f84 [0,4194304] 0 2024-03-18T14:43:25.237 INFO:tasks.workunit.client.1.smithi129.stdout:4/667: rename d0/d19/d46/d3e/d21/d97 to d0/d9/d6a/d7b/dd0 0 2024-03-18T14:43:25.238 INFO:tasks.workunit.client.1.smithi129.stdout:2/749: readlink d7/d1f/d20/d2d/dab/lca 0 2024-03-18T14:43:25.239 INFO:tasks.workunit.client.1.smithi129.stdout:5/687: creat d0/d32/d3a/d45/d83/d9b/dc4/fcd x:0 0 0 2024-03-18T14:43:25.240 INFO:tasks.workunit.client.0.smithi087.stdout:2/892: creat d2/ddd/d22/d2c/d3a/d40/d98/dd8/f127 x:0 0 0 2024-03-18T14:43:25.241 INFO:tasks.workunit.client.0.smithi087.stdout:2/893: fsync d2/ddd/f46 0 2024-03-18T14:43:25.241 INFO:tasks.workunit.client.1.smithi129.stdout:8/750: creat d9/d11/d55/d68/d72/ff7 x:0 0 0 2024-03-18T14:43:25.242 INFO:tasks.workunit.client.1.smithi129.stdout:0/738: dread d0/d23/d35/fb4 [0,4194304] 0 2024-03-18T14:43:25.243 INFO:tasks.workunit.client.0.smithi087.stdout:9/978: link db/f10d db/d18/d1c/d69/d6f/d140/f14b 0 2024-03-18T14:43:25.245 INFO:tasks.workunit.client.1.smithi129.stdout:7/728: creat d4/d2d/d2e/d79/dc6/d54/d86/fdf x:0 0 0 2024-03-18T14:43:25.246 INFO:tasks.workunit.client.0.smithi087.stdout:6/828: truncate d3/d7/dbd/fca 518910 0 2024-03-18T14:43:25.248 INFO:tasks.workunit.client.1.smithi129.stdout:2/750: rename d7/l19 to d7/d1c/d32/lec 0 2024-03-18T14:43:25.249 INFO:tasks.workunit.client.0.smithi087.stdout:7/946: creat d1/d6/d29/d2f/d68/d65/d60/d66/f13f x:0 0 0 2024-03-18T14:43:25.250 INFO:tasks.workunit.client.0.smithi087.stdout:4/855: creat d2/db/d24/d30/d7b/dbe/dc6/f119 x:0 0 0 2024-03-18T14:43:25.250 INFO:tasks.workunit.client.1.smithi129.stdout:8/751: mkdir d9/d11/d55/d6a/d6f/df8 0 2024-03-18T14:43:25.252 INFO:tasks.workunit.client.0.smithi087.stdout:0/877: symlink d0/d128/l12a 0 2024-03-18T14:43:25.252 INFO:tasks.workunit.client.1.smithi129.stdout:4/668: creat d0/d19/d46/d3e/dc0/fd1 x:0 0 0 2024-03-18T14:43:25.253 INFO:tasks.workunit.client.1.smithi129.stdout:7/729: stat d4/d83/fbb 0 2024-03-18T14:43:25.254 INFO:tasks.workunit.client.0.smithi087.stdout:0/878: stat d0/d1a/d7b/d2a/d85/l77 0 2024-03-18T14:43:25.254 INFO:tasks.workunit.client.0.smithi087.stdout:8/856: dwrite d1/d6/d9/f60 [0,4194304] 0 2024-03-18T14:43:25.254 INFO:tasks.workunit.client.1.smithi129.stdout:7/730: fdatasync d4/d2d/d2e/d79/dc6/ff 0 2024-03-18T14:43:25.256 INFO:tasks.workunit.client.0.smithi087.stdout:5/915: rename d13/d1b/d27/d35/da7/lf1 to d13/d1b/d30/d6e/dc8/l134 0 2024-03-18T14:43:25.256 INFO:tasks.workunit.client.1.smithi129.stdout:6/727: rename d3/d5/fa6 to d3/d30/de/d65/d93/dd0/feb 0 2024-03-18T14:43:25.259 INFO:tasks.workunit.client.0.smithi087.stdout:8/857: symlink d1/d6/d8d/l11d 0 2024-03-18T14:43:25.259 INFO:tasks.workunit.client.1.smithi129.stdout:0/739: dread d0/d23/d71/f96 [0,4194304] 0 2024-03-18T14:43:25.259 INFO:tasks.workunit.client.0.smithi087.stdout:8/858: stat d1/d6/d2f/f39 0 2024-03-18T14:43:25.260 INFO:tasks.workunit.client.1.smithi129.stdout:7/731: dwrite d4/d2d/d2e/d42/d58/f7f [0,4194304] 0 2024-03-18T14:43:25.264 INFO:tasks.workunit.client.1.smithi129.stdout:4/669: rmdir d0/d3c 39 2024-03-18T14:43:25.268 INFO:tasks.workunit.client.0.smithi087.stdout:5/916: rmdir d13/d1b/d30/d6e/d88 39 2024-03-18T14:43:25.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/935: sync 2024-03-18T14:43:25.268 INFO:tasks.workunit.client.1.smithi129.stdout:2/751: mkdir d7/d1f/d20/d2b/d41/da6/ded 0 2024-03-18T14:43:25.270 INFO:tasks.workunit.client.0.smithi087.stdout:4/856: creat d2/db/d24/d30/d7b/d7f/da5/db4/dfe/f11a x:0 0 0 2024-03-18T14:43:25.271 INFO:tasks.workunit.client.1.smithi129.stdout:6/728: rename d3/d30/de/d65/l81 to d3/d30/de/d6c/d9e/db6/lec 0 2024-03-18T14:43:25.271 INFO:tasks.workunit.client.0.smithi087.stdout:8/859: mkdir d1/d6/d2f/d44/d45/d72/db6/d11e 0 2024-03-18T14:43:25.272 INFO:tasks.workunit.client.1.smithi129.stdout:7/732: symlink d4/d2d/d2e/d79/dc6/d8/d3b/le0 0 2024-03-18T14:43:25.273 INFO:tasks.workunit.client.1.smithi129.stdout:8/752: truncate d9/d11/d1a/f4b 1283490 0 2024-03-18T14:43:25.275 INFO:tasks.workunit.client.1.smithi129.stdout:2/752: dwrite d7/d1f/d20/d36/f73 [0,4194304] 0 2024-03-18T14:43:25.276 INFO:tasks.workunit.client.0.smithi087.stdout:1/936: write d3/d1d/d79/f7f [4630847,44711] 0 2024-03-18T14:43:25.277 INFO:tasks.workunit.client.0.smithi087.stdout:2/894: write d2/ddd/d22/d24/d65/f6b [528161,46290] 0 2024-03-18T14:43:25.278 INFO:tasks.workunit.client.1.smithi129.stdout:4/670: creat d0/d3c/d6c/fd2 x:0 0 0 2024-03-18T14:43:25.279 INFO:tasks.workunit.client.0.smithi087.stdout:7/947: dread d1/d6/d16/dc/f26 [0,4194304] 0 2024-03-18T14:43:25.279 INFO:tasks.workunit.client.0.smithi087.stdout:9/979: write db/d18/d1c/d69/d6f/d140/f145 [1313700,4632] 0 2024-03-18T14:43:25.280 INFO:tasks.workunit.client.0.smithi087.stdout:6/829: truncate d3/d7/d25/d62/d7c/d29/d22/f5d 5089239 0 2024-03-18T14:43:25.281 INFO:tasks.workunit.client.1.smithi129.stdout:9/714: dwrite d0/db/fb5 [0,4194304] 0 2024-03-18T14:43:25.282 INFO:tasks.workunit.client.1.smithi129.stdout:1/700: sync 2024-03-18T14:43:25.282 INFO:tasks.workunit.client.1.smithi129.stdout:5/688: dread d0/dc/f7b [0,4194304] 0 2024-03-18T14:43:25.283 INFO:tasks.workunit.client.1.smithi129.stdout:6/729: dwrite d3/f6a [0,4194304] 0 2024-03-18T14:43:25.284 INFO:tasks.workunit.client.0.smithi087.stdout:2/895: chown d2/ddd/d22/c3f 29559449 1 2024-03-18T14:43:25.285 INFO:tasks.workunit.client.0.smithi087.stdout:2/896: write d2/f43 [2674935,69361] 0 2024-03-18T14:43:25.285 INFO:tasks.workunit.client.0.smithi087.stdout:7/948: creat d1/d6/da/d59/dfe/f140 x:0 0 0 2024-03-18T14:43:25.285 INFO:tasks.workunit.client.1.smithi129.stdout:8/753: dwrite d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:25.286 INFO:tasks.workunit.client.0.smithi087.stdout:7/949: chown d1/d6/d16/dc/ddc/d12d 1505804 1 2024-03-18T14:43:25.286 INFO:tasks.workunit.client.0.smithi087.stdout:8/860: creat d1/d6/d2f/d44/d45/d72/db6/d11e/f11f x:0 0 0 2024-03-18T14:43:25.286 INFO:tasks.workunit.client.1.smithi129.stdout:2/753: unlink d7/d1f/d20/d2b/d41/c69 0 2024-03-18T14:43:25.287 INFO:tasks.workunit.client.0.smithi087.stdout:1/937: creat d3/d1d/d1e/d43/d50/d71/d11a/f120 x:0 0 0 2024-03-18T14:43:25.288 INFO:tasks.workunit.client.1.smithi129.stdout:2/754: fsync d7/d1f/d20/d72/f9f 0 2024-03-18T14:43:25.289 INFO:tasks.workunit.client.0.smithi087.stdout:8/861: dread - d1/d6/d2f/d44/d45/d72/f10f zero size 2024-03-18T14:43:25.289 INFO:tasks.workunit.client.0.smithi087.stdout:0/879: dread d0/d1a/d7b/d2a/f52 [0,4194304] 0 2024-03-18T14:43:25.289 INFO:tasks.workunit.client.1.smithi129.stdout:7/733: creat d4/d2d/d2e/fe1 x:0 0 0 2024-03-18T14:43:25.290 INFO:tasks.workunit.client.1.smithi129.stdout:7/734: chown d4/d2d/d2e/d45/fc4 14438725 1 2024-03-18T14:43:25.294 INFO:tasks.workunit.client.0.smithi087.stdout:5/917: dwrite d13/d1b/d27/d28/d9a/fcb [0,4194304] 0 2024-03-18T14:43:25.295 INFO:tasks.workunit.client.1.smithi129.stdout:7/735: dwrite d4/d2d/d2e/d79/dc6/ff [0,4194304] 0 2024-03-18T14:43:25.295 INFO:tasks.workunit.client.1.smithi129.stdout:0/740: dread d0/d23/d6b/f9a [0,4194304] 0 2024-03-18T14:43:25.295 INFO:tasks.workunit.client.0.smithi087.stdout:1/938: dwrite d3/d1d/d1e/d43/dfb/dc8/fd9 [4194304,4194304] 0 2024-03-18T14:43:25.296 INFO:tasks.workunit.client.1.smithi129.stdout:0/741: write d0/d23/d35/f36 [657063,44137] 0 2024-03-18T14:43:25.298 INFO:tasks.workunit.client.0.smithi087.stdout:7/950: creat d1/d6/d29/d2f/d68/d65/d96/d123/f141 x:0 0 0 2024-03-18T14:43:25.298 INFO:tasks.workunit.client.1.smithi129.stdout:6/730: fdatasync d3/d6/f2d 0 2024-03-18T14:43:25.298 INFO:tasks.workunit.client.1.smithi129.stdout:6/731: write d3/d30/df/d28/f54 [2254892,107369] 0 2024-03-18T14:43:25.302 INFO:tasks.workunit.client.1.smithi129.stdout:2/755: mknod d7/d1f/d20/d72/cee 0 2024-03-18T14:43:25.303 INFO:tasks.workunit.client.1.smithi129.stdout:2/756: dread - d7/d1c/d79/fa3 zero size 2024-03-18T14:43:25.303 INFO:tasks.workunit.client.1.smithi129.stdout:1/701: dread d1/d2/d28/d65/d7c/d7d/fa5 [0,4194304] 0 2024-03-18T14:43:25.304 INFO:tasks.workunit.client.0.smithi087.stdout:2/897: symlink d2/d44/l128 0 2024-03-18T14:43:25.305 INFO:tasks.workunit.client.0.smithi087.stdout:0/880: symlink d0/d2/d4/d27/dc3/l12b 0 2024-03-18T14:43:25.306 INFO:tasks.workunit.client.0.smithi087.stdout:7/951: symlink d1/d6/d16/da6/dee/l142 0 2024-03-18T14:43:25.306 INFO:tasks.workunit.client.1.smithi129.stdout:4/671: link d0/d3c/d6c/d89/f9b d0/d9/d4c/fd3 0 2024-03-18T14:43:25.309 INFO:tasks.workunit.client.0.smithi087.stdout:1/939: symlink d3/d1d/d1f/l121 0 2024-03-18T14:43:25.309 INFO:tasks.workunit.client.1.smithi129.stdout:0/742: dwrite d0/d23/f67 [0,4194304] 0 2024-03-18T14:43:25.310 INFO:tasks.workunit.client.0.smithi087.stdout:7/952: dwrite d1/d6/d16/dc/f5f [0,4194304] 0 2024-03-18T14:43:25.312 INFO:tasks.workunit.client.0.smithi087.stdout:2/898: symlink d2/ddd/d22/d2c/d3a/d68/dcb/l129 0 2024-03-18T14:43:25.313 INFO:tasks.workunit.client.0.smithi087.stdout:2/899: write d2/ddd/d22/d24/f10c [509015,111339] 0 2024-03-18T14:43:25.313 INFO:tasks.workunit.client.1.smithi129.stdout:1/702: rename d1/d2/d28/d65/d19/dc9/l5b to d1/d2/d28/d65/d19/dc9/d56/ldc 0 2024-03-18T14:43:25.314 INFO:tasks.workunit.client.1.smithi129.stdout:1/703: write d1/dbf/fcc [1000071,61956] 0 2024-03-18T14:43:25.314 INFO:tasks.workunit.client.1.smithi129.stdout:7/736: symlink d4/d2d/d2e/d79/dc6/le2 0 2024-03-18T14:43:25.315 INFO:tasks.workunit.client.1.smithi129.stdout:3/687: sync 2024-03-18T14:43:25.315 INFO:tasks.workunit.client.1.smithi129.stdout:7/737: chown d4/d2d/d2e/f73 39554818 1 2024-03-18T14:43:25.316 INFO:tasks.workunit.client.1.smithi129.stdout:0/743: creat d0/d14/d91/fe6 x:0 0 0 2024-03-18T14:43:25.317 INFO:tasks.workunit.client.1.smithi129.stdout:8/754: link d9/d11/c7b d9/d11/d55/d6a/d6f/df8/cf9 0 2024-03-18T14:43:25.317 INFO:tasks.workunit.client.1.smithi129.stdout:7/738: chown d4/d2d/d2e/d79/dc6/le2 117911338 1 2024-03-18T14:43:25.317 INFO:tasks.workunit.client.1.smithi129.stdout:0/744: fsync d0/d6c/f85 0 2024-03-18T14:43:25.319 INFO:tasks.workunit.client.0.smithi087.stdout:5/918: mkdir d13/d1b/d30/d6e/d88/db4/d129/d135 0 2024-03-18T14:43:25.325 INFO:tasks.workunit.client.0.smithi087.stdout:1/940: mkdir d3/d3c/db8/d8f/dc2/d122 0 2024-03-18T14:43:25.325 INFO:tasks.workunit.client.1.smithi129.stdout:4/672: rename d0/d19/d5d/f8c to d0/d19/d46/d3e/d21/d7f/fd4 0 2024-03-18T14:43:25.325 INFO:tasks.workunit.client.1.smithi129.stdout:3/688: fdatasync d4/dd/d1f/d5f/d31/fd1 0 2024-03-18T14:43:25.325 INFO:tasks.workunit.client.1.smithi129.stdout:0/745: chown d0/d23/cbf 7 1 2024-03-18T14:43:25.325 INFO:tasks.workunit.client.0.smithi087.stdout:2/900: rmdir d2/ddd/d22/d2c/d3a/d49/d58/d78 39 2024-03-18T14:43:25.326 INFO:tasks.workunit.client.1.smithi129.stdout:0/746: fdatasync d0/d23/d35/d3b/fad 0 2024-03-18T14:43:25.328 INFO:tasks.workunit.client.0.smithi087.stdout:5/919: rename d13/d1b/d27/lb5 to d13/d1b/d30/d6e/d88/db4/d129/l136 0 2024-03-18T14:43:25.329 INFO:tasks.workunit.client.0.smithi087.stdout:7/953: creat d1/d6/da/d42/dde/f143 x:0 0 0 2024-03-18T14:43:25.330 INFO:tasks.workunit.client.0.smithi087.stdout:7/954: dread - d1/d6/d16/f100 zero size 2024-03-18T14:43:25.331 INFO:tasks.workunit.client.0.smithi087.stdout:7/955: write d1/d6/d29/f53 [4373934,74672] 0 2024-03-18T14:43:25.333 INFO:tasks.workunit.client.0.smithi087.stdout:5/920: symlink d13/d1b/d27/d8f/dab/l137 0 2024-03-18T14:43:25.333 INFO:tasks.workunit.client.0.smithi087.stdout:0/881: getdents d0/d1a/d34/d3d/dd6 0 2024-03-18T14:43:25.333 INFO:tasks.workunit.client.1.smithi129.stdout:0/747: write d0/d14/d28/fa8 [1334978,67889] 0 2024-03-18T14:43:25.334 INFO:tasks.workunit.client.0.smithi087.stdout:3/889: sync 2024-03-18T14:43:25.335 INFO:tasks.workunit.client.1.smithi129.stdout:4/673: rename d0/d19/d46/d3e/d21/dc9 to d0/d19/d46/d3e/d21/d4d/d58/d61/dd5 0 2024-03-18T14:43:25.336 INFO:tasks.workunit.client.0.smithi087.stdout:7/956: mkdir d1/d6/d16/da6/dee/d144 0 2024-03-18T14:43:25.337 INFO:tasks.workunit.client.0.smithi087.stdout:1/941: creat d3/d1d/d1e/f123 x:0 0 0 2024-03-18T14:43:25.337 INFO:tasks.workunit.client.1.smithi129.stdout:1/704: creat d1/d2/d28/d65/d7c/fdd x:0 0 0 2024-03-18T14:43:25.338 INFO:tasks.workunit.client.0.smithi087.stdout:0/882: dwrite d0/d1a/d80/d88/dbd/f10f [0,4194304] 0 2024-03-18T14:43:25.338 INFO:tasks.workunit.client.0.smithi087.stdout:1/942: dread - d3/d1d/d1f/d63/f109 zero size 2024-03-18T14:43:25.339 INFO:tasks.workunit.client.0.smithi087.stdout:1/943: chown d3/d1d/d1f/d34/f62 375410 1 2024-03-18T14:43:25.340 INFO:tasks.workunit.client.1.smithi129.stdout:0/748: rmdir d0/d23/d35/d3b/d42 39 2024-03-18T14:43:25.341 INFO:tasks.workunit.client.0.smithi087.stdout:7/957: write d1/d97/db9/f10e [3411181,79918] 0 2024-03-18T14:43:25.342 INFO:tasks.workunit.client.0.smithi087.stdout:2/901: getdents d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111 0 2024-03-18T14:43:25.342 INFO:tasks.workunit.client.1.smithi129.stdout:7/739: truncate d4/d2d/d2e/d79/dc6/d54/d86/f99 401089 0 2024-03-18T14:43:25.342 INFO:tasks.workunit.client.1.smithi129.stdout:7/740: readlink d4/d8c/l89 0 2024-03-18T14:43:25.344 INFO:tasks.workunit.client.0.smithi087.stdout:1/944: dwrite d3/d1d/d1e/d20/f56 [0,4194304] 0 2024-03-18T14:43:25.345 INFO:tasks.workunit.client.0.smithi087.stdout:5/921: creat d13/d1b/d27/d35/f138 x:0 0 0 2024-03-18T14:43:25.345 INFO:tasks.workunit.client.1.smithi129.stdout:1/705: unlink d1/d2/d28/c44 0 2024-03-18T14:43:25.345 INFO:tasks.workunit.client.0.smithi087.stdout:8/862: dread d1/d6/d2f/fa8 [0,4194304] 0 2024-03-18T14:43:25.347 INFO:tasks.workunit.client.0.smithi087.stdout:5/922: write d13/d1b/d27/d28/d9a/f123 [243961,74801] 0 2024-03-18T14:43:25.347 INFO:tasks.workunit.client.1.smithi129.stdout:3/689: truncate d4/fa1 1765698 0 2024-03-18T14:43:25.348 INFO:tasks.workunit.client.1.smithi129.stdout:9/715: sync 2024-03-18T14:43:25.349 INFO:tasks.workunit.client.0.smithi087.stdout:9/980: dread db/d18/d1c/f93 [0,4194304] 0 2024-03-18T14:43:25.349 INFO:tasks.workunit.client.1.smithi129.stdout:9/716: chown d0/d15/cb9 2940 1 2024-03-18T14:43:25.353 INFO:tasks.workunit.client.0.smithi087.stdout:1/945: creat d3/d1d/d1f/d63/f124 x:0 0 0 2024-03-18T14:43:25.353 INFO:tasks.workunit.client.0.smithi087.stdout:8/863: truncate d1/d6/d14/db2/dbc/fbf 822972 0 2024-03-18T14:43:25.354 INFO:tasks.workunit.client.1.smithi129.stdout:9/717: dwrite d0/db/f1d [4194304,4194304] 0 2024-03-18T14:43:25.354 INFO:tasks.workunit.client.0.smithi087.stdout:9/981: rmdir db/d18/d1e/d28 39 2024-03-18T14:43:25.356 INFO:tasks.workunit.client.0.smithi087.stdout:8/864: symlink d1/l120 0 2024-03-18T14:43:25.358 INFO:tasks.workunit.client.1.smithi129.stdout:5/689: truncate d0/dc/d18/d2b/f47 1158908 0 2024-03-18T14:43:25.359 INFO:tasks.workunit.client.1.smithi129.stdout:5/690: dread - d0/d32/d34/d6c/da3/fc7 zero size 2024-03-18T14:43:25.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/865: creat d1/d6/d2f/d44/d45/d72/d7f/f121 x:0 0 0 2024-03-18T14:43:25.366 INFO:tasks.workunit.client.0.smithi087.stdout:4/857: sync 2024-03-18T14:43:25.366 INFO:tasks.workunit.client.1.smithi129.stdout:8/755: truncate d9/d11/d1a/d32/d3a/f9d 1659608 0 2024-03-18T14:43:25.366 INFO:tasks.workunit.client.1.smithi129.stdout:6/732: sync 2024-03-18T14:43:25.366 INFO:tasks.workunit.client.1.smithi129.stdout:2/757: sync 2024-03-18T14:43:25.367 INFO:tasks.workunit.client.1.smithi129.stdout:8/756: write d9/d11/d1a/d32/d41/d4d/f56 [3829246,61202] 0 2024-03-18T14:43:25.371 INFO:tasks.workunit.client.1.smithi129.stdout:1/706: write d1/d2/d28/d65/d19/f61 [2367410,31709] 0 2024-03-18T14:43:25.372 INFO:tasks.workunit.client.1.smithi129.stdout:3/690: write d4/d11/d1d/d50/d90/fb6 [2711486,93072] 0 2024-03-18T14:43:25.373 INFO:tasks.workunit.client.0.smithi087.stdout:1/946: truncate d3/d1d/d1e/d20/fd5 1195871 0 2024-03-18T14:43:25.374 INFO:tasks.workunit.client.0.smithi087.stdout:2/902: dread d2/ddd/d22/fe2 [0,4194304] 0 2024-03-18T14:43:25.374 INFO:tasks.workunit.client.0.smithi087.stdout:3/890: dwrite d0/de/d30/d46/d76/fd7 [0,4194304] 0 2024-03-18T14:43:25.375 INFO:tasks.workunit.client.1.smithi129.stdout:5/691: fdatasync d0/df/f44 0 2024-03-18T14:43:25.375 INFO:tasks.workunit.client.0.smithi087.stdout:8/866: mkdir d1/d6/d2f/d9b/d122 0 2024-03-18T14:43:25.376 INFO:tasks.workunit.client.0.smithi087.stdout:1/947: chown d3/d1d/d79/f8d 12538 1 2024-03-18T14:43:25.376 INFO:tasks.workunit.client.0.smithi087.stdout:9/982: link f8 db/d18/d1e/d28/f14c 0 2024-03-18T14:43:25.377 INFO:tasks.workunit.client.1.smithi129.stdout:4/674: dread d0/d19/d46/d3e/d21/d4d/d70/f25 [0,4194304] 0 2024-03-18T14:43:25.377 INFO:tasks.workunit.client.0.smithi087.stdout:3/891: fdatasync d0/de/d30/fe1 0 2024-03-18T14:43:25.377 INFO:tasks.workunit.client.0.smithi087.stdout:4/858: truncate d2/db/fe1 123937 0 2024-03-18T14:43:25.378 INFO:tasks.workunit.client.0.smithi087.stdout:7/958: dwrite d1/d6/d29/d2f/d68/d65/d60/f84 [0,4194304] 0 2024-03-18T14:43:25.378 INFO:tasks.workunit.client.0.smithi087.stdout:9/983: fdatasync db/f10 0 2024-03-18T14:43:25.379 INFO:tasks.workunit.client.0.smithi087.stdout:2/903: creat d2/ddd/d5a/ded/f12a x:0 0 0 2024-03-18T14:43:25.379 INFO:tasks.workunit.client.0.smithi087.stdout:5/923: dread d13/d1b/d27/d35/f9c [0,4194304] 0 2024-03-18T14:43:25.381 INFO:tasks.workunit.client.0.smithi087.stdout:4/859: read d2/db/d24/d30/f100 [3280542,13588] 0 2024-03-18T14:43:25.381 INFO:tasks.workunit.client.1.smithi129.stdout:5/692: mkdir d0/dc/d18/d2b/d71/dce 0 2024-03-18T14:43:25.382 INFO:tasks.workunit.client.0.smithi087.stdout:3/892: creat d0/d3/d95/f10b x:0 0 0 2024-03-18T14:43:25.383 INFO:tasks.workunit.client.0.smithi087.stdout:8/867: creat d1/d6/d2f/d44/d45/d71/daa/dad/f123 x:0 0 0 2024-03-18T14:43:25.384 INFO:tasks.workunit.client.1.smithi129.stdout:7/741: dread d4/d2d/d2e/d79/dc6/d8/d3b/f6f [0,4194304] 0 2024-03-18T14:43:25.384 INFO:tasks.workunit.client.0.smithi087.stdout:2/904: mknod d2/ddd/c12b 0 2024-03-18T14:43:25.386 INFO:tasks.workunit.client.0.smithi087.stdout:9/984: rmdir db/d18/d3a/d113 39 2024-03-18T14:43:25.386 INFO:tasks.workunit.client.0.smithi087.stdout:8/868: dwrite d1/d6/d9/f60 [4194304,4194304] 0 2024-03-18T14:43:25.388 INFO:tasks.workunit.client.0.smithi087.stdout:5/924: mknod d13/d1b/d27/d8f/c139 0 2024-03-18T14:43:25.389 INFO:tasks.workunit.client.0.smithi087.stdout:5/925: write f12 [2591612,67523] 0 2024-03-18T14:43:25.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/883: dread d0/f16 [0,4194304] 0 2024-03-18T14:43:25.390 INFO:tasks.workunit.client.0.smithi087.stdout:0/884: write d0/f50 [3028196,104998] 0 2024-03-18T14:43:25.391 INFO:tasks.workunit.client.1.smithi129.stdout:2/758: fsync d7/d1f/d20/d2b/d41/d65/fad 0 2024-03-18T14:43:25.391 INFO:tasks.workunit.client.1.smithi129.stdout:6/733: creat d3/d30/df/d28/d79/daf/db7/dc3/fed x:0 0 0 2024-03-18T14:43:25.392 INFO:tasks.workunit.client.1.smithi129.stdout:8/757: rmdir d9/d11/d55/d68/d72/d90 39 2024-03-18T14:43:25.392 INFO:tasks.workunit.client.1.smithi129.stdout:2/759: readlink d7/d1f/d20/d36/da9/dc1/ld7 0 2024-03-18T14:43:25.393 INFO:tasks.workunit.client.1.smithi129.stdout:4/675: mknod d0/d19/d46/d2e/cd6 0 2024-03-18T14:43:25.394 INFO:tasks.workunit.client.0.smithi087.stdout:4/860: unlink d2/d13/l97 0 2024-03-18T14:43:25.399 INFO:tasks.workunit.client.0.smithi087.stdout:5/926: truncate d13/d1b/d27/f2a 660752 0 2024-03-18T14:43:25.402 INFO:tasks.workunit.client.1.smithi129.stdout:9/718: truncate d0/db/d90/fea 420250 0 2024-03-18T14:43:25.404 INFO:tasks.workunit.client.1.smithi129.stdout:1/707: dread d1/d2/d28/d65/f21 [4194304,4194304] 0 2024-03-18T14:43:25.404 INFO:tasks.workunit.client.1.smithi129.stdout:1/708: dread - d1/d2/d28/d65/d7c/fdd zero size 2024-03-18T14:43:25.408 INFO:tasks.workunit.client.1.smithi129.stdout:8/758: rmdir d9/d11/d1a/d32/d41/d4d/d96/dcc 39 2024-03-18T14:43:25.408 INFO:tasks.workunit.client.1.smithi129.stdout:0/749: write d0/d14/f4d [718334,97316] 0 2024-03-18T14:43:25.408 INFO:tasks.workunit.client.1.smithi129.stdout:8/759: readlink d9/d11/d53/d5f/l82 0 2024-03-18T14:43:25.411 INFO:tasks.workunit.client.1.smithi129.stdout:4/676: truncate d0/d19/f84 868409 0 2024-03-18T14:43:25.412 INFO:tasks.workunit.client.0.smithi087.stdout:3/893: symlink d0/d3/d4f/d6e/l10c 0 2024-03-18T14:43:25.412 INFO:tasks.workunit.client.0.smithi087.stdout:4/861: mknod d2/db/d24/d30/d49/c11b 0 2024-03-18T14:43:25.413 INFO:tasks.workunit.client.1.smithi129.stdout:3/691: truncate d4/d11/d34/d3c/d95/f96 1016519 0 2024-03-18T14:43:25.413 INFO:tasks.workunit.client.0.smithi087.stdout:4/862: stat d2/db/d3c/f50 0 2024-03-18T14:43:25.416 INFO:tasks.workunit.client.0.smithi087.stdout:1/948: dwrite d3/d1d/d1e/d43/fa5 [4194304,4194304] 0 2024-03-18T14:43:25.416 INFO:tasks.workunit.client.0.smithi087.stdout:4/863: write d2/db/d24/d30/d7b/dbe/dcf/ff4 [109862,70259] 0 2024-03-18T14:43:25.416 INFO:tasks.workunit.client.0.smithi087.stdout:7/959: link d1/d6/da/d42/d61/d74/f8d d1/d6/d16/da6/dee/f145 0 2024-03-18T14:43:25.418 INFO:tasks.workunit.client.1.smithi129.stdout:9/719: creat d0/da1/dc1/feb x:0 0 0 2024-03-18T14:43:25.418 INFO:tasks.workunit.client.1.smithi129.stdout:9/720: fdatasync d0/db/f1d 0 2024-03-18T14:43:25.419 INFO:tasks.workunit.client.0.smithi087.stdout:4/864: write d2/db/d7a/f106 [563161,76254] 0 2024-03-18T14:43:25.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/894: mkdir d0/d3/df/d42/d10d 0 2024-03-18T14:43:25.419 INFO:tasks.workunit.client.0.smithi087.stdout:9/985: dwrite db/d18/d3a/fe1 [0,4194304] 0 2024-03-18T14:43:25.421 INFO:tasks.workunit.client.1.smithi129.stdout:5/693: dread d0/dc/d18/f1d [0,4194304] 0 2024-03-18T14:43:25.421 INFO:tasks.workunit.client.0.smithi087.stdout:3/895: readlink d0/d3/df/d9a/lbb 0 2024-03-18T14:43:25.422 INFO:tasks.workunit.client.0.smithi087.stdout:1/949: fdatasync d3/d3c/fce 0 2024-03-18T14:43:25.424 INFO:tasks.workunit.client.0.smithi087.stdout:7/960: dread d1/d97/f107 [0,4194304] 0 2024-03-18T14:43:25.424 INFO:tasks.workunit.client.0.smithi087.stdout:9/986: dread - db/d18/ff6 zero size 2024-03-18T14:43:25.425 INFO:tasks.workunit.client.1.smithi129.stdout:4/677: creat d0/d19/d46/d3e/d21/d4d/fd7 x:0 0 0 2024-03-18T14:43:25.426 INFO:tasks.workunit.client.0.smithi087.stdout:7/961: chown d1/d6/da/d42/d61/d74/c85 180 1 2024-03-18T14:43:25.426 INFO:tasks.workunit.client.1.smithi129.stdout:4/678: readlink d0/d19/d46/l74 0 2024-03-18T14:43:25.426 INFO:tasks.workunit.client.1.smithi129.stdout:0/750: dread d0/fd [0,4194304] 0 2024-03-18T14:43:25.427 INFO:tasks.workunit.client.0.smithi087.stdout:3/896: mknod d0/d3/d10/da5/c10e 0 2024-03-18T14:43:25.427 INFO:tasks.workunit.client.0.smithi087.stdout:4/865: dwrite d2/db/d24/d30/d8a/ff8 [0,4194304] 0 2024-03-18T14:43:25.427 INFO:tasks.workunit.client.1.smithi129.stdout:4/679: write d0/d19/d46/d3e/f29 [3549428,2010] 0 2024-03-18T14:43:25.427 INFO:tasks.workunit.client.1.smithi129.stdout:0/751: chown d0/d14/d28/f86 9 1 2024-03-18T14:43:25.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/752: write d0/d14/f4d [1996571,58425] 0 2024-03-18T14:43:25.428 INFO:tasks.workunit.client.0.smithi087.stdout:4/866: fdatasync d2/db/d24/d30/d7b/d7f/f10c 0 2024-03-18T14:43:25.430 INFO:tasks.workunit.client.0.smithi087.stdout:6/830: sync 2024-03-18T14:43:25.432 INFO:tasks.workunit.client.1.smithi129.stdout:7/742: sync 2024-03-18T14:43:25.432 INFO:tasks.workunit.client.0.smithi087.stdout:3/897: creat d0/d72/d85/f10f x:0 0 0 2024-03-18T14:43:25.433 INFO:tasks.workunit.client.0.smithi087.stdout:1/950: dwrite d3/d1d/f21 [0,4194304] 0 2024-03-18T14:43:25.434 INFO:tasks.workunit.client.0.smithi087.stdout:3/898: fsync d0/de/d30/d46/dc3/fee 0 2024-03-18T14:43:25.435 INFO:tasks.workunit.client.0.smithi087.stdout:1/951: chown d3/d1d/f22 27568138 1 2024-03-18T14:43:25.435 INFO:tasks.workunit.client.0.smithi087.stdout:6/831: dread d3/d7/f43 [0,4194304] 0 2024-03-18T14:43:25.438 INFO:tasks.workunit.client.0.smithi087.stdout:4/867: symlink d2/db/d24/d30/d8a/d95/l11c 0 2024-03-18T14:43:25.439 INFO:tasks.workunit.client.0.smithi087.stdout:4/868: chown d2/db/d24/d30/d7b/dbe/dcf/def/d104 423 1 2024-03-18T14:43:25.441 INFO:tasks.workunit.client.1.smithi129.stdout:6/734: link d3/d30/de/d49/l67 d3/d6/d7f/lee 0 2024-03-18T14:43:25.442 INFO:tasks.workunit.client.0.smithi087.stdout:5/927: truncate d13/d1b/d27/d35/f9c 855383 0 2024-03-18T14:43:25.444 INFO:tasks.workunit.client.0.smithi087.stdout:1/952: chown d3/d1d/d45/c5e 218 1 2024-03-18T14:43:25.445 INFO:tasks.workunit.client.1.smithi129.stdout:2/760: creat d7/d1c/fef x:0 0 0 2024-03-18T14:43:25.445 INFO:tasks.workunit.client.1.smithi129.stdout:1/709: truncate d1/d2/d28/d65/d19/d84/fc7 381177 0 2024-03-18T14:43:25.446 INFO:tasks.workunit.client.0.smithi087.stdout:3/899: symlink d0/de/d30/d60/l110 0 2024-03-18T14:43:25.449 INFO:tasks.workunit.client.0.smithi087.stdout:2/905: truncate d2/ddd/d22/d2c/d3a/d40/d98/dd8/f127 850462 0 2024-03-18T14:43:25.449 INFO:tasks.workunit.client.1.smithi129.stdout:3/692: symlink d4/d11/d34/dc0/le7 0 2024-03-18T14:43:25.449 INFO:tasks.workunit.client.1.smithi129.stdout:3/693: chown d4/dd 458585 1 2024-03-18T14:43:25.450 INFO:tasks.workunit.client.0.smithi087.stdout:6/832: mkdir d3/d7/d25/d62/d7c/d46/d121 0 2024-03-18T14:43:25.451 INFO:tasks.workunit.client.0.smithi087.stdout:6/833: chown d3/d7/d25/d62/d7c/d29/d22/d23/da9/cac 2859307 1 2024-03-18T14:43:25.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/928: symlink d13/d1b/d7e/dfc/l13a 0 2024-03-18T14:43:25.453 INFO:tasks.workunit.client.0.smithi087.stdout:1/953: fdatasync d3/d1d/d1e/d43/d9b/fb7 0 2024-03-18T14:43:25.454 INFO:tasks.workunit.client.1.smithi129.stdout:8/760: creat d9/d11/d1a/d14/db7/ffa x:0 0 0 2024-03-18T14:43:25.455 INFO:tasks.workunit.client.0.smithi087.stdout:4/869: dread d2/db/fe1 [0,4194304] 0 2024-03-18T14:43:25.456 INFO:tasks.workunit.client.1.smithi129.stdout:0/753: symlink d0/d23/d35/d50/da5/le7 0 2024-03-18T14:43:25.457 INFO:tasks.workunit.client.0.smithi087.stdout:9/987: rename db/d18/d1e/d28/dc2/deb/lee to db/d18/d1e/l14d 0 2024-03-18T14:43:25.457 INFO:tasks.workunit.client.0.smithi087.stdout:0/885: sync 2024-03-18T14:43:25.457 INFO:tasks.workunit.client.0.smithi087.stdout:8/869: sync 2024-03-18T14:43:25.457 INFO:tasks.workunit.client.1.smithi129.stdout:9/721: fdatasync d0/db/d11/d97/dd1/d26/d19/d29/f2d 0 2024-03-18T14:43:25.458 INFO:tasks.workunit.client.1.smithi129.stdout:9/722: chown d0/db/d11/d97/dd1/d26/d19/d29/f44 2123339 1 2024-03-18T14:43:25.459 INFO:tasks.workunit.client.0.smithi087.stdout:2/906: mknod d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/c12c 0 2024-03-18T14:43:25.459 INFO:tasks.workunit.client.1.smithi129.stdout:5/694: rmdir d0/dc/d18/d2b/d71/dce 0 2024-03-18T14:43:25.461 INFO:tasks.workunit.client.0.smithi087.stdout:4/870: dwrite d2/db/d24/d30/d8a/d95/fbb [0,4194304] 0 2024-03-18T14:43:25.463 INFO:tasks.workunit.client.0.smithi087.stdout:9/988: dwrite db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:25.466 INFO:tasks.workunit.client.1.smithi129.stdout:8/761: mkdir d9/d33/dc2/dfb 0 2024-03-18T14:43:25.466 INFO:tasks.workunit.client.1.smithi129.stdout:4/680: sync 2024-03-18T14:43:25.470 INFO:tasks.workunit.client.1.smithi129.stdout:1/710: dwrite d1/d2/d28/d65/d19/dc9/d56/f82 [0,4194304] 0 2024-03-18T14:43:25.471 INFO:tasks.workunit.client.1.smithi129.stdout:1/711: write d1/d35/f45 [4430410,1895] 0 2024-03-18T14:43:25.473 INFO:tasks.workunit.client.1.smithi129.stdout:5/695: chown d0/f2 104473097 1 2024-03-18T14:43:25.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/681: mkdir d0/d19/d46/d3e/d21/d4d/d58/dd8 0 2024-03-18T14:43:25.476 INFO:tasks.workunit.client.0.smithi087.stdout:5/929: symlink d13/d1b/d27/d28/l13b 0 2024-03-18T14:43:25.477 INFO:tasks.workunit.client.1.smithi129.stdout:3/694: dread d4/dd/d1f/d5f/d31/f49 [0,4194304] 0 2024-03-18T14:43:25.477 INFO:tasks.workunit.client.0.smithi087.stdout:7/962: getdents d1/d6/d29/d2f/d6b 0 2024-03-18T14:43:25.478 INFO:tasks.workunit.client.1.smithi129.stdout:6/735: write d3/fdc [280129,94297] 0 2024-03-18T14:43:25.478 INFO:tasks.workunit.client.1.smithi129.stdout:7/743: getdents d4/d8c/d9e 0 2024-03-18T14:43:25.478 INFO:tasks.workunit.client.1.smithi129.stdout:9/723: dread d0/f1b [0,4194304] 0 2024-03-18T14:43:25.479 INFO:tasks.workunit.client.1.smithi129.stdout:7/744: write d4/d2d/d2e/fe1 [731797,29306] 0 2024-03-18T14:43:25.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/834: dwrite d3/d7/d25/d62/d7c/d46/f6d [0,4194304] 0 2024-03-18T14:43:25.480 INFO:tasks.workunit.client.0.smithi087.stdout:8/870: rmdir d1/d6/d2f/d44/d45/d71/daa 39 2024-03-18T14:43:25.481 INFO:tasks.workunit.client.1.smithi129.stdout:7/745: chown d4/d2d/d2e/d42/d58/f60 115491 1 2024-03-18T14:43:25.483 INFO:tasks.workunit.client.1.smithi129.stdout:4/682: fsync d0/d19/d46/d2e/f82 0 2024-03-18T14:43:25.483 INFO:tasks.workunit.client.1.smithi129.stdout:3/695: mkdir d4/d11/d1d/d50/d90/dac/de8 0 2024-03-18T14:43:25.484 INFO:tasks.workunit.client.1.smithi129.stdout:3/696: dread - d4/d38/da3/db1/fd5 zero size 2024-03-18T14:43:25.485 INFO:tasks.workunit.client.1.smithi129.stdout:6/736: rename d3/d6/d7f/fd3 to d3/d6/d7f/d8f/fef 0 2024-03-18T14:43:25.486 INFO:tasks.workunit.client.1.smithi129.stdout:3/697: dread d4/d11/d1d/d36/f7d [0,4194304] 0 2024-03-18T14:43:25.487 INFO:tasks.workunit.client.0.smithi087.stdout:3/900: rmdir d0/d3/df/d42/d10d 0 2024-03-18T14:43:25.488 INFO:tasks.workunit.client.0.smithi087.stdout:1/954: truncate d3/d1d/d1e/d43/d9b/ff1 1168392 0 2024-03-18T14:43:25.488 INFO:tasks.workunit.client.1.smithi129.stdout:5/696: unlink d0/l7 0 2024-03-18T14:43:25.490 INFO:tasks.workunit.client.1.smithi129.stdout:6/737: dwrite d3/d5/d46/fe1 [0,4194304] 0 2024-03-18T14:43:25.490 INFO:tasks.workunit.client.0.smithi087.stdout:5/930: rename d13/d1b/d27/d35/d3b/fc4 to d13/d1b/d27/d8f/d11c/f13c 0 2024-03-18T14:43:25.492 INFO:tasks.workunit.client.0.smithi087.stdout:8/871: creat d1/d6/d8d/dc2/f124 x:0 0 0 2024-03-18T14:43:25.492 INFO:tasks.workunit.client.0.smithi087.stdout:9/989: fsync db/d18/fc6 0 2024-03-18T14:43:25.492 INFO:tasks.workunit.client.1.smithi129.stdout:4/683: creat d0/d19/d46/d3e/d33/fd9 x:0 0 0 2024-03-18T14:43:25.493 INFO:tasks.workunit.client.0.smithi087.stdout:4/871: truncate d2/db/fd8 1350749 0 2024-03-18T14:43:25.497 INFO:tasks.workunit.client.1.smithi129.stdout:2/761: truncate d7/f58 3474784 0 2024-03-18T14:43:25.498 INFO:tasks.workunit.client.1.smithi129.stdout:9/724: dread d0/db/d11/d97/dd1/d26/d19/d8d/f95 [0,4194304] 0 2024-03-18T14:43:25.498 INFO:tasks.workunit.client.0.smithi087.stdout:8/872: dwrite d1/d6/d9/fdd [0,4194304] 0 2024-03-18T14:43:25.498 INFO:tasks.workunit.client.0.smithi087.stdout:7/963: dread d1/f2e [0,4194304] 0 2024-03-18T14:43:25.499 INFO:tasks.workunit.client.0.smithi087.stdout:9/990: dwrite db/d18/f142 [0,4194304] 0 2024-03-18T14:43:25.500 INFO:tasks.workunit.client.0.smithi087.stdout:7/964: dread - d1/d6/da/d42/d61/f12c zero size 2024-03-18T14:43:25.500 INFO:tasks.workunit.client.1.smithi129.stdout:0/754: truncate d0/d14/d53/dc9/fdd 3302812 0 2024-03-18T14:43:25.501 INFO:tasks.workunit.client.1.smithi129.stdout:1/712: write d1/d35/d7a/fcf [1138184,20959] 0 2024-03-18T14:43:25.501 INFO:tasks.workunit.client.0.smithi087.stdout:3/901: rename d0/d1c/l3b to d0/d3/d4f/l111 0 2024-03-18T14:43:25.502 INFO:tasks.workunit.client.1.smithi129.stdout:0/755: write d0/d14/d91/fe6 [181819,119431] 0 2024-03-18T14:43:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:4/684: mknod d0/d9/d40/d5f/cda 0 2024-03-18T14:43:25.504 INFO:tasks.workunit.client.1.smithi129.stdout:9/725: dread d0/db/d11/d97/dd1/d26/d19/f9b [0,4194304] 0 2024-03-18T14:43:25.505 INFO:tasks.workunit.client.0.smithi087.stdout:5/931: creat d13/d1b/d30/d6e/dc8/f13d x:0 0 0 2024-03-18T14:43:25.505 INFO:tasks.workunit.client.1.smithi129.stdout:4/685: stat d0/d9/d4c/dca 0 2024-03-18T14:43:25.506 INFO:tasks.workunit.client.0.smithi087.stdout:5/932: write d13/d1b/d30/d6e/d88/fca [4571889,12416] 0 2024-03-18T14:43:25.506 INFO:tasks.workunit.client.1.smithi129.stdout:4/686: read - d0/d19/fc7 zero size 2024-03-18T14:43:25.507 INFO:tasks.workunit.client.0.smithi087.stdout:5/933: chown d13/d1b/d27/d28/d9a/dae/l104 28689 1 2024-03-18T14:43:25.507 INFO:tasks.workunit.client.1.smithi129.stdout:0/756: dwrite d0/d23/d29/f38 [0,4194304] 0 2024-03-18T14:43:25.508 INFO:tasks.workunit.client.1.smithi129.stdout:4/687: chown d0/f13 16245746 1 2024-03-18T14:43:25.508 INFO:tasks.workunit.client.1.smithi129.stdout:7/746: link d4/d2d/d2e/d79/dc6/d38/d61/d68/c98 d4/d2d/d2e/d79/dc6/d8/ce3 0 2024-03-18T14:43:25.509 INFO:tasks.workunit.client.1.smithi129.stdout:0/757: dread - d0/d23/d71/dc2/d4a/d61/fcb zero size 2024-03-18T14:43:25.509 INFO:tasks.workunit.client.1.smithi129.stdout:7/747: dread - d4/fd8 zero size 2024-03-18T14:43:25.510 INFO:tasks.workunit.client.1.smithi129.stdout:0/758: fsync d0/d23/f3f 0 2024-03-18T14:43:25.511 INFO:tasks.workunit.client.1.smithi129.stdout:3/698: rename d4/dd/d1f/da8/faa to d4/fe9 0 2024-03-18T14:43:25.513 INFO:tasks.workunit.client.1.smithi129.stdout:2/762: mkdir d7/d1f/d20/d2b/d41/d65/df0 0 2024-03-18T14:43:25.514 INFO:tasks.workunit.client.1.smithi129.stdout:2/763: readlink d7/d1f/d20/d2a/d6b/l76 0 2024-03-18T14:43:25.515 INFO:tasks.workunit.client.0.smithi087.stdout:2/907: truncate d2/f43 4126468 0 2024-03-18T14:43:25.515 INFO:tasks.workunit.client.0.smithi087.stdout:0/886: getdents d0/d1a/d80/d88 0 2024-03-18T14:43:25.515 INFO:tasks.workunit.client.0.smithi087.stdout:0/887: chown d0/d2/c123 166 1 2024-03-18T14:43:25.516 INFO:tasks.workunit.client.1.smithi129.stdout:4/688: creat d0/d19/d46/d3e/d21/d32/fdb x:0 0 0 2024-03-18T14:43:25.517 INFO:tasks.workunit.client.0.smithi087.stdout:8/873: unlink d1/d6/d2f/d44/d45/d72/d7f/fc1 0 2024-03-18T14:43:25.518 INFO:tasks.workunit.client.1.smithi129.stdout:7/748: mknod d4/d2d/d2e/d79/dc6/d54/ce4 0 2024-03-18T14:43:25.519 INFO:tasks.workunit.client.1.smithi129.stdout:7/749: write d4/d2d/d2e/d79/dc6/d38/d61/d6a/f92 [1267046,55841] 0 2024-03-18T14:43:25.520 INFO:tasks.workunit.client.1.smithi129.stdout:3/699: mkdir d4/d11/d1d/d50/d90/dea 0 2024-03-18T14:43:25.520 INFO:tasks.workunit.client.0.smithi087.stdout:5/934: mkdir d13/d1b/d27/d35/dc6/dd6/d13e 0 2024-03-18T14:43:25.521 INFO:tasks.workunit.client.1.smithi129.stdout:1/713: truncate d1/d91/fd9 1010503 0 2024-03-18T14:43:25.521 INFO:tasks.workunit.client.1.smithi129.stdout:3/700: write d4/d11/d34/d3c/f81 [5960642,35333] 0 2024-03-18T14:43:25.523 INFO:tasks.workunit.client.0.smithi087.stdout:6/835: truncate d3/d7/d25/d62/d7c/d29/d22/d75/d92/f113 1020003 0 2024-03-18T14:43:25.523 INFO:tasks.workunit.client.1.smithi129.stdout:9/726: link d0/db/d90/d3e/f81 d0/db/d11/d97/dd1/d25/dad/fec 0 2024-03-18T14:43:25.523 INFO:tasks.workunit.client.1.smithi129.stdout:9/727: chown d0/db/d11/d97 9353 1 2024-03-18T14:43:25.523 INFO:tasks.workunit.client.1.smithi129.stdout:8/762: truncate d9/d11/d55/d68/f76 337888 0 2024-03-18T14:43:25.524 INFO:tasks.workunit.client.1.smithi129.stdout:8/763: chown d9/d11/d18/c48 1801 1 2024-03-18T14:43:25.525 INFO:tasks.workunit.client.0.smithi087.stdout:1/955: truncate d3/d1d/d1e/d43/d50/d71/d11a/f120 649200 0 2024-03-18T14:43:25.527 INFO:tasks.workunit.client.0.smithi087.stdout:7/965: dread d1/d6/d29/d2f/d68/fab [0,4194304] 0 2024-03-18T14:43:25.527 INFO:tasks.workunit.client.1.smithi129.stdout:2/764: chown d7/f6e 485957 1 2024-03-18T14:43:25.529 INFO:tasks.workunit.client.1.smithi129.stdout:2/765: dread - d7/d1f/fbf zero size 2024-03-18T14:43:25.529 INFO:tasks.workunit.client.0.smithi087.stdout:0/888: rmdir d0/d2/d4/de8/dad/dea/d5d/d78 39 2024-03-18T14:43:25.530 INFO:tasks.workunit.client.1.smithi129.stdout:5/697: dwrite d0/d32/d34/f53 [0,4194304] 0 2024-03-18T14:43:25.532 INFO:tasks.workunit.client.1.smithi129.stdout:4/689: write d0/d19/d46/d3e/d21/d4d/d70/f25 [3775478,14437] 0 2024-03-18T14:43:25.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/902: write d0/de/d30/f9f [931158,25579] 0 2024-03-18T14:43:25.535 INFO:tasks.workunit.client.0.smithi087.stdout:3/903: readlink d0/de/d30/d8e/lc9 0 2024-03-18T14:43:25.543 INFO:tasks.workunit.client.0.smithi087.stdout:5/935: creat d13/d1b/d70/da8/f13f x:0 0 0 2024-03-18T14:43:25.543 INFO:tasks.workunit.client.1.smithi129.stdout:1/714: creat d1/d35/d7a/fde x:0 0 0 2024-03-18T14:43:25.544 INFO:tasks.workunit.client.0.smithi087.stdout:4/872: link d2/db/d24/d30/d7b/d7f/da5/db4/db7/ld7 d2/db/d3c/d90/l11d 0 2024-03-18T14:43:25.546 INFO:tasks.workunit.client.0.smithi087.stdout:7/966: symlink d1/d97/l146 0 2024-03-18T14:43:25.547 INFO:tasks.workunit.client.0.smithi087.stdout:0/889: mknod d0/d1a/d7b/c12c 0 2024-03-18T14:43:25.548 INFO:tasks.workunit.client.0.smithi087.stdout:3/904: creat d0/d1c/d25/f112 x:0 0 0 2024-03-18T14:43:25.548 INFO:tasks.workunit.client.0.smithi087.stdout:6/836: dwrite d3/d7/d25/d62/d7c/d29/d22/f32 [4194304,4194304] 0 2024-03-18T14:43:25.548 INFO:tasks.workunit.client.1.smithi129.stdout:9/728: write d0/db/d90/d3e/f81 [126661,59971] 0 2024-03-18T14:43:25.549 INFO:tasks.workunit.client.0.smithi087.stdout:2/908: creat d2/ddd/d22/f12d x:0 0 0 2024-03-18T14:43:25.551 INFO:tasks.workunit.client.0.smithi087.stdout:4/873: symlink d2/db/d24/d30/d7b/dbe/ddc/de3/l11e 0 2024-03-18T14:43:25.552 INFO:tasks.workunit.client.0.smithi087.stdout:7/967: dwrite d1/d6/d29/d2f/fca [0,4194304] 0 2024-03-18T14:43:25.552 INFO:tasks.workunit.client.1.smithi129.stdout:2/766: dwrite d7/d1f/d81/dd4/fe7 [0,4194304] 0 2024-03-18T14:43:25.552 INFO:tasks.workunit.client.1.smithi129.stdout:6/738: rename d3/f1a to d3/d30/ff0 0 2024-03-18T14:43:25.553 INFO:tasks.workunit.client.1.smithi129.stdout:7/750: truncate d4/d2d/d2e/d45/fd0 967847 0 2024-03-18T14:43:25.553 INFO:tasks.workunit.client.1.smithi129.stdout:6/739: readlink d3/d30/df/d28/l2c 0 2024-03-18T14:43:25.553 INFO:tasks.workunit.client.0.smithi087.stdout:7/968: write d1/d6/da/d42/d67/f87 [2464064,105934] 0 2024-03-18T14:43:25.554 INFO:tasks.workunit.client.1.smithi129.stdout:1/715: creat d1/d2/d28/d65/d19/d96/fdf x:0 0 0 2024-03-18T14:43:25.554 INFO:tasks.workunit.client.1.smithi129.stdout:2/767: write d7/d1f/d20/d36/da9/dc1/fc5 [312434,99943] 0 2024-03-18T14:43:25.557 INFO:tasks.workunit.client.1.smithi129.stdout:9/729: rmdir d0/db/d11/d97/dd1/d25/dad 39 2024-03-18T14:43:25.558 INFO:tasks.workunit.client.0.smithi087.stdout:0/890: rmdir d0/d1a/de6 39 2024-03-18T14:43:25.559 INFO:tasks.workunit.client.1.smithi129.stdout:0/759: getdents d0/d23/d35/d3b 0 2024-03-18T14:43:25.560 INFO:tasks.workunit.client.0.smithi087.stdout:4/874: mknod d2/db/d24/d30/d7b/dbe/dc6/c11f 0 2024-03-18T14:43:25.562 INFO:tasks.workunit.client.0.smithi087.stdout:0/891: dwrite d0/d2/d4/d27/fd3 [0,4194304] 0 2024-03-18T14:43:25.563 INFO:tasks.workunit.client.0.smithi087.stdout:5/936: creat d13/d1b/d27/d35/f140 x:0 0 0 2024-03-18T14:43:25.565 INFO:tasks.workunit.client.0.smithi087.stdout:3/905: truncate d0/de/d30/f7c 283629 0 2024-03-18T14:43:25.566 INFO:tasks.workunit.client.0.smithi087.stdout:3/906: chown d0/d3/fda 1834 1 2024-03-18T14:43:25.567 INFO:tasks.workunit.client.0.smithi087.stdout:4/875: symlink d2/l120 0 2024-03-18T14:43:25.568 INFO:tasks.workunit.client.0.smithi087.stdout:5/937: truncate d13/d1b/d27/f34 2964318 0 2024-03-18T14:43:25.569 INFO:tasks.workunit.client.1.smithi129.stdout:3/701: rename d4/d38/da3/db1/fbf to d4/d38/da3/dc9/feb 0 2024-03-18T14:43:25.569 INFO:tasks.workunit.client.1.smithi129.stdout:2/768: mknod d7/d3f/d5f/cf1 0 2024-03-18T14:43:25.572 INFO:tasks.workunit.client.1.smithi129.stdout:1/716: creat d1/d35/db8/dc6/fe0 x:0 0 0 2024-03-18T14:43:25.574 INFO:tasks.workunit.client.1.smithi129.stdout:6/740: dwrite d3/d30/f66 [0,4194304] 0 2024-03-18T14:43:25.577 INFO:tasks.workunit.client.1.smithi129.stdout:5/698: rename d0/d32/d34/fba to d0/dc/d1a/fcf 0 2024-03-18T14:43:25.578 INFO:tasks.workunit.client.0.smithi087.stdout:4/876: link d2/f16 d2/dc2/dce/f121 0 2024-03-18T14:43:25.578 INFO:tasks.workunit.client.1.smithi129.stdout:5/699: dread - d0/d32/d3a/f62 zero size 2024-03-18T14:43:25.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/892: getdents d0/d2/d4/d27/dc3/dd2 0 2024-03-18T14:43:25.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/751: creat d4/fe5 x:0 0 0 2024-03-18T14:43:25.583 INFO:tasks.workunit.client.1.smithi129.stdout:3/702: symlink d4/d11/d34/dc0/lec 0 2024-03-18T14:43:25.584 INFO:tasks.workunit.client.1.smithi129.stdout:4/690: truncate d0/d19/d46/d3e/d21/d4d/d58/d61/f98 166404 0 2024-03-18T14:43:25.584 INFO:tasks.workunit.client.0.smithi087.stdout:5/938: rename d13/d1b/d27/d28/d9a/dae/l125 to d13/d1b/d70/l141 0 2024-03-18T14:43:25.584 INFO:tasks.workunit.client.0.smithi087.stdout:0/893: read - d0/d1a/d7b/d26/ff5 zero size 2024-03-18T14:43:25.585 INFO:tasks.workunit.client.1.smithi129.stdout:8/764: dwrite d9/d11/d1a/d14/d60/fd5 [0,4194304] 0 2024-03-18T14:43:25.586 INFO:tasks.workunit.client.1.smithi129.stdout:2/769: creat d7/d1f/d20/d36/da9/dc1/da5/dc4/ff2 x:0 0 0 2024-03-18T14:43:25.588 INFO:tasks.workunit.client.0.smithi087.stdout:3/907: link d0/de/d30/d67/lb3 d0/de/d30/d46/l113 0 2024-03-18T14:43:25.588 INFO:tasks.workunit.client.1.smithi129.stdout:2/770: write d7/d1f/d20/d2b/d41/f6f [1437557,44303] 0 2024-03-18T14:43:25.589 INFO:tasks.workunit.client.1.smithi129.stdout:9/730: truncate d0/db/d11/d97/dd1/fbc 3742745 0 2024-03-18T14:43:25.590 INFO:tasks.workunit.client.1.smithi129.stdout:1/717: mkdir d1/d2/d28/d65/d19/dc9/d87/dc0/de1 0 2024-03-18T14:43:25.590 INFO:tasks.workunit.client.1.smithi129.stdout:3/703: dwrite d4/dd/d1f/da8/fc6 [0,4194304] 0 2024-03-18T14:43:25.592 INFO:tasks.workunit.client.1.smithi129.stdout:6/741: unlink d3/d30/de/d65/d80/fe0 0 2024-03-18T14:43:25.592 INFO:tasks.workunit.client.1.smithi129.stdout:2/771: write d7/d1f/d20/d36/da9/dc1/f18 [831900,10325] 0 2024-03-18T14:43:25.593 INFO:tasks.workunit.client.0.smithi087.stdout:7/969: dwrite d1/d6/d29/d2f/d68/faa [0,4194304] 0 2024-03-18T14:43:25.593 INFO:tasks.workunit.client.1.smithi129.stdout:0/760: dwrite d0/f95 [0,4194304] 0 2024-03-18T14:43:25.594 INFO:tasks.workunit.client.0.smithi087.stdout:6/837: dwrite d3/f108 [0,4194304] 0 2024-03-18T14:43:25.594 INFO:tasks.workunit.client.1.smithi129.stdout:2/772: stat d7/d1f/d20/d2d/dab/caf 0 2024-03-18T14:43:25.595 INFO:tasks.workunit.client.0.smithi087.stdout:5/939: chown d13/l55 54114681 1 2024-03-18T14:43:25.596 INFO:tasks.workunit.client.0.smithi087.stdout:5/940: fsync d13/d1b/d70/da8/fb2 0 2024-03-18T14:43:25.596 INFO:tasks.workunit.client.1.smithi129.stdout:1/718: dread d1/d2/f1f [0,4194304] 0 2024-03-18T14:43:25.599 INFO:tasks.workunit.client.0.smithi087.stdout:0/894: mknod d0/dab/d113/c12d 0 2024-03-18T14:43:25.602 INFO:tasks.workunit.client.1.smithi129.stdout:0/761: rename d0/d23/c31 to d0/d14/dca/ce8 0 2024-03-18T14:43:25.603 INFO:tasks.workunit.client.1.smithi129.stdout:2/773: stat d7/d1f/f57 0 2024-03-18T14:43:25.604 INFO:tasks.workunit.client.0.smithi087.stdout:3/908: creat d0/d3/d4f/d6e/dc8/f114 x:0 0 0 2024-03-18T14:43:25.605 INFO:tasks.workunit.client.1.smithi129.stdout:4/691: creat d0/d9/d4c/dca/fdc x:0 0 0 2024-03-18T14:43:25.606 INFO:tasks.workunit.client.0.smithi087.stdout:1/956: sync 2024-03-18T14:43:25.606 INFO:tasks.workunit.client.0.smithi087.stdout:9/991: sync 2024-03-18T14:43:25.606 INFO:tasks.workunit.client.0.smithi087.stdout:8/874: sync 2024-03-18T14:43:25.607 INFO:tasks.workunit.client.0.smithi087.stdout:8/875: fdatasync d1/d6/d9/f51 0 2024-03-18T14:43:25.609 INFO:tasks.workunit.client.1.smithi129.stdout:4/692: dwrite d0/d19/d46/d3e/d21/f5c [0,4194304] 0 2024-03-18T14:43:25.610 INFO:tasks.workunit.client.1.smithi129.stdout:8/765: creat d9/d33/dc2/ddc/ffc x:0 0 0 2024-03-18T14:43:25.616 INFO:tasks.workunit.client.0.smithi087.stdout:6/838: unlink d3/dcd/lfd 0 2024-03-18T14:43:25.618 INFO:tasks.workunit.client.1.smithi129.stdout:5/700: write d0/f84 [3069757,55952] 0 2024-03-18T14:43:25.618 INFO:tasks.workunit.client.0.smithi087.stdout:4/877: creat d2/d13/f122 x:0 0 0 2024-03-18T14:43:25.619 INFO:tasks.workunit.client.1.smithi129.stdout:3/704: dread d4/dd/f8f [0,4194304] 0 2024-03-18T14:43:25.619 INFO:tasks.workunit.client.1.smithi129.stdout:6/742: mknod d3/d30/de/cf1 0 2024-03-18T14:43:25.623 INFO:tasks.workunit.client.0.smithi087.stdout:9/992: mkdir db/d18/d1c/d69/d6f/d14e 0 2024-03-18T14:43:25.623 INFO:tasks.workunit.client.1.smithi129.stdout:1/719: rename d1/d2/d28/d65/d7c/d7d to d1/db2/de2 0 2024-03-18T14:43:25.625 INFO:tasks.workunit.client.0.smithi087.stdout:8/876: rmdir d1/d6/d9/d5d/d87/da2/df0 39 2024-03-18T14:43:25.625 INFO:tasks.workunit.client.1.smithi129.stdout:0/762: creat d0/d23/d35/d50/da5/fe9 x:0 0 0 2024-03-18T14:43:25.627 INFO:tasks.workunit.client.1.smithi129.stdout:8/766: fsync d9/f1d 0 2024-03-18T14:43:25.627 INFO:tasks.workunit.client.1.smithi129.stdout:8/767: fsync d9/d11/d1a/d32/d3a/d5d/fa5 0 2024-03-18T14:43:25.628 INFO:tasks.workunit.client.0.smithi087.stdout:4/878: mknod d2/dc2/c123 0 2024-03-18T14:43:25.628 INFO:tasks.workunit.client.1.smithi129.stdout:8/768: chown d9/d11/d1a/d32 2 1 2024-03-18T14:43:25.628 INFO:tasks.workunit.client.1.smithi129.stdout:8/769: write d9/d11/d53/f80 [15148,48402] 0 2024-03-18T14:43:25.629 INFO:tasks.workunit.client.1.smithi129.stdout:7/752: link d4/d2d/d2e/d45/fc4 d4/d2d/d2e/d79/dc6/d38/d61/fe6 0 2024-03-18T14:43:25.639 INFO:tasks.workunit.client.1.smithi129.stdout:5/701: mknod d0/df/cd0 0 2024-03-18T14:43:25.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/909: sync 2024-03-18T14:43:25.640 INFO:tasks.workunit.client.1.smithi129.stdout:2/774: rename d7/c21 to d7/d1f/d20/d36/dc0/cf3 0 2024-03-18T14:43:25.640 INFO:tasks.workunit.client.0.smithi087.stdout:2/910: fdatasync d2/ddd/d22/d2c/f30 0 2024-03-18T14:43:25.641 INFO:tasks.workunit.client.1.smithi129.stdout:0/763: creat d0/d23/d71/dcd/fea x:0 0 0 2024-03-18T14:43:25.643 INFO:tasks.workunit.client.1.smithi129.stdout:9/731: write d0/db/d90/fea [1062824,55155] 0 2024-03-18T14:43:25.647 INFO:tasks.workunit.client.1.smithi129.stdout:3/705: dwrite d4/dd/f3d [0,4194304] 0 2024-03-18T14:43:25.649 INFO:tasks.workunit.client.1.smithi129.stdout:8/770: mknod d9/cfd 0 2024-03-18T14:43:25.649 INFO:tasks.workunit.client.1.smithi129.stdout:8/771: fsync d9/d11/d1a/f92 0 2024-03-18T14:43:25.650 INFO:tasks.workunit.client.1.smithi129.stdout:8/772: dread - d9/d11/d1a/d32/d3a/d70/fd8 zero size 2024-03-18T14:43:25.651 INFO:tasks.workunit.client.1.smithi129.stdout:4/693: rename d0/f80 to d0/d9/fdd 0 2024-03-18T14:43:25.652 INFO:tasks.workunit.client.1.smithi129.stdout:4/694: write d0/d19/d46/d3e/d33/fd9 [724111,121024] 0 2024-03-18T14:43:25.653 INFO:tasks.workunit.client.1.smithi129.stdout:5/702: creat d0/dc/d18/d2b/d71/fd1 x:0 0 0 2024-03-18T14:43:25.654 INFO:tasks.workunit.client.1.smithi129.stdout:7/753: write d4/d2d/d2e/d79/dc6/d38/d49/f7a [1477927,37578] 0 2024-03-18T14:43:25.655 INFO:tasks.workunit.client.1.smithi129.stdout:1/720: dread d1/d2/f64 [0,4194304] 0 2024-03-18T14:43:25.655 INFO:tasks.workunit.client.1.smithi129.stdout:2/775: stat d7/d1f/d20/d36/dc0/cf3 0 2024-03-18T14:43:25.656 INFO:tasks.workunit.client.1.smithi129.stdout:1/721: chown d1/d35/f45 19055575 1 2024-03-18T14:43:25.656 INFO:tasks.workunit.client.1.smithi129.stdout:2/776: dread - d7/d1f/d20/d36/da9/fbc zero size 2024-03-18T14:43:25.657 INFO:tasks.workunit.client.1.smithi129.stdout:3/706: mkdir d4/d38/da3/dc9/da9/ded 0 2024-03-18T14:43:25.660 INFO:tasks.workunit.client.0.smithi087.stdout:3/909: fdatasync d0/de/f12 0 2024-03-18T14:43:25.660 INFO:tasks.workunit.client.1.smithi129.stdout:8/773: rmdir d9/d33/dc2/ddc 39 2024-03-18T14:43:25.663 INFO:tasks.workunit.client.0.smithi087.stdout:9/993: truncate db/d31/f36 9128026 0 2024-03-18T14:43:25.666 INFO:tasks.workunit.client.0.smithi087.stdout:9/994: dread db/d18/d1e/f24 [0,4194304] 0 2024-03-18T14:43:25.668 INFO:tasks.workunit.client.0.smithi087.stdout:4/879: dread d2/db/d82/fc7 [0,4194304] 0 2024-03-18T14:43:25.668 INFO:tasks.workunit.client.0.smithi087.stdout:2/911: mknod d2/ddd/d22/d24/db2/c12e 0 2024-03-18T14:43:25.669 INFO:tasks.workunit.client.0.smithi087.stdout:4/880: fsync d2/db/d24/d30/d7b/d7f/fee 0 2024-03-18T14:43:25.671 INFO:tasks.workunit.client.0.smithi087.stdout:5/941: truncate d13/d1b/d27/d35/f140 173373 0 2024-03-18T14:43:25.672 INFO:tasks.workunit.client.1.smithi129.stdout:3/707: creat d4/d11/d34/d4c/fee x:0 0 0 2024-03-18T14:43:25.674 INFO:tasks.workunit.client.1.smithi129.stdout:5/703: fsync d0/dc/d18/d2b/f47 0 2024-03-18T14:43:25.675 INFO:tasks.workunit.client.0.smithi087.stdout:5/942: dwrite d13/d1b/d27/d8f/dab/fe0 [0,4194304] 0 2024-03-18T14:43:25.675 INFO:tasks.workunit.client.1.smithi129.stdout:9/732: link d0/db/d90/d70/l78 d0/db/d11/d97/d99/led 0 2024-03-18T14:43:25.676 INFO:tasks.workunit.client.1.smithi129.stdout:9/733: stat d0/db/d11/d97/dd1 0 2024-03-18T14:43:25.678 INFO:tasks.workunit.client.1.smithi129.stdout:5/704: dwrite d0/d32/d3a/d52/f90 [0,4194304] 0 2024-03-18T14:43:25.679 INFO:tasks.workunit.client.1.smithi129.stdout:2/777: mknod d7/d1f/d20/d2b/d41/da6/ded/cf4 0 2024-03-18T14:43:25.680 INFO:tasks.workunit.client.1.smithi129.stdout:5/705: dread - d0/d32/d3a/d52/d6e/fc3 zero size 2024-03-18T14:43:25.683 INFO:tasks.workunit.client.1.smithi129.stdout:0/764: link d0/d14/d91/cd6 d0/d23/d35/d3b/ceb 0 2024-03-18T14:43:25.684 INFO:tasks.workunit.client.1.smithi129.stdout:6/743: sync 2024-03-18T14:43:25.684 INFO:tasks.workunit.client.1.smithi129.stdout:6/744: chown d3/d30/de/d65/d93/f97 0 1 2024-03-18T14:43:25.684 INFO:tasks.workunit.client.1.smithi129.stdout:1/722: creat d1/d2/d28/d65/fe3 x:0 0 0 2024-03-18T14:43:25.686 INFO:tasks.workunit.client.1.smithi129.stdout:2/778: symlink d7/d1c/d7b/lf5 0 2024-03-18T14:43:25.686 INFO:tasks.workunit.client.0.smithi087.stdout:8/877: write d1/d6/d2f/d44/d4b/f54 [7130720,13851] 0 2024-03-18T14:43:25.686 INFO:tasks.workunit.client.0.smithi087.stdout:1/957: link d3/c13 d3/d1d/d1e/d43/da3/dd3/c125 0 2024-03-18T14:43:25.689 INFO:tasks.workunit.client.1.smithi129.stdout:4/695: getdents d0 0 2024-03-18T14:43:25.689 INFO:tasks.workunit.client.0.smithi087.stdout:2/912: symlink d2/ddd/d22/d2c/d3a/d68/l12f 0 2024-03-18T14:43:25.690 INFO:tasks.workunit.client.0.smithi087.stdout:4/881: creat d2/db/de/d8b/f124 x:0 0 0 2024-03-18T14:43:25.691 INFO:tasks.workunit.client.0.smithi087.stdout:1/958: dwrite d3/de4/fed [0,4194304] 0 2024-03-18T14:43:25.691 INFO:tasks.workunit.client.1.smithi129.stdout:7/754: link d4/d2d/d2e/d42/f7c d4/d2d/d2e/d79/dc6/d38/d61/d6a/fe7 0 2024-03-18T14:43:25.691 INFO:tasks.workunit.client.1.smithi129.stdout:7/755: stat d4/d2d/d2e/d79/dc6/d38 0 2024-03-18T14:43:25.691 INFO:tasks.workunit.client.0.smithi087.stdout:5/943: readlink l10 0 2024-03-18T14:43:25.692 INFO:tasks.workunit.client.0.smithi087.stdout:4/882: chown d2/db/d24/d30/d7b/dbe/dcf 17606 1 2024-03-18T14:43:25.692 INFO:tasks.workunit.client.1.smithi129.stdout:8/774: getdents d9/d11/d1a 0 2024-03-18T14:43:25.693 INFO:tasks.workunit.client.0.smithi087.stdout:3/910: symlink d0/d3/d4f/d6e/l115 0 2024-03-18T14:43:25.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/775: chown d9/d11/d1a/d66 3242956 1 2024-03-18T14:43:25.693 INFO:tasks.workunit.client.0.smithi087.stdout:0/895: link d0/d2/d4/d19/cdd d0/d1a/de6/c12e 0 2024-03-18T14:43:25.694 INFO:tasks.workunit.client.0.smithi087.stdout:3/911: fdatasync d0/d3/ffd 0 2024-03-18T14:43:25.695 INFO:tasks.workunit.client.0.smithi087.stdout:7/970: getdents d1/d6 0 2024-03-18T14:43:25.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/883: write d2/db/d24/d30/d49/d4f/f116 [652165,34054] 0 2024-03-18T14:43:25.696 INFO:tasks.workunit.client.1.smithi129.stdout:2/779: creat d7/d1f/d20/d2b/d41/da6/ded/ff6 x:0 0 0 2024-03-18T14:43:25.696 INFO:tasks.workunit.client.0.smithi087.stdout:6/839: getdents d3/d7/d25/d62/d8b/d106 0 2024-03-18T14:43:25.696 INFO:tasks.workunit.client.1.smithi129.stdout:2/780: write d7/d1f/d20/d2b/d41/f5e [4457796,32763] 0 2024-03-18T14:43:25.697 INFO:tasks.workunit.client.0.smithi087.stdout:4/884: chown d2/d13/d28/f70 8815810 1 2024-03-18T14:43:25.698 INFO:tasks.workunit.client.0.smithi087.stdout:2/913: dwrite d2/ddd/d22/d2c/d3a/d76/f7e [0,4194304] 0 2024-03-18T14:43:25.698 INFO:tasks.workunit.client.1.smithi129.stdout:2/781: write d7/d1c/d79/fa3 [448383,42072] 0 2024-03-18T14:43:25.698 INFO:tasks.workunit.client.1.smithi129.stdout:3/708: dread d4/fb3 [0,4194304] 0 2024-03-18T14:43:25.699 INFO:tasks.workunit.client.1.smithi129.stdout:2/782: fsync d7/d1f/d20/d2a/f5a 0 2024-03-18T14:43:25.701 INFO:tasks.workunit.client.0.smithi087.stdout:6/840: dread d3/f108 [0,4194304] 0 2024-03-18T14:43:25.701 INFO:tasks.workunit.client.0.smithi087.stdout:8/878: mknod d1/d6/d8d/dc2/dda/c125 0 2024-03-18T14:43:25.702 INFO:tasks.workunit.client.0.smithi087.stdout:8/879: fdatasync d1/d6/d2f/d44/dfc/d107/fe5 0 2024-03-18T14:43:25.703 INFO:tasks.workunit.client.0.smithi087.stdout:1/959: fdatasync d3/f7c 0 2024-03-18T14:43:25.705 INFO:tasks.workunit.client.0.smithi087.stdout:0/896: readlink d0/d2/d4/de8/dad/dea/d5d/l75 0 2024-03-18T14:43:25.706 INFO:tasks.workunit.client.1.smithi129.stdout:1/723: mknod d1/d2/d28/d65/d19/ce4 0 2024-03-18T14:43:25.706 INFO:tasks.workunit.client.1.smithi129.stdout:9/734: truncate d0/db/d11/d97/dd1/d26/d19/d8d/f98 515513 0 2024-03-18T14:43:25.708 INFO:tasks.workunit.client.1.smithi129.stdout:5/706: creat d0/fd2 x:0 0 0 2024-03-18T14:43:25.710 INFO:tasks.workunit.client.1.smithi129.stdout:4/696: link d0/d9/fdd d0/d9/d6a/d7b/fde 0 2024-03-18T14:43:25.711 INFO:tasks.workunit.client.0.smithi087.stdout:8/880: creat d1/d6/d2f/d44/d45/d72/db6/f126 x:0 0 0 2024-03-18T14:43:25.712 INFO:tasks.workunit.client.0.smithi087.stdout:2/914: dwrite d2/ddd/d22/d2c/d3a/d40/d98/fd0 [4194304,4194304] 0 2024-03-18T14:43:25.712 INFO:tasks.workunit.client.0.smithi087.stdout:7/971: dread d1/d6/d29/d2f/d68/d65/d60/d66/d8b/f124 [0,4194304] 0 2024-03-18T14:43:25.712 INFO:tasks.workunit.client.1.smithi129.stdout:0/765: fdatasync d0/d23/d35/d3b/fad 0 2024-03-18T14:43:25.713 INFO:tasks.workunit.client.1.smithi129.stdout:0/766: chown d0/d23/d71/dc2/c6a 448015286 1 2024-03-18T14:43:25.713 INFO:tasks.workunit.client.0.smithi087.stdout:1/960: symlink d3/d1d/d1e/d43/da3/dd3/l126 0 2024-03-18T14:43:25.714 INFO:tasks.workunit.client.1.smithi129.stdout:3/709: mkdir d4/d11/d1d/d50/def 0 2024-03-18T14:43:25.716 INFO:tasks.workunit.client.1.smithi129.stdout:2/783: rename d7/d1c/d79/cc2 to d7/d3f/cf7 0 2024-03-18T14:43:25.717 INFO:tasks.workunit.client.0.smithi087.stdout:5/944: write f11 [1021253,38956] 0 2024-03-18T14:43:25.720 INFO:tasks.workunit.client.1.smithi129.stdout:6/745: creat d3/d6/ff2 x:0 0 0 2024-03-18T14:43:25.720 INFO:tasks.workunit.client.1.smithi129.stdout:9/735: unlink d0/db/d2e/d9f/dcb/de0/f92 0 2024-03-18T14:43:25.721 INFO:tasks.workunit.client.1.smithi129.stdout:2/784: dwrite d7/d1f/d20/d36/fa8 [0,4194304] 0 2024-03-18T14:43:25.722 INFO:tasks.workunit.client.1.smithi129.stdout:7/756: creat d4/d2d/d2e/d79/dc6/d54/d86/fe8 x:0 0 0 2024-03-18T14:43:25.722 INFO:tasks.workunit.client.0.smithi087.stdout:9/995: rename db/d31/c67 to db/d18/d1e/c14f 0 2024-03-18T14:43:25.722 INFO:tasks.workunit.client.0.smithi087.stdout:9/996: chown db/d18/d1c/f50 165708 1 2024-03-18T14:43:25.722 INFO:tasks.workunit.client.0.smithi087.stdout:6/841: symlink d3/d7/d25/d62/d7c/d29/d22/l122 0 2024-03-18T14:43:25.723 INFO:tasks.workunit.client.1.smithi129.stdout:3/710: creat d4/d38/da3/ff0 x:0 0 0 2024-03-18T14:43:25.724 INFO:tasks.workunit.client.1.smithi129.stdout:2/785: write d7/d1c/d7b/fd8 [964764,89103] 0 2024-03-18T14:43:25.725 INFO:tasks.workunit.client.1.smithi129.stdout:4/697: rename d0/d9/d4c/dca/fdc to d0/d3c/fdf 0 2024-03-18T14:43:25.725 INFO:tasks.workunit.client.0.smithi087.stdout:8/881: symlink d1/d6/d14/db2/dbc/l127 0 2024-03-18T14:43:25.727 INFO:tasks.workunit.client.0.smithi087.stdout:7/972: creat d1/d6/da/d59/f147 x:0 0 0 2024-03-18T14:43:25.727 INFO:tasks.workunit.client.1.smithi129.stdout:9/736: dwrite d0/db/d90/d3e/d7e/fbe [0,4194304] 0 2024-03-18T14:43:25.728 INFO:tasks.workunit.client.0.smithi087.stdout:2/915: mkdir d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d130 0 2024-03-18T14:43:25.730 INFO:tasks.workunit.client.0.smithi087.stdout:5/945: chown d13/d1b/d7e/lef 1917091 1 2024-03-18T14:43:25.733 INFO:tasks.workunit.client.0.smithi087.stdout:3/912: dwrite d0/d3/df/d9a/f9b [0,4194304] 0 2024-03-18T14:43:25.734 INFO:tasks.workunit.client.0.smithi087.stdout:0/897: link d0/d2/d4/f111 d0/d2/d6b/d7c/f12f 0 2024-03-18T14:43:25.736 INFO:tasks.workunit.client.0.smithi087.stdout:6/842: creat d3/d7/d25/d62/d7c/da0/d96/d97/dc6/f123 x:0 0 0 2024-03-18T14:43:25.737 INFO:tasks.workunit.client.0.smithi087.stdout:6/843: chown d3/d7/d25/d62/d7c/d29/d22/l102 407286 1 2024-03-18T14:43:25.738 INFO:tasks.workunit.client.1.smithi129.stdout:5/707: dwrite d0/dc/d22/f39 [0,4194304] 0 2024-03-18T14:43:25.739 INFO:tasks.workunit.client.0.smithi087.stdout:2/916: symlink d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/l131 0 2024-03-18T14:43:25.739 INFO:tasks.workunit.client.1.smithi129.stdout:0/767: symlink d0/d23/d71/dc2/d4a/lec 0 2024-03-18T14:43:25.740 INFO:tasks.workunit.client.0.smithi087.stdout:5/946: mkdir d13/d1b/d70/d142 0 2024-03-18T14:43:25.740 INFO:tasks.workunit.client.1.smithi129.stdout:7/757: rmdir d4/d2d/d2e/d79/dc6/d8 39 2024-03-18T14:43:25.743 INFO:tasks.workunit.client.0.smithi087.stdout:8/882: creat d1/d6/d2f/d9b/d122/f128 x:0 0 0 2024-03-18T14:43:25.744 INFO:tasks.workunit.client.1.smithi129.stdout:4/698: symlink d0/le0 0 2024-03-18T14:43:25.744 INFO:tasks.workunit.client.0.smithi087.stdout:7/973: mkdir d1/d6/da/d13e/d148 0 2024-03-18T14:43:25.745 INFO:tasks.workunit.client.1.smithi129.stdout:2/786: truncate d7/f59 933376 0 2024-03-18T14:43:25.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/844: fdatasync d3/d7/d25/d62/d7c/d29/d22/d75/d92/fe4 0 2024-03-18T14:43:25.746 INFO:tasks.workunit.client.0.smithi087.stdout:2/917: stat d2/ddd/d22/d2c/d3a/d49/d58/d78/cb6 0 2024-03-18T14:43:25.748 INFO:tasks.workunit.client.0.smithi087.stdout:6/845: write d3/d7/d25/d62/d7c/d29/d7d/fc8 [322455,54018] 0 2024-03-18T14:43:25.748 INFO:tasks.workunit.client.0.smithi087.stdout:4/885: rename d2/db/d24/d30/d7b/d7f/c72 to d2/c125 0 2024-03-18T14:43:25.749 INFO:tasks.workunit.client.0.smithi087.stdout:7/974: dwrite d1/d97/f137 [0,4194304] 0 2024-03-18T14:43:25.750 INFO:tasks.workunit.client.0.smithi087.stdout:6/846: stat d3/d7/d25/f41 0 2024-03-18T14:43:25.751 INFO:tasks.workunit.client.0.smithi087.stdout:7/975: chown d1/d6/d29/l63 0 1 2024-03-18T14:43:25.751 INFO:tasks.workunit.client.1.smithi129.stdout:0/768: chown d0/d23/d35/d3b/l84 231419157 1 2024-03-18T14:43:25.751 INFO:tasks.workunit.client.1.smithi129.stdout:3/711: mknod d4/d38/da3/dc9/da9/dd4/cf1 0 2024-03-18T14:43:25.752 INFO:tasks.workunit.client.0.smithi087.stdout:6/847: write d3/d7/d25/d62/d7c/d29/d7d/fcf [400583,108682] 0 2024-03-18T14:43:25.752 INFO:tasks.workunit.client.0.smithi087.stdout:8/883: creat d1/d6/d9/d5d/f129 x:0 0 0 2024-03-18T14:43:25.753 INFO:tasks.workunit.client.0.smithi087.stdout:6/848: dread - d3/d7/d25/d62/d7c/d29/dce/fed zero size 2024-03-18T14:43:25.754 INFO:tasks.workunit.client.1.smithi129.stdout:2/787: fsync d7/d3f/d5f/f7d 0 2024-03-18T14:43:25.756 INFO:tasks.workunit.client.0.smithi087.stdout:9/997: getdents db/d18/d1e/d28/d76/db7 0 2024-03-18T14:43:25.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/712: read d4/d11/d34/d3c/d95/f96 [888406,87438] 0 2024-03-18T14:43:25.759 INFO:tasks.workunit.client.0.smithi087.stdout:1/961: rename d3/f7c to d3/d1d/d1e/d43/d50/d71/d11a/f127 0 2024-03-18T14:43:25.759 INFO:tasks.workunit.client.1.smithi129.stdout:7/758: link d4/d2d/d2e/d45/f55 d4/d2d/d2e/d79/dc6/d54/d86/fe9 0 2024-03-18T14:43:25.760 INFO:tasks.workunit.client.1.smithi129.stdout:9/737: link d0/db/d90/d70/d93/ld3 d0/db/d2e/d9d/dbb/lee 0 2024-03-18T14:43:25.760 INFO:tasks.workunit.client.0.smithi087.stdout:2/918: dread d2/ddd/d22/d2c/d3a/d49/fa3 [0,4194304] 0 2024-03-18T14:43:25.761 INFO:tasks.workunit.client.1.smithi129.stdout:9/738: write d0/db/d11/d97/dd1/d26/d19/d8d/fa8 [1011697,779] 0 2024-03-18T14:43:25.761 INFO:tasks.workunit.client.0.smithi087.stdout:2/919: read - d2/ddd/d22/d24/d65/d7f/ffb zero size 2024-03-18T14:43:25.762 INFO:tasks.workunit.client.1.smithi129.stdout:2/788: creat d7/d1f/d20/d2b/d41/d65/d88/ff8 x:0 0 0 2024-03-18T14:43:25.763 INFO:tasks.workunit.client.1.smithi129.stdout:2/789: readlink d7/l9 0 2024-03-18T14:43:25.764 INFO:tasks.workunit.client.1.smithi129.stdout:9/739: dread - d0/d15/f7a zero size 2024-03-18T14:43:25.765 INFO:tasks.workunit.client.0.smithi087.stdout:4/886: creat d2/db/d3c/d90/f126 x:0 0 0 2024-03-18T14:43:25.767 INFO:tasks.workunit.client.1.smithi129.stdout:2/790: read d7/d1f/d20/d36/da9/dc1/da5/dc4/fd9 [4026327,81169] 0 2024-03-18T14:43:25.767 INFO:tasks.workunit.client.1.smithi129.stdout:6/746: rename d3/d30/df/d28/fbb to d3/d30/de/d65/d93/ff3 0 2024-03-18T14:43:25.769 INFO:tasks.workunit.client.0.smithi087.stdout:7/976: stat d1/d6/da/d59/dbe/d11a/d95/dae 0 2024-03-18T14:43:25.769 INFO:tasks.workunit.client.1.smithi129.stdout:0/769: creat d0/d23/d71/dc2/d4a/d7a/fed x:0 0 0 2024-03-18T14:43:25.770 INFO:tasks.workunit.client.1.smithi129.stdout:9/740: dread d0/db/d90/d70/fa6 [0,4194304] 0 2024-03-18T14:43:25.770 INFO:tasks.workunit.client.1.smithi129.stdout:3/713: symlink d4/d11/lf2 0 2024-03-18T14:43:25.770 INFO:tasks.workunit.client.0.smithi087.stdout:0/898: write d0/d1a/d34/d3d/fb8 [1459665,30975] 0 2024-03-18T14:43:25.771 INFO:tasks.workunit.client.1.smithi129.stdout:9/741: write d0/db/d1f/f4e [758530,117161] 0 2024-03-18T14:43:25.772 INFO:tasks.workunit.client.1.smithi129.stdout:7/759: getdents d4/d2d/d2e/d79/dc6/ddc 0 2024-03-18T14:43:25.772 INFO:tasks.workunit.client.1.smithi129.stdout:9/742: read - d0/db/d2e/f7c zero size 2024-03-18T14:43:25.772 INFO:tasks.workunit.client.1.smithi129.stdout:9/743: chown d0/f8 497939 1 2024-03-18T14:43:25.773 INFO:tasks.workunit.client.0.smithi087.stdout:6/849: rmdir d3/d7/d25/dfb 39 2024-03-18T14:43:25.773 INFO:tasks.workunit.client.1.smithi129.stdout:9/744: write d0/db/d90/d70/fb7 [232538,44117] 0 2024-03-18T14:43:25.774 INFO:tasks.workunit.client.0.smithi087.stdout:9/998: read - db/d18/d3a/d113/f13a zero size 2024-03-18T14:43:25.774 INFO:tasks.workunit.client.1.smithi129.stdout:6/747: rmdir d3/d30 39 2024-03-18T14:43:25.775 INFO:tasks.workunit.client.0.smithi087.stdout:9/999: read - db/d18/d1e/d28/d76/db7/fc8 zero size 2024-03-18T14:43:25.776 INFO:tasks.workunit.client.1.smithi129.stdout:2/791: symlink d7/d1c/d62/lf9 0 2024-03-18T14:43:25.777 INFO:tasks.workunit.client.0.smithi087.stdout:5/947: rename d13/d1b/d70/da8/f13f to d13/d1b/d27/d28/d9a/f143 0 2024-03-18T14:43:25.778 INFO:tasks.workunit.client.1.smithi129.stdout:8/776: sync 2024-03-18T14:43:25.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/920: symlink d2/d44/d72/de0/d11d/l132 0 2024-03-18T14:43:25.779 INFO:tasks.workunit.client.0.smithi087.stdout:2/921: dread - d2/ddd/d22/d24/db2/fda zero size 2024-03-18T14:43:25.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/887: chown d2/db/d24/f26 19 1 2024-03-18T14:43:25.780 INFO:tasks.workunit.client.0.smithi087.stdout:3/913: link d0/d3/d4f/l111 d0/de/d30/d46/d76/l116 0 2024-03-18T14:43:25.784 INFO:tasks.workunit.client.0.smithi087.stdout:6/850: rmdir d3/d7/d25/d62/d8b 39 2024-03-18T14:43:25.785 INFO:tasks.workunit.client.0.smithi087.stdout:1/962: symlink d3/d1d/d1e/l128 0 2024-03-18T14:43:25.786 INFO:tasks.workunit.client.0.smithi087.stdout:5/948: fdatasync d13/d1b/d27/d28/f54 0 2024-03-18T14:43:25.788 INFO:tasks.workunit.client.0.smithi087.stdout:2/922: rmdir d2/ddd/d22/d2c 39 2024-03-18T14:43:25.791 INFO:tasks.workunit.client.1.smithi129.stdout:5/708: dwrite d0/d32/d3a/d45/f74 [4194304,4194304] 0 2024-03-18T14:43:25.792 INFO:tasks.workunit.client.0.smithi087.stdout:4/888: dwrite d2/f5b [0,4194304] 0 2024-03-18T14:43:25.793 INFO:tasks.workunit.client.1.smithi129.stdout:3/714: mknod d4/d11/d1d/d50/d91/d93/cf3 0 2024-03-18T14:43:25.795 INFO:tasks.workunit.client.0.smithi087.stdout:8/884: creat d1/d6/d9/d5d/d87/da2/f12a x:0 0 0 2024-03-18T14:43:25.795 INFO:tasks.workunit.client.0.smithi087.stdout:8/885: write d1/f2 [4913851,32698] 0 2024-03-18T14:43:25.796 INFO:tasks.workunit.client.1.smithi129.stdout:0/770: rename d0/c39 to d0/d14/d28/d63/cee 0 2024-03-18T14:43:25.796 INFO:tasks.workunit.client.1.smithi129.stdout:2/792: fdatasync d7/d1f/d20/d36/da9/dc1/da5/fbb 0 2024-03-18T14:43:25.797 INFO:tasks.workunit.client.1.smithi129.stdout:0/771: stat d0/d23/d71/dc2/d4a/l6d 0 2024-03-18T14:43:25.798 INFO:tasks.workunit.client.1.smithi129.stdout:6/748: dwrite d3/d6/d7f/db4/fc8 [0,4194304] 0 2024-03-18T14:43:25.798 INFO:tasks.workunit.client.0.smithi087.stdout:1/963: creat d3/d1d/d1f/d63/f129 x:0 0 0 2024-03-18T14:43:25.799 INFO:tasks.workunit.client.0.smithi087.stdout:5/949: readlink d13/d1b/d27/d35/la1 0 2024-03-18T14:43:25.800 INFO:tasks.workunit.client.0.smithi087.stdout:0/899: write d0/d2/d3c/f61 [2088983,83727] 0 2024-03-18T14:43:25.801 INFO:tasks.workunit.client.1.smithi129.stdout:6/749: dread d3/f6a [0,4194304] 0 2024-03-18T14:43:25.802 INFO:tasks.workunit.client.0.smithi087.stdout:4/889: chown d2/d13/d28/ce0 208759931 1 2024-03-18T14:43:25.803 INFO:tasks.workunit.client.0.smithi087.stdout:3/914: symlink d0/d3/l117 0 2024-03-18T14:43:25.803 INFO:tasks.workunit.client.0.smithi087.stdout:4/890: stat d2/db/d24/d30/d56 0 2024-03-18T14:43:25.804 INFO:tasks.workunit.client.0.smithi087.stdout:7/977: truncate d1/d6/da/d59/f111 258352 0 2024-03-18T14:43:25.805 INFO:tasks.workunit.client.1.smithi129.stdout:9/745: getdents d0/db/d11/d97/dd1/d25/d8e 0 2024-03-18T14:43:25.806 INFO:tasks.workunit.client.0.smithi087.stdout:8/886: mknod d1/d6/d2f/d44/d4b/da5/c12b 0 2024-03-18T14:43:25.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/915: dwrite d0/d3/d10/fbe [0,4194304] 0 2024-03-18T14:43:25.808 INFO:tasks.workunit.client.0.smithi087.stdout:3/916: dread - d0/d3/d4f/d6e/dc8/f114 zero size 2024-03-18T14:43:25.809 INFO:tasks.workunit.client.0.smithi087.stdout:3/917: stat d0/d3/df/f7d 0 2024-03-18T14:43:25.811 INFO:tasks.workunit.client.0.smithi087.stdout:2/923: dread - d2/ddd/d22/d2c/d3a/d40/deb/f105 zero size 2024-03-18T14:43:25.814 INFO:tasks.workunit.client.0.smithi087.stdout:7/978: symlink d1/d6/da/d59/dbe/d11a/dd4/l149 0 2024-03-18T14:43:25.815 INFO:tasks.workunit.client.1.smithi129.stdout:6/750: mkdir d3/d5/d46/df4 0 2024-03-18T14:43:25.817 INFO:tasks.workunit.client.1.smithi129.stdout:9/746: mknod d0/db/d11/d97/dd1/d26/d5f/cef 0 2024-03-18T14:43:25.818 INFO:tasks.workunit.client.1.smithi129.stdout:8/777: creat d9/d11/d1a/d32/d41/df5/ffe x:0 0 0 2024-03-18T14:43:25.819 INFO:tasks.workunit.client.0.smithi087.stdout:3/918: mknod d0/d1c/d25/c118 0 2024-03-18T14:43:25.820 INFO:tasks.workunit.client.0.smithi087.stdout:5/950: rename d13/d1b/d27/d8f/fd4 to d13/d1b/d27/d98/dc2/f144 0 2024-03-18T14:43:25.821 INFO:tasks.workunit.client.0.smithi087.stdout:5/951: read - d13/d1b/d70/f12b zero size 2024-03-18T14:43:25.822 INFO:tasks.workunit.client.1.smithi129.stdout:4/699: truncate d0/d3c/d6c/d89/f9b 1836222 0 2024-03-18T14:43:25.822 INFO:tasks.workunit.client.1.smithi129.stdout:3/715: creat d4/dd/d1f/d2f/dae/ff4 x:0 0 0 2024-03-18T14:43:25.822 INFO:tasks.workunit.client.1.smithi129.stdout:3/716: chown d4/dd/d41 400196 1 2024-03-18T14:43:25.823 INFO:tasks.workunit.client.0.smithi087.stdout:7/979: creat d1/d6/d29/d2f/d68/dbf/f14a x:0 0 0 2024-03-18T14:43:25.824 INFO:tasks.workunit.client.0.smithi087.stdout:2/924: write d2/ddd/d22/d2c/d3a/d49/fa3 [985865,31016] 0 2024-03-18T14:43:25.824 INFO:tasks.workunit.client.0.smithi087.stdout:3/919: mknod d0/d3/d7a/c119 0 2024-03-18T14:43:25.825 INFO:tasks.workunit.client.1.smithi129.stdout:9/747: mkdir d0/d15/df0 0 2024-03-18T14:43:25.825 INFO:tasks.workunit.client.0.smithi087.stdout:8/887: dread d1/d6/d8d/dc2/fd8 [0,4194304] 0 2024-03-18T14:43:25.826 INFO:tasks.workunit.client.0.smithi087.stdout:7/980: mknod d1/d6/da/d59/dfe/c14b 0 2024-03-18T14:43:25.826 INFO:tasks.workunit.client.0.smithi087.stdout:8/888: stat d1/d6/d2f/f95 0 2024-03-18T14:43:25.827 INFO:tasks.workunit.client.1.smithi129.stdout:4/700: chown d0/d19/d46/d3e/d21/d4d/d70/f2c 61831119 1 2024-03-18T14:43:25.827 INFO:tasks.workunit.client.1.smithi129.stdout:4/701: dread - d0/d3c/fb0 zero size 2024-03-18T14:43:25.828 INFO:tasks.workunit.client.1.smithi129.stdout:3/717: mknod d4/d11/d34/d53/d87/cf5 0 2024-03-18T14:43:25.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/751: readlink d3/d30/de/d6c/d9e/db6/lec 0 2024-03-18T14:43:25.831 INFO:tasks.workunit.client.1.smithi129.stdout:8/778: creat d9/d11/d18/da4/dd2/fff x:0 0 0 2024-03-18T14:43:25.832 INFO:tasks.workunit.client.0.smithi087.stdout:3/920: creat d0/d3/df/d42/dfc/d106/f11a x:0 0 0 2024-03-18T14:43:25.833 INFO:tasks.workunit.client.0.smithi087.stdout:8/889: dread d1/d6/d8d/fed [0,4194304] 0 2024-03-18T14:43:25.834 INFO:tasks.workunit.client.1.smithi129.stdout:1/724: sync 2024-03-18T14:43:25.834 INFO:tasks.workunit.client.0.smithi087.stdout:8/890: write d1/d6/d2f/d44/d45/d72/d7f/ff3 [2073862,60787] 0 2024-03-18T14:43:25.835 INFO:tasks.workunit.client.0.smithi087.stdout:3/921: truncate d0/d3/d4f/d6e/fb0 935308 0 2024-03-18T14:43:25.838 INFO:tasks.workunit.client.1.smithi129.stdout:8/779: dwrite d9/d11/ff3 [0,4194304] 0 2024-03-18T14:43:25.838 INFO:tasks.workunit.client.1.smithi129.stdout:1/725: dread - d1/d2/d28/d65/d19/dc9/d87/f9b zero size 2024-03-18T14:43:25.838 INFO:tasks.workunit.client.1.smithi129.stdout:2/793: dwrite d7/d1f/d20/d36/da9/dc1/f1a [0,4194304] 0 2024-03-18T14:43:25.839 INFO:tasks.workunit.client.0.smithi087.stdout:6/851: dwrite d3/d7/d25/d62/d7c/d29/d22/d75/d92/f113 [0,4194304] 0 2024-03-18T14:43:25.840 INFO:tasks.workunit.client.1.smithi129.stdout:4/702: unlink d0/d19/d46/d2e/f82 0 2024-03-18T14:43:25.841 INFO:tasks.workunit.client.0.smithi087.stdout:1/964: truncate d3/d1d/d1f/fb0 1614272 0 2024-03-18T14:43:25.841 INFO:tasks.workunit.client.1.smithi129.stdout:1/726: write d1/d35/f9c [1089582,3738] 0 2024-03-18T14:43:25.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/709: dwrite d0/dc/f4e [0,4194304] 0 2024-03-18T14:43:25.843 INFO:tasks.workunit.client.1.smithi129.stdout:4/703: stat d0/d3c/d6c/cbf 0 2024-03-18T14:43:25.843 INFO:tasks.workunit.client.0.smithi087.stdout:0/900: truncate d0/f16 3729327 0 2024-03-18T14:43:25.844 INFO:tasks.workunit.client.1.smithi129.stdout:0/772: dread d0/d23/d29/f58 [4194304,4194304] 0 2024-03-18T14:43:25.844 INFO:tasks.workunit.client.0.smithi087.stdout:2/925: write d2/ddd/d22/d2c/d3a/d40/f84 [1422013,71485] 0 2024-03-18T14:43:25.845 INFO:tasks.workunit.client.1.smithi129.stdout:1/727: fsync d1/d2/d28/d65/d19/dc9/d56/f82 0 2024-03-18T14:43:25.847 INFO:tasks.workunit.client.0.smithi087.stdout:0/901: chown d0/d2/d4/d27/dc3/dd2/dff/f106 45256 1 2024-03-18T14:43:25.847 INFO:tasks.workunit.client.1.smithi129.stdout:8/780: dwrite d9/d11/d18/da4/ff0 [0,4194304] 0 2024-03-18T14:43:25.847 INFO:tasks.workunit.client.0.smithi087.stdout:4/891: dread d2/db/d24/d30/d56/f8c [0,4194304] 0 2024-03-18T14:43:25.848 INFO:tasks.workunit.client.1.smithi129.stdout:8/781: write d9/d33/fbf [1373076,9793] 0 2024-03-18T14:43:25.848 INFO:tasks.workunit.client.1.smithi129.stdout:6/752: creat d3/d5/d46/df4/ff5 x:0 0 0 2024-03-18T14:43:25.849 INFO:tasks.workunit.client.0.smithi087.stdout:8/891: mknod d1/d6/d2f/d44/d45/d72/d7f/c12c 0 2024-03-18T14:43:25.849 INFO:tasks.workunit.client.0.smithi087.stdout:0/902: chown d0/d2/d4/de8/f70 12213 1 2024-03-18T14:43:25.849 INFO:tasks.workunit.client.0.smithi087.stdout:5/952: dwrite d13/ff8 [0,4194304] 0 2024-03-18T14:43:25.850 INFO:tasks.workunit.client.1.smithi129.stdout:6/753: chown d3/d30/de/d6c/d9e/f9f 477569058 1 2024-03-18T14:43:25.851 INFO:tasks.workunit.client.1.smithi129.stdout:6/754: read - d3/d30/de/d49/fa4 zero size 2024-03-18T14:43:25.851 INFO:tasks.workunit.client.1.smithi129.stdout:6/755: dread - d3/d5/d46/df4/ff5 zero size 2024-03-18T14:43:25.852 INFO:tasks.workunit.client.0.smithi087.stdout:6/852: write d3/d7/d25/d62/d7c/d29/f16 [6703462,70630] 0 2024-03-18T14:43:25.853 INFO:tasks.workunit.client.0.smithi087.stdout:5/953: chown d13/d1b/d27/l84 109084508 1 2024-03-18T14:43:25.853 INFO:tasks.workunit.client.0.smithi087.stdout:7/981: dwrite d1/d6/d29/d2f/d68/d65/f86 [0,4194304] 0 2024-03-18T14:43:25.854 INFO:tasks.workunit.client.0.smithi087.stdout:2/926: chown d2/ddd/d5a/de1 198441827 1 2024-03-18T14:43:25.854 INFO:tasks.workunit.client.0.smithi087.stdout:7/982: stat d1/d6/d16/da6/lb5 0 2024-03-18T14:43:25.856 INFO:tasks.workunit.client.0.smithi087.stdout:4/892: unlink d2/db/d24/d30/d49/d4f/fde 0 2024-03-18T14:43:25.858 INFO:tasks.workunit.client.1.smithi129.stdout:3/718: truncate d4/d38/da3/dc9/fe3 544485 0 2024-03-18T14:43:25.858 INFO:tasks.workunit.client.1.smithi129.stdout:2/794: creat d7/d1f/d20/d2b/deb/ffa x:0 0 0 2024-03-18T14:43:25.858 INFO:tasks.workunit.client.1.smithi129.stdout:3/719: chown d4/d11/d1d/d50/d91 257760 1 2024-03-18T14:43:25.860 INFO:tasks.workunit.client.0.smithi087.stdout:7/983: dwrite d1/d6/da/d42/d61/f12c [0,4194304] 0 2024-03-18T14:43:25.860 INFO:tasks.workunit.client.1.smithi129.stdout:0/773: unlink d0/d23/d35/d3b/c41 0 2024-03-18T14:43:25.860 INFO:tasks.workunit.client.0.smithi087.stdout:8/892: mkdir d1/d6/d2f/d44/d45/d72/d7f/d12d 0 2024-03-18T14:43:25.865 INFO:tasks.workunit.client.1.smithi129.stdout:6/756: fdatasync d3/d6/d7f/db4/d57/f64 0 2024-03-18T14:43:25.866 INFO:tasks.workunit.client.1.smithi129.stdout:6/757: chown d3/d30/de/da9 14950181 1 2024-03-18T14:43:25.866 INFO:tasks.workunit.client.1.smithi129.stdout:7/760: sync 2024-03-18T14:43:25.866 INFO:tasks.workunit.client.1.smithi129.stdout:1/728: getdents d1/d2/d28/d65/d19/dc9/d87/dc0/de1 0 2024-03-18T14:43:25.871 INFO:tasks.workunit.client.1.smithi129.stdout:0/774: rmdir d0/d14 39 2024-03-18T14:43:25.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/853: rename d3/d7/d25/d62/d7c/d29/d22/d61/l11e to d3/d7/dbd/l124 0 2024-03-18T14:43:25.876 INFO:tasks.workunit.client.0.smithi087.stdout:2/927: unlink d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/l131 0 2024-03-18T14:43:25.876 INFO:tasks.workunit.client.1.smithi129.stdout:4/704: rename d0/d19/d46/d3e/d21/d32/fb6 to d0/d19/d46/d3e/d21/d4d/d70/fe1 0 2024-03-18T14:43:25.882 INFO:tasks.workunit.client.0.smithi087.stdout:8/893: creat d1/d6/d2f/d44/d45/d72/db6/f12e x:0 0 0 2024-03-18T14:43:25.882 INFO:tasks.workunit.client.0.smithi087.stdout:6/854: rename d3/dcd/ddb to d3/dcd/d125 0 2024-03-18T14:43:25.883 INFO:tasks.workunit.client.0.smithi087.stdout:8/894: write d1/d6/d2f/d44/d45/d50/fe4 [4657662,117447] 0 2024-03-18T14:43:25.888 INFO:tasks.workunit.client.0.smithi087.stdout:4/893: symlink d2/db/d24/l127 0 2024-03-18T14:43:25.896 INFO:tasks.workunit.client.1.smithi129.stdout:9/748: truncate d0/f4 6187058 0 2024-03-18T14:43:25.897 INFO:tasks.workunit.client.0.smithi087.stdout:7/984: getdents d1/d97 0 2024-03-18T14:43:25.898 INFO:tasks.workunit.client.0.smithi087.stdout:3/922: write d0/de/d30/f7c [754081,88892] 0 2024-03-18T14:43:25.900 INFO:tasks.workunit.client.1.smithi129.stdout:6/758: chown d3/d30/c2a 45681137 1 2024-03-18T14:43:25.900 INFO:tasks.workunit.client.0.smithi087.stdout:0/903: write d0/d2/d4/de8/dad/dea/dcb/f127 [2460487,44723] 0 2024-03-18T14:43:25.901 INFO:tasks.workunit.client.1.smithi129.stdout:6/759: chown d3/d6/c15 12 1 2024-03-18T14:43:25.901 INFO:tasks.workunit.client.1.smithi129.stdout:6/760: dread - d3/d6/f8a zero size 2024-03-18T14:43:25.902 INFO:tasks.workunit.client.1.smithi129.stdout:6/761: chown d3/d30/de/d65/d93 1564864 1 2024-03-18T14:43:25.903 INFO:tasks.workunit.client.1.smithi129.stdout:1/729: mkdir d1/dbf/de5 0 2024-03-18T14:43:25.904 INFO:tasks.workunit.client.0.smithi087.stdout:1/965: dwrite d3/d1d/d1f/d34/d38/fb1 [0,4194304] 0 2024-03-18T14:43:25.904 INFO:tasks.workunit.client.0.smithi087.stdout:6/855: creat d3/d7/d25/d62/d7c/f126 x:0 0 0 2024-03-18T14:43:25.904 INFO:tasks.workunit.client.0.smithi087.stdout:5/954: dwrite d13/d1b/d27/d35/da7/ff3 [0,4194304] 0 2024-03-18T14:43:25.904 INFO:tasks.workunit.client.1.smithi129.stdout:3/720: mkdir d4/dd/df6 0 2024-03-18T14:43:25.905 INFO:tasks.workunit.client.1.smithi129.stdout:3/721: chown d4/d11/d34/dc0/lec 2 1 2024-03-18T14:43:25.907 INFO:tasks.workunit.client.1.smithi129.stdout:5/710: dread d0/f36 [0,4194304] 0 2024-03-18T14:43:25.907 INFO:tasks.workunit.client.0.smithi087.stdout:2/928: getdents d2/d44/d72/d8a 0 2024-03-18T14:43:25.907 INFO:tasks.workunit.client.0.smithi087.stdout:8/895: creat d1/d6/d2f/d44/d45/d72/f12f x:0 0 0 2024-03-18T14:43:25.910 INFO:tasks.workunit.client.1.smithi129.stdout:8/782: truncate d9/d11/d1a/d14/d60/fbe 4283845 0 2024-03-18T14:43:25.911 INFO:tasks.workunit.client.0.smithi087.stdout:7/985: symlink d1/d6/d29/d2f/dea/l14c 0 2024-03-18T14:43:25.911 INFO:tasks.workunit.client.1.smithi129.stdout:0/775: dread d0/d23/d71/dc2/d4a/f70 [0,4194304] 0 2024-03-18T14:43:25.911 INFO:tasks.workunit.client.1.smithi129.stdout:3/722: dwrite d4/d11/d1d/d50/d91/f94 [0,4194304] 0 2024-03-18T14:43:25.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/929: dwrite d2/ddd/d22/d24/db2/fda [0,4194304] 0 2024-03-18T14:43:25.915 INFO:tasks.workunit.client.1.smithi129.stdout:3/723: dread d4/dd/d1f/da8/fc6 [0,4194304] 0 2024-03-18T14:43:25.917 INFO:tasks.workunit.client.0.smithi087.stdout:7/986: dwrite d1/d6/d29/d2f/dea/f11f [0,4194304] 0 2024-03-18T14:43:25.919 INFO:tasks.workunit.client.0.smithi087.stdout:6/856: unlink d3/d7/d25/d62/d7c/d29/d22/d23/l79 0 2024-03-18T14:43:25.919 INFO:tasks.workunit.client.1.smithi129.stdout:3/724: dwrite d4/d11/d1d/d50/d91/d97/fa2 [0,4194304] 0 2024-03-18T14:43:25.920 INFO:tasks.workunit.client.0.smithi087.stdout:8/896: rmdir d1/d6/d2f/d44/d45/d72/d7f 39 2024-03-18T14:43:25.924 INFO:tasks.workunit.client.0.smithi087.stdout:4/894: dread d2/db/d67/f9c [0,4194304] 0 2024-03-18T14:43:25.924 INFO:tasks.workunit.client.1.smithi129.stdout:2/795: truncate d7/d1f/d81/dd4/fe7 1984733 0 2024-03-18T14:43:25.927 INFO:tasks.workunit.client.1.smithi129.stdout:4/705: stat d0/d9/d6a/db1 0 2024-03-18T14:43:25.928 INFO:tasks.workunit.client.1.smithi129.stdout:2/796: dread d7/d1f/d20/d36/f73 [0,4194304] 0 2024-03-18T14:43:25.929 INFO:tasks.workunit.client.0.smithi087.stdout:6/857: symlink d3/d7/d25/d62/d7c/d29/d7d/l127 0 2024-03-18T14:43:25.930 INFO:tasks.workunit.client.1.smithi129.stdout:6/762: dread d3/d30/de/d6c/d9e/f9f [0,4194304] 0 2024-03-18T14:43:25.930 INFO:tasks.workunit.client.1.smithi129.stdout:9/749: creat d0/da1/dc1/ff1 x:0 0 0 2024-03-18T14:43:25.931 INFO:tasks.workunit.client.1.smithi129.stdout:9/750: stat d0/db/d11/d97/dd1/d25/d8e/f67 0 2024-03-18T14:43:25.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/895: creat d2/db/d24/d30/d7b/d7f/d112/f128 x:0 0 0 2024-03-18T14:43:25.933 INFO:tasks.workunit.client.0.smithi087.stdout:2/930: read d2/ddd/d22/d2c/d3a/d40/d98/dd8/fef [2661587,90198] 0 2024-03-18T14:43:25.934 INFO:tasks.workunit.client.0.smithi087.stdout:1/966: rmdir d3/d3c/db8/d8f/d99/dfc 0 2024-03-18T14:43:25.934 INFO:tasks.workunit.client.0.smithi087.stdout:3/923: getdents d0/d3/d10/da5 0 2024-03-18T14:43:25.935 INFO:tasks.workunit.client.0.smithi087.stdout:3/924: chown d0/d3/df/d9a/lbb 31 1 2024-03-18T14:43:25.936 INFO:tasks.workunit.client.0.smithi087.stdout:2/931: mknod d2/ddd/d5a/c133 0 2024-03-18T14:43:25.936 INFO:tasks.workunit.client.0.smithi087.stdout:6/858: read d3/d7/d25/d62/d7c/d46/f88 [224361,24335] 0 2024-03-18T14:43:25.937 INFO:tasks.workunit.client.1.smithi129.stdout:5/711: mknod d0/d32/d34/d6c/da3/cd3 0 2024-03-18T14:43:25.937 INFO:tasks.workunit.client.0.smithi087.stdout:2/932: read - d2/ddd/d22/d2c/fa9 zero size 2024-03-18T14:43:25.937 INFO:tasks.workunit.client.1.smithi129.stdout:2/797: read d7/d1f/d20/d2a/f48 [1628663,39303] 0 2024-03-18T14:43:25.942 INFO:tasks.workunit.client.0.smithi087.stdout:3/925: truncate d0/d3/df/d42/dfc/d106/f11a 641495 0 2024-03-18T14:43:25.944 INFO:tasks.workunit.client.0.smithi087.stdout:6/859: dwrite d3/d7/d25/f41 [0,4194304] 0 2024-03-18T14:43:25.945 INFO:tasks.workunit.client.0.smithi087.stdout:2/933: rename d2/ddd/d22/c3f to d2/ddd/c134 0 2024-03-18T14:43:25.947 INFO:tasks.workunit.client.1.smithi129.stdout:9/751: mkdir d0/db/d1f/dae/df2 0 2024-03-18T14:43:25.950 INFO:tasks.workunit.client.0.smithi087.stdout:6/860: read d3/d7/d25/d62/d7c/d29/d22/f2c [663652,106206] 0 2024-03-18T14:43:25.951 INFO:tasks.workunit.client.0.smithi087.stdout:3/926: creat d0/f11b x:0 0 0 2024-03-18T14:43:25.952 INFO:tasks.workunit.client.1.smithi129.stdout:4/706: dread d0/f13 [0,4194304] 0 2024-03-18T14:43:25.952 INFO:tasks.workunit.client.0.smithi087.stdout:2/934: symlink d2/ddd/d22/d2c/d3a/d76/d81/l135 0 2024-03-18T14:43:25.954 INFO:tasks.workunit.client.1.smithi129.stdout:1/730: creat d1/db2/de2/fe6 x:0 0 0 2024-03-18T14:43:25.954 INFO:tasks.workunit.client.0.smithi087.stdout:2/935: chown d2/ddd/d22/d2c/d3a/d49/f8b 1975 1 2024-03-18T14:43:25.955 INFO:tasks.workunit.client.1.smithi129.stdout:6/763: link d3/d30/de/d6c/c4c d3/d6/d82/d9a/dad/cf6 0 2024-03-18T14:43:25.956 INFO:tasks.workunit.client.0.smithi087.stdout:3/927: dwrite d0/d72/d85/f90 [4194304,4194304] 0 2024-03-18T14:43:25.956 INFO:tasks.workunit.client.1.smithi129.stdout:6/764: chown d3/d5/d46 123 1 2024-03-18T14:43:25.956 INFO:tasks.workunit.client.0.smithi087.stdout:3/928: readlink d0/d3/l2e 0 2024-03-18T14:43:25.957 INFO:tasks.workunit.client.1.smithi129.stdout:4/707: mkdir d0/d19/d46/d3e/d21/d7f/de2 0 2024-03-18T14:43:25.957 INFO:tasks.workunit.client.1.smithi129.stdout:6/765: chown d3/d6 1 1 2024-03-18T14:43:25.958 INFO:tasks.workunit.client.1.smithi129.stdout:9/752: dwrite d0/db/fd [0,4194304] 0 2024-03-18T14:43:25.960 INFO:tasks.workunit.client.1.smithi129.stdout:5/712: rename d0/dc/d1a/c1b to d0/dc/cd4 0 2024-03-18T14:43:25.960 INFO:tasks.workunit.client.1.smithi129.stdout:3/725: getdents d4/d38/da3/dc9/da9/dd4 0 2024-03-18T14:43:25.961 INFO:tasks.workunit.client.0.smithi087.stdout:7/987: dread d1/d6/da/ff [0,4194304] 0 2024-03-18T14:43:25.964 INFO:tasks.workunit.client.0.smithi087.stdout:3/929: rmdir d0/d3/d4f/d6e 39 2024-03-18T14:43:25.964 INFO:tasks.workunit.client.0.smithi087.stdout:3/930: dread - d0/d3/fda zero size 2024-03-18T14:43:25.965 INFO:tasks.workunit.client.1.smithi129.stdout:4/708: dwrite d0/d19/d46/d3e/d21/d32/fdb [0,4194304] 0 2024-03-18T14:43:25.966 INFO:tasks.workunit.client.0.smithi087.stdout:7/988: mknod d1/d6/d29/d2f/d68/d10f/c14d 0 2024-03-18T14:43:25.967 INFO:tasks.workunit.client.1.smithi129.stdout:7/761: write d4/fd [2511788,69441] 0 2024-03-18T14:43:25.967 INFO:tasks.workunit.client.1.smithi129.stdout:4/709: fsync d0/d19/d46/d3e/d33/fd9 0 2024-03-18T14:43:25.969 INFO:tasks.workunit.client.1.smithi129.stdout:1/731: mkdir d1/db2/dc3/de7 0 2024-03-18T14:43:25.969 INFO:tasks.workunit.client.1.smithi129.stdout:5/713: dwrite d0/d32/d34/f3b [0,4194304] 0 2024-03-18T14:43:25.969 INFO:tasks.workunit.client.0.smithi087.stdout:5/955: dwrite d13/d1b/f3a [0,4194304] 0 2024-03-18T14:43:25.970 INFO:tasks.workunit.client.1.smithi129.stdout:6/766: symlink d3/d30/de/d49/lf7 0 2024-03-18T14:43:25.971 INFO:tasks.workunit.client.1.smithi129.stdout:8/783: dwrite d9/f4c [0,4194304] 0 2024-03-18T14:43:25.972 INFO:tasks.workunit.client.1.smithi129.stdout:4/710: read d0/d19/d46/d3e/d21/f5c [1195218,69355] 0 2024-03-18T14:43:25.974 INFO:tasks.workunit.client.1.smithi129.stdout:3/726: write d4/dd/d1f/d5f/fdb [1206412,24557] 0 2024-03-18T14:43:25.974 INFO:tasks.workunit.client.1.smithi129.stdout:0/776: dread d0/f55 [0,4194304] 0 2024-03-18T14:43:25.974 INFO:tasks.workunit.client.0.smithi087.stdout:2/936: creat d2/ddd/d5a/d10f/f136 x:0 0 0 2024-03-18T14:43:25.976 INFO:tasks.workunit.client.0.smithi087.stdout:3/931: mknod d0/de/d30/dc5/c11c 0 2024-03-18T14:43:25.978 INFO:tasks.workunit.client.0.smithi087.stdout:7/989: symlink d1/d6/da/d59/l14e 0 2024-03-18T14:43:25.978 INFO:tasks.workunit.client.1.smithi129.stdout:5/714: creat d0/d32/d3a/d52/d69/d8a/fd5 x:0 0 0 2024-03-18T14:43:25.979 INFO:tasks.workunit.client.0.smithi087.stdout:8/897: dread d1/d6/d9/f3a [0,4194304] 0 2024-03-18T14:43:25.982 INFO:tasks.workunit.client.0.smithi087.stdout:5/956: rename d13/d1b/d30/f5b to d13/d1b/d27/d98/dc2/f145 0 2024-03-18T14:43:25.983 INFO:tasks.workunit.client.0.smithi087.stdout:5/957: chown d13/d1b/d27/d28/d9a/dae/l104 22 1 2024-03-18T14:43:25.983 INFO:tasks.workunit.client.0.smithi087.stdout:4/896: dread d2/d13/d28/f2d [0,4194304] 0 2024-03-18T14:43:25.985 INFO:tasks.workunit.client.0.smithi087.stdout:8/898: mkdir d1/d6/d8d/dc2/d130 0 2024-03-18T14:43:25.988 INFO:tasks.workunit.client.0.smithi087.stdout:1/967: truncate d3/d1d/d1f/d63/f7e 1560808 0 2024-03-18T14:43:25.988 INFO:tasks.workunit.client.0.smithi087.stdout:4/897: dwrite d2/db/d67/f6a [0,4194304] 0 2024-03-18T14:43:25.989 INFO:tasks.workunit.client.0.smithi087.stdout:4/898: chown d2/db/d24/d30/d7b/d7f/c75 2489 1 2024-03-18T14:43:25.990 INFO:tasks.workunit.client.0.smithi087.stdout:0/904: sync 2024-03-18T14:43:25.991 INFO:tasks.workunit.client.1.smithi129.stdout:0/777: rmdir d0/d23/d35 39 2024-03-18T14:43:25.991 INFO:tasks.workunit.client.0.smithi087.stdout:6/861: write d3/d7/d25/d62/d7c/d29/d22/f5d [803628,5509] 0 2024-03-18T14:43:25.991 INFO:tasks.workunit.client.1.smithi129.stdout:4/711: truncate d0/d19/d46/d3e/f42 2417710 0 2024-03-18T14:43:25.991 INFO:tasks.workunit.client.1.smithi129.stdout:1/732: read d1/f9 [3722391,68624] 0 2024-03-18T14:43:25.992 INFO:tasks.workunit.client.1.smithi129.stdout:4/712: chown d0/d9/d85 994585110 1 2024-03-18T14:43:25.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/932: mkdir d0/d3/d7a/d101/d11d 0 2024-03-18T14:43:25.992 INFO:tasks.workunit.client.0.smithi087.stdout:3/933: stat d0/de/d30 0 2024-03-18T14:43:25.993 INFO:tasks.workunit.client.0.smithi087.stdout:3/934: fsync d0/de/d30/d46/dc3/fcb 0 2024-03-18T14:43:25.996 INFO:tasks.workunit.client.1.smithi129.stdout:1/733: dwrite d1/d2/d28/f81 [0,4194304] 0 2024-03-18T14:43:26.000 INFO:tasks.workunit.client.1.smithi129.stdout:0/778: dwrite d0/d23/d71/fa9 [4194304,4194304] 0 2024-03-18T14:43:26.000 INFO:tasks.workunit.client.1.smithi129.stdout:7/762: link d4/d2d/d2e/d79/dc6/d8/d3b/f4d d4/d2d/d2e/d79/dc6/d38/d61/d6a/dba/fea 0 2024-03-18T14:43:26.000 INFO:tasks.workunit.client.1.smithi129.stdout:2/798: sync 2024-03-18T14:43:26.003 INFO:tasks.workunit.client.0.smithi087.stdout:7/990: link d1/cb0 d1/d6/d29/d2f/d68/dbf/c14f 0 2024-03-18T14:43:26.003 INFO:tasks.workunit.client.1.smithi129.stdout:1/734: mknod d1/d2/d28/d65/d19/dc9/d87/d8c/ce8 0 2024-03-18T14:43:26.005 INFO:tasks.workunit.client.0.smithi087.stdout:8/899: mkdir d1/d6/d2f/d44/d45/d72/d7f/ddc/d131 0 2024-03-18T14:43:26.006 INFO:tasks.workunit.client.1.smithi129.stdout:0/779: dwrite d0/d23/d29/f38 [4194304,4194304] 0 2024-03-18T14:43:26.007 INFO:tasks.workunit.client.0.smithi087.stdout:0/905: dread d0/d1a/d7b/d26/f4b [0,4194304] 0 2024-03-18T14:43:26.008 INFO:tasks.workunit.client.0.smithi087.stdout:3/935: mkdir d0/d3/d10/da5/df5/d11e 0 2024-03-18T14:43:26.008 INFO:tasks.workunit.client.0.smithi087.stdout:7/991: mknod d1/d6/da/d13e/c150 0 2024-03-18T14:43:26.009 INFO:tasks.workunit.client.1.smithi129.stdout:9/753: dread d0/db/d11/d97/dd1/d26/f2a [0,4194304] 0 2024-03-18T14:43:26.009 INFO:tasks.workunit.client.0.smithi087.stdout:8/900: mknod d1/d6/d9/d5d/c132 0 2024-03-18T14:43:26.009 INFO:tasks.workunit.client.1.smithi129.stdout:4/713: rename d0/d19/d46/d3e/d21/f72 to d0/d19/d46/d3e/fe3 0 2024-03-18T14:43:26.010 INFO:tasks.workunit.client.1.smithi129.stdout:9/754: fsync d0/db/d1f/d4c/d57/f82 0 2024-03-18T14:43:26.011 INFO:tasks.workunit.client.1.smithi129.stdout:1/735: link d1/f6c d1/d2/d28/d65/d19/d84/fe9 0 2024-03-18T14:43:26.013 INFO:tasks.workunit.client.0.smithi087.stdout:0/906: symlink d0/d2/d4/de8/l130 0 2024-03-18T14:43:26.016 INFO:tasks.workunit.client.0.smithi087.stdout:6/862: creat d3/d7/d25/d62/d7c/f128 x:0 0 0 2024-03-18T14:43:26.017 INFO:tasks.workunit.client.0.smithi087.stdout:6/863: readlink d3/d7/d25/d62/d7c/d46/dc9/l116 0 2024-03-18T14:43:26.017 INFO:tasks.workunit.client.0.smithi087.stdout:8/901: dread - d1/d6/d8d/fac zero size 2024-03-18T14:43:26.018 INFO:tasks.workunit.client.1.smithi129.stdout:9/755: mknod d0/db/d53/cf3 0 2024-03-18T14:43:26.019 INFO:tasks.workunit.client.0.smithi087.stdout:3/936: symlink d0/d3/l11f 0 2024-03-18T14:43:26.019 INFO:tasks.workunit.client.0.smithi087.stdout:3/937: fsync d0/d3/df/f7d 0 2024-03-18T14:43:26.020 INFO:tasks.workunit.client.1.smithi129.stdout:6/767: getdents d3/d6/d82/d9a/dad 0 2024-03-18T14:43:26.021 INFO:tasks.workunit.client.1.smithi129.stdout:6/768: dread - d3/d6/ff2 zero size 2024-03-18T14:43:26.021 INFO:tasks.workunit.client.0.smithi087.stdout:0/907: read d0/d1a/d80/f95 [215327,66505] 0 2024-03-18T14:43:26.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/992: mknod d1/d6/d16/dc/ddc/d12d/c151 0 2024-03-18T14:43:26.021 INFO:tasks.workunit.client.0.smithi087.stdout:7/993: chown d1/d6/d29/d2f/d6b 26394822 1 2024-03-18T14:43:26.022 INFO:tasks.workunit.client.0.smithi087.stdout:0/908: dread - d0/d2/d4/de8/dad/dea/da3/f10c zero size 2024-03-18T14:43:26.023 INFO:tasks.workunit.client.0.smithi087.stdout:7/994: write d1/d6/da/d42/d61/fd3 [78959,53118] 0 2024-03-18T14:43:26.025 INFO:tasks.workunit.client.0.smithi087.stdout:6/864: creat d3/d7/d25/d62/d7c/da0/d96/d97/dbc/f129 x:0 0 0 2024-03-18T14:43:26.026 INFO:tasks.workunit.client.1.smithi129.stdout:8/784: dread d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:26.027 INFO:tasks.workunit.client.0.smithi087.stdout:3/938: creat d0/de/d30/d8e/f120 x:0 0 0 2024-03-18T14:43:26.027 INFO:tasks.workunit.client.1.smithi129.stdout:0/780: creat d0/d14/d53/dc9/fef x:0 0 0 2024-03-18T14:43:26.029 INFO:tasks.workunit.client.0.smithi087.stdout:6/865: creat d3/d7/d25/d62/d7c/da0/d96/f12a x:0 0 0 2024-03-18T14:43:26.030 INFO:tasks.workunit.client.1.smithi129.stdout:9/756: chown d0/db/f6b 48 1 2024-03-18T14:43:26.030 INFO:tasks.workunit.client.0.smithi087.stdout:3/939: read - d0/d72/d85/fac zero size 2024-03-18T14:43:26.032 INFO:tasks.workunit.client.1.smithi129.stdout:6/769: mkdir d3/d30/de/d49/df8 0 2024-03-18T14:43:26.032 INFO:tasks.workunit.client.0.smithi087.stdout:7/995: dread d1/f76 [0,4194304] 0 2024-03-18T14:43:26.032 INFO:tasks.workunit.client.1.smithi129.stdout:6/770: fsync d3/d30/de/d49/fa4 0 2024-03-18T14:43:26.036 INFO:tasks.workunit.client.1.smithi129.stdout:9/757: symlink d0/db/d11/d97/dd1/d25/d8e/lf4 0 2024-03-18T14:43:26.036 INFO:tasks.workunit.client.1.smithi129.stdout:4/714: getdents d0/d19/d5d 0 2024-03-18T14:43:26.038 INFO:tasks.workunit.client.0.smithi087.stdout:2/937: dread d2/ddd/d22/d2c/d3a/d40/d98/f10b [0,4194304] 0 2024-03-18T14:43:26.040 INFO:tasks.workunit.client.1.smithi129.stdout:3/727: write d4/dd/d1f/fce [1118691,68266] 0 2024-03-18T14:43:26.040 INFO:tasks.workunit.client.0.smithi087.stdout:2/938: write d2/ddd/d22/d2c/d3a/d40/f8d [7743305,123010] 0 2024-03-18T14:43:26.041 INFO:tasks.workunit.client.1.smithi129.stdout:3/728: fsync d4/dd/d1f/d2f/dae/ff4 0 2024-03-18T14:43:26.041 INFO:tasks.workunit.client.0.smithi087.stdout:0/909: dread d0/d1a/d80/d88/ff8 [0,4194304] 0 2024-03-18T14:43:26.043 INFO:tasks.workunit.client.1.smithi129.stdout:5/715: truncate d0/dc/d18/d2b/f5e 3287348 0 2024-03-18T14:43:26.044 INFO:tasks.workunit.client.0.smithi087.stdout:8/902: rmdir d1/d6/d2f/d44 39 2024-03-18T14:43:26.047 INFO:tasks.workunit.client.0.smithi087.stdout:0/910: dwrite d0/d2/d4/d19/f5e [0,4194304] 0 2024-03-18T14:43:26.047 INFO:tasks.workunit.client.0.smithi087.stdout:4/899: dwrite d2/f36 [0,4194304] 0 2024-03-18T14:43:26.049 INFO:tasks.workunit.client.0.smithi087.stdout:3/940: link d0/d3/d4f/l9e d0/d1c/l121 0 2024-03-18T14:43:26.049 INFO:tasks.workunit.client.0.smithi087.stdout:4/900: readlink d2/db/d7a/lac 0 2024-03-18T14:43:26.049 INFO:tasks.workunit.client.1.smithi129.stdout:7/763: dread d4/d2d/d2e/d79/dc6/d8/f47 [0,4194304] 0 2024-03-18T14:43:26.050 INFO:tasks.workunit.client.0.smithi087.stdout:0/911: write d0/d1a/d34/d3d/fb8 [1244925,125679] 0 2024-03-18T14:43:26.050 INFO:tasks.workunit.client.0.smithi087.stdout:5/958: dread d13/d1b/d7e/fa2 [0,4194304] 0 2024-03-18T14:43:26.053 INFO:tasks.workunit.client.1.smithi129.stdout:2/799: dread d7/d1f/d20/d36/da9/dc1/da5/fbb [0,4194304] 0 2024-03-18T14:43:26.054 INFO:tasks.workunit.client.1.smithi129.stdout:1/736: dwrite d1/d2/d28/f63 [0,4194304] 0 2024-03-18T14:43:26.055 INFO:tasks.workunit.client.1.smithi129.stdout:2/800: chown d7/d1f/d81/f8f 2 1 2024-03-18T14:43:26.055 INFO:tasks.workunit.client.1.smithi129.stdout:1/737: chown d1/l8a 0 1 2024-03-18T14:43:26.055 INFO:tasks.workunit.client.1.smithi129.stdout:0/781: dread d0/d14/f4d [0,4194304] 0 2024-03-18T14:43:26.056 INFO:tasks.workunit.client.1.smithi129.stdout:8/785: link d9/d33/fc4 d9/d11/f100 0 2024-03-18T14:43:26.057 INFO:tasks.workunit.client.1.smithi129.stdout:3/729: write d4/f21 [837202,114251] 0 2024-03-18T14:43:26.057 INFO:tasks.workunit.client.1.smithi129.stdout:1/738: write d1/d2/d28/d65/d19/fca [863575,17042] 0 2024-03-18T14:43:26.057 INFO:tasks.workunit.client.1.smithi129.stdout:5/716: symlink d0/dc/d1a/d61/ld6 0 2024-03-18T14:43:26.060 INFO:tasks.workunit.client.1.smithi129.stdout:1/739: fsync d1/d2/d28/d65/d19/dc9/fbb 0 2024-03-18T14:43:26.060 INFO:tasks.workunit.client.1.smithi129.stdout:4/715: symlink d0/d19/d46/d3e/le4 0 2024-03-18T14:43:26.062 INFO:tasks.workunit.client.0.smithi087.stdout:7/996: rename d1/d6/da/d42/d61/lf4 to d1/d6/d29/d2f/l152 0 2024-03-18T14:43:26.066 INFO:tasks.workunit.client.0.smithi087.stdout:1/968: dread d3/d1d/d1f/d34/f76 [0,4194304] 0 2024-03-18T14:43:26.066 INFO:tasks.workunit.client.0.smithi087.stdout:5/959: chown d13/f24 16663621 1 2024-03-18T14:43:26.068 INFO:tasks.workunit.client.1.smithi129.stdout:5/717: rmdir d0/d32/d3a/d52 39 2024-03-18T14:43:26.068 INFO:tasks.workunit.client.1.smithi129.stdout:6/771: getdents d3/d30 0 2024-03-18T14:43:26.068 INFO:tasks.workunit.client.1.smithi129.stdout:2/801: dwrite d7/d1f/fbf [0,4194304] 0 2024-03-18T14:43:26.069 INFO:tasks.workunit.client.1.smithi129.stdout:7/764: creat d4/d2d/d2e/d79/dc6/d54/feb x:0 0 0 2024-03-18T14:43:26.069 INFO:tasks.workunit.client.0.smithi087.stdout:1/969: read - d3/d1d/d1f/dab/f105 zero size 2024-03-18T14:43:26.069 INFO:tasks.workunit.client.0.smithi087.stdout:7/997: mkdir d1/d6/da/d13e/d148/d153 0 2024-03-18T14:43:26.069 INFO:tasks.workunit.client.0.smithi087.stdout:3/941: dwrite d0/fb9 [0,4194304] 0 2024-03-18T14:43:26.070 INFO:tasks.workunit.client.0.smithi087.stdout:0/912: symlink d0/d2/d4/de8/dad/dea/d5d/d10b/d125/l131 0 2024-03-18T14:43:26.071 INFO:tasks.workunit.client.1.smithi129.stdout:1/740: mknod d1/dbf/cea 0 2024-03-18T14:43:26.071 INFO:tasks.workunit.client.0.smithi087.stdout:0/913: fdatasync d0/d1a/de6/f117 0 2024-03-18T14:43:26.071 INFO:tasks.workunit.client.0.smithi087.stdout:5/960: truncate d13/d1b/d30/f49 828754 0 2024-03-18T14:43:26.072 INFO:tasks.workunit.client.1.smithi129.stdout:4/716: creat d0/d9/d40/d5f/fe5 x:0 0 0 2024-03-18T14:43:26.074 INFO:tasks.workunit.client.0.smithi087.stdout:3/942: unlink d0/d3/d10/da5/c10e 0 2024-03-18T14:43:26.074 INFO:tasks.workunit.client.1.smithi129.stdout:0/782: dwrite d0/d14/f2d [4194304,4194304] 0 2024-03-18T14:43:26.074 INFO:tasks.workunit.client.0.smithi087.stdout:1/970: dwrite d3/d1d/d1e/d43/dfb/f86 [0,4194304] 0 2024-03-18T14:43:26.075 INFO:tasks.workunit.client.0.smithi087.stdout:3/943: chown d0/de/d30/d60/ddb/ce4 2 1 2024-03-18T14:43:26.076 INFO:tasks.workunit.client.1.smithi129.stdout:4/717: write d0/f88 [3504872,113201] 0 2024-03-18T14:43:26.076 INFO:tasks.workunit.client.1.smithi129.stdout:2/802: fsync d7/d1f/d20/d2d/dab/fe5 0 2024-03-18T14:43:26.077 INFO:tasks.workunit.client.0.smithi087.stdout:2/939: rename d2/ddd/d22/d2c/d3a/d40/deb/f105 to d2/d44/d72/f137 0 2024-03-18T14:43:26.077 INFO:tasks.workunit.client.0.smithi087.stdout:4/901: dread d2/d13/d28/f70 [0,4194304] 0 2024-03-18T14:43:26.077 INFO:tasks.workunit.client.1.smithi129.stdout:7/765: mkdir d4/d2d/d2e/d45/dca/dec 0 2024-03-18T14:43:26.079 INFO:tasks.workunit.client.0.smithi087.stdout:6/866: dread d3/d7/d25/d62/d7c/d29/f16 [0,4194304] 0 2024-03-18T14:43:26.080 INFO:tasks.workunit.client.0.smithi087.stdout:7/998: creat d1/d6/da/d59/dbe/d11a/d95/f154 x:0 0 0 2024-03-18T14:43:26.081 INFO:tasks.workunit.client.1.smithi129.stdout:1/741: symlink d1/d2/leb 0 2024-03-18T14:43:26.081 INFO:tasks.workunit.client.0.smithi087.stdout:7/999: chown d1/d6/d29/d2f/d68/c5b 15703948 1 2024-03-18T14:43:26.082 INFO:tasks.workunit.client.0.smithi087.stdout:5/961: creat d13/d1b/d70/f146 x:0 0 0 2024-03-18T14:43:26.088 INFO:tasks.workunit.client.1.smithi129.stdout:7/766: dwrite d4/d2d/d2e/f41 [0,4194304] 0 2024-03-18T14:43:26.090 INFO:tasks.workunit.client.1.smithi129.stdout:7/767: fdatasync d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/fac 0 2024-03-18T14:43:26.090 INFO:tasks.workunit.client.1.smithi129.stdout:0/783: rename d0/d14/d53 to d0/d14/d28/df0 0 2024-03-18T14:43:26.090 INFO:tasks.workunit.client.0.smithi087.stdout:3/944: rename d0/de/d30/d46/dc3 to d0/d3/d10/da5/dce/d122 0 2024-03-18T14:43:26.094 INFO:tasks.workunit.client.0.smithi087.stdout:6/867: dwrite d3/dcd/fe5 [0,4194304] 0 2024-03-18T14:43:26.095 INFO:tasks.workunit.client.0.smithi087.stdout:6/868: dread - d3/d7/d25/d62/d7c/da0/d96/d97/dc6/fe6 zero size 2024-03-18T14:43:26.096 INFO:tasks.workunit.client.1.smithi129.stdout:9/758: dwrite d0/db/d11/d97/dd1/d26/d19/d29/f2d [0,4194304] 0 2024-03-18T14:43:26.098 INFO:tasks.workunit.client.1.smithi129.stdout:0/784: write d0/d23/d71/f96 [2836770,12496] 0 2024-03-18T14:43:26.100 INFO:tasks.workunit.client.1.smithi129.stdout:8/786: sync 2024-03-18T14:43:26.101 INFO:tasks.workunit.client.1.smithi129.stdout:7/768: symlink d4/d2d/d3a/led 0 2024-03-18T14:43:26.102 INFO:tasks.workunit.client.1.smithi129.stdout:1/742: truncate d1/d2/d28/d65/d19/d96/fdf 334251 0 2024-03-18T14:43:26.103 INFO:tasks.workunit.client.1.smithi129.stdout:1/743: fdatasync d1/d2/d28/d65/d19/d96/fa4 0 2024-03-18T14:43:26.103 INFO:tasks.workunit.client.1.smithi129.stdout:9/759: symlink d0/db/d11/d97/dd1/d26/d19/lf5 0 2024-03-18T14:43:26.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/962: mknod d13/d1b/d70/dce/d107/c147 0 2024-03-18T14:43:26.104 INFO:tasks.workunit.client.0.smithi087.stdout:5/963: chown ca 257 1 2024-03-18T14:43:26.105 INFO:tasks.workunit.client.0.smithi087.stdout:1/971: link d3/d1d/d1e/d20/d7a/db4/fcc d3/de4/f12a 0 2024-03-18T14:43:26.106 INFO:tasks.workunit.client.0.smithi087.stdout:2/940: symlink d2/ddd/d22/d2c/d3a/d40/l138 0 2024-03-18T14:43:26.107 INFO:tasks.workunit.client.0.smithi087.stdout:2/941: chown d2/ddd/d22/d2c/d3a/d68/dcb 1724 1 2024-03-18T14:43:26.107 INFO:tasks.workunit.client.0.smithi087.stdout:8/903: sync 2024-03-18T14:43:26.108 INFO:tasks.workunit.client.1.smithi129.stdout:8/787: truncate d9/d11/d1a/d14/f5e 514038 0 2024-03-18T14:43:26.108 INFO:tasks.workunit.client.0.smithi087.stdout:3/945: symlink d0/d3/d95/l123 0 2024-03-18T14:43:26.109 INFO:tasks.workunit.client.1.smithi129.stdout:7/769: write d4/d2d/d2e/d45/f4c [3337090,62206] 0 2024-03-18T14:43:26.109 INFO:tasks.workunit.client.1.smithi129.stdout:8/788: chown d9/d33/fef 7423076 1 2024-03-18T14:43:26.110 INFO:tasks.workunit.client.0.smithi087.stdout:2/942: read d2/d44/d72/d79/d101/fbf [1630530,3083] 0 2024-03-18T14:43:26.110 INFO:tasks.workunit.client.1.smithi129.stdout:7/770: dread - d4/d2d/d2e/d79/dc6/d38/d61/d68/fb3 zero size 2024-03-18T14:43:26.110 INFO:tasks.workunit.client.1.smithi129.stdout:1/744: symlink d1/d2/d28/da7/db5/lec 0 2024-03-18T14:43:26.111 INFO:tasks.workunit.client.1.smithi129.stdout:9/760: chown d0/db/d11/d97/dd1/d26/d19/l69 62895869 1 2024-03-18T14:43:26.112 INFO:tasks.workunit.client.1.smithi129.stdout:9/761: stat d0/db/d11/d97 0 2024-03-18T14:43:26.115 INFO:tasks.workunit.client.1.smithi129.stdout:3/730: dread d4/dd/d1f/d5f/d31/f5c [0,4194304] 0 2024-03-18T14:43:26.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/869: mknod d3/d7/d25/d62/d7c/d29/dce/dd9/c12b 0 2024-03-18T14:43:26.115 INFO:tasks.workunit.client.0.smithi087.stdout:5/964: unlink d13/d1b/f46 0 2024-03-18T14:43:26.115 INFO:tasks.workunit.client.0.smithi087.stdout:4/902: truncate d2/db/d24/d30/d7b/d7f/f10c 1035684 0 2024-03-18T14:43:26.116 INFO:tasks.workunit.client.1.smithi129.stdout:8/789: rename d9/d33/c40 to d9/d11/d1a/d66/c101 0 2024-03-18T14:43:26.116 INFO:tasks.workunit.client.0.smithi087.stdout:3/946: dread - d0/d3/d4f/d6e/dc8/fdd zero size 2024-03-18T14:43:26.117 INFO:tasks.workunit.client.1.smithi129.stdout:8/790: readlink d9/d11/d18/l5c 0 2024-03-18T14:43:26.117 INFO:tasks.workunit.client.0.smithi087.stdout:2/943: dread - d2/ddd/d22/d2c/d3a/d40/d52/fc9 zero size 2024-03-18T14:43:26.119 INFO:tasks.workunit.client.0.smithi087.stdout:1/972: mkdir d3/d1d/d1e/d43/d50/d12b 0 2024-03-18T14:43:26.120 INFO:tasks.workunit.client.1.smithi129.stdout:3/731: creat d4/d11/d34/d53/ff7 x:0 0 0 2024-03-18T14:43:26.121 INFO:tasks.workunit.client.1.smithi129.stdout:3/732: readlink d4/d11/d1d/l7c 0 2024-03-18T14:43:26.122 INFO:tasks.workunit.client.1.smithi129.stdout:7/771: creat d4/d2d/d2e/d79/dc6/d54/fee x:0 0 0 2024-03-18T14:43:26.122 INFO:tasks.workunit.client.0.smithi087.stdout:4/903: creat d2/dc2/dce/f129 x:0 0 0 2024-03-18T14:43:26.122 INFO:tasks.workunit.client.0.smithi087.stdout:5/965: symlink d13/d1b/d27/d28/d9a/df0/l148 0 2024-03-18T14:43:26.123 INFO:tasks.workunit.client.1.smithi129.stdout:3/733: write d4/dd/d1f/d5f/d31/f77 [843264,12921] 0 2024-03-18T14:43:26.123 INFO:tasks.workunit.client.0.smithi087.stdout:2/944: dwrite d2/ddd/d22/d24/f2a [4194304,4194304] 0 2024-03-18T14:43:26.123 INFO:tasks.workunit.client.0.smithi087.stdout:5/966: chown d13/d1b/d27/d28 9 1 2024-03-18T14:43:26.124 INFO:tasks.workunit.client.0.smithi087.stdout:5/967: chown d13/d1b/d27/d8f/dab 42823 1 2024-03-18T14:43:26.124 INFO:tasks.workunit.client.1.smithi129.stdout:1/745: rename d1/d2/d28/d65/d19/dc9/d71/fba to d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/fed 0 2024-03-18T14:43:26.125 INFO:tasks.workunit.client.0.smithi087.stdout:3/947: unlink d0/d3/f7 0 2024-03-18T14:43:26.126 INFO:tasks.workunit.client.1.smithi129.stdout:8/791: rmdir d9/d11/d55/d68 39 2024-03-18T14:43:26.127 INFO:tasks.workunit.client.1.smithi129.stdout:5/718: truncate d0/df/f37 210154 0 2024-03-18T14:43:26.128 INFO:tasks.workunit.client.0.smithi087.stdout:6/870: mknod d3/d7/d25/dfb/c12c 0 2024-03-18T14:43:26.130 INFO:tasks.workunit.client.1.smithi129.stdout:3/734: dread d4/d38/f47 [0,4194304] 0 2024-03-18T14:43:26.131 INFO:tasks.workunit.client.0.smithi087.stdout:1/973: rename d3/d1d/d1f/dab/f10d to d3/d1d/d1e/d20/d7a/f12c 0 2024-03-18T14:43:26.133 INFO:tasks.workunit.client.0.smithi087.stdout:0/914: dread d0/d2/d3c/d73/fc6 [0,4194304] 0 2024-03-18T14:43:26.133 INFO:tasks.workunit.client.1.smithi129.stdout:4/718: truncate d0/d19/d46/d3e/d21/d7f/fd4 58618 0 2024-03-18T14:43:26.133 INFO:tasks.workunit.client.0.smithi087.stdout:8/904: getdents d1/d6/d9/d5d/d87/dd1 0 2024-03-18T14:43:26.134 INFO:tasks.workunit.client.1.smithi129.stdout:2/803: dwrite d7/d1c/f9d [0,4194304] 0 2024-03-18T14:43:26.134 INFO:tasks.workunit.client.0.smithi087.stdout:8/905: fsync d1/d6/d9/d5d/d87/fb0 0 2024-03-18T14:43:26.135 INFO:tasks.workunit.client.1.smithi129.stdout:6/772: dread d3/d30/de/f58 [0,4194304] 0 2024-03-18T14:43:26.135 INFO:tasks.workunit.client.1.smithi129.stdout:2/804: write d7/d1c/d32/fb3 [588094,80853] 0 2024-03-18T14:43:26.136 INFO:tasks.workunit.client.0.smithi087.stdout:4/904: rename d2/d13/f122 to d2/dc2/dce/f12a 0 2024-03-18T14:43:26.140 INFO:tasks.workunit.client.1.smithi129.stdout:2/805: dwrite d7/d1f/d20/d36/da9/dc1/da5/fbb [0,4194304] 0 2024-03-18T14:43:26.140 INFO:tasks.workunit.client.0.smithi087.stdout:5/968: link d13/f11d d13/d1b/d30/d6e/d88/db4/f149 0 2024-03-18T14:43:26.141 INFO:tasks.workunit.client.1.smithi129.stdout:2/806: write d7/d1c/fef [436134,89388] 0 2024-03-18T14:43:26.142 INFO:tasks.workunit.client.1.smithi129.stdout:0/785: sync 2024-03-18T14:43:26.146 INFO:tasks.workunit.client.0.smithi087.stdout:6/871: symlink d3/d7/d25/d10e/d115/l12d 0 2024-03-18T14:43:26.146 INFO:tasks.workunit.client.1.smithi129.stdout:1/746: chown d1/d35/c38 17917371 1 2024-03-18T14:43:26.151 INFO:tasks.workunit.client.1.smithi129.stdout:3/735: dread d4/d38/da3/dc9/fe3 [0,4194304] 0 2024-03-18T14:43:26.152 INFO:tasks.workunit.client.1.smithi129.stdout:6/773: symlink d3/d30/de/da9/lf9 0 2024-03-18T14:43:26.152 INFO:tasks.workunit.client.1.smithi129.stdout:6/774: readlink d3/l3f 0 2024-03-18T14:43:26.153 INFO:tasks.workunit.client.1.smithi129.stdout:2/807: mkdir d7/d1f/d20/d36/da9/dc1/da5/dfb 0 2024-03-18T14:43:26.153 INFO:tasks.workunit.client.1.smithi129.stdout:6/775: chown d3/d30/de/d49/fa4 104295459 1 2024-03-18T14:43:26.155 INFO:tasks.workunit.client.1.smithi129.stdout:6/776: fdatasync d3/d6/d7f/db4/d57/f75 0 2024-03-18T14:43:26.156 INFO:tasks.workunit.client.1.smithi129.stdout:3/736: dread d4/d11/d1d/d50/d91/d97/fc1 [0,4194304] 0 2024-03-18T14:43:26.157 INFO:tasks.workunit.client.1.smithi129.stdout:7/772: rename d4/d2d/d2e/d79/dc6/d54/f69 to d4/d2d/d2e/d79/dc6/d38/d49/fef 0 2024-03-18T14:43:26.160 INFO:tasks.workunit.client.1.smithi129.stdout:9/762: link d0/db/d11/d97/dd1/d26/d19/f9b d0/db/d11/d97/dd1/ff6 0 2024-03-18T14:43:26.161 INFO:tasks.workunit.client.1.smithi129.stdout:5/719: creat d0/d32/d3a/d52/d69/fd7 x:0 0 0 2024-03-18T14:43:26.161 INFO:tasks.workunit.client.1.smithi129.stdout:9/763: write d0/db/d90/d70/fb7 [1076908,90614] 0 2024-03-18T14:43:26.161 INFO:tasks.workunit.client.1.smithi129.stdout:4/719: fsync d0/fab 0 2024-03-18T14:43:26.163 INFO:tasks.workunit.client.0.smithi087.stdout:2/945: link d2/ddd/d22/d2c/d3a/d40/d52/f5c d2/ddd/d22/d24/f139 0 2024-03-18T14:43:26.163 INFO:tasks.workunit.client.1.smithi129.stdout:5/720: write d0/d32/d3a/d52/d69/fd7 [591735,50521] 0 2024-03-18T14:43:26.163 INFO:tasks.workunit.client.1.smithi129.stdout:9/764: chown d0/db/d11/d97/dd1/d25/d8e/lf4 588669620 1 2024-03-18T14:43:26.166 INFO:tasks.workunit.client.1.smithi129.stdout:5/721: dread d0/dc/f77 [0,4194304] 0 2024-03-18T14:43:26.166 INFO:tasks.workunit.client.1.smithi129.stdout:6/777: creat d3/d30/de/da9/ffa x:0 0 0 2024-03-18T14:43:26.167 INFO:tasks.workunit.client.1.smithi129.stdout:4/720: dread d0/d19/d46/d3e/d33/f8b [0,4194304] 0 2024-03-18T14:43:26.169 INFO:tasks.workunit.client.1.smithi129.stdout:8/792: creat d9/f102 x:0 0 0 2024-03-18T14:43:26.169 INFO:tasks.workunit.client.1.smithi129.stdout:7/773: write d4/d8c/f76 [326602,70082] 0 2024-03-18T14:43:26.169 INFO:tasks.workunit.client.0.smithi087.stdout:8/906: rmdir d1/d6/d2f/d44/d45/d71 39 2024-03-18T14:43:26.169 INFO:tasks.workunit.client.1.smithi129.stdout:1/747: truncate d1/d2/d28/d65/f36 3106103 0 2024-03-18T14:43:26.170 INFO:tasks.workunit.client.0.smithi087.stdout:4/905: write d2/fb2 [1054884,71240] 0 2024-03-18T14:43:26.171 INFO:tasks.workunit.client.1.smithi129.stdout:0/786: dwrite d0/d23/d35/d3b/d42/dc0/fdb [0,4194304] 0 2024-03-18T14:43:26.171 INFO:tasks.workunit.client.0.smithi087.stdout:4/906: chown d2/db/d24/d30/d7b/d7f/fee 216568355 1 2024-03-18T14:43:26.171 INFO:tasks.workunit.client.1.smithi129.stdout:8/793: fsync d9/d11/d1a/d14/d60/fb8 0 2024-03-18T14:43:26.172 INFO:tasks.workunit.client.0.smithi087.stdout:4/907: chown d2/db/d24/d30/d7b/d7f/fb9 24817 1 2024-03-18T14:43:26.172 INFO:tasks.workunit.client.0.smithi087.stdout:0/915: rename d0/d2/l9d to d0/d7f/l132 0 2024-03-18T14:43:26.172 INFO:tasks.workunit.client.0.smithi087.stdout:1/974: write d3/d1d/d1e/d43/d50/d71/d11a/f120 [420432,92191] 0 2024-03-18T14:43:26.173 INFO:tasks.workunit.client.0.smithi087.stdout:5/969: write ff [8236892,71545] 0 2024-03-18T14:43:26.174 INFO:tasks.workunit.client.0.smithi087.stdout:5/970: fsync d13/d1b/d30/d6e/dc8/f13d 0 2024-03-18T14:43:26.175 INFO:tasks.workunit.client.0.smithi087.stdout:5/971: write d13/d1b/d70/da8/f10c [446402,125347] 0 2024-03-18T14:43:26.178 INFO:tasks.workunit.client.0.smithi087.stdout:6/872: dwrite d3/d7/f24 [4194304,4194304] 0 2024-03-18T14:43:26.178 INFO:tasks.workunit.client.1.smithi129.stdout:9/765: mknod d0/db/d11/d97/dd1/d26/d5f/cf7 0 2024-03-18T14:43:26.180 INFO:tasks.workunit.client.0.smithi087.stdout:2/946: mknod d2/ddd/d5a/d10f/c13a 0 2024-03-18T14:43:26.180 INFO:tasks.workunit.client.0.smithi087.stdout:3/948: link d0/d1c/d25/c51 d0/d1c/c124 0 2024-03-18T14:43:26.180 INFO:tasks.workunit.client.1.smithi129.stdout:5/722: mkdir d0/d32/d3a/d52/d6e/dd8 0 2024-03-18T14:43:26.181 INFO:tasks.workunit.client.0.smithi087.stdout:8/907: read d1/d6/d9/f6c [63309,36814] 0 2024-03-18T14:43:26.183 INFO:tasks.workunit.client.1.smithi129.stdout:1/748: rmdir d1/d35/d7a 39 2024-03-18T14:43:26.183 INFO:tasks.workunit.client.1.smithi129.stdout:9/766: dread d0/db/d2e/d9f/faa [0,4194304] 0 2024-03-18T14:43:26.184 INFO:tasks.workunit.client.0.smithi087.stdout:8/908: chown d1/d6/d2f/d44/d45/d50/fd2 100 1 2024-03-18T14:43:26.184 INFO:tasks.workunit.client.1.smithi129.stdout:9/767: chown d0/db/d11/c52 29 1 2024-03-18T14:43:26.186 INFO:tasks.workunit.client.0.smithi087.stdout:4/908: truncate d2/db/d24/d30/d56/f8c 4308289 0 2024-03-18T14:43:26.187 INFO:tasks.workunit.client.0.smithi087.stdout:0/916: dwrite d0/d2/d4/d19/f25 [0,4194304] 0 2024-03-18T14:43:26.187 INFO:tasks.workunit.client.1.smithi129.stdout:9/768: dwrite d0/db/d1f/d4c/d57/fa3 [0,4194304] 0 2024-03-18T14:43:26.190 INFO:tasks.workunit.client.0.smithi087.stdout:6/873: getdents d3/d7/d25/d62/d7c/d29/d22/d75/d92/de9 0 2024-03-18T14:43:26.190 INFO:tasks.workunit.client.0.smithi087.stdout:2/947: dwrite d2/ddd/d22/d2c/d3a/d40/fbc [0,4194304] 0 2024-03-18T14:43:26.190 INFO:tasks.workunit.client.0.smithi087.stdout:3/949: dwrite d0/de/d30/dc5/fd9 [0,4194304] 0 2024-03-18T14:43:26.190 INFO:tasks.workunit.client.1.smithi129.stdout:3/737: rename d4/d38/da3/dc9/da9 to d4/d11/d34/df8 0 2024-03-18T14:43:26.191 INFO:tasks.workunit.client.0.smithi087.stdout:0/917: rename d0/d2 to d0/d2/d4/d8b/d133 22 2024-03-18T14:43:26.191 INFO:tasks.workunit.client.0.smithi087.stdout:4/909: readlink d2/db/d24/d30/d8a/d95/l11c 0 2024-03-18T14:43:26.192 INFO:tasks.workunit.client.0.smithi087.stdout:8/909: mknod d1/d6/d2f/d44/d45/d72/db6/d11e/c133 0 2024-03-18T14:43:26.196 INFO:tasks.workunit.client.1.smithi129.stdout:1/749: dwrite d1/d2/f64 [4194304,4194304] 0 2024-03-18T14:43:26.197 INFO:tasks.workunit.client.1.smithi129.stdout:1/750: dread - d1/d2/d28/d65/d7c/fdd zero size 2024-03-18T14:43:26.198 INFO:tasks.workunit.client.1.smithi129.stdout:1/751: write d1/d2/d28/d65/f99 [5188875,66405] 0 2024-03-18T14:43:26.200 INFO:tasks.workunit.client.0.smithi087.stdout:6/874: mkdir d3/d7/d25/d62/d7c/d29/dce/d12e 0 2024-03-18T14:43:26.200 INFO:tasks.workunit.client.1.smithi129.stdout:0/787: mknod d0/de3/cf1 0 2024-03-18T14:43:26.200 INFO:tasks.workunit.client.1.smithi129.stdout:8/794: getdents d9/d11/d53/d5f/dcb/dd9 0 2024-03-18T14:43:26.201 INFO:tasks.workunit.client.0.smithi087.stdout:5/972: write d13/d1b/d70/fad [1949435,114121] 0 2024-03-18T14:43:26.201 INFO:tasks.workunit.client.0.smithi087.stdout:4/910: mknod d2/db/d24/d30/d7b/dbe/dcf/c12b 0 2024-03-18T14:43:26.202 INFO:tasks.workunit.client.1.smithi129.stdout:2/808: getdents d7/d1f/d20/d36/da9/dc1/da5/dc4 0 2024-03-18T14:43:26.204 INFO:tasks.workunit.client.0.smithi087.stdout:1/975: dwrite d3/d1d/d1e/d20/f80 [0,4194304] 0 2024-03-18T14:43:26.204 INFO:tasks.workunit.client.1.smithi129.stdout:9/769: truncate d0/d15/f7a 512043 0 2024-03-18T14:43:26.204 INFO:tasks.workunit.client.0.smithi087.stdout:2/948: read d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/f116 [815479,12918] 0 2024-03-18T14:43:26.205 INFO:tasks.workunit.client.0.smithi087.stdout:2/949: chown d2/ddd/d5a 2 1 2024-03-18T14:43:26.206 INFO:tasks.workunit.client.1.smithi129.stdout:3/738: mknod d4/dd/d1f/d5f/cf9 0 2024-03-18T14:43:26.207 INFO:tasks.workunit.client.1.smithi129.stdout:3/739: readlink d4/dd/d1f/d5f/d82/da6/ld3 0 2024-03-18T14:43:26.208 INFO:tasks.workunit.client.0.smithi087.stdout:0/918: rename d0/d2/d4/de8/dad/dea/dcb to d0/d1a/d8c/d134 0 2024-03-18T14:43:26.209 INFO:tasks.workunit.client.0.smithi087.stdout:2/950: dwrite d2/ddd/d22/f4d [4194304,4194304] 0 2024-03-18T14:43:26.209 INFO:tasks.workunit.client.0.smithi087.stdout:0/919: chown d0/d2/d4/de8/lac 6 1 2024-03-18T14:43:26.209 INFO:tasks.workunit.client.0.smithi087.stdout:5/973: chown d13/c8b 1 1 2024-03-18T14:43:26.211 INFO:tasks.workunit.client.0.smithi087.stdout:5/974: write d13/d1b/d27/d28/d9a/f123 [1002530,15624] 0 2024-03-18T14:43:26.213 INFO:tasks.workunit.client.0.smithi087.stdout:2/951: dread d2/ddd/d22/d2c/d3a/d76/f7e [0,4194304] 0 2024-03-18T14:43:26.215 INFO:tasks.workunit.client.1.smithi129.stdout:3/740: read d4/d11/d34/f76 [133595,118730] 0 2024-03-18T14:43:26.216 INFO:tasks.workunit.client.0.smithi087.stdout:2/952: dread d2/ddd/d22/d2c/d3a/d40/fbc [0,4194304] 0 2024-03-18T14:43:26.217 INFO:tasks.workunit.client.1.smithi129.stdout:6/778: truncate d3/d30/de/da9/fdd 868356 0 2024-03-18T14:43:26.217 INFO:tasks.workunit.client.1.smithi129.stdout:4/721: link d0/d19/d46/c2f d0/d3c/ce6 0 2024-03-18T14:43:26.218 INFO:tasks.workunit.client.0.smithi087.stdout:6/875: mknod d3/d7/d25/d62/d7c/da0/d96/d97/c12f 0 2024-03-18T14:43:26.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/779: chown d3/d6/f9b 3226223 1 2024-03-18T14:43:26.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/780: dread - d3/fd1 zero size 2024-03-18T14:43:26.219 INFO:tasks.workunit.client.0.smithi087.stdout:8/910: chown d1/d6/d2f/d44/d45/d71/daa/fb8 854 1 2024-03-18T14:43:26.219 INFO:tasks.workunit.client.0.smithi087.stdout:4/911: mkdir d2/db/d24/d30/d49/d12c 0 2024-03-18T14:43:26.219 INFO:tasks.workunit.client.1.smithi129.stdout:6/781: write d3/d6/fd6 [556467,116940] 0 2024-03-18T14:43:26.220 INFO:tasks.workunit.client.1.smithi129.stdout:8/795: unlink d9/d11/d1a/d32/d3a/d70/fd8 0 2024-03-18T14:43:26.221 INFO:tasks.workunit.client.1.smithi129.stdout:0/788: read d0/d14/f8a [341148,22416] 0 2024-03-18T14:43:26.221 INFO:tasks.workunit.client.1.smithi129.stdout:7/774: link d4/l2c d4/d2d/d2e/d45/dca/lf0 0 2024-03-18T14:43:26.222 INFO:tasks.workunit.client.0.smithi087.stdout:1/976: symlink d3/d1d/d1e/d43/d50/d71/df7/l12d 0 2024-03-18T14:43:26.223 INFO:tasks.workunit.client.0.smithi087.stdout:1/977: write d3/d1d/d45/fae [390403,8886] 0 2024-03-18T14:43:26.223 INFO:tasks.workunit.client.1.smithi129.stdout:7/775: readlink d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/ldb 0 2024-03-18T14:43:26.223 INFO:tasks.workunit.client.1.smithi129.stdout:6/782: dread d3/d6/d7f/db4/fc8 [0,4194304] 0 2024-03-18T14:43:26.225 INFO:tasks.workunit.client.1.smithi129.stdout:3/741: rename d4/d11/d1d/d50/d91/d93 to d4/dd/d1f/d5f/dfa 0 2024-03-18T14:43:26.226 INFO:tasks.workunit.client.0.smithi087.stdout:3/950: truncate d0/de/d30/d60/fe8 712723 0 2024-03-18T14:43:26.226 INFO:tasks.workunit.client.0.smithi087.stdout:0/920: rmdir d0/d2/d6b 39 2024-03-18T14:43:26.226 INFO:tasks.workunit.client.1.smithi129.stdout:5/723: sync 2024-03-18T14:43:26.228 INFO:tasks.workunit.client.1.smithi129.stdout:1/752: creat d1/db2/dc3/de7/fee x:0 0 0 2024-03-18T14:43:26.229 INFO:tasks.workunit.client.0.smithi087.stdout:5/975: rename d13/d1b/d27/ced to d13/d1b/d70/d142/c14a 0 2024-03-18T14:43:26.233 INFO:tasks.workunit.client.0.smithi087.stdout:6/876: unlink d3/d7/d25/d62/d7c/da0/d96/d97/cf5 0 2024-03-18T14:43:26.234 INFO:tasks.workunit.client.0.smithi087.stdout:8/911: mknod d1/d6/d8d/dc2/dda/c134 0 2024-03-18T14:43:26.234 INFO:tasks.workunit.client.0.smithi087.stdout:6/877: chown d3/d7/d25/d62/d7c/d29/d22/d61/lc7 4 1 2024-03-18T14:43:26.235 INFO:tasks.workunit.client.1.smithi129.stdout:8/796: mkdir d9/d11/d1a/d32/d41/d4d/d103 0 2024-03-18T14:43:26.237 INFO:tasks.workunit.client.0.smithi087.stdout:1/978: truncate d3/d1d/d1f/f5d 558189 0 2024-03-18T14:43:26.237 INFO:tasks.workunit.client.1.smithi129.stdout:9/770: link d0/db/d11/d97/dd1/d26/d19/d29/fb3 d0/d15/dd7/ff8 0 2024-03-18T14:43:26.238 INFO:tasks.workunit.client.1.smithi129.stdout:0/789: creat d0/d23/d6b/ff2 x:0 0 0 2024-03-18T14:43:26.238 INFO:tasks.workunit.client.1.smithi129.stdout:8/797: read d9/d11/d1a/d32/d41/fa3 [1691846,48659] 0 2024-03-18T14:43:26.240 INFO:tasks.workunit.client.0.smithi087.stdout:3/951: truncate d0/d3/df/d42/fa6 1478390 0 2024-03-18T14:43:26.240 INFO:tasks.workunit.client.0.smithi087.stdout:3/952: chown d0/de/d30/d46/d76/cf9 16317 1 2024-03-18T14:43:26.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/912: rename d2/db/d24/d30/d7b/dbe/dcf/dda to d2/db/d24/d30/d49/d12d 0 2024-03-18T14:43:26.242 INFO:tasks.workunit.client.1.smithi129.stdout:3/742: creat d4/d11/d1d/d36/ffb x:0 0 0 2024-03-18T14:43:26.243 INFO:tasks.workunit.client.1.smithi129.stdout:7/776: dread d4/fc2 [0,4194304] 0 2024-03-18T14:43:26.245 INFO:tasks.workunit.client.1.smithi129.stdout:6/783: dwrite d3/d30/df/d28/d79/dc4/fc6 [0,4194304] 0 2024-03-18T14:43:26.249 INFO:tasks.workunit.client.1.smithi129.stdout:3/743: dwrite d4/d11/d1d/fb5 [0,4194304] 0 2024-03-18T14:43:26.249 INFO:tasks.workunit.client.1.smithi129.stdout:2/809: truncate d7/d1f/fbf 3516697 0 2024-03-18T14:43:26.253 INFO:tasks.workunit.client.0.smithi087.stdout:5/976: truncate d13/d1b/d7e/fbf 1017278 0 2024-03-18T14:43:26.256 INFO:tasks.workunit.client.1.smithi129.stdout:4/722: mkdir d0/d3c/d6c/d89/de7 0 2024-03-18T14:43:26.257 INFO:tasks.workunit.client.0.smithi087.stdout:8/912: creat d1/d6/d2f/d44/d45/d50/d58/f135 x:0 0 0 2024-03-18T14:43:26.258 INFO:tasks.workunit.client.0.smithi087.stdout:1/979: creat d3/d1d/d1e/d43/dfb/dc8/f12e x:0 0 0 2024-03-18T14:43:26.258 INFO:tasks.workunit.client.1.smithi129.stdout:1/753: dwrite d1/d2/d28/d65/d19/dc9/d56/fd3 [0,4194304] 0 2024-03-18T14:43:26.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/754: stat d1/d2/fbc 0 2024-03-18T14:43:26.261 INFO:tasks.workunit.client.0.smithi087.stdout:6/878: rename d3/d7/d25/d114 to d3/d7/d25/d62/d7c/d29/de7/d130 0 2024-03-18T14:43:26.262 INFO:tasks.workunit.client.0.smithi087.stdout:5/977: chown d13/d1b/d70/dce/ce3 310 1 2024-03-18T14:43:26.264 INFO:tasks.workunit.client.1.smithi129.stdout:6/784: mkdir d3/d6/d7f/dfb 0 2024-03-18T14:43:26.264 INFO:tasks.workunit.client.1.smithi129.stdout:1/755: dwrite d1/d2/d28/d65/d19/f4a [4194304,4194304] 0 2024-03-18T14:43:26.267 INFO:tasks.workunit.client.0.smithi087.stdout:8/913: creat d1/d6/d2f/d44/d45/d72/d7f/ddc/f136 x:0 0 0 2024-03-18T14:43:26.267 INFO:tasks.workunit.client.0.smithi087.stdout:1/980: chown d3/d1d/d1e/d43/d9b/ff1 431 1 2024-03-18T14:43:26.268 INFO:tasks.workunit.client.0.smithi087.stdout:1/981: chown d3/d1d/d1e/d43/dfb/dc8/f10f 1028 1 2024-03-18T14:43:26.270 INFO:tasks.workunit.client.0.smithi087.stdout:2/953: truncate d2/ddd/d22/d24/d65/f6b 507519 0 2024-03-18T14:43:26.272 INFO:tasks.workunit.client.0.smithi087.stdout:6/879: creat d3/d7/d25/d62/d7c/d29/de7/f131 x:0 0 0 2024-03-18T14:43:26.273 INFO:tasks.workunit.client.1.smithi129.stdout:2/810: rename d7/d1f/f52 to d7/d1f/d20/d36/ffc 0 2024-03-18T14:43:26.273 INFO:tasks.workunit.client.0.smithi087.stdout:0/921: getdents d0/dab/d113 0 2024-03-18T14:43:26.274 INFO:tasks.workunit.client.0.smithi087.stdout:0/922: fdatasync d0/d1a/d34/d3d/fc9 0 2024-03-18T14:43:26.275 INFO:tasks.workunit.client.1.smithi129.stdout:4/723: dread d0/d19/d46/f36 [0,4194304] 0 2024-03-18T14:43:26.275 INFO:tasks.workunit.client.1.smithi129.stdout:9/771: mknod d0/db/d6f/dda/cf9 0 2024-03-18T14:43:26.279 INFO:tasks.workunit.client.0.smithi087.stdout:5/978: mknod d13/d1b/d27/d119/c14b 0 2024-03-18T14:43:26.280 INFO:tasks.workunit.client.1.smithi129.stdout:7/777: creat d4/d2d/d2e/d79/dc6/d38/d61/d6a/dba/ff1 x:0 0 0 2024-03-18T14:43:26.280 INFO:tasks.workunit.client.0.smithi087.stdout:5/979: fdatasync d13/d1b/d70/da8/f12c 0 2024-03-18T14:43:26.280 INFO:tasks.workunit.client.0.smithi087.stdout:6/880: creat d3/d7/d25/d62/d7c/da0/d96/f132 x:0 0 0 2024-03-18T14:43:26.281 INFO:tasks.workunit.client.1.smithi129.stdout:6/785: mknod d3/d6/d82/d9a/cfc 0 2024-03-18T14:43:26.281 INFO:tasks.workunit.client.1.smithi129.stdout:5/724: link d0/dc/d18/c33 d0/dc/d4c/cd9 0 2024-03-18T14:43:26.283 INFO:tasks.workunit.client.0.smithi087.stdout:8/914: creat d1/d6/d2f/d44/d45/d72/d7f/d12d/f137 x:0 0 0 2024-03-18T14:43:26.283 INFO:tasks.workunit.client.0.smithi087.stdout:1/982: rmdir d3/d1d/d1e/d43 39 2024-03-18T14:43:26.285 INFO:tasks.workunit.client.1.smithi129.stdout:4/724: mkdir d0/d19/d46/d3e/d21/d4d/d58/d61/dd5/de8 0 2024-03-18T14:43:26.286 INFO:tasks.workunit.client.1.smithi129.stdout:6/786: dwrite d3/d6/d7f/db4/f70 [0,4194304] 0 2024-03-18T14:43:26.287 INFO:tasks.workunit.client.0.smithi087.stdout:8/915: dwrite d1/d6/d2f/d44/d45/fa4 [4194304,4194304] 0 2024-03-18T14:43:26.289 INFO:tasks.workunit.client.0.smithi087.stdout:4/913: getdents d2/db/d82 0 2024-03-18T14:43:26.292 INFO:tasks.workunit.client.1.smithi129.stdout:8/798: dwrite d9/d11/d1a/d32/d3a/f49 [4194304,4194304] 0 2024-03-18T14:43:26.292 INFO:tasks.workunit.client.1.smithi129.stdout:5/725: write d0/dc/d1a/fcf [1347811,39739] 0 2024-03-18T14:43:26.293 INFO:tasks.workunit.client.1.smithi129.stdout:2/811: symlink d7/d1c/lfd 0 2024-03-18T14:43:26.293 INFO:tasks.workunit.client.0.smithi087.stdout:0/923: mknod d0/d1a/d7b/d26/c135 0 2024-03-18T14:43:26.294 INFO:tasks.workunit.client.0.smithi087.stdout:0/924: fsync d0/d2/d4/d27/dc3/dd2/dff/f106 0 2024-03-18T14:43:26.294 INFO:tasks.workunit.client.0.smithi087.stdout:2/954: creat d2/ddd/d22/d2c/d3a/d40/f13b x:0 0 0 2024-03-18T14:43:26.296 INFO:tasks.workunit.client.1.smithi129.stdout:4/725: unlink d0/d19/d46/d3e/d21/l69 0 2024-03-18T14:43:26.296 INFO:tasks.workunit.client.1.smithi129.stdout:0/790: dread d0/d23/d35/f69 [0,4194304] 0 2024-03-18T14:43:26.299 INFO:tasks.workunit.client.0.smithi087.stdout:3/953: sync 2024-03-18T14:43:26.302 INFO:tasks.workunit.client.1.smithi129.stdout:2/812: creat d7/d1f/d20/d36/da9/ffe x:0 0 0 2024-03-18T14:43:26.305 INFO:tasks.workunit.client.1.smithi129.stdout:4/726: creat d0/d9/d6a/fe9 x:0 0 0 2024-03-18T14:43:26.305 INFO:tasks.workunit.client.0.smithi087.stdout:8/916: symlink d1/d6/d2f/d44/d45/d72/db6/l138 0 2024-03-18T14:43:26.306 INFO:tasks.workunit.client.0.smithi087.stdout:6/881: symlink d3/d7/d25/l133 0 2024-03-18T14:43:26.306 INFO:tasks.workunit.client.0.smithi087.stdout:1/983: mkdir d3/d1d/d12f 0 2024-03-18T14:43:26.306 INFO:tasks.workunit.client.1.smithi129.stdout:5/726: symlink d0/lda 0 2024-03-18T14:43:26.306 INFO:tasks.workunit.client.0.smithi087.stdout:0/925: symlink d0/dab/l136 0 2024-03-18T14:43:26.307 INFO:tasks.workunit.client.0.smithi087.stdout:4/914: getdents d2/db/de/df5 0 2024-03-18T14:43:26.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/744: sync 2024-03-18T14:43:26.310 INFO:tasks.workunit.client.0.smithi087.stdout:3/954: link d0/d1c/d25/l108 d0/d3/d4f/d6e/dc8/l125 0 2024-03-18T14:43:26.310 INFO:tasks.workunit.client.0.smithi087.stdout:8/917: chown d1/d6/d2f/d44/d45/d50/f73 216 1 2024-03-18T14:43:26.310 INFO:tasks.workunit.client.0.smithi087.stdout:6/882: write d3/d7/d25/d62/d7c/d29/f27 [938883,6741] 0 2024-03-18T14:43:26.311 INFO:tasks.workunit.client.0.smithi087.stdout:5/980: dwrite d13/d1b/d27/ffe [0,4194304] 0 2024-03-18T14:43:26.311 INFO:tasks.workunit.client.0.smithi087.stdout:3/955: dread - d0/de/d30/fe1 zero size 2024-03-18T14:43:26.311 INFO:tasks.workunit.client.0.smithi087.stdout:1/984: unlink d3/d3c/db8/d8f/dc2/ffe 0 2024-03-18T14:43:26.311 INFO:tasks.workunit.client.1.smithi129.stdout:9/772: truncate d0/db/d2e/f4b 2437478 0 2024-03-18T14:43:26.311 INFO:tasks.workunit.client.1.smithi129.stdout:5/727: dwrite d0/d32/d3a/d52/d69/d8a/fc9 [0,4194304] 0 2024-03-18T14:43:26.312 INFO:tasks.workunit.client.0.smithi087.stdout:6/883: chown d3/d7/d25/f91 1 1 2024-03-18T14:43:26.313 INFO:tasks.workunit.client.0.smithi087.stdout:3/956: chown d0/de/d30/d8e/f120 29841 1 2024-03-18T14:43:26.314 INFO:tasks.workunit.client.0.smithi087.stdout:2/955: rename d2/ddd/d22/d24/f2a to d2/ddd/f13c 0 2024-03-18T14:43:26.314 INFO:tasks.workunit.client.0.smithi087.stdout:6/884: stat d3/d7/d25/d62/d7c/d29/d22/d75/d92 0 2024-03-18T14:43:26.314 INFO:tasks.workunit.client.1.smithi129.stdout:8/799: creat d9/d11/d1a/d32/d41/d4d/d96/dcc/f104 x:0 0 0 2024-03-18T14:43:26.315 INFO:tasks.workunit.client.1.smithi129.stdout:8/800: readlink d9/d11/d1a/d32/l67 0 2024-03-18T14:43:26.315 INFO:tasks.workunit.client.0.smithi087.stdout:4/915: mknod d2/dc2/dce/c12e 0 2024-03-18T14:43:26.316 INFO:tasks.workunit.client.0.smithi087.stdout:3/957: read d0/de/d30/d46/f61 [1895112,90988] 0 2024-03-18T14:43:26.316 INFO:tasks.workunit.client.1.smithi129.stdout:0/791: truncate d0/d23/d6b/f89 2106309 0 2024-03-18T14:43:26.319 INFO:tasks.workunit.client.1.smithi129.stdout:4/727: mkdir d0/d19/d46/d2e/d66/dea 0 2024-03-18T14:43:26.319 INFO:tasks.workunit.client.1.smithi129.stdout:7/778: link d4/d2d/d2e/d79/dc6/l39 d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/lf2 0 2024-03-18T14:43:26.320 INFO:tasks.workunit.client.0.smithi087.stdout:5/981: dread d13/d1b/d7e/f8e [0,4194304] 0 2024-03-18T14:43:26.320 INFO:tasks.workunit.client.0.smithi087.stdout:3/958: dwrite d0/de/d30/d8e/f120 [0,4194304] 0 2024-03-18T14:43:26.320 INFO:tasks.workunit.client.0.smithi087.stdout:8/918: creat d1/d6/d9/f139 x:0 0 0 2024-03-18T14:43:26.321 INFO:tasks.workunit.client.1.smithi129.stdout:3/745: creat d4/dd/db0/ffc x:0 0 0 2024-03-18T14:43:26.321 INFO:tasks.workunit.client.1.smithi129.stdout:6/787: getdents d3/d30/de/d6c/d9e 0 2024-03-18T14:43:26.329 INFO:tasks.workunit.client.0.smithi087.stdout:1/985: chown d3/d1d/d1e/d43/fa5 1233182 1 2024-03-18T14:43:26.332 INFO:tasks.workunit.client.1.smithi129.stdout:5/728: creat d0/d32/d3a/d45/d83/d9b/fdb x:0 0 0 2024-03-18T14:43:26.334 INFO:tasks.workunit.client.1.smithi129.stdout:4/728: chown d0/d19/d46/d3e/d21/d7f/ca2 1 1 2024-03-18T14:43:26.334 INFO:tasks.workunit.client.1.smithi129.stdout:1/756: sync 2024-03-18T14:43:26.334 INFO:tasks.workunit.client.1.smithi129.stdout:3/746: symlink d4/dd/db0/dc3/lfd 0 2024-03-18T14:43:26.335 INFO:tasks.workunit.client.1.smithi129.stdout:4/729: fsync d0/d9/d40/fbd 0 2024-03-18T14:43:26.337 INFO:tasks.workunit.client.0.smithi087.stdout:0/926: getdents d0/d1a/d80/d88 0 2024-03-18T14:43:26.337 INFO:tasks.workunit.client.1.smithi129.stdout:6/788: chown d3/d30/df/d28/d79/daf/lc0 1 1 2024-03-18T14:43:26.337 INFO:tasks.workunit.client.0.smithi087.stdout:6/885: mkdir d3/d7/d25/d62/d7c/d29/d22/d134 0 2024-03-18T14:43:26.338 INFO:tasks.workunit.client.0.smithi087.stdout:4/916: symlink d2/d13/l12f 0 2024-03-18T14:43:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:1/757: write d1/d2/d28/d65/d19/d96/fa4 [88652,101087] 0 2024-03-18T14:43:26.340 INFO:tasks.workunit.client.1.smithi129.stdout:9/773: dread d0/db/d11/d97/dd1/d25/f61 [0,4194304] 0 2024-03-18T14:43:26.341 INFO:tasks.workunit.client.1.smithi129.stdout:8/801: dwrite f6 [4194304,4194304] 0 2024-03-18T14:43:26.343 INFO:tasks.workunit.client.1.smithi129.stdout:7/779: rename d4/d2d/d2e/d79/dc6/d38/d61/d68/fb4 to d4/d2d/d2e/d79/ff3 0 2024-03-18T14:43:26.343 INFO:tasks.workunit.client.0.smithi087.stdout:6/886: rmdir d3/d7/d25/d62/d7c/d46/dc9 39 2024-03-18T14:43:26.344 INFO:tasks.workunit.client.1.smithi129.stdout:0/792: getdents d0/d23 0 2024-03-18T14:43:26.344 INFO:tasks.workunit.client.1.smithi129.stdout:7/780: dread - d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/fc0 zero size 2024-03-18T14:43:26.346 INFO:tasks.workunit.client.1.smithi129.stdout:1/758: stat d1/d2/d28/f51 0 2024-03-18T14:43:26.346 INFO:tasks.workunit.client.1.smithi129.stdout:0/793: write d0/d23/d35/f36 [281709,92293] 0 2024-03-18T14:43:26.354 INFO:tasks.workunit.client.0.smithi087.stdout:1/986: dread d3/d1d/f21 [0,4194304] 0 2024-03-18T14:43:26.356 INFO:tasks.workunit.client.0.smithi087.stdout:5/982: write d13/d1b/d27/d98/dc2/f144 [909464,80286] 0 2024-03-18T14:43:26.356 INFO:tasks.workunit.client.0.smithi087.stdout:3/959: write d0/d3/df/d42/dfc/d106/f11a [454599,104415] 0 2024-03-18T14:43:26.358 INFO:tasks.workunit.client.1.smithi129.stdout:3/747: link d4/d11/d1d/f46 d4/d11/d34/d53/ffe 0 2024-03-18T14:43:26.359 INFO:tasks.workunit.client.0.smithi087.stdout:8/919: rename d1/d6/d2f/d44/dfc/cff to d1/d6/d2f/d44/d45/d72/c13a 0 2024-03-18T14:43:26.359 INFO:tasks.workunit.client.1.smithi129.stdout:4/730: creat d0/d19/d46/d3e/d21/d7f/de2/feb x:0 0 0 2024-03-18T14:43:26.360 INFO:tasks.workunit.client.1.smithi129.stdout:4/731: readlink d0/d19/d46/d3e/d21/d4d/l7a 0 2024-03-18T14:43:26.360 INFO:tasks.workunit.client.0.smithi087.stdout:0/927: creat d0/d2/d4/d8b/d109/f137 x:0 0 0 2024-03-18T14:43:26.361 INFO:tasks.workunit.client.0.smithi087.stdout:2/956: fdatasync d2/ddd/d22/d24/d65/f6b 0 2024-03-18T14:43:26.362 INFO:tasks.workunit.client.1.smithi129.stdout:6/789: link d3/d30/d44/f4a d3/d30/de/d65/d93/dd0/ffd 0 2024-03-18T14:43:26.363 INFO:tasks.workunit.client.0.smithi087.stdout:4/917: symlink d2/dc2/d105/l130 0 2024-03-18T14:43:26.364 INFO:tasks.workunit.client.1.smithi129.stdout:8/802: creat d9/d11/d1a/d32/d41/d4d/d103/f105 x:0 0 0 2024-03-18T14:43:26.364 INFO:tasks.workunit.client.1.smithi129.stdout:5/729: dread d0/dc/d18/d5f/f86 [0,4194304] 0 2024-03-18T14:43:26.364 INFO:tasks.workunit.client.0.smithi087.stdout:5/983: unlink d13/d1b/d27/ce5 0 2024-03-18T14:43:26.367 INFO:tasks.workunit.client.1.smithi129.stdout:2/813: sync 2024-03-18T14:43:26.367 INFO:tasks.workunit.client.0.smithi087.stdout:3/960: mknod d0/de/d30/dc5/c126 0 2024-03-18T14:43:26.368 INFO:tasks.workunit.client.1.smithi129.stdout:4/732: chown d0/d19/d46/d3e/d21/d32/f83 29019 1 2024-03-18T14:43:26.369 INFO:tasks.workunit.client.1.smithi129.stdout:6/790: write d3/d6/d7f/d8f/fef [1694078,10631] 0 2024-03-18T14:43:26.370 INFO:tasks.workunit.client.1.smithi129.stdout:5/730: dwrite d0/d32/d3a/d52/f90 [0,4194304] 0 2024-03-18T14:43:26.371 INFO:tasks.workunit.client.1.smithi129.stdout:1/759: creat d1/d2/d28/d65/fef x:0 0 0 2024-03-18T14:43:26.371 INFO:tasks.workunit.client.1.smithi129.stdout:0/794: dread d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:26.371 INFO:tasks.workunit.client.0.smithi087.stdout:2/957: creat d2/ddd/d22/d2c/d3a/d49/d58/d78/f13d x:0 0 0 2024-03-18T14:43:26.372 INFO:tasks.workunit.client.1.smithi129.stdout:5/731: fsync d0/d32/d34/f3b 0 2024-03-18T14:43:26.373 INFO:tasks.workunit.client.1.smithi129.stdout:7/781: rename d4/d2d/d2e/d79/dc6/d8/fcf to d4/d2d/d2e/d79/dc6/d38/ff4 0 2024-03-18T14:43:26.374 INFO:tasks.workunit.client.1.smithi129.stdout:9/774: getdents d0/db/d11/d97/dd1/d26/d19/d8d 0 2024-03-18T14:43:26.374 INFO:tasks.workunit.client.0.smithi087.stdout:8/920: write d1/d6/d9/d5d/d87/f8a [990047,4032] 0 2024-03-18T14:43:26.374 INFO:tasks.workunit.client.1.smithi129.stdout:7/782: chown d4/d2d/d2e/d45/l4a 24 1 2024-03-18T14:43:26.376 INFO:tasks.workunit.client.1.smithi129.stdout:8/803: mknod d9/d11/d53/d5f/dcb/dd9/c106 0 2024-03-18T14:43:26.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/814: dread d7/d1c/d7b/fd8 [0,4194304] 0 2024-03-18T14:43:26.377 INFO:tasks.workunit.client.1.smithi129.stdout:2/815: chown d7/d1f/d20 201 1 2024-03-18T14:43:26.378 INFO:tasks.workunit.client.1.smithi129.stdout:3/748: rmdir d4/d11/dbb 0 2024-03-18T14:43:26.378 INFO:tasks.workunit.client.0.smithi087.stdout:4/918: unlink d2/db/d24/d30/d7b/d7f/da5/dae/fd6 0 2024-03-18T14:43:26.378 INFO:tasks.workunit.client.0.smithi087.stdout:1/987: write d3/d1d/d79/fd7 [432493,118330] 0 2024-03-18T14:43:26.378 INFO:tasks.workunit.client.0.smithi087.stdout:5/984: fsync d13/d1b/d27/d35/f43 0 2024-03-18T14:43:26.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/791: creat d3/d6/d82/ffe x:0 0 0 2024-03-18T14:43:26.380 INFO:tasks.workunit.client.0.smithi087.stdout:6/887: truncate d3/d7/d25/d62/d7c/d29/de7/f131 290045 0 2024-03-18T14:43:26.380 INFO:tasks.workunit.client.1.smithi129.stdout:0/795: read d0/d23/d6b/f9a [3220912,63499] 0 2024-03-18T14:43:26.382 INFO:tasks.workunit.client.0.smithi087.stdout:6/888: dread d3/d7/f2e [4194304,4194304] 0 2024-03-18T14:43:26.382 INFO:tasks.workunit.client.1.smithi129.stdout:1/760: mknod d1/d2/d28/da7/cf0 0 2024-03-18T14:43:26.383 INFO:tasks.workunit.client.0.smithi087.stdout:2/958: creat d2/ddd/d22/d24/d91/dd7/f13e x:0 0 0 2024-03-18T14:43:26.384 INFO:tasks.workunit.client.1.smithi129.stdout:5/732: creat d0/d32/d3a/d45/d83/d9b/dc4/fdc x:0 0 0 2024-03-18T14:43:26.385 INFO:tasks.workunit.client.0.smithi087.stdout:8/921: dread - d1/d6/d2f/d9b/fbe zero size 2024-03-18T14:43:26.385 INFO:tasks.workunit.client.1.smithi129.stdout:9/775: mkdir d0/db/d11/d97/dd1/d6c/dfa 0 2024-03-18T14:43:26.388 INFO:tasks.workunit.client.1.smithi129.stdout:8/804: creat d9/d11/d18/da4/dd2/f107 x:0 0 0 2024-03-18T14:43:26.389 INFO:tasks.workunit.client.1.smithi129.stdout:3/749: mkdir d4/d11/d34/d3c/d95/dff 0 2024-03-18T14:43:26.390 INFO:tasks.workunit.client.1.smithi129.stdout:0/796: stat d0/d14/f20 0 2024-03-18T14:43:26.390 INFO:tasks.workunit.client.0.smithi087.stdout:4/919: readlink d2/l7 0 2024-03-18T14:43:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:1/761: rmdir d1/d2/d28/d65/d19 39 2024-03-18T14:43:26.391 INFO:tasks.workunit.client.1.smithi129.stdout:0/797: chown d0/d14/f20 12 1 2024-03-18T14:43:26.391 INFO:tasks.workunit.client.0.smithi087.stdout:2/959: rename d2/ddd/d22/d2c/d3a/d40/d4a/d97/c9f to d2/d44/d72/d79/d101/d115/c13f 0 2024-03-18T14:43:26.391 INFO:tasks.workunit.client.0.smithi087.stdout:0/928: creat d0/d2/d4/d27/f138 x:0 0 0 2024-03-18T14:43:26.392 INFO:tasks.workunit.client.0.smithi087.stdout:3/961: truncate d0/f6d 3908128 0 2024-03-18T14:43:26.393 INFO:tasks.workunit.client.0.smithi087.stdout:2/960: read d2/ddd/d22/d24/f10c [545226,81187] 0 2024-03-18T14:43:26.393 INFO:tasks.workunit.client.1.smithi129.stdout:4/733: rename d0/c2a to d0/d9/d85/cec 0 2024-03-18T14:43:26.395 INFO:tasks.workunit.client.0.smithi087.stdout:2/961: read d2/ddd/d22/d24/f139 [1673587,48505] 0 2024-03-18T14:43:26.397 INFO:tasks.workunit.client.0.smithi087.stdout:2/962: fsync d2/ddd/d22/d2c/d3a/d68/f93 0 2024-03-18T14:43:26.397 INFO:tasks.workunit.client.0.smithi087.stdout:5/985: mknod d13/d1b/d27/d8f/dab/d10d/c14c 0 2024-03-18T14:43:26.398 INFO:tasks.workunit.client.0.smithi087.stdout:5/986: readlink d13/d1b/d7e/lef 0 2024-03-18T14:43:26.402 INFO:tasks.workunit.client.1.smithi129.stdout:7/783: unlink d4/d2d/d3a/fa3 0 2024-03-18T14:43:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:2/816: symlink d7/d3f/d5f/dea/lff 0 2024-03-18T14:43:26.403 INFO:tasks.workunit.client.1.smithi129.stdout:5/733: dread d0/d32/d34/f51 [0,4194304] 0 2024-03-18T14:43:26.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/929: symlink d0/d2/d4/de8/dad/dea/d5d/d78/l139 0 2024-03-18T14:43:26.404 INFO:tasks.workunit.client.0.smithi087.stdout:0/930: chown d0/f3 9612 1 2024-03-18T14:43:26.404 INFO:tasks.workunit.client.0.smithi087.stdout:5/987: readlink d13/d1b/d70/dce/lea 0 2024-03-18T14:43:26.405 INFO:tasks.workunit.client.1.smithi129.stdout:8/805: stat d9/d11/d55/d68/cdd 0 2024-03-18T14:43:26.405 INFO:tasks.workunit.client.1.smithi129.stdout:5/734: write d0/d32/d3a/d45/d83/d9b/dc4/fcd [862065,96522] 0 2024-03-18T14:43:26.408 INFO:tasks.workunit.client.1.smithi129.stdout:5/735: write d0/d32/d3a/d52/d69/d8a/fa7 [3801865,77335] 0 2024-03-18T14:43:26.408 INFO:tasks.workunit.client.0.smithi087.stdout:6/889: dread d3/f108 [0,4194304] 0 2024-03-18T14:43:26.409 INFO:tasks.workunit.client.1.smithi129.stdout:2/817: dwrite d7/d1f/d20/d2b/d41/f5d [4194304,4194304] 0 2024-03-18T14:43:26.409 INFO:tasks.workunit.client.1.smithi129.stdout:5/736: dread - d0/d32/d3a/d52/d6e/fc3 zero size 2024-03-18T14:43:26.410 INFO:tasks.workunit.client.0.smithi087.stdout:8/922: dread d1/fd [0,4194304] 0 2024-03-18T14:43:26.411 INFO:tasks.workunit.client.0.smithi087.stdout:5/988: symlink d13/d1b/d27/d28/l14d 0 2024-03-18T14:43:26.413 INFO:tasks.workunit.client.0.smithi087.stdout:2/963: rename d2/ddd/d22/d2c/d3a/d68/lcc to d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d130/l140 0 2024-03-18T14:43:26.414 INFO:tasks.workunit.client.1.smithi129.stdout:6/792: dwrite d3/d30/df/f42 [0,4194304] 0 2024-03-18T14:43:26.415 INFO:tasks.workunit.client.0.smithi087.stdout:3/962: dread d0/d1c/f5b [0,4194304] 0 2024-03-18T14:43:26.415 INFO:tasks.workunit.client.0.smithi087.stdout:6/890: creat d3/d7/d25/d62/d7c/d29/d22/d75/f135 x:0 0 0 2024-03-18T14:43:26.416 INFO:tasks.workunit.client.0.smithi087.stdout:0/931: truncate d0/d2/d4/f65 197860 0 2024-03-18T14:43:26.416 INFO:tasks.workunit.client.1.smithi129.stdout:9/776: dwrite d0/d15/dd7/ff8 [0,4194304] 0 2024-03-18T14:43:26.417 INFO:tasks.workunit.client.1.smithi129.stdout:9/777: chown d0/db/d2e/d9f/dcb/de0/f54 45166382 1 2024-03-18T14:43:26.417 INFO:tasks.workunit.client.1.smithi129.stdout:8/806: mknod d9/d11/db3/c108 0 2024-03-18T14:43:26.418 INFO:tasks.workunit.client.1.smithi129.stdout:9/778: chown d0/db/d11/d97/dd1/d25/fdd 439 1 2024-03-18T14:43:26.419 INFO:tasks.workunit.client.0.smithi087.stdout:3/963: dwrite d0/de/d30/d67/ff6 [0,4194304] 0 2024-03-18T14:43:26.419 INFO:tasks.workunit.client.0.smithi087.stdout:5/989: rename ca to d13/d1b/d27/d35/dc6/dd6/d13e/c14e 0 2024-03-18T14:43:26.420 INFO:tasks.workunit.client.1.smithi129.stdout:3/750: write d4/d38/da3/dc9/fe3 [221406,80335] 0 2024-03-18T14:43:26.420 INFO:tasks.workunit.client.0.smithi087.stdout:3/964: dread - d0/f107 zero size 2024-03-18T14:43:26.424 INFO:tasks.workunit.client.1.smithi129.stdout:9/779: dwrite d0/db/f18 [4194304,4194304] 0 2024-03-18T14:43:26.424 INFO:tasks.workunit.client.1.smithi129.stdout:0/798: dwrite d0/d23/d35/f69 [4194304,4194304] 0 2024-03-18T14:43:26.424 INFO:tasks.workunit.client.0.smithi087.stdout:0/932: dread d0/d1a/de6/f117 [0,4194304] 0 2024-03-18T14:43:26.424 INFO:tasks.workunit.client.0.smithi087.stdout:2/964: dwrite d2/d44/d72/d79/f9c [0,4194304] 0 2024-03-18T14:43:26.425 INFO:tasks.workunit.client.0.smithi087.stdout:6/891: rename d3/d7/d25/d62/d7c/d29/d7d/fcf to d3/d7/dbd/f136 0 2024-03-18T14:43:26.426 INFO:tasks.workunit.client.1.smithi129.stdout:5/737: rename d0/d32/d3a/d52/d69/d8a to d0/dc/d4c/ddd 0 2024-03-18T14:43:26.427 INFO:tasks.workunit.client.0.smithi087.stdout:5/990: rmdir d13/d1b/d30 39 2024-03-18T14:43:26.428 INFO:tasks.workunit.client.1.smithi129.stdout:1/762: mknod d1/d2/d28/d65/d19/dc9/d87/dc0/cf1 0 2024-03-18T14:43:26.430 INFO:tasks.workunit.client.1.smithi129.stdout:9/780: dwrite d0/db/d2e/d9f/dcb/de0/f47 [4194304,4194304] 0 2024-03-18T14:43:26.430 INFO:tasks.workunit.client.0.smithi087.stdout:3/965: dread d0/de/d30/d46/f61 [0,4194304] 0 2024-03-18T14:43:26.431 INFO:tasks.workunit.client.1.smithi129.stdout:9/781: chown d0/db/d11/d97/dd1/d26/c31 459309 1 2024-03-18T14:43:26.432 INFO:tasks.workunit.client.0.smithi087.stdout:8/923: getdents d1/d6/d2f/d44/d45 0 2024-03-18T14:43:26.433 INFO:tasks.workunit.client.0.smithi087.stdout:0/933: rmdir d0/d1a/d7b/d26/d79 39 2024-03-18T14:43:26.434 INFO:tasks.workunit.client.0.smithi087.stdout:0/934: write d0/d2/d3c/f58 [869798,55117] 0 2024-03-18T14:43:26.436 INFO:tasks.workunit.client.0.smithi087.stdout:5/991: dwrite d13/d1b/d30/d6e/d88/f12f [0,4194304] 0 2024-03-18T14:43:26.438 INFO:tasks.workunit.client.0.smithi087.stdout:6/892: mkdir d3/d7/d25/d62/d7c/d29/d22/d134/d137 0 2024-03-18T14:43:26.438 INFO:tasks.workunit.client.0.smithi087.stdout:2/965: rename d2/ddd/d22/d24/fce to d2/ddd/dca/f141 0 2024-03-18T14:43:26.438 INFO:tasks.workunit.client.1.smithi129.stdout:0/799: write d0/d14/d91/fc7 [2973852,38994] 0 2024-03-18T14:43:26.439 INFO:tasks.workunit.client.0.smithi087.stdout:0/935: rmdir d0/d1a/de6 39 2024-03-18T14:43:26.439 INFO:tasks.workunit.client.1.smithi129.stdout:5/738: fdatasync d0/d32/d34/f51 0 2024-03-18T14:43:26.440 INFO:tasks.workunit.client.1.smithi129.stdout:5/739: read - d0/dc/d1a/d61/faf zero size 2024-03-18T14:43:26.443 INFO:tasks.workunit.client.1.smithi129.stdout:3/751: dread - d4/d11/d34/d3c/d3f/fbe zero size 2024-03-18T14:43:26.444 INFO:tasks.workunit.client.1.smithi129.stdout:3/752: readlink d4/d11/lf2 0 2024-03-18T14:43:26.446 INFO:tasks.workunit.client.0.smithi087.stdout:5/992: fsync d13/d1b/d27/d35/d3b/fd2 0 2024-03-18T14:43:26.447 INFO:tasks.workunit.client.1.smithi129.stdout:0/800: rename d0/d23/d29/c2b to d0/d23/d35/d50/da5/cf3 0 2024-03-18T14:43:26.447 INFO:tasks.workunit.client.1.smithi129.stdout:1/763: mkdir d1/dbf/dce/df2 0 2024-03-18T14:43:26.448 INFO:tasks.workunit.client.1.smithi129.stdout:0/801: fdatasync d0/d14/d28/fa8 0 2024-03-18T14:43:26.448 INFO:tasks.workunit.client.0.smithi087.stdout:5/993: write d13/d1b/d30/d6e/d88/fe9 [1947215,115244] 0 2024-03-18T14:43:26.449 INFO:tasks.workunit.client.0.smithi087.stdout:3/966: rename d0/d3/df/d42/l4a to d0/d3/d7a/dea/l127 0 2024-03-18T14:43:26.452 INFO:tasks.workunit.client.1.smithi129.stdout:9/782: read d0/db/d11/d97/dd1/d25/d8e/f67 [79852,16422] 0 2024-03-18T14:43:26.453 INFO:tasks.workunit.client.0.smithi087.stdout:2/966: chown d2/ddd/c134 25487515 1 2024-03-18T14:43:26.453 INFO:tasks.workunit.client.0.smithi087.stdout:5/994: dwrite d13/d1b/d27/d35/d3b/f127 [0,4194304] 0 2024-03-18T14:43:26.453 INFO:tasks.workunit.client.0.smithi087.stdout:0/936: mknod d0/d1a/d7b/d2a/c13a 0 2024-03-18T14:43:26.454 INFO:tasks.workunit.client.1.smithi129.stdout:6/793: truncate d3/d30/de/d49/fe4 587485 0 2024-03-18T14:43:26.456 INFO:tasks.workunit.client.0.smithi087.stdout:1/988: sync 2024-03-18T14:43:26.464 INFO:tasks.workunit.client.1.smithi129.stdout:5/740: symlink d0/d32/d34/d9f/lde 0 2024-03-18T14:43:26.464 INFO:tasks.workunit.client.1.smithi129.stdout:3/753: creat d4/d11/d34/d3c/d95/dff/f100 x:0 0 0 2024-03-18T14:43:26.465 INFO:tasks.workunit.client.1.smithi129.stdout:9/783: mknod d0/db/d1f/dae/df2/cfb 0 2024-03-18T14:43:26.465 INFO:tasks.workunit.client.1.smithi129.stdout:7/784: write d4/d2d/d2e/d79/dc6/d38/d61/d6a/fe7 [901314,89121] 0 2024-03-18T14:43:26.466 INFO:tasks.workunit.client.0.smithi087.stdout:6/893: write d3/d7/d25/d62/d7c/d46/dc9/fdf [3411351,118485] 0 2024-03-18T14:43:26.466 INFO:tasks.workunit.client.1.smithi129.stdout:5/741: write d0/dc/d18/d2b/d71/fd1 [1038364,73762] 0 2024-03-18T14:43:26.466 INFO:tasks.workunit.client.1.smithi129.stdout:1/764: stat d1/d35/d7a/ca8 0 2024-03-18T14:43:26.467 INFO:tasks.workunit.client.1.smithi129.stdout:4/734: sync 2024-03-18T14:43:26.468 INFO:tasks.workunit.client.1.smithi129.stdout:0/802: mknod d0/cf4 0 2024-03-18T14:43:26.469 INFO:tasks.workunit.client.1.smithi129.stdout:8/807: getdents d9/d11/d55/d68/d72/d90 0 2024-03-18T14:43:26.470 INFO:tasks.workunit.client.0.smithi087.stdout:0/937: read d0/d1a/d7b/d26/f2c [3047946,11109] 0 2024-03-18T14:43:26.472 INFO:tasks.workunit.client.0.smithi087.stdout:2/967: symlink d2/ddd/l142 0 2024-03-18T14:43:26.473 INFO:tasks.workunit.client.1.smithi129.stdout:0/803: dwrite d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:26.473 INFO:tasks.workunit.client.0.smithi087.stdout:4/920: sync 2024-03-18T14:43:26.474 INFO:tasks.workunit.client.1.smithi129.stdout:0/804: stat d0/f95 0 2024-03-18T14:43:26.474 INFO:tasks.workunit.client.0.smithi087.stdout:4/921: dread - d2/db/de/d8b/f124 zero size 2024-03-18T14:43:26.476 INFO:tasks.workunit.client.1.smithi129.stdout:1/765: dread d1/d2/d28/f51 [0,4194304] 0 2024-03-18T14:43:26.476 INFO:tasks.workunit.client.1.smithi129.stdout:1/766: fdatasync d1/d2/d28/d65/d19/dc9/fbb 0 2024-03-18T14:43:26.478 INFO:tasks.workunit.client.0.smithi087.stdout:8/924: rename d1/d6/d2f/d44/d4b/da5/l105 to d1/d6/d9/d5d/d87/l13b 0 2024-03-18T14:43:26.478 INFO:tasks.workunit.client.1.smithi129.stdout:1/767: write d1/d2/d28/d65/d19/dc9/fb9 [3825894,98444] 0 2024-03-18T14:43:26.478 INFO:tasks.workunit.client.1.smithi129.stdout:3/754: rename d4/d11/d1d/d50/def to d4/dd/d1f/d5f/d8c/d101 0 2024-03-18T14:43:26.478 INFO:tasks.workunit.client.0.smithi087.stdout:8/925: chown d1/d6/d2f/d44/dfc 5674 1 2024-03-18T14:43:26.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/805: symlink d0/d23/d6b/lf5 0 2024-03-18T14:43:26.480 INFO:tasks.workunit.client.0.smithi087.stdout:2/968: write d2/ddd/f34 [1935211,101262] 0 2024-03-18T14:43:26.482 INFO:tasks.workunit.client.0.smithi087.stdout:2/969: write d2/ddd/d22/d2c/d3a/d76/d9a/db5/ff7 [3703467,129307] 0 2024-03-18T14:43:26.482 INFO:tasks.workunit.client.0.smithi087.stdout:4/922: symlink d2/db/d24/d30/d7b/d7f/d112/l131 0 2024-03-18T14:43:26.482 INFO:tasks.workunit.client.1.smithi129.stdout:5/742: getdents d0/d32/d3a/d45/d83/dc8 0 2024-03-18T14:43:26.483 INFO:tasks.workunit.client.0.smithi087.stdout:2/970: stat d2/ddd/d22/d24/d91/dd7/f13e 0 2024-03-18T14:43:26.492 INFO:tasks.workunit.client.1.smithi129.stdout:1/768: mkdir d1/d2/d28/d65/d19/d52/df3 0 2024-03-18T14:43:26.492 INFO:tasks.workunit.client.0.smithi087.stdout:8/926: write d1/d6/d9/d5d/d87/da2/df0/ffb [1483457,39794] 0 2024-03-18T14:43:26.492 INFO:tasks.workunit.client.0.smithi087.stdout:1/989: dread d3/d1d/d45/fae [0,4194304] 0 2024-03-18T14:43:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:2/818: sync 2024-03-18T14:43:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:2/819: fsync d7/d1f/d20/d2a/f7a 0 2024-03-18T14:43:26.494 INFO:tasks.workunit.client.1.smithi129.stdout:6/794: truncate d3/d6/d7f/db4/fc8 2427387 0 2024-03-18T14:43:26.495 INFO:tasks.workunit.client.1.smithi129.stdout:3/755: mknod d4/dd/d1f/d5f/d8c/d101/c102 0 2024-03-18T14:43:26.495 INFO:tasks.workunit.client.1.smithi129.stdout:6/795: stat d3/d30/de/d49/ca7 0 2024-03-18T14:43:26.496 INFO:tasks.workunit.client.1.smithi129.stdout:0/806: mknod d0/d14/d28/d63/d8d/cf6 0 2024-03-18T14:43:26.496 INFO:tasks.workunit.client.0.smithi087.stdout:8/927: dwrite d1/faf [0,4194304] 0 2024-03-18T14:43:26.497 INFO:tasks.workunit.client.0.smithi087.stdout:5/995: link d13/c3d d13/d1b/d27/d28/c14f 0 2024-03-18T14:43:26.498 INFO:tasks.workunit.client.0.smithi087.stdout:5/996: write d13/d1b/d70/f12b [558199,31977] 0 2024-03-18T14:43:26.500 INFO:tasks.workunit.client.0.smithi087.stdout:2/971: write d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/f116 [1738501,69945] 0 2024-03-18T14:43:26.502 INFO:tasks.workunit.client.1.smithi129.stdout:7/785: link d4/d2d/d2e/fe1 d4/d2d/d2e/d79/dc6/ff5 0 2024-03-18T14:43:26.504 INFO:tasks.workunit.client.0.smithi087.stdout:2/972: dread - d2/ddd/d22/d2c/d3a/d40/d4a/d97/fea zero size 2024-03-18T14:43:26.504 INFO:tasks.workunit.client.0.smithi087.stdout:3/967: dwrite d0/d3/d10/da5/dce/d122/fcb [0,4194304] 0 2024-03-18T14:43:26.505 INFO:tasks.workunit.client.1.smithi129.stdout:5/743: rename d0/d32/d3a/d45/d83/d9b to d0/d32/d3a/d45/d83/ddf 0 2024-03-18T14:43:26.505 INFO:tasks.workunit.client.1.smithi129.stdout:9/784: link d0/db/d2e/d9f/dcb/de0/cca d0/db/d11/d97/dd1/d6c/dd4/cfc 0 2024-03-18T14:43:26.505 INFO:tasks.workunit.client.0.smithi087.stdout:3/968: chown d0/d3/fda 965482028 1 2024-03-18T14:43:26.505 INFO:tasks.workunit.client.0.smithi087.stdout:6/894: dwrite d3/d7/dbd/fca [0,4194304] 0 2024-03-18T14:43:26.508 INFO:tasks.workunit.client.0.smithi087.stdout:1/990: rmdir d3/d1d/d1e/d20 39 2024-03-18T14:43:26.509 INFO:tasks.workunit.client.0.smithi087.stdout:4/923: fdatasync d2/d13/d28/f40 0 2024-03-18T14:43:26.511 INFO:tasks.workunit.client.0.smithi087.stdout:8/928: write d1/d6/d2f/d44/dfc/f11c [995820,80194] 0 2024-03-18T14:43:26.511 INFO:tasks.workunit.client.0.smithi087.stdout:4/924: chown d2/db/d24/d30/d56/cd3 23622 1 2024-03-18T14:43:26.513 INFO:tasks.workunit.client.1.smithi129.stdout:1/769: creat d1/db2/de2/d80/ff4 x:0 0 0 2024-03-18T14:43:26.513 INFO:tasks.workunit.client.0.smithi087.stdout:6/895: write d3/f108 [4815873,78627] 0 2024-03-18T14:43:26.514 INFO:tasks.workunit.client.1.smithi129.stdout:3/756: dread d4/fb [0,4194304] 0 2024-03-18T14:43:26.514 INFO:tasks.workunit.client.1.smithi129.stdout:9/785: dwrite d0/db/fb5 [4194304,4194304] 0 2024-03-18T14:43:26.516 INFO:tasks.workunit.client.1.smithi129.stdout:6/796: creat d3/d30/de/d6c/d9e/db6/fff x:0 0 0 2024-03-18T14:43:26.516 INFO:tasks.workunit.client.0.smithi087.stdout:5/997: link d13/d1b/f10e d13/d1b/d27/d28/d9a/df0/f150 0 2024-03-18T14:43:26.517 INFO:tasks.workunit.client.1.smithi129.stdout:6/797: write d3/d6/d7f/d8f/fef [1229935,120442] 0 2024-03-18T14:43:26.518 INFO:tasks.workunit.client.1.smithi129.stdout:4/735: fdatasync d0/d19/d46/d3e/fe3 0 2024-03-18T14:43:26.519 INFO:tasks.workunit.client.0.smithi087.stdout:8/929: creat d1/d6/d2f/d9b/f13c x:0 0 0 2024-03-18T14:43:26.519 INFO:tasks.workunit.client.1.smithi129.stdout:7/786: mkdir d4/d2d/d2e/d79/dc6/d8/d3b/df6 0 2024-03-18T14:43:26.520 INFO:tasks.workunit.client.0.smithi087.stdout:8/930: fsync d1/d6/d2f/d44/d4b/f86 0 2024-03-18T14:43:26.520 INFO:tasks.workunit.client.1.smithi129.stdout:2/820: dread d7/d1f/d20/d36/f6d [0,4194304] 0 2024-03-18T14:43:26.522 INFO:tasks.workunit.client.1.smithi129.stdout:8/808: link d9/d11/f78 d9/d33/dc2/ddc/f109 0 2024-03-18T14:43:26.523 INFO:tasks.workunit.client.1.smithi129.stdout:8/809: chown d9/d11/d1a/d32/d3a/d9a 2031078 1 2024-03-18T14:43:26.524 INFO:tasks.workunit.client.0.smithi087.stdout:8/931: mkdir d1/d6/d2f/d44/d45/d72/db6/d13d 0 2024-03-18T14:43:26.524 INFO:tasks.workunit.client.0.smithi087.stdout:0/938: sync 2024-03-18T14:43:26.525 INFO:tasks.workunit.client.1.smithi129.stdout:1/770: truncate d1/d2/d28/f51 1572692 0 2024-03-18T14:43:26.526 INFO:tasks.workunit.client.0.smithi087.stdout:5/998: creat d13/d1b/d27/d35/f151 x:0 0 0 2024-03-18T14:43:26.528 INFO:tasks.workunit.client.0.smithi087.stdout:0/939: dread - d0/d2/d6b/fe5 zero size 2024-03-18T14:43:26.529 INFO:tasks.workunit.client.0.smithi087.stdout:8/932: mkdir d1/d6/d2f/d44/d45/d72/d7f/ddc/d13e 0 2024-03-18T14:43:26.530 INFO:tasks.workunit.client.0.smithi087.stdout:1/991: write d3/d1d/d1f/f75 [142348,32488] 0 2024-03-18T14:43:26.531 INFO:tasks.workunit.client.0.smithi087.stdout:5/999: dwrite d13/d1b/d70/f12b [0,4194304] 0 2024-03-18T14:43:26.532 INFO:tasks.workunit.client.0.smithi087.stdout:1/992: write d3/d1d/d1f/f70 [7641865,14814] 0 2024-03-18T14:43:26.534 INFO:tasks.workunit.client.0.smithi087.stdout:0/940: chown d0/d1a/d34/d3d/c67 26 1 2024-03-18T14:43:26.534 INFO:tasks.workunit.client.0.smithi087.stdout:3/969: dwrite d0/d3/d10/f75 [0,4194304] 0 2024-03-18T14:43:26.535 INFO:tasks.workunit.client.0.smithi087.stdout:8/933: creat d1/d6/d103/f13f x:0 0 0 2024-03-18T14:43:26.536 INFO:tasks.workunit.client.0.smithi087.stdout:8/934: write d1/d6/d9/d5d/d87/fb9 [817774,14709] 0 2024-03-18T14:43:26.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/993: symlink d3/d1d/d1e/d43/da3/dc3/l130 0 2024-03-18T14:43:26.539 INFO:tasks.workunit.client.0.smithi087.stdout:1/994: readlink d3/l60 0 2024-03-18T14:43:26.540 INFO:tasks.workunit.client.0.smithi087.stdout:3/970: symlink d0/d3/d4f/d6e/l128 0 2024-03-18T14:43:26.540 INFO:tasks.workunit.client.0.smithi087.stdout:2/973: dread d2/ddd/d22/d2c/d3a/d40/d52/fae [0,4194304] 0 2024-03-18T14:43:26.540 INFO:tasks.workunit.client.0.smithi087.stdout:3/971: fsync d0/f52 0 2024-03-18T14:43:26.540 INFO:tasks.workunit.client.0.smithi087.stdout:8/935: fdatasync d1/d6/ff2 0 2024-03-18T14:43:26.543 INFO:tasks.workunit.client.0.smithi087.stdout:1/995: rmdir d3/d3c/db8 39 2024-03-18T14:43:26.544 INFO:tasks.workunit.client.0.smithi087.stdout:6/896: write d3/f19 [959580,98733] 0 2024-03-18T14:43:26.546 INFO:tasks.workunit.client.0.smithi087.stdout:6/897: write d3/d7/d25/d62/d7c/da0/f10c [20659,68587] 0 2024-03-18T14:43:26.547 INFO:tasks.workunit.client.0.smithi087.stdout:3/972: mknod d0/d3/df/d9a/c129 0 2024-03-18T14:43:26.549 INFO:tasks.workunit.client.0.smithi087.stdout:1/996: unlink d3/d1d/d79/f8d 0 2024-03-18T14:43:26.551 INFO:tasks.workunit.client.0.smithi087.stdout:0/941: rename d0/d1a/d7b/d2a/d9a/cb2 to d0/d1a/d7b/d26/c13b 0 2024-03-18T14:43:26.553 INFO:tasks.workunit.client.0.smithi087.stdout:4/925: write d2/db/d24/d30/d56/f8c [3713693,25959] 0 2024-03-18T14:43:26.556 INFO:tasks.workunit.client.0.smithi087.stdout:0/942: mknod d0/d1a/d7b/d2a/d9a/c13c 0 2024-03-18T14:43:26.557 INFO:tasks.workunit.client.1.smithi129.stdout:2/821: symlink d7/d1c/d79/l100 0 2024-03-18T14:43:26.557 INFO:tasks.workunit.client.0.smithi087.stdout:2/974: dread d2/ddd/d22/d24/d65/f6b [0,4194304] 0 2024-03-18T14:43:26.558 INFO:tasks.workunit.client.1.smithi129.stdout:9/786: dread d0/db/d11/d97/dd1/d26/d19/d8d/fa8 [0,4194304] 0 2024-03-18T14:43:26.560 INFO:tasks.workunit.client.1.smithi129.stdout:8/810: dwrite d9/d11/d1a/d14/dc0/fba [0,4194304] 0 2024-03-18T14:43:26.560 INFO:tasks.workunit.client.1.smithi129.stdout:1/771: creat d1/d2/d28/d65/d19/dc9/d71/ff5 x:0 0 0 2024-03-18T14:43:26.560 INFO:tasks.workunit.client.0.smithi087.stdout:6/898: rename d3/d7/d25/d62/d7c/d29/de7/f131 to d3/d7/d25/d62/d7c/d46/d121/f138 0 2024-03-18T14:43:26.561 INFO:tasks.workunit.client.1.smithi129.stdout:6/798: truncate d3/d5/d46/fc1 212304 0 2024-03-18T14:43:26.562 INFO:tasks.workunit.client.0.smithi087.stdout:2/975: dwrite d2/ddd/d5a/d10f/f136 [0,4194304] 0 2024-03-18T14:43:26.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/822: mknod d7/d1f/d20/d36/da9/dc1/da5/c101 0 2024-03-18T14:43:26.564 INFO:tasks.workunit.client.0.smithi087.stdout:8/936: write d1/f1b [1953838,64062] 0 2024-03-18T14:43:26.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/997: mkdir d3/d1d/d1e/d20/d131 0 2024-03-18T14:43:26.565 INFO:tasks.workunit.client.1.smithi129.stdout:1/772: mkdir d1/d35/db8/dc6/df6 0 2024-03-18T14:43:26.565 INFO:tasks.workunit.client.0.smithi087.stdout:1/998: write d3/f4e [3622473,70194] 0 2024-03-18T14:43:26.566 INFO:tasks.workunit.client.1.smithi129.stdout:3/757: dwrite d4/d11/d34/d4c/f5d [0,4194304] 0 2024-03-18T14:43:26.566 INFO:tasks.workunit.client.0.smithi087.stdout:1/999: read - d3/d1d/d1e/d43/dfb/dc8/f12e zero size 2024-03-18T14:43:26.567 INFO:tasks.workunit.client.1.smithi129.stdout:5/744: dwrite d0/f4 [0,4194304] 0 2024-03-18T14:43:26.569 INFO:tasks.workunit.client.1.smithi129.stdout:5/745: dread - d0/dc/d1a/d61/f8b zero size 2024-03-18T14:43:26.569 INFO:tasks.workunit.client.0.smithi087.stdout:4/926: symlink d2/l132 0 2024-03-18T14:43:26.570 INFO:tasks.workunit.client.1.smithi129.stdout:9/787: truncate d0/d15/f7a 1182688 0 2024-03-18T14:43:26.571 INFO:tasks.workunit.client.1.smithi129.stdout:2/823: dwrite d7/d1f/d20/d2d/f44 [0,4194304] 0 2024-03-18T14:43:26.572 INFO:tasks.workunit.client.1.smithi129.stdout:0/807: sync 2024-03-18T14:43:26.572 INFO:tasks.workunit.client.0.smithi087.stdout:3/973: dwrite d0/d72/f99 [0,4194304] 0 2024-03-18T14:43:26.572 INFO:tasks.workunit.client.1.smithi129.stdout:2/824: fdatasync d7/d1f/d20/d72/fdc 0 2024-03-18T14:43:26.574 INFO:tasks.workunit.client.1.smithi129.stdout:0/808: chown d0/d23/d35/d3b/d42/dc0/fdb 3 1 2024-03-18T14:43:26.574 INFO:tasks.workunit.client.1.smithi129.stdout:2/825: write d7/d1f/d81/fcc [1581445,7086] 0 2024-03-18T14:43:26.578 INFO:tasks.workunit.client.0.smithi087.stdout:8/937: mkdir d1/d6/d2f/d44/d140 0 2024-03-18T14:43:26.578 INFO:tasks.workunit.client.0.smithi087.stdout:0/943: dread d0/d1a/d7b/d2a/f52 [0,4194304] 0 2024-03-18T14:43:26.578 INFO:tasks.workunit.client.1.smithi129.stdout:3/758: mknod d4/d11/d1d/c103 0 2024-03-18T14:43:26.579 INFO:tasks.workunit.client.1.smithi129.stdout:7/787: link d4/d2d/d2e/d45/la7 d4/d2d/d2e/d79/dc6/lf7 0 2024-03-18T14:43:26.579 INFO:tasks.workunit.client.1.smithi129.stdout:3/759: chown d4/d11/d34/d53/c60 129705997 1 2024-03-18T14:43:26.581 INFO:tasks.workunit.client.0.smithi087.stdout:2/976: rmdir d2/ddd/d5a/de1 0 2024-03-18T14:43:26.582 INFO:tasks.workunit.client.1.smithi129.stdout:5/746: mkdir d0/dc/d1a/d61/d94/de0 0 2024-03-18T14:43:26.582 INFO:tasks.workunit.client.0.smithi087.stdout:8/938: rmdir d1/d6/d2f/d44/d45/d50 39 2024-03-18T14:43:26.583 INFO:tasks.workunit.client.0.smithi087.stdout:0/944: truncate d0/d2/d6b/fe5 58812 0 2024-03-18T14:43:26.584 INFO:tasks.workunit.client.0.smithi087.stdout:2/977: truncate d2/d44/d72/d79/fb0 1202195 0 2024-03-18T14:43:26.585 INFO:tasks.workunit.client.0.smithi087.stdout:2/978: dread - d2/ddd/d22/d2c/fa9 zero size 2024-03-18T14:43:26.586 INFO:tasks.workunit.client.1.smithi129.stdout:2/826: fdatasync d7/d1f/d20/d2d/fb7 0 2024-03-18T14:43:26.587 INFO:tasks.workunit.client.0.smithi087.stdout:0/945: creat d0/d2/d4/d8b/d109/f13d x:0 0 0 2024-03-18T14:43:26.587 INFO:tasks.workunit.client.0.smithi087.stdout:3/974: read d0/d3/df/f33 [3472082,19719] 0 2024-03-18T14:43:26.588 INFO:tasks.workunit.client.0.smithi087.stdout:2/979: creat d2/ddd/d22/d2c/d3a/d40/d98/f143 x:0 0 0 2024-03-18T14:43:26.591 INFO:tasks.workunit.client.1.smithi129.stdout:3/760: unlink d4/d11/l22 0 2024-03-18T14:43:26.592 INFO:tasks.workunit.client.1.smithi129.stdout:3/761: write d4/d11/d34/d3c/fd2 [378141,29850] 0 2024-03-18T14:43:26.594 INFO:tasks.workunit.client.0.smithi087.stdout:2/980: rmdir d2/ddd 39 2024-03-18T14:43:26.594 INFO:tasks.workunit.client.1.smithi129.stdout:9/788: rename d0/db/d90/d70/d93/la5 to d0/db/d1f/d4c/d57/lfd 0 2024-03-18T14:43:26.594 INFO:tasks.workunit.client.1.smithi129.stdout:4/736: sync 2024-03-18T14:43:26.594 INFO:tasks.workunit.client.0.smithi087.stdout:0/946: dread d0/d1a/d7b/d26/f4b [0,4194304] 0 2024-03-18T14:43:26.596 INFO:tasks.workunit.client.1.smithi129.stdout:1/773: creat d1/d2/d28/d65/d19/ff7 x:0 0 0 2024-03-18T14:43:26.597 INFO:tasks.workunit.client.1.smithi129.stdout:2/827: mknod d7/d1f/d20/d2b/d41/d65/d88/c102 0 2024-03-18T14:43:26.597 INFO:tasks.workunit.client.1.smithi129.stdout:7/788: getdents d4/d2d/d2e/d79/dc6/d8/d3b/df6 0 2024-03-18T14:43:26.598 INFO:tasks.workunit.client.0.smithi087.stdout:3/975: link d0/d3/d10/c17 d0/d3/d10/da5/dce/d122/c12a 0 2024-03-18T14:43:26.598 INFO:tasks.workunit.client.1.smithi129.stdout:3/762: mknod d4/d11/d34/df8/dd4/c104 0 2024-03-18T14:43:26.599 INFO:tasks.workunit.client.1.smithi129.stdout:3/763: fdatasync d4/d11/d34/d3c/d95/dff/f100 0 2024-03-18T14:43:26.599 INFO:tasks.workunit.client.0.smithi087.stdout:0/947: link d0/d2/d4/d19/f10d d0/d2/d4/d19/f13e 0 2024-03-18T14:43:26.602 INFO:tasks.workunit.client.0.smithi087.stdout:3/976: dwrite d0/de/d30/d67/f79 [0,4194304] 0 2024-03-18T14:43:26.603 INFO:tasks.workunit.client.1.smithi129.stdout:9/789: rename d0/f5 to d0/db/d2e/d9d/dbb/ffe 0 2024-03-18T14:43:26.606 INFO:tasks.workunit.client.1.smithi129.stdout:2/828: symlink d7/d1f/d20/d2a/d6b/l103 0 2024-03-18T14:43:26.607 INFO:tasks.workunit.client.1.smithi129.stdout:5/747: creat d0/d32/fe1 x:0 0 0 2024-03-18T14:43:26.609 INFO:tasks.workunit.client.1.smithi129.stdout:4/737: symlink d0/d9/d4c/dca/led 0 2024-03-18T14:43:26.610 INFO:tasks.workunit.client.0.smithi087.stdout:6/899: truncate d3/d7/d25/d62/d7c/d29/fd8 1141921 0 2024-03-18T14:43:26.610 INFO:tasks.workunit.client.1.smithi129.stdout:9/790: rmdir d0/db/d11/d97/dd1/d25 39 2024-03-18T14:43:26.611 INFO:tasks.workunit.client.0.smithi087.stdout:3/977: dread d0/de/d30/d46/f68 [0,4194304] 0 2024-03-18T14:43:26.611 INFO:tasks.workunit.client.0.smithi087.stdout:6/900: chown d3/d7/ff1 231668524 1 2024-03-18T14:43:26.611 INFO:tasks.workunit.client.0.smithi087.stdout:4/927: dread d2/db/d24/d30/f5c [0,4194304] 0 2024-03-18T14:43:26.612 INFO:tasks.workunit.client.1.smithi129.stdout:0/809: dread d0/d14/f5f [0,4194304] 0 2024-03-18T14:43:26.612 INFO:tasks.workunit.client.1.smithi129.stdout:1/774: dread d1/d2/f3b [0,4194304] 0 2024-03-18T14:43:26.614 INFO:tasks.workunit.client.1.smithi129.stdout:6/799: truncate d3/d6/d7f/db4/fb5 1065058 0 2024-03-18T14:43:26.615 INFO:tasks.workunit.client.1.smithi129.stdout:3/764: dread d4/d11/d34/d53/f80 [0,4194304] 0 2024-03-18T14:43:26.615 INFO:tasks.workunit.client.1.smithi129.stdout:7/789: creat d4/d83/ff8 x:0 0 0 2024-03-18T14:43:26.616 INFO:tasks.workunit.client.1.smithi129.stdout:5/748: dwrite d0/dc/d22/f35 [0,4194304] 0 2024-03-18T14:43:26.616 INFO:tasks.workunit.client.1.smithi129.stdout:2/829: unlink d7/d1f/d20/d72/cee 0 2024-03-18T14:43:26.617 INFO:tasks.workunit.client.1.smithi129.stdout:1/775: fdatasync d1/d2/d28/d65/d19/dc9/d87/fa9 0 2024-03-18T14:43:26.618 INFO:tasks.workunit.client.1.smithi129.stdout:4/738: creat d0/d19/d46/fee x:0 0 0 2024-03-18T14:43:26.619 INFO:tasks.workunit.client.1.smithi129.stdout:0/810: unlink d0/d23/d6b/f8b 0 2024-03-18T14:43:26.621 INFO:tasks.workunit.client.1.smithi129.stdout:7/790: symlink d4/d8c/dd5/lf9 0 2024-03-18T14:43:26.622 INFO:tasks.workunit.client.1.smithi129.stdout:2/830: read d7/d1f/d81/fcc [2650639,118409] 0 2024-03-18T14:43:26.623 INFO:tasks.workunit.client.1.smithi129.stdout:8/811: dwrite d9/d11/d1a/d32/d3a/d5d/f62 [0,4194304] 0 2024-03-18T14:43:26.623 INFO:tasks.workunit.client.1.smithi129.stdout:7/791: chown d4/d8c/faa 81023 1 2024-03-18T14:43:26.624 INFO:tasks.workunit.client.1.smithi129.stdout:0/811: dread - d0/d23/d35/d50/fda zero size 2024-03-18T14:43:26.624 INFO:tasks.workunit.client.1.smithi129.stdout:5/749: mkdir d0/d32/d3a/d45/d83/ddf/de2 0 2024-03-18T14:43:26.628 INFO:tasks.workunit.client.1.smithi129.stdout:6/800: getdents d3/d5/d46 0 2024-03-18T14:43:26.628 INFO:tasks.workunit.client.1.smithi129.stdout:0/812: stat d0/d14/d28/f86 0 2024-03-18T14:43:26.629 INFO:tasks.workunit.client.1.smithi129.stdout:2/831: mknod d7/d1c/d79/dd5/c104 0 2024-03-18T14:43:26.631 INFO:tasks.workunit.client.1.smithi129.stdout:5/750: creat d0/dc/d1a/fe3 x:0 0 0 2024-03-18T14:43:26.631 INFO:tasks.workunit.client.1.smithi129.stdout:3/765: dwrite d4/d11/d1d/d50/d91/d97/fa2 [0,4194304] 0 2024-03-18T14:43:26.636 INFO:tasks.workunit.client.1.smithi129.stdout:1/776: truncate d1/d2/d28/d65/d19/dc9/f9d 96287 0 2024-03-18T14:43:26.636 INFO:tasks.workunit.client.1.smithi129.stdout:4/739: dwrite d0/d19/d46/d3e/d21/d4d/d58/f96 [0,4194304] 0 2024-03-18T14:43:26.637 INFO:tasks.workunit.client.1.smithi129.stdout:9/791: dread d0/f10 [0,4194304] 0 2024-03-18T14:43:26.637 INFO:tasks.workunit.client.1.smithi129.stdout:3/766: chown d4/d11/d1d/d50/d91/d97/fc1 31449 1 2024-03-18T14:43:26.638 INFO:tasks.workunit.client.1.smithi129.stdout:3/767: dread - d4/dd/d1f/d2f/dae/ff4 zero size 2024-03-18T14:43:26.639 INFO:tasks.workunit.client.1.smithi129.stdout:2/832: rmdir d7/d1f/d20/d36 39 2024-03-18T14:43:26.645 INFO:tasks.workunit.client.1.smithi129.stdout:6/801: dread d3/d30/de/d65/d93/fa0 [0,4194304] 0 2024-03-18T14:43:26.650 INFO:tasks.workunit.client.1.smithi129.stdout:0/813: dread d0/f72 [0,4194304] 0 2024-03-18T14:43:26.651 INFO:tasks.workunit.client.1.smithi129.stdout:5/751: creat d0/dc/d1a/d61/d94/db7/fe4 x:0 0 0 2024-03-18T14:43:26.652 INFO:tasks.workunit.client.1.smithi129.stdout:5/752: fdatasync d0/d32/d34/f53 0 2024-03-18T14:43:26.654 INFO:tasks.workunit.client.1.smithi129.stdout:7/792: rename d4/d2d/d2e/d79/dc6/d8 to d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa 0 2024-03-18T14:43:26.655 INFO:tasks.workunit.client.1.smithi129.stdout:4/740: fdatasync d0/f88 0 2024-03-18T14:43:26.655 INFO:tasks.workunit.client.1.smithi129.stdout:7/793: write d4/d2d/d2e/d42/f7b [284267,46794] 0 2024-03-18T14:43:26.656 INFO:tasks.workunit.client.1.smithi129.stdout:1/777: mknod d1/d2/d28/da7/cf8 0 2024-03-18T14:43:26.658 INFO:tasks.workunit.client.1.smithi129.stdout:8/812: dread d9/d11/d1a/d14/f2c [0,4194304] 0 2024-03-18T14:43:26.659 INFO:tasks.workunit.client.1.smithi129.stdout:9/792: write d0/db/d11/d97/dd1/d25/dad/fec [1058248,42414] 0 2024-03-18T14:43:26.659 INFO:tasks.workunit.client.1.smithi129.stdout:6/802: dread d3/d30/de/d6c/f31 [0,4194304] 0 2024-03-18T14:43:26.659 INFO:tasks.workunit.client.1.smithi129.stdout:1/778: fsync d1/d2/d28/d65/d19/dc9/fb9 0 2024-03-18T14:43:26.660 INFO:tasks.workunit.client.1.smithi129.stdout:8/813: readlink d9/d11/d18/l42 0 2024-03-18T14:43:26.661 INFO:tasks.workunit.client.1.smithi129.stdout:1/779: write d1/d35/f45 [3950123,6206] 0 2024-03-18T14:43:26.661 INFO:tasks.workunit.client.1.smithi129.stdout:0/814: symlink d0/d23/d29/lf7 0 2024-03-18T14:43:26.662 INFO:tasks.workunit.client.1.smithi129.stdout:8/814: write d9/d11/d1a/f30 [4944281,36237] 0 2024-03-18T14:43:26.663 INFO:tasks.workunit.client.1.smithi129.stdout:5/753: mknod d0/dc/d4c/ce5 0 2024-03-18T14:43:26.666 INFO:tasks.workunit.client.1.smithi129.stdout:2/833: dwrite d7/d1f/d20/d36/fe2 [0,4194304] 0 2024-03-18T14:43:26.666 INFO:tasks.workunit.client.1.smithi129.stdout:0/815: read d0/d23/d71/dc2/d4a/f70 [11503431,45824] 0 2024-03-18T14:43:26.669 INFO:tasks.workunit.client.1.smithi129.stdout:4/741: creat d0/d19/d46/d3e/d21/d4d/fef x:0 0 0 2024-03-18T14:43:26.671 INFO:tasks.workunit.client.1.smithi129.stdout:4/742: write d0/d19/d46/d3e/d21/d4d/d70/f25 [3646037,65667] 0 2024-03-18T14:43:26.675 INFO:tasks.workunit.client.1.smithi129.stdout:7/794: mkdir d4/d2d/d2e/d79/dc6/d38/d61/d68/dfb 0 2024-03-18T14:43:26.677 INFO:tasks.workunit.client.1.smithi129.stdout:9/793: creat d0/db/d11/d97/dd1/d26/d19/d8d/fff x:0 0 0 2024-03-18T14:43:26.678 INFO:tasks.workunit.client.1.smithi129.stdout:9/794: fdatasync d0/db/d1f/d4c/d57/fa3 0 2024-03-18T14:43:26.680 INFO:tasks.workunit.client.1.smithi129.stdout:0/816: dread d0/d23/d6b/f9a [0,4194304] 0 2024-03-18T14:43:26.681 INFO:tasks.workunit.client.1.smithi129.stdout:2/834: creat d7/d1f/d20/d2d/f105 x:0 0 0 2024-03-18T14:43:26.682 INFO:tasks.workunit.client.1.smithi129.stdout:4/743: stat d0/d19/d46/d3e/d21/d32/l55 0 2024-03-18T14:43:26.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/939: sync 2024-03-18T14:43:26.685 INFO:tasks.workunit.client.0.smithi087.stdout:8/940: read - d1/d6/d8d/dc2/f102 zero size 2024-03-18T14:43:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:3/768: link d4/dd/d1f/d5f/dfa/cda d4/dd/d1f/d5f/d8c/c105 0 2024-03-18T14:43:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:6/803: mknod d3/d30/df/d28/c100 0 2024-03-18T14:43:26.692 INFO:tasks.workunit.client.1.smithi129.stdout:8/815: fdatasync d9/d11/d1a/d32/d3a/f59 0 2024-03-18T14:43:26.693 INFO:tasks.workunit.client.1.smithi129.stdout:1/780: truncate d1/d2/d28/d65/d19/d84/fe9 207576 0 2024-03-18T14:43:26.694 INFO:tasks.workunit.client.1.smithi129.stdout:9/795: mknod d0/db/d11/d97/dd1/d25/c100 0 2024-03-18T14:43:26.695 INFO:tasks.workunit.client.1.smithi129.stdout:8/816: write d9/d11/d53/fa1 [1071542,72793] 0 2024-03-18T14:43:26.695 INFO:tasks.workunit.client.0.smithi087.stdout:4/928: symlink d2/db/d24/d30/d7b/d7f/d112/l133 0 2024-03-18T14:43:26.696 INFO:tasks.workunit.client.1.smithi129.stdout:6/804: creat d3/d30/f101 x:0 0 0 2024-03-18T14:43:26.697 INFO:tasks.workunit.client.1.smithi129.stdout:5/754: dread d0/dc/d4c/ddd/fa7 [0,4194304] 0 2024-03-18T14:43:26.697 INFO:tasks.workunit.client.1.smithi129.stdout:8/817: dread - d9/d11/d1a/d32/d41/d4d/d103/f105 zero size 2024-03-18T14:43:26.698 INFO:tasks.workunit.client.0.smithi087.stdout:4/929: fsync d2/db/fe1 0 2024-03-18T14:43:26.699 INFO:tasks.workunit.client.1.smithi129.stdout:4/744: truncate d0/d19/d46/d3e/d21/d4d/fd7 24275 0 2024-03-18T14:43:26.700 INFO:tasks.workunit.client.0.smithi087.stdout:3/978: getdents d0/d3/d4f/d6e 0 2024-03-18T14:43:26.700 INFO:tasks.workunit.client.0.smithi087.stdout:3/979: fsync d0/d3/d40/f97 0 2024-03-18T14:43:26.702 INFO:tasks.workunit.client.1.smithi129.stdout:2/835: creat d7/d1f/d20/d2b/d41/d65/f106 x:0 0 0 2024-03-18T14:43:26.705 INFO:tasks.workunit.client.1.smithi129.stdout:5/755: creat d0/d32/d3a/d45/d83/ddf/dc4/fe6 x:0 0 0 2024-03-18T14:43:26.711 INFO:tasks.workunit.client.1.smithi129.stdout:4/745: write d0/fbb [959136,100079] 0 2024-03-18T14:43:26.712 INFO:tasks.workunit.client.1.smithi129.stdout:0/817: truncate d0/d14/fd5 2119962 0 2024-03-18T14:43:26.714 INFO:tasks.workunit.client.1.smithi129.stdout:9/796: dwrite d0/db/d11/d97/dd1/ff6 [0,4194304] 0 2024-03-18T14:43:26.715 INFO:tasks.workunit.client.0.smithi087.stdout:4/930: symlink d2/db/d7a/l134 0 2024-03-18T14:43:26.717 INFO:tasks.workunit.client.0.smithi087.stdout:2/981: sync 2024-03-18T14:43:26.717 INFO:tasks.workunit.client.1.smithi129.stdout:8/818: write d9/d33/fc5 [1282965,69865] 0 2024-03-18T14:43:26.719 INFO:tasks.workunit.client.1.smithi129.stdout:3/769: truncate d4/d11/d1d/d50/d90/dac/fd7 408668 0 2024-03-18T14:43:26.721 INFO:tasks.workunit.client.1.smithi129.stdout:2/836: dread d7/d1f/d20/d36/da9/dc1/f18 [0,4194304] 0 2024-03-18T14:43:26.723 INFO:tasks.workunit.client.1.smithi129.stdout:5/756: mkdir d0/d32/d3a/de7 0 2024-03-18T14:43:26.723 INFO:tasks.workunit.client.1.smithi129.stdout:2/837: dread - d7/d1c/d7b/fd6 zero size 2024-03-18T14:43:26.724 INFO:tasks.workunit.client.1.smithi129.stdout:8/819: dwrite d9/d11/d18/da4/dd2/fff [0,4194304] 0 2024-03-18T14:43:26.725 INFO:tasks.workunit.client.1.smithi129.stdout:5/757: fdatasync d0/dc/d1a/d61/faf 0 2024-03-18T14:43:26.725 INFO:tasks.workunit.client.1.smithi129.stdout:6/805: rmdir d3/d30/de/d49 39 2024-03-18T14:43:26.725 INFO:tasks.workunit.client.1.smithi129.stdout:3/770: dread d4/d11/d1d/fb5 [0,4194304] 0 2024-03-18T14:43:26.726 INFO:tasks.workunit.client.0.smithi087.stdout:8/941: rmdir d1/d6/d2f/d44/d45/d71/daa/dad 39 2024-03-18T14:43:26.726 INFO:tasks.workunit.client.1.smithi129.stdout:1/781: sync 2024-03-18T14:43:26.726 INFO:tasks.workunit.client.1.smithi129.stdout:7/795: sync 2024-03-18T14:43:26.734 INFO:tasks.workunit.client.0.smithi087.stdout:6/901: truncate d3/d7/d25/d62/d7c/d29/f1d 2431404 0 2024-03-18T14:43:26.735 INFO:tasks.workunit.client.1.smithi129.stdout:8/820: mkdir d9/d11/d1a/d32/d41/d4d/d10a 0 2024-03-18T14:43:26.737 INFO:tasks.workunit.client.0.smithi087.stdout:3/980: unlink d0/d3/d4f/f6f 0 2024-03-18T14:43:26.738 INFO:tasks.workunit.client.1.smithi129.stdout:4/746: truncate d0/d19/d46/d3e/d21/d4d/d70/fe1 1177350 0 2024-03-18T14:43:26.739 INFO:tasks.workunit.client.1.smithi129.stdout:5/758: symlink d0/d32/d34/d6c/le8 0 2024-03-18T14:43:26.740 INFO:tasks.workunit.client.1.smithi129.stdout:3/771: creat d4/d11/d34/d3c/d95/dff/f106 x:0 0 0 2024-03-18T14:43:26.740 INFO:tasks.workunit.client.1.smithi129.stdout:9/797: dwrite d0/db/d11/d97/dd1/d26/d5f/f72 [0,4194304] 0 2024-03-18T14:43:26.741 INFO:tasks.workunit.client.0.smithi087.stdout:4/931: rename d2/db/d24/d30/f91 to d2/db/d24/d30/d7b/dbe/ddc/f135 0 2024-03-18T14:43:26.741 INFO:tasks.workunit.client.1.smithi129.stdout:0/818: rename d0/l44 to d0/d23/d71/dc2/d4a/d7a/lf8 0 2024-03-18T14:43:26.743 INFO:tasks.workunit.client.0.smithi087.stdout:8/942: mknod d1/d6/d9/d5d/d87/d88/c141 0 2024-03-18T14:43:26.743 INFO:tasks.workunit.client.1.smithi129.stdout:7/796: write d4/d2d/d2e/d79/dc6/d54/fbf [348648,88683] 0 2024-03-18T14:43:26.743 INFO:tasks.workunit.client.1.smithi129.stdout:3/772: read d4/dd/f4d [1112336,117057] 0 2024-03-18T14:43:26.744 INFO:tasks.workunit.client.1.smithi129.stdout:8/821: creat d9/d11/d1a/d14/d60/f10b x:0 0 0 2024-03-18T14:43:26.745 INFO:tasks.workunit.client.1.smithi129.stdout:7/797: write d4/d2d/d2e/d79/f9f [1572597,109219] 0 2024-03-18T14:43:26.745 INFO:tasks.workunit.client.0.smithi087.stdout:6/902: unlink d3/d7/d25/d62/d7c/da0/d96/d97/cd5 0 2024-03-18T14:43:26.745 INFO:tasks.workunit.client.1.smithi129.stdout:6/806: mkdir d3/d30/de/d49/d102 0 2024-03-18T14:43:26.746 INFO:tasks.workunit.client.0.smithi087.stdout:3/981: truncate d0/d3/d10/fc1 746366 0 2024-03-18T14:43:26.748 INFO:tasks.workunit.client.0.smithi087.stdout:0/948: sync 2024-03-18T14:43:26.749 INFO:tasks.workunit.client.0.smithi087.stdout:2/982: mkdir d2/ddd/d22/d2c/d3a/d49/ddc/d144 0 2024-03-18T14:43:26.750 INFO:tasks.workunit.client.0.smithi087.stdout:8/943: mknod d1/d6/d14/db2/dbc/d111/c142 0 2024-03-18T14:43:26.751 INFO:tasks.workunit.client.1.smithi129.stdout:5/759: rename d0/d32/d3a/d52/f90 to d0/dc/d22/fe9 0 2024-03-18T14:43:26.751 INFO:tasks.workunit.client.0.smithi087.stdout:8/944: fdatasync d1/d6/d2f/d9b/d122/f128 0 2024-03-18T14:43:26.751 INFO:tasks.workunit.client.1.smithi129.stdout:5/760: fdatasync d0/d32/d3a/d52/d69/fd7 0 2024-03-18T14:43:26.752 INFO:tasks.workunit.client.0.smithi087.stdout:6/903: creat d3/d7/d25/d62/d7c/d29/d22/d134/f139 x:0 0 0 2024-03-18T14:43:26.753 INFO:tasks.workunit.client.0.smithi087.stdout:4/932: creat d2/db/d24/d30/d7b/d7f/da5/d113/f136 x:0 0 0 2024-03-18T14:43:26.755 INFO:tasks.workunit.client.0.smithi087.stdout:3/982: rename d0/f28 to d0/d3/d7a/f12b 0 2024-03-18T14:43:26.756 INFO:tasks.workunit.client.0.smithi087.stdout:3/983: dread - d0/d3/d4f/fc4 zero size 2024-03-18T14:43:26.757 INFO:tasks.workunit.client.0.smithi087.stdout:6/904: write d3/d7/f2e [4394584,97970] 0 2024-03-18T14:43:26.759 INFO:tasks.workunit.client.0.smithi087.stdout:4/933: symlink d2/db/d24/d30/d7b/l137 0 2024-03-18T14:43:26.760 INFO:tasks.workunit.client.0.smithi087.stdout:3/984: dread d0/d3/df/d42/dfc/d106/f11a [0,4194304] 0 2024-03-18T14:43:26.761 INFO:tasks.workunit.client.0.smithi087.stdout:3/985: dread d0/de/d30/d46/f68 [0,4194304] 0 2024-03-18T14:43:26.762 INFO:tasks.workunit.client.1.smithi129.stdout:8/822: creat d9/d11/d1a/f10c x:0 0 0 2024-03-18T14:43:26.762 INFO:tasks.workunit.client.1.smithi129.stdout:6/807: mkdir d3/d6/d7f/d8f/d103 0 2024-03-18T14:43:26.762 INFO:tasks.workunit.client.1.smithi129.stdout:4/747: symlink d0/d19/d46/d3e/d21/d4d/d70/lf0 0 2024-03-18T14:43:26.763 INFO:tasks.workunit.client.1.smithi129.stdout:6/808: fsync d3/d6/f8a 0 2024-03-18T14:43:26.763 INFO:tasks.workunit.client.1.smithi129.stdout:5/761: write d0/d32/d3a/d52/d6e/fb6 [938129,67295] 0 2024-03-18T14:43:26.765 INFO:tasks.workunit.client.1.smithi129.stdout:2/838: getdents d7/d3f 0 2024-03-18T14:43:26.765 INFO:tasks.workunit.client.1.smithi129.stdout:5/762: stat d0/d32/l56 0 2024-03-18T14:43:26.766 INFO:tasks.workunit.client.1.smithi129.stdout:5/763: stat d0/dc/d1a/fbe 0 2024-03-18T14:43:26.766 INFO:tasks.workunit.client.1.smithi129.stdout:9/798: rename d0/db/d90 to d0/db/d11/d97/dd1/d6c/dfa/d101 0 2024-03-18T14:43:26.769 INFO:tasks.workunit.client.1.smithi129.stdout:1/782: dwrite d1/d2/d28/d65/d19/d84/fc7 [0,4194304] 0 2024-03-18T14:43:26.769 INFO:tasks.workunit.client.0.smithi087.stdout:0/949: write d0/d2/d4/d19/d5a/f7d [82790,127067] 0 2024-03-18T14:43:26.773 INFO:tasks.workunit.client.0.smithi087.stdout:6/905: rmdir d3/d7/d25/d62/d7c/d29/d22/d134 39 2024-03-18T14:43:26.775 INFO:tasks.workunit.client.0.smithi087.stdout:6/906: chown d3/d7/d25/d62/d7c/d29/d22/d23/da9/l83 7 1 2024-03-18T14:43:26.776 INFO:tasks.workunit.client.1.smithi129.stdout:1/783: dread d1/d2/d28/d65/d19/d52/fa2 [0,4194304] 0 2024-03-18T14:43:26.777 INFO:tasks.workunit.client.0.smithi087.stdout:0/950: rmdir d0/d2/d4/de8/dad/dea 39 2024-03-18T14:43:26.777 INFO:tasks.workunit.client.1.smithi129.stdout:1/784: stat d1/d2/f3 0 2024-03-18T14:43:26.779 INFO:tasks.workunit.client.1.smithi129.stdout:7/798: rename d4/d2d/d2e/d79/dc6/d38/d61/d68/dfb to d4/d2d/dfc 0 2024-03-18T14:43:26.779 INFO:tasks.workunit.client.0.smithi087.stdout:4/934: creat d2/db/de/d8b/dc4/f138 x:0 0 0 2024-03-18T14:43:26.780 INFO:tasks.workunit.client.0.smithi087.stdout:4/935: write f1 [5582735,110118] 0 2024-03-18T14:43:26.781 INFO:tasks.workunit.client.0.smithi087.stdout:2/983: getdents d2/ddd/dca 0 2024-03-18T14:43:26.781 INFO:tasks.workunit.client.0.smithi087.stdout:4/936: dread - d2/d13/f10d zero size 2024-03-18T14:43:26.782 INFO:tasks.workunit.client.1.smithi129.stdout:0/819: dread d0/d23/d35/d3b/d42/dc0/fdb [0,4194304] 0 2024-03-18T14:43:26.783 INFO:tasks.workunit.client.1.smithi129.stdout:9/799: creat d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f102 x:0 0 0 2024-03-18T14:43:26.784 INFO:tasks.workunit.client.0.smithi087.stdout:8/945: getdents d1/d6/d2f/d44/d4b 0 2024-03-18T14:43:26.784 INFO:tasks.workunit.client.0.smithi087.stdout:0/951: mkdir d0/d2/d4/d13f 0 2024-03-18T14:43:26.786 INFO:tasks.workunit.client.0.smithi087.stdout:2/984: mknod d2/ddd/d22/d2c/d3a/d76/d9a/d9b/de5/d111/c145 0 2024-03-18T14:43:26.786 INFO:tasks.workunit.client.0.smithi087.stdout:0/952: read d0/d1a/d80/d88/f2e [63282,94044] 0 2024-03-18T14:43:26.787 INFO:tasks.workunit.client.1.smithi129.stdout:8/823: dread d9/d11/d1a/d14/f2c [0,4194304] 0 2024-03-18T14:43:26.788 INFO:tasks.workunit.client.1.smithi129.stdout:1/785: mkdir d1/d2/d28/d65/d19/d96/df9 0 2024-03-18T14:43:26.788 INFO:tasks.workunit.client.0.smithi087.stdout:4/937: rename d2/db/l83 to d2/db/d24/d30/d49/d12d/ddb/l139 0 2024-03-18T14:43:26.788 INFO:tasks.workunit.client.1.smithi129.stdout:5/764: mknod d0/dc/d18/d2b/d8c/cea 0 2024-03-18T14:43:26.788 INFO:tasks.workunit.client.0.smithi087.stdout:6/907: creat d3/d7/d25/d62/d7c/d29/f13a x:0 0 0 2024-03-18T14:43:26.789 INFO:tasks.workunit.client.1.smithi129.stdout:7/799: dread - d4/d2d/d2e/d79/dc6/f63 zero size 2024-03-18T14:43:26.789 INFO:tasks.workunit.client.1.smithi129.stdout:1/786: read d1/d2/d28/d65/d19/d84/fc7 [3664098,13014] 0 2024-03-18T14:43:26.790 INFO:tasks.workunit.client.0.smithi087.stdout:6/908: read d3/d7/d25/fe3 [205322,68316] 0 2024-03-18T14:43:26.792 INFO:tasks.workunit.client.1.smithi129.stdout:9/800: rename d0/db/d53/f58 to d0/db/d2e/f103 0 2024-03-18T14:43:26.792 INFO:tasks.workunit.client.1.smithi129.stdout:0/820: dread d0/d14/f4d [0,4194304] 0 2024-03-18T14:43:26.793 INFO:tasks.workunit.client.1.smithi129.stdout:0/821: write d0/d23/d35/d50/f7d [273436,123274] 0 2024-03-18T14:43:26.793 INFO:tasks.workunit.client.1.smithi129.stdout:8/824: mknod d9/d11/d1a/d14/dc0/c10d 0 2024-03-18T14:43:26.795 INFO:tasks.workunit.client.0.smithi087.stdout:6/909: creat d3/d7/d25/d10e/d115/f13b x:0 0 0 2024-03-18T14:43:26.798 INFO:tasks.workunit.client.1.smithi129.stdout:1/787: unlink d1/l8a 0 2024-03-18T14:43:26.800 INFO:tasks.workunit.client.0.smithi087.stdout:8/946: write d1/d6/d2f/f95 [100543,27724] 0 2024-03-18T14:43:26.803 INFO:tasks.workunit.client.0.smithi087.stdout:2/985: truncate d2/ddd/d22/d2c/f2e 4207838 0 2024-03-18T14:43:26.804 INFO:tasks.workunit.client.0.smithi087.stdout:0/953: dwrite d0/d2/d4/f8d [0,4194304] 0 2024-03-18T14:43:26.804 INFO:tasks.workunit.client.0.smithi087.stdout:2/986: write d2/ddd/d22/d2c/d3a/fc1 [4473788,68664] 0 2024-03-18T14:43:26.806 INFO:tasks.workunit.client.1.smithi129.stdout:6/809: dwrite d3/d30/df/d28/f8c [0,4194304] 0 2024-03-18T14:43:26.806 INFO:tasks.workunit.client.0.smithi087.stdout:6/910: link d3/d7/d25/d8e/fae d3/d7/d25/d62/d7c/da0/d96/d97/f13c 0 2024-03-18T14:43:26.807 INFO:tasks.workunit.client.1.smithi129.stdout:4/748: getdents d0/d19/d46/d3e 0 2024-03-18T14:43:26.807 INFO:tasks.workunit.client.0.smithi087.stdout:8/947: chown d1/d6/d2f/d44/d45/d72/db6/l138 1413237542 1 2024-03-18T14:43:26.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/986: sync 2024-03-18T14:43:26.807 INFO:tasks.workunit.client.0.smithi087.stdout:3/987: write d0/f52 [7838221,17231] 0 2024-03-18T14:43:26.808 INFO:tasks.workunit.client.1.smithi129.stdout:4/749: readlink d0/d19/d46/d3e/d21/d4d/d70/lf0 0 2024-03-18T14:43:26.808 INFO:tasks.workunit.client.1.smithi129.stdout:9/801: creat d0/da1/f104 x:0 0 0 2024-03-18T14:43:26.808 INFO:tasks.workunit.client.0.smithi087.stdout:3/988: fsync d0/d3/d4f/fc4 0 2024-03-18T14:43:26.808 INFO:tasks.workunit.client.1.smithi129.stdout:9/802: readlink d0/db/d2e/l40 0 2024-03-18T14:43:26.809 INFO:tasks.workunit.client.1.smithi129.stdout:7/800: write d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/f3d [2909634,50011] 0 2024-03-18T14:43:26.811 INFO:tasks.workunit.client.1.smithi129.stdout:7/801: write d4/d83/ff8 [797478,125276] 0 2024-03-18T14:43:26.813 INFO:tasks.workunit.client.0.smithi087.stdout:6/911: chown d3/d7/d25/d62/d8b/d106 744455 1 2024-03-18T14:43:26.813 INFO:tasks.workunit.client.0.smithi087.stdout:6/912: readlink d3/d7/dbd/ld7 0 2024-03-18T14:43:26.815 INFO:tasks.workunit.client.1.smithi129.stdout:0/822: creat d0/d14/d28/d63/d8d/ff9 x:0 0 0 2024-03-18T14:43:26.815 INFO:tasks.workunit.client.1.smithi129.stdout:5/765: creat d0/d32/d3a/de7/feb x:0 0 0 2024-03-18T14:43:26.815 INFO:tasks.workunit.client.0.smithi087.stdout:3/989: rename d0/d1c/d25/f3c to d0/d3/d7a/d101/d11d/f12c 0 2024-03-18T14:43:26.815 INFO:tasks.workunit.client.0.smithi087.stdout:0/954: truncate d0/d1a/d7b/d26/fce 438372 0 2024-03-18T14:43:26.816 INFO:tasks.workunit.client.1.smithi129.stdout:0/823: dread - d0/d23/d71/f7f zero size 2024-03-18T14:43:26.818 INFO:tasks.workunit.client.1.smithi129.stdout:9/803: symlink d0/d15/l105 0 2024-03-18T14:43:26.818 INFO:tasks.workunit.client.0.smithi087.stdout:2/987: creat d2/ddd/f146 x:0 0 0 2024-03-18T14:43:26.820 INFO:tasks.workunit.client.0.smithi087.stdout:0/955: dwrite d0/d2/d4/d8b/fa6 [0,4194304] 0 2024-03-18T14:43:26.820 INFO:tasks.workunit.client.0.smithi087.stdout:3/990: mkdir d0/d3/df/d42/d12d 0 2024-03-18T14:43:26.822 INFO:tasks.workunit.client.1.smithi129.stdout:4/750: creat d0/d19/d46/d3e/d21/d4d/d58/d61/dd5/ff1 x:0 0 0 2024-03-18T14:43:26.823 INFO:tasks.workunit.client.1.smithi129.stdout:8/825: rename d9/d11/d1a/d32/d41/df5 to d9/d11/d1a/d32/d41/d4d/d10a/d10e 0 2024-03-18T14:43:26.824 INFO:tasks.workunit.client.1.smithi129.stdout:7/802: chown d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/lf2 35359500 1 2024-03-18T14:43:26.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/938: sync 2024-03-18T14:43:26.825 INFO:tasks.workunit.client.0.smithi087.stdout:4/939: stat d2/db/d3c/d90/l11d 0 2024-03-18T14:43:26.825 INFO:tasks.workunit.client.1.smithi129.stdout:7/803: write d4/d2d/d2e/d79/dc6/d54/d86/fdf [624885,40908] 0 2024-03-18T14:43:26.826 INFO:tasks.workunit.client.1.smithi129.stdout:3/773: sync 2024-03-18T14:43:26.827 INFO:tasks.workunit.client.1.smithi129.stdout:7/804: dread - d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/fac zero size 2024-03-18T14:43:26.829 INFO:tasks.workunit.client.1.smithi129.stdout:0/824: dread d0/d23/d35/d50/f7d [0,4194304] 0 2024-03-18T14:43:26.829 INFO:tasks.workunit.client.1.smithi129.stdout:6/810: truncate d3/d30/de/d65/d93/dd0/ffd 3921781 0 2024-03-18T14:43:26.831 INFO:tasks.workunit.client.1.smithi129.stdout:5/766: dread d0/df/f68 [0,4194304] 0 2024-03-18T14:43:26.833 INFO:tasks.workunit.client.0.smithi087.stdout:4/940: mknod d2/c13a 0 2024-03-18T14:43:26.833 INFO:tasks.workunit.client.0.smithi087.stdout:4/941: stat d2/db/d24/d30/d7b/l137 0 2024-03-18T14:43:26.835 INFO:tasks.workunit.client.0.smithi087.stdout:8/948: write d1/d6/d9/d5d/f9c [1024698,111831] 0 2024-03-18T14:43:26.836 INFO:tasks.workunit.client.0.smithi087.stdout:8/949: fdatasync d1/d6/d9/d5d/d87/da2/df0/ff5 0 2024-03-18T14:43:26.837 INFO:tasks.workunit.client.0.smithi087.stdout:8/950: dread - d1/d6/d9/d5d/f129 zero size 2024-03-18T14:43:26.837 INFO:tasks.workunit.client.0.smithi087.stdout:3/991: write d0/d1c/f84 [1073199,21585] 0 2024-03-18T14:43:26.837 INFO:tasks.workunit.client.1.smithi129.stdout:0/825: symlink d0/de3/lfa 0 2024-03-18T14:43:26.838 INFO:tasks.workunit.client.1.smithi129.stdout:6/811: creat d3/d5/d46/df4/f104 x:0 0 0 2024-03-18T14:43:26.839 INFO:tasks.workunit.client.0.smithi087.stdout:4/942: creat d2/db/d84/d87/f13b x:0 0 0 2024-03-18T14:43:26.839 INFO:tasks.workunit.client.0.smithi087.stdout:2/988: link d2/ddd/d22/d2c/f2e d2/ddd/d22/d2c/d3a/d49/ddc/d144/f147 0 2024-03-18T14:43:26.841 INFO:tasks.workunit.client.1.smithi129.stdout:9/804: rename d0/db/d11/d97/dd1/d26/d19/d29/f2d to d0/db/d11/d97/dd1/d26/d19/dd5/f106 0 2024-03-18T14:43:26.841 INFO:tasks.workunit.client.0.smithi087.stdout:2/989: fdatasync d2/d44/fb7 0 2024-03-18T14:43:26.842 INFO:tasks.workunit.client.0.smithi087.stdout:6/913: dwrite d3/d7/d25/d62/d7c/d46/d121/f138 [0,4194304] 0 2024-03-18T14:43:26.842 INFO:tasks.workunit.client.1.smithi129.stdout:9/805: fdatasync d0/d15/dd7/ff8 0 2024-03-18T14:43:26.842 INFO:tasks.workunit.client.0.smithi087.stdout:8/951: mkdir d1/d6/d9/d5d/d143 0 2024-03-18T14:43:26.844 INFO:tasks.workunit.client.1.smithi129.stdout:3/774: mkdir d4/d38/d9b/d107 0 2024-03-18T14:43:26.845 INFO:tasks.workunit.client.1.smithi129.stdout:7/805: mknod d4/d2d/d2e/d79/dc6/cfd 0 2024-03-18T14:43:26.845 INFO:tasks.workunit.client.0.smithi087.stdout:8/952: readlink d1/d6/d2f/d44/d4b/da5/la6 0 2024-03-18T14:43:26.845 INFO:tasks.workunit.client.0.smithi087.stdout:0/956: dwrite d0/d2/d4/de8/dad/dea/fc2 [0,4194304] 0 2024-03-18T14:43:26.845 INFO:tasks.workunit.client.0.smithi087.stdout:3/992: rename d0/d1c/f39 to d0/d3/d10/da5/df5/d11e/f12e 0 2024-03-18T14:43:26.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/775: write d4/dd/d1f/d2f/dae/ff4 [727863,77482] 0 2024-03-18T14:43:26.846 INFO:tasks.workunit.client.1.smithi129.stdout:7/806: fsync d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/fc0 0 2024-03-18T14:43:26.846 INFO:tasks.workunit.client.1.smithi129.stdout:3/776: readlink d4/d11/d1d/d50/d91/d97/lca 0 2024-03-18T14:43:26.851 INFO:tasks.workunit.client.0.smithi087.stdout:4/943: dwrite d2/db/d24/d30/d7b/d7f/f68 [0,4194304] 0 2024-03-18T14:43:26.851 INFO:tasks.workunit.client.1.smithi129.stdout:7/807: dwrite d4/d2d/d2e/d79/dc6/d54/feb [0,4194304] 0 2024-03-18T14:43:26.851 INFO:tasks.workunit.client.1.smithi129.stdout:4/751: write d0/d19/d46/d3e/d21/d4d/d58/d61/f98 [335286,110800] 0 2024-03-18T14:43:26.852 INFO:tasks.workunit.client.1.smithi129.stdout:5/767: mknod d0/d32/cec 0 2024-03-18T14:43:26.853 INFO:tasks.workunit.client.1.smithi129.stdout:2/839: sync 2024-03-18T14:43:26.855 INFO:tasks.workunit.client.1.smithi129.stdout:6/812: rename d3/d30/de/d6c/d9e/db6/fbf to d3/d6/d7f/d8f/d103/f105 0 2024-03-18T14:43:26.856 INFO:tasks.workunit.client.0.smithi087.stdout:2/990: symlink d2/ddd/d22/d24/d65/d7f/l148 0 2024-03-18T14:43:26.857 INFO:tasks.workunit.client.1.smithi129.stdout:8/826: creat d9/d33/f10f x:0 0 0 2024-03-18T14:43:26.857 INFO:tasks.workunit.client.0.smithi087.stdout:6/914: unlink d3/d7/d25/d62/d7c/d46/ce0 0 2024-03-18T14:43:26.858 INFO:tasks.workunit.client.1.smithi129.stdout:2/840: dwrite d7/d3f/d5f/fe4 [0,4194304] 0 2024-03-18T14:43:26.858 INFO:tasks.workunit.client.0.smithi087.stdout:6/915: fsync d3/d7/d25/d62/d7c/d29/d7d/f8c 0 2024-03-18T14:43:26.862 INFO:tasks.workunit.client.1.smithi129.stdout:1/788: write d1/d2/d28/d65/d19/d52/fa6 [872401,84347] 0 2024-03-18T14:43:26.862 INFO:tasks.workunit.client.1.smithi129.stdout:7/808: chown d4/d2d/d2e/d45/ca1 122891 1 2024-03-18T14:43:26.863 INFO:tasks.workunit.client.0.smithi087.stdout:3/993: rename d0/d3/d4f/d6e/dc8/c105 to d0/de/d30/d60/ddb/dff/c12f 0 2024-03-18T14:43:26.865 INFO:tasks.workunit.client.1.smithi129.stdout:4/752: mknod d0/d9/d40/d5f/cf2 0 2024-03-18T14:43:26.867 INFO:tasks.workunit.client.0.smithi087.stdout:2/991: mknod d2/ddd/d22/d2c/d3a/c149 0 2024-03-18T14:43:26.870 INFO:tasks.workunit.client.0.smithi087.stdout:8/953: mkdir d1/d6/d2f/d44/d45/d72/db6/d13d/d144 0 2024-03-18T14:43:26.871 INFO:tasks.workunit.client.0.smithi087.stdout:6/916: mkdir d3/d7/d25/d62/d7c/d29/d22/d75/d92/d13d 0 2024-03-18T14:43:26.872 INFO:tasks.workunit.client.1.smithi129.stdout:6/813: unlink d3/d6/d82/lae 0 2024-03-18T14:43:26.872 INFO:tasks.workunit.client.0.smithi087.stdout:3/994: creat d0/de/d30/d60/ddb/f130 x:0 0 0 2024-03-18T14:43:26.872 INFO:tasks.workunit.client.1.smithi129.stdout:8/827: chown d9/d11/d55/d68/d72/d90/cbb 6 1 2024-03-18T14:43:26.873 INFO:tasks.workunit.client.1.smithi129.stdout:2/841: creat d7/d1f/d20/d2a/f107 x:0 0 0 2024-03-18T14:43:26.873 INFO:tasks.workunit.client.1.smithi129.stdout:2/842: chown d7/d1c/l2f 66602 1 2024-03-18T14:43:26.874 INFO:tasks.workunit.client.0.smithi087.stdout:8/954: creat d1/d6/d2f/d44/d4b/da5/f145 x:0 0 0 2024-03-18T14:43:26.876 INFO:tasks.workunit.client.1.smithi129.stdout:0/826: unlink d0/d14/dca/ce8 0 2024-03-18T14:43:26.877 INFO:tasks.workunit.client.1.smithi129.stdout:0/827: chown d0/d23/d71/dcd/fea 14 1 2024-03-18T14:43:26.877 INFO:tasks.workunit.client.1.smithi129.stdout:0/828: chown d0/d23/d6b/l82 358780364 1 2024-03-18T14:43:26.881 INFO:tasks.workunit.client.0.smithi087.stdout:8/955: rmdir d1/d6/d2f/d44/d45/d72 39 2024-03-18T14:43:26.882 INFO:tasks.workunit.client.0.smithi087.stdout:6/917: truncate d3/d7/d25/d62/d7c/da0/d96/d97/f117 267868 0 2024-03-18T14:43:26.884 INFO:tasks.workunit.client.1.smithi129.stdout:9/806: write d0/d15/f42 [1427729,106728] 0 2024-03-18T14:43:26.886 INFO:tasks.workunit.client.1.smithi129.stdout:9/807: chown d0/db/d11/d97/dd1/d25/cc2 444 1 2024-03-18T14:43:26.887 INFO:tasks.workunit.client.0.smithi087.stdout:6/918: dwrite d3/d7/d25/d62/d8b/fee [0,4194304] 0 2024-03-18T14:43:26.889 INFO:tasks.workunit.client.0.smithi087.stdout:3/995: write d0/de/f12 [1940163,6818] 0 2024-03-18T14:43:26.889 INFO:tasks.workunit.client.1.smithi129.stdout:3/777: dwrite d4/dd/d1f/d5f/d31/fcf [0,4194304] 0 2024-03-18T14:43:26.891 INFO:tasks.workunit.client.0.smithi087.stdout:6/919: symlink d3/d7/d25/d62/d7c/da0/dbe/db6/l13e 0 2024-03-18T14:43:26.891 INFO:tasks.workunit.client.1.smithi129.stdout:1/789: dread d1/d35/fbd [0,4194304] 0 2024-03-18T14:43:26.892 INFO:tasks.workunit.client.1.smithi129.stdout:9/808: dwrite d0/db/d11/d97/dd1/f85 [0,4194304] 0 2024-03-18T14:43:26.897 INFO:tasks.workunit.client.0.smithi087.stdout:6/920: rename d3/d7/d25/d62/d7c/d29/d22/l11c to d3/d7/d25/d62/d7c/da0/dbe/db6/dde/l13f 0 2024-03-18T14:43:26.898 INFO:tasks.workunit.client.0.smithi087.stdout:4/944: dread d2/db/d24/d30/f100 [0,4194304] 0 2024-03-18T14:43:26.898 INFO:tasks.workunit.client.0.smithi087.stdout:0/957: dread d0/d2/d4/d27/f9b [0,4194304] 0 2024-03-18T14:43:26.899 INFO:tasks.workunit.client.1.smithi129.stdout:5/768: mkdir d0/dc/d18/d2b/ded 0 2024-03-18T14:43:26.899 INFO:tasks.workunit.client.0.smithi087.stdout:3/996: creat d0/de/d30/f131 x:0 0 0 2024-03-18T14:43:26.899 INFO:tasks.workunit.client.0.smithi087.stdout:6/921: fdatasync d3/d7/d25/d62/d8b/fb7 0 2024-03-18T14:43:26.900 INFO:tasks.workunit.client.1.smithi129.stdout:5/769: fsync d0/d32/d34/f51 0 2024-03-18T14:43:26.900 INFO:tasks.workunit.client.1.smithi129.stdout:4/753: unlink d0/d9/d6a/fcb 0 2024-03-18T14:43:26.903 INFO:tasks.workunit.client.0.smithi087.stdout:6/922: rename d3/d7/d25/d62/d7c/d29/d22 to d3/d7/d25/d62/d7c/d29/d22/d134/d140 22 2024-03-18T14:43:26.906 INFO:tasks.workunit.client.1.smithi129.stdout:6/814: mkdir d3/d30/df/d28/d79/d106 0 2024-03-18T14:43:26.907 INFO:tasks.workunit.client.1.smithi129.stdout:2/843: unlink d7/l8 0 2024-03-18T14:43:26.907 INFO:tasks.workunit.client.0.smithi087.stdout:8/956: truncate d1/d6/d9/f60 6929705 0 2024-03-18T14:43:26.907 INFO:tasks.workunit.client.0.smithi087.stdout:6/923: stat d3/d7/dbd/l124 0 2024-03-18T14:43:26.908 INFO:tasks.workunit.client.0.smithi087.stdout:3/997: creat d0/d3/d4f/f132 x:0 0 0 2024-03-18T14:43:26.910 INFO:tasks.workunit.client.0.smithi087.stdout:6/924: chown d3/d7/d25/lba 4423465 1 2024-03-18T14:43:26.910 INFO:tasks.workunit.client.1.smithi129.stdout:5/770: mknod d0/d32/d3a/d45/cee 0 2024-03-18T14:43:26.911 INFO:tasks.workunit.client.0.smithi087.stdout:3/998: mknod d0/d3/d4f/d6e/dc8/c133 0 2024-03-18T14:43:26.912 INFO:tasks.workunit.client.1.smithi129.stdout:4/754: creat d0/d9/d6a/db1/ff3 x:0 0 0 2024-03-18T14:43:26.912 INFO:tasks.workunit.client.1.smithi129.stdout:7/809: creat d4/d2d/d2e/d79/dc6/ffe x:0 0 0 2024-03-18T14:43:26.913 INFO:tasks.workunit.client.0.smithi087.stdout:2/992: sync 2024-03-18T14:43:26.913 INFO:tasks.workunit.client.0.smithi087.stdout:3/999: dread d0/d3/df/d42/dfc/d106/f11a [0,4194304] 0 2024-03-18T14:43:26.914 INFO:tasks.workunit.client.1.smithi129.stdout:7/810: fdatasync d4/d8c/d9e/fce 0 2024-03-18T14:43:26.915 INFO:tasks.workunit.client.1.smithi129.stdout:5/771: dwrite d0/df/f48 [4194304,4194304] 0 2024-03-18T14:43:26.915 INFO:tasks.workunit.client.1.smithi129.stdout:6/815: rmdir d3/d30/de/d65/d93/dd0 39 2024-03-18T14:43:26.916 INFO:tasks.workunit.client.1.smithi129.stdout:5/772: stat d0/d32/d3a/d45 0 2024-03-18T14:43:26.916 INFO:tasks.workunit.client.1.smithi129.stdout:9/809: fsync d0/d15/f7a 0 2024-03-18T14:43:26.918 INFO:tasks.workunit.client.1.smithi129.stdout:4/755: chown d0/f1c 81582 1 2024-03-18T14:43:26.921 INFO:tasks.workunit.client.0.smithi087.stdout:8/957: write d1/d6/f43 [438758,89568] 0 2024-03-18T14:43:26.921 INFO:tasks.workunit.client.0.smithi087.stdout:2/993: truncate d2/ddd/d22/d2c/d3a/d40/d4a/d97/fea 123122 0 2024-03-18T14:43:26.921 INFO:tasks.workunit.client.1.smithi129.stdout:9/810: dwrite d0/da1/dc1/ff1 [0,4194304] 0 2024-03-18T14:43:26.927 INFO:tasks.workunit.client.0.smithi087.stdout:2/994: getdents d2/ddd/d22/d24/d91 0 2024-03-18T14:43:26.927 INFO:tasks.workunit.client.0.smithi087.stdout:0/958: dread d0/d2/d4/d19/f13e [0,4194304] 0 2024-03-18T14:43:26.929 INFO:tasks.workunit.client.0.smithi087.stdout:2/995: mkdir d2/ddd/d5a/d10f/d14a 0 2024-03-18T14:43:26.931 INFO:tasks.workunit.client.0.smithi087.stdout:4/945: dread d2/db/d24/d30/d7b/d7f/fee [0,4194304] 0 2024-03-18T14:43:26.931 INFO:tasks.workunit.client.1.smithi129.stdout:0/829: getdents d0/d23/d35/d3b/de0 0 2024-03-18T14:43:26.934 INFO:tasks.workunit.client.0.smithi087.stdout:4/946: creat d2/db/d24/d30/d7b/d7f/da5/dae/f13c x:0 0 0 2024-03-18T14:43:26.934 INFO:tasks.workunit.client.1.smithi129.stdout:3/778: truncate d4/f21 309938 0 2024-03-18T14:43:26.934 INFO:tasks.workunit.client.0.smithi087.stdout:2/996: truncate d2/ddd/d22/d2c/d3a/d40/d52/f112 527242 0 2024-03-18T14:43:26.936 INFO:tasks.workunit.client.1.smithi129.stdout:7/811: mknod d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/cff 0 2024-03-18T14:43:26.936 INFO:tasks.workunit.client.1.smithi129.stdout:8/828: sync 2024-03-18T14:43:26.938 INFO:tasks.workunit.client.0.smithi087.stdout:4/947: creat d2/d13/d28/f13d x:0 0 0 2024-03-18T14:43:26.939 INFO:tasks.workunit.client.1.smithi129.stdout:5/773: chown d0/dc/d18/d2b/ca4 0 1 2024-03-18T14:43:26.940 INFO:tasks.workunit.client.0.smithi087.stdout:0/959: write d0/d2/d4/de8/dad/dea/d5d/d78/ff0 [796892,96089] 0 2024-03-18T14:43:26.941 INFO:tasks.workunit.client.0.smithi087.stdout:0/960: fsync d0/dab/d113/f11d 0 2024-03-18T14:43:26.942 INFO:tasks.workunit.client.0.smithi087.stdout:4/948: symlink d2/db/d24/d30/d7b/dbe/dcf/l13e 0 2024-03-18T14:43:26.942 INFO:tasks.workunit.client.0.smithi087.stdout:0/961: chown d0/d1a/d34/d3d/c67 2405137 1 2024-03-18T14:43:26.943 INFO:tasks.workunit.client.1.smithi129.stdout:6/816: write d3/d6/d7f/db4/d57/f64 [3435083,62034] 0 2024-03-18T14:43:26.944 INFO:tasks.workunit.client.1.smithi129.stdout:9/811: symlink d0/db/d11/d97/d99/l107 0 2024-03-18T14:43:26.946 INFO:tasks.workunit.client.1.smithi129.stdout:9/812: write d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f81 [1589754,50133] 0 2024-03-18T14:43:26.946 INFO:tasks.workunit.client.0.smithi087.stdout:4/949: rmdir d2/db/de/d8b 39 2024-03-18T14:43:26.946 INFO:tasks.workunit.client.1.smithi129.stdout:9/813: write d0/db/f18 [3090179,118705] 0 2024-03-18T14:43:26.946 INFO:tasks.workunit.client.1.smithi129.stdout:3/779: symlink d4/d38/d9b/l108 0 2024-03-18T14:43:26.948 INFO:tasks.workunit.client.1.smithi129.stdout:3/780: fdatasync d4/dd/d1f/d5f/fdb 0 2024-03-18T14:43:26.948 INFO:tasks.workunit.client.1.smithi129.stdout:2/844: truncate d7/d1f/d20/d2a/f5a 4092307 0 2024-03-18T14:43:26.949 INFO:tasks.workunit.client.1.smithi129.stdout:3/781: chown d4/d11/d34/d53/d87 2631822 1 2024-03-18T14:43:26.949 INFO:tasks.workunit.client.1.smithi129.stdout:0/830: dread d0/d23/d71/fd2 [0,4194304] 0 2024-03-18T14:43:26.949 INFO:tasks.workunit.client.0.smithi087.stdout:8/958: dread d1/f6d [0,4194304] 0 2024-03-18T14:43:26.951 INFO:tasks.workunit.client.0.smithi087.stdout:8/959: chown d1/d6/d9/d5d/d87/da2/df0/ff5 45 1 2024-03-18T14:43:26.951 INFO:tasks.workunit.client.0.smithi087.stdout:4/950: rename d2/db/d24/f58 to d2/db/d24/d30/d8a/d95/f13f 0 2024-03-18T14:43:26.951 INFO:tasks.workunit.client.0.smithi087.stdout:2/997: write d2/ddd/d22/d2c/d3a/d68/f6f [485494,6257] 0 2024-03-18T14:43:26.952 INFO:tasks.workunit.client.1.smithi129.stdout:7/812: creat d4/d2d/d2e/d79/dc6/d38/d61/d6a/f100 x:0 0 0 2024-03-18T14:43:26.952 INFO:tasks.workunit.client.1.smithi129.stdout:1/790: write d1/d2/d28/d65/d7c/fd4 [151997,93312] 0 2024-03-18T14:43:26.953 INFO:tasks.workunit.client.1.smithi129.stdout:5/774: mknod d0/dc/d4c/cef 0 2024-03-18T14:43:26.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/960: mkdir d1/d6/d2f/d44/d4b/d146 0 2024-03-18T14:43:26.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/961: chown d1/d6/d2f 713966 1 2024-03-18T14:43:26.954 INFO:tasks.workunit.client.0.smithi087.stdout:8/962: write d1/d6/d9/f51 [925108,36308] 0 2024-03-18T14:43:26.954 INFO:tasks.workunit.client.1.smithi129.stdout:3/782: dwrite d4/d11/d34/d3c/d95/dff/f100 [0,4194304] 0 2024-03-18T14:43:26.955 INFO:tasks.workunit.client.0.smithi087.stdout:2/998: rmdir d2/ddd/d22/d2c/d3a/d49 39 2024-03-18T14:43:26.956 INFO:tasks.workunit.client.1.smithi129.stdout:3/783: dread - d4/d11/d34/d3c/d95/dff/f106 zero size 2024-03-18T14:43:26.956 INFO:tasks.workunit.client.0.smithi087.stdout:0/962: dread d0/d2/d4/de8/dad/ffd [0,4194304] 0 2024-03-18T14:43:26.956 INFO:tasks.workunit.client.1.smithi129.stdout:6/817: truncate d3/d30/df/f5f 1593749 0 2024-03-18T14:43:26.957 INFO:tasks.workunit.client.0.smithi087.stdout:4/951: creat d2/db/d82/d99/f140 x:0 0 0 2024-03-18T14:43:26.957 INFO:tasks.workunit.client.1.smithi129.stdout:3/784: stat d4/dd/d1f/d2f/fad 0 2024-03-18T14:43:26.957 INFO:tasks.workunit.client.1.smithi129.stdout:6/818: write d3/d6/d7f/db4/d57/f75 [516391,48691] 0 2024-03-18T14:43:26.959 INFO:tasks.workunit.client.0.smithi087.stdout:2/999: read d2/ddd/d22/d2c/d3a/d40/d52/f112 [329031,122572] 0 2024-03-18T14:43:26.960 INFO:tasks.workunit.client.0.smithi087.stdout:0/963: dwrite d0/d2/d4/d19/d5a/f11f [0,4194304] 0 2024-03-18T14:43:26.961 INFO:tasks.workunit.client.1.smithi129.stdout:2/845: mknod d7/d1f/d20/d2b/deb/c108 0 2024-03-18T14:43:26.961 INFO:tasks.workunit.client.1.smithi129.stdout:8/829: mkdir d9/d11/d55/d110 0 2024-03-18T14:43:26.961 INFO:tasks.workunit.client.0.smithi087.stdout:0/964: write d0/f50 [2523658,82365] 0 2024-03-18T14:43:26.962 INFO:tasks.workunit.client.1.smithi129.stdout:6/819: dwrite d3/d6/d7f/d8f/fce [0,4194304] 0 2024-03-18T14:43:26.962 INFO:tasks.workunit.client.0.smithi087.stdout:4/952: symlink d2/db/d3c/l141 0 2024-03-18T14:43:26.963 INFO:tasks.workunit.client.0.smithi087.stdout:0/965: chown d0/d1a/d7b/d2a/f68 27651879 1 2024-03-18T14:43:26.965 INFO:tasks.workunit.client.0.smithi087.stdout:4/953: read d2/db/d24/d30/d7b/dbe/fa8 [2886013,53544] 0 2024-03-18T14:43:26.966 INFO:tasks.workunit.client.1.smithi129.stdout:5/775: mknod d0/d32/d3a/d45/d83/cf0 0 2024-03-18T14:43:26.966 INFO:tasks.workunit.client.0.smithi087.stdout:4/954: write d2/db/d24/d30/d7b/d7f/d112/f128 [424210,9648] 0 2024-03-18T14:43:26.966 INFO:tasks.workunit.client.0.smithi087.stdout:8/963: write d1/d6/d2f/d9b/fcc [410029,98616] 0 2024-03-18T14:43:26.967 INFO:tasks.workunit.client.1.smithi129.stdout:9/814: creat d0/db/d2e/dd9/de8/f108 x:0 0 0 2024-03-18T14:43:26.968 INFO:tasks.workunit.client.1.smithi129.stdout:0/831: dwrite d0/d23/d35/d3b/fd8 [0,4194304] 0 2024-03-18T14:43:26.968 INFO:tasks.workunit.client.1.smithi129.stdout:3/785: creat d4/dd/d41/f109 x:0 0 0 2024-03-18T14:43:26.970 INFO:tasks.workunit.client.1.smithi129.stdout:6/820: dwrite d3/fdc [0,4194304] 0 2024-03-18T14:43:26.971 INFO:tasks.workunit.client.0.smithi087.stdout:0/966: read d0/d2/d4/de8/dad/dea/da3/da8/fcc [3991985,110384] 0 2024-03-18T14:43:26.974 INFO:tasks.workunit.client.0.smithi087.stdout:0/967: creat d0/d1a/d7b/d2a/f140 x:0 0 0 2024-03-18T14:43:26.974 INFO:tasks.workunit.client.1.smithi129.stdout:0/832: dwrite d0/d23/d71/fc3 [0,4194304] 0 2024-03-18T14:43:26.975 INFO:tasks.workunit.client.1.smithi129.stdout:1/791: symlink d1/dbf/dce/lfa 0 2024-03-18T14:43:26.978 INFO:tasks.workunit.client.0.smithi087.stdout:8/964: rename d1/d6/l28 to d1/d6/d2f/d44/d45/d72/l147 0 2024-03-18T14:43:26.983 INFO:tasks.workunit.client.0.smithi087.stdout:0/968: creat d0/d2/d4/f141 x:0 0 0 2024-03-18T14:43:26.984 INFO:tasks.workunit.client.0.smithi087.stdout:6/925: sync 2024-03-18T14:43:26.984 INFO:tasks.workunit.client.0.smithi087.stdout:4/955: dwrite d2/db/de/fcc [0,4194304] 0 2024-03-18T14:43:26.984 INFO:tasks.workunit.client.1.smithi129.stdout:2/846: creat d7/d1f/d20/d36/da9/dc1/f109 x:0 0 0 2024-03-18T14:43:26.985 INFO:tasks.workunit.client.0.smithi087.stdout:4/956: chown d2/l47 18653205 1 2024-03-18T14:43:26.987 INFO:tasks.workunit.client.1.smithi129.stdout:8/830: rename d9/d11/d1a/d32/l67 to d9/d11/d53/d5f/dcb/dd9/l111 0 2024-03-18T14:43:26.987 INFO:tasks.workunit.client.1.smithi129.stdout:4/756: truncate d0/d3c/fdf 849590 0 2024-03-18T14:43:26.989 INFO:tasks.workunit.client.0.smithi087.stdout:0/969: mknod d0/d1a/d34/d3d/c142 0 2024-03-18T14:43:26.992 INFO:tasks.workunit.client.0.smithi087.stdout:6/926: fsync d3/d7/d25/d62/d7c/da0/d96/d97/f117 0 2024-03-18T14:43:26.993 INFO:tasks.workunit.client.1.smithi129.stdout:5/776: creat d0/dc/d1a/d61/d94/db7/ff1 x:0 0 0 2024-03-18T14:43:26.993 INFO:tasks.workunit.client.1.smithi129.stdout:3/786: rmdir d4/dd/d1f/d5f 39 2024-03-18T14:43:26.994 INFO:tasks.workunit.client.0.smithi087.stdout:4/957: truncate d2/db/d84/d87/f13b 761001 0 2024-03-18T14:43:26.996 INFO:tasks.workunit.client.0.smithi087.stdout:4/958: chown d2/db/d24/d30/d8a/d95/l11c 8772409 1 2024-03-18T14:43:26.997 INFO:tasks.workunit.client.0.smithi087.stdout:6/927: dwrite d3/d7/d25/d62/d7c/d29/dce/fe1 [0,4194304] 0 2024-03-18T14:43:26.997 INFO:tasks.workunit.client.0.smithi087.stdout:4/959: write d2/db/f10b [816167,86136] 0 2024-03-18T14:43:26.998 INFO:tasks.workunit.client.0.smithi087.stdout:6/928: chown d3/d7/d25/d62/d7c/da0/fc4 26 1 2024-03-18T14:43:26.999 INFO:tasks.workunit.client.0.smithi087.stdout:6/929: chown d3/d7/d25/d62/d7c/d29/d7d 14073105 1 2024-03-18T14:43:27.001 INFO:tasks.workunit.client.1.smithi129.stdout:8/831: read d9/f7d [393691,89403] 0 2024-03-18T14:43:27.001 INFO:tasks.workunit.client.0.smithi087.stdout:6/930: fsync d3/d7/d25/fe3 0 2024-03-18T14:43:27.002 INFO:tasks.workunit.client.1.smithi129.stdout:5/777: dread d0/dc/f7b [0,4194304] 0 2024-03-18T14:43:27.004 INFO:tasks.workunit.client.1.smithi129.stdout:3/787: creat d4/dd/d1f/da8/f10a x:0 0 0 2024-03-18T14:43:27.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/931: rename d3/d7/d25/d62/d7c/d29/d22/d23/da9/cac to d3/d7/dbd/c141 0 2024-03-18T14:43:27.005 INFO:tasks.workunit.client.0.smithi087.stdout:6/932: chown d3/d7/d25/d8e/fae 5083653 1 2024-03-18T14:43:27.006 INFO:tasks.workunit.client.1.smithi129.stdout:7/813: getdents d4/d2d/d3a 0 2024-03-18T14:43:27.007 INFO:tasks.workunit.client.1.smithi129.stdout:1/792: mknod d1/db2/cfb 0 2024-03-18T14:43:27.008 INFO:tasks.workunit.client.0.smithi087.stdout:6/933: mkdir d3/d7/dbd/d142 0 2024-03-18T14:43:27.009 INFO:tasks.workunit.client.0.smithi087.stdout:4/960: dread d2/db/d24/d30/d8a/d95/f13f [4194304,4194304] 0 2024-03-18T14:43:27.009 INFO:tasks.workunit.client.1.smithi129.stdout:2/847: mknod d7/d1f/c10a 0 2024-03-18T14:43:27.010 INFO:tasks.workunit.client.0.smithi087.stdout:4/961: write d2/d13/fec [135003,112481] 0 2024-03-18T14:43:27.011 INFO:tasks.workunit.client.1.smithi129.stdout:9/815: rename d0/f1e to d0/db/d6f/dda/f109 0 2024-03-18T14:43:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/821: dread d3/d30/df/f5f [0,4194304] 0 2024-03-18T14:43:27.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/822: write d3/fdc [1665229,43043] 0 2024-03-18T14:43:27.014 INFO:tasks.workunit.client.1.smithi129.stdout:4/757: link d0/d19/d46/d3e/d21/d32/f57 d0/d3c/d6c/ff4 0 2024-03-18T14:43:27.015 INFO:tasks.workunit.client.0.smithi087.stdout:6/934: truncate d3/d7/d25/d62/d7c/d29/d22/d134/f139 793317 0 2024-03-18T14:43:27.015 INFO:tasks.workunit.client.0.smithi087.stdout:6/935: stat d3 0 2024-03-18T14:43:27.016 INFO:tasks.workunit.client.0.smithi087.stdout:0/970: write d0/d1a/d7b/d26/ff5 [563390,83241] 0 2024-03-18T14:43:27.016 INFO:tasks.workunit.client.0.smithi087.stdout:4/962: dread d2/db/de/f2f [0,4194304] 0 2024-03-18T14:43:27.017 INFO:tasks.workunit.client.1.smithi129.stdout:3/788: creat d4/d11/d1d/d50/d91/f10b x:0 0 0 2024-03-18T14:43:27.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/814: mknod d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/c101 0 2024-03-18T14:43:27.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/936: rmdir d3/d7/d25/d62/d7c/d29/dce/dd9 39 2024-03-18T14:43:27.020 INFO:tasks.workunit.client.0.smithi087.stdout:6/937: dread - d3/d7/d25/d62/d7c/d29/ffe zero size 2024-03-18T14:43:27.021 INFO:tasks.workunit.client.0.smithi087.stdout:4/963: fsync d2/db/d84/d87/f9b 0 2024-03-18T14:43:27.021 INFO:tasks.workunit.client.0.smithi087.stdout:0/971: fsync d0/d1a/d7b/d26/f2c 0 2024-03-18T14:43:27.023 INFO:tasks.workunit.client.0.smithi087.stdout:8/965: dread d1/f2c [0,4194304] 0 2024-03-18T14:43:27.023 INFO:tasks.workunit.client.1.smithi129.stdout:0/833: truncate d0/d23/d35/d50/fab 1379774 0 2024-03-18T14:43:27.024 INFO:tasks.workunit.client.1.smithi129.stdout:0/834: fdatasync d0/d23/d35/f69 0 2024-03-18T14:43:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:8/832: rename d9/d11/f100 to d9/d11/d1a/d32/d3a/d5d/f112 0 2024-03-18T14:43:27.029 INFO:tasks.workunit.client.1.smithi129.stdout:1/793: write d1/d2/d28/d65/d19/d52/fa2 [29984,114792] 0 2024-03-18T14:43:27.030 INFO:tasks.workunit.client.0.smithi087.stdout:0/972: fsync d0/fc 0 2024-03-18T14:43:27.033 INFO:tasks.workunit.client.0.smithi087.stdout:6/938: link d3/d7/d25/d8e/l10d d3/d7/d25/dfb/l143 0 2024-03-18T14:43:27.034 INFO:tasks.workunit.client.1.smithi129.stdout:1/794: dread d1/d2/d28/d65/d19/d84/fc7 [0,4194304] 0 2024-03-18T14:43:27.034 INFO:tasks.workunit.client.1.smithi129.stdout:7/815: creat d4/d2d/d2e/d42/d58/f102 x:0 0 0 2024-03-18T14:43:27.035 INFO:tasks.workunit.client.0.smithi087.stdout:0/973: mkdir d0/d1a/d80/d88/dbd/d143 0 2024-03-18T14:43:27.036 INFO:tasks.workunit.client.1.smithi129.stdout:4/758: dread d0/f1c [0,4194304] 0 2024-03-18T14:43:27.036 INFO:tasks.workunit.client.1.smithi129.stdout:1/795: write d1/d2/d28/d65/d19/dc9/d87/fa9 [560168,29628] 0 2024-03-18T14:43:27.037 INFO:tasks.workunit.client.0.smithi087.stdout:8/966: rename d1/d6/d14/f110 to d1/d6/f148 0 2024-03-18T14:43:27.037 INFO:tasks.workunit.client.0.smithi087.stdout:8/967: fdatasync d1/d6/d2f/f91 0 2024-03-18T14:43:27.040 INFO:tasks.workunit.client.1.smithi129.stdout:0/835: creat d0/d23/d35/d3b/d42/dc0/ffb x:0 0 0 2024-03-18T14:43:27.041 INFO:tasks.workunit.client.1.smithi129.stdout:2/848: write d7/d1c/d32/fe0 [149502,65296] 0 2024-03-18T14:43:27.042 INFO:tasks.workunit.client.0.smithi087.stdout:8/968: rename d1/d6/d2f/d44/dfc/d107/ce0 to d1/d6/d2f/d44/d4b/d146/c149 0 2024-03-18T14:43:27.042 INFO:tasks.workunit.client.1.smithi129.stdout:2/849: stat d7/d1c/d62/lf9 0 2024-03-18T14:43:27.042 INFO:tasks.workunit.client.1.smithi129.stdout:8/833: mknod d9/d11/d1a/d14/d60/c113 0 2024-03-18T14:43:27.043 INFO:tasks.workunit.client.1.smithi129.stdout:9/816: dwrite d0/db/d11/d97/dd1/d6c/dfa/d101/d70/fa6 [0,4194304] 0 2024-03-18T14:43:27.044 INFO:tasks.workunit.client.0.smithi087.stdout:6/939: dread d3/d7/d25/d62/d7c/d29/d22/f7a [0,4194304] 0 2024-03-18T14:43:27.044 INFO:tasks.workunit.client.1.smithi129.stdout:3/789: creat d4/dd/d1f/d5f/f10c x:0 0 0 2024-03-18T14:43:27.047 INFO:tasks.workunit.client.1.smithi129.stdout:1/796: mknod d1/d2/d28/d65/d72/cfc 0 2024-03-18T14:43:27.047 INFO:tasks.workunit.client.0.smithi087.stdout:8/969: creat d1/d6/d9/d5d/d87/da2/df0/f14a x:0 0 0 2024-03-18T14:43:27.048 INFO:tasks.workunit.client.0.smithi087.stdout:6/940: symlink d3/d7/d25/dfb/d120/l144 0 2024-03-18T14:43:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:3/790: dread d4/dd/f32 [0,4194304] 0 2024-03-18T14:43:27.048 INFO:tasks.workunit.client.1.smithi129.stdout:0/836: rmdir d0/d23/d35/d50 39 2024-03-18T14:43:27.048 INFO:tasks.workunit.client.0.smithi087.stdout:4/964: dread d2/db/d67/f78 [0,4194304] 0 2024-03-18T14:43:27.049 INFO:tasks.workunit.client.1.smithi129.stdout:1/797: dread - d1/d2/d28/d65/d19/dc9/d87/f9b zero size 2024-03-18T14:43:27.049 INFO:tasks.workunit.client.1.smithi129.stdout:3/791: write d4/d38/f1c [2871401,123846] 0 2024-03-18T14:43:27.050 INFO:tasks.workunit.client.1.smithi129.stdout:2/850: mkdir d7/d1c/d79/dd5/d10b 0 2024-03-18T14:43:27.052 INFO:tasks.workunit.client.1.smithi129.stdout:7/816: symlink d4/d2d/d2e/d42/l103 0 2024-03-18T14:43:27.052 INFO:tasks.workunit.client.0.smithi087.stdout:8/970: dwrite d1/d6/d2f/d44/d45/fa4 [8388608,4194304] 0 2024-03-18T14:43:27.053 INFO:tasks.workunit.client.0.smithi087.stdout:6/941: creat d3/d7/d25/d62/d7c/da0/dbe/db6/f145 x:0 0 0 2024-03-18T14:43:27.054 INFO:tasks.workunit.client.1.smithi129.stdout:8/834: dread d9/d11/d1a/d14/f5e [0,4194304] 0 2024-03-18T14:43:27.054 INFO:tasks.workunit.client.1.smithi129.stdout:1/798: dwrite d1/d2/d28/d65/d19/ff7 [0,4194304] 0 2024-03-18T14:43:27.055 INFO:tasks.workunit.client.1.smithi129.stdout:8/835: chown d9/f102 1 1 2024-03-18T14:43:27.055 INFO:tasks.workunit.client.1.smithi129.stdout:7/817: fdatasync d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/fc0 0 2024-03-18T14:43:27.056 INFO:tasks.workunit.client.1.smithi129.stdout:5/778: rename d0/dc/d18/d2b/d71 to d0/d32/d3a/df2 0 2024-03-18T14:43:27.056 INFO:tasks.workunit.client.1.smithi129.stdout:1/799: dread - d1/d2/d28/d65/d19/dc9/d71/ff5 zero size 2024-03-18T14:43:27.057 INFO:tasks.workunit.client.1.smithi129.stdout:0/837: mkdir d0/d23/d71/dc2/d4a/d7a/dbd/dfc 0 2024-03-18T14:43:27.061 INFO:tasks.workunit.client.1.smithi129.stdout:4/759: truncate d0/d9/d4c/f90 266992 0 2024-03-18T14:43:27.066 INFO:tasks.workunit.client.0.smithi087.stdout:6/942: dread d3/d7/d25/d62/d7c/d29/d22/f2c [0,4194304] 0 2024-03-18T14:43:27.069 INFO:tasks.workunit.client.0.smithi087.stdout:6/943: symlink d3/d7/d25/d62/d7c/da0/d96/d97/l146 0 2024-03-18T14:43:27.070 INFO:tasks.workunit.client.1.smithi129.stdout:6/823: rename d3/d30/de/d65/d80/fd9 to d3/d6/d7f/d8f/f107 0 2024-03-18T14:43:27.070 INFO:tasks.workunit.client.0.smithi087.stdout:6/944: readlink d3/d7/d25/d62/d7c/d29/d22/la4 0 2024-03-18T14:43:27.071 INFO:tasks.workunit.client.0.smithi087.stdout:4/965: dread d2/f5b [0,4194304] 0 2024-03-18T14:43:27.071 INFO:tasks.workunit.client.1.smithi129.stdout:1/800: creat d1/db2/dc3/de7/ffd x:0 0 0 2024-03-18T14:43:27.072 INFO:tasks.workunit.client.1.smithi129.stdout:0/838: dread - d0/d23/d35/d50/fda zero size 2024-03-18T14:43:27.074 INFO:tasks.workunit.client.1.smithi129.stdout:4/760: truncate d0/d19/d46/d3e/d21/d32/f83 144318 0 2024-03-18T14:43:27.074 INFO:tasks.workunit.client.0.smithi087.stdout:4/966: truncate d2/db/d24/d30/f100 1987978 0 2024-03-18T14:43:27.075 INFO:tasks.workunit.client.1.smithi129.stdout:8/836: fsync d9/d11/d1a/d32/d3a/f8f 0 2024-03-18T14:43:27.075 INFO:tasks.workunit.client.0.smithi087.stdout:6/945: dwrite d3/d7/d25/d8e/fdd [4194304,4194304] 0 2024-03-18T14:43:27.075 INFO:tasks.workunit.client.1.smithi129.stdout:8/837: write d9/d11/f3b [4086804,128875] 0 2024-03-18T14:43:27.076 INFO:tasks.workunit.client.0.smithi087.stdout:4/967: fdatasync d2/db/d24/d30/d7b/dbe/fea 0 2024-03-18T14:43:27.078 INFO:tasks.workunit.client.0.smithi087.stdout:6/946: creat d3/d7/d25/d62/d8b/d106/f147 x:0 0 0 2024-03-18T14:43:27.079 INFO:tasks.workunit.client.0.smithi087.stdout:4/968: symlink d2/db/d24/d30/d7b/dbe/dcf/def/l142 0 2024-03-18T14:43:27.079 INFO:tasks.workunit.client.1.smithi129.stdout:5/779: write d0/dc/d18/f8d [179026,108817] 0 2024-03-18T14:43:27.080 INFO:tasks.workunit.client.1.smithi129.stdout:5/780: read - d0/fd2 zero size 2024-03-18T14:43:27.081 INFO:tasks.workunit.client.1.smithi129.stdout:7/818: dwrite d4/d2d/d2e/d79/dc6/d38/d49/f65 [0,4194304] 0 2024-03-18T14:43:27.083 INFO:tasks.workunit.client.0.smithi087.stdout:8/971: dread d1/f1b [0,4194304] 0 2024-03-18T14:43:27.083 INFO:tasks.workunit.client.0.smithi087.stdout:0/974: sync 2024-03-18T14:43:27.084 INFO:tasks.workunit.client.0.smithi087.stdout:8/972: readlink d1/d6/d2f/d44/d45/d71/dec/l101 0 2024-03-18T14:43:27.084 INFO:tasks.workunit.client.0.smithi087.stdout:6/947: truncate d3/d7/d25/d62/d7c/d29/d22/d75/f9b 991394 0 2024-03-18T14:43:27.085 INFO:tasks.workunit.client.1.smithi129.stdout:9/817: rename d0/db/d11/d97/dd1/d26/c3a to d0/db/d2e/d9f/c10a 0 2024-03-18T14:43:27.086 INFO:tasks.workunit.client.1.smithi129.stdout:9/818: write d0/db/d2e/d9d/fba [889664,9931] 0 2024-03-18T14:43:27.086 INFO:tasks.workunit.client.0.smithi087.stdout:0/975: mknod d0/d1a/d34/d3d/dd6/c144 0 2024-03-18T14:43:27.087 INFO:tasks.workunit.client.1.smithi129.stdout:6/824: creat d3/d6/d82/d9a/dbe/f108 x:0 0 0 2024-03-18T14:43:27.087 INFO:tasks.workunit.client.0.smithi087.stdout:0/976: stat d0/d1a/l101 0 2024-03-18T14:43:27.088 INFO:tasks.workunit.client.0.smithi087.stdout:8/973: creat d1/d6/d14/db2/dbc/d111/f14b x:0 0 0 2024-03-18T14:43:27.088 INFO:tasks.workunit.client.0.smithi087.stdout:6/948: dread d3/d7/d25/d62/d7c/d29/dce/fe1 [0,4194304] 0 2024-03-18T14:43:27.089 INFO:tasks.workunit.client.1.smithi129.stdout:4/761: mknod d0/d19/d46/d3e/d21/cf5 0 2024-03-18T14:43:27.089 INFO:tasks.workunit.client.0.smithi087.stdout:8/974: stat d1/d6/d2f/d9b/fbe 0 2024-03-18T14:43:27.090 INFO:tasks.workunit.client.0.smithi087.stdout:4/969: link d2/db/d24/d30/d7b/dbe/dcf/c12b d2/c143 0 2024-03-18T14:43:27.090 INFO:tasks.workunit.client.1.smithi129.stdout:8/838: creat d9/d11/d1a/d32/d41/d4d/d103/f114 x:0 0 0 2024-03-18T14:43:27.093 INFO:tasks.workunit.client.0.smithi087.stdout:0/977: creat d0/d2/d4/de8/dad/dea/da3/da8/f145 x:0 0 0 2024-03-18T14:43:27.095 INFO:tasks.workunit.client.0.smithi087.stdout:6/949: unlink d3/d7/d25/d62/d7c/da0/d96/d97/l146 0 2024-03-18T14:43:27.095 INFO:tasks.workunit.client.1.smithi129.stdout:3/792: rename d4/d11/d1d/d50/d90/dea to d4/d11/d1d/d50/d90/dac/de8/d10d 0 2024-03-18T14:43:27.097 INFO:tasks.workunit.client.0.smithi087.stdout:6/950: creat d3/d7/d25/d62/d7c/da0/dbe/db6/f148 x:0 0 0 2024-03-18T14:43:27.097 INFO:tasks.workunit.client.1.smithi129.stdout:0/839: unlink d0/d14/l1f 0 2024-03-18T14:43:27.097 INFO:tasks.workunit.client.1.smithi129.stdout:0/840: fsync d0/f72 0 2024-03-18T14:43:27.097 INFO:tasks.workunit.client.0.smithi087.stdout:0/978: mknod d0/d1a/de6/c146 0 2024-03-18T14:43:27.098 INFO:tasks.workunit.client.1.smithi129.stdout:2/851: link d7/d1c/d32/f77 d7/d1c/d79/dd5/f10c 0 2024-03-18T14:43:27.098 INFO:tasks.workunit.client.0.smithi087.stdout:0/979: write d0/d2/d4/d27/dc3/f10e [965972,88838] 0 2024-03-18T14:43:27.099 INFO:tasks.workunit.client.0.smithi087.stdout:6/951: read d3/d7/d25/d62/d7c/d29/f8a [356864,56656] 0 2024-03-18T14:43:27.102 INFO:tasks.workunit.client.1.smithi129.stdout:0/841: dwrite d0/d23/d71/fc3 [0,4194304] 0 2024-03-18T14:43:27.105 INFO:tasks.workunit.client.1.smithi129.stdout:7/819: write d4/d2d/d2e/fe1 [850094,73716] 0 2024-03-18T14:43:27.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/762: mknod d0/d19/d46/cf6 0 2024-03-18T14:43:27.108 INFO:tasks.workunit.client.1.smithi129.stdout:8/839: fsync d9/d33/fc4 0 2024-03-18T14:43:27.109 INFO:tasks.workunit.client.1.smithi129.stdout:5/781: dwrite d0/f2 [0,4194304] 0 2024-03-18T14:43:27.109 INFO:tasks.workunit.client.1.smithi129.stdout:5/782: stat d0/dc/d18/d2b/l6b 0 2024-03-18T14:43:27.111 INFO:tasks.workunit.client.1.smithi129.stdout:1/801: rename d1/d2/d28/d65/d19/dc9/d87/d8c/l8d to d1/db2/dc3/dc8/lfe 0 2024-03-18T14:43:27.113 INFO:tasks.workunit.client.1.smithi129.stdout:3/793: creat d4/d11/d34/df8/dd4/f10e x:0 0 0 2024-03-18T14:43:27.113 INFO:tasks.workunit.client.0.smithi087.stdout:0/980: creat d0/d2/d6b/d7c/f147 x:0 0 0 2024-03-18T14:43:27.114 INFO:tasks.workunit.client.1.smithi129.stdout:6/825: unlink d3/d30/df/d28/l96 0 2024-03-18T14:43:27.115 INFO:tasks.workunit.client.0.smithi087.stdout:6/952: creat d3/d7/d25/d62/d7c/d29/de7/f149 x:0 0 0 2024-03-18T14:43:27.115 INFO:tasks.workunit.client.0.smithi087.stdout:8/975: dread d1/d6/d2f/d44/d4b/f4c [0,4194304] 0 2024-03-18T14:43:27.115 INFO:tasks.workunit.client.1.smithi129.stdout:6/826: fsync d3/d6/d7f/d8f/fef 0 2024-03-18T14:43:27.118 INFO:tasks.workunit.client.0.smithi087.stdout:8/976: symlink d1/d6/d2f/d9b/l14c 0 2024-03-18T14:43:27.119 INFO:tasks.workunit.client.0.smithi087.stdout:4/970: dwrite d2/db/f80 [0,4194304] 0 2024-03-18T14:43:27.120 INFO:tasks.workunit.client.1.smithi129.stdout:7/820: symlink d4/d8c/d9e/l104 0 2024-03-18T14:43:27.122 INFO:tasks.workunit.client.1.smithi129.stdout:5/783: mknod d0/d32/d3a/d52/d69/cf3 0 2024-03-18T14:43:27.124 INFO:tasks.workunit.client.1.smithi129.stdout:1/802: mknod d1/db2/cff 0 2024-03-18T14:43:27.124 INFO:tasks.workunit.client.1.smithi129.stdout:2/852: dread d7/d1f/d20/d36/da9/dc1/da5/dc4/fd9 [0,4194304] 0 2024-03-18T14:43:27.126 INFO:tasks.workunit.client.1.smithi129.stdout:3/794: rmdir d4/d11/d34/d53 39 2024-03-18T14:43:27.126 INFO:tasks.workunit.client.1.smithi129.stdout:3/795: read - d4/d38/da3/dc9/feb zero size 2024-03-18T14:43:27.126 INFO:tasks.workunit.client.0.smithi087.stdout:4/971: rmdir d2/db/d24/d30/d7b 39 2024-03-18T14:43:27.127 INFO:tasks.workunit.client.1.smithi129.stdout:6/827: truncate d3/d30/de/d6c/f53 1408267 0 2024-03-18T14:43:27.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/763: creat d0/d3c/d6c/d89/de7/ff7 x:0 0 0 2024-03-18T14:43:27.131 INFO:tasks.workunit.client.1.smithi129.stdout:4/764: fdatasync d0/d19/d46/d3e/d21/d4d/d58/f96 0 2024-03-18T14:43:27.131 INFO:tasks.workunit.client.0.smithi087.stdout:0/981: dwrite d0/d2/d4/d8b/fa6 [4194304,4194304] 0 2024-03-18T14:43:27.131 INFO:tasks.workunit.client.1.smithi129.stdout:2/853: dread - d7/d3f/fa0 zero size 2024-03-18T14:43:27.132 INFO:tasks.workunit.client.0.smithi087.stdout:4/972: mknod d2/d13/d28/c144 0 2024-03-18T14:43:27.134 INFO:tasks.workunit.client.1.smithi129.stdout:3/796: truncate d4/dd/d1f/d5f/d31/f98 125344 0 2024-03-18T14:43:27.135 INFO:tasks.workunit.client.1.smithi129.stdout:6/828: symlink d3/d6/d7f/l109 0 2024-03-18T14:43:27.135 INFO:tasks.workunit.client.1.smithi129.stdout:6/829: chown d3/d30/de/cf1 0 1 2024-03-18T14:43:27.136 INFO:tasks.workunit.client.0.smithi087.stdout:4/973: read - d2/db/d24/d30/d7b/dbe/dc6/f119 zero size 2024-03-18T14:43:27.136 INFO:tasks.workunit.client.0.smithi087.stdout:0/982: mknod d0/d1a/d107/c148 0 2024-03-18T14:43:27.137 INFO:tasks.workunit.client.0.smithi087.stdout:4/974: write d2/f36 [1061360,379] 0 2024-03-18T14:43:27.138 INFO:tasks.workunit.client.1.smithi129.stdout:9/819: rename d0/db/d11/d97/dd1/d25 to d0/db/d10b 0 2024-03-18T14:43:27.138 INFO:tasks.workunit.client.0.smithi087.stdout:0/983: chown d0/d2/d4/d27/dc3/l12b 268575143 1 2024-03-18T14:43:27.139 INFO:tasks.workunit.client.0.smithi087.stdout:4/975: write d2/dc2/dce/f129 [203519,40867] 0 2024-03-18T14:43:27.139 INFO:tasks.workunit.client.1.smithi129.stdout:3/797: dwrite d4/d11/d1d/f7f [0,4194304] 0 2024-03-18T14:43:27.140 INFO:tasks.workunit.client.1.smithi129.stdout:8/840: dread d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:27.141 INFO:tasks.workunit.client.0.smithi087.stdout:6/953: dwrite d3/d7/f85 [0,4194304] 0 2024-03-18T14:43:27.142 INFO:tasks.workunit.client.0.smithi087.stdout:0/984: mkdir d0/d2/d4/d19/d149 0 2024-03-18T14:43:27.144 INFO:tasks.workunit.client.0.smithi087.stdout:4/976: creat d2/db/d24/d30/d56/f145 x:0 0 0 2024-03-18T14:43:27.147 INFO:tasks.workunit.client.0.smithi087.stdout:8/977: dread d1/d6/d2f/d44/d45/d71/fc8 [0,4194304] 0 2024-03-18T14:43:27.147 INFO:tasks.workunit.client.1.smithi129.stdout:5/784: creat d0/d32/d3a/d45/d83/dc8/ff4 x:0 0 0 2024-03-18T14:43:27.147 INFO:tasks.workunit.client.1.smithi129.stdout:0/842: getdents d0/d23/d6b 0 2024-03-18T14:43:27.152 INFO:tasks.workunit.client.1.smithi129.stdout:4/765: unlink d0/d19/d46/d3e/d21/d32/fdb 0 2024-03-18T14:43:27.152 INFO:tasks.workunit.client.1.smithi129.stdout:4/766: readlink d0/d19/d46/d3e/d33/l7c 0 2024-03-18T14:43:27.153 INFO:tasks.workunit.client.1.smithi129.stdout:7/821: write d4/d2d/d2e/d79/dc6/d38/d61/d68/f72 [93786,117340] 0 2024-03-18T14:43:27.156 INFO:tasks.workunit.client.0.smithi087.stdout:8/978: creat d1/d6/d2f/d44/d45/d71/daa/dad/f14d x:0 0 0 2024-03-18T14:43:27.158 INFO:tasks.workunit.client.0.smithi087.stdout:8/979: read d1/d6/d9/d5d/f8f [240225,76982] 0 2024-03-18T14:43:27.159 INFO:tasks.workunit.client.1.smithi129.stdout:3/798: creat d4/d38/da3/f10f x:0 0 0 2024-03-18T14:43:27.160 INFO:tasks.workunit.client.1.smithi129.stdout:8/841: chown d9/d11/d18/fd1 1384 1 2024-03-18T14:43:27.161 INFO:tasks.workunit.client.0.smithi087.stdout:6/954: write d3/d7/d25/d62/d7c/d29/d22/d75/d92/fe4 [174522,85326] 0 2024-03-18T14:43:27.161 INFO:tasks.workunit.client.1.smithi129.stdout:8/842: fdatasync d9/d11/d1a/d14/db7/ffa 0 2024-03-18T14:43:27.164 INFO:tasks.workunit.client.0.smithi087.stdout:6/955: symlink d3/d7/d25/d62/d7c/d29/d22/d75/l14a 0 2024-03-18T14:43:27.168 INFO:tasks.workunit.client.1.smithi129.stdout:6/830: mknod d3/d30/c10a 0 2024-03-18T14:43:27.168 INFO:tasks.workunit.client.0.smithi087.stdout:8/980: dwrite d1/d6/d2f/d44/d45/d72/db6/fca [0,4194304] 0 2024-03-18T14:43:27.169 INFO:tasks.workunit.client.0.smithi087.stdout:6/956: fdatasync d3/d7/d25/d8e/f110 0 2024-03-18T14:43:27.169 INFO:tasks.workunit.client.1.smithi129.stdout:2/854: dwrite d7/d1c/f74 [0,4194304] 0 2024-03-18T14:43:27.170 INFO:tasks.workunit.client.1.smithi129.stdout:3/799: mkdir d4/dd/d1f/d2f/dae/d110 0 2024-03-18T14:43:27.170 INFO:tasks.workunit.client.0.smithi087.stdout:8/981: mknod d1/d6/d8d/dcd/c14e 0 2024-03-18T14:43:27.170 INFO:tasks.workunit.client.1.smithi129.stdout:9/820: dwrite d0/db/d2e/d9f/faa [0,4194304] 0 2024-03-18T14:43:27.171 INFO:tasks.workunit.client.0.smithi087.stdout:0/985: dread d0/d1a/d7b/d26/d79/fd7 [0,4194304] 0 2024-03-18T14:43:27.171 INFO:tasks.workunit.client.0.smithi087.stdout:8/982: fdatasync d1/d6/d14/f1c 0 2024-03-18T14:43:27.172 INFO:tasks.workunit.client.1.smithi129.stdout:4/767: truncate d0/d9/d4c/f90 999245 0 2024-03-18T14:43:27.173 INFO:tasks.workunit.client.1.smithi129.stdout:4/768: write d0/d19/d46/fee [817868,15552] 0 2024-03-18T14:43:27.173 INFO:tasks.workunit.client.1.smithi129.stdout:7/822: mknod d4/d2d/d2e/d79/dc6/ddc/c105 0 2024-03-18T14:43:27.176 INFO:tasks.workunit.client.0.smithi087.stdout:0/986: rename d0/d1a/d34/d3d/c142 to d0/d1a/de6/c14a 0 2024-03-18T14:43:27.180 INFO:tasks.workunit.client.1.smithi129.stdout:7/823: dwrite d4/d2d/d2e/d79/dc6/d38/d61/d6a/f100 [0,4194304] 0 2024-03-18T14:43:27.181 INFO:tasks.workunit.client.1.smithi129.stdout:4/769: rename d0/d9/fdd to d0/d19/d46/d2e/ff8 0 2024-03-18T14:43:27.182 INFO:tasks.workunit.client.1.smithi129.stdout:4/770: read - d0/d3c/fb0 zero size 2024-03-18T14:43:27.182 INFO:tasks.workunit.client.1.smithi129.stdout:5/785: getdents d0/d32/d3a/d45/d83/ddf/dc4 0 2024-03-18T14:43:27.184 INFO:tasks.workunit.client.0.smithi087.stdout:6/957: mkdir d3/d7/d25/d62/d7c/d14b 0 2024-03-18T14:43:27.184 INFO:tasks.workunit.client.0.smithi087.stdout:8/983: creat d1/d6/d8d/dc2/d130/f14f x:0 0 0 2024-03-18T14:43:27.184 INFO:tasks.workunit.client.0.smithi087.stdout:0/987: unlink d0/d1a/d7b/d2a/f140 0 2024-03-18T14:43:27.186 INFO:tasks.workunit.client.1.smithi129.stdout:8/843: truncate d9/d11/d18/f3f 5224090 0 2024-03-18T14:43:27.186 INFO:tasks.workunit.client.1.smithi129.stdout:1/803: sync 2024-03-18T14:43:27.186 INFO:tasks.workunit.client.0.smithi087.stdout:6/958: chown d3/d7/d25/d62/d7c/d29/d22/l102 107 1 2024-03-18T14:43:27.188 INFO:tasks.workunit.client.0.smithi087.stdout:0/988: mknod d0/d1a/d34/d3d/c14b 0 2024-03-18T14:43:27.188 INFO:tasks.workunit.client.1.smithi129.stdout:3/800: truncate d4/fa1 1986931 0 2024-03-18T14:43:27.189 INFO:tasks.workunit.client.1.smithi129.stdout:3/801: write d4/d38/f1c [1666851,78391] 0 2024-03-18T14:43:27.190 INFO:tasks.workunit.client.1.smithi129.stdout:3/802: chown d4/d38/da3/dc9/l88 0 1 2024-03-18T14:43:27.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/984: mkdir d1/d6/d8d/dc2/dda/d117/d150 0 2024-03-18T14:43:27.190 INFO:tasks.workunit.client.0.smithi087.stdout:8/985: stat d1/d6/d2f/d44/d4b/f108 0 2024-03-18T14:43:27.192 INFO:tasks.workunit.client.0.smithi087.stdout:0/989: fdatasync d0/d7f/fd4 0 2024-03-18T14:43:27.193 INFO:tasks.workunit.client.1.smithi129.stdout:0/843: dwrite d0/d23/d35/d50/fab [0,4194304] 0 2024-03-18T14:43:27.194 INFO:tasks.workunit.client.1.smithi129.stdout:4/771: symlink d0/d9/d85/lf9 0 2024-03-18T14:43:27.195 INFO:tasks.workunit.client.1.smithi129.stdout:5/786: readlink d0/d32/d3a/df2/l7f 0 2024-03-18T14:43:27.196 INFO:tasks.workunit.client.1.smithi129.stdout:6/831: mknod d3/d30/df/d28/c10b 0 2024-03-18T14:43:27.201 INFO:tasks.workunit.client.0.smithi087.stdout:0/990: link d0/d1a/d80/f95 d0/d1a/d7b/d2a/d85/f14c 0 2024-03-18T14:43:27.201 INFO:tasks.workunit.client.0.smithi087.stdout:0/991: read d0/d1a/de6/f117 [181960,12049] 0 2024-03-18T14:43:27.204 INFO:tasks.workunit.client.1.smithi129.stdout:9/821: dread d0/db/d2e/f50 [0,4194304] 0 2024-03-18T14:43:27.205 INFO:tasks.workunit.client.1.smithi129.stdout:5/787: mknod d0/d32/d3a/d45/d83/ddf/dc4/cf5 0 2024-03-18T14:43:27.206 INFO:tasks.workunit.client.1.smithi129.stdout:5/788: readlink d0/dc/d1a/l41 0 2024-03-18T14:43:27.206 INFO:tasks.workunit.client.0.smithi087.stdout:6/959: truncate d3/d7/d25/d62/d7c/d46/d121/f138 2501637 0 2024-03-18T14:43:27.207 INFO:tasks.workunit.client.1.smithi129.stdout:2/855: getdents d7/d1f/d20/d2b/d41/da6/ded 0 2024-03-18T14:43:27.207 INFO:tasks.workunit.client.0.smithi087.stdout:6/960: stat d3/d7/cd0 0 2024-03-18T14:43:27.207 INFO:tasks.workunit.client.0.smithi087.stdout:8/986: write d1/d6/d2f/d44/f52 [1866481,87844] 0 2024-03-18T14:43:27.207 INFO:tasks.workunit.client.0.smithi087.stdout:6/961: chown d3/d7/dbd/fca 6 1 2024-03-18T14:43:27.208 INFO:tasks.workunit.client.0.smithi087.stdout:6/962: fsync d3/d7/d25/d62/d8b/fa1 0 2024-03-18T14:43:27.210 INFO:tasks.workunit.client.0.smithi087.stdout:4/977: sync 2024-03-18T14:43:27.210 INFO:tasks.workunit.client.1.smithi129.stdout:0/844: dread d0/d23/d35/d50/f77 [0,4194304] 0 2024-03-18T14:43:27.210 INFO:tasks.workunit.client.0.smithi087.stdout:6/963: read d3/d7/d25/d62/d7c/d29/d22/d23/da9/fc1 [19701,8446] 0 2024-03-18T14:43:27.210 INFO:tasks.workunit.client.0.smithi087.stdout:8/987: write d1/d6/d2f/d44/d45/d50/f5e [720788,74601] 0 2024-03-18T14:43:27.211 INFO:tasks.workunit.client.1.smithi129.stdout:7/824: write d4/d2d/d2e/d79/dc6/d38/d61/d6a/dba/fea [2428348,97292] 0 2024-03-18T14:43:27.211 INFO:tasks.workunit.client.0.smithi087.stdout:4/978: write d2/dc2/fd0 [1620274,125355] 0 2024-03-18T14:43:27.213 INFO:tasks.workunit.client.1.smithi129.stdout:1/804: write d1/d2/d28/d65/d19/d52/f58 [611546,100591] 0 2024-03-18T14:43:27.214 INFO:tasks.workunit.client.0.smithi087.stdout:4/979: mkdir d2/db/d146 0 2024-03-18T14:43:27.216 INFO:tasks.workunit.client.0.smithi087.stdout:4/980: read d2/db/fe1 [74684,84650] 0 2024-03-18T14:43:27.216 INFO:tasks.workunit.client.0.smithi087.stdout:8/988: rename d1/d6/d2f/d44/d45/d72/d7f/c12c to d1/d6/d2f/d44/dfc/d107/c151 0 2024-03-18T14:43:27.221 INFO:tasks.workunit.client.1.smithi129.stdout:3/803: rename d4/d11 to d4/dd/d1f/d111 0 2024-03-18T14:43:27.221 INFO:tasks.workunit.client.0.smithi087.stdout:4/981: mknod d2/db/d24/d30/d56/c147 0 2024-03-18T14:43:27.222 INFO:tasks.workunit.client.0.smithi087.stdout:8/989: symlink d1/d6/d9/d5d/d87/dd1/l152 0 2024-03-18T14:43:27.222 INFO:tasks.workunit.client.0.smithi087.stdout:4/982: write d2/db/d84/d87/fed [596615,71464] 0 2024-03-18T14:43:27.222 INFO:tasks.workunit.client.1.smithi129.stdout:8/844: truncate d9/d11/d53/f80 1601103 0 2024-03-18T14:43:27.222 INFO:tasks.workunit.client.0.smithi087.stdout:6/964: link d3/d7/d25/d62/d7c/d29/c51 d3/d7/d25/d62/d7c/d29/d22/d134/c14c 0 2024-03-18T14:43:27.223 INFO:tasks.workunit.client.1.smithi129.stdout:4/772: truncate d0/d19/d46/fee 1232502 0 2024-03-18T14:43:27.223 INFO:tasks.workunit.client.0.smithi087.stdout:8/990: chown d1/d6/d14/db2/l106 603995 1 2024-03-18T14:43:27.224 INFO:tasks.workunit.client.0.smithi087.stdout:0/992: dread d0/d1a/d34/d3d/dd6/f108 [0,4194304] 0 2024-03-18T14:43:27.226 INFO:tasks.workunit.client.1.smithi129.stdout:0/845: creat d0/d14/d28/ffd x:0 0 0 2024-03-18T14:43:27.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/825: mknod d4/d2d/d2e/d79/dc6/d38/d61/d68/c106 0 2024-03-18T14:43:27.229 INFO:tasks.workunit.client.0.smithi087.stdout:4/983: getdents d2/db/d24/d30/d7b/d7f/da5 0 2024-03-18T14:43:27.229 INFO:tasks.workunit.client.0.smithi087.stdout:0/993: dwrite d0/d2/d4/d27/dc3/dd2/f112 [0,4194304] 0 2024-03-18T14:43:27.229 INFO:tasks.workunit.client.1.smithi129.stdout:9/822: link d0/d15/fdc d0/db/d11/f10c 0 2024-03-18T14:43:27.232 INFO:tasks.workunit.client.1.smithi129.stdout:3/804: dread d4/dd/d1f/d111/d34/d3c/f81 [0,4194304] 0 2024-03-18T14:43:27.234 INFO:tasks.workunit.client.1.smithi129.stdout:9/823: dread d0/db/d11/d97/dd1/f85 [0,4194304] 0 2024-03-18T14:43:27.234 INFO:tasks.workunit.client.1.smithi129.stdout:8/845: unlink d9/d11/d18/l1c 0 2024-03-18T14:43:27.235 INFO:tasks.workunit.client.1.smithi129.stdout:8/846: chown d9/d33/dc2/ddc/fe3 89260247 1 2024-03-18T14:43:27.236 INFO:tasks.workunit.client.1.smithi129.stdout:9/824: write d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f102 [883625,4337] 0 2024-03-18T14:43:27.236 INFO:tasks.workunit.client.0.smithi087.stdout:8/991: write d1/d6/d2f/f41 [447256,64159] 0 2024-03-18T14:43:27.236 INFO:tasks.workunit.client.1.smithi129.stdout:8/847: readlink d9/d11/d55/d6a/l71 0 2024-03-18T14:43:27.237 INFO:tasks.workunit.client.0.smithi087.stdout:0/994: write d0/d2/d4/de8/dad/f105 [639176,69] 0 2024-03-18T14:43:27.241 INFO:tasks.workunit.client.1.smithi129.stdout:8/848: dwrite d9/fe4 [0,4194304] 0 2024-03-18T14:43:27.241 INFO:tasks.workunit.client.1.smithi129.stdout:5/789: write d0/fb5 [811711,37674] 0 2024-03-18T14:43:27.241 INFO:tasks.workunit.client.1.smithi129.stdout:1/805: write d1/db2/de2/fa5 [1433448,126443] 0 2024-03-18T14:43:27.241 INFO:tasks.workunit.client.1.smithi129.stdout:4/773: dread d0/d19/d46/d3e/d33/f8b [0,4194304] 0 2024-03-18T14:43:27.241 INFO:tasks.workunit.client.0.smithi087.stdout:0/995: mkdir d0/d1a/d34/d3d/d14d 0 2024-03-18T14:43:27.242 INFO:tasks.workunit.client.0.smithi087.stdout:4/984: getdents d2/db/d24/d30/d7b/dbe 0 2024-03-18T14:43:27.243 INFO:tasks.workunit.client.0.smithi087.stdout:6/965: dread d3/d7/d25/f7b [0,4194304] 0 2024-03-18T14:43:27.244 INFO:tasks.workunit.client.0.smithi087.stdout:6/966: write d3/d7/d25/d62/d7c/d29/d22/d75/d92/f104 [787838,25347] 0 2024-03-18T14:43:27.245 INFO:tasks.workunit.client.0.smithi087.stdout:0/996: rename d0/d2/d4/de8/dad/dea/d5d/d78/l9c to d0/d2/d6b/d7c/l14e 0 2024-03-18T14:43:27.246 INFO:tasks.workunit.client.1.smithi129.stdout:3/805: dread - d4/dd/d1f/d111/d1d/d36/f7e zero size 2024-03-18T14:43:27.247 INFO:tasks.workunit.client.0.smithi087.stdout:0/997: write d0/f50 [2796876,34009] 0 2024-03-18T14:43:27.247 INFO:tasks.workunit.client.1.smithi129.stdout:2/856: truncate d7/d1f/d20/d2b/d41/d65/d88/fe6 390544 0 2024-03-18T14:43:27.248 INFO:tasks.workunit.client.1.smithi129.stdout:2/857: readlink d7/d1f/d20/d36/da9/dc1/l2c 0 2024-03-18T14:43:27.249 INFO:tasks.workunit.client.1.smithi129.stdout:9/825: mknod d0/db/d2e/dd9/c10d 0 2024-03-18T14:43:27.249 INFO:tasks.workunit.client.0.smithi087.stdout:0/998: stat d0/d1a/d107 0 2024-03-18T14:43:27.249 INFO:tasks.workunit.client.1.smithi129.stdout:2/858: write d7/d1f/d20/d2b/d41/d65/d88/fd0 [529392,53847] 0 2024-03-18T14:43:27.250 INFO:tasks.workunit.client.1.smithi129.stdout:2/859: readlink d7/d1f/d20/d2a/d6b/l76 0 2024-03-18T14:43:27.250 INFO:tasks.workunit.client.1.smithi129.stdout:2/860: fsync d7/d1f/d20/d2b/f51 0 2024-03-18T14:43:27.251 INFO:tasks.workunit.client.0.smithi087.stdout:8/992: dwrite d1/d6/d14/f5b [4194304,4194304] 0 2024-03-18T14:43:27.251 INFO:tasks.workunit.client.0.smithi087.stdout:6/967: dwrite d3/d7/d25/d62/d7c/d29/d22/d75/d92/f113 [0,4194304] 0 2024-03-18T14:43:27.251 INFO:tasks.workunit.client.1.smithi129.stdout:8/849: mkdir d9/d11/d18/da4/dd2/d115 0 2024-03-18T14:43:27.252 INFO:tasks.workunit.client.0.smithi087.stdout:8/993: stat d1/d6/d8d/dcd 0 2024-03-18T14:43:27.252 INFO:tasks.workunit.client.1.smithi129.stdout:5/790: creat d0/dc/d1a/d61/ff6 x:0 0 0 2024-03-18T14:43:27.253 INFO:tasks.workunit.client.0.smithi087.stdout:0/999: creat d0/dab/d113/f14f x:0 0 0 2024-03-18T14:43:27.254 INFO:tasks.workunit.client.1.smithi129.stdout:4/774: creat d0/d19/d46/d3e/d21/d4d/d58/d61/dd5/ffa x:0 0 0 2024-03-18T14:43:27.254 INFO:tasks.workunit.client.0.smithi087.stdout:6/968: fdatasync d3/d7/d25/d62/d7c/f94 0 2024-03-18T14:43:27.256 INFO:tasks.workunit.client.1.smithi129.stdout:7/826: unlink d4/d8c/fda 0 2024-03-18T14:43:27.256 INFO:tasks.workunit.client.1.smithi129.stdout:7/827: stat d4/d2d/d2e/d42/d58/f102 0 2024-03-18T14:43:27.258 INFO:tasks.workunit.client.1.smithi129.stdout:6/832: rename d3/d6/d7f/db4/d57/f75 to d3/d30/df/f10c 0 2024-03-18T14:43:27.260 INFO:tasks.workunit.client.1.smithi129.stdout:2/861: mkdir d7/d1f/d20/d36/d10d 0 2024-03-18T14:43:27.261 INFO:tasks.workunit.client.1.smithi129.stdout:2/862: chown d7/d1f/d20/d2b/d41/d65/d88/fd0 2018284 1 2024-03-18T14:43:27.262 INFO:tasks.workunit.client.1.smithi129.stdout:5/791: creat d0/d32/d3a/de7/ff7 x:0 0 0 2024-03-18T14:43:27.270 INFO:tasks.workunit.client.1.smithi129.stdout:0/846: truncate d0/d23/d35/d3b/d42/dc0/fc5 232792 0 2024-03-18T14:43:27.272 INFO:tasks.workunit.client.1.smithi129.stdout:3/806: rename d4/dd/d1f/d111/d1d/d50/d91/d97/fe5 to d4/dd/d1f/d111/d34/df8/ded/f112 0 2024-03-18T14:43:27.273 INFO:tasks.workunit.client.0.smithi087.stdout:8/994: dwrite d1/d6/d9/d5d/d87/d88/fef [0,4194304] 0 2024-03-18T14:43:27.273 INFO:tasks.workunit.client.0.smithi087.stdout:6/969: dwrite d3/d7/d25/d62/d7c/da0/d96/d97/f13c [0,4194304] 0 2024-03-18T14:43:27.275 INFO:tasks.workunit.client.1.smithi129.stdout:8/850: write d9/d11/d1a/d32/d3a/d70/f8c [509520,104198] 0 2024-03-18T14:43:27.275 INFO:tasks.workunit.client.1.smithi129.stdout:1/806: truncate d1/d35/fbd 1426185 0 2024-03-18T14:43:27.279 INFO:tasks.workunit.client.1.smithi129.stdout:5/792: symlink d0/d32/d3a/d45/d83/ddf/lf8 0 2024-03-18T14:43:27.279 INFO:tasks.workunit.client.0.smithi087.stdout:6/970: dwrite d3/d7/d25/d62/d7c/d29/d22/d75/d92/fe4 [0,4194304] 0 2024-03-18T14:43:27.279 INFO:tasks.workunit.client.1.smithi129.stdout:4/775: dwrite d0/d19/d5d/fad [0,4194304] 0 2024-03-18T14:43:27.281 INFO:tasks.workunit.client.1.smithi129.stdout:0/847: truncate d0/d23/d71/dc2/d4a/fc1 3605321 0 2024-03-18T14:43:27.281 INFO:tasks.workunit.client.0.smithi087.stdout:6/971: readlink d3/d7/d25/d62/lf3 0 2024-03-18T14:43:27.282 INFO:tasks.workunit.client.1.smithi129.stdout:0/848: write d0/d14/d28/d63/d8d/fa7 [2539919,1768] 0 2024-03-18T14:43:27.282 INFO:tasks.workunit.client.0.smithi087.stdout:8/995: dwrite d1/d6/d2f/d44/d45/d71/daa/fb8 [0,4194304] 0 2024-03-18T14:43:27.284 INFO:tasks.workunit.client.1.smithi129.stdout:7/828: rename d4/d2d/dfc to d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107 0 2024-03-18T14:43:27.284 INFO:tasks.workunit.client.1.smithi129.stdout:6/833: write d3/d30/de/f58 [293623,3248] 0 2024-03-18T14:43:27.286 INFO:tasks.workunit.client.1.smithi129.stdout:6/834: read d3/d30/de/d65/d93/fa0 [1509629,57154] 0 2024-03-18T14:43:27.290 INFO:tasks.workunit.client.1.smithi129.stdout:2/863: write d7/f6e [265650,102543] 0 2024-03-18T14:43:27.292 INFO:tasks.workunit.client.0.smithi087.stdout:6/972: rename d3/d7/d25/d62/d7c/d29/d22/d134/f139 to d3/d7/d25/f14d 0 2024-03-18T14:43:27.292 INFO:tasks.workunit.client.0.smithi087.stdout:4/985: sync 2024-03-18T14:43:27.292 INFO:tasks.workunit.client.1.smithi129.stdout:1/807: creat d1/db2/f100 x:0 0 0 2024-03-18T14:43:27.293 INFO:tasks.workunit.client.1.smithi129.stdout:1/808: readlink d1/d2/l15 0 2024-03-18T14:43:27.293 INFO:tasks.workunit.client.1.smithi129.stdout:9/826: getdents d0/db/d1f/d4c 0 2024-03-18T14:43:27.295 INFO:tasks.workunit.client.1.smithi129.stdout:0/849: dread d0/d23/d6b/f89 [0,4194304] 0 2024-03-18T14:43:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:5/793: symlink d0/d32/d3a/d45/lf9 0 2024-03-18T14:43:27.297 INFO:tasks.workunit.client.1.smithi129.stdout:4/776: creat d0/d19/d46/d3e/d21/d4d/ffb x:0 0 0 2024-03-18T14:43:27.299 INFO:tasks.workunit.client.1.smithi129.stdout:8/851: symlink d9/d11/d1a/d66/l116 0 2024-03-18T14:43:27.300 INFO:tasks.workunit.client.1.smithi129.stdout:1/809: creat d1/d35/db8/f101 x:0 0 0 2024-03-18T14:43:27.301 INFO:tasks.workunit.client.1.smithi129.stdout:9/827: rmdir d0/db/d11/d97/dd1/d6c/dfa/d101 39 2024-03-18T14:43:27.302 INFO:tasks.workunit.client.0.smithi087.stdout:4/986: rename d2/db/d24/d30/d7b/d7f/da5/db4/db7/ld7 to d2/d13/d28/l148 0 2024-03-18T14:43:27.303 INFO:tasks.workunit.client.1.smithi129.stdout:0/850: creat d0/d23/d35/d3b/d42/dc0/ffe x:0 0 0 2024-03-18T14:43:27.303 INFO:tasks.workunit.client.1.smithi129.stdout:8/852: dwrite d9/d11/f3b [0,4194304] 0 2024-03-18T14:43:27.304 INFO:tasks.workunit.client.0.smithi087.stdout:4/987: write d2/db/d24/d30/d7b/d7f/da5/db4/f101 [2813450,126216] 0 2024-03-18T14:43:27.305 INFO:tasks.workunit.client.0.smithi087.stdout:4/988: dread - d2/db/d24/d30/d7b/dbe/dcf/def/d104/f110 zero size 2024-03-18T14:43:27.307 INFO:tasks.workunit.client.1.smithi129.stdout:5/794: creat d0/d32/d3a/de7/ffa x:0 0 0 2024-03-18T14:43:27.307 INFO:tasks.workunit.client.0.smithi087.stdout:6/973: rename d3/d7/d25/d62/d7c/d29/f13a to d3/d7/d25/d62/d7c/d29/d22/d75/f14e 0 2024-03-18T14:43:27.307 INFO:tasks.workunit.client.1.smithi129.stdout:5/795: readlink d0/d32/d3a/df2/l7f 0 2024-03-18T14:43:27.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/807: getdents d4/dd/d1f/d111/d34/dc0 0 2024-03-18T14:43:27.308 INFO:tasks.workunit.client.0.smithi087.stdout:4/989: truncate d2/db/d84/d87/f9b 367744 0 2024-03-18T14:43:27.308 INFO:tasks.workunit.client.1.smithi129.stdout:3/808: dread - d4/d38/da3/db1/fd5 zero size 2024-03-18T14:43:27.309 INFO:tasks.workunit.client.0.smithi087.stdout:4/990: dread - d2/db/d7a/f9e zero size 2024-03-18T14:43:27.311 INFO:tasks.workunit.client.0.smithi087.stdout:6/974: dwrite d3/d7/d25/d62/f10b [0,4194304] 0 2024-03-18T14:43:27.317 INFO:tasks.workunit.client.0.smithi087.stdout:4/991: creat d2/db/d82/d99/f149 x:0 0 0 2024-03-18T14:43:27.321 INFO:tasks.workunit.client.0.smithi087.stdout:4/992: dwrite d2/db/d24/d30/d8a/d95/f117 [0,4194304] 0 2024-03-18T14:43:27.325 INFO:tasks.workunit.client.1.smithi129.stdout:4/777: symlink d0/d19/lfc 0 2024-03-18T14:43:27.325 INFO:tasks.workunit.client.0.smithi087.stdout:4/993: dwrite d2/db/d24/f4c [4194304,4194304] 0 2024-03-18T14:43:27.325 INFO:tasks.workunit.client.1.smithi129.stdout:9/828: rename d0/db/d11/d97/dd1/d6c/dfa/d101/l7d to d0/db/d2e/l10e 0 2024-03-18T14:43:27.328 INFO:tasks.workunit.client.1.smithi129.stdout:7/829: getdents d4/d2d 0 2024-03-18T14:43:27.328 INFO:tasks.workunit.client.0.smithi087.stdout:8/996: dread d1/d6/d2f/d44/f52 [0,4194304] 0 2024-03-18T14:43:27.329 INFO:tasks.workunit.client.0.smithi087.stdout:4/994: mknod d2/db/d24/d30/d7b/d7f/da5/dae/c14a 0 2024-03-18T14:43:27.329 INFO:tasks.workunit.client.0.smithi087.stdout:8/997: dread - d1/d6/f148 zero size 2024-03-18T14:43:27.332 INFO:tasks.workunit.client.0.smithi087.stdout:4/995: mkdir d2/db/d24/d30/d7b/d7f/da5/db4/db7/d14b 0 2024-03-18T14:43:27.335 INFO:tasks.workunit.client.1.smithi129.stdout:3/809: rename d4/dd/df6 to d4/dd/d1f/d111/d1d/d36/d113 0 2024-03-18T14:43:27.337 INFO:tasks.workunit.client.1.smithi129.stdout:9/829: creat d0/db/d2e/d9d/dbb/f10f x:0 0 0 2024-03-18T14:43:27.339 INFO:tasks.workunit.client.1.smithi129.stdout:9/830: write d0/db/d11/d97/dd1/d6c/dfa/d101/d70/fb7 [960064,29158] 0 2024-03-18T14:43:27.340 INFO:tasks.workunit.client.0.smithi087.stdout:4/996: rename d2/f96 to d2/db/d24/d30/d49/d12d/ddb/d10e/f14c 0 2024-03-18T14:43:27.340 INFO:tasks.workunit.client.0.smithi087.stdout:6/975: dwrite d3/d7/d25/d62/d7c/d29/d22/d23/f33 [0,4194304] 0 2024-03-18T14:43:27.341 INFO:tasks.workunit.client.0.smithi087.stdout:4/997: fdatasync d2/db/d84/d87/fed 0 2024-03-18T14:43:27.341 INFO:tasks.workunit.client.1.smithi129.stdout:6/835: write d3/d30/f1e [4689401,117368] 0 2024-03-18T14:43:27.342 INFO:tasks.workunit.client.1.smithi129.stdout:7/830: fsync d4/d2d/d2e/d42/d58/f67 0 2024-03-18T14:43:27.343 INFO:tasks.workunit.client.1.smithi129.stdout:6/836: dread d3/d5/d46/f89 [0,4194304] 0 2024-03-18T14:43:27.343 INFO:tasks.workunit.client.1.smithi129.stdout:2/864: dread d7/d1c/f84 [0,4194304] 0 2024-03-18T14:43:27.345 INFO:tasks.workunit.client.0.smithi087.stdout:8/998: getdents d1/d6/d9/d5d/d87/da2 0 2024-03-18T14:43:27.345 INFO:tasks.workunit.client.1.smithi129.stdout:8/853: write d9/d11/d1a/d32/fb6 [523910,91979] 0 2024-03-18T14:43:27.345 INFO:tasks.workunit.client.0.smithi087.stdout:6/976: mknod d3/d7/d25/d62/d7c/d29/d22/d75/d92/d13d/c14f 0 2024-03-18T14:43:27.346 INFO:tasks.workunit.client.1.smithi129.stdout:1/810: getdents d1/d2/d28/d65/d7c 0 2024-03-18T14:43:27.347 INFO:tasks.workunit.client.0.smithi087.stdout:6/977: chown d3/d7/d25/d62/d7c/da0/dbe/db6/f148 6458368 1 2024-03-18T14:43:27.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/811: write d1/d2/f3d [1808501,79303] 0 2024-03-18T14:43:27.348 INFO:tasks.workunit.client.0.smithi087.stdout:4/998: getdents d2/db/d84/d87 0 2024-03-18T14:43:27.350 INFO:tasks.workunit.client.0.smithi087.stdout:8/999: rename d1/d6/d14/db2/dbc/l127 to d1/d6/d2f/d44/d45/d71/daa/dad/l153 0 2024-03-18T14:43:27.350 INFO:tasks.workunit.client.1.smithi129.stdout:3/810: rename d4/dd/d1f/d111/d34/dc0/le7 to d4/dd/d41/l114 0 2024-03-18T14:43:27.351 INFO:tasks.workunit.client.1.smithi129.stdout:4/778: truncate d0/d19/d46/d3e/d21/d32/f57 843680 0 2024-03-18T14:43:27.351 INFO:tasks.workunit.client.1.smithi129.stdout:3/811: stat d4/dd/d1f/d5f/d82/da6/ce4 0 2024-03-18T14:43:27.353 INFO:tasks.workunit.client.0.smithi087.stdout:4/999: mknod d2/db/d24/d30/d7b/d7f/da5/d113/c14d 0 2024-03-18T14:43:27.353 INFO:tasks.workunit.client.1.smithi129.stdout:5/796: getdents d0/dc 0 2024-03-18T14:43:27.353 INFO:tasks.workunit.client.0.smithi087.stdout:6/978: mknod d3/d7/dbd/d142/c150 0 2024-03-18T14:43:27.359 INFO:tasks.workunit.client.1.smithi129.stdout:9/831: rename d0/d15/cb9 to d0/db/d2e/d9d/dbb/c110 0 2024-03-18T14:43:27.360 INFO:tasks.workunit.client.1.smithi129.stdout:6/837: chown d3/d30/d44/fe7 4 1 2024-03-18T14:43:27.361 INFO:tasks.workunit.client.1.smithi129.stdout:4/779: truncate d0/d19/d46/d3e/d21/d32/fb9 255894 0 2024-03-18T14:43:27.365 INFO:tasks.workunit.client.1.smithi129.stdout:6/838: write d3/d30/f7d [3155366,23599] 0 2024-03-18T14:43:27.366 INFO:tasks.workunit.client.1.smithi129.stdout:3/812: truncate d4/dd/d1f/d111/d34/d53/ffe 1230190 0 2024-03-18T14:43:27.366 INFO:tasks.workunit.client.1.smithi129.stdout:3/813: chown d4/dd/d1f/d111/d34/df8/dd4 1 1 2024-03-18T14:43:27.369 INFO:tasks.workunit.client.1.smithi129.stdout:0/851: sync 2024-03-18T14:43:27.369 INFO:tasks.workunit.client.1.smithi129.stdout:4/780: mknod d0/d9/d4c/dca/cfd 0 2024-03-18T14:43:27.370 INFO:tasks.workunit.client.1.smithi129.stdout:2/865: truncate d7/d1f/d20/d36/da9/fb4 2850149 0 2024-03-18T14:43:27.371 INFO:tasks.workunit.client.1.smithi129.stdout:2/866: dread - d7/d3f/fa0 zero size 2024-03-18T14:43:27.371 INFO:tasks.workunit.client.1.smithi129.stdout:8/854: truncate d9/f4c 970589 0 2024-03-18T14:43:27.372 INFO:tasks.workunit.client.1.smithi129.stdout:1/812: write d1/d2/d28/d65/d19/d96/fdf [729045,120560] 0 2024-03-18T14:43:27.373 INFO:tasks.workunit.client.1.smithi129.stdout:4/781: dread d0/d9/d4c/faa [0,4194304] 0 2024-03-18T14:43:27.373 INFO:tasks.workunit.client.1.smithi129.stdout:6/839: write d3/d30/f95 [576171,55871] 0 2024-03-18T14:43:27.374 INFO:tasks.workunit.client.1.smithi129.stdout:3/814: write d4/dd/d1f/d2f/fad [1659276,54610] 0 2024-03-18T14:43:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:9/832: dread d0/db/d1f/f7b [0,4194304] 0 2024-03-18T14:43:27.375 INFO:tasks.workunit.client.1.smithi129.stdout:7/831: rename d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/df6 to d4/d2d/d2e/d42/d108 0 2024-03-18T14:43:27.377 INFO:tasks.workunit.client.1.smithi129.stdout:6/840: read d3/d30/de/f58 [3688875,46699] 0 2024-03-18T14:43:27.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/815: fsync d4/dd/d1f/d5f/d31/f77 0 2024-03-18T14:43:27.379 INFO:tasks.workunit.client.1.smithi129.stdout:2/867: truncate d7/d1f/d20/d2d/fb7 3450422 0 2024-03-18T14:43:27.379 INFO:tasks.workunit.client.1.smithi129.stdout:6/841: fdatasync d3/d30/de/d6c/d9e/db6/fff 0 2024-03-18T14:43:27.380 INFO:tasks.workunit.client.1.smithi129.stdout:5/797: rename d0/d32/d34/d6c/f98 to d0/df/ffb 0 2024-03-18T14:43:27.381 INFO:tasks.workunit.client.1.smithi129.stdout:1/813: mknod d1/dbf/dce/df2/c102 0 2024-03-18T14:43:27.389 INFO:tasks.workunit.client.1.smithi129.stdout:8/855: dwrite d9/d11/d1a/d32/d3a/faf [4194304,4194304] 0 2024-03-18T14:43:27.392 INFO:tasks.workunit.client.0.smithi087.stdout:6/979: sync 2024-03-18T14:43:27.392 INFO:tasks.workunit.client.0.smithi087.stdout:6/980: chown d3/d7/d25/d62/d7c/d46/dc9 124480585 1 2024-03-18T14:43:27.395 INFO:tasks.workunit.client.1.smithi129.stdout:0/852: rename d0/d23/d71/f7f to d0/d14/dca/fff 0 2024-03-18T14:43:27.396 INFO:tasks.workunit.client.1.smithi129.stdout:5/798: symlink d0/dc/lfc 0 2024-03-18T14:43:27.397 INFO:tasks.workunit.client.0.smithi087.stdout:6/981: dwrite d3/d7/d25/d62/d7c/d46/dc9/fdf [4194304,4194304] 0 2024-03-18T14:43:27.397 INFO:tasks.workunit.client.1.smithi129.stdout:1/814: unlink d1/d35/d7a/lc1 0 2024-03-18T14:43:27.398 INFO:tasks.workunit.client.1.smithi129.stdout:0/853: dread d0/d14/f5f [0,4194304] 0 2024-03-18T14:43:27.399 INFO:tasks.workunit.client.1.smithi129.stdout:9/833: mkdir d0/db/d10b/d111 0 2024-03-18T14:43:27.399 INFO:tasks.workunit.client.0.smithi087.stdout:6/982: mkdir d3/d7/d25/d62/d8b/d151 0 2024-03-18T14:43:27.401 INFO:tasks.workunit.client.1.smithi129.stdout:5/799: dwrite d0/d32/d3a/d45/d83/ddf/fc0 [0,4194304] 0 2024-03-18T14:43:27.407 INFO:tasks.workunit.client.0.smithi087.stdout:6/983: dread d3/d7/d25/d62/d7c/d29/d22/f5f [0,4194304] 0 2024-03-18T14:43:27.410 INFO:tasks.workunit.client.1.smithi129.stdout:0/854: read d0/d23/d71/dc2/f4c [573117,3410] 0 2024-03-18T14:43:27.414 INFO:tasks.workunit.client.1.smithi129.stdout:5/800: read d0/d32/d34/d6c/f78 [1212088,33607] 0 2024-03-18T14:43:27.415 INFO:tasks.workunit.client.1.smithi129.stdout:7/832: truncate d4/d83/ff8 123891 0 2024-03-18T14:43:27.416 INFO:tasks.workunit.client.1.smithi129.stdout:3/816: truncate d4/fe9 4997048 0 2024-03-18T14:43:27.418 INFO:tasks.workunit.client.1.smithi129.stdout:8/856: truncate d9/d11/d18/da4/fcf 738925 0 2024-03-18T14:43:27.418 INFO:tasks.workunit.client.1.smithi129.stdout:6/842: write d3/d30/de/d49/fe4 [1565834,8742] 0 2024-03-18T14:43:27.420 INFO:tasks.workunit.client.1.smithi129.stdout:0/855: stat d0/d23/d35/d3b/la1 0 2024-03-18T14:43:27.422 INFO:tasks.workunit.client.1.smithi129.stdout:4/782: rename d0/d19/d46/d3e/d33 to d0/d19/d46/d3e/d21/d4d/d70/dfe 0 2024-03-18T14:43:27.422 INFO:tasks.workunit.client.1.smithi129.stdout:5/801: dwrite d0/df/f44 [4194304,4194304] 0 2024-03-18T14:43:27.423 INFO:tasks.workunit.client.1.smithi129.stdout:3/817: dread d4/dd/d1f/d111/d1d/d36/f7d [0,4194304] 0 2024-03-18T14:43:27.423 INFO:tasks.workunit.client.1.smithi129.stdout:7/833: mkdir d4/d2d/d2e/d45/dca/d109 0 2024-03-18T14:43:27.424 INFO:tasks.workunit.client.1.smithi129.stdout:2/868: dwrite d7/d1c/d32/f77 [0,4194304] 0 2024-03-18T14:43:27.424 INFO:tasks.workunit.client.1.smithi129.stdout:6/843: write d3/d30/de/da9/ffa [157326,98271] 0 2024-03-18T14:43:27.426 INFO:tasks.workunit.client.1.smithi129.stdout:9/834: creat d0/db/f112 x:0 0 0 2024-03-18T14:43:27.427 INFO:tasks.workunit.client.1.smithi129.stdout:4/783: write d0/d9/d40/d5f/fe5 [53367,95262] 0 2024-03-18T14:43:27.428 INFO:tasks.workunit.client.0.smithi087.stdout:6/984: dread d3/d7/d25/d62/d7c/f42 [0,4194304] 0 2024-03-18T14:43:27.429 INFO:tasks.workunit.client.1.smithi129.stdout:9/835: write d0/db/d2e/f7c [329305,91360] 0 2024-03-18T14:43:27.431 INFO:tasks.workunit.client.1.smithi129.stdout:8/857: dwrite d9/d11/d1a/d32/d3a/d70/fd6 [0,4194304] 0 2024-03-18T14:43:27.432 INFO:tasks.workunit.client.0.smithi087.stdout:6/985: rmdir d3/d7/d25/d62/d7c/da0/d96 39 2024-03-18T14:43:27.433 INFO:tasks.workunit.client.1.smithi129.stdout:8/858: write d9/d11/d1a/d32/d41/d4d/f56 [1644682,109835] 0 2024-03-18T14:43:27.434 INFO:tasks.workunit.client.1.smithi129.stdout:6/844: dwrite d3/d6/d7f/db4/fd8 [0,4194304] 0 2024-03-18T14:43:27.434 INFO:tasks.workunit.client.1.smithi129.stdout:1/815: getdents d1/dbf 0 2024-03-18T14:43:27.436 INFO:tasks.workunit.client.1.smithi129.stdout:0/856: symlink d0/d14/d28/df0/dc9/l100 0 2024-03-18T14:43:27.441 INFO:tasks.workunit.client.1.smithi129.stdout:3/818: creat d4/dd/d1f/d111/d34/df8/dd4/f115 x:0 0 0 2024-03-18T14:43:27.441 INFO:tasks.workunit.client.0.smithi087.stdout:6/986: rename d3/d7/d25/d62/d7c/c68 to d3/d7/d25/d62/d7c/d14b/c152 0 2024-03-18T14:43:27.444 INFO:tasks.workunit.client.0.smithi087.stdout:6/987: fsync d3/d7/d25/d62/d7c/d29/d22/f7a 0 2024-03-18T14:43:27.449 INFO:tasks.workunit.client.1.smithi129.stdout:2/869: truncate d7/d1f/d20/d2b/d41/d65/fad 540382 0 2024-03-18T14:43:27.452 INFO:tasks.workunit.client.1.smithi129.stdout:6/845: mknod d3/d5/d46/c10d 0 2024-03-18T14:43:27.453 INFO:tasks.workunit.client.1.smithi129.stdout:1/816: symlink d1/d2/d28/d65/d19/d52/l103 0 2024-03-18T14:43:27.454 INFO:tasks.workunit.client.1.smithi129.stdout:7/834: creat d4/d2d/d2e/d45/dca/dec/f10a x:0 0 0 2024-03-18T14:43:27.455 INFO:tasks.workunit.client.1.smithi129.stdout:7/835: readlink d4/d2d/d2e/d42/l8e 0 2024-03-18T14:43:27.456 INFO:tasks.workunit.client.1.smithi129.stdout:9/836: symlink d0/l113 0 2024-03-18T14:43:27.457 INFO:tasks.workunit.client.1.smithi129.stdout:8/859: mknod d9/d11/d1a/d14/db7/dc1/deb/c117 0 2024-03-18T14:43:27.459 INFO:tasks.workunit.client.1.smithi129.stdout:6/846: rename d3/d30/de/d65/d93/c9d to d3/d6/d82/c10e 0 2024-03-18T14:43:27.460 INFO:tasks.workunit.client.1.smithi129.stdout:5/802: creat d0/dc/d1a/d61/d94/db7/ffd x:0 0 0 2024-03-18T14:43:27.461 INFO:tasks.workunit.client.1.smithi129.stdout:9/837: dwrite d0/db/d10b/fdd [0,4194304] 0 2024-03-18T14:43:27.468 INFO:tasks.workunit.client.1.smithi129.stdout:3/819: dwrite d4/dd/d1f/d111/d1d/f7f [4194304,4194304] 0 2024-03-18T14:43:27.471 INFO:tasks.workunit.client.1.smithi129.stdout:0/857: truncate d0/d23/d71/faa 34485 0 2024-03-18T14:43:27.472 INFO:tasks.workunit.client.1.smithi129.stdout:8/860: readlink d9/d11/d53/d5f/dcb/dd9/l111 0 2024-03-18T14:43:27.474 INFO:tasks.workunit.client.1.smithi129.stdout:7/836: write d4/d2d/d2e/d45/f55 [9160456,78921] 0 2024-03-18T14:43:27.475 INFO:tasks.workunit.client.1.smithi129.stdout:7/837: chown d4/d8c/f76 121396 1 2024-03-18T14:43:27.476 INFO:tasks.workunit.client.1.smithi129.stdout:6/847: dread d3/d5/d46/fc1 [0,4194304] 0 2024-03-18T14:43:27.477 INFO:tasks.workunit.client.1.smithi129.stdout:2/870: truncate d7/d1f/d20/d36/da9/dc1/fc5 1121614 0 2024-03-18T14:43:27.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/820: creat d4/dd/d1f/d111/d34/df8/ded/f116 x:0 0 0 2024-03-18T14:43:27.480 INFO:tasks.workunit.client.0.smithi087.stdout:6/988: sync 2024-03-18T14:43:27.480 INFO:tasks.workunit.client.1.smithi129.stdout:0/858: creat d0/d23/d35/d50/da5/f101 x:0 0 0 2024-03-18T14:43:27.481 INFO:tasks.workunit.client.1.smithi129.stdout:8/861: mkdir d9/d11/d18/da4/d118 0 2024-03-18T14:43:27.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/989: getdents d3/d7/dbd/d142 0 2024-03-18T14:43:27.483 INFO:tasks.workunit.client.0.smithi087.stdout:6/990: write d3/dcd/fe5 [1608235,100044] 0 2024-03-18T14:43:27.485 INFO:tasks.workunit.client.1.smithi129.stdout:4/784: rename d0/d19/d46/d3e/d21/d4d/d70/f4a to d0/d3c/d6c/d89/de7/fff 0 2024-03-18T14:43:27.485 INFO:tasks.workunit.client.0.smithi087.stdout:6/991: write d3/d7/d25/d8e/ff9 [31111,57126] 0 2024-03-18T14:43:27.487 INFO:tasks.workunit.client.1.smithi129.stdout:8/862: dwrite d9/d11/d1a/d32/d41/d4d/d96/dcc/ff4 [0,4194304] 0 2024-03-18T14:43:27.488 INFO:tasks.workunit.client.0.smithi087.stdout:6/992: read d3/d7/d25/d62/d7c/d46/dc9/fda [380222,17598] 0 2024-03-18T14:43:27.491 INFO:tasks.workunit.client.1.smithi129.stdout:1/817: dwrite d1/d2/d28/f51 [0,4194304] 0 2024-03-18T14:43:27.493 INFO:tasks.workunit.client.1.smithi129.stdout:7/838: rename d4/d2d/d2e/cd3 to d4/d2d/d2e/d45/dca/c10b 0 2024-03-18T14:43:27.494 INFO:tasks.workunit.client.1.smithi129.stdout:8/863: dread d9/d11/d1a/d14/f2c [0,4194304] 0 2024-03-18T14:43:27.495 INFO:tasks.workunit.client.1.smithi129.stdout:8/864: read - d9/d11/d53/d5f/fdf zero size 2024-03-18T14:43:27.496 INFO:tasks.workunit.client.0.smithi087.stdout:6/993: dwrite d3/d7/d25/d62/d7c/d29/d22/d61/fb8 [0,4194304] 0 2024-03-18T14:43:27.496 INFO:tasks.workunit.client.1.smithi129.stdout:8/865: stat d9/d11/d55/d68/d72/d90 0 2024-03-18T14:43:27.496 INFO:tasks.workunit.client.1.smithi129.stdout:8/866: chown d9/d11/d1a/d32/d41/d4d/d103/f105 132890584 1 2024-03-18T14:43:27.497 INFO:tasks.workunit.client.1.smithi129.stdout:8/867: readlink d9/d11/d1a/d14/d60/led 0 2024-03-18T14:43:27.497 INFO:tasks.workunit.client.1.smithi129.stdout:9/838: truncate d0/f35 3367453 0 2024-03-18T14:43:27.498 INFO:tasks.workunit.client.1.smithi129.stdout:9/839: dread - d0/db/d11/d97/dd1/d26/d19/d8d/fff zero size 2024-03-18T14:43:27.500 INFO:tasks.workunit.client.0.smithi087.stdout:6/994: truncate d3/d7/d25/d62/d7c/d29/d22/f3b 379749 0 2024-03-18T14:43:27.502 INFO:tasks.workunit.client.0.smithi087.stdout:6/995: rmdir d3/d7/d25/d62/d7c/d29/d22/d75/d92 39 2024-03-18T14:43:27.503 INFO:tasks.workunit.client.1.smithi129.stdout:3/821: mknod d4/dd/d1f/d111/d34/c117 0 2024-03-18T14:43:27.503 INFO:tasks.workunit.client.1.smithi129.stdout:9/840: dwrite d0/db/d2e/d9f/faa [0,4194304] 0 2024-03-18T14:43:27.503 INFO:tasks.workunit.client.0.smithi087.stdout:6/996: stat d3/d7/d25/d62/d7c/f42 0 2024-03-18T14:43:27.505 INFO:tasks.workunit.client.1.smithi129.stdout:2/871: dread d7/d1f/d20/d36/da9/dc1/f1a [0,4194304] 0 2024-03-18T14:43:27.507 INFO:tasks.workunit.client.1.smithi129.stdout:7/839: symlink d4/d2d/d2e/d79/dc6/d38/d61/d6a/l10c 0 2024-03-18T14:43:27.507 INFO:tasks.workunit.client.0.smithi087.stdout:6/997: creat d3/d7/d25/d62/d7c/da0/d96/f153 x:0 0 0 2024-03-18T14:43:27.508 INFO:tasks.workunit.client.1.smithi129.stdout:6/848: creat d3/d30/de/d65/d93/dd0/de6/f10f x:0 0 0 2024-03-18T14:43:27.509 INFO:tasks.workunit.client.0.smithi087.stdout:6/998: symlink d3/d7/d25/d62/d7c/d46/d121/l154 0 2024-03-18T14:43:27.510 INFO:tasks.workunit.client.1.smithi129.stdout:8/868: creat d9/d11/d55/d68/d72/d90/f119 x:0 0 0 2024-03-18T14:43:27.511 INFO:tasks.workunit.client.1.smithi129.stdout:8/869: stat d9/d11/d53/d5f/dcb 0 2024-03-18T14:43:27.512 INFO:tasks.workunit.client.1.smithi129.stdout:6/849: dwrite d3/d6/f51 [0,4194304] 0 2024-03-18T14:43:27.512 INFO:tasks.workunit.client.1.smithi129.stdout:3/822: creat d4/dd/d1f/d111/d34/df8/ded/f118 x:0 0 0 2024-03-18T14:43:27.515 INFO:tasks.workunit.client.1.smithi129.stdout:1/818: link d1/d35/f45 d1/db2/dc3/f104 0 2024-03-18T14:43:27.515 INFO:tasks.workunit.client.1.smithi129.stdout:1/819: readlink d1/d35/ld8 0 2024-03-18T14:43:27.518 INFO:tasks.workunit.client.1.smithi129.stdout:5/803: truncate d0/dc/d22/f39 328816 0 2024-03-18T14:43:27.520 INFO:tasks.workunit.client.1.smithi129.stdout:2/872: creat d7/d1f/d20/d2b/d41/da6/f10e x:0 0 0 2024-03-18T14:43:27.521 INFO:tasks.workunit.client.1.smithi129.stdout:2/873: chown d7/d1f/d20/d36/da9/dc1/da5/dc4/ff2 37 1 2024-03-18T14:43:27.523 INFO:tasks.workunit.client.1.smithi129.stdout:7/840: symlink d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/l10d 0 2024-03-18T14:43:27.526 INFO:tasks.workunit.client.0.smithi087.stdout:6/999: dwrite d3/d7/d25/d62/d7c/f42 [0,4194304] 0 2024-03-18T14:43:27.529 INFO:tasks.workunit.client.0.smithi087.stderr:+ rm -rf -- ./tmp.gXbGEdU7ly 2024-03-18T14:43:27.564 INFO:tasks.workunit.client.1.smithi129.stdout:6/850: creat d3/d30/df/d28/d79/daf/f110 x:0 0 0 2024-03-18T14:43:27.566 INFO:tasks.workunit.client.1.smithi129.stdout:4/785: getdents d0/d19/d46/d2e 0 2024-03-18T14:43:27.570 INFO:tasks.workunit.client.1.smithi129.stdout:5/804: rmdir d0/dc/d1a 39 2024-03-18T14:43:27.571 INFO:tasks.workunit.client.1.smithi129.stdout:9/841: dwrite d0/d15/f7a [0,4194304] 0 2024-03-18T14:43:27.571 INFO:tasks.workunit.client.1.smithi129.stdout:5/805: write d0/d32/d3a/d45/f74 [1119310,120499] 0 2024-03-18T14:43:27.573 INFO:tasks.workunit.client.1.smithi129.stdout:9/842: readlink d0/db/d11/d97/dd1/d26/d19/le7 0 2024-03-18T14:43:27.574 INFO:tasks.workunit.client.1.smithi129.stdout:7/841: dread d4/d8c/f9b [0,4194304] 0 2024-03-18T14:43:27.577 INFO:tasks.workunit.client.1.smithi129.stdout:8/870: fdatasync d9/d11/d18/da4/fcf 0 2024-03-18T14:43:27.579 INFO:tasks.workunit.client.1.smithi129.stdout:3/823: link d4/dd/d1f/d111/d34/d4c/fee d4/d38/d9b/d107/f119 0 2024-03-18T14:43:27.579 INFO:tasks.workunit.client.1.smithi129.stdout:3/824: write d4/dd/d41/f109 [881099,63351] 0 2024-03-18T14:43:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:1/820: mknod d1/db2/de2/c105 0 2024-03-18T14:43:27.582 INFO:tasks.workunit.client.1.smithi129.stdout:4/786: dread d0/fab [0,4194304] 0 2024-03-18T14:43:27.584 INFO:tasks.workunit.client.1.smithi129.stdout:0/859: getdents d0/d23 0 2024-03-18T14:43:27.585 INFO:tasks.workunit.client.1.smithi129.stdout:5/806: dread - d0/dc/d1a/d61/d94/db7/fe4 zero size 2024-03-18T14:43:27.585 INFO:tasks.workunit.client.1.smithi129.stdout:9/843: readlink d0/db/d2e/d9d/dbb/lee 0 2024-03-18T14:43:27.586 INFO:tasks.workunit.client.1.smithi129.stdout:2/874: truncate d7/f58 2098148 0 2024-03-18T14:43:27.586 INFO:tasks.workunit.client.1.smithi129.stdout:0/860: fdatasync d0/d14/d91/fc7 0 2024-03-18T14:43:27.590 INFO:tasks.workunit.client.1.smithi129.stdout:1/821: truncate d1/d2/f3 4600471 0 2024-03-18T14:43:27.591 INFO:tasks.workunit.client.1.smithi129.stdout:1/822: read d1/d2/f3b [313433,97011] 0 2024-03-18T14:43:27.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/842: mknod d4/d2d/d2e/d42/c10e 0 2024-03-18T14:43:27.595 INFO:tasks.workunit.client.1.smithi129.stdout:9/844: unlink d0/db/d53/f7f 0 2024-03-18T14:43:27.596 INFO:tasks.workunit.client.1.smithi129.stdout:5/807: rmdir d0/dc/d18/d2b/d8c 39 2024-03-18T14:43:27.598 INFO:tasks.workunit.client.1.smithi129.stdout:7/843: symlink d4/d2d/d2e/d42/d108/l10f 0 2024-03-18T14:43:27.598 INFO:tasks.workunit.client.1.smithi129.stdout:6/851: dread d3/d30/de/d65/d93/dd0/ffd [0,4194304] 0 2024-03-18T14:43:27.598 INFO:tasks.workunit.client.1.smithi129.stdout:3/825: truncate d4/dd/db0/ffc 471867 0 2024-03-18T14:43:27.600 INFO:tasks.workunit.client.1.smithi129.stdout:3/826: stat d4/dd/d1f/d2f/dae 0 2024-03-18T14:43:27.601 INFO:tasks.workunit.client.1.smithi129.stdout:2/875: creat d7/d1f/d20/d2b/d41/f10f x:0 0 0 2024-03-18T14:43:27.603 INFO:tasks.workunit.client.1.smithi129.stdout:9/845: rename d0/db/d11/d97/dd1/d6c/dfa/d101/d70 to d0/db/d11/d97/d99/d114 0 2024-03-18T14:43:27.603 INFO:tasks.workunit.client.1.smithi129.stdout:8/871: link d9/l7e d9/d11/d55/d6a/d6f/l11a 0 2024-03-18T14:43:27.603 INFO:tasks.workunit.client.1.smithi129.stdout:1/823: truncate d1/d35/db8/f101 614575 0 2024-03-18T14:43:27.605 INFO:tasks.workunit.client.1.smithi129.stdout:0/861: getdents d0/d14/d91 0 2024-03-18T14:43:27.605 INFO:tasks.workunit.client.1.smithi129.stdout:5/808: creat d0/d32/d3a/d45/d83/ddf/de2/ffe x:0 0 0 2024-03-18T14:43:27.606 INFO:tasks.workunit.client.1.smithi129.stdout:7/844: symlink d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/l110 0 2024-03-18T14:43:27.606 INFO:tasks.workunit.client.1.smithi129.stdout:4/787: dread d0/d19/d46/d3e/d21/d4d/d70/dfe/f7d [0,4194304] 0 2024-03-18T14:43:27.607 INFO:tasks.workunit.client.1.smithi129.stdout:2/876: unlink d7/l67 0 2024-03-18T14:43:27.607 INFO:tasks.workunit.client.1.smithi129.stdout:4/788: readlink d0/le0 0 2024-03-18T14:43:27.608 INFO:tasks.workunit.client.1.smithi129.stdout:3/827: creat d4/dd/d1f/d5f/d8c/f11a x:0 0 0 2024-03-18T14:43:27.609 INFO:tasks.workunit.client.1.smithi129.stdout:6/852: dwrite d3/d30/de/da9/fe9 [0,4194304] 0 2024-03-18T14:43:27.611 INFO:tasks.workunit.client.1.smithi129.stdout:1/824: mknod d1/dbf/dce/c106 0 2024-03-18T14:43:27.611 INFO:tasks.workunit.client.1.smithi129.stdout:4/789: rmdir d0/d19/d46/d2e 39 2024-03-18T14:43:27.613 INFO:tasks.workunit.client.1.smithi129.stdout:2/877: creat d7/d1f/d20/d2b/f110 x:0 0 0 2024-03-18T14:43:27.614 INFO:tasks.workunit.client.1.smithi129.stdout:8/872: rename d9/l54 to d9/d11/d18/da4/l11b 0 2024-03-18T14:43:27.615 INFO:tasks.workunit.client.1.smithi129.stdout:9/846: dread d0/db/d11/d97/d99/db2/fc0 [0,4194304] 0 2024-03-18T14:43:27.616 INFO:tasks.workunit.client.1.smithi129.stdout:2/878: write d7/d1c/d79/dd5/f10c [1021767,115596] 0 2024-03-18T14:43:27.619 INFO:tasks.workunit.client.1.smithi129.stdout:6/853: dwrite d3/d6/d7f/db4/f9c [4194304,4194304] 0 2024-03-18T14:43:27.621 INFO:tasks.workunit.client.1.smithi129.stdout:3/828: rename d4/dd/d1f/d111/d1d/d50/d91 to d4/dd/d1f/d5f/de2/d11b 0 2024-03-18T14:43:27.621 INFO:tasks.workunit.client.1.smithi129.stdout:1/825: dwrite d1/db2/dc3/de7/fee [0,4194304] 0 2024-03-18T14:43:27.621 INFO:tasks.workunit.client.1.smithi129.stdout:5/809: truncate d0/d32/d34/f53 1939811 0 2024-03-18T14:43:27.624 INFO:tasks.workunit.client.1.smithi129.stdout:4/790: mkdir d0/d19/d46/d3e/dc0/d100 0 2024-03-18T14:43:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:0/862: getdents d0/d23/d71/dcd 0 2024-03-18T14:43:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:8/873: unlink d9/d11/d1a/d14/db7/ff2 0 2024-03-18T14:43:27.625 INFO:tasks.workunit.client.1.smithi129.stdout:5/810: chown d0/d32/d3a/df2/c87 169 1 2024-03-18T14:43:27.627 INFO:tasks.workunit.client.1.smithi129.stdout:1/826: write d1/d2/d28/d65/d19/d52/fc5 [516744,83590] 0 2024-03-18T14:43:27.628 INFO:tasks.workunit.client.1.smithi129.stdout:2/879: dwrite d7/d3f/d5f/fcf [0,4194304] 0 2024-03-18T14:43:27.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/811: write d0/dc/d22/fbc [365723,67462] 0 2024-03-18T14:43:27.630 INFO:tasks.workunit.client.1.smithi129.stdout:2/880: dread - d7/d1f/d20/d2d/dab/fc6 zero size 2024-03-18T14:43:27.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/791: dwrite d0/fbb [0,4194304] 0 2024-03-18T14:43:27.644 INFO:tasks.workunit.client.1.smithi129.stdout:0/863: dread d0/d23/d35/d3b/d42/dc0/fdb [0,4194304] 0 2024-03-18T14:43:27.652 INFO:tasks.workunit.client.1.smithi129.stdout:6/854: symlink d3/d30/df/d28/d79/daf/db7/dc3/l111 0 2024-03-18T14:43:27.679 INFO:tasks.workunit.client.1.smithi129.stdout:5/812: creat d0/d32/d3a/d52/d69/fff x:0 0 0 2024-03-18T14:43:27.679 INFO:tasks.workunit.client.1.smithi129.stdout:2/881: mknod d7/d1f/d20/d2b/d41/da6/ded/c111 0 2024-03-18T14:43:27.679 INFO:tasks.workunit.client.1.smithi129.stdout:0/864: rmdir d0/d14/d28/d63/d8d 39 2024-03-18T14:43:27.679 INFO:tasks.workunit.client.1.smithi129.stdout:8/874: mkdir d9/d33/dc2/d11c 0 2024-03-18T14:43:27.680 INFO:tasks.workunit.client.1.smithi129.stdout:9/847: creat d0/db/d11/d97/dd1/f115 x:0 0 0 2024-03-18T14:43:27.681 INFO:tasks.workunit.client.1.smithi129.stdout:7/845: rename d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/l10d to d4/d2d/d2e/d79/dc6/d38/l111 0 2024-03-18T14:43:27.682 INFO:tasks.workunit.client.1.smithi129.stdout:6/855: creat d3/d6/d7f/dfb/f112 x:0 0 0 2024-03-18T14:43:27.685 INFO:tasks.workunit.client.1.smithi129.stdout:1/827: rename d1/d91/fb4 to d1/d35/d7a/f107 0 2024-03-18T14:43:27.685 INFO:tasks.workunit.client.1.smithi129.stdout:3/829: getdents d4/dd/d1f/d5f/de2/d11b 0 2024-03-18T14:43:27.686 INFO:tasks.workunit.client.1.smithi129.stdout:5/813: symlink d0/dc/d1a/d61/d94/de0/l100 0 2024-03-18T14:43:27.688 INFO:tasks.workunit.client.1.smithi129.stdout:8/875: dwrite d9/d11/d1a/d32/d3a/d5d/f9e [0,4194304] 0 2024-03-18T14:43:27.688 INFO:tasks.workunit.client.1.smithi129.stdout:5/814: dread - d0/df/ffb zero size 2024-03-18T14:43:27.688 INFO:tasks.workunit.client.1.smithi129.stdout:9/848: creat d0/db/d11/d97/dd1/d26/f116 x:0 0 0 2024-03-18T14:43:27.690 INFO:tasks.workunit.client.1.smithi129.stdout:0/865: link d0/d23/d35/d3b/c6e d0/d6c/ddf/c102 0 2024-03-18T14:43:27.691 INFO:tasks.workunit.client.1.smithi129.stdout:9/849: chown d0/db/d1f/f7b 5 1 2024-03-18T14:43:27.691 INFO:tasks.workunit.client.1.smithi129.stdout:7/846: truncate d4/d2d/d2e/d42/d58/f102 907673 0 2024-03-18T14:43:27.693 INFO:tasks.workunit.client.1.smithi129.stdout:8/876: mknod d9/d11/d1a/d32/d41/d4d/c11d 0 2024-03-18T14:43:27.694 INFO:tasks.workunit.client.1.smithi129.stdout:3/830: dread d4/dd/d1f/d111/d34/d3c/f81 [0,4194304] 0 2024-03-18T14:43:27.697 INFO:tasks.workunit.client.1.smithi129.stdout:6/856: getdents d3/d30/de/d6c 0 2024-03-18T14:43:27.697 INFO:tasks.workunit.client.1.smithi129.stdout:0/866: fdatasync d0/d14/f5f 0 2024-03-18T14:43:27.697 INFO:tasks.workunit.client.1.smithi129.stdout:5/815: truncate d0/dc/d18/d2b/f47 476005 0 2024-03-18T14:43:27.698 INFO:tasks.workunit.client.1.smithi129.stdout:9/850: creat d0/db/d1f/dae/db8/f117 x:0 0 0 2024-03-18T14:43:27.699 INFO:tasks.workunit.client.1.smithi129.stdout:8/877: dwrite d9/d11/d1a/d32/d3a/d5d/f9e [0,4194304] 0 2024-03-18T14:43:27.699 INFO:tasks.workunit.client.1.smithi129.stdout:5/816: readlink d0/df/lad 0 2024-03-18T14:43:27.699 INFO:tasks.workunit.client.1.smithi129.stdout:0/867: chown d0/c13 12 1 2024-03-18T14:43:27.700 INFO:tasks.workunit.client.1.smithi129.stdout:9/851: stat d0/db/d11/d97/dd1/d6c 0 2024-03-18T14:43:27.701 INFO:tasks.workunit.client.1.smithi129.stdout:5/817: dread - d0/d32/d3a/de7/ffa zero size 2024-03-18T14:43:27.703 INFO:tasks.workunit.client.1.smithi129.stdout:6/857: rmdir d3/d30/d44 39 2024-03-18T14:43:27.705 INFO:tasks.workunit.client.1.smithi129.stdout:9/852: read d0/db/d11/d97/dd1/d26/d19/d29/fb3 [2313196,96670] 0 2024-03-18T14:43:27.705 INFO:tasks.workunit.client.1.smithi129.stdout:7/847: truncate d4/d2d/d2e/d79/dc6/fb0 964938 0 2024-03-18T14:43:27.711 INFO:tasks.workunit.client.1.smithi129.stdout:1/828: write d1/d2/d28/d65/f36 [2585624,128645] 0 2024-03-18T14:43:27.711 INFO:tasks.workunit.client.1.smithi129.stdout:8/878: fdatasync d9/d11/d1a/d14/d60/fbe 0 2024-03-18T14:43:27.716 INFO:tasks.workunit.client.1.smithi129.stdout:0/868: rename d0/l15 to d0/d23/d71/dc2/d4a/d7a/dbd/l103 0 2024-03-18T14:43:27.716 INFO:tasks.workunit.client.1.smithi129.stdout:8/879: dwrite d9/d11/d1a/d32/d3a/d70/f8c [0,4194304] 0 2024-03-18T14:43:27.718 INFO:tasks.workunit.client.1.smithi129.stdout:0/869: write d0/d14/d91/fb5 [661235,53948] 0 2024-03-18T14:43:27.718 INFO:tasks.workunit.client.1.smithi129.stdout:3/831: truncate d4/dd/d1f/d5f/d31/fcf 3456001 0 2024-03-18T14:43:27.720 INFO:tasks.workunit.client.1.smithi129.stdout:9/853: symlink d0/da1/dc1/l118 0 2024-03-18T14:43:27.723 INFO:tasks.workunit.client.1.smithi129.stdout:6/858: dread d3/d5/f11 [0,4194304] 0 2024-03-18T14:43:27.723 INFO:tasks.workunit.client.1.smithi129.stdout:7/848: mkdir d4/d2d/d2e/d79/dc6/d38/d49/d112 0 2024-03-18T14:43:27.728 INFO:tasks.workunit.client.1.smithi129.stdout:8/880: chown d9/d33/dc2/ddc/f109 455 1 2024-03-18T14:43:27.732 INFO:tasks.workunit.client.1.smithi129.stdout:9/854: write d0/db/d2e/f103 [2132349,111520] 0 2024-03-18T14:43:27.733 INFO:tasks.workunit.client.1.smithi129.stdout:9/855: dread - d0/db/d2e/d9f/fce zero size 2024-03-18T14:43:27.734 INFO:tasks.workunit.client.1.smithi129.stdout:5/818: truncate d0/d32/d34/f51 4742634 0 2024-03-18T14:43:27.734 INFO:tasks.workunit.client.1.smithi129.stdout:9/856: fsync d0/db/d11/d97/d99/d114/fb7 0 2024-03-18T14:43:27.735 INFO:tasks.workunit.client.1.smithi129.stdout:3/832: symlink d4/dd/d1f/d2f/dae/d110/l11c 0 2024-03-18T14:43:27.736 INFO:tasks.workunit.client.1.smithi129.stdout:3/833: chown d4/dd/d1f/c83 3792 1 2024-03-18T14:43:27.739 INFO:tasks.workunit.client.1.smithi129.stdout:0/870: creat d0/d14/f104 x:0 0 0 2024-03-18T14:43:27.742 INFO:tasks.workunit.client.1.smithi129.stdout:5/819: symlink d0/d32/d3a/d45/l101 0 2024-03-18T14:43:27.742 INFO:tasks.workunit.client.1.smithi129.stdout:6/859: dread d3/d30/f7d [0,4194304] 0 2024-03-18T14:43:27.743 INFO:tasks.workunit.client.1.smithi129.stdout:1/829: getdents d1/db2/dc3/de7 0 2024-03-18T14:43:27.744 INFO:tasks.workunit.client.1.smithi129.stdout:2/882: sync 2024-03-18T14:43:27.747 INFO:tasks.workunit.client.1.smithi129.stdout:6/860: chown d3/d30/df/d28/l5e 34 1 2024-03-18T14:43:27.747 INFO:tasks.workunit.client.1.smithi129.stdout:7/849: getdents d4/d2d/d2e/d79/dc6/d38 0 2024-03-18T14:43:27.748 INFO:tasks.workunit.client.1.smithi129.stdout:1/830: symlink d1/db2/de2/d80/l108 0 2024-03-18T14:43:27.748 INFO:tasks.workunit.client.1.smithi129.stdout:6/861: write d3/d30/f101 [184292,123424] 0 2024-03-18T14:43:27.749 INFO:tasks.workunit.client.1.smithi129.stdout:7/850: stat d4/d2d/d2e/d79/dc6/d38/d49/f7a 0 2024-03-18T14:43:27.750 INFO:tasks.workunit.client.1.smithi129.stdout:1/831: write d1/d2/d28/d65/fe3 [184767,130912] 0 2024-03-18T14:43:27.750 INFO:tasks.workunit.client.1.smithi129.stdout:9/857: creat d0/db/d11/d97/dd1/d26/f119 x:0 0 0 2024-03-18T14:43:27.751 INFO:tasks.workunit.client.1.smithi129.stdout:2/883: rmdir d7/d1f/d20/d36/da9/dc1/da5/dc4 39 2024-03-18T14:43:27.754 INFO:tasks.workunit.client.1.smithi129.stdout:8/881: dread f8 [0,4194304] 0 2024-03-18T14:43:27.755 INFO:tasks.workunit.client.1.smithi129.stdout:7/851: unlink d4/d2d/d2e/d42/d58/f67 0 2024-03-18T14:43:27.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/834: truncate d4/dd/d1f/d111/d1d/fb5 2877711 0 2024-03-18T14:43:27.758 INFO:tasks.workunit.client.1.smithi129.stdout:8/882: dread - d9/d11/d1a/d32/d41/d4d/dce/fe1 zero size 2024-03-18T14:43:27.759 INFO:tasks.workunit.client.1.smithi129.stdout:9/858: dwrite d0/db/d11/d97/d99/d114/fa6 [4194304,4194304] 0 2024-03-18T14:43:27.760 INFO:tasks.workunit.client.1.smithi129.stdout:0/871: getdents d0/d23/d71/dc2 0 2024-03-18T14:43:27.760 INFO:tasks.workunit.client.1.smithi129.stdout:8/883: readlink d9/d11/d55/l58 0 2024-03-18T14:43:27.761 INFO:tasks.workunit.client.1.smithi129.stdout:1/832: symlink d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/l109 0 2024-03-18T14:43:27.762 INFO:tasks.workunit.client.1.smithi129.stdout:6/862: dread d3/d30/de/d6c/f31 [0,4194304] 0 2024-03-18T14:43:27.763 INFO:tasks.workunit.client.1.smithi129.stdout:6/863: chown d3/d5/d46/df4/ff5 24 1 2024-03-18T14:43:27.766 INFO:tasks.workunit.client.1.smithi129.stdout:2/884: mknod d7/d1f/d20/d2b/d41/da6/c112 0 2024-03-18T14:43:27.767 INFO:tasks.workunit.client.1.smithi129.stdout:7/852: chown d4/d2d/d2e/d79/dc6/d54/f94 105344125 1 2024-03-18T14:43:27.768 INFO:tasks.workunit.client.1.smithi129.stdout:4/792: sync 2024-03-18T14:43:27.769 INFO:tasks.workunit.client.1.smithi129.stdout:5/820: link d0/f9 d0/dc/d1a/d61/f102 0 2024-03-18T14:43:27.770 INFO:tasks.workunit.client.1.smithi129.stdout:3/835: fdatasync d4/dd/d1f/d111/d1d/f9e 0 2024-03-18T14:43:27.771 INFO:tasks.workunit.client.1.smithi129.stdout:0/872: creat d0/d23/d6b/f105 x:0 0 0 2024-03-18T14:43:27.772 INFO:tasks.workunit.client.1.smithi129.stdout:1/833: creat d1/d35/db8/dc6/f10a x:0 0 0 2024-03-18T14:43:27.774 INFO:tasks.workunit.client.1.smithi129.stdout:6/864: symlink d3/d30/de/d65/l113 0 2024-03-18T14:43:27.777 INFO:tasks.workunit.client.1.smithi129.stdout:5/821: mkdir d0/d32/d34/d103 0 2024-03-18T14:43:27.779 INFO:tasks.workunit.client.1.smithi129.stdout:9/859: mknod d0/db/d11/d97/dd1/c11a 0 2024-03-18T14:43:27.781 INFO:tasks.workunit.client.1.smithi129.stdout:3/836: write d4/dd/d1f/d111/d34/f76 [1094251,40906] 0 2024-03-18T14:43:27.782 INFO:tasks.workunit.client.1.smithi129.stdout:3/837: readlink d4/dd/d1f/d111/d34/d3c/l3e 0 2024-03-18T14:43:27.784 INFO:tasks.workunit.client.1.smithi129.stdout:9/860: dwrite d0/db/d2e/f7c [0,4194304] 0 2024-03-18T14:43:27.784 INFO:tasks.workunit.client.1.smithi129.stdout:3/838: chown d4/dd/d1f/d111/d1d/d36/f4a 18113 1 2024-03-18T14:43:27.785 INFO:tasks.workunit.client.1.smithi129.stdout:7/853: unlink d4/d2d/d2e/d79/dc6/fb0 0 2024-03-18T14:43:27.787 INFO:tasks.workunit.client.1.smithi129.stdout:8/884: truncate d9/d11/d1a/d32/d3a/d5d/f62 919885 0 2024-03-18T14:43:27.790 INFO:tasks.workunit.client.1.smithi129.stdout:5/822: symlink d0/d32/d3a/d52/l104 0 2024-03-18T14:43:27.791 INFO:tasks.workunit.client.1.smithi129.stdout:0/873: fdatasync d0/d23/d71/faa 0 2024-03-18T14:43:27.794 INFO:tasks.workunit.client.1.smithi129.stdout:2/885: rename d7/d1c/d32/l47 to d7/d1f/d20/d2b/d41/l113 0 2024-03-18T14:43:27.794 INFO:tasks.workunit.client.1.smithi129.stdout:9/861: readlink d0/db/d2e/l10e 0 2024-03-18T14:43:27.795 INFO:tasks.workunit.client.1.smithi129.stdout:3/839: mknod d4/dd/d1f/d111/d34/d4c/c11d 0 2024-03-18T14:43:27.796 INFO:tasks.workunit.client.1.smithi129.stdout:7/854: creat d4/d2d/d2e/d79/f113 x:0 0 0 2024-03-18T14:43:27.799 INFO:tasks.workunit.client.1.smithi129.stdout:4/793: link d0/d19/d46/l74 d0/d9/d40/d5f/d77/l101 0 2024-03-18T14:43:27.801 INFO:tasks.workunit.client.1.smithi129.stdout:5/823: creat d0/d32/d3a/df2/f105 x:0 0 0 2024-03-18T14:43:27.802 INFO:tasks.workunit.client.1.smithi129.stdout:0/874: creat d0/d23/d35/d3b/d42/dc0/f106 x:0 0 0 2024-03-18T14:43:27.803 INFO:tasks.workunit.client.1.smithi129.stdout:0/875: dread - d0/d23/d71/dcd/fd9 zero size 2024-03-18T14:43:27.804 INFO:tasks.workunit.client.1.smithi129.stdout:1/834: dread d1/f1d [0,4194304] 0 2024-03-18T14:43:27.804 INFO:tasks.workunit.client.1.smithi129.stdout:6/865: rename d3/d30/de/da9/lc5 to d3/d6/d7f/l114 0 2024-03-18T14:43:27.805 INFO:tasks.workunit.client.1.smithi129.stdout:9/862: creat d0/db/d2e/f11b x:0 0 0 2024-03-18T14:43:27.806 INFO:tasks.workunit.client.1.smithi129.stdout:3/840: symlink d4/dd/d1f/d2f/dae/l11e 0 2024-03-18T14:43:27.808 INFO:tasks.workunit.client.1.smithi129.stdout:4/794: truncate d0/d19/d46/d3e/d21/f5c 4621578 0 2024-03-18T14:43:27.812 INFO:tasks.workunit.client.1.smithi129.stdout:9/863: creat d0/db/d2e/d9f/dcb/f11c x:0 0 0 2024-03-18T14:43:27.813 INFO:tasks.workunit.client.1.smithi129.stdout:3/841: symlink d4/dd/db0/l11f 0 2024-03-18T14:43:27.816 INFO:tasks.workunit.client.1.smithi129.stdout:7/855: truncate d4/f4f 2438865 0 2024-03-18T14:43:27.817 INFO:tasks.workunit.client.1.smithi129.stdout:4/795: rmdir d0/d9 39 2024-03-18T14:43:27.818 INFO:tasks.workunit.client.1.smithi129.stdout:2/886: dread d7/f1d [0,4194304] 0 2024-03-18T14:43:27.819 INFO:tasks.workunit.client.1.smithi129.stdout:0/876: mknod d0/d14/d28/d63/d8d/c107 0 2024-03-18T14:43:27.822 INFO:tasks.workunit.client.1.smithi129.stdout:1/835: dread d1/d2/d28/d65/f99 [0,4194304] 0 2024-03-18T14:43:27.823 INFO:tasks.workunit.client.1.smithi129.stdout:6/866: getdents d3/d30/de/d49/d102 0 2024-03-18T14:43:27.823 INFO:tasks.workunit.client.1.smithi129.stdout:1/836: chown d1/d2/d28/d65/d19/dc9/d87/d8c 28899 1 2024-03-18T14:43:27.825 INFO:tasks.workunit.client.1.smithi129.stdout:1/837: chown d1/d2/d28/d65/d19/dc9/d87/dc0/ccd 2008 1 2024-03-18T14:43:27.825 INFO:tasks.workunit.client.1.smithi129.stdout:1/838: readlink d1/d2/d28/d65/d19/l57 0 2024-03-18T14:43:27.828 INFO:tasks.workunit.client.1.smithi129.stdout:8/885: truncate d9/d11/d1a/f30 4102101 0 2024-03-18T14:43:27.829 INFO:tasks.workunit.client.1.smithi129.stdout:7/856: mkdir d4/d2d/d3a/d114 0 2024-03-18T14:43:27.830 INFO:tasks.workunit.client.1.smithi129.stdout:5/824: truncate d0/d32/d34/d6c/da3/fc7 1025585 0 2024-03-18T14:43:27.833 INFO:tasks.workunit.client.1.smithi129.stdout:2/887: chown d7/d1f/d20/d2b/d41/d65/d88/fe6 19518248 1 2024-03-18T14:43:27.835 INFO:tasks.workunit.client.1.smithi129.stdout:8/886: dwrite d9/f102 [0,4194304] 0 2024-03-18T14:43:27.836 INFO:tasks.workunit.client.1.smithi129.stdout:3/842: dread d4/fa [0,4194304] 0 2024-03-18T14:43:27.837 INFO:tasks.workunit.client.1.smithi129.stdout:4/796: write d0/d19/d46/d3e/d21/d4d/d70/dfe/f8b [1453238,2381] 0 2024-03-18T14:43:27.843 INFO:tasks.workunit.client.1.smithi129.stdout:2/888: mkdir d7/d3f/d114 0 2024-03-18T14:43:27.843 INFO:tasks.workunit.client.1.smithi129.stdout:1/839: mknod d1/d35/c10b 0 2024-03-18T14:43:27.847 INFO:tasks.workunit.client.1.smithi129.stdout:9/864: truncate d0/db/d11/d97/dd1/d26/f119 909678 0 2024-03-18T14:43:27.847 INFO:tasks.workunit.client.1.smithi129.stdout:8/887: unlink d9/d11/d1a/d14/d60/l97 0 2024-03-18T14:43:27.847 INFO:tasks.workunit.client.1.smithi129.stdout:3/843: creat d4/dd/d1f/d111/d1d/f120 x:0 0 0 2024-03-18T14:43:27.848 INFO:tasks.workunit.client.1.smithi129.stdout:9/865: chown d0/db/d11/d97/dd1/d6c/dfa/d101/d3e 23303437 1 2024-03-18T14:43:27.851 INFO:tasks.workunit.client.1.smithi129.stdout:5/825: unlink d0/dc/d18/d2b/c43 0 2024-03-18T14:43:27.852 INFO:tasks.workunit.client.1.smithi129.stdout:6/867: link d3/d30/de/cf1 d3/d30/de/d49/df8/c115 0 2024-03-18T14:43:27.856 INFO:tasks.workunit.client.1.smithi129.stdout:4/797: mknod d0/c102 0 2024-03-18T14:43:27.859 INFO:tasks.workunit.client.1.smithi129.stdout:7/857: dread d4/d2d/d2e/d79/dc6/d38/d49/f65 [0,4194304] 0 2024-03-18T14:43:27.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/888: write d9/d11/d1a/f63 [300227,106857] 0 2024-03-18T14:43:27.863 INFO:tasks.workunit.client.1.smithi129.stdout:8/889: stat d9/d11/d1a/d32/d41/d4d/ddb 0 2024-03-18T14:43:27.866 INFO:tasks.workunit.client.1.smithi129.stdout:0/877: getdents d0/d23/d71/dc2/d4a/d61 0 2024-03-18T14:43:27.867 INFO:tasks.workunit.client.1.smithi129.stdout:6/868: write d3/d30/de/d6c/f31 [1616497,108436] 0 2024-03-18T14:43:27.868 INFO:tasks.workunit.client.1.smithi129.stdout:2/889: dread d7/d1f/d20/d36/fe2 [0,4194304] 0 2024-03-18T14:43:27.868 INFO:tasks.workunit.client.1.smithi129.stdout:2/890: chown d7/d1c/f92 16648549 1 2024-03-18T14:43:27.869 INFO:tasks.workunit.client.1.smithi129.stdout:7/858: stat d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/l35 0 2024-03-18T14:43:27.869 INFO:tasks.workunit.client.1.smithi129.stdout:1/840: write d1/d35/f3f [3192387,54530] 0 2024-03-18T14:43:27.871 INFO:tasks.workunit.client.1.smithi129.stdout:1/841: write d1/d2/d28/d65/d19/ff7 [1435340,11896] 0 2024-03-18T14:43:27.871 INFO:tasks.workunit.client.1.smithi129.stdout:1/842: write d1/d35/db8/dc6/f10a [476491,82514] 0 2024-03-18T14:43:27.872 INFO:tasks.workunit.client.1.smithi129.stdout:1/843: stat d1/d2/d28/d65/d19/d52/c7e 0 2024-03-18T14:43:27.889 INFO:tasks.workunit.client.1.smithi129.stdout:5/826: rename d0/dc/lcc to d0/d32/d34/l106 0 2024-03-18T14:43:27.890 INFO:tasks.workunit.client.1.smithi129.stdout:5/827: fdatasync d0/dc/d1a/d61/d94/fc1 0 2024-03-18T14:43:27.890 INFO:tasks.workunit.client.1.smithi129.stdout:8/890: dread d9/d11/d55/d68/f76 [0,4194304] 0 2024-03-18T14:43:27.896 INFO:tasks.workunit.client.1.smithi129.stdout:9/866: write d0/db/d11/d97/f9e [4248899,112725] 0 2024-03-18T14:43:27.898 INFO:tasks.workunit.client.1.smithi129.stdout:7/859: creat d4/d2d/d2e/d79/dc6/d38/d49/f115 x:0 0 0 2024-03-18T14:43:27.900 INFO:tasks.workunit.client.1.smithi129.stdout:0/878: write d0/d14/f5f [1800892,104066] 0 2024-03-18T14:43:27.902 INFO:tasks.workunit.client.1.smithi129.stdout:3/844: creat d4/dd/d1f/f121 x:0 0 0 2024-03-18T14:43:27.902 INFO:tasks.workunit.client.1.smithi129.stdout:0/879: write d0/d23/d71/dcd/fea [707777,758] 0 2024-03-18T14:43:27.902 INFO:tasks.workunit.client.1.smithi129.stdout:4/798: dwrite d0/f5 [0,4194304] 0 2024-03-18T14:43:27.904 INFO:tasks.workunit.client.1.smithi129.stdout:2/891: rename d7/d1f/f4c to d7/d3f/d5f/dea/f115 0 2024-03-18T14:43:27.906 INFO:tasks.workunit.client.1.smithi129.stdout:8/891: mknod d9/d11/d1a/d66/c11e 0 2024-03-18T14:43:27.909 INFO:tasks.workunit.client.1.smithi129.stdout:0/880: write d0/d14/fb9 [697365,91297] 0 2024-03-18T14:43:27.910 INFO:tasks.workunit.client.1.smithi129.stdout:4/799: creat d0/d19/d46/d3e/d21/f103 x:0 0 0 2024-03-18T14:43:27.910 INFO:tasks.workunit.client.1.smithi129.stdout:3/845: dwrite d4/dd/d1f/d111/d34/d3c/f9d [0,4194304] 0 2024-03-18T14:43:27.912 INFO:tasks.workunit.client.1.smithi129.stdout:7/860: rename d4/d2d/d2e/d79/lde to d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/l116 0 2024-03-18T14:43:27.912 INFO:tasks.workunit.client.1.smithi129.stdout:2/892: dwrite d7/d1c/d79/fa3 [0,4194304] 0 2024-03-18T14:43:27.913 INFO:tasks.workunit.client.1.smithi129.stdout:7/861: chown d4/d2d/d2e/d79/dc6/cfd 3274040 1 2024-03-18T14:43:27.917 INFO:tasks.workunit.client.1.smithi129.stdout:0/881: dwrite d0/d23/d71/fa9 [4194304,4194304] 0 2024-03-18T14:43:27.919 INFO:tasks.workunit.client.1.smithi129.stdout:0/882: chown d0/cf4 59695 1 2024-03-18T14:43:27.920 INFO:tasks.workunit.client.1.smithi129.stdout:8/892: mkdir d9/d11/d53/d5f/dcb/d11f 0 2024-03-18T14:43:27.923 INFO:tasks.workunit.client.1.smithi129.stdout:1/844: dwrite d1/d91/fd9 [0,4194304] 0 2024-03-18T14:43:27.924 INFO:tasks.workunit.client.1.smithi129.stdout:7/862: dwrite d4/d2d/d2e/d79/dc6/d38/d61/d68/f72 [0,4194304] 0 2024-03-18T14:43:27.929 INFO:tasks.workunit.client.1.smithi129.stdout:6/869: link d3/d30/de/d6c/c4b d3/d30/de/d65/d93/dd0/c116 0 2024-03-18T14:43:27.931 INFO:tasks.workunit.client.1.smithi129.stdout:0/883: read d0/d23/d35/d3b/d42/dc0/fc5 [225021,10457] 0 2024-03-18T14:43:27.933 INFO:tasks.workunit.client.1.smithi129.stdout:4/800: mknod d0/d9/d6a/c104 0 2024-03-18T14:43:27.933 INFO:tasks.workunit.client.1.smithi129.stdout:2/893: mkdir d7/d1c/d116 0 2024-03-18T14:43:27.935 INFO:tasks.workunit.client.1.smithi129.stdout:5/828: getdents d0/dc/d1a/db9 0 2024-03-18T14:43:27.939 INFO:tasks.workunit.client.1.smithi129.stdout:9/867: truncate d0/db/fb5 1023930 0 2024-03-18T14:43:27.940 INFO:tasks.workunit.client.1.smithi129.stdout:2/894: dwrite d7/d1c/fbe [0,4194304] 0 2024-03-18T14:43:27.941 INFO:tasks.workunit.client.1.smithi129.stdout:4/801: dwrite d0/d19/d46/d3e/d21/d4d/d58/f8f [0,4194304] 0 2024-03-18T14:43:27.944 INFO:tasks.workunit.client.1.smithi129.stdout:6/870: write d3/d6/d82/d9a/fd7 [3107043,98545] 0 2024-03-18T14:43:27.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/845: mknod d1/db2/dc3/dc8/dd0/c10c 0 2024-03-18T14:43:27.947 INFO:tasks.workunit.client.1.smithi129.stdout:8/893: dwrite d9/d11/d1a/d14/d60/fbe [0,4194304] 0 2024-03-18T14:43:27.949 INFO:tasks.workunit.client.1.smithi129.stdout:4/802: mkdir d0/d3c/d6c/d105 0 2024-03-18T14:43:27.951 INFO:tasks.workunit.client.1.smithi129.stdout:7/863: truncate d4/d83/fbb 356514 0 2024-03-18T14:43:27.953 INFO:tasks.workunit.client.1.smithi129.stdout:2/895: mknod d7/d1c/d116/c117 0 2024-03-18T14:43:27.954 INFO:tasks.workunit.client.1.smithi129.stdout:2/896: readlink d7/d1c/d32/l70 0 2024-03-18T14:43:27.958 INFO:tasks.workunit.client.1.smithi129.stdout:0/884: link d0/d14/f24 d0/d23/f108 0 2024-03-18T14:43:27.959 INFO:tasks.workunit.client.1.smithi129.stdout:6/871: mkdir d3/d30/de/d49/df8/d117 0 2024-03-18T14:43:27.963 INFO:tasks.workunit.client.1.smithi129.stdout:5/829: truncate d0/d32/d3a/fb4 3195135 0 2024-03-18T14:43:27.965 INFO:tasks.workunit.client.1.smithi129.stdout:7/864: creat d4/d2d/d2e/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107/f117 x:0 0 0 2024-03-18T14:43:27.966 INFO:tasks.workunit.client.1.smithi129.stdout:2/897: mkdir d7/d1c/d79/d118 0 2024-03-18T14:43:27.967 INFO:tasks.workunit.client.1.smithi129.stdout:9/868: link d0/db/d2e/d9f/dcb/de0/cca d0/db/d53/c11d 0 2024-03-18T14:43:27.968 INFO:tasks.workunit.client.1.smithi129.stdout:4/803: mkdir d0/d3c/d6c/d105/d106 0 2024-03-18T14:43:27.968 INFO:tasks.workunit.client.1.smithi129.stdout:0/885: chown d0/d23/d35/d3b/fad 438 1 2024-03-18T14:43:27.970 INFO:tasks.workunit.client.1.smithi129.stdout:6/872: unlink d3/d6/d82/d9a/dbe/f108 0 2024-03-18T14:43:27.971 INFO:tasks.workunit.client.1.smithi129.stdout:1/846: creat d1/d2/d28/f10d x:0 0 0 2024-03-18T14:43:27.972 INFO:tasks.workunit.client.1.smithi129.stdout:5/830: rmdir d0/dc/d22 39 2024-03-18T14:43:27.974 INFO:tasks.workunit.client.1.smithi129.stdout:7/865: truncate d4/d2d/d2e/d79/dc6/f63 202228 0 2024-03-18T14:43:27.980 INFO:tasks.workunit.client.1.smithi129.stdout:4/804: write d0/d19/d46/d3e/f47 [4854418,98099] 0 2024-03-18T14:43:27.980 INFO:tasks.workunit.client.1.smithi129.stdout:8/894: dread d9/d11/d18/f34 [0,4194304] 0 2024-03-18T14:43:27.984 INFO:tasks.workunit.client.1.smithi129.stdout:6/873: mknod d3/d30/df/d28/d79/daf/c118 0 2024-03-18T14:43:27.986 INFO:tasks.workunit.client.1.smithi129.stdout:1/847: rename d1/db2/dc3/dc8/dd0 to d1/d2/d28/d65/d72/d10e 0 2024-03-18T14:43:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:3/846: sync 2024-03-18T14:43:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:2/898: fdatasync d7/d1f/d20/f55 0 2024-03-18T14:43:27.987 INFO:tasks.workunit.client.1.smithi129.stdout:1/848: write d1/db2/de2/fda [999989,65946] 0 2024-03-18T14:43:27.988 INFO:tasks.workunit.client.1.smithi129.stdout:2/899: write d7/d1c/f74 [4074022,58809] 0 2024-03-18T14:43:27.989 INFO:tasks.workunit.client.1.smithi129.stdout:1/849: chown d1/d35/db8/dc6/df6 1403240 1 2024-03-18T14:43:27.990 INFO:tasks.workunit.client.1.smithi129.stdout:9/869: symlink d0/db/d10b/l11e 0 2024-03-18T14:43:27.990 INFO:tasks.workunit.client.1.smithi129.stdout:4/805: mkdir d0/d9/d107 0 2024-03-18T14:43:27.992 INFO:tasks.workunit.client.1.smithi129.stdout:8/895: write d9/d11/d1a/d32/d41/fa3 [341550,44771] 0 2024-03-18T14:43:27.993 INFO:tasks.workunit.client.1.smithi129.stdout:8/896: write d9/d11/d18/da4/f9c [1987209,128886] 0 2024-03-18T14:43:27.999 INFO:tasks.workunit.client.1.smithi129.stdout:0/886: truncate d0/d23/d35/d3b/d42/dc0/fdb 1404507 0 2024-03-18T14:43:28.004 INFO:tasks.workunit.client.1.smithi129.stdout:2/900: write d7/d1f/d20/d2b/d41/d65/d88/fe6 [1347199,106860] 0 2024-03-18T14:43:28.006 INFO:tasks.workunit.client.1.smithi129.stdout:5/831: creat d0/d32/f107 x:0 0 0 2024-03-18T14:43:28.008 INFO:tasks.workunit.client.1.smithi129.stdout:8/897: write d9/d11/d1a/d32/d3a/f8f [1959050,105021] 0 2024-03-18T14:43:28.009 INFO:tasks.workunit.client.1.smithi129.stdout:0/887: creat d0/d14/d91/f109 x:0 0 0 2024-03-18T14:43:28.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/888: fsync d0/d23/f3f 0 2024-03-18T14:43:28.013 INFO:tasks.workunit.client.1.smithi129.stdout:8/898: dwrite d9/d11/d1a/d14/dc0/fba [0,4194304] 0 2024-03-18T14:43:28.014 INFO:tasks.workunit.client.1.smithi129.stdout:2/901: write d7/d1f/d20/d36/ffc [1639710,99555] 0 2024-03-18T14:43:28.017 INFO:tasks.workunit.client.1.smithi129.stdout:7/866: getdents d4/d8c/d9e 0 2024-03-18T14:43:28.019 INFO:tasks.workunit.client.1.smithi129.stdout:3/847: link d4/dd/d1f/d111/d34/d4c/c9c d4/dd/d1f/d111/d34/df8/c122 0 2024-03-18T14:43:28.021 INFO:tasks.workunit.client.1.smithi129.stdout:1/850: truncate d1/d2/d28/d65/d7c/fdd 31623 0 2024-03-18T14:43:28.022 INFO:tasks.workunit.client.1.smithi129.stdout:9/870: truncate d0/db/f112 730433 0 2024-03-18T14:43:28.022 INFO:tasks.workunit.client.1.smithi129.stdout:1/851: read - d1/d35/db8/dc6/fe0 zero size 2024-03-18T14:43:28.022 INFO:tasks.workunit.client.1.smithi129.stdout:4/806: link d0/d19/d46/d3e/d21/d4d/d70/lf0 d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/l108 0 2024-03-18T14:43:28.023 INFO:tasks.workunit.client.1.smithi129.stdout:8/899: mkdir d9/d11/d18/d120 0 2024-03-18T14:43:28.024 INFO:tasks.workunit.client.1.smithi129.stdout:2/902: mknod d7/d1f/d20/d36/c119 0 2024-03-18T14:43:28.024 INFO:tasks.workunit.client.1.smithi129.stdout:6/874: link d3/d30/l3e d3/d30/de/d49/d102/l119 0 2024-03-18T14:43:28.032 INFO:tasks.workunit.client.1.smithi129.stdout:0/889: mknod d0/d6c/ddf/c10a 0 2024-03-18T14:43:28.036 INFO:tasks.workunit.client.1.smithi129.stdout:7/867: dwrite d4/d8c/f9b [4194304,4194304] 0 2024-03-18T14:43:28.041 INFO:tasks.workunit.client.1.smithi129.stdout:1/852: creat d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/f10f x:0 0 0 2024-03-18T14:43:28.043 INFO:tasks.workunit.client.1.smithi129.stdout:2/903: unlink d7/d1f/d20/d2d/dab/fc6 0 2024-03-18T14:43:28.044 INFO:tasks.workunit.client.1.smithi129.stdout:6/875: fsync d3/d30/de/d65/d93/f97 0 2024-03-18T14:43:28.045 INFO:tasks.workunit.client.1.smithi129.stdout:0/890: rmdir d0/d23/d35/d50/da5 39 2024-03-18T14:43:28.046 INFO:tasks.workunit.client.1.smithi129.stdout:3/848: dread d4/dd/d1f/d5f/de2/d11b/f94 [0,4194304] 0 2024-03-18T14:43:28.046 INFO:tasks.workunit.client.1.smithi129.stdout:5/832: dwrite d0/dc/d18/d2b/f47 [0,4194304] 0 2024-03-18T14:43:28.048 INFO:tasks.workunit.client.1.smithi129.stdout:7/868: dwrite d4/d2d/d2e/d45/f4c [0,4194304] 0 2024-03-18T14:43:28.048 INFO:tasks.workunit.client.1.smithi129.stdout:6/876: readlink d3/d30/de/d49/lb0 0 2024-03-18T14:43:28.049 INFO:tasks.workunit.client.1.smithi129.stdout:4/807: mkdir d0/d19/d46/d3e/dc0/d100/d109 0 2024-03-18T14:43:28.049 INFO:tasks.workunit.client.1.smithi129.stdout:8/900: unlink d9/l74 0 2024-03-18T14:43:28.050 INFO:tasks.workunit.client.1.smithi129.stdout:3/849: dread - d4/dd/d1f/d5f/dfa/fe0 zero size 2024-03-18T14:43:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:9/871: dwrite d0/db/d2e/d9f/dcb/de0/f54 [0,4194304] 0 2024-03-18T14:43:28.051 INFO:tasks.workunit.client.1.smithi129.stdout:7/869: chown d4/d2d/d2e/fe1 76 1 2024-03-18T14:43:28.053 INFO:tasks.workunit.client.1.smithi129.stdout:9/872: fdatasync d0/da1/dc1/ff1 0 2024-03-18T14:43:28.058 INFO:tasks.workunit.client.1.smithi129.stdout:2/904: read - d7/d1f/d20/d36/da9/dc1/da5/dc4/ff2 zero size 2024-03-18T14:43:28.060 INFO:tasks.workunit.client.1.smithi129.stdout:4/808: dwrite d0/d9/d40/fbd [0,4194304] 0 2024-03-18T14:43:28.061 INFO:tasks.workunit.client.1.smithi129.stdout:3/850: dwrite d4/dd/d1f/d5f/d31/fd1 [0,4194304] 0 2024-03-18T14:43:28.063 INFO:tasks.workunit.client.1.smithi129.stdout:9/873: dwrite d0/db/d2e/f11b [0,4194304] 0 2024-03-18T14:43:28.063 INFO:tasks.workunit.client.1.smithi129.stdout:0/891: mkdir d0/d23/d35/d50/d10b 0 2024-03-18T14:43:28.064 INFO:tasks.workunit.client.1.smithi129.stdout:7/870: read d4/fc2 [368462,30782] 0 2024-03-18T14:43:28.066 INFO:tasks.workunit.client.1.smithi129.stdout:5/833: link d0/d32/d3a/f62 d0/d32/d3a/de7/f108 0 2024-03-18T14:43:28.066 INFO:tasks.workunit.client.1.smithi129.stdout:8/901: dread d9/d11/d1a/d32/d3a/f59 [0,4194304] 0 2024-03-18T14:43:28.066 INFO:tasks.workunit.client.1.smithi129.stdout:0/892: write d0/d23/d71/dcd/fea [1033510,31268] 0 2024-03-18T14:43:28.088 INFO:tasks.workunit.client.1.smithi129.stdout:6/877: creat d3/d30/df/d28/d79/d106/f11a x:0 0 0 2024-03-18T14:43:28.089 INFO:tasks.workunit.client.1.smithi129.stdout:7/871: creat d4/d2d/d3a/f118 x:0 0 0 2024-03-18T14:43:28.090 INFO:tasks.workunit.client.1.smithi129.stdout:5/834: readlink d0/dc/l29 0 2024-03-18T14:43:28.091 INFO:tasks.workunit.client.1.smithi129.stdout:0/893: creat d0/d23/d35/dde/f10c x:0 0 0 2024-03-18T14:43:28.091 INFO:tasks.workunit.client.1.smithi129.stdout:1/853: dread d1/d2/d28/d65/d19/d96/fa4 [0,4194304] 0 2024-03-18T14:43:28.093 INFO:tasks.workunit.client.1.smithi129.stdout:9/874: dwrite d0/da1/f104 [0,4194304] 0 2024-03-18T14:43:28.094 INFO:tasks.workunit.client.1.smithi129.stdout:8/902: write d9/d11/d18/fd1 [1508614,32883] 0 2024-03-18T14:43:28.094 INFO:tasks.workunit.client.1.smithi129.stdout:4/809: mkdir d0/d9/d107/d10a 0 2024-03-18T14:43:28.096 INFO:tasks.workunit.client.1.smithi129.stdout:6/878: unlink d3/d5/d46/fc1 0 2024-03-18T14:43:28.097 INFO:tasks.workunit.client.1.smithi129.stdout:1/854: creat d1/db2/f110 x:0 0 0 2024-03-18T14:43:28.098 INFO:tasks.workunit.client.1.smithi129.stdout:7/872: write d4/d2d/d2e/d79/dc6/d38/d49/fef [2335835,130552] 0 2024-03-18T14:43:28.100 INFO:tasks.workunit.client.1.smithi129.stdout:7/873: fsync d4/d2d/d2e/d79/dc6/d38/d49/f62 0 2024-03-18T14:43:28.100 INFO:tasks.workunit.client.1.smithi129.stdout:5/835: creat d0/d32/d3a/d45/d83/ddf/f109 x:0 0 0 2024-03-18T14:43:28.103 INFO:tasks.workunit.client.1.smithi129.stdout:0/894: readlink d0/d23/d71/dc2/d4a/d7a/dbd/l103 0 2024-03-18T14:43:28.103 INFO:tasks.workunit.client.1.smithi129.stdout:8/903: symlink d9/d11/d1a/d32/d41/d4d/d96/dcc/l121 0 2024-03-18T14:43:28.105 INFO:tasks.workunit.client.1.smithi129.stdout:6/879: creat d3/d30/df/d28/d79/f11b x:0 0 0 2024-03-18T14:43:28.105 INFO:tasks.workunit.client.1.smithi129.stdout:0/895: fsync d0/d14/d28/df0/fce 0 2024-03-18T14:43:28.106 INFO:tasks.workunit.client.1.smithi129.stdout:7/874: dwrite d4/d8c/f76 [0,4194304] 0 2024-03-18T14:43:28.106 INFO:tasks.workunit.client.1.smithi129.stdout:1/855: creat d1/d2/d28/d65/d7c/f111 x:0 0 0 2024-03-18T14:43:28.108 INFO:tasks.workunit.client.1.smithi129.stdout:2/905: dread d7/d1c/f9d [0,4194304] 0 2024-03-18T14:43:28.108 INFO:tasks.workunit.client.1.smithi129.stdout:6/880: chown d3/d30/c10a 956 1 2024-03-18T14:43:28.109 INFO:tasks.workunit.client.1.smithi129.stdout:0/896: chown d0/d23/d71/dc2/d4a/d61/fcb 3329 1 2024-03-18T14:43:28.110 INFO:tasks.workunit.client.1.smithi129.stdout:5/836: mknod d0/d32/c10a 0 2024-03-18T14:43:28.111 INFO:tasks.workunit.client.1.smithi129.stdout:6/881: write d3/d6/d7f/db4/f9c [2834164,24988] 0 2024-03-18T14:43:28.111 INFO:tasks.workunit.client.1.smithi129.stdout:9/875: creat d0/db/d11/d97/dd1/d26/f11f x:0 0 0 2024-03-18T14:43:28.112 INFO:tasks.workunit.client.1.smithi129.stdout:6/882: chown d3/d6/fd6 139 1 2024-03-18T14:43:28.112 INFO:tasks.workunit.client.1.smithi129.stdout:9/876: chown d0/db/d10b/d8e/f9a 175775 1 2024-03-18T14:43:28.112 INFO:tasks.workunit.client.1.smithi129.stdout:8/904: read d9/d11/d1a/f77 [2052079,104255] 0 2024-03-18T14:43:28.113 INFO:tasks.workunit.client.1.smithi129.stdout:7/875: symlink d4/d2d/d2e/d79/dc6/d38/d61/l119 0 2024-03-18T14:43:28.118 INFO:tasks.workunit.client.1.smithi129.stdout:4/810: rename d0/d19/d46/d3e/d21/d4d/d70/l26 to d0/d19/d46/d2e/d66/dea/l10b 0 2024-03-18T14:43:28.118 INFO:tasks.workunit.client.1.smithi129.stdout:4/811: stat d0/d19 0 2024-03-18T14:43:28.118 INFO:tasks.workunit.client.1.smithi129.stdout:5/837: unlink d0/dc/d1a/d61/ff6 0 2024-03-18T14:43:28.120 INFO:tasks.workunit.client.1.smithi129.stdout:4/812: write d0/d19/d46/d3e/d21/d4d/d70/fc6 [457513,118525] 0 2024-03-18T14:43:28.121 INFO:tasks.workunit.client.1.smithi129.stdout:8/905: dread - d9/d11/d1a/d32/d3a/d70/f88 zero size 2024-03-18T14:43:28.122 INFO:tasks.workunit.client.1.smithi129.stdout:8/906: dread - d9/d11/d1a/d32/d41/d4d/d96/fa0 zero size 2024-03-18T14:43:28.125 INFO:tasks.workunit.client.1.smithi129.stdout:8/907: write d9/d11/d1a/d14/d60/fd5 [4684225,14575] 0 2024-03-18T14:43:28.125 INFO:tasks.workunit.client.1.smithi129.stdout:0/897: mkdir d0/d23/d35/d50/d10d 0 2024-03-18T14:43:28.127 INFO:tasks.workunit.client.1.smithi129.stdout:4/813: dwrite d0/d3c/fb0 [0,4194304] 0 2024-03-18T14:43:28.128 INFO:tasks.workunit.client.1.smithi129.stdout:8/908: write d9/d11/d1a/d32/d3a/f49 [4622979,59668] 0 2024-03-18T14:43:28.128 INFO:tasks.workunit.client.1.smithi129.stdout:3/851: sync 2024-03-18T14:43:28.129 INFO:tasks.workunit.client.1.smithi129.stdout:4/814: write d0/d19/d46/f63 [1345238,70348] 0 2024-03-18T14:43:28.130 INFO:tasks.workunit.client.1.smithi129.stdout:8/909: chown d9/d11/d1a/d14/l47 0 1 2024-03-18T14:43:28.131 INFO:tasks.workunit.client.1.smithi129.stdout:5/838: dread d0/df/f66 [0,4194304] 0 2024-03-18T14:43:28.132 INFO:tasks.workunit.client.1.smithi129.stdout:2/906: creat d7/f11a x:0 0 0 2024-03-18T14:43:28.132 INFO:tasks.workunit.client.1.smithi129.stdout:1/856: truncate d1/db2/de2/fa5 115921 0 2024-03-18T14:43:28.133 INFO:tasks.workunit.client.1.smithi129.stdout:8/910: readlink d9/d11/d1a/d32/d3a/d70/le0 0 2024-03-18T14:43:28.135 INFO:tasks.workunit.client.1.smithi129.stdout:6/883: dwrite d3/d5/f27 [0,4194304] 0 2024-03-18T14:43:28.139 INFO:tasks.workunit.client.1.smithi129.stdout:3/852: mknod d4/dd/d1f/da8/c123 0 2024-03-18T14:43:28.140 INFO:tasks.workunit.client.1.smithi129.stdout:4/815: mknod d0/d9/d6a/d7b/dd0/c10c 0 2024-03-18T14:43:28.143 INFO:tasks.workunit.client.1.smithi129.stdout:9/877: write d0/f4 [5288988,103867] 0 2024-03-18T14:43:28.144 INFO:tasks.workunit.client.1.smithi129.stdout:7/876: truncate d4/d2d/d2e/fe1 627349 0 2024-03-18T14:43:28.144 INFO:tasks.workunit.client.1.smithi129.stdout:9/878: chown d0/db/d2e/l94 6908 1 2024-03-18T14:43:28.147 INFO:tasks.workunit.client.1.smithi129.stdout:2/907: symlink d7/d1f/d20/d36/dc0/l11b 0 2024-03-18T14:43:28.149 INFO:tasks.workunit.client.1.smithi129.stdout:6/884: symlink d3/d30/de/d6c/d9e/l11c 0 2024-03-18T14:43:28.151 INFO:tasks.workunit.client.1.smithi129.stdout:5/839: rename d0/f11 to d0/dc/d18/d5f/f10b 0 2024-03-18T14:43:28.152 INFO:tasks.workunit.client.1.smithi129.stdout:5/840: write d0/dc/d1a/fe3 [803160,5486] 0 2024-03-18T14:43:28.153 INFO:tasks.workunit.client.1.smithi129.stdout:1/857: dread d1/d35/d7a/f94 [0,4194304] 0 2024-03-18T14:43:28.154 INFO:tasks.workunit.client.1.smithi129.stdout:6/885: creat d3/d30/df/d28/d79/daf/db7/f11d x:0 0 0 2024-03-18T14:43:28.159 INFO:tasks.workunit.client.1.smithi129.stdout:1/858: dwrite d1/d2/d28/d65/d19/dc9/d87/f9b [0,4194304] 0 2024-03-18T14:43:28.162 INFO:tasks.workunit.client.1.smithi129.stdout:1/859: read d1/d2/d28/d65/d19/f37 [767640,16253] 0 2024-03-18T14:43:28.163 INFO:tasks.workunit.client.1.smithi129.stdout:8/911: truncate d9/d11/d55/d68/d72/fda 584896 0 2024-03-18T14:43:28.166 INFO:tasks.workunit.client.1.smithi129.stdout:7/877: rename d4/d2d/d2e to d4/d83/d11a 0 2024-03-18T14:43:28.167 INFO:tasks.workunit.client.1.smithi129.stdout:9/879: dread d0/db/d11/d97/dd1/d26/d19/d29/fb3 [0,4194304] 0 2024-03-18T14:43:28.168 INFO:tasks.workunit.client.1.smithi129.stdout:8/912: dwrite d9/d11/d18/fd1 [0,4194304] 0 2024-03-18T14:43:28.171 INFO:tasks.workunit.client.1.smithi129.stdout:3/853: truncate d4/dd/d1f/d111/d34/d3c/f81 4092765 0 2024-03-18T14:43:28.171 INFO:tasks.workunit.client.1.smithi129.stdout:9/880: write d0/db/d11/d97/dd1/d26/d19/f9b [3565673,65827] 0 2024-03-18T14:43:28.171 INFO:tasks.workunit.client.1.smithi129.stdout:0/898: getdents d0/d23/d35/dde 0 2024-03-18T14:43:28.174 INFO:tasks.workunit.client.1.smithi129.stdout:1/860: mknod d1/d35/db8/c112 0 2024-03-18T14:43:28.174 INFO:tasks.workunit.client.1.smithi129.stdout:9/881: chown d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f81 77305 1 2024-03-18T14:43:28.175 INFO:tasks.workunit.client.1.smithi129.stdout:7/878: dwrite d4/d83/d11a/d79/dc6/d54/d86/fe9 [0,4194304] 0 2024-03-18T14:43:28.176 INFO:tasks.workunit.client.1.smithi129.stdout:9/882: chown d0/db/d2e/d9d/dbb/lee 127 1 2024-03-18T14:43:28.176 INFO:tasks.workunit.client.1.smithi129.stdout:7/879: chown d4/fe5 3 1 2024-03-18T14:43:28.178 INFO:tasks.workunit.client.1.smithi129.stdout:2/908: rename d7/d1c/d79/dd5/f10c to d7/d1f/d20/d36/da9/dc1/da5/dfb/f11c 0 2024-03-18T14:43:28.179 INFO:tasks.workunit.client.1.smithi129.stdout:2/909: read - d7/d1f/d20/d2b/deb/ffa zero size 2024-03-18T14:43:28.181 INFO:tasks.workunit.client.1.smithi129.stdout:8/913: creat d9/d11/d55/d68/d72/d90/f122 x:0 0 0 2024-03-18T14:43:28.182 INFO:tasks.workunit.client.1.smithi129.stdout:8/914: write d9/d11/d1a/d32/d41/d4d/d96/dcc/f104 [963216,34768] 0 2024-03-18T14:43:28.183 INFO:tasks.workunit.client.1.smithi129.stdout:8/915: chown d9/d11/d18/f34 400 1 2024-03-18T14:43:28.184 INFO:tasks.workunit.client.1.smithi129.stdout:6/886: write d3/d6/f2d [3285282,13628] 0 2024-03-18T14:43:28.185 INFO:tasks.workunit.client.1.smithi129.stdout:3/854: truncate d4/dd/d1f/f4b 1010740 0 2024-03-18T14:43:28.188 INFO:tasks.workunit.client.1.smithi129.stdout:5/841: dwrite d0/d32/d34/f70 [0,4194304] 0 2024-03-18T14:43:28.188 INFO:tasks.workunit.client.1.smithi129.stdout:7/880: mknod d4/d83/d11a/d45/c11b 0 2024-03-18T14:43:28.191 INFO:tasks.workunit.client.1.smithi129.stdout:0/899: dread d0/d14/f8a [0,4194304] 0 2024-03-18T14:43:28.192 INFO:tasks.workunit.client.1.smithi129.stdout:8/916: rename d9/d11/d1a/d32/d3a/f49 to d9/d11/d53/d5f/dcb/dd9/f123 0 2024-03-18T14:43:28.197 INFO:tasks.workunit.client.1.smithi129.stdout:6/887: mkdir d3/d30/df/d28/d79/daf/db7/d11e 0 2024-03-18T14:43:28.199 INFO:tasks.workunit.client.1.smithi129.stdout:5/842: creat d0/d32/d3a/d45/d83/ddf/dc4/f10c x:0 0 0 2024-03-18T14:43:28.205 INFO:tasks.workunit.client.1.smithi129.stdout:2/910: write d7/d1f/d20/d2d/fb7 [90062,47192] 0 2024-03-18T14:43:28.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/917: unlink d9/d11/d1a/d32/d3a/l4e 0 2024-03-18T14:43:28.209 INFO:tasks.workunit.client.1.smithi129.stdout:8/918: dread - d9/d33/dc2/ddc/f109 zero size 2024-03-18T14:43:28.210 INFO:tasks.workunit.client.1.smithi129.stdout:9/883: creat d0/db/d11/d97/dd1/f120 x:0 0 0 2024-03-18T14:43:28.210 INFO:tasks.workunit.client.1.smithi129.stdout:4/816: sync 2024-03-18T14:43:28.211 INFO:tasks.workunit.client.1.smithi129.stdout:6/888: write d3/d6/d7f/d8f/f107 [1179355,14554] 0 2024-03-18T14:43:28.212 INFO:tasks.workunit.client.1.smithi129.stdout:6/889: chown d3/d6/l94 53793843 1 2024-03-18T14:43:28.212 INFO:tasks.workunit.client.1.smithi129.stdout:5/843: chown d0/c19 1422205 1 2024-03-18T14:43:28.213 INFO:tasks.workunit.client.1.smithi129.stdout:6/890: write d3/d6/d7f/db4/f70 [3136804,81445] 0 2024-03-18T14:43:28.214 INFO:tasks.workunit.client.1.smithi129.stdout:2/911: symlink d7/d1c/d79/l11d 0 2024-03-18T14:43:28.216 INFO:tasks.workunit.client.1.smithi129.stdout:9/884: mkdir d0/db/d10b/d8e/d121 0 2024-03-18T14:43:28.218 INFO:tasks.workunit.client.1.smithi129.stdout:2/912: dwrite d7/d3f/fcb [0,4194304] 0 2024-03-18T14:43:28.221 INFO:tasks.workunit.client.1.smithi129.stdout:2/913: write d7/f1d [289532,20568] 0 2024-03-18T14:43:28.221 INFO:tasks.workunit.client.1.smithi129.stdout:5/844: chown d0/dc/d18/d2b/f5e 7956 1 2024-03-18T14:43:28.221 INFO:tasks.workunit.client.1.smithi129.stdout:3/855: getdents d4/dd/d1f/d5f/d8c 0 2024-03-18T14:43:28.222 INFO:tasks.workunit.client.1.smithi129.stdout:5/845: dread - d0/d32/f107 zero size 2024-03-18T14:43:28.225 INFO:tasks.workunit.client.1.smithi129.stdout:3/856: fsync d4/dd/d1f/d111/d34/f76 0 2024-03-18T14:43:28.225 INFO:tasks.workunit.client.1.smithi129.stdout:8/919: dwrite d9/d11/d55/d68/fcd [0,4194304] 0 2024-03-18T14:43:28.226 INFO:tasks.workunit.client.1.smithi129.stdout:9/885: dread d0/db/d11/d97/dd1/d26/d19/d29/fb3 [0,4194304] 0 2024-03-18T14:43:28.227 INFO:tasks.workunit.client.1.smithi129.stdout:3/857: readlink d4/dd/d1f/d111/lf2 0 2024-03-18T14:43:28.227 INFO:tasks.workunit.client.1.smithi129.stdout:8/920: readlink d9/d11/d53/d5f/dcb/dd9/l111 0 2024-03-18T14:43:28.229 INFO:tasks.workunit.client.1.smithi129.stdout:8/921: dread - d9/d11/d1a/d32/d41/d4d/dce/fea zero size 2024-03-18T14:43:28.229 INFO:tasks.workunit.client.1.smithi129.stdout:6/891: link d3/d5/d46/f63 d3/d30/df/d28/d79/daf/f11f 0 2024-03-18T14:43:28.231 INFO:tasks.workunit.client.1.smithi129.stdout:2/914: creat d7/d1f/d20/dda/f11e x:0 0 0 2024-03-18T14:43:28.234 INFO:tasks.workunit.client.1.smithi129.stdout:9/886: creat d0/db/d11/d97/dd1/d6c/dd4/f122 x:0 0 0 2024-03-18T14:43:28.235 INFO:tasks.workunit.client.1.smithi129.stdout:3/858: creat d4/dd/d1f/d111/d1d/f124 x:0 0 0 2024-03-18T14:43:28.236 INFO:tasks.workunit.client.1.smithi129.stdout:1/861: sync 2024-03-18T14:43:28.239 INFO:tasks.workunit.client.1.smithi129.stdout:3/859: mknod d4/dd/d1f/d5f/dfa/c125 0 2024-03-18T14:43:28.240 INFO:tasks.workunit.client.1.smithi129.stdout:8/922: read d9/d11/d18/f24 [1543056,121926] 0 2024-03-18T14:43:28.240 INFO:tasks.workunit.client.1.smithi129.stdout:4/817: dwrite d0/d19/d46/d3e/f42 [0,4194304] 0 2024-03-18T14:43:28.240 INFO:tasks.workunit.client.1.smithi129.stdout:6/892: creat d3/d30/df/d28/d79/daf/db7/d11e/f120 x:0 0 0 2024-03-18T14:43:28.243 INFO:tasks.workunit.client.1.smithi129.stdout:1/862: fdatasync d1/d2/d28/fa0 0 2024-03-18T14:43:28.244 INFO:tasks.workunit.client.1.smithi129.stdout:1/863: write d1/d2/d28/d65/d19/dc9/d56/f82 [898238,93229] 0 2024-03-18T14:43:28.244 INFO:tasks.workunit.client.1.smithi129.stdout:5/846: write d0/f84 [1618664,117690] 0 2024-03-18T14:43:28.245 INFO:tasks.workunit.client.1.smithi129.stdout:9/887: write d0/f77 [85953,66190] 0 2024-03-18T14:43:28.249 INFO:tasks.workunit.client.1.smithi129.stdout:1/864: dwrite d1/d35/d7a/fde [0,4194304] 0 2024-03-18T14:43:28.252 INFO:tasks.workunit.client.1.smithi129.stdout:8/923: creat d9/d11/d1a/d32/d41/d4d/d10a/f124 x:0 0 0 2024-03-18T14:43:28.253 INFO:tasks.workunit.client.1.smithi129.stdout:9/888: creat d0/db/d2e/d9d/dbb/f123 x:0 0 0 2024-03-18T14:43:28.254 INFO:tasks.workunit.client.1.smithi129.stdout:9/889: chown d0/db/d2e/d9f/dcb 397997 1 2024-03-18T14:43:28.256 INFO:tasks.workunit.client.1.smithi129.stdout:2/915: dread d7/f58 [0,4194304] 0 2024-03-18T14:43:28.258 INFO:tasks.workunit.client.1.smithi129.stdout:1/865: mknod d1/d2/d28/d65/d72/d10e/c113 0 2024-03-18T14:43:28.258 INFO:tasks.workunit.client.1.smithi129.stdout:6/893: creat d3/d30/d44/f121 x:0 0 0 2024-03-18T14:43:28.261 INFO:tasks.workunit.client.1.smithi129.stdout:4/818: truncate d0/d9/d6a/d7b/fde 544088 0 2024-03-18T14:43:28.263 INFO:tasks.workunit.client.1.smithi129.stdout:8/924: rename d9/d11/d53/d5f/dcb/dd9 to d9/d11/d18/da4/d125 0 2024-03-18T14:43:28.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/890: creat d0/db/d2e/dd9/f124 x:0 0 0 2024-03-18T14:43:28.266 INFO:tasks.workunit.client.1.smithi129.stdout:1/866: fsync d1/d35/f45 0 2024-03-18T14:43:28.267 INFO:tasks.workunit.client.1.smithi129.stdout:5/847: truncate d0/dc/d1a/fbd 892416 0 2024-03-18T14:43:28.268 INFO:tasks.workunit.client.1.smithi129.stdout:1/867: chown d1/d2/d28/d65/d19 1944128 1 2024-03-18T14:43:28.268 INFO:tasks.workunit.client.1.smithi129.stdout:4/819: chown d0/d19/d46/d3e/d21/d32/f57 2181496 1 2024-03-18T14:43:28.269 INFO:tasks.workunit.client.1.smithi129.stdout:0/900: sync 2024-03-18T14:43:28.269 INFO:tasks.workunit.client.1.smithi129.stdout:7/881: sync 2024-03-18T14:43:28.270 INFO:tasks.workunit.client.1.smithi129.stdout:5/848: dread - d0/dc/d1a/fbe zero size 2024-03-18T14:43:28.271 INFO:tasks.workunit.client.1.smithi129.stdout:8/925: dwrite d9/d11/d18/da4/dd2/f107 [0,4194304] 0 2024-03-18T14:43:28.272 INFO:tasks.workunit.client.1.smithi129.stdout:2/916: write d7/d1c/d32/f4f [285590,2497] 0 2024-03-18T14:43:28.274 INFO:tasks.workunit.client.1.smithi129.stdout:2/917: readlink d7/lf 0 2024-03-18T14:43:28.274 INFO:tasks.workunit.client.1.smithi129.stdout:8/926: stat d9/d11/d18/da4/d125 0 2024-03-18T14:43:28.275 INFO:tasks.workunit.client.1.smithi129.stdout:6/894: creat d3/d30/de/d49/df8/d117/f122 x:0 0 0 2024-03-18T14:43:28.275 INFO:tasks.workunit.client.1.smithi129.stdout:3/860: dread d4/d38/da3/fc8 [0,4194304] 0 2024-03-18T14:43:28.275 INFO:tasks.workunit.client.1.smithi129.stdout:0/901: write d0/d23/d71/dc2/d4a/d61/fcb [907269,63745] 0 2024-03-18T14:43:28.277 INFO:tasks.workunit.client.1.smithi129.stdout:5/849: write d0/dc/d1a/d61/d94/db7/ffd [938240,66363] 0 2024-03-18T14:43:28.277 INFO:tasks.workunit.client.1.smithi129.stdout:7/882: chown d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/c101 951910544 1 2024-03-18T14:43:28.277 INFO:tasks.workunit.client.1.smithi129.stdout:9/891: dwrite d0/db/d11/d97/dd1/d26/d19/d29/f44 [0,4194304] 0 2024-03-18T14:43:28.280 INFO:tasks.workunit.client.1.smithi129.stdout:0/902: read d0/d14/f24 [2814429,48572] 0 2024-03-18T14:43:28.281 INFO:tasks.workunit.client.1.smithi129.stdout:5/850: fdatasync d0/dc/d1a/d61/d94/db7/ff1 0 2024-03-18T14:43:28.284 INFO:tasks.workunit.client.1.smithi129.stdout:9/892: dwrite d0/f35 [0,4194304] 0 2024-03-18T14:43:28.285 INFO:tasks.workunit.client.1.smithi129.stdout:3/861: creat d4/d38/da3/dc9/f126 x:0 0 0 2024-03-18T14:43:28.285 INFO:tasks.workunit.client.1.smithi129.stdout:1/868: link d1/dbf/cea d1/d2/d28/d65/d19/dc9/d56/c114 0 2024-03-18T14:43:28.286 INFO:tasks.workunit.client.1.smithi129.stdout:9/893: readlink d0/db/d2e/l10e 0 2024-03-18T14:43:28.288 INFO:tasks.workunit.client.1.smithi129.stdout:0/903: mknod d0/de3/c10e 0 2024-03-18T14:43:28.289 INFO:tasks.workunit.client.1.smithi129.stdout:0/904: readlink d0/l32 0 2024-03-18T14:43:28.291 INFO:tasks.workunit.client.1.smithi129.stdout:7/883: symlink d4/d83/d11a/d79/dc6/d38/d49/d112/l11c 0 2024-03-18T14:43:28.291 INFO:tasks.workunit.client.1.smithi129.stdout:4/820: dread d0/d19/d46/fee [0,4194304] 0 2024-03-18T14:43:28.291 INFO:tasks.workunit.client.1.smithi129.stdout:3/862: chown d4/dd/d1f/d111/d1d/f46 501 1 2024-03-18T14:43:28.295 INFO:tasks.workunit.client.1.smithi129.stdout:5/851: mkdir d0/d32/d10d 0 2024-03-18T14:43:28.298 INFO:tasks.workunit.client.1.smithi129.stdout:2/918: link d7/d1f/d20/d2d/f2e d7/d1c/d79/dd5/f11f 0 2024-03-18T14:43:28.299 INFO:tasks.workunit.client.1.smithi129.stdout:5/852: dwrite d0/d32/d3a/df2/f105 [0,4194304] 0 2024-03-18T14:43:28.299 INFO:tasks.workunit.client.1.smithi129.stdout:3/863: chown d4/fa1 15 1 2024-03-18T14:43:28.303 INFO:tasks.workunit.client.1.smithi129.stdout:6/895: getdents d3/d30/df/d28/d79/daf/db7/dc3 0 2024-03-18T14:43:28.303 INFO:tasks.workunit.client.1.smithi129.stdout:4/821: dread d0/d19/d46/d3e/d21/d4d/d58/d61/f98 [0,4194304] 0 2024-03-18T14:43:28.305 INFO:tasks.workunit.client.1.smithi129.stdout:8/927: truncate d9/d11/d1a/d32/d3a/d70/f81 5103021 0 2024-03-18T14:43:28.309 INFO:tasks.workunit.client.1.smithi129.stdout:6/896: dread d3/d6/d7f/db4/d57/fa2 [0,4194304] 0 2024-03-18T14:43:28.309 INFO:tasks.workunit.client.1.smithi129.stdout:1/869: rmdir d1/d2/d28/d65/d19/d96/df9 0 2024-03-18T14:43:28.312 INFO:tasks.workunit.client.1.smithi129.stdout:3/864: mknod d4/dd/d1f/d2f/dae/c127 0 2024-03-18T14:43:28.314 INFO:tasks.workunit.client.1.smithi129.stdout:0/905: write d0/d23/d35/d3b/d42/dc0/fdb [1307191,93624] 0 2024-03-18T14:43:28.316 INFO:tasks.workunit.client.1.smithi129.stdout:5/853: write d0/f9 [252575,62529] 0 2024-03-18T14:43:28.318 INFO:tasks.workunit.client.1.smithi129.stdout:3/865: dwrite d4/dd/d1f/d5f/d31/fd0 [0,4194304] 0 2024-03-18T14:43:28.318 INFO:tasks.workunit.client.1.smithi129.stdout:7/884: truncate d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/f4d 1319271 0 2024-03-18T14:43:28.320 INFO:tasks.workunit.client.1.smithi129.stdout:2/919: symlink d7/d1f/d81/l120 0 2024-03-18T14:43:28.321 INFO:tasks.workunit.client.1.smithi129.stdout:1/870: symlink d1/d2/d28/d65/d19/dc9/d71/l115 0 2024-03-18T14:43:28.322 INFO:tasks.workunit.client.1.smithi129.stdout:6/897: rename d3/d30/df/f5f to d3/d5/d46/df4/f123 0 2024-03-18T14:43:28.323 INFO:tasks.workunit.client.1.smithi129.stdout:9/894: getdents d0/db/d11/d97/dd1/d26 0 2024-03-18T14:43:28.324 INFO:tasks.workunit.client.1.smithi129.stdout:9/895: write d0/db/d2e/dd9/de8/f108 [78055,16771] 0 2024-03-18T14:43:28.325 INFO:tasks.workunit.client.1.smithi129.stdout:4/822: write d0/f13 [574113,12565] 0 2024-03-18T14:43:28.325 INFO:tasks.workunit.client.1.smithi129.stdout:5/854: write d0/dc/d18/d2b/d8c/f92 [446361,243] 0 2024-03-18T14:43:28.326 INFO:tasks.workunit.client.1.smithi129.stdout:5/855: chown d0/dc/d18/d2b/fb3 87 1 2024-03-18T14:43:28.328 INFO:tasks.workunit.client.1.smithi129.stdout:4/823: dread d0/fab [0,4194304] 0 2024-03-18T14:43:28.330 INFO:tasks.workunit.client.1.smithi129.stdout:1/871: chown d1/d2/d28/d65/d19/c6b 1020 1 2024-03-18T14:43:28.331 INFO:tasks.workunit.client.1.smithi129.stdout:6/898: symlink d3/d6/d7f/db4/d57/l124 0 2024-03-18T14:43:28.333 INFO:tasks.workunit.client.1.smithi129.stdout:9/896: mknod d0/db/d2e/d9f/c125 0 2024-03-18T14:43:28.335 INFO:tasks.workunit.client.1.smithi129.stdout:7/885: mkdir d4/d83/d11a/d79/dc6/d11d 0 2024-03-18T14:43:28.336 INFO:tasks.workunit.client.1.smithi129.stdout:5/856: creat d0/d32/d34/d6c/da3/f10e x:0 0 0 2024-03-18T14:43:28.341 INFO:tasks.workunit.client.1.smithi129.stdout:8/928: truncate d9/d11/d1a/d32/d41/d4d/d96/dcc/ff4 1991593 0 2024-03-18T14:43:28.342 INFO:tasks.workunit.client.1.smithi129.stdout:0/906: truncate d0/d23/d29/f58 2644924 0 2024-03-18T14:43:28.344 INFO:tasks.workunit.client.1.smithi129.stdout:3/866: write d4/dd/d1f/d5f/d31/f98 [929259,68519] 0 2024-03-18T14:43:28.345 INFO:tasks.workunit.client.1.smithi129.stdout:2/920: truncate d7/d1f/d20/d36/da9/dc1/da5/fbb 1540263 0 2024-03-18T14:43:28.348 INFO:tasks.workunit.client.1.smithi129.stdout:9/897: rename d0/db/d11/d97/dd1/d26/d19/d29 to d0/db/d2e/d9d/d126 0 2024-03-18T14:43:28.351 INFO:tasks.workunit.client.1.smithi129.stdout:0/907: creat d0/d23/d6b/f10f x:0 0 0 2024-03-18T14:43:28.352 INFO:tasks.workunit.client.1.smithi129.stdout:4/824: truncate d0/d3c/fdf 147105 0 2024-03-18T14:43:28.352 INFO:tasks.workunit.client.1.smithi129.stdout:0/908: stat d0/d14/d91/f109 0 2024-03-18T14:43:28.354 INFO:tasks.workunit.client.1.smithi129.stdout:9/898: dwrite d0/db/f1d [0,4194304] 0 2024-03-18T14:43:28.354 INFO:tasks.workunit.client.1.smithi129.stdout:5/857: symlink d0/d32/d34/d103/l10f 0 2024-03-18T14:43:28.357 INFO:tasks.workunit.client.1.smithi129.stdout:8/929: dread d9/d11/f3b [0,4194304] 0 2024-03-18T14:43:28.360 INFO:tasks.workunit.client.1.smithi129.stdout:1/872: truncate d1/d35/db8/dc6/f10a 977127 0 2024-03-18T14:43:28.365 INFO:tasks.workunit.client.1.smithi129.stdout:3/867: mkdir d4/dd/d128 0 2024-03-18T14:43:28.367 INFO:tasks.workunit.client.1.smithi129.stdout:4/825: creat d0/d9/d85/f10d x:0 0 0 2024-03-18T14:43:28.368 INFO:tasks.workunit.client.1.smithi129.stdout:5/858: dread - d0/dc/d4c/ddd/fd5 zero size 2024-03-18T14:43:28.371 INFO:tasks.workunit.client.1.smithi129.stdout:4/826: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:28.372 INFO:tasks.workunit.client.1.smithi129.stdout:4/827: readlink d0/d9/d85/la5 0 2024-03-18T14:43:28.375 INFO:tasks.workunit.client.1.smithi129.stdout:4/828: write d0/d19/d46/d3e/d21/d7f/de2/feb [254107,56644] 0 2024-03-18T14:43:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:2/921: dwrite d7/d1f/d20/d36/da9/dc1/f15 [0,4194304] 0 2024-03-18T14:43:28.376 INFO:tasks.workunit.client.1.smithi129.stdout:7/886: link d4/f66 d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107/f11e 0 2024-03-18T14:43:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:3/868: truncate d4/dd/d1f/da8/fc6 1912751 0 2024-03-18T14:43:28.377 INFO:tasks.workunit.client.1.smithi129.stdout:7/887: chown d4/d83/d11a/d42/d58/lad 15 1 2024-03-18T14:43:28.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/899: symlink d0/d15/df0/l127 0 2024-03-18T14:43:28.382 INFO:tasks.workunit.client.1.smithi129.stdout:9/900: write d0/db/d11/d97/dd1/d26/d19/f9b [3242632,98073] 0 2024-03-18T14:43:28.383 INFO:tasks.workunit.client.1.smithi129.stdout:7/888: dwrite d4/d83/d11a/d79/dc6/d54/d86/fdf [0,4194304] 0 2024-03-18T14:43:28.383 INFO:tasks.workunit.client.1.smithi129.stdout:2/922: chown d7/l4b 1030286 1 2024-03-18T14:43:28.385 INFO:tasks.workunit.client.1.smithi129.stdout:4/829: creat d0/d19/d46/d3e/d21/d4d/d70/dfe/f10e x:0 0 0 2024-03-18T14:43:28.387 INFO:tasks.workunit.client.1.smithi129.stdout:9/901: dread d0/db/d11/d97/dd1/d26/d19/d8d/f98 [0,4194304] 0 2024-03-18T14:43:28.389 INFO:tasks.workunit.client.1.smithi129.stdout:2/923: dwrite d7/f6e [0,4194304] 0 2024-03-18T14:43:28.390 INFO:tasks.workunit.client.1.smithi129.stdout:9/902: creat d0/db/d2e/f128 x:0 0 0 2024-03-18T14:43:28.392 INFO:tasks.workunit.client.1.smithi129.stdout:7/889: creat d4/d83/d11a/d45/dca/d109/f11f x:0 0 0 2024-03-18T14:43:28.392 INFO:tasks.workunit.client.1.smithi129.stdout:3/869: creat d4/dd/d1f/f129 x:0 0 0 2024-03-18T14:43:28.397 INFO:tasks.workunit.client.1.smithi129.stdout:3/870: dwrite d4/dd/d1f/d111/d1d/d50/d90/fb6 [0,4194304] 0 2024-03-18T14:43:28.399 INFO:tasks.workunit.client.1.smithi129.stdout:1/873: write d1/db2/de2/fa5 [955725,56803] 0 2024-03-18T14:43:28.399 INFO:tasks.workunit.client.1.smithi129.stdout:8/930: write d9/d11/d1a/d32/d41/d4d/d96/dcc/ff4 [1040841,95876] 0 2024-03-18T14:43:28.400 INFO:tasks.workunit.client.1.smithi129.stdout:1/874: write d1/d91/fd9 [2050362,110843] 0 2024-03-18T14:43:28.400 INFO:tasks.workunit.client.1.smithi129.stdout:2/924: rename d7/d1f/d20/d36/da9/dc1/f109 to d7/d1c/d116/f121 0 2024-03-18T14:43:28.401 INFO:tasks.workunit.client.1.smithi129.stdout:7/890: mknod d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107/c120 0 2024-03-18T14:43:28.402 INFO:tasks.workunit.client.1.smithi129.stdout:7/891: dread - d4/d2d/d3a/fd6 zero size 2024-03-18T14:43:28.403 INFO:tasks.workunit.client.1.smithi129.stdout:7/892: chown d4/d83/d11a/d79/dc6/d38/d61/d68/c106 850635 1 2024-03-18T14:43:28.409 INFO:tasks.workunit.client.1.smithi129.stdout:4/830: truncate d0/d9/d40/d5f/fe5 73252 0 2024-03-18T14:43:28.411 INFO:tasks.workunit.client.1.smithi129.stdout:8/931: creat d9/d11/d1a/d32/d3a/d5d/f126 x:0 0 0 2024-03-18T14:43:28.412 INFO:tasks.workunit.client.1.smithi129.stdout:1/875: creat d1/d35/db8/f116 x:0 0 0 2024-03-18T14:43:28.413 INFO:tasks.workunit.client.1.smithi129.stdout:2/925: fsync d7/d1f/d20/d36/fe2 0 2024-03-18T14:43:28.413 INFO:tasks.workunit.client.1.smithi129.stdout:1/876: chown d1/db2/de2/fe6 22 1 2024-03-18T14:43:28.413 INFO:tasks.workunit.client.1.smithi129.stdout:1/877: chown d1/d35/ld8 4 1 2024-03-18T14:43:28.414 INFO:tasks.workunit.client.1.smithi129.stdout:1/878: fdatasync d1/d2/d28/d65/d19/d96/fdf 0 2024-03-18T14:43:28.419 INFO:tasks.workunit.client.1.smithi129.stdout:9/903: write d0/db/d6f/dda/f109 [4055312,47101] 0 2024-03-18T14:43:28.420 INFO:tasks.workunit.client.1.smithi129.stdout:6/899: sync 2024-03-18T14:43:28.431 INFO:tasks.workunit.client.1.smithi129.stdout:2/926: creat d7/d1c/d62/f122 x:0 0 0 2024-03-18T14:43:28.432 INFO:tasks.workunit.client.1.smithi129.stdout:3/871: write d4/dd/d1f/d2f/fad [2709703,84432] 0 2024-03-18T14:43:28.432 INFO:tasks.workunit.client.1.smithi129.stdout:1/879: mknod d1/d2/d28/d65/d19/dc9/d87/c117 0 2024-03-18T14:43:28.433 INFO:tasks.workunit.client.1.smithi129.stdout:4/831: symlink d0/l10f 0 2024-03-18T14:43:28.433 INFO:tasks.workunit.client.1.smithi129.stdout:7/893: write d4/f4f [1749149,127514] 0 2024-03-18T14:43:28.435 INFO:tasks.workunit.client.1.smithi129.stdout:9/904: creat d0/db/d6f/f129 x:0 0 0 2024-03-18T14:43:28.435 INFO:tasks.workunit.client.1.smithi129.stdout:2/927: symlink d7/d1c/d32/l123 0 2024-03-18T14:43:28.436 INFO:tasks.workunit.client.1.smithi129.stdout:1/880: write d1/d2/d28/d65/d19/d52/fa2 [78327,13426] 0 2024-03-18T14:43:28.436 INFO:tasks.workunit.client.1.smithi129.stdout:3/872: write d4/dd/d1f/d111/d34/df8/ded/f118 [701886,19356] 0 2024-03-18T14:43:28.439 INFO:tasks.workunit.client.1.smithi129.stdout:6/900: truncate d3/d6/d7f/d8f/d103/f105 589624 0 2024-03-18T14:43:28.439 INFO:tasks.workunit.client.1.smithi129.stdout:2/928: mkdir d7/d1c/d62/d124 0 2024-03-18T14:43:28.440 INFO:tasks.workunit.client.1.smithi129.stdout:6/901: fsync d3/d5/d46/df4/ff5 0 2024-03-18T14:43:28.441 INFO:tasks.workunit.client.1.smithi129.stdout:6/902: write d3/d5/f71 [1227550,37048] 0 2024-03-18T14:43:28.441 INFO:tasks.workunit.client.1.smithi129.stdout:2/929: stat d7/d1f/d20/d2b/d41/d65/d88/fd0 0 2024-03-18T14:43:28.442 INFO:tasks.workunit.client.1.smithi129.stdout:6/903: chown d3/d30/de/da9/lf9 550204298 1 2024-03-18T14:43:28.444 INFO:tasks.workunit.client.1.smithi129.stdout:9/905: creat d0/f12a x:0 0 0 2024-03-18T14:43:28.448 INFO:tasks.workunit.client.1.smithi129.stdout:6/904: stat d3/d30/de/d49/l67 0 2024-03-18T14:43:28.449 INFO:tasks.workunit.client.1.smithi129.stdout:3/873: dread d4/d38/f1b [0,4194304] 0 2024-03-18T14:43:28.449 INFO:tasks.workunit.client.1.smithi129.stdout:7/894: getdents d4/d83/d11a/d42/d108 0 2024-03-18T14:43:28.451 INFO:tasks.workunit.client.1.smithi129.stdout:9/906: dwrite d0/db/d11/d97/d99/d114/fa6 [4194304,4194304] 0 2024-03-18T14:43:28.455 INFO:tasks.workunit.client.1.smithi129.stdout:4/832: dread d0/d19/d46/d3e/f47 [0,4194304] 0 2024-03-18T14:43:28.456 INFO:tasks.workunit.client.1.smithi129.stdout:2/930: write d7/d1f/d20/d36/f9e [585563,31740] 0 2024-03-18T14:43:28.456 INFO:tasks.workunit.client.1.smithi129.stdout:4/833: dread - d0/d9/d6a/fe9 zero size 2024-03-18T14:43:28.458 INFO:tasks.workunit.client.1.smithi129.stdout:3/874: rmdir d4/dd/d1f/d111/d1d 39 2024-03-18T14:43:28.459 INFO:tasks.workunit.client.1.smithi129.stdout:1/881: dwrite d1/d2/f33 [0,4194304] 0 2024-03-18T14:43:28.460 INFO:tasks.workunit.client.1.smithi129.stdout:7/895: mknod d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/c121 0 2024-03-18T14:43:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:9/907: creat d0/da1/f12b x:0 0 0 2024-03-18T14:43:28.461 INFO:tasks.workunit.client.1.smithi129.stdout:9/908: chown d0/c3 125633 1 2024-03-18T14:43:28.467 INFO:tasks.workunit.client.1.smithi129.stdout:7/896: creat d4/d8c/f122 x:0 0 0 2024-03-18T14:43:28.468 INFO:tasks.workunit.client.1.smithi129.stdout:9/909: creat d0/db/d11/d97/d99/f12c x:0 0 0 2024-03-18T14:43:28.469 INFO:tasks.workunit.client.1.smithi129.stdout:4/834: truncate d0/d19/f84 432345 0 2024-03-18T14:43:28.469 INFO:tasks.workunit.client.1.smithi129.stdout:3/875: dwrite d4/dd/d1f/d2f/fc5 [0,4194304] 0 2024-03-18T14:43:28.470 INFO:tasks.workunit.client.1.smithi129.stdout:7/897: dread - d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/fc0 zero size 2024-03-18T14:43:28.470 INFO:tasks.workunit.client.1.smithi129.stdout:0/909: sync 2024-03-18T14:43:28.470 INFO:tasks.workunit.client.1.smithi129.stdout:5/859: sync 2024-03-18T14:43:28.472 INFO:tasks.workunit.client.1.smithi129.stdout:5/860: readlink d0/dc/d18/d2b/d8c/l95 0 2024-03-18T14:43:28.473 INFO:tasks.workunit.client.1.smithi129.stdout:1/882: link d1/l2d d1/d35/db8/dc6/df6/l118 0 2024-03-18T14:43:28.474 INFO:tasks.workunit.client.1.smithi129.stdout:0/910: fdatasync d0/d23/d35/d3b/d42/dc0/fdb 0 2024-03-18T14:43:28.474 INFO:tasks.workunit.client.1.smithi129.stdout:7/898: write d4/d83/d11a/d45/f55 [2617493,30318] 0 2024-03-18T14:43:28.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/835: creat d0/d19/d46/d3e/d21/d4d/d70/dc3/f110 x:0 0 0 2024-03-18T14:43:28.477 INFO:tasks.workunit.client.1.smithi129.stdout:6/905: write d3/d30/f87 [812050,68316] 0 2024-03-18T14:43:28.477 INFO:tasks.workunit.client.1.smithi129.stdout:0/911: write d0/d23/d35/d3b/fad [1002692,60857] 0 2024-03-18T14:43:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:5/861: mknod d0/d32/d3a/d52/c110 0 2024-03-18T14:43:28.479 INFO:tasks.workunit.client.1.smithi129.stdout:3/876: dread d4/fb3 [0,4194304] 0 2024-03-18T14:43:28.503 INFO:tasks.workunit.client.1.smithi129.stdout:1/883: rename d1/dbf/fcc to d1/d2/d28/da7/db5/f119 0 2024-03-18T14:43:28.503 INFO:tasks.workunit.client.1.smithi129.stdout:0/912: mknod d0/d23/d6b/c110 0 2024-03-18T14:43:28.503 INFO:tasks.workunit.client.1.smithi129.stdout:6/906: chown d3/d6/d7f/lee 405420663 1 2024-03-18T14:43:28.504 INFO:tasks.workunit.client.1.smithi129.stdout:9/910: dwrite d0/db/d11/d97/dd1/d26/d19/dd5/f106 [0,4194304] 0 2024-03-18T14:43:28.508 INFO:tasks.workunit.client.1.smithi129.stdout:1/884: chown d1/db2/de2/fa5 1 1 2024-03-18T14:43:28.508 INFO:tasks.workunit.client.1.smithi129.stdout:2/931: dwrite d7/d3f/f87 [0,4194304] 0 2024-03-18T14:43:28.508 INFO:tasks.workunit.client.1.smithi129.stdout:5/862: dread d0/d32/d34/f4d [0,4194304] 0 2024-03-18T14:43:28.509 INFO:tasks.workunit.client.1.smithi129.stdout:0/913: chown d0/d23/d71/dc2/d4a/l6d 9166903 1 2024-03-18T14:43:28.511 INFO:tasks.workunit.client.1.smithi129.stdout:2/932: stat d7/d1f/d20/d2b/d41/l95 0 2024-03-18T14:43:28.511 INFO:tasks.workunit.client.1.smithi129.stdout:7/899: dwrite d4/d83/d11a/d45/dca/dec/f10a [0,4194304] 0 2024-03-18T14:43:28.512 INFO:tasks.workunit.client.1.smithi129.stdout:5/863: chown d0/d32/d3a/d45/l101 2130136853 1 2024-03-18T14:43:28.512 INFO:tasks.workunit.client.1.smithi129.stdout:7/900: write d4/d8c/f9b [1061412,79081] 0 2024-03-18T14:43:28.513 INFO:tasks.workunit.client.1.smithi129.stdout:7/901: readlink d4/d83/d11a/d79/dc6/l56 0 2024-03-18T14:43:28.514 INFO:tasks.workunit.client.1.smithi129.stdout:7/902: fdatasync d4/fd8 0 2024-03-18T14:43:28.516 INFO:tasks.workunit.client.1.smithi129.stdout:3/877: mkdir d4/dd/d1f/d5f/d8c/d101/d12a 0 2024-03-18T14:43:28.516 INFO:tasks.workunit.client.1.smithi129.stdout:7/903: write d4/d83/d11a/d79/f9f [3173915,98599] 0 2024-03-18T14:43:28.517 INFO:tasks.workunit.client.1.smithi129.stdout:6/907: unlink d3/d6/d7f/lbd 0 2024-03-18T14:43:28.518 INFO:tasks.workunit.client.1.smithi129.stdout:5/864: dwrite d0/dc/d1a/d61/d94/db7/fe4 [0,4194304] 0 2024-03-18T14:43:28.522 INFO:tasks.workunit.client.1.smithi129.stdout:0/914: unlink d0/f55 0 2024-03-18T14:43:28.522 INFO:tasks.workunit.client.1.smithi129.stdout:3/878: dwrite d4/d38/da3/dc9/fe3 [0,4194304] 0 2024-03-18T14:43:28.524 INFO:tasks.workunit.client.1.smithi129.stdout:2/933: symlink d7/d1f/d20/d36/dc0/l125 0 2024-03-18T14:43:28.531 INFO:tasks.workunit.client.1.smithi129.stdout:0/915: mknod d0/de3/c111 0 2024-03-18T14:43:28.532 INFO:tasks.workunit.client.1.smithi129.stdout:0/916: chown d0/d14/f2d 0 1 2024-03-18T14:43:28.533 INFO:tasks.workunit.client.1.smithi129.stdout:2/934: mkdir d7/d1c/d32/d126 0 2024-03-18T14:43:28.533 INFO:tasks.workunit.client.1.smithi129.stdout:7/904: fdatasync d4/f16 0 2024-03-18T14:43:28.536 INFO:tasks.workunit.client.1.smithi129.stdout:8/932: sync 2024-03-18T14:43:28.536 INFO:tasks.workunit.client.1.smithi129.stdout:9/911: creat d0/db/d11/d97/dd1/d26/d19/f12d x:0 0 0 2024-03-18T14:43:28.538 INFO:tasks.workunit.client.1.smithi129.stdout:0/917: fdatasync d0/d14/f8a 0 2024-03-18T14:43:28.542 INFO:tasks.workunit.client.1.smithi129.stdout:7/905: mkdir d4/d8c/d123 0 2024-03-18T14:43:28.542 INFO:tasks.workunit.client.1.smithi129.stdout:6/908: link d3/d30/de/d65/l6d d3/d30/de/d6c/d9e/l125 0 2024-03-18T14:43:28.543 INFO:tasks.workunit.client.1.smithi129.stdout:8/933: creat d9/d11/d1a/d32/d41/d4d/d10a/d10e/f127 x:0 0 0 2024-03-18T14:43:28.552 INFO:tasks.workunit.client.1.smithi129.stdout:5/865: dwrite d0/d32/d34/f53 [0,4194304] 0 2024-03-18T14:43:28.552 INFO:tasks.workunit.client.1.smithi129.stdout:2/935: mkdir d7/d1f/d20/d2b/d41/d65/df0/d127 0 2024-03-18T14:43:28.559 INFO:tasks.workunit.client.1.smithi129.stdout:9/912: link d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f81 d0/da1/dc1/f12e 0 2024-03-18T14:43:28.560 INFO:tasks.workunit.client.1.smithi129.stdout:5/866: write d0/d32/d3a/d45/d83/ddf/dc4/fcd [701582,69724] 0 2024-03-18T14:43:28.561 INFO:tasks.workunit.client.1.smithi129.stdout:0/918: dwrite d0/f8e [0,4194304] 0 2024-03-18T14:43:28.562 INFO:tasks.workunit.client.1.smithi129.stdout:7/906: symlink d4/d2d/d3a/d114/l124 0 2024-03-18T14:43:28.563 INFO:tasks.workunit.client.1.smithi129.stdout:2/936: creat d7/d1c/d79/d118/f128 x:0 0 0 2024-03-18T14:43:28.564 INFO:tasks.workunit.client.1.smithi129.stdout:2/937: write d7/d3f/f87 [2966217,54896] 0 2024-03-18T14:43:28.566 INFO:tasks.workunit.client.1.smithi129.stdout:9/913: dread d0/db/d11/d97/dd1/d26/d19/f6a [0,4194304] 0 2024-03-18T14:43:28.566 INFO:tasks.workunit.client.1.smithi129.stdout:2/938: write d7/d1f/d20/d2b/d41/f5e [85106,104449] 0 2024-03-18T14:43:28.570 INFO:tasks.workunit.client.1.smithi129.stdout:0/919: mkdir d0/d23/d35/d112 0 2024-03-18T14:43:28.570 INFO:tasks.workunit.client.1.smithi129.stdout:5/867: creat d0/f111 x:0 0 0 2024-03-18T14:43:28.574 INFO:tasks.workunit.client.1.smithi129.stdout:2/939: mkdir d7/d1c/d79/d129 0 2024-03-18T14:43:28.575 INFO:tasks.workunit.client.1.smithi129.stdout:5/868: dwrite d0/d32/d34/f53 [0,4194304] 0 2024-03-18T14:43:28.576 INFO:tasks.workunit.client.1.smithi129.stdout:2/940: write d7/d1f/d20/d36/da9/dc1/f15 [2942391,113596] 0 2024-03-18T14:43:28.576 INFO:tasks.workunit.client.1.smithi129.stdout:7/907: link d4/d83/d11a/d79/dc6/fc3 d4/d2d/d3a/f125 0 2024-03-18T14:43:28.577 INFO:tasks.workunit.client.1.smithi129.stdout:2/941: stat d7/d1f/d20/d2d/f35 0 2024-03-18T14:43:28.578 INFO:tasks.workunit.client.1.smithi129.stdout:4/836: sync 2024-03-18T14:43:28.581 INFO:tasks.workunit.client.1.smithi129.stdout:6/909: dwrite d3/d30/ff0 [0,4194304] 0 2024-03-18T14:43:28.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/914: write d0/fe4 [294168,4490] 0 2024-03-18T14:43:28.582 INFO:tasks.workunit.client.1.smithi129.stdout:9/915: chown d0/db/d10b/f61 220117245 1 2024-03-18T14:43:28.586 INFO:tasks.workunit.client.1.smithi129.stdout:7/908: mkdir d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/d126 0 2024-03-18T14:43:28.589 INFO:tasks.workunit.client.1.smithi129.stdout:0/920: creat d0/d23/d35/d3b/de0/f113 x:0 0 0 2024-03-18T14:43:28.589 INFO:tasks.workunit.client.1.smithi129.stdout:0/921: chown d0/d23/d71/dc2/d4a/lec 4 1 2024-03-18T14:43:28.590 INFO:tasks.workunit.client.1.smithi129.stdout:2/942: symlink d7/d1f/d81/l12a 0 2024-03-18T14:43:28.590 INFO:tasks.workunit.client.1.smithi129.stdout:0/922: dread - d0/d23/d35/dde/f10c zero size 2024-03-18T14:43:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:7/909: mknod d4/d83/c127 0 2024-03-18T14:43:28.591 INFO:tasks.workunit.client.1.smithi129.stdout:0/923: chown d0/d23/d29/f38 5147 1 2024-03-18T14:43:28.593 INFO:tasks.workunit.client.1.smithi129.stdout:6/910: truncate d3/d6/d7f/db4/fc8 2390663 0 2024-03-18T14:43:28.593 INFO:tasks.workunit.client.1.smithi129.stdout:7/910: write d4/d83/d11a/d79/dc6/d38/d61/d6a/dba/ff1 [617244,124646] 0 2024-03-18T14:43:28.594 INFO:tasks.workunit.client.1.smithi129.stdout:7/911: stat d4/d83/d11a/f41 0 2024-03-18T14:43:28.596 INFO:tasks.workunit.client.1.smithi129.stdout:2/943: mkdir d7/d3f/d12b 0 2024-03-18T14:43:28.598 INFO:tasks.workunit.client.1.smithi129.stdout:6/911: symlink d3/d6/d82/l126 0 2024-03-18T14:43:28.600 INFO:tasks.workunit.client.1.smithi129.stdout:5/869: dwrite d0/df/f3c [4194304,4194304] 0 2024-03-18T14:43:28.601 INFO:tasks.workunit.client.1.smithi129.stdout:5/870: dread - d0/d32/d3a/d52/d6e/fc3 zero size 2024-03-18T14:43:28.601 INFO:tasks.workunit.client.1.smithi129.stdout:4/837: write d0/d9/d40/d5f/fe5 [454388,129964] 0 2024-03-18T14:43:28.602 INFO:tasks.workunit.client.1.smithi129.stdout:5/871: write d0/d32/d3a/d45/d83/ddf/f109 [985702,52287] 0 2024-03-18T14:43:28.604 INFO:tasks.workunit.client.1.smithi129.stdout:5/872: chown d0/dc/d18/d2b/d8c/f92 0 1 2024-03-18T14:43:28.605 INFO:tasks.workunit.client.1.smithi129.stdout:0/924: dread d0/d23/d71/dc2/d4a/f70 [4194304,4194304] 0 2024-03-18T14:43:28.605 INFO:tasks.workunit.client.1.smithi129.stdout:2/944: unlink d7/d1f/d20/d2b/d41/d65/d88/fe6 0 2024-03-18T14:43:28.608 INFO:tasks.workunit.client.1.smithi129.stdout:6/912: mknod d3/d30/de/d65/d80/c127 0 2024-03-18T14:43:28.612 INFO:tasks.workunit.client.1.smithi129.stdout:4/838: symlink d0/d19/d46/l111 0 2024-03-18T14:43:28.613 INFO:tasks.workunit.client.1.smithi129.stdout:5/873: mknod d0/d32/d3a/d52/d6e/dd8/c112 0 2024-03-18T14:43:28.613 INFO:tasks.workunit.client.1.smithi129.stdout:3/879: sync 2024-03-18T14:43:28.614 INFO:tasks.workunit.client.1.smithi129.stdout:1/885: sync 2024-03-18T14:43:28.614 INFO:tasks.workunit.client.1.smithi129.stdout:0/925: dread d0/d23/d35/d3b/fad [0,4194304] 0 2024-03-18T14:43:28.614 INFO:tasks.workunit.client.1.smithi129.stdout:5/874: write d0/dc/d4c/ddd/f8f [819354,62784] 0 2024-03-18T14:43:28.615 INFO:tasks.workunit.client.1.smithi129.stdout:0/926: fdatasync d0/d14/d28/df0/dc9/fef 0 2024-03-18T14:43:28.616 INFO:tasks.workunit.client.1.smithi129.stdout:0/927: chown d0/d23/d71 2166 1 2024-03-18T14:43:28.616 INFO:tasks.workunit.client.1.smithi129.stdout:7/912: truncate d4/d83/d11a/d42/f7c 2135371 0 2024-03-18T14:43:28.617 INFO:tasks.workunit.client.1.smithi129.stdout:0/928: read - d0/d23/d6b/ff2 zero size 2024-03-18T14:43:28.621 INFO:tasks.workunit.client.1.smithi129.stdout:4/839: mkdir d0/d3c/d6c/d105/d112 0 2024-03-18T14:43:28.624 INFO:tasks.workunit.client.1.smithi129.stdout:3/880: write d4/dd/d1f/d5f/d31/f5c [225667,128241] 0 2024-03-18T14:43:28.627 INFO:tasks.workunit.client.1.smithi129.stdout:4/840: unlink d0/d19/d46/d3e/d21/f103 0 2024-03-18T14:43:28.628 INFO:tasks.workunit.client.1.smithi129.stdout:5/875: dread d0/d32/d34/d6c/da3/fc7 [0,4194304] 0 2024-03-18T14:43:28.629 INFO:tasks.workunit.client.1.smithi129.stdout:8/934: sync 2024-03-18T14:43:28.629 INFO:tasks.workunit.client.1.smithi129.stdout:9/916: sync 2024-03-18T14:43:28.630 INFO:tasks.workunit.client.1.smithi129.stdout:2/945: dwrite d7/d1c/d79/dd5/f11f [0,4194304] 0 2024-03-18T14:43:28.630 INFO:tasks.workunit.client.1.smithi129.stdout:1/886: dread d1/fbe [0,4194304] 0 2024-03-18T14:43:28.630 INFO:tasks.workunit.client.1.smithi129.stdout:6/913: dread d3/d30/df/d28/f8c [0,4194304] 0 2024-03-18T14:43:28.631 INFO:tasks.workunit.client.1.smithi129.stdout:3/881: mkdir d4/dd/d1f/d111/d34/df8/d12b 0 2024-03-18T14:43:28.632 INFO:tasks.workunit.client.1.smithi129.stdout:0/929: rename d0/d14/f4d to d0/f114 0 2024-03-18T14:43:28.634 INFO:tasks.workunit.client.1.smithi129.stdout:3/882: fsync d4/dd/d1f/d111/d34/d3c/f9d 0 2024-03-18T14:43:28.637 INFO:tasks.workunit.client.1.smithi129.stdout:1/887: mkdir d1/d2/d28/d65/d19/dc9/d56/d11a 0 2024-03-18T14:43:28.638 INFO:tasks.workunit.client.1.smithi129.stdout:8/935: mknod d9/d11/d1a/d32/d41/d4d/d10a/d10e/c128 0 2024-03-18T14:43:28.642 INFO:tasks.workunit.client.1.smithi129.stdout:7/913: rename d4/d83/d11a/d79/dc6/d38/d61/d6a/dba/ff1 to d4/d83/d11a/d79/dc6/d11d/f128 0 2024-03-18T14:43:28.642 INFO:tasks.workunit.client.1.smithi129.stdout:6/914: truncate d3/d30/de/f58 2435870 0 2024-03-18T14:43:28.643 INFO:tasks.workunit.client.1.smithi129.stdout:7/914: fdatasync d4/d8c/d9e/fb1 0 2024-03-18T14:43:28.643 INFO:tasks.workunit.client.1.smithi129.stdout:9/917: dwrite d0/f1b [0,4194304] 0 2024-03-18T14:43:28.646 INFO:tasks.workunit.client.1.smithi129.stdout:5/876: mkdir d0/d32/d3a/d113 0 2024-03-18T14:43:28.647 INFO:tasks.workunit.client.1.smithi129.stdout:1/888: fsync d1/d2/d28/d65/d19/f37 0 2024-03-18T14:43:28.655 INFO:tasks.workunit.client.1.smithi129.stdout:3/883: dwrite d4/dd/d1f/d5f/de2/d11b/d97/fc1 [0,4194304] 0 2024-03-18T14:43:28.662 INFO:tasks.workunit.client.1.smithi129.stdout:5/877: symlink d0/d32/d3a/d52/l114 0 2024-03-18T14:43:28.663 INFO:tasks.workunit.client.1.smithi129.stdout:2/946: truncate d7/d1f/d20/d2b/d41/da6/f9b 1802328 0 2024-03-18T14:43:28.664 INFO:tasks.workunit.client.1.smithi129.stdout:1/889: rmdir d1/d2/d28/d65/d19/dc9/d87 39 2024-03-18T14:43:28.665 INFO:tasks.workunit.client.1.smithi129.stdout:1/890: write d1/d35/f9c [1611585,81792] 0 2024-03-18T14:43:28.667 INFO:tasks.workunit.client.1.smithi129.stdout:8/936: mkdir d9/d11/d55/d68/d129 0 2024-03-18T14:43:28.669 INFO:tasks.workunit.client.1.smithi129.stdout:6/915: mkdir d3/d6/dd5/d128 0 2024-03-18T14:43:28.670 INFO:tasks.workunit.client.1.smithi129.stdout:3/884: mkdir d4/dd/d1f/d5f/d31/d12c 0 2024-03-18T14:43:28.674 INFO:tasks.workunit.client.1.smithi129.stdout:7/915: rename d4/d83/d11a/d79/dc6/d38/d61/d6a/fe7 to d4/d83/d11a/d79/dc6/d38/f129 0 2024-03-18T14:43:28.688 INFO:tasks.workunit.client.1.smithi129.stdout:4/841: getdents d0/d19/d46/d3e/d21/d4d/d58/d61/d7e 0 2024-03-18T14:43:28.691 INFO:tasks.workunit.client.1.smithi129.stdout:1/891: unlink d1/d2/d28/d65/d19/d52/l6d 0 2024-03-18T14:43:28.692 INFO:tasks.workunit.client.1.smithi129.stdout:0/930: getdents d0/d14/d28/df0/dc9 0 2024-03-18T14:43:28.695 INFO:tasks.workunit.client.1.smithi129.stdout:9/918: link d0/db/d11/d97/dd1/d6c/dd4/ce9 d0/db/d53/c12f 0 2024-03-18T14:43:28.695 INFO:tasks.workunit.client.1.smithi129.stdout:9/919: stat d0/db/d11/f1a 0 2024-03-18T14:43:28.699 INFO:tasks.workunit.client.1.smithi129.stdout:4/842: fdatasync d0/d19/d46/f36 0 2024-03-18T14:43:28.700 INFO:tasks.workunit.client.1.smithi129.stdout:4/843: readlink d0/d19/d46/d3e/d21/d4d/d58/d61/l8a 0 2024-03-18T14:43:28.701 INFO:tasks.workunit.client.1.smithi129.stdout:8/937: mknod d9/d33/dc2/d11c/c12a 0 2024-03-18T14:43:28.701 INFO:tasks.workunit.client.1.smithi129.stdout:4/844: fsync d0/d19/d46/d3e/d21/d4d/d70/dfe/f93 0 2024-03-18T14:43:28.703 INFO:tasks.workunit.client.1.smithi129.stdout:9/920: fdatasync d0/f10 0 2024-03-18T14:43:28.705 INFO:tasks.workunit.client.1.smithi129.stdout:8/938: read d9/d11/d1a/d32/d41/d4d/ddb/fec [1779462,19936] 0 2024-03-18T14:43:28.707 INFO:tasks.workunit.client.1.smithi129.stdout:8/939: chown d9/d11/d1a/d32/d41 4300 1 2024-03-18T14:43:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:9/921: dwrite d0/db/d1f/d4c/d57/f82 [0,4194304] 0 2024-03-18T14:43:28.708 INFO:tasks.workunit.client.1.smithi129.stdout:8/940: write d9/d11/ff3 [1463597,69382] 0 2024-03-18T14:43:28.716 INFO:tasks.workunit.client.1.smithi129.stdout:5/878: write d0/dc/d1a/fbd [221665,25805] 0 2024-03-18T14:43:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:3/885: creat d4/dd/d1f/d111/f12d x:0 0 0 2024-03-18T14:43:28.722 INFO:tasks.workunit.client.1.smithi129.stdout:2/947: link d7/d1c/lfd d7/d1f/d20/l12c 0 2024-03-18T14:43:28.724 INFO:tasks.workunit.client.1.smithi129.stdout:9/922: mknod d0/db/d6f/dda/c130 0 2024-03-18T14:43:28.733 INFO:tasks.workunit.client.1.smithi129.stdout:4/845: dread d0/d19/d5d/fad [0,4194304] 0 2024-03-18T14:43:28.733 INFO:tasks.workunit.client.1.smithi129.stdout:0/931: truncate d0/d14/d91/fc7 1316619 0 2024-03-18T14:43:28.733 INFO:tasks.workunit.client.1.smithi129.stdout:4/846: chown d0/fbb 18 1 2024-03-18T14:43:28.734 INFO:tasks.workunit.client.1.smithi129.stdout:6/916: getdents d3/d30/de/d49/df8 0 2024-03-18T14:43:28.736 INFO:tasks.workunit.client.1.smithi129.stdout:8/941: dread d9/f15 [0,4194304] 0 2024-03-18T14:43:28.737 INFO:tasks.workunit.client.1.smithi129.stdout:8/942: chown d9/d33/dc2/ddc 0 1 2024-03-18T14:43:28.739 INFO:tasks.workunit.client.1.smithi129.stdout:9/923: fsync d0/db/d11/d97/dd1/d26/d19/d8d/fa8 0 2024-03-18T14:43:28.740 INFO:tasks.workunit.client.1.smithi129.stdout:7/916: creat d4/d83/d11a/d79/dc6/d38/d61/d6a/f12a x:0 0 0 2024-03-18T14:43:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:1/892: getdents d1/d2/d28 0 2024-03-18T14:43:28.742 INFO:tasks.workunit.client.1.smithi129.stdout:1/893: stat d1/d2/f4b 0 2024-03-18T14:43:28.744 INFO:tasks.workunit.client.1.smithi129.stdout:0/932: unlink d0/d14/d28/df0/l56 0 2024-03-18T14:43:28.748 INFO:tasks.workunit.client.1.smithi129.stdout:4/847: creat d0/d19/d46/d3e/d21/d4d/d58/d61/f113 x:0 0 0 2024-03-18T14:43:28.749 INFO:tasks.workunit.client.1.smithi129.stdout:4/848: dread - d0/d19/d46/d3e/d21/d4d/ffb zero size 2024-03-18T14:43:28.750 INFO:tasks.workunit.client.1.smithi129.stdout:4/849: chown d0/d9/d40/fbd 10392606 1 2024-03-18T14:43:28.750 INFO:tasks.workunit.client.1.smithi129.stdout:6/917: unlink d3/d30/de/d6c/l5d 0 2024-03-18T14:43:28.752 INFO:tasks.workunit.client.1.smithi129.stdout:3/886: creat d4/dd/d1f/d5f/d31/d12c/f12e x:0 0 0 2024-03-18T14:43:28.753 INFO:tasks.workunit.client.1.smithi129.stdout:2/948: creat d7/d1f/d20/d2d/dc9/f12d x:0 0 0 2024-03-18T14:43:28.755 INFO:tasks.workunit.client.1.smithi129.stdout:9/924: creat d0/db/d2e/d9d/f131 x:0 0 0 2024-03-18T14:43:28.757 INFO:tasks.workunit.client.1.smithi129.stdout:3/887: dwrite d4/d38/da3/dc9/fe3 [0,4194304] 0 2024-03-18T14:43:28.758 INFO:tasks.workunit.client.1.smithi129.stdout:7/917: dread d4/d83/d11a/d79/dc6/d54/d86/f99 [0,4194304] 0 2024-03-18T14:43:28.759 INFO:tasks.workunit.client.1.smithi129.stdout:7/918: chown d4/d2d/d3a/f78 102001 1 2024-03-18T14:43:28.760 INFO:tasks.workunit.client.1.smithi129.stdout:6/918: mkdir d3/d30/df/d28/d79/daf/db7/d11e/d129 0 2024-03-18T14:43:28.761 INFO:tasks.workunit.client.1.smithi129.stdout:2/949: mknod d7/d1c/d79/dd5/c12e 0 2024-03-18T14:43:28.762 INFO:tasks.workunit.client.1.smithi129.stdout:5/879: link d0/d32/d3a/d52/d6e/la6 d0/d32/d34/d6c/l115 0 2024-03-18T14:43:28.765 INFO:tasks.workunit.client.1.smithi129.stdout:1/894: link d1/d2/d28/f10d d1/d2/d28/d65/d19/d84/f11b 0 2024-03-18T14:43:28.765 INFO:tasks.workunit.client.1.smithi129.stdout:4/850: getdents d0/d19/d46/d3e/dc0/d100/d109 0 2024-03-18T14:43:28.766 INFO:tasks.workunit.client.1.smithi129.stdout:3/888: write d4/dd/d1f/d111/d1d/f120 [305605,48427] 0 2024-03-18T14:43:28.768 INFO:tasks.workunit.client.1.smithi129.stdout:8/943: rename d9/f1d to d9/d11/f12b 0 2024-03-18T14:43:28.769 INFO:tasks.workunit.client.1.smithi129.stdout:7/919: creat d4/d83/d11a/d79/dc6/d38/d61/d6a/f12b x:0 0 0 2024-03-18T14:43:28.775 INFO:tasks.workunit.client.1.smithi129.stdout:8/944: fsync d9/d11/d1a/d32/d3a/d5d/f112 0 2024-03-18T14:43:28.776 INFO:tasks.workunit.client.1.smithi129.stdout:2/950: dwrite d7/d1c/d116/f121 [0,4194304] 0 2024-03-18T14:43:28.778 INFO:tasks.workunit.client.1.smithi129.stdout:7/920: dwrite d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/fac [0,4194304] 0 2024-03-18T14:43:28.778 INFO:tasks.workunit.client.1.smithi129.stdout:4/851: symlink d0/l114 0 2024-03-18T14:43:28.780 INFO:tasks.workunit.client.1.smithi129.stdout:0/933: rename d0/d23/d71/dc2/d4a/fc1 to d0/d14/d28/f115 0 2024-03-18T14:43:28.782 INFO:tasks.workunit.client.1.smithi129.stdout:1/895: link d1/d2/d28/d65/d19/d52/c92 d1/db2/dc3/de7/c11c 0 2024-03-18T14:43:28.783 INFO:tasks.workunit.client.1.smithi129.stdout:9/925: dread d0/f8 [4194304,4194304] 0 2024-03-18T14:43:28.784 INFO:tasks.workunit.client.1.smithi129.stdout:1/896: dread - d1/d2/d28/d65/d19/d84/f11b zero size 2024-03-18T14:43:28.786 INFO:tasks.workunit.client.1.smithi129.stdout:0/934: dwrite d0/d14/d28/d63/d8d/ff9 [0,4194304] 0 2024-03-18T14:43:28.786 INFO:tasks.workunit.client.1.smithi129.stdout:8/945: creat d9/d11/d18/da4/f12c x:0 0 0 2024-03-18T14:43:28.790 INFO:tasks.workunit.client.1.smithi129.stdout:6/919: rename d3/d6/d7f/db4/d57/le3 to d3/d6/d7f/d8f/l12a 0 2024-03-18T14:43:28.791 INFO:tasks.workunit.client.1.smithi129.stdout:5/880: getdents d0/d32/d3a/d52/d69 0 2024-03-18T14:43:28.791 INFO:tasks.workunit.client.1.smithi129.stdout:7/921: read d4/f87 [280591,5312] 0 2024-03-18T14:43:28.791 INFO:tasks.workunit.client.1.smithi129.stdout:5/881: write d0/f2 [4587328,111138] 0 2024-03-18T14:43:28.792 INFO:tasks.workunit.client.1.smithi129.stdout:5/882: write d0/fd2 [207819,29364] 0 2024-03-18T14:43:28.800 INFO:tasks.workunit.client.1.smithi129.stdout:9/926: unlink d0/db/d11/d97/dd1/d26/d5f/f84 0 2024-03-18T14:43:28.811 INFO:tasks.workunit.client.1.smithi129.stdout:8/946: mknod d9/d11/db3/c12d 0 2024-03-18T14:43:28.817 INFO:tasks.workunit.client.1.smithi129.stdout:5/883: write d0/dc/f4e [4088863,85322] 0 2024-03-18T14:43:28.819 INFO:tasks.workunit.client.1.smithi129.stdout:5/884: read d0/f2 [4135290,11523] 0 2024-03-18T14:43:28.820 INFO:tasks.workunit.client.1.smithi129.stdout:7/922: dwrite d4/fd1 [0,4194304] 0 2024-03-18T14:43:28.820 INFO:tasks.workunit.client.1.smithi129.stdout:2/951: rmdir d7/d1f/d20/d36/d10d 0 2024-03-18T14:43:28.821 INFO:tasks.workunit.client.1.smithi129.stdout:0/935: fdatasync d0/d23/d35/d3b/f79 0 2024-03-18T14:43:28.821 INFO:tasks.workunit.client.1.smithi129.stdout:2/952: write d7/f1e [358314,129022] 0 2024-03-18T14:43:28.827 INFO:tasks.workunit.client.1.smithi129.stdout:9/927: truncate d0/db/d10b/dad/fec 986155 0 2024-03-18T14:43:28.830 INFO:tasks.workunit.client.1.smithi129.stdout:3/889: sync 2024-03-18T14:43:28.832 INFO:tasks.workunit.client.1.smithi129.stdout:0/936: symlink d0/d23/l116 0 2024-03-18T14:43:28.833 INFO:tasks.workunit.client.1.smithi129.stdout:0/937: write d0/d14/d91/f109 [236010,129009] 0 2024-03-18T14:43:28.834 INFO:tasks.workunit.client.1.smithi129.stdout:2/953: rmdir d7/d1f/d20/d2b/deb 39 2024-03-18T14:43:28.835 INFO:tasks.workunit.client.1.smithi129.stdout:6/920: mkdir d3/d30/de/d65/d93/dd0/d12b 0 2024-03-18T14:43:28.836 INFO:tasks.workunit.client.1.smithi129.stdout:1/897: creat d1/d2/d28/d65/d7c/f11d x:0 0 0 2024-03-18T14:43:28.837 INFO:tasks.workunit.client.1.smithi129.stdout:9/928: unlink d0/db/d2e/d9f/dcb/de0/lab 0 2024-03-18T14:43:28.840 INFO:tasks.workunit.client.1.smithi129.stdout:5/885: unlink d0/dc/f5b 0 2024-03-18T14:43:28.842 INFO:tasks.workunit.client.1.smithi129.stdout:5/886: write d0/d32/d34/f64 [1223778,29478] 0 2024-03-18T14:43:28.842 INFO:tasks.workunit.client.1.smithi129.stdout:7/923: mknod d4/d83/d11a/d79/dc6/d38/d49/c12c 0 2024-03-18T14:43:28.847 INFO:tasks.workunit.client.1.smithi129.stdout:2/954: dread d7/d3f/d5f/f8e [0,4194304] 0 2024-03-18T14:43:28.848 INFO:tasks.workunit.client.1.smithi129.stdout:8/947: truncate d9/d11/d1a/d32/d3a/d70/f8c 4379661 0 2024-03-18T14:43:28.849 INFO:tasks.workunit.client.1.smithi129.stdout:5/887: dwrite d0/dc/d1a/d61/d94/db7/fbb [0,4194304] 0 2024-03-18T14:43:28.849 INFO:tasks.workunit.client.1.smithi129.stdout:7/924: dwrite d4/d83/d11a/d79/dc6/d54/feb [0,4194304] 0 2024-03-18T14:43:28.849 INFO:tasks.workunit.client.1.smithi129.stdout:0/938: stat d0/d23/d35/d3b/l2f 0 2024-03-18T14:43:28.850 INFO:tasks.workunit.client.1.smithi129.stdout:8/948: dread - d9/d11/d1a/f10c zero size 2024-03-18T14:43:28.852 INFO:tasks.workunit.client.1.smithi129.stdout:3/890: write d4/d38/f47 [56231,12718] 0 2024-03-18T14:43:28.861 INFO:tasks.workunit.client.1.smithi129.stdout:2/955: rename d7/d1f/d20/d2b/d41/f5e to d7/d1f/d20/d36/da9/dcd/f12f 0 2024-03-18T14:43:28.861 INFO:tasks.workunit.client.1.smithi129.stdout:4/852: sync 2024-03-18T14:43:28.863 INFO:tasks.workunit.client.1.smithi129.stdout:6/921: truncate d3/d30/f20 2857475 0 2024-03-18T14:43:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:0/939: dread d0/d14/fb9 [0,4194304] 0 2024-03-18T14:43:28.866 INFO:tasks.workunit.client.1.smithi129.stdout:1/898: mknod d1/d2/d28/d65/d19/dc9/d87/c11e 0 2024-03-18T14:43:28.868 INFO:tasks.workunit.client.1.smithi129.stdout:3/891: creat d4/dd/d1f/d5f/dfa/f12f x:0 0 0 2024-03-18T14:43:28.869 INFO:tasks.workunit.client.1.smithi129.stdout:4/853: dwrite d0/d19/fc7 [0,4194304] 0 2024-03-18T14:43:28.869 INFO:tasks.workunit.client.1.smithi129.stdout:9/929: link d0/db/d2e/d9f/faa d0/db/d10b/d8e/f132 0 2024-03-18T14:43:28.870 INFO:tasks.workunit.client.1.smithi129.stdout:4/854: readlink d0/d19/d46/d3e/d21/d4d/d58/d61/l8a 0 2024-03-18T14:43:28.874 INFO:tasks.workunit.client.1.smithi129.stdout:8/949: write d9/d11/d1a/d32/d41/d4d/f4f [1904250,54627] 0 2024-03-18T14:43:28.875 INFO:tasks.workunit.client.1.smithi129.stdout:2/956: unlink d7/d3f/fa0 0 2024-03-18T14:43:28.877 INFO:tasks.workunit.client.1.smithi129.stdout:6/922: dread d3/d30/df/f10c [0,4194304] 0 2024-03-18T14:43:28.902 INFO:tasks.workunit.client.1.smithi129.stdout:0/940: creat d0/d23/d71/f117 x:0 0 0 2024-03-18T14:43:28.903 INFO:tasks.workunit.client.1.smithi129.stdout:1/899: creat d1/d2/d28/d65/d19/dc9/d71/f11f x:0 0 0 2024-03-18T14:43:28.905 INFO:tasks.workunit.client.1.smithi129.stdout:3/892: mkdir d4/dd/d1f/d5f/d82/d130 0 2024-03-18T14:43:28.914 INFO:tasks.workunit.client.1.smithi129.stdout:8/950: fsync d9/f7d 0 2024-03-18T14:43:28.916 INFO:tasks.workunit.client.1.smithi129.stdout:2/957: unlink d7/d1f/d20/d36/da9/dc1/l2c 0 2024-03-18T14:43:28.917 INFO:tasks.workunit.client.1.smithi129.stdout:7/925: truncate d4/d2d/d3a/fd6 610131 0 2024-03-18T14:43:28.917 INFO:tasks.workunit.client.1.smithi129.stdout:9/930: write d0/db/d1f/d4c/d57/f63 [55894,102980] 0 2024-03-18T14:43:28.919 INFO:tasks.workunit.client.1.smithi129.stdout:9/931: chown d0/db/d11/d97/dd1/d26/d19/dd5/le5 32 1 2024-03-18T14:43:28.920 INFO:tasks.workunit.client.1.smithi129.stdout:5/888: getdents d0/dc/d1a/d61/d94 0 2024-03-18T14:43:28.920 INFO:tasks.workunit.client.1.smithi129.stdout:9/932: stat d0/db/d11/d97/dd1/d26/d19/d8d/fff 0 2024-03-18T14:43:28.927 INFO:tasks.workunit.client.1.smithi129.stdout:7/926: symlink d4/d83/d11a/d79/dc6/d11d/l12d 0 2024-03-18T14:43:28.928 INFO:tasks.workunit.client.1.smithi129.stdout:1/900: symlink d1/d2/d28/d65/dd6/l120 0 2024-03-18T14:43:28.928 INFO:tasks.workunit.client.1.smithi129.stdout:4/855: creat d0/d19/d46/d3e/f115 x:0 0 0 2024-03-18T14:43:28.930 INFO:tasks.workunit.client.1.smithi129.stdout:5/889: dwrite d0/d32/d34/f64 [0,4194304] 0 2024-03-18T14:43:28.931 INFO:tasks.workunit.client.1.smithi129.stdout:0/941: dwrite d0/d23/d35/d50/f77 [0,4194304] 0 2024-03-18T14:43:28.931 INFO:tasks.workunit.client.1.smithi129.stdout:8/951: truncate d9/d11/d1a/f30 1659549 0 2024-03-18T14:43:28.931 INFO:tasks.workunit.client.1.smithi129.stdout:9/933: dwrite d0/db/d11/d97/dd1/d26/d5f/f72 [0,4194304] 0 2024-03-18T14:43:28.932 INFO:tasks.workunit.client.1.smithi129.stdout:6/923: link d3/d30/df/d28/d79/daf/lc0 d3/d30/df/d28/d79/daf/l12c 0 2024-03-18T14:43:28.933 INFO:tasks.workunit.client.1.smithi129.stdout:5/890: fdatasync d0/dc/d1a/fbd 0 2024-03-18T14:43:28.934 INFO:tasks.workunit.client.1.smithi129.stdout:0/942: chown d0/d23/d35/d3b/fad 244464 1 2024-03-18T14:43:28.936 INFO:tasks.workunit.client.1.smithi129.stdout:5/891: dread - d0/d32/d3a/d52/d6e/fc3 zero size 2024-03-18T14:43:28.936 INFO:tasks.workunit.client.1.smithi129.stdout:0/943: write d0/d14/f2d [8964510,77484] 0 2024-03-18T14:43:28.937 INFO:tasks.workunit.client.1.smithi129.stdout:1/901: creat d1/d2/d28/d65/d72/f121 x:0 0 0 2024-03-18T14:43:28.938 INFO:tasks.workunit.client.1.smithi129.stdout:0/944: fdatasync d0/d23/d6b/f10f 0 2024-03-18T14:43:28.941 INFO:tasks.workunit.client.1.smithi129.stdout:2/958: getdents d7/d1f/d20/d36/da9/dcd 0 2024-03-18T14:43:28.941 INFO:tasks.workunit.client.1.smithi129.stdout:2/959: readlink d7/l64 0 2024-03-18T14:43:28.945 INFO:tasks.workunit.client.1.smithi129.stdout:1/902: chown d1/f88 0 1 2024-03-18T14:43:28.945 INFO:tasks.workunit.client.1.smithi129.stdout:0/945: rmdir d0/d23/d71/dc2/d4a/d61 39 2024-03-18T14:43:28.947 INFO:tasks.workunit.client.1.smithi129.stdout:5/892: creat d0/d32/d3a/d113/f116 x:0 0 0 2024-03-18T14:43:28.948 INFO:tasks.workunit.client.1.smithi129.stdout:1/903: dread - d1/d2/d28/fa0 zero size 2024-03-18T14:43:28.948 INFO:tasks.workunit.client.1.smithi129.stdout:5/893: fdatasync d0/d32/d3a/d52/d69/fd7 0 2024-03-18T14:43:28.949 INFO:tasks.workunit.client.1.smithi129.stdout:4/856: dread d0/d3c/d6c/d89/de7/fff [0,4194304] 0 2024-03-18T14:43:28.953 INFO:tasks.workunit.client.1.smithi129.stdout:8/952: getdents d9/d11/d1a/d32/d3a/d9a 0 2024-03-18T14:43:28.954 INFO:tasks.workunit.client.1.smithi129.stdout:2/960: mknod d7/d1f/d20/c130 0 2024-03-18T14:43:28.955 INFO:tasks.workunit.client.1.smithi129.stdout:2/961: write d7/d1f/d20/d2d/dab/fde [379371,111340] 0 2024-03-18T14:43:28.957 INFO:tasks.workunit.client.1.smithi129.stdout:5/894: creat d0/dc/d18/d2b/d8c/f117 x:0 0 0 2024-03-18T14:43:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:4/857: chown d0/d9/d85/cec 87162801 1 2024-03-18T14:43:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:5/895: dread - d0/dc/d1a/d61/faf zero size 2024-03-18T14:43:28.958 INFO:tasks.workunit.client.1.smithi129.stdout:7/927: write d4/d2d/f2a [1179939,28050] 0 2024-03-18T14:43:28.960 INFO:tasks.workunit.client.1.smithi129.stdout:0/946: dread d0/d23/d71/dc2/f4c [0,4194304] 0 2024-03-18T14:43:28.961 INFO:tasks.workunit.client.1.smithi129.stdout:1/904: mknod d1/d2/d28/d65/d19/c122 0 2024-03-18T14:43:28.963 INFO:tasks.workunit.client.1.smithi129.stdout:5/896: mknod d0/dc/d1a/d61/d94/db7/c118 0 2024-03-18T14:43:28.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/858: mkdir d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/d116 0 2024-03-18T14:43:28.965 INFO:tasks.workunit.client.1.smithi129.stdout:1/905: chown d1/d2/d28/d65/f98 39635470 1 2024-03-18T14:43:28.966 INFO:tasks.workunit.client.1.smithi129.stdout:2/962: unlink d7/d1c/d32/lec 0 2024-03-18T14:43:28.966 INFO:tasks.workunit.client.1.smithi129.stdout:9/934: dread d0/db/d11/f1a [0,4194304] 0 2024-03-18T14:43:28.966 INFO:tasks.workunit.client.1.smithi129.stdout:6/924: dwrite d3/d5/d46/f55 [0,4194304] 0 2024-03-18T14:43:28.967 INFO:tasks.workunit.client.1.smithi129.stdout:0/947: creat d0/d14/d28/df0/f118 x:0 0 0 2024-03-18T14:43:28.967 INFO:tasks.workunit.client.1.smithi129.stdout:5/897: write d0/d32/d34/f70 [208407,39513] 0 2024-03-18T14:43:28.968 INFO:tasks.workunit.client.1.smithi129.stdout:4/859: dread - d0/d19/d46/d3e/d21/d4d/d70/dc3/f110 zero size 2024-03-18T14:43:28.968 INFO:tasks.workunit.client.1.smithi129.stdout:9/935: dread - d0/db/d2e/d9d/dbb/f10f zero size 2024-03-18T14:43:28.984 INFO:tasks.workunit.client.1.smithi129.stdout:3/893: sync 2024-03-18T14:43:28.990 INFO:tasks.workunit.client.1.smithi129.stdout:8/953: getdents d9/d11/d55/d6a/d6f/df8 0 2024-03-18T14:43:28.990 INFO:tasks.workunit.client.1.smithi129.stdout:2/963: write d7/d1f/d20/d72/f9f [1005230,6028] 0 2024-03-18T14:43:28.990 INFO:tasks.workunit.client.1.smithi129.stdout:6/925: chown d3/d5/d46/c99 113823728 1 2024-03-18T14:43:28.993 INFO:tasks.workunit.client.1.smithi129.stdout:7/928: dwrite d4/d83/d11a/d45/dca/dec/f10a [4194304,4194304] 0 2024-03-18T14:43:28.993 INFO:tasks.workunit.client.1.smithi129.stdout:0/948: creat d0/de3/f119 x:0 0 0 2024-03-18T14:43:28.995 INFO:tasks.workunit.client.1.smithi129.stdout:9/936: dread - d0/db/d1f/dae/faf zero size 2024-03-18T14:43:28.997 INFO:tasks.workunit.client.1.smithi129.stdout:3/894: creat d4/dd/d1f/d5f/de2/f131 x:0 0 0 2024-03-18T14:43:28.999 INFO:tasks.workunit.client.1.smithi129.stdout:0/949: read d0/d14/d91/fe6 [150738,18567] 0 2024-03-18T14:43:29.002 INFO:tasks.workunit.client.1.smithi129.stdout:5/898: dwrite d0/d32/d3a/d45/d83/ddf/f109 [0,4194304] 0 2024-03-18T14:43:29.002 INFO:tasks.workunit.client.1.smithi129.stdout:9/937: creat d0/d15/df0/f133 x:0 0 0 2024-03-18T14:43:29.004 INFO:tasks.workunit.client.1.smithi129.stdout:5/899: readlink d0/dc/d18/la8 0 2024-03-18T14:43:29.004 INFO:tasks.workunit.client.1.smithi129.stdout:8/954: rename d9/d11/d1a/d14/dc0/fba to d9/d11/d55/d68/d72/d90/f12e 0 2024-03-18T14:43:29.005 INFO:tasks.workunit.client.1.smithi129.stdout:6/926: dwrite d3/d6/f51 [0,4194304] 0 2024-03-18T14:43:29.006 INFO:tasks.workunit.client.1.smithi129.stdout:2/964: write d7/d1f/d20/d36/f73 [2373319,37074] 0 2024-03-18T14:43:29.009 INFO:tasks.workunit.client.1.smithi129.stdout:2/965: write d7/d1f/d20/d2b/f51 [5559354,57642] 0 2024-03-18T14:43:29.010 INFO:tasks.workunit.client.1.smithi129.stdout:6/927: dread d3/d30/d44/fe7 [0,4194304] 0 2024-03-18T14:43:29.010 INFO:tasks.workunit.client.1.smithi129.stdout:0/950: dwrite d0/d23/d71/dcd/fea [0,4194304] 0 2024-03-18T14:43:29.012 INFO:tasks.workunit.client.1.smithi129.stdout:6/928: write d3/d6/d7f/d8f/fce [762254,18720] 0 2024-03-18T14:43:29.012 INFO:tasks.workunit.client.1.smithi129.stdout:7/929: rename d4/d2d/d3a/d114/l124 to d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/l12e 0 2024-03-18T14:43:29.015 INFO:tasks.workunit.client.1.smithi129.stdout:8/955: mkdir d9/d33/dc2/d11c/d12f 0 2024-03-18T14:43:29.015 INFO:tasks.workunit.client.1.smithi129.stdout:4/860: dread d0/d3c/fb0 [0,4194304] 0 2024-03-18T14:43:29.019 INFO:tasks.workunit.client.1.smithi129.stdout:9/938: creat d0/db/d11/d97/dd1/d26/d19/f134 x:0 0 0 2024-03-18T14:43:29.020 INFO:tasks.workunit.client.1.smithi129.stdout:8/956: dwrite d9/d11/d18/da4/f9c [4194304,4194304] 0 2024-03-18T14:43:29.021 INFO:tasks.workunit.client.1.smithi129.stdout:8/957: stat d9/d11/d55/d6a/d6f/la6 0 2024-03-18T14:43:29.022 INFO:tasks.workunit.client.1.smithi129.stdout:8/958: stat d9/d11/d1a/d32/d41/d4d/d96/dcc 0 2024-03-18T14:43:29.023 INFO:tasks.workunit.client.1.smithi129.stdout:0/951: mknod d0/c11a 0 2024-03-18T14:43:29.024 INFO:tasks.workunit.client.1.smithi129.stdout:8/959: write d9/d11/d1a/d32/d41/d4d/d10a/d10e/f127 [125367,51244] 0 2024-03-18T14:43:29.024 INFO:tasks.workunit.client.1.smithi129.stdout:0/952: readlink d0/d23/d35/d3b/l2f 0 2024-03-18T14:43:29.026 INFO:tasks.workunit.client.1.smithi129.stdout:4/861: creat d0/d19/d46/d3e/d21/d4d/d58/f117 x:0 0 0 2024-03-18T14:43:29.026 INFO:tasks.workunit.client.1.smithi129.stdout:3/895: getdents d4/dd/d1f/d5f/d8c/d101 0 2024-03-18T14:43:29.027 INFO:tasks.workunit.client.1.smithi129.stdout:3/896: fsync d4/dd/d1f/d2f/fad 0 2024-03-18T14:43:29.027 INFO:tasks.workunit.client.1.smithi129.stdout:9/939: symlink d0/da1/l135 0 2024-03-18T14:43:29.032 INFO:tasks.workunit.client.1.smithi129.stdout:9/940: dwrite d0/db/d11/d97/dd1/ff6 [0,4194304] 0 2024-03-18T14:43:29.033 INFO:tasks.workunit.client.1.smithi129.stdout:9/941: write d0/db/d1f/f7b [318545,20556] 0 2024-03-18T14:43:29.034 INFO:tasks.workunit.client.1.smithi129.stdout:5/900: write d0/df/f59 [2182926,74471] 0 2024-03-18T14:43:29.035 INFO:tasks.workunit.client.1.smithi129.stdout:8/960: creat d9/d11/d18/da4/d125/f130 x:0 0 0 2024-03-18T14:43:29.038 INFO:tasks.workunit.client.1.smithi129.stdout:9/942: dwrite d0/db/d2e/d9f/dcb/f11c [0,4194304] 0 2024-03-18T14:43:29.039 INFO:tasks.workunit.client.1.smithi129.stdout:6/929: rename d3/d30/de/d65/d93/dd0/ffd to d3/d30/df/d28/f12d 0 2024-03-18T14:43:29.041 INFO:tasks.workunit.client.1.smithi129.stdout:7/930: write d4/d83/d11a/d42/d58/f60 [297326,98631] 0 2024-03-18T14:43:29.044 INFO:tasks.workunit.client.1.smithi129.stdout:9/943: dwrite d0/db/d11/d97/dd1/d26/d19/d8d/fff [0,4194304] 0 2024-03-18T14:43:29.045 INFO:tasks.workunit.client.1.smithi129.stdout:9/944: chown d0/db/d2e/cac 175585 1 2024-03-18T14:43:29.045 INFO:tasks.workunit.client.1.smithi129.stdout:3/897: creat d4/dd/d1f/d5f/d82/f132 x:0 0 0 2024-03-18T14:43:29.046 INFO:tasks.workunit.client.1.smithi129.stdout:2/966: getdents d7/d1c/d79 0 2024-03-18T14:43:29.047 INFO:tasks.workunit.client.1.smithi129.stdout:0/953: fsync d0/d14/d28/f115 0 2024-03-18T14:43:29.051 INFO:tasks.workunit.client.1.smithi129.stdout:6/930: mkdir d3/d6/d82/d12e 0 2024-03-18T14:43:29.055 INFO:tasks.workunit.client.1.smithi129.stdout:3/898: write d4/dd/d1f/d111/d34/d53/f80 [2116224,41254] 0 2024-03-18T14:43:29.059 INFO:tasks.workunit.client.1.smithi129.stdout:4/862: creat d0/d3c/d6c/d89/f118 x:0 0 0 2024-03-18T14:43:29.060 INFO:tasks.workunit.client.1.smithi129.stdout:6/931: mkdir d3/d6/d7f/db4/d12f 0 2024-03-18T14:43:29.060 INFO:tasks.workunit.client.1.smithi129.stdout:6/932: read - d3/d6/d82/d9a/dad/fe8 zero size 2024-03-18T14:43:29.069 INFO:tasks.workunit.client.1.smithi129.stdout:0/954: dread d0/d23/d71/fa9 [4194304,4194304] 0 2024-03-18T14:43:29.070 INFO:tasks.workunit.client.1.smithi129.stdout:9/945: rmdir d0/db/d10b/d8e/d121 0 2024-03-18T14:43:29.071 INFO:tasks.workunit.client.1.smithi129.stdout:1/906: sync 2024-03-18T14:43:29.072 INFO:tasks.workunit.client.1.smithi129.stdout:2/967: dwrite d7/d1f/d20/d36/da9/dc1/fc5 [0,4194304] 0 2024-03-18T14:43:29.072 INFO:tasks.workunit.client.1.smithi129.stdout:6/933: chown d3/d30/de/d65/l6d 4445595 1 2024-03-18T14:43:29.072 INFO:tasks.workunit.client.1.smithi129.stdout:7/931: dread d4/d8c/f9b [4194304,4194304] 0 2024-03-18T14:43:29.072 INFO:tasks.workunit.client.1.smithi129.stdout:3/899: truncate d4/dd/db0/ffc 1133798 0 2024-03-18T14:43:29.073 INFO:tasks.workunit.client.1.smithi129.stdout:8/961: getdents d9/d11/d55/d6a/d6f 0 2024-03-18T14:43:29.074 INFO:tasks.workunit.client.1.smithi129.stdout:9/946: dread - d0/db/d11/d97/dd1/d26/f11f zero size 2024-03-18T14:43:29.076 INFO:tasks.workunit.client.1.smithi129.stdout:0/955: creat d0/d23/d35/d3b/d42/f11b x:0 0 0 2024-03-18T14:43:29.077 INFO:tasks.workunit.client.1.smithi129.stdout:0/956: fsync d0/d23/d71/dcd/fea 0 2024-03-18T14:43:29.080 INFO:tasks.workunit.client.1.smithi129.stdout:2/968: creat d7/d1f/d20/d2b/d41/da6/f131 x:0 0 0 2024-03-18T14:43:29.082 INFO:tasks.workunit.client.1.smithi129.stdout:1/907: rename d1/d2/d28/d65/d19/d52/l103 to d1/d2/d28/d65/d19/dc9/d87/dc0/l123 0 2024-03-18T14:43:29.084 INFO:tasks.workunit.client.1.smithi129.stdout:4/863: getdents d0/d3c/d6c 0 2024-03-18T14:43:29.085 INFO:tasks.workunit.client.1.smithi129.stdout:3/900: mknod d4/dd/d128/c133 0 2024-03-18T14:43:29.087 INFO:tasks.workunit.client.1.smithi129.stdout:1/908: dwrite d1/d35/d7a/fcf [0,4194304] 0 2024-03-18T14:43:29.089 INFO:tasks.workunit.client.1.smithi129.stdout:0/957: rename d0/d23/d6b/c73 to d0/d23/d29/c11c 0 2024-03-18T14:43:29.090 INFO:tasks.workunit.client.1.smithi129.stdout:0/958: readlink d0/d23/l116 0 2024-03-18T14:43:29.091 INFO:tasks.workunit.client.1.smithi129.stdout:9/947: write d0/db/d11/d97/dd1/d26/d19/f6a [1383973,59428] 0 2024-03-18T14:43:29.091 INFO:tasks.workunit.client.1.smithi129.stdout:6/934: dwrite d3/d6/f4e [0,4194304] 0 2024-03-18T14:43:29.093 INFO:tasks.workunit.client.1.smithi129.stdout:7/932: link d4/d83/d11a/d79/dc6/d38/d61/d6a/f12b d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107/f12f 0 2024-03-18T14:43:29.097 INFO:tasks.workunit.client.1.smithi129.stdout:6/935: dread - d3/d30/de/da9/fcf zero size 2024-03-18T14:43:29.098 INFO:tasks.workunit.client.1.smithi129.stdout:9/948: mkdir d0/db/d11/d97/dd1/d6c/d136 0 2024-03-18T14:43:29.100 INFO:tasks.workunit.client.1.smithi129.stdout:2/969: rmdir d7/d1c/d79/dd5/d10b 0 2024-03-18T14:43:29.101 INFO:tasks.workunit.client.1.smithi129.stdout:1/909: dread d1/db2/de2/fa5 [0,4194304] 0 2024-03-18T14:43:29.102 INFO:tasks.workunit.client.1.smithi129.stdout:3/901: mknod d4/dd/d1f/d5f/d82/d130/c134 0 2024-03-18T14:43:29.103 INFO:tasks.workunit.client.1.smithi129.stdout:5/901: sync 2024-03-18T14:43:29.105 INFO:tasks.workunit.client.1.smithi129.stdout:2/970: dwrite d7/d1f/d20/d36/ffc [0,4194304] 0 2024-03-18T14:43:29.107 INFO:tasks.workunit.client.1.smithi129.stdout:4/864: write d0/d3c/fdf [817096,33496] 0 2024-03-18T14:43:29.108 INFO:tasks.workunit.client.1.smithi129.stdout:0/959: write d0/d14/d91/fc7 [346467,65946] 0 2024-03-18T14:43:29.110 INFO:tasks.workunit.client.1.smithi129.stdout:9/949: write d0/db/d10b/f61 [4903240,535] 0 2024-03-18T14:43:29.111 INFO:tasks.workunit.client.1.smithi129.stdout:7/933: symlink d4/d83/d11a/d42/l130 0 2024-03-18T14:43:29.112 INFO:tasks.workunit.client.1.smithi129.stdout:1/910: mknod d1/d2/d28/d65/d19/dc9/d87/d8c/c124 0 2024-03-18T14:43:29.114 INFO:tasks.workunit.client.1.smithi129.stdout:3/902: readlink d4/dd/d41/l114 0 2024-03-18T14:43:29.117 INFO:tasks.workunit.client.1.smithi129.stdout:9/950: dwrite d0/db/d11/d97/dd1/d6c/fc6 [0,4194304] 0 2024-03-18T14:43:29.122 INFO:tasks.workunit.client.1.smithi129.stdout:3/903: creat d4/dd/db0/dc3/f135 x:0 0 0 2024-03-18T14:43:29.122 INFO:tasks.workunit.client.1.smithi129.stdout:4/865: fsync d0/d19/d46/d3e/d21/f5c 0 2024-03-18T14:43:29.123 INFO:tasks.workunit.client.1.smithi129.stdout:0/960: dread d0/d23/f108 [0,4194304] 0 2024-03-18T14:43:29.125 INFO:tasks.workunit.client.1.smithi129.stdout:9/951: mknod d0/db/d11/d97/dd1/d6c/d136/c137 0 2024-03-18T14:43:29.126 INFO:tasks.workunit.client.1.smithi129.stdout:4/866: dread d0/d19/d5d/fad [0,4194304] 0 2024-03-18T14:43:29.128 INFO:tasks.workunit.client.1.smithi129.stdout:0/961: creat d0/d23/d71/dcd/f11d x:0 0 0 2024-03-18T14:43:29.128 INFO:tasks.workunit.client.1.smithi129.stdout:7/934: dread d4/f4f [0,4194304] 0 2024-03-18T14:43:29.129 INFO:tasks.workunit.client.1.smithi129.stdout:2/971: write d7/d1c/d32/f75 [376949,18827] 0 2024-03-18T14:43:29.129 INFO:tasks.workunit.client.1.smithi129.stdout:7/935: stat d4/d83/d11a/d79/dc6/d38/d49/cd7 0 2024-03-18T14:43:29.129 INFO:tasks.workunit.client.1.smithi129.stdout:8/962: sync 2024-03-18T14:43:29.130 INFO:tasks.workunit.client.1.smithi129.stdout:3/904: truncate d4/d38/d9b/d107/f119 702114 0 2024-03-18T14:43:29.132 INFO:tasks.workunit.client.1.smithi129.stdout:5/902: truncate d0/d32/d3a/df2/f105 4308510 0 2024-03-18T14:43:29.132 INFO:tasks.workunit.client.1.smithi129.stdout:1/911: write d1/d2/d28/d65/d72/f78 [242006,83710] 0 2024-03-18T14:43:29.133 INFO:tasks.workunit.client.1.smithi129.stdout:5/903: fdatasync d0/fb5 0 2024-03-18T14:43:29.135 INFO:tasks.workunit.client.1.smithi129.stdout:9/952: rename d0/db/d2e/d9d to d0/db/d11/d138 0 2024-03-18T14:43:29.136 INFO:tasks.workunit.client.1.smithi129.stdout:4/867: mknod d0/d19/d46/d3e/dc0/c119 0 2024-03-18T14:43:29.136 INFO:tasks.workunit.client.1.smithi129.stdout:7/936: dwrite d4/d83/d11a/f5a [0,4194304] 0 2024-03-18T14:43:29.136 INFO:tasks.workunit.client.1.smithi129.stdout:6/936: dread d3/d30/f66 [0,4194304] 0 2024-03-18T14:43:29.136 INFO:tasks.workunit.client.1.smithi129.stdout:5/904: write d0/dc/d4c/ddd/fd5 [797585,61420] 0 2024-03-18T14:43:29.140 INFO:tasks.workunit.client.1.smithi129.stdout:7/937: write d4/d2d/d3a/f78 [4137850,81845] 0 2024-03-18T14:43:29.140 INFO:tasks.workunit.client.1.smithi129.stdout:2/972: rmdir d7/d1f/d81/dd4 39 2024-03-18T14:43:29.142 INFO:tasks.workunit.client.1.smithi129.stdout:3/905: creat d4/dd/d1f/d5f/de2/f136 x:0 0 0 2024-03-18T14:43:29.142 INFO:tasks.workunit.client.1.smithi129.stdout:1/912: dwrite d1/db2/f100 [0,4194304] 0 2024-03-18T14:43:29.143 INFO:tasks.workunit.client.1.smithi129.stdout:2/973: write d7/d1f/d20/d2b/d41/d65/d88/fd0 [504923,83135] 0 2024-03-18T14:43:29.144 INFO:tasks.workunit.client.1.smithi129.stdout:2/974: fdatasync d7/d1f/d20/d36/da9/fbc 0 2024-03-18T14:43:29.147 INFO:tasks.workunit.client.1.smithi129.stdout:9/953: mknod d0/db/d11/c139 0 2024-03-18T14:43:29.148 INFO:tasks.workunit.client.1.smithi129.stdout:0/962: symlink d0/d23/d71/dc2/d4a/d61/l11e 0 2024-03-18T14:43:29.148 INFO:tasks.workunit.client.1.smithi129.stdout:4/868: rmdir d0/d19/d46/d3e/d21/d4d/d58/d61/d7e 39 2024-03-18T14:43:29.149 INFO:tasks.workunit.client.1.smithi129.stdout:4/869: readlink d0/d9/d40/d5f/d77/l101 0 2024-03-18T14:43:29.151 INFO:tasks.workunit.client.1.smithi129.stdout:6/937: rename d3/d30/de/d65/d80 to d3/d5/d46/d130 0 2024-03-18T14:43:29.153 INFO:tasks.workunit.client.1.smithi129.stdout:7/938: mkdir d4/d83/d11a/d79/dc6/d38/d61/d68/d131 0 2024-03-18T14:43:29.154 INFO:tasks.workunit.client.1.smithi129.stdout:7/939: chown d4/d2d/c33 2 1 2024-03-18T14:43:29.154 INFO:tasks.workunit.client.1.smithi129.stdout:3/906: rmdir d4/dd/d1f/d5f/de2/d11b 39 2024-03-18T14:43:29.189 INFO:tasks.workunit.client.1.smithi129.stdout:1/913: mkdir d1/db2/dc3/dc8/d125 0 2024-03-18T14:43:29.190 INFO:tasks.workunit.client.1.smithi129.stdout:3/907: stat d4/dd/d1f/d111/d34/d3c/l6d 0 2024-03-18T14:43:29.191 INFO:tasks.workunit.client.1.smithi129.stdout:4/870: chown d0/d19/d46/d3e/d21/d4d/d70/lf0 3070 1 2024-03-18T14:43:29.192 INFO:tasks.workunit.client.1.smithi129.stdout:6/938: truncate d3/d30/df/f85 2571305 0 2024-03-18T14:43:29.192 INFO:tasks.workunit.client.1.smithi129.stdout:0/963: write d0/d23/d35/d3b/f33 [3310303,127191] 0 2024-03-18T14:43:29.193 INFO:tasks.workunit.client.1.smithi129.stdout:1/914: write d1/d2/d28/d65/fe3 [186403,24633] 0 2024-03-18T14:43:29.195 INFO:tasks.workunit.client.1.smithi129.stdout:5/905: getdents d0/df 0 2024-03-18T14:43:29.196 INFO:tasks.workunit.client.1.smithi129.stdout:6/939: symlink d3/d6/dd5/l131 0 2024-03-18T14:43:29.196 INFO:tasks.workunit.client.1.smithi129.stdout:0/964: write d0/d14/f104 [764217,105110] 0 2024-03-18T14:43:29.196 INFO:tasks.workunit.client.1.smithi129.stdout:3/908: read d4/dd/d1f/d5f/d8c/f8d [190177,35277] 0 2024-03-18T14:43:29.198 INFO:tasks.workunit.client.1.smithi129.stdout:7/940: rename d4/d83/d11a/d45/f5e to d4/d83/d11a/d79/f132 0 2024-03-18T14:43:29.199 INFO:tasks.workunit.client.1.smithi129.stdout:6/940: write d3/d5/f27 [3366556,20884] 0 2024-03-18T14:43:29.200 INFO:tasks.workunit.client.1.smithi129.stdout:1/915: write d1/d35/d7a/f94 [2678436,19111] 0 2024-03-18T14:43:29.202 INFO:tasks.workunit.client.1.smithi129.stdout:9/954: dwrite d0/db/f6b [0,4194304] 0 2024-03-18T14:43:29.202 INFO:tasks.workunit.client.1.smithi129.stdout:4/871: mknod d0/d19/d46/d3e/dc0/d100/d109/c11a 0 2024-03-18T14:43:29.204 INFO:tasks.workunit.client.1.smithi129.stdout:8/963: sync 2024-03-18T14:43:29.205 INFO:tasks.workunit.client.1.smithi129.stdout:9/955: fsync d0/da1/dc1/feb 0 2024-03-18T14:43:29.207 INFO:tasks.workunit.client.1.smithi129.stdout:8/964: stat d9/d11/d18/da4/dd2 0 2024-03-18T14:43:29.209 INFO:tasks.workunit.client.1.smithi129.stdout:5/906: dwrite d0/dc/d18/d2b/f47 [4194304,4194304] 0 2024-03-18T14:43:29.209 INFO:tasks.workunit.client.1.smithi129.stdout:0/965: dwrite d0/d14/d28/ffd [0,4194304] 0 2024-03-18T14:43:29.210 INFO:tasks.workunit.client.1.smithi129.stdout:3/909: link d4/fa d4/dd/d1f/d5f/d31/d12c/f137 0 2024-03-18T14:43:29.211 INFO:tasks.workunit.client.1.smithi129.stdout:0/966: dread - d0/fe2 zero size 2024-03-18T14:43:29.212 INFO:tasks.workunit.client.1.smithi129.stdout:6/941: dwrite d3/d5/f13 [0,4194304] 0 2024-03-18T14:43:29.215 INFO:tasks.workunit.client.1.smithi129.stdout:4/872: read d0/d3c/fc1 [225975,75471] 0 2024-03-18T14:43:29.216 INFO:tasks.workunit.client.1.smithi129.stdout:4/873: write d0/d3c/d6c/fd2 [849343,120757] 0 2024-03-18T14:43:29.216 INFO:tasks.workunit.client.1.smithi129.stdout:1/916: dread d1/db2/de2/fda [0,4194304] 0 2024-03-18T14:43:29.217 INFO:tasks.workunit.client.1.smithi129.stdout:9/956: mknod d0/db/d6f/dda/c13a 0 2024-03-18T14:43:29.218 INFO:tasks.workunit.client.1.smithi129.stdout:8/965: truncate d9/f7d 1224681 0 2024-03-18T14:43:29.221 INFO:tasks.workunit.client.1.smithi129.stdout:7/941: getdents d4/d83/d11a 0 2024-03-18T14:43:29.223 INFO:tasks.workunit.client.1.smithi129.stdout:8/966: creat d9/d11/d55/d6a/f131 x:0 0 0 2024-03-18T14:43:29.224 INFO:tasks.workunit.client.1.smithi129.stdout:4/874: dwrite d0/d19/d46/d3e/d21/d4d/d70/fc6 [0,4194304] 0 2024-03-18T14:43:29.225 INFO:tasks.workunit.client.1.smithi129.stdout:9/957: mkdir d0/db/d10b/d111/d13b 0 2024-03-18T14:43:29.225 INFO:tasks.workunit.client.1.smithi129.stdout:1/917: dwrite d1/db2/dc3/de7/ffd [0,4194304] 0 2024-03-18T14:43:29.226 INFO:tasks.workunit.client.1.smithi129.stdout:8/967: read - d9/d11/d1a/d14/d60/f10b zero size 2024-03-18T14:43:29.227 INFO:tasks.workunit.client.1.smithi129.stdout:7/942: rmdir d4/d83/d11a/d45 39 2024-03-18T14:43:29.230 INFO:tasks.workunit.client.1.smithi129.stdout:1/918: dwrite d1/d35/f9c [0,4194304] 0 2024-03-18T14:43:29.233 INFO:tasks.workunit.client.1.smithi129.stdout:5/907: getdents d0/dc/d1a/d61/d94/db7 0 2024-03-18T14:43:29.239 INFO:tasks.workunit.client.1.smithi129.stdout:5/908: dwrite d0/d32/d3a/d45/d83/ddf/de2/ffe [0,4194304] 0 2024-03-18T14:43:29.240 INFO:tasks.workunit.client.1.smithi129.stdout:6/942: dwrite d3/d30/df/faa [0,4194304] 0 2024-03-18T14:43:29.245 INFO:tasks.workunit.client.1.smithi129.stdout:9/958: rename d0/db/d11/d138/dbb/c110 to d0/db/d1f/dae/c13c 0 2024-03-18T14:43:29.245 INFO:tasks.workunit.client.1.smithi129.stdout:1/919: dwrite d1/d2/f1f [4194304,4194304] 0 2024-03-18T14:43:29.246 INFO:tasks.workunit.client.1.smithi129.stdout:2/975: sync 2024-03-18T14:43:29.246 INFO:tasks.workunit.client.1.smithi129.stdout:7/943: dread - d4/d83/d11a/d79/dc6/ffe zero size 2024-03-18T14:43:29.247 INFO:tasks.workunit.client.1.smithi129.stdout:5/909: rmdir d0/d32/d34/d103 39 2024-03-18T14:43:29.249 INFO:tasks.workunit.client.1.smithi129.stdout:8/968: creat d9/d11/d1a/d32/d41/f132 x:0 0 0 2024-03-18T14:43:29.250 INFO:tasks.workunit.client.1.smithi129.stdout:9/959: readlink d0/db/d1f/d4c/d57/lfd 0 2024-03-18T14:43:29.252 INFO:tasks.workunit.client.1.smithi129.stdout:9/960: dread - d0/db/d2e/dd9/f124 zero size 2024-03-18T14:43:29.252 INFO:tasks.workunit.client.1.smithi129.stdout:1/920: dwrite d1/d35/d7a/f94 [4194304,4194304] 0 2024-03-18T14:43:29.253 INFO:tasks.workunit.client.1.smithi129.stdout:5/910: unlink d0/dc/d1a/d61/f6d 0 2024-03-18T14:43:29.255 INFO:tasks.workunit.client.1.smithi129.stdout:5/911: fdatasync d0/d32/d34/f53 0 2024-03-18T14:43:29.255 INFO:tasks.workunit.client.1.smithi129.stdout:7/944: creat d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/f133 x:0 0 0 2024-03-18T14:43:29.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/921: read d1/d2/d28/d65/d19/ff7 [3455441,28729] 0 2024-03-18T14:43:29.259 INFO:tasks.workunit.client.1.smithi129.stdout:8/969: dwrite d9/d11/d1a/d32/d41/d4d/d96/fa0 [0,4194304] 0 2024-03-18T14:43:29.259 INFO:tasks.workunit.client.1.smithi129.stdout:1/922: dread - d1/db2/de2/d80/ff4 zero size 2024-03-18T14:43:29.260 INFO:tasks.workunit.client.1.smithi129.stdout:8/970: chown d9/d11/d18/da4/fe2 1 1 2024-03-18T14:43:29.260 INFO:tasks.workunit.client.1.smithi129.stdout:1/923: fdatasync d1/d2/d28/d65/d19/f61 0 2024-03-18T14:43:29.264 INFO:tasks.workunit.client.1.smithi129.stdout:9/961: symlink d0/db/d11/d97/dd1/d26/d19/dd5/l13d 0 2024-03-18T14:43:29.266 INFO:tasks.workunit.client.1.smithi129.stdout:6/943: truncate d3/d30/de/d6c/d9e/db6/fea 617302 0 2024-03-18T14:43:29.267 INFO:tasks.workunit.client.1.smithi129.stdout:4/875: dread d0/d19/d46/d3e/d21/d4d/d70/dfe/f7d [0,4194304] 0 2024-03-18T14:43:29.272 INFO:tasks.workunit.client.1.smithi129.stdout:9/962: creat d0/db/d11/d97/d99/d114/f13e x:0 0 0 2024-03-18T14:43:29.273 INFO:tasks.workunit.client.1.smithi129.stdout:9/963: stat d0/db/d11/d97/dd1/d26/d19 0 2024-03-18T14:43:29.274 INFO:tasks.workunit.client.1.smithi129.stdout:9/964: stat d0/db/d1f/f4e 0 2024-03-18T14:43:29.274 INFO:tasks.workunit.client.1.smithi129.stdout:9/965: chown d0/db/d1f/d4c 0 1 2024-03-18T14:43:29.274 INFO:tasks.workunit.client.1.smithi129.stdout:1/924: creat d1/d2/d28/d65/d19/dc9/d56/d11a/f126 x:0 0 0 2024-03-18T14:43:29.277 INFO:tasks.workunit.client.1.smithi129.stdout:8/971: link d9/f1b d9/d11/d53/f133 0 2024-03-18T14:43:29.277 INFO:tasks.workunit.client.1.smithi129.stdout:6/944: mkdir d3/d6/d132 0 2024-03-18T14:43:29.279 INFO:tasks.workunit.client.1.smithi129.stdout:9/966: mknod d0/db/d1f/dae/db8/c13f 0 2024-03-18T14:43:29.280 INFO:tasks.workunit.client.1.smithi129.stdout:9/967: dread - d0/db/d11/d138/dbb/f123 zero size 2024-03-18T14:43:29.281 INFO:tasks.workunit.client.1.smithi129.stdout:4/876: truncate d0/d19/d46/f36 3626322 0 2024-03-18T14:43:29.282 INFO:tasks.workunit.client.1.smithi129.stdout:6/945: mknod d3/d30/df/d28/d79/d106/c133 0 2024-03-18T14:43:29.283 INFO:tasks.workunit.client.1.smithi129.stdout:5/912: dread d0/d32/d34/d6c/f78 [0,4194304] 0 2024-03-18T14:43:29.285 INFO:tasks.workunit.client.1.smithi129.stdout:5/913: write d0/d32/d3a/de7/feb [758655,42460] 0 2024-03-18T14:43:29.287 INFO:tasks.workunit.client.1.smithi129.stdout:3/910: sync 2024-03-18T14:43:29.289 INFO:tasks.workunit.client.1.smithi129.stdout:9/968: dread d0/db/d1f/f4e [0,4194304] 0 2024-03-18T14:43:29.291 INFO:tasks.workunit.client.1.smithi129.stdout:4/877: dwrite d0/d19/d46/d3e/d21/d4d/d70/dfe/fd9 [0,4194304] 0 2024-03-18T14:43:29.291 INFO:tasks.workunit.client.1.smithi129.stdout:2/976: dread d7/d1c/d32/f77 [0,4194304] 0 2024-03-18T14:43:29.294 INFO:tasks.workunit.client.1.smithi129.stdout:6/946: creat d3/d6/d82/d9a/dbe/f134 x:0 0 0 2024-03-18T14:43:29.296 INFO:tasks.workunit.client.1.smithi129.stdout:5/914: dread d0/d32/d3a/d45/d83/ddf/f109 [0,4194304] 0 2024-03-18T14:43:29.297 INFO:tasks.workunit.client.1.smithi129.stdout:8/972: getdents d9/d11/d1a/d32/d41/d4d/d103 0 2024-03-18T14:43:29.298 INFO:tasks.workunit.client.1.smithi129.stdout:1/925: dwrite d1/d2/f3 [0,4194304] 0 2024-03-18T14:43:29.299 INFO:tasks.workunit.client.1.smithi129.stdout:5/915: chown d0/dc/d18/d2b/d8c/cea 1736096 1 2024-03-18T14:43:29.301 INFO:tasks.workunit.client.1.smithi129.stdout:9/969: dwrite d0/db/f18 [4194304,4194304] 0 2024-03-18T14:43:29.301 INFO:tasks.workunit.client.1.smithi129.stdout:2/977: creat d7/d1f/d20/d36/da9/dc1/f132 x:0 0 0 2024-03-18T14:43:29.304 INFO:tasks.workunit.client.1.smithi129.stdout:9/970: dread - d0/db/d11/d97/d99/f12c zero size 2024-03-18T14:43:29.305 INFO:tasks.workunit.client.1.smithi129.stdout:0/967: sync 2024-03-18T14:43:29.305 INFO:tasks.workunit.client.1.smithi129.stdout:7/945: sync 2024-03-18T14:43:29.305 INFO:tasks.workunit.client.1.smithi129.stdout:1/926: creat d1/d2/d28/d65/dd6/f127 x:0 0 0 2024-03-18T14:43:29.305 INFO:tasks.workunit.client.1.smithi129.stdout:6/947: dwrite d3/d30/de/da9/ffa [0,4194304] 0 2024-03-18T14:43:29.307 INFO:tasks.workunit.client.1.smithi129.stdout:6/948: fdatasync d3/d6/fd6 0 2024-03-18T14:43:29.307 INFO:tasks.workunit.client.1.smithi129.stdout:9/971: write d0/db/d2e/f7c [3704385,126810] 0 2024-03-18T14:43:29.307 INFO:tasks.workunit.client.1.smithi129.stdout:5/916: write d0/dc/d18/f1d [1778541,45744] 0 2024-03-18T14:43:29.309 INFO:tasks.workunit.client.1.smithi129.stdout:3/911: truncate d4/dd/d1f/d5f/d31/d12c/f12e 913428 0 2024-03-18T14:43:29.309 INFO:tasks.workunit.client.1.smithi129.stdout:3/912: readlink d4/d38/lc2 0 2024-03-18T14:43:29.313 INFO:tasks.workunit.client.1.smithi129.stdout:7/946: read d4/d83/d11a/d79/dc6/f31 [1138662,65030] 0 2024-03-18T14:43:29.317 INFO:tasks.workunit.client.1.smithi129.stdout:2/978: dwrite d7/d1f/d20/fb5 [0,4194304] 0 2024-03-18T14:43:29.319 INFO:tasks.workunit.client.1.smithi129.stdout:3/913: creat d4/d38/da3/db1/f138 x:0 0 0 2024-03-18T14:43:29.321 INFO:tasks.workunit.client.1.smithi129.stdout:7/947: dwrite d4/d83/d11a/d79/dc6/d54/f94 [0,4194304] 0 2024-03-18T14:43:29.321 INFO:tasks.workunit.client.1.smithi129.stdout:8/973: getdents d9/d33/dc2/ddc 0 2024-03-18T14:43:29.324 INFO:tasks.workunit.client.1.smithi129.stdout:2/979: mkdir d7/d1f/d20/d36/da9/dc1/da5/dc4/d133 0 2024-03-18T14:43:29.324 INFO:tasks.workunit.client.1.smithi129.stdout:8/974: fsync d9/d11/d1a/d32/d3a/d5d/fa5 0 2024-03-18T14:43:29.325 INFO:tasks.workunit.client.1.smithi129.stdout:5/917: dwrite d0/f36 [0,4194304] 0 2024-03-18T14:43:29.328 INFO:tasks.workunit.client.1.smithi129.stdout:0/968: truncate d0/d23/d35/d3b/de0/f113 510214 0 2024-03-18T14:43:29.329 INFO:tasks.workunit.client.1.smithi129.stdout:9/972: truncate d0/db/d11/d97/d99/d114/f13e 1005073 0 2024-03-18T14:43:29.336 INFO:tasks.workunit.client.1.smithi129.stdout:3/914: creat d4/f139 x:0 0 0 2024-03-18T14:43:29.336 INFO:tasks.workunit.client.1.smithi129.stdout:9/973: dread d0/db/d2e/f50 [0,4194304] 0 2024-03-18T14:43:29.342 INFO:tasks.workunit.client.1.smithi129.stdout:9/974: dwrite d0/da1/dc1/feb [0,4194304] 0 2024-03-18T14:43:29.342 INFO:tasks.workunit.client.1.smithi129.stdout:3/915: dwrite d4/dd/d1f/d111/d34/df8/ded/f118 [0,4194304] 0 2024-03-18T14:43:29.350 INFO:tasks.workunit.client.1.smithi129.stdout:9/975: rename d0/l113 to d0/d15/dd7/l140 0 2024-03-18T14:43:29.351 INFO:tasks.workunit.client.1.smithi129.stdout:3/916: creat d4/dd/d1f/d5f/d82/d130/f13a x:0 0 0 2024-03-18T14:43:29.351 INFO:tasks.workunit.client.1.smithi129.stdout:4/878: dread d0/d19/d46/d3e/f42 [0,4194304] 0 2024-03-18T14:43:29.356 INFO:tasks.workunit.client.1.smithi129.stdout:0/969: write d0/d23/d71/fd2 [958005,92650] 0 2024-03-18T14:43:29.356 INFO:tasks.workunit.client.1.smithi129.stdout:5/918: truncate d0/dc/f77 302270 0 2024-03-18T14:43:29.359 INFO:tasks.workunit.client.1.smithi129.stdout:9/976: creat d0/db/d1f/d4c/d57/f141 x:0 0 0 2024-03-18T14:43:29.361 INFO:tasks.workunit.client.1.smithi129.stdout:1/927: dwrite d1/d2/d28/d65/fb0 [0,4194304] 0 2024-03-18T14:43:29.361 INFO:tasks.workunit.client.1.smithi129.stdout:3/917: chown d4/dd/d1f/d111/d34/d4c/c9c 1466684 1 2024-03-18T14:43:29.362 INFO:tasks.workunit.client.1.smithi129.stdout:2/980: dread d7/d3f/d5f/f8e [0,4194304] 0 2024-03-18T14:43:29.364 INFO:tasks.workunit.client.1.smithi129.stdout:4/879: getdents d0/d9/d6a/db1 0 2024-03-18T14:43:29.364 INFO:tasks.workunit.client.1.smithi129.stdout:8/975: dwrite d9/d11/d1a/d32/d3a/d70/f8c [0,4194304] 0 2024-03-18T14:43:29.365 INFO:tasks.workunit.client.1.smithi129.stdout:9/977: symlink d0/db/d11/d97/d99/l142 0 2024-03-18T14:43:29.373 INFO:tasks.workunit.client.1.smithi129.stdout:4/880: truncate d0/d19/f54 1209524 0 2024-03-18T14:43:29.374 INFO:tasks.workunit.client.1.smithi129.stdout:4/881: fsync d0/d19/d46/d3e/d21/d4d/d58/f96 0 2024-03-18T14:43:29.380 INFO:tasks.workunit.client.1.smithi129.stdout:9/978: mknod d0/db/d11/d97/dd1/d6c/dfa/d101/c143 0 2024-03-18T14:43:29.380 INFO:tasks.workunit.client.1.smithi129.stdout:3/918: unlink d4/dd/d1f/d5f/dfa/c7a 0 2024-03-18T14:43:29.381 INFO:tasks.workunit.client.1.smithi129.stdout:3/919: write d4/dd/d1f/d5f/d82/da6/fd8 [430326,43088] 0 2024-03-18T14:43:29.385 INFO:tasks.workunit.client.1.smithi129.stdout:2/981: link d7/d1f/d20/c31 d7/d1c/d79/c134 0 2024-03-18T14:43:29.385 INFO:tasks.workunit.client.1.smithi129.stdout:2/982: fdatasync d7/d3f/fcb 0 2024-03-18T14:43:29.387 INFO:tasks.workunit.client.1.smithi129.stdout:5/919: truncate d0/dc/d1a/d61/d94/db7/fe4 521392 0 2024-03-18T14:43:29.387 INFO:tasks.workunit.client.1.smithi129.stdout:6/949: sync 2024-03-18T14:43:29.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/882: creat d0/d9/d107/d10a/f11b x:0 0 0 2024-03-18T14:43:29.389 INFO:tasks.workunit.client.1.smithi129.stdout:1/928: truncate d1/d2/d28/f68 3731312 0 2024-03-18T14:43:29.389 INFO:tasks.workunit.client.1.smithi129.stdout:4/883: fdatasync d0/d19/d46/d3e/d21/d4d/ffb 0 2024-03-18T14:43:29.392 INFO:tasks.workunit.client.1.smithi129.stdout:9/979: rename d0/f8 to d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f144 0 2024-03-18T14:43:29.392 INFO:tasks.workunit.client.1.smithi129.stdout:5/920: dwrite d0/dc/d1a/fcf [0,4194304] 0 2024-03-18T14:43:29.393 INFO:tasks.workunit.client.1.smithi129.stdout:5/921: readlink d0/df/lad 0 2024-03-18T14:43:29.396 INFO:tasks.workunit.client.1.smithi129.stdout:8/976: getdents d9 0 2024-03-18T14:43:29.398 INFO:tasks.workunit.client.1.smithi129.stdout:0/970: dwrite d0/d23/d35/d3b/de0/f113 [0,4194304] 0 2024-03-18T14:43:29.401 INFO:tasks.workunit.client.1.smithi129.stdout:8/977: dwrite d9/d11/d55/d68/fcd [0,4194304] 0 2024-03-18T14:43:29.402 INFO:tasks.workunit.client.1.smithi129.stdout:4/884: mknod d0/d9/d6a/d7b/dd0/c11c 0 2024-03-18T14:43:29.404 INFO:tasks.workunit.client.1.smithi129.stdout:4/885: readlink d0/d19/d46/l74 0 2024-03-18T14:43:29.408 INFO:tasks.workunit.client.1.smithi129.stdout:3/920: creat d4/dd/d1f/d5f/d8c/d101/d12a/f13b x:0 0 0 2024-03-18T14:43:29.412 INFO:tasks.workunit.client.1.smithi129.stdout:0/971: write d0/d23/d35/fb4 [100204,2216] 0 2024-03-18T14:43:29.413 INFO:tasks.workunit.client.1.smithi129.stdout:0/972: fdatasync d0/d14/d28/d63/d8d/ff9 0 2024-03-18T14:43:29.415 INFO:tasks.workunit.client.1.smithi129.stdout:8/978: unlink d9/ca 0 2024-03-18T14:43:29.416 INFO:tasks.workunit.client.1.smithi129.stdout:4/886: mknod d0/d9/d6a/c11d 0 2024-03-18T14:43:29.419 INFO:tasks.workunit.client.1.smithi129.stdout:5/922: mkdir d0/dc/d18/d2b/d119 0 2024-03-18T14:43:29.419 INFO:tasks.workunit.client.1.smithi129.stdout:5/923: read - d0/d32/f107 zero size 2024-03-18T14:43:29.420 INFO:tasks.workunit.client.1.smithi129.stdout:3/921: chown d4/dd/d1f/d5f/d31/fcf 942848676 1 2024-03-18T14:43:29.422 INFO:tasks.workunit.client.1.smithi129.stdout:9/980: link d0/db/d11/d97/dd1/f115 d0/db/d11/d138/d126/f145 0 2024-03-18T14:43:29.426 INFO:tasks.workunit.client.1.smithi129.stdout:9/981: dwrite d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f102 [0,4194304] 0 2024-03-18T14:43:29.427 INFO:tasks.workunit.client.1.smithi129.stdout:0/973: symlink d0/de3/l11f 0 2024-03-18T14:43:29.428 INFO:tasks.workunit.client.1.smithi129.stdout:0/974: chown d0/d23/d35/d50/fab 515701334 1 2024-03-18T14:43:29.432 INFO:tasks.workunit.client.1.smithi129.stdout:6/950: dwrite d3/d30/df/d28/d79/daf/f11f [0,4194304] 0 2024-03-18T14:43:29.437 INFO:tasks.workunit.client.1.smithi129.stdout:1/929: rename d1/d2/f1f to d1/d2/d28/d65/f128 0 2024-03-18T14:43:29.439 INFO:tasks.workunit.client.1.smithi129.stdout:7/948: sync 2024-03-18T14:43:29.441 INFO:tasks.workunit.client.1.smithi129.stdout:5/924: symlink d0/d32/d3a/d45/d83/ddf/l11a 0 2024-03-18T14:43:29.441 INFO:tasks.workunit.client.1.smithi129.stdout:5/925: stat d0/dc/d18/d2b/f5e 0 2024-03-18T14:43:29.442 INFO:tasks.workunit.client.1.smithi129.stdout:3/922: mknod d4/dd/d1f/d111/d34/d53/c13c 0 2024-03-18T14:43:29.447 INFO:tasks.workunit.client.1.smithi129.stdout:5/926: dread d0/fb5 [0,4194304] 0 2024-03-18T14:43:29.448 INFO:tasks.workunit.client.1.smithi129.stdout:5/927: chown d0/df/c21 7658795 1 2024-03-18T14:43:29.449 INFO:tasks.workunit.client.1.smithi129.stdout:5/928: write d0/d32/d3a/d45/d83/ddf/dc4/fe6 [565577,31677] 0 2024-03-18T14:43:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:4/887: dwrite d0/d19/d46/fee [0,4194304] 0 2024-03-18T14:43:29.453 INFO:tasks.workunit.client.1.smithi129.stdout:9/982: mkdir d0/db/d146 0 2024-03-18T14:43:29.455 INFO:tasks.workunit.client.1.smithi129.stdout:3/923: chown d4/dd/d1f/d5f/de2/d11b/f10b 66 1 2024-03-18T14:43:29.456 INFO:tasks.workunit.client.1.smithi129.stdout:3/924: dread - d4/dd/d1f/d111/d34/df8/ded/f112 zero size 2024-03-18T14:43:29.456 INFO:tasks.workunit.client.1.smithi129.stdout:0/975: mknod d0/d23/d35/d50/da5/c120 0 2024-03-18T14:43:29.457 INFO:tasks.workunit.client.1.smithi129.stdout:3/925: readlink d4/dd/d1f/d111/d34/d3c/l6d 0 2024-03-18T14:43:29.458 INFO:tasks.workunit.client.1.smithi129.stdout:6/951: mknod d3/d30/c135 0 2024-03-18T14:43:29.458 INFO:tasks.workunit.client.1.smithi129.stdout:0/976: fdatasync d0/d14/d28/d63/d8d/fa7 0 2024-03-18T14:43:29.458 INFO:tasks.workunit.client.1.smithi129.stdout:3/926: fsync d4/d38/f47 0 2024-03-18T14:43:29.459 INFO:tasks.workunit.client.1.smithi129.stdout:3/927: read - d4/dd/d1f/d111/d1d/f124 zero size 2024-03-18T14:43:29.460 INFO:tasks.workunit.client.1.smithi129.stdout:3/928: write d4/dd/d1f/da8/f10a [979879,108073] 0 2024-03-18T14:43:29.460 INFO:tasks.workunit.client.1.smithi129.stdout:8/979: symlink d9/d11/d1a/d32/d3a/d70/l134 0 2024-03-18T14:43:29.463 INFO:tasks.workunit.client.1.smithi129.stdout:5/929: dread d0/dc/d18/d5f/f86 [0,4194304] 0 2024-03-18T14:43:29.466 INFO:tasks.workunit.client.1.smithi129.stdout:0/977: unlink d0/d23/d71/fa9 0 2024-03-18T14:43:29.467 INFO:tasks.workunit.client.1.smithi129.stdout:3/929: dread d4/dd/d1f/d5f/d31/f98 [0,4194304] 0 2024-03-18T14:43:29.467 INFO:tasks.workunit.client.1.smithi129.stdout:6/952: mknod d3/d5/d46/c136 0 2024-03-18T14:43:29.468 INFO:tasks.workunit.client.1.smithi129.stdout:8/980: dread - d9/d11/d18/fa2 zero size 2024-03-18T14:43:29.470 INFO:tasks.workunit.client.1.smithi129.stdout:1/930: truncate d1/d2/f33 4737730 0 2024-03-18T14:43:29.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/888: truncate d0/d19/d46/d3e/d21/d4d/fd7 462378 0 2024-03-18T14:43:29.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/889: chown d0/d3c/d6c/cbf 424816729 1 2024-03-18T14:43:29.477 INFO:tasks.workunit.client.1.smithi129.stdout:3/930: mknod d4/dd/d128/c13d 0 2024-03-18T14:43:29.478 INFO:tasks.workunit.client.1.smithi129.stdout:8/981: creat d9/d11/d1a/d32/d41/d4d/d96/dcc/f135 x:0 0 0 2024-03-18T14:43:29.480 INFO:tasks.workunit.client.1.smithi129.stdout:1/931: creat d1/d2/d28/d65/d19/d96/f129 x:0 0 0 2024-03-18T14:43:29.480 INFO:tasks.workunit.client.1.smithi129.stdout:2/983: sync 2024-03-18T14:43:29.480 INFO:tasks.workunit.client.1.smithi129.stdout:1/932: chown d1/d91/fd9 1000241 1 2024-03-18T14:43:29.480 INFO:tasks.workunit.client.1.smithi129.stdout:2/984: chown d7/d1f/d20/d36/dc0/l11b 225026 1 2024-03-18T14:43:29.481 INFO:tasks.workunit.client.1.smithi129.stdout:2/985: stat d7/d1c/d79/c91 0 2024-03-18T14:43:29.485 INFO:tasks.workunit.client.1.smithi129.stdout:7/949: link d4/d83/d11a/l2f d4/d2d/d3a/l134 0 2024-03-18T14:43:29.487 INFO:tasks.workunit.client.1.smithi129.stdout:9/983: creat d0/db/f147 x:0 0 0 2024-03-18T14:43:29.487 INFO:tasks.workunit.client.1.smithi129.stdout:5/930: mknod d0/d32/d34/d103/c11b 0 2024-03-18T14:43:29.488 INFO:tasks.workunit.client.1.smithi129.stdout:1/933: mknod d1/d2/d28/d65/d19/dc9/d87/dc0/c12a 0 2024-03-18T14:43:29.489 INFO:tasks.workunit.client.1.smithi129.stdout:6/953: dwrite d3/d30/d44/fe7 [0,4194304] 0 2024-03-18T14:43:29.491 INFO:tasks.workunit.client.1.smithi129.stdout:2/986: rename d7/d1f/d20/d2b/d41/d65/d88/cb6 to d7/d1c/d79/d118/c135 0 2024-03-18T14:43:29.493 INFO:tasks.workunit.client.1.smithi129.stdout:8/982: symlink d9/d11/d53/d5f/dcb/d11f/l136 0 2024-03-18T14:43:29.493 INFO:tasks.workunit.client.1.smithi129.stdout:9/984: dwrite d0/db/d11/d97/d99/d114/fa6 [4194304,4194304] 0 2024-03-18T14:43:29.494 INFO:tasks.workunit.client.1.smithi129.stdout:8/983: stat d9/d11/d1a/d32/d3a/d9a 0 2024-03-18T14:43:29.494 INFO:tasks.workunit.client.1.smithi129.stdout:9/985: dread - d0/db/d10b/fe1 zero size 2024-03-18T14:43:29.498 INFO:tasks.workunit.client.1.smithi129.stdout:1/934: creat d1/d35/db8/f12b x:0 0 0 2024-03-18T14:43:29.500 INFO:tasks.workunit.client.1.smithi129.stdout:6/954: symlink d3/d30/df/d28/d79/daf/l137 0 2024-03-18T14:43:29.505 INFO:tasks.workunit.client.1.smithi129.stdout:0/978: getdents d0 0 2024-03-18T14:43:29.505 INFO:tasks.workunit.client.1.smithi129.stdout:2/987: creat d7/d1f/d20/d2a/f136 x:0 0 0 2024-03-18T14:43:29.506 INFO:tasks.workunit.client.1.smithi129.stdout:0/979: chown d0/de3/f119 47883 1 2024-03-18T14:43:29.506 INFO:tasks.workunit.client.1.smithi129.stdout:2/988: fdatasync d7/d1c/d79/d118/f128 0 2024-03-18T14:43:29.506 INFO:tasks.workunit.client.1.smithi129.stdout:0/980: chown d0/cf4 0 1 2024-03-18T14:43:29.508 INFO:tasks.workunit.client.1.smithi129.stdout:0/981: write d0/d23/d35/d3b/d42/f11b [543876,35603] 0 2024-03-18T14:43:29.508 INFO:tasks.workunit.client.1.smithi129.stdout:0/982: fdatasync d0/f72 0 2024-03-18T14:43:29.509 INFO:tasks.workunit.client.1.smithi129.stdout:6/955: creat d3/d6/d82/d9a/f138 x:0 0 0 2024-03-18T14:43:29.511 INFO:tasks.workunit.client.1.smithi129.stdout:1/935: mkdir d1/d2/d28/d65/d19/d52/df3/d12c 0 2024-03-18T14:43:29.511 INFO:tasks.workunit.client.1.smithi129.stdout:2/989: dwrite d7/f6e [0,4194304] 0 2024-03-18T14:43:29.513 INFO:tasks.workunit.client.1.smithi129.stdout:7/950: write d4/d83/d11a/f73 [682335,43500] 0 2024-03-18T14:43:29.515 INFO:tasks.workunit.client.1.smithi129.stdout:0/983: unlink d0/d23/d35/d3b/fd8 0 2024-03-18T14:43:29.515 INFO:tasks.workunit.client.1.smithi129.stdout:1/936: dread d1/db2/f100 [0,4194304] 0 2024-03-18T14:43:29.516 INFO:tasks.workunit.client.1.smithi129.stdout:6/956: mknod d3/d30/de/d6c/c139 0 2024-03-18T14:43:29.516 INFO:tasks.workunit.client.1.smithi129.stdout:0/984: chown d0/de3/c111 8 1 2024-03-18T14:43:29.518 INFO:tasks.workunit.client.1.smithi129.stdout:8/984: dread d9/d11/d1a/d32/d3a/d70/fd6 [0,4194304] 0 2024-03-18T14:43:29.520 INFO:tasks.workunit.client.1.smithi129.stdout:8/985: chown d9/d11/d18/da4/f12c 5722 1 2024-03-18T14:43:29.520 INFO:tasks.workunit.client.1.smithi129.stdout:9/986: truncate d0/f4 3010129 0 2024-03-18T14:43:29.521 INFO:tasks.workunit.client.1.smithi129.stdout:7/951: stat d4/d83/d11a/lbd 0 2024-03-18T14:43:29.522 INFO:tasks.workunit.client.1.smithi129.stdout:0/985: mknod d0/d23/d29/c121 0 2024-03-18T14:43:29.522 INFO:tasks.workunit.client.1.smithi129.stdout:6/957: dwrite d3/d30/ff0 [0,4194304] 0 2024-03-18T14:43:29.524 INFO:tasks.workunit.client.1.smithi129.stdout:6/958: chown d3/d30/f101 456259 1 2024-03-18T14:43:29.525 INFO:tasks.workunit.client.1.smithi129.stdout:2/990: mknod d7/d1f/d20/d2b/d41/d65/c137 0 2024-03-18T14:43:29.526 INFO:tasks.workunit.client.1.smithi129.stdout:2/991: read - d7/d1f/d20/d2d/f105 zero size 2024-03-18T14:43:29.530 INFO:tasks.workunit.client.1.smithi129.stdout:9/987: unlink d0/db/d1f/d4c/d57/lfd 0 2024-03-18T14:43:29.530 INFO:tasks.workunit.client.1.smithi129.stdout:9/988: write d0/fe4 [1946089,53436] 0 2024-03-18T14:43:29.531 INFO:tasks.workunit.client.1.smithi129.stdout:3/931: sync 2024-03-18T14:43:29.531 INFO:tasks.workunit.client.1.smithi129.stdout:4/890: sync 2024-03-18T14:43:29.533 INFO:tasks.workunit.client.1.smithi129.stdout:8/986: rename d9/d11/d1a/d32/d3a/l36 to d9/d11/d1a/d66/l137 0 2024-03-18T14:43:29.534 INFO:tasks.workunit.client.1.smithi129.stdout:0/986: mkdir d0/d23/d35/d3b/d42/dc0/d122 0 2024-03-18T14:43:29.536 INFO:tasks.workunit.client.1.smithi129.stdout:7/952: mkdir d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107/d135 0 2024-03-18T14:43:29.537 INFO:tasks.workunit.client.1.smithi129.stdout:7/953: read d4/d83/d11a/d79/dc6/d38/d61/fe6 [945796,114502] 0 2024-03-18T14:43:29.538 INFO:tasks.workunit.client.1.smithi129.stdout:7/954: read - d4/d83/d11a/d79/dc6/d54/d86/fe8 zero size 2024-03-18T14:43:29.539 INFO:tasks.workunit.client.1.smithi129.stdout:2/992: creat d7/d1f/d20/d36/da9/dc1/da5/dfb/f138 x:0 0 0 2024-03-18T14:43:29.539 INFO:tasks.workunit.client.1.smithi129.stdout:7/955: dread - d4/d2d/d3a/fbe zero size 2024-03-18T14:43:29.540 INFO:tasks.workunit.client.1.smithi129.stdout:7/956: dread - d4/d83/d11a/d79/dc6/d38/d61/d68/fb3 zero size 2024-03-18T14:43:29.544 INFO:tasks.workunit.client.1.smithi129.stdout:4/891: rmdir d0/d19/d46/d3e/d21/d4d 39 2024-03-18T14:43:29.550 INFO:tasks.workunit.client.1.smithi129.stdout:6/959: symlink d3/d30/de/d65/d93/dd0/d12b/l13a 0 2024-03-18T14:43:29.550 INFO:tasks.workunit.client.1.smithi129.stdout:8/987: write d9/d11/d18/da4/fd0 [424388,19662] 0 2024-03-18T14:43:29.551 INFO:tasks.workunit.client.1.smithi129.stdout:9/989: dwrite d0/db/f43 [0,4194304] 0 2024-03-18T14:43:29.551 INFO:tasks.workunit.client.1.smithi129.stdout:1/937: truncate d1/d2/d28/d65/d19/dc9/d56/d11a/f126 681286 0 2024-03-18T14:43:29.553 INFO:tasks.workunit.client.1.smithi129.stdout:3/932: mkdir d4/d13e 0 2024-03-18T14:43:29.554 INFO:tasks.workunit.client.1.smithi129.stdout:3/933: write d4/dd/d1f/f129 [365828,36230] 0 2024-03-18T14:43:29.554 INFO:tasks.workunit.client.1.smithi129.stdout:4/892: write d0/d19/f38 [2160404,71322] 0 2024-03-18T14:43:29.554 INFO:tasks.workunit.client.1.smithi129.stdout:8/988: read d9/d11/d18/da4/f9c [5093446,112731] 0 2024-03-18T14:43:29.555 INFO:tasks.workunit.client.1.smithi129.stdout:0/987: rename d0/d23/d29/c11c to d0/d23/d6b/c123 0 2024-03-18T14:43:29.556 INFO:tasks.workunit.client.1.smithi129.stdout:8/989: chown d9/d11/d1a/d14/db7 1253 1 2024-03-18T14:43:29.557 INFO:tasks.workunit.client.1.smithi129.stdout:6/960: mkdir d3/d6/d7f/db4/d57/d13b 0 2024-03-18T14:43:29.558 INFO:tasks.workunit.client.1.smithi129.stdout:6/961: chown d3/d6/dd5/d128 282422627 1 2024-03-18T14:43:29.559 INFO:tasks.workunit.client.1.smithi129.stdout:6/962: read - d3/d30/de/d49/df8/d117/f122 zero size 2024-03-18T14:43:29.560 INFO:tasks.workunit.client.1.smithi129.stdout:8/990: dread d9/d11/d55/d68/fcd [0,4194304] 0 2024-03-18T14:43:29.561 INFO:tasks.workunit.client.1.smithi129.stdout:8/991: write d9/d11/d53/d5f/fdf [385586,16376] 0 2024-03-18T14:43:29.562 INFO:tasks.workunit.client.1.smithi129.stdout:3/934: symlink d4/d38/d9b/l13f 0 2024-03-18T14:43:29.562 INFO:tasks.workunit.client.1.smithi129.stdout:8/992: chown d9/d11/d1a/d32/d41/d4d/d10a/f124 594 1 2024-03-18T14:43:29.563 INFO:tasks.workunit.client.1.smithi129.stdout:3/935: write d4/d38/da3/dc9/f126 [516896,81031] 0 2024-03-18T14:43:29.564 INFO:tasks.workunit.client.1.smithi129.stdout:3/936: dread - d4/d38/da3/ff0 zero size 2024-03-18T14:43:29.565 INFO:tasks.workunit.client.1.smithi129.stdout:2/993: rename d7/d1c/d32 to d7/d1f/d20/d36/dc0/d139 0 2024-03-18T14:43:29.568 INFO:tasks.workunit.client.1.smithi129.stdout:6/963: chown d3/d30/df/d28/l4f 62152 1 2024-03-18T14:43:29.571 INFO:tasks.workunit.client.1.smithi129.stdout:8/993: creat d9/d11/d1a/d14/db7/dc1/deb/f138 x:0 0 0 2024-03-18T14:43:29.573 INFO:tasks.workunit.client.1.smithi129.stdout:6/964: dwrite d3/d30/d44/fe7 [4194304,4194304] 0 2024-03-18T14:43:29.575 INFO:tasks.workunit.client.1.smithi129.stdout:6/965: write d3/d6/d7f/db4/fd8 [2363954,29504] 0 2024-03-18T14:43:29.578 INFO:tasks.workunit.client.1.smithi129.stdout:9/990: dread d0/db/d11/d97/dd1/d6c/dfa/d101/d3e/f144 [0,4194304] 0 2024-03-18T14:43:29.580 INFO:tasks.workunit.client.1.smithi129.stdout:1/938: creat d1/d35/f12d x:0 0 0 2024-03-18T14:43:29.581 INFO:tasks.workunit.client.1.smithi129.stdout:4/893: creat d0/d19/d46/d3e/d21/f11e x:0 0 0 2024-03-18T14:43:29.582 INFO:tasks.workunit.client.1.smithi129.stdout:4/894: readlink d0/d19/d46/d3e/d21/d32/l6b 0 2024-03-18T14:43:29.583 INFO:tasks.workunit.client.1.smithi129.stdout:3/937: mknod d4/c140 0 2024-03-18T14:43:29.585 INFO:tasks.workunit.client.1.smithi129.stdout:2/994: symlink d7/d1f/d81/dd4/l13a 0 2024-03-18T14:43:29.590 INFO:tasks.workunit.client.1.smithi129.stdout:8/994: mkdir d9/d11/d1a/d139 0 2024-03-18T14:43:29.590 INFO:tasks.workunit.client.1.smithi129.stdout:9/991: dwrite d0/db/d11/d97/d99/db2/fc0 [0,4194304] 0 2024-03-18T14:43:29.593 INFO:tasks.workunit.client.1.smithi129.stdout:6/966: symlink d3/d6/d7f/db4/d57/d13b/l13c 0 2024-03-18T14:43:29.594 INFO:tasks.workunit.client.1.smithi129.stdout:1/939: write d1/d2/d28/d65/f98 [853626,42442] 0 2024-03-18T14:43:29.595 INFO:tasks.workunit.client.1.smithi129.stdout:0/988: getdents d0/d23/d35/d3b/d42 0 2024-03-18T14:43:29.596 INFO:tasks.workunit.client.1.smithi129.stdout:0/989: chown d0/d23/d71/f117 6 1 2024-03-18T14:43:29.596 INFO:tasks.workunit.client.1.smithi129.stdout:4/895: fdatasync d0/d19/f54 0 2024-03-18T14:43:29.601 INFO:tasks.workunit.client.1.smithi129.stdout:1/940: chown d1/d2/d28/d65/d7c/cab 466677900 1 2024-03-18T14:43:29.603 INFO:tasks.workunit.client.1.smithi129.stdout:1/941: chown d1/dbf/dce/c106 0 1 2024-03-18T14:43:29.604 INFO:tasks.workunit.client.1.smithi129.stdout:1/942: stat d1/db2/dc3/de7/ffd 0 2024-03-18T14:43:29.605 INFO:tasks.workunit.client.1.smithi129.stdout:3/938: dwrite d4/dd/d1f/d5f/dfa/f12f [0,4194304] 0 2024-03-18T14:43:29.607 INFO:tasks.workunit.client.1.smithi129.stdout:4/896: mkdir d0/d19/d11f 0 2024-03-18T14:43:29.610 INFO:tasks.workunit.client.1.smithi129.stdout:2/995: getdents d7/d1f/d20/d2b/d41/d65/df0 0 2024-03-18T14:43:29.613 INFO:tasks.workunit.client.1.smithi129.stdout:4/897: creat d0/d19/d46/d3e/dc0/d100/f120 x:0 0 0 2024-03-18T14:43:29.615 INFO:tasks.workunit.client.1.smithi129.stdout:9/992: dread d0/fe4 [0,4194304] 0 2024-03-18T14:43:29.615 INFO:tasks.workunit.client.1.smithi129.stdout:8/995: truncate d9/d11/d1a/d32/d3a/d70/fd6 504686 0 2024-03-18T14:43:29.616 INFO:tasks.workunit.client.1.smithi129.stdout:1/943: write d1/d2/d28/d65/d19/f76 [1021754,100118] 0 2024-03-18T14:43:29.616 INFO:tasks.workunit.client.1.smithi129.stdout:3/939: write d4/dd/d1f/d111/d1d/d50/f67 [477406,97141] 0 2024-03-18T14:43:29.617 INFO:tasks.workunit.client.1.smithi129.stdout:2/996: fdatasync d7/d1f/d20/d36/da9/dc1/f18 0 2024-03-18T14:43:29.618 INFO:tasks.workunit.client.1.smithi129.stdout:8/996: dread - d9/d11/d55/d68/d72/d90/f122 zero size 2024-03-18T14:43:29.618 INFO:tasks.workunit.client.1.smithi129.stdout:9/993: rmdir d0/db/d11/d97/dd1/d6c/dfa 39 2024-03-18T14:43:29.618 INFO:tasks.workunit.client.1.smithi129.stdout:2/997: chown d7/d1f/d20/d36/dc0/d139/d126 1473 1 2024-03-18T14:43:29.619 INFO:tasks.workunit.client.1.smithi129.stdout:4/898: mknod d0/d3c/d6c/d105/d106/c121 0 2024-03-18T14:43:29.619 INFO:tasks.workunit.client.1.smithi129.stdout:1/944: read d1/d2/d28/d65/d19/dc9/d56/f82 [1520443,30432] 0 2024-03-18T14:43:29.620 INFO:tasks.workunit.client.1.smithi129.stdout:3/940: creat d4/dd/d1f/d5f/f141 x:0 0 0 2024-03-18T14:43:29.621 INFO:tasks.workunit.client.1.smithi129.stdout:5/931: sync 2024-03-18T14:43:29.623 INFO:tasks.workunit.client.1.smithi129.stdout:9/994: mkdir d0/db/d1f/d4c/d148 0 2024-03-18T14:43:29.624 INFO:tasks.workunit.client.1.smithi129.stdout:4/899: mknod d0/d9/d85/c122 0 2024-03-18T14:43:29.628 INFO:tasks.workunit.client.1.smithi129.stdout:9/995: creat d0/db/d11/d97/dd1/d6c/d136/f149 x:0 0 0 2024-03-18T14:43:29.629 INFO:tasks.workunit.client.1.smithi129.stdout:1/945: mknod d1/d2/c12e 0 2024-03-18T14:43:29.631 INFO:tasks.workunit.client.1.smithi129.stdout:4/900: creat d0/d19/d46/d3e/d21/d7f/de2/f123 x:0 0 0 2024-03-18T14:43:29.632 INFO:tasks.workunit.client.1.smithi129.stdout:8/997: creat d9/d11/d1a/f13a x:0 0 0 2024-03-18T14:43:29.633 INFO:tasks.workunit.client.1.smithi129.stdout:3/941: creat d4/dd/d1f/d111/f142 x:0 0 0 2024-03-18T14:43:29.634 INFO:tasks.workunit.client.1.smithi129.stdout:9/996: dwrite d0/db/d2e/dd9/f124 [0,4194304] 0 2024-03-18T14:43:29.639 INFO:tasks.workunit.client.1.smithi129.stdout:5/932: write d0/dc/f77 [708078,86693] 0 2024-03-18T14:43:29.644 INFO:tasks.workunit.client.1.smithi129.stdout:2/998: rename d7/d1f/d20/d36/dc0/ce8 to d7/d1f/d20/d36/da9/dc1/da5/c13b 0 2024-03-18T14:43:29.644 INFO:tasks.workunit.client.1.smithi129.stdout:1/946: fsync d1/d35/db8/f101 0 2024-03-18T14:43:29.644 INFO:tasks.workunit.client.1.smithi129.stdout:4/901: fdatasync d0/d19/d46/d3e/d21/d4d/d58/f8f 0 2024-03-18T14:43:29.683 INFO:tasks.workunit.client.1.smithi129.stdout:9/997: fdatasync d0/db/d10b/d8e/f67 0 2024-03-18T14:43:29.683 INFO:tasks.workunit.client.1.smithi129.stdout:5/933: creat d0/d32/d34/d103/f11c x:0 0 0 2024-03-18T14:43:29.684 INFO:tasks.workunit.client.1.smithi129.stdout:2/999: creat d7/d1f/d20/d2b/d41/da6/ded/f13c x:0 0 0 2024-03-18T14:43:29.684 INFO:tasks.workunit.client.1.smithi129.stdout:1/947: read d1/d2/d28/d65/d19/d52/f6a [1203973,46268] 0 2024-03-18T14:43:29.685 INFO:tasks.workunit.client.1.smithi129.stdout:9/998: write d0/db/d11/d138/fa7 [1741902,90445] 0 2024-03-18T14:43:29.686 INFO:tasks.workunit.client.1.smithi129.stdout:8/998: link d9/d11/d18/fd1 d9/d11/d53/d5f/f13b 0 2024-03-18T14:43:29.706 INFO:tasks.workunit.client.1.smithi129.stdout:7/957: sync 2024-03-18T14:43:29.708 INFO:tasks.workunit.client.1.smithi129.stdout:9/999: mkdir d0/db/d6f/dda/d14a 0 2024-03-18T14:43:29.708 INFO:tasks.workunit.client.1.smithi129.stdout:3/942: dread d4/dd/d1f/d5f/d31/f5c [0,4194304] 0 2024-03-18T14:43:29.709 INFO:tasks.workunit.client.1.smithi129.stdout:7/958: fsync d4/d8c/d9e/fce 0 2024-03-18T14:43:29.710 INFO:tasks.workunit.client.1.smithi129.stdout:5/934: dwrite d0/dc/d18/d2b/d8c/f117 [0,4194304] 0 2024-03-18T14:43:29.731 INFO:tasks.workunit.client.1.smithi129.stdout:6/967: sync 2024-03-18T14:43:29.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/968: dread - d3/d5/d46/df4/ff5 zero size 2024-03-18T14:43:29.732 INFO:tasks.workunit.client.1.smithi129.stdout:6/969: dread - d3/d6/d82/ffe zero size 2024-03-18T14:43:29.740 INFO:tasks.workunit.client.1.smithi129.stdout:5/935: dread d0/d32/d3a/df2/fa9 [0,4194304] 0 2024-03-18T14:43:29.741 INFO:tasks.workunit.client.1.smithi129.stdout:5/936: readlink d0/d32/d3a/d52/d69/l82 0 2024-03-18T14:43:29.780 INFO:tasks.workunit.client.1.smithi129.stdout:4/902: sync 2024-03-18T14:43:29.780 INFO:tasks.workunit.client.1.smithi129.stdout:0/990: sync 2024-03-18T14:43:29.780 INFO:tasks.workunit.client.1.smithi129.stdout:1/948: sync 2024-03-18T14:43:29.781 INFO:tasks.workunit.client.1.smithi129.stdout:1/949: chown d1/dbf/dce/df2/c102 259418 1 2024-03-18T14:43:29.798 INFO:tasks.workunit.client.1.smithi129.stdout:5/937: sync 2024-03-18T14:43:29.819 INFO:tasks.workunit.client.1.smithi129.stdout:6/970: symlink d3/d6/d7f/d8f/l13d 0 2024-03-18T14:43:29.822 INFO:tasks.workunit.client.1.smithi129.stdout:1/950: unlink d1/d2/d28/d65/d19/dc9/d87/dc0/cf1 0 2024-03-18T14:43:29.823 INFO:tasks.workunit.client.1.smithi129.stdout:3/943: dread d4/dd/d1f/f4b [0,4194304] 0 2024-03-18T14:43:29.826 INFO:tasks.workunit.client.1.smithi129.stdout:8/999: chown d9/d11/d1a/d66/l137 805 1 2024-03-18T14:43:29.849 INFO:tasks.workunit.client.1.smithi129.stdout:6/971: unlink d3/d30/de/d49/ca7 0 2024-03-18T14:43:29.890 INFO:tasks.workunit.client.1.smithi129.stdout:0/991: creat d0/d14/d28/d63/f124 x:0 0 0 2024-03-18T14:43:29.907 INFO:tasks.workunit.client.1.smithi129.stdout:0/992: dread d0/d23/f3f [0,4194304] 0 2024-03-18T14:43:29.915 INFO:tasks.workunit.client.1.smithi129.stdout:5/938: write d0/d32/d34/f4d [1032739,71438] 0 2024-03-18T14:43:29.934 INFO:tasks.workunit.client.1.smithi129.stdout:7/959: symlink d4/d83/d11a/d79/l136 0 2024-03-18T14:43:29.936 INFO:tasks.workunit.client.1.smithi129.stdout:1/951: mkdir d1/d2/d28/d65/d12f 0 2024-03-18T14:43:29.936 INFO:tasks.workunit.client.1.smithi129.stdout:7/960: write d4/d83/d11a/d79/dc6/d54/f94 [1819794,19288] 0 2024-03-18T14:43:29.939 INFO:tasks.workunit.client.1.smithi129.stdout:3/944: rmdir d4/dd/d1f 39 2024-03-18T14:43:29.958 INFO:tasks.workunit.client.1.smithi129.stdout:4/903: getdents d0/d19/d46/d3e/d21/d4d/d58/d61/dd5 0 2024-03-18T14:43:29.959 INFO:tasks.workunit.client.1.smithi129.stdout:6/972: mknod d3/d30/de/db3/c13e 0 2024-03-18T14:43:29.959 INFO:tasks.workunit.client.1.smithi129.stdout:6/973: stat d3/d30/d44/f77 0 2024-03-18T14:43:29.960 INFO:tasks.workunit.client.1.smithi129.stdout:5/939: creat d0/d32/d3a/d45/d83/ddf/de2/f11d x:0 0 0 2024-03-18T14:43:29.962 INFO:tasks.workunit.client.1.smithi129.stdout:7/961: creat d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/f137 x:0 0 0 2024-03-18T14:43:29.963 INFO:tasks.workunit.client.1.smithi129.stdout:3/945: write d4/dd/d1f/d111/d34/f76 [467278,108660] 0 2024-03-18T14:43:29.963 INFO:tasks.workunit.client.1.smithi129.stdout:4/904: mknod d0/d9/d107/c124 0 2024-03-18T14:43:29.967 INFO:tasks.workunit.client.1.smithi129.stdout:1/952: truncate d1/d35/db8/dc6/fe0 934349 0 2024-03-18T14:43:29.968 INFO:tasks.workunit.client.1.smithi129.stdout:6/974: symlink d3/d6/d7f/db4/d12f/l13f 0 2024-03-18T14:43:29.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/905: creat d0/d19/d46/d3e/d21/d32/f125 x:0 0 0 2024-03-18T14:43:29.969 INFO:tasks.workunit.client.1.smithi129.stdout:4/906: chown d0/d3c/d6c/d89/de7/fff 13676 1 2024-03-18T14:43:29.977 INFO:tasks.workunit.client.1.smithi129.stdout:5/940: rename d0/dc/d22/la2 to d0/d32/d3a/d52/l11e 0 2024-03-18T14:43:29.979 INFO:tasks.workunit.client.1.smithi129.stdout:7/962: creat d4/d83/d11a/d42/d108/f138 x:0 0 0 2024-03-18T14:43:29.979 INFO:tasks.workunit.client.1.smithi129.stdout:0/993: getdents d0/d23/d35/d3b/de0 0 2024-03-18T14:43:29.980 INFO:tasks.workunit.client.1.smithi129.stdout:1/953: fdatasync d1/d2/d28/d65/f128 0 2024-03-18T14:43:29.981 INFO:tasks.workunit.client.1.smithi129.stdout:6/975: creat d3/d30/df/d28/d79/f140 x:0 0 0 2024-03-18T14:43:29.982 INFO:tasks.workunit.client.1.smithi129.stdout:7/963: stat d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b 0 2024-03-18T14:43:29.983 INFO:tasks.workunit.client.1.smithi129.stdout:5/941: dwrite d0/d32/d3a/d45/f74 [0,4194304] 0 2024-03-18T14:43:29.984 INFO:tasks.workunit.client.1.smithi129.stdout:5/942: dread - d0/dc/d1a/fbe zero size 2024-03-18T14:43:29.987 INFO:tasks.workunit.client.1.smithi129.stdout:1/954: mknod d1/db2/dc3/dc8/c130 0 2024-03-18T14:43:29.988 INFO:tasks.workunit.client.1.smithi129.stdout:6/976: rmdir d3/d6/d82/d9a 39 2024-03-18T14:43:29.989 INFO:tasks.workunit.client.1.smithi129.stdout:6/977: chown d3/d30/de/db3/c13e 6334 1 2024-03-18T14:43:29.991 INFO:tasks.workunit.client.1.smithi129.stdout:3/946: link d4/dd/d1f/d111/d34/d53/c13c d4/dd/d1f/d111/d1d/d50/d90/dac/c143 0 2024-03-18T14:43:29.991 INFO:tasks.workunit.client.1.smithi129.stdout:5/943: rmdir d0/dc/d1a/d61/d94 39 2024-03-18T14:43:29.992 INFO:tasks.workunit.client.1.smithi129.stdout:0/994: truncate d0/d14/fd5 1699283 0 2024-03-18T14:43:29.995 INFO:tasks.workunit.client.1.smithi129.stdout:4/907: rename d0/d19/d46/d2e/d66/dea/l10b to d0/d19/d46/d3e/l126 0 2024-03-18T14:43:29.996 INFO:tasks.workunit.client.1.smithi129.stdout:5/944: write d0/dc/d1a/d61/d94/db7/ffd [1413165,99574] 0 2024-03-18T14:43:29.996 INFO:tasks.workunit.client.1.smithi129.stdout:4/908: chown d0/d19/d46/d2e/d66/c6e 21 1 2024-03-18T14:43:29.997 INFO:tasks.workunit.client.1.smithi129.stdout:3/947: symlink d4/dd/d1f/d5f/de2/d11b/l144 0 2024-03-18T14:43:29.997 INFO:tasks.workunit.client.1.smithi129.stdout:5/945: readlink d0/dc/d18/d2b/d8c/l95 0 2024-03-18T14:43:29.998 INFO:tasks.workunit.client.1.smithi129.stdout:4/909: chown d0/d19/d46/d3e/d21/d4d/d70 148456 1 2024-03-18T14:43:29.998 INFO:tasks.workunit.client.1.smithi129.stdout:6/978: mknod d3/d6/dd5/d128/c141 0 2024-03-18T14:43:30.001 INFO:tasks.workunit.client.1.smithi129.stdout:0/995: creat d0/d23/d35/d3b/d42/dc0/d122/f125 x:0 0 0 2024-03-18T14:43:30.005 INFO:tasks.workunit.client.1.smithi129.stdout:1/955: write d1/d35/d7a/f107 [971865,10174] 0 2024-03-18T14:43:30.007 INFO:tasks.workunit.client.1.smithi129.stdout:4/910: fdatasync d0/d3c/d6c/f8d 0 2024-03-18T14:43:30.008 INFO:tasks.workunit.client.1.smithi129.stdout:6/979: mknod d3/d30/df/d28/d79/d106/c142 0 2024-03-18T14:43:30.008 INFO:tasks.workunit.client.1.smithi129.stdout:7/964: dwrite d4/d83/d11a/f30 [0,4194304] 0 2024-03-18T14:43:30.013 INFO:tasks.workunit.client.1.smithi129.stdout:1/956: truncate d1/f1d 1066758 0 2024-03-18T14:43:30.014 INFO:tasks.workunit.client.1.smithi129.stdout:4/911: symlink d0/d3c/d6c/d105/d106/l127 0 2024-03-18T14:43:30.016 INFO:tasks.workunit.client.1.smithi129.stdout:0/996: mknod d0/d23/d71/dc2/d4a/c126 0 2024-03-18T14:43:30.017 INFO:tasks.workunit.client.1.smithi129.stdout:3/948: write d4/dd/d1f/d111/f62 [292239,56084] 0 2024-03-18T14:43:30.019 INFO:tasks.workunit.client.1.smithi129.stdout:5/946: creat d0/d32/d3a/f11f x:0 0 0 2024-03-18T14:43:30.020 INFO:tasks.workunit.client.1.smithi129.stdout:5/947: dread - d0/d32/d3a/d45/d83/ddf/fdb zero size 2024-03-18T14:43:30.024 INFO:tasks.workunit.client.1.smithi129.stdout:3/949: mknod d4/dd/d1f/d5f/d8c/d101/d12a/c145 0 2024-03-18T14:43:30.025 INFO:tasks.workunit.client.1.smithi129.stdout:1/957: mkdir d1/d35/d131 0 2024-03-18T14:43:30.030 INFO:tasks.workunit.client.1.smithi129.stdout:5/948: creat d0/d32/d3a/de7/f120 x:0 0 0 2024-03-18T14:43:30.030 INFO:tasks.workunit.client.1.smithi129.stdout:6/980: creat d3/d30/f143 x:0 0 0 2024-03-18T14:43:30.031 INFO:tasks.workunit.client.1.smithi129.stdout:7/965: rename d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d107 to d4/d83/d11a/d42/d139 0 2024-03-18T14:43:30.031 INFO:tasks.workunit.client.1.smithi129.stdout:3/950: symlink d4/dd/d1f/d111/d34/df8/l146 0 2024-03-18T14:43:30.032 INFO:tasks.workunit.client.1.smithi129.stdout:4/912: truncate d0/d19/d46/d3e/d21/d4d/d70/dfe/f10e 219346 0 2024-03-18T14:43:30.032 INFO:tasks.workunit.client.1.smithi129.stdout:6/981: write d3/d5/f11 [4487664,4807] 0 2024-03-18T14:43:30.034 INFO:tasks.workunit.client.1.smithi129.stdout:5/949: rmdir d0/d32/d3a/d52/d69 39 2024-03-18T14:43:30.034 INFO:tasks.workunit.client.1.smithi129.stdout:6/982: fsync d3/d6/d7f/db4/f9c 0 2024-03-18T14:43:30.034 INFO:tasks.workunit.client.1.smithi129.stdout:3/951: dread - d4/dd/d1f/d111/d34/fdd zero size 2024-03-18T14:43:30.034 INFO:tasks.workunit.client.1.smithi129.stdout:4/913: chown d0/d19/d46/d3e/d21/d4d/d70/fc6 31742 1 2024-03-18T14:43:30.037 INFO:tasks.workunit.client.1.smithi129.stdout:7/966: dwrite d4/d83/d11a/d79/dc6/d38/d49/f115 [0,4194304] 0 2024-03-18T14:43:30.041 INFO:tasks.workunit.client.1.smithi129.stdout:1/958: write d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/fed [743868,45910] 0 2024-03-18T14:43:30.045 INFO:tasks.workunit.client.1.smithi129.stdout:5/950: creat d0/dc/d18/d2b/ded/f121 x:0 0 0 2024-03-18T14:43:30.047 INFO:tasks.workunit.client.1.smithi129.stdout:4/914: dread d0/fa7 [0,4194304] 0 2024-03-18T14:43:30.047 INFO:tasks.workunit.client.1.smithi129.stdout:4/915: stat d0/d19/d46/d3e/d21/d4d 0 2024-03-18T14:43:30.048 INFO:tasks.workunit.client.1.smithi129.stdout:5/951: creat d0/d32/d34/d6c/da3/f122 x:0 0 0 2024-03-18T14:43:30.049 INFO:tasks.workunit.client.1.smithi129.stdout:4/916: symlink d0/d9/d6a/l128 0 2024-03-18T14:43:30.050 INFO:tasks.workunit.client.1.smithi129.stdout:5/952: creat d0/d32/d3a/d45/d83/ddf/dc4/f123 x:0 0 0 2024-03-18T14:43:30.051 INFO:tasks.workunit.client.1.smithi129.stdout:5/953: chown d0/df/f66 172611211 1 2024-03-18T14:43:30.052 INFO:tasks.workunit.client.1.smithi129.stdout:4/917: symlink d0/d19/d46/d3e/d21/d4d/d70/l129 0 2024-03-18T14:43:30.054 INFO:tasks.workunit.client.1.smithi129.stdout:4/918: fsync d0/d19/d46/d3e/d21/d4d/ffb 0 2024-03-18T14:43:30.056 INFO:tasks.workunit.client.1.smithi129.stdout:5/954: dwrite d0/dc/d18/f1d [0,4194304] 0 2024-03-18T14:43:30.056 INFO:tasks.workunit.client.1.smithi129.stdout:4/919: write d0/d19/d46/d3e/d21/d7f/de2/f123 [525913,3882] 0 2024-03-18T14:43:30.057 INFO:tasks.workunit.client.1.smithi129.stdout:4/920: chown d0/d9/d85/c122 0 1 2024-03-18T14:43:30.060 INFO:tasks.workunit.client.1.smithi129.stdout:5/955: stat d0/dc/d18/d2b/f57 0 2024-03-18T14:43:30.060 INFO:tasks.workunit.client.1.smithi129.stdout:7/967: dread d4/d83/d11a/d79/dc6/d54/d86/fdf [0,4194304] 0 2024-03-18T14:43:30.061 INFO:tasks.workunit.client.1.smithi129.stdout:5/956: chown d0/f111 53 1 2024-03-18T14:43:30.062 INFO:tasks.workunit.client.1.smithi129.stdout:4/921: dwrite d0/d19/d46/d3e/d21/d4d/d70/dfe/fd9 [0,4194304] 0 2024-03-18T14:43:30.064 INFO:tasks.workunit.client.1.smithi129.stdout:7/968: creat d4/d83/d11a/d79/f13a x:0 0 0 2024-03-18T14:43:30.066 INFO:tasks.workunit.client.1.smithi129.stdout:7/969: write d4/d83/d11a/d79/dc6/d54/fee [571939,23773] 0 2024-03-18T14:43:30.066 INFO:tasks.workunit.client.1.smithi129.stdout:4/922: rmdir d0/d3c/d6c/d105/d106 39 2024-03-18T14:43:30.069 INFO:tasks.workunit.client.1.smithi129.stdout:7/970: truncate d4/d2d/d3a/fd6 426084 0 2024-03-18T14:43:30.071 INFO:tasks.workunit.client.1.smithi129.stdout:7/971: fsync d4/d83/d11a/d79/dc6/d54/d86/fe8 0 2024-03-18T14:43:30.071 INFO:tasks.workunit.client.1.smithi129.stdout:4/923: creat d0/d3c/d6c/d89/f12a x:0 0 0 2024-03-18T14:43:30.074 INFO:tasks.workunit.client.1.smithi129.stdout:4/924: unlink d0/d9/d85/la5 0 2024-03-18T14:43:30.076 INFO:tasks.workunit.client.1.smithi129.stdout:5/957: write d0/dc/d18/d2b/f57 [2039485,51290] 0 2024-03-18T14:43:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:4/925: dwrite d0/d19/d46/d3e/d21/d4d/ffb [0,4194304] 0 2024-03-18T14:43:30.079 INFO:tasks.workunit.client.1.smithi129.stdout:5/958: mknod d0/df/c124 0 2024-03-18T14:43:30.081 INFO:tasks.workunit.client.1.smithi129.stdout:5/959: readlink d0/d32/d3a/d45/d83/ddf/l11a 0 2024-03-18T14:43:30.082 INFO:tasks.workunit.client.1.smithi129.stdout:7/972: dwrite d4/d83/d11a/d79/dc6/d38/d49/f65 [0,4194304] 0 2024-03-18T14:43:30.082 INFO:tasks.workunit.client.1.smithi129.stdout:4/926: read d0/fbb [1403991,42409] 0 2024-03-18T14:43:30.082 INFO:tasks.workunit.client.1.smithi129.stdout:5/960: chown d0/dc/d18/d5f/l9a 15 1 2024-03-18T14:43:30.083 INFO:tasks.workunit.client.1.smithi129.stdout:7/973: readlink d4/d83/d11a/d42/l4b 0 2024-03-18T14:43:30.085 INFO:tasks.workunit.client.1.smithi129.stdout:0/997: sync 2024-03-18T14:43:30.088 INFO:tasks.workunit.client.1.smithi129.stdout:5/961: creat d0/dc/d1a/d61/d94/f125 x:0 0 0 2024-03-18T14:43:30.089 INFO:tasks.workunit.client.1.smithi129.stdout:4/927: write d0/d19/d46/d3e/d21/d4d/d70/dfe/f7d [1982792,122867] 0 2024-03-18T14:43:30.092 INFO:tasks.workunit.client.1.smithi129.stdout:7/974: creat d4/d83/d11a/d79/dc6/d38/d49/d112/f13b x:0 0 0 2024-03-18T14:43:30.094 INFO:tasks.workunit.client.1.smithi129.stdout:5/962: unlink d0/dc/d18/d2b/f5e 0 2024-03-18T14:43:30.095 INFO:tasks.workunit.client.1.smithi129.stdout:0/998: dread d0/d23/d6b/f9a [0,4194304] 0 2024-03-18T14:43:30.097 INFO:tasks.workunit.client.1.smithi129.stdout:4/928: creat d0/d19/d46/d3e/d21/d4d/d58/d61/dd5/de8/f12b x:0 0 0 2024-03-18T14:43:30.097 INFO:tasks.workunit.client.1.smithi129.stdout:5/963: creat d0/dc/d18/d5f/f126 x:0 0 0 2024-03-18T14:43:30.098 INFO:tasks.workunit.client.1.smithi129.stdout:7/975: mknod d4/d83/d11a/d79/dc6/d54/c13c 0 2024-03-18T14:43:30.100 INFO:tasks.workunit.client.1.smithi129.stdout:0/999: creat d0/f127 x:0 0 0 2024-03-18T14:43:30.107 INFO:tasks.workunit.client.1.smithi129.stdout:5/964: rmdir d0/dc/d18/d2b 39 2024-03-18T14:43:30.110 INFO:tasks.workunit.client.1.smithi129.stdout:7/976: write d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/f3f [2535189,55293] 0 2024-03-18T14:43:30.111 INFO:tasks.workunit.client.1.smithi129.stdout:4/929: truncate d0/f1c 1764951 0 2024-03-18T14:43:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:5/965: dread d0/dc/d4c/ddd/fd5 [0,4194304] 0 2024-03-18T14:43:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:4/930: chown d0/d19/d46/d2e/c3d 516391 1 2024-03-18T14:43:30.112 INFO:tasks.workunit.client.1.smithi129.stdout:7/977: fdatasync d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/fc0 0 2024-03-18T14:43:30.113 INFO:tasks.workunit.client.1.smithi129.stdout:4/931: dread - d0/d3c/d6c/d89/f12a zero size 2024-03-18T14:43:30.113 INFO:tasks.workunit.client.1.smithi129.stdout:7/978: read d4/fc2 [460706,57409] 0 2024-03-18T14:43:30.115 INFO:tasks.workunit.client.1.smithi129.stdout:6/983: sync 2024-03-18T14:43:30.116 INFO:tasks.workunit.client.1.smithi129.stdout:7/979: creat d4/d83/d11a/d42/d58/f13d x:0 0 0 2024-03-18T14:43:30.118 INFO:tasks.workunit.client.1.smithi129.stdout:6/984: creat d3/d30/de/da9/f144 x:0 0 0 2024-03-18T14:43:30.119 INFO:tasks.workunit.client.1.smithi129.stdout:5/966: dwrite d0/d32/d3a/d52/d69/fd7 [0,4194304] 0 2024-03-18T14:43:30.121 INFO:tasks.workunit.client.1.smithi129.stdout:6/985: write d3/d30/df/d28/d79/daf/db7/dc3/fed [821367,78522] 0 2024-03-18T14:43:30.121 INFO:tasks.workunit.client.1.smithi129.stdout:6/986: chown d3/d5 1 1 2024-03-18T14:43:30.122 INFO:tasks.workunit.client.1.smithi129.stdout:6/987: stat d3/d6/d7f/db4/fd8 0 2024-03-18T14:43:30.123 INFO:tasks.workunit.client.1.smithi129.stdout:7/980: dread d4/d83/d11a/d79/f132 [0,4194304] 0 2024-03-18T14:43:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:7/981: write d4/d83/d11a/d79/dc6/d54/fee [953702,117990] 0 2024-03-18T14:43:30.125 INFO:tasks.workunit.client.1.smithi129.stdout:4/932: mknod d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/d116/c12c 0 2024-03-18T14:43:30.126 INFO:tasks.workunit.client.1.smithi129.stdout:5/967: dwrite d0/d32/d34/f4d [0,4194304] 0 2024-03-18T14:43:30.128 INFO:tasks.workunit.client.1.smithi129.stdout:6/988: symlink d3/d30/df/l145 0 2024-03-18T14:43:30.129 INFO:tasks.workunit.client.1.smithi129.stdout:5/968: mkdir d0/df/d127 0 2024-03-18T14:43:30.131 INFO:tasks.workunit.client.1.smithi129.stdout:4/933: truncate d0/d19/d46/d3e/d21/d4d/d70/dfe/fbe 907725 0 2024-03-18T14:43:30.132 INFO:tasks.workunit.client.1.smithi129.stdout:4/934: write d0/d19/d46/d3e/d21/d4d/ffb [3019784,24318] 0 2024-03-18T14:43:30.133 INFO:tasks.workunit.client.1.smithi129.stdout:4/935: fdatasync d0/d19/d46/d3e/d21/d4d/d58/f8f 0 2024-03-18T14:43:30.134 INFO:tasks.workunit.client.1.smithi129.stdout:4/936: write d0/d19/d46/d3e/d21/d4d/d70/dc3/f110 [983111,89259] 0 2024-03-18T14:43:30.136 INFO:tasks.workunit.client.1.smithi129.stdout:5/969: mknod d0/d32/d10d/c128 0 2024-03-18T14:43:30.138 INFO:tasks.workunit.client.1.smithi129.stdout:4/937: rmdir d0/d3c/d6c/d89/de7 39 2024-03-18T14:43:30.138 INFO:tasks.workunit.client.1.smithi129.stdout:4/938: chown d0/d19/d46/d3e/dc0/fd1 181703 1 2024-03-18T14:43:30.140 INFO:tasks.workunit.client.1.smithi129.stdout:7/982: getdents d4/d83/d11a/d42 0 2024-03-18T14:43:30.142 INFO:tasks.workunit.client.1.smithi129.stdout:5/970: creat d0/dc/d18/d2b/ded/f129 x:0 0 0 2024-03-18T14:43:30.146 INFO:tasks.workunit.client.1.smithi129.stdout:4/939: truncate d0/d3c/d6c/d89/de7/fff 199144 0 2024-03-18T14:43:30.146 INFO:tasks.workunit.client.1.smithi129.stdout:7/983: write d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/fc1 [230694,356] 0 2024-03-18T14:43:30.148 INFO:tasks.workunit.client.1.smithi129.stdout:5/971: creat d0/d32/d3a/d45/d83/f12a x:0 0 0 2024-03-18T14:43:30.148 INFO:tasks.workunit.client.1.smithi129.stdout:6/989: dwrite d3/d30/de/d65/d93/fe2 [0,4194304] 0 2024-03-18T14:43:30.153 INFO:tasks.workunit.client.1.smithi129.stdout:7/984: mknod d4/d83/d11a/d79/dc6/d38/d61/d6a/dba/c13e 0 2024-03-18T14:43:30.154 INFO:tasks.workunit.client.1.smithi129.stdout:5/972: creat d0/dc/d18/d2b/ded/f12b x:0 0 0 2024-03-18T14:43:30.155 INFO:tasks.workunit.client.1.smithi129.stdout:1/959: sync 2024-03-18T14:43:30.155 INFO:tasks.workunit.client.1.smithi129.stdout:3/952: sync 2024-03-18T14:43:30.159 INFO:tasks.workunit.client.1.smithi129.stdout:5/973: unlink d0/dc/d18/d5f/f126 0 2024-03-18T14:43:30.161 INFO:tasks.workunit.client.1.smithi129.stdout:1/960: creat d1/d2/d28/d65/d19/dc9/d56/f132 x:0 0 0 2024-03-18T14:43:30.165 INFO:tasks.workunit.client.1.smithi129.stdout:1/961: dread - d1/d2/d28/d65/fae zero size 2024-03-18T14:43:30.165 INFO:tasks.workunit.client.1.smithi129.stdout:5/974: dwrite d0/d32/d3a/fb4 [0,4194304] 0 2024-03-18T14:43:30.166 INFO:tasks.workunit.client.1.smithi129.stdout:3/953: link d4/dd/d1f/d111/c74 d4/dd/d1f/d111/d1d/c147 0 2024-03-18T14:43:30.169 INFO:tasks.workunit.client.1.smithi129.stdout:4/940: dread d0/d9/d40/fbd [0,4194304] 0 2024-03-18T14:43:30.170 INFO:tasks.workunit.client.1.smithi129.stdout:3/954: mknod d4/dd/d1f/d5f/d82/d130/c148 0 2024-03-18T14:43:30.171 INFO:tasks.workunit.client.1.smithi129.stdout:5/975: dread d0/d32/d3a/fb4 [0,4194304] 0 2024-03-18T14:43:30.173 INFO:tasks.workunit.client.1.smithi129.stdout:6/990: dread d3/d5/f13 [0,4194304] 0 2024-03-18T14:43:30.175 INFO:tasks.workunit.client.1.smithi129.stdout:6/991: chown d3/d30/df/f42 1 1 2024-03-18T14:43:30.176 INFO:tasks.workunit.client.1.smithi129.stdout:4/941: dwrite d0/d19/f38 [0,4194304] 0 2024-03-18T14:43:30.180 INFO:tasks.workunit.client.1.smithi129.stdout:7/985: dread d4/d83/d11a/d79/dc6/fab [0,4194304] 0 2024-03-18T14:43:30.180 INFO:tasks.workunit.client.1.smithi129.stdout:3/955: creat d4/dd/d1f/d111/d34/d3c/d3f/f149 x:0 0 0 2024-03-18T14:43:30.181 INFO:tasks.workunit.client.1.smithi129.stdout:7/986: fsync d4/f66 0 2024-03-18T14:43:30.182 INFO:tasks.workunit.client.1.smithi129.stdout:6/992: rmdir d3/d6/d82/d9a/dad 39 2024-03-18T14:43:30.182 INFO:tasks.workunit.client.1.smithi129.stdout:1/962: dread d1/d2/d28/d65/f30 [0,4194304] 0 2024-03-18T14:43:30.183 INFO:tasks.workunit.client.1.smithi129.stdout:6/993: readlink d3/d30/df/l145 0 2024-03-18T14:43:30.184 INFO:tasks.workunit.client.1.smithi129.stdout:4/942: dread d0/d19/d46/d3e/d21/d7f/fd4 [0,4194304] 0 2024-03-18T14:43:30.186 INFO:tasks.workunit.client.1.smithi129.stdout:7/987: mkdir d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d13f 0 2024-03-18T14:43:30.189 INFO:tasks.workunit.client.1.smithi129.stdout:3/956: rename d4/d38/da3/dc9/lb9 to d4/dd/d1f/d5f/d8c/d101/l14a 0 2024-03-18T14:43:30.191 INFO:tasks.workunit.client.1.smithi129.stdout:4/943: mkdir d0/d9/d6a/d7b/dd0/d12d 0 2024-03-18T14:43:30.192 INFO:tasks.workunit.client.1.smithi129.stdout:1/963: truncate d1/d2/d28/d65/d19/dc9/d56/d11a/f126 1419494 0 2024-03-18T14:43:30.196 INFO:tasks.workunit.client.1.smithi129.stdout:5/976: dread d0/dc/d22/f35 [0,4194304] 0 2024-03-18T14:43:30.196 INFO:tasks.workunit.client.1.smithi129.stdout:6/994: write d3/d30/df/f85 [1126403,79503] 0 2024-03-18T14:43:30.198 INFO:tasks.workunit.client.1.smithi129.stdout:3/957: symlink d4/dd/d1f/d111/d1d/l14b 0 2024-03-18T14:43:30.200 INFO:tasks.workunit.client.1.smithi129.stdout:1/964: symlink d1/dbf/l133 0 2024-03-18T14:43:30.201 INFO:tasks.workunit.client.1.smithi129.stdout:1/965: write d1/d35/f9c [181659,74554] 0 2024-03-18T14:43:30.201 INFO:tasks.workunit.client.1.smithi129.stdout:5/977: readlink d0/dc/l93 0 2024-03-18T14:43:30.202 INFO:tasks.workunit.client.1.smithi129.stdout:6/995: rmdir d3/d30/de/db3 39 2024-03-18T14:43:30.204 INFO:tasks.workunit.client.1.smithi129.stdout:4/944: unlink d0/d19/d46/f36 0 2024-03-18T14:43:30.205 INFO:tasks.workunit.client.1.smithi129.stdout:3/958: truncate d4/dd/d1f/d111/d1d/d36/f4a 2324316 0 2024-03-18T14:43:30.206 INFO:tasks.workunit.client.1.smithi129.stdout:3/959: write d4/dd/d1f/d5f/de2/f136 [662742,113807] 0 2024-03-18T14:43:30.208 INFO:tasks.workunit.client.1.smithi129.stdout:6/996: symlink d3/d30/de/d49/df8/d117/l146 0 2024-03-18T14:43:30.210 INFO:tasks.workunit.client.1.smithi129.stdout:7/988: rename d4/d83/d11a/lbc to d4/d83/d11a/d79/dc6/d54/l140 0 2024-03-18T14:43:30.218 INFO:tasks.workunit.client.1.smithi129.stdout:1/966: rename d1/d35/d7a to d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/d134 0 2024-03-18T14:43:30.222 INFO:tasks.workunit.client.1.smithi129.stdout:6/997: mkdir d3/d6/d82/d12e/d147 0 2024-03-18T14:43:30.222 INFO:tasks.workunit.client.1.smithi129.stdout:5/978: dread d0/dc/f7b [0,4194304] 0 2024-03-18T14:43:30.224 INFO:tasks.workunit.client.1.smithi129.stdout:7/989: mknod d4/d83/d11a/d45/c141 0 2024-03-18T14:43:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:3/960: dread d4/dd/d1f/d111/d34/df8/ded/f118 [0,4194304] 0 2024-03-18T14:43:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:7/990: fsync d4/d83/d11a/d79/dc6/ff 0 2024-03-18T14:43:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:5/979: dread d0/fd2 [0,4194304] 0 2024-03-18T14:43:30.226 INFO:tasks.workunit.client.1.smithi129.stdout:3/961: readlink d4/d38/da3/lbc 0 2024-03-18T14:43:30.227 INFO:tasks.workunit.client.1.smithi129.stdout:5/980: write d0/d32/d3a/f11f [734658,2464] 0 2024-03-18T14:43:30.227 INFO:tasks.workunit.client.1.smithi129.stdout:6/998: rename d3/d30/de/da9/f144 to d3/d30/df/d28/d79/dc4/f148 0 2024-03-18T14:43:30.230 INFO:tasks.workunit.client.1.smithi129.stdout:7/991: mkdir d4/d2d/d142 0 2024-03-18T14:43:30.230 INFO:tasks.workunit.client.1.smithi129.stdout:1/967: dwrite d1/db2/de2/d80/f9a [0,4194304] 0 2024-03-18T14:43:30.230 INFO:tasks.workunit.client.1.smithi129.stdout:7/992: chown d4/d83/c127 103678037 1 2024-03-18T14:43:30.232 INFO:tasks.workunit.client.1.smithi129.stdout:1/968: write d1/d2/d28/d65/d19/f76 [309850,62321] 0 2024-03-18T14:43:30.233 INFO:tasks.workunit.client.1.smithi129.stdout:5/981: fdatasync d0/dc/d22/fe9 0 2024-03-18T14:43:30.234 INFO:tasks.workunit.client.1.smithi129.stdout:6/999: symlink d3/d6/d7f/d8f/l149 0 2024-03-18T14:43:30.236 INFO:tasks.workunit.client.1.smithi129.stdout:7/993: creat d4/d2d/f143 x:0 0 0 2024-03-18T14:43:30.241 INFO:tasks.workunit.client.1.smithi129.stdout:3/962: write d4/dd/d1f/d111/d34/d3c/d3f/f63 [1137686,90048] 0 2024-03-18T14:43:30.241 INFO:tasks.workunit.client.1.smithi129.stdout:1/969: symlink d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/l135 0 2024-03-18T14:43:30.242 INFO:tasks.workunit.client.1.smithi129.stdout:1/970: write d1/fbe [3826166,64197] 0 2024-03-18T14:43:30.244 INFO:tasks.workunit.client.1.smithi129.stdout:7/994: creat d4/d2d/d3a/d114/f144 x:0 0 0 2024-03-18T14:43:30.245 INFO:tasks.workunit.client.1.smithi129.stdout:3/963: mkdir d4/dd/d1f/d5f/d82/d14c 0 2024-03-18T14:43:30.246 INFO:tasks.workunit.client.1.smithi129.stdout:1/971: fsync d1/d2/d28/d65/d19/ff7 0 2024-03-18T14:43:30.246 INFO:tasks.workunit.client.1.smithi129.stdout:5/982: dwrite d0/dc/d18/d5f/f86 [0,4194304] 0 2024-03-18T14:43:30.251 INFO:tasks.workunit.client.1.smithi129.stdout:7/995: dwrite d4/d83/d11a/d42/d139/f117 [0,4194304] 0 2024-03-18T14:43:30.252 INFO:tasks.workunit.client.1.smithi129.stdout:7/996: write d4/d83/d11a/d45/f4c [4477521,37193] 0 2024-03-18T14:43:30.253 INFO:tasks.workunit.client.1.smithi129.stdout:1/972: symlink d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/d134/l136 0 2024-03-18T14:43:30.254 INFO:tasks.workunit.client.1.smithi129.stdout:5/983: truncate d0/dc/d1a/d61/d94/db7/fe4 1540609 0 2024-03-18T14:43:30.255 INFO:tasks.workunit.client.1.smithi129.stdout:3/964: dread d4/dd/d1f/d111/d34/d3c/d95/f96 [0,4194304] 0 2024-03-18T14:43:30.256 INFO:tasks.workunit.client.1.smithi129.stdout:7/997: creat d4/d2d/d142/f145 x:0 0 0 2024-03-18T14:43:30.257 INFO:tasks.workunit.client.1.smithi129.stdout:1/973: rename d1/d2/d28/l47 to d1/d2/d28/d65/d19/dc9/d56/d11a/l137 0 2024-03-18T14:43:30.258 INFO:tasks.workunit.client.1.smithi129.stdout:1/974: dread - d1/d35/db8/f116 zero size 2024-03-18T14:43:30.258 INFO:tasks.workunit.client.1.smithi129.stdout:5/984: write d0/dc/d4c/ddd/fc9 [373370,101568] 0 2024-03-18T14:43:30.261 INFO:tasks.workunit.client.1.smithi129.stdout:3/965: mkdir d4/dd/d1f/d111/d34/d4c/d14d 0 2024-03-18T14:43:30.262 INFO:tasks.workunit.client.1.smithi129.stdout:3/966: readlink d4/dd/d1f/d111/d34/d3c/l3e 0 2024-03-18T14:43:30.262 INFO:tasks.workunit.client.1.smithi129.stdout:1/975: symlink d1/dbf/l138 0 2024-03-18T14:43:30.264 INFO:tasks.workunit.client.1.smithi129.stdout:7/998: unlink d4/d83/d11a/c4e 0 2024-03-18T14:43:30.266 INFO:tasks.workunit.client.1.smithi129.stdout:3/967: mkdir d4/dd/d1f/d5f/d14e 0 2024-03-18T14:43:30.273 INFO:tasks.workunit.client.1.smithi129.stdout:3/968: write d4/dd/d1f/d111/d34/df8/ded/f112 [763550,16469] 0 2024-03-18T14:43:30.273 INFO:tasks.workunit.client.1.smithi129.stdout:5/985: dwrite d0/d32/d3a/df2/fa9 [0,4194304] 0 2024-03-18T14:43:30.274 INFO:tasks.workunit.client.1.smithi129.stdout:7/999: write d4/d83/d11a/d79/dc6/d38/d61/d68/d6b/d81/dfa/d3b/f40 [632426,64586] 0 2024-03-18T14:43:30.274 INFO:tasks.workunit.client.1.smithi129.stdout:3/969: chown d4/dd/d128/c133 1 1 2024-03-18T14:43:30.277 INFO:tasks.workunit.client.1.smithi129.stdout:1/976: creat d1/d2/d28/d65/d19/dc9/d87/dc0/f139 x:0 0 0 2024-03-18T14:43:30.279 INFO:tasks.workunit.client.1.smithi129.stdout:3/970: mkdir d4/dd/d1f/d5f/d82/d14f 0 2024-03-18T14:43:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:1/977: symlink d1/d2/d28/d65/d72/d10e/l13a 0 2024-03-18T14:43:30.281 INFO:tasks.workunit.client.1.smithi129.stdout:5/986: read d0/d32/d3a/d45/d83/ddf/de2/ffe [600573,70942] 0 2024-03-18T14:43:30.282 INFO:tasks.workunit.client.1.smithi129.stdout:3/971: symlink d4/dd/d1f/d5f/d82/d14f/l150 0 2024-03-18T14:43:30.285 INFO:tasks.workunit.client.1.smithi129.stdout:3/972: mknod d4/dd/d1f/d5f/d82/da6/c151 0 2024-03-18T14:43:30.286 INFO:tasks.workunit.client.1.smithi129.stdout:5/987: creat d0/f12c x:0 0 0 2024-03-18T14:43:30.288 INFO:tasks.workunit.client.1.smithi129.stdout:1/978: rmdir d1/d2/d28/d65/d19/dc9/d87/dc0/de1 0 2024-03-18T14:43:30.289 INFO:tasks.workunit.client.1.smithi129.stdout:3/973: mkdir d4/dd/d1f/d2f/dae/d152 0 2024-03-18T14:43:30.289 INFO:tasks.workunit.client.1.smithi129.stdout:4/945: sync 2024-03-18T14:43:30.290 INFO:tasks.workunit.client.1.smithi129.stdout:3/974: write d4/dd/d1f/d5f/d82/d130/f13a [998854,77112] 0 2024-03-18T14:43:30.291 INFO:tasks.workunit.client.1.smithi129.stdout:5/988: rmdir d0/d32/d3a/de7 39 2024-03-18T14:43:30.291 INFO:tasks.workunit.client.1.smithi129.stdout:3/975: read - d4/dd/d1f/d5f/de2/f131 zero size 2024-03-18T14:43:30.293 INFO:tasks.workunit.client.1.smithi129.stdout:4/946: symlink d0/d9/d4c/l12e 0 2024-03-18T14:43:30.297 INFO:tasks.workunit.client.1.smithi129.stdout:5/989: dread d0/d32/d3a/d45/d83/ddf/dc4/fcd [0,4194304] 0 2024-03-18T14:43:30.297 INFO:tasks.workunit.client.1.smithi129.stdout:5/990: read - d0/dc/d18/d2b/ded/f121 zero size 2024-03-18T14:43:30.300 INFO:tasks.workunit.client.1.smithi129.stdout:1/979: truncate d1/d2/d28/d65/d19/f37 2262942 0 2024-03-18T14:43:30.301 INFO:tasks.workunit.client.1.smithi129.stdout:1/980: stat d1/d35/lb7 0 2024-03-18T14:43:30.302 INFO:tasks.workunit.client.1.smithi129.stdout:5/991: creat d0/d32/d34/d6c/f12d x:0 0 0 2024-03-18T14:43:30.304 INFO:tasks.workunit.client.1.smithi129.stdout:5/992: dread - d0/d32/d34/d6c/da3/f10e zero size 2024-03-18T14:43:30.304 INFO:tasks.workunit.client.1.smithi129.stdout:4/947: symlink d0/d9/d40/l12f 0 2024-03-18T14:43:30.306 INFO:tasks.workunit.client.1.smithi129.stdout:1/981: dread d1/d2/d28/d65/d19/d52/fc5 [0,4194304] 0 2024-03-18T14:43:30.306 INFO:tasks.workunit.client.1.smithi129.stdout:3/976: dwrite d4/dd/d1f/d111/d34/d4c/f65 [0,4194304] 0 2024-03-18T14:43:30.307 INFO:tasks.workunit.client.1.smithi129.stdout:4/948: read d0/f88 [2318596,34058] 0 2024-03-18T14:43:30.308 INFO:tasks.workunit.client.1.smithi129.stdout:5/993: read d0/d32/d3a/d45/f65 [45959,79123] 0 2024-03-18T14:43:30.310 INFO:tasks.workunit.client.1.smithi129.stdout:3/977: mknod d4/dd/d1f/d5f/d31/c153 0 2024-03-18T14:43:30.312 INFO:tasks.workunit.client.1.smithi129.stdout:1/982: rename d1/d2/d28/d65/l39 to d1/d35/db8/dc6/l13b 0 2024-03-18T14:43:30.317 INFO:tasks.workunit.client.1.smithi129.stdout:3/978: mknod d4/dd/d1f/d5f/dfa/c154 0 2024-03-18T14:43:30.318 INFO:tasks.workunit.client.1.smithi129.stdout:3/979: write d4/fb3 [5466757,8446] 0 2024-03-18T14:43:30.320 INFO:tasks.workunit.client.1.smithi129.stdout:3/980: creat d4/dd/d1f/d5f/de2/d11b/d97/f155 x:0 0 0 2024-03-18T14:43:30.324 INFO:tasks.workunit.client.1.smithi129.stdout:4/949: truncate d0/d9/d40/d5f/fe5 1337393 0 2024-03-18T14:43:30.324 INFO:tasks.workunit.client.1.smithi129.stdout:5/994: truncate d0/d32/d34/f70 2739174 0 2024-03-18T14:43:30.325 INFO:tasks.workunit.client.1.smithi129.stdout:1/983: truncate d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/d134/fde 540269 0 2024-03-18T14:43:30.326 INFO:tasks.workunit.client.1.smithi129.stdout:3/981: mknod d4/c156 0 2024-03-18T14:43:30.327 INFO:tasks.workunit.client.1.smithi129.stdout:5/995: chown d0/f6 227 1 2024-03-18T14:43:30.329 INFO:tasks.workunit.client.1.smithi129.stdout:4/950: dwrite d0/d19/d46/d3e/d21/d4d/d70/dfe/f93 [0,4194304] 0 2024-03-18T14:43:30.331 INFO:tasks.workunit.client.1.smithi129.stdout:1/984: getdents d1/d2/d28/d65/d19/dc9/d56 0 2024-03-18T14:43:30.332 INFO:tasks.workunit.client.1.smithi129.stdout:5/996: chown d0/d32/d3a/df2/f105 669614279 1 2024-03-18T14:43:30.333 INFO:tasks.workunit.client.1.smithi129.stdout:3/982: dread d4/dd/d1f/d2f/dae/ff4 [0,4194304] 0 2024-03-18T14:43:30.334 INFO:tasks.workunit.client.1.smithi129.stdout:5/997: dread - d0/dc/d1a/d61/d94/f125 zero size 2024-03-18T14:43:30.336 INFO:tasks.workunit.client.1.smithi129.stdout:4/951: rmdir d0 39 2024-03-18T14:43:30.337 INFO:tasks.workunit.client.1.smithi129.stdout:1/985: mknod d1/d2/d28/d65/d72/d10e/c13c 0 2024-03-18T14:43:30.343 INFO:tasks.workunit.client.1.smithi129.stdout:1/986: rename d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/d134 to d1/d2/d28/d65/d19/d96/d13d 0 2024-03-18T14:43:30.345 INFO:tasks.workunit.client.1.smithi129.stdout:3/983: link d4/dd/d1f/d111/d34/d53/laf d4/dd/d1f/d111/d1d/d50/d90/dac/l157 0 2024-03-18T14:43:30.347 INFO:tasks.workunit.client.1.smithi129.stdout:5/998: getdents d0 0 2024-03-18T14:43:30.347 INFO:tasks.workunit.client.1.smithi129.stdout:1/987: mknod d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/c13e 0 2024-03-18T14:43:30.350 INFO:tasks.workunit.client.1.smithi129.stdout:3/984: symlink d4/dd/d1f/d111/d34/d53/l158 0 2024-03-18T14:43:30.351 INFO:tasks.workunit.client.1.smithi129.stdout:5/999: creat d0/dc/d1a/d61/d94/de0/f12e x:0 0 0 2024-03-18T14:43:30.352 INFO:tasks.workunit.client.1.smithi129.stdout:4/952: rename d0/d19/d46/d3e/d21/d4d/d58/d61/l8a to d0/d19/d46/l130 0 2024-03-18T14:43:30.355 INFO:tasks.workunit.client.1.smithi129.stdout:1/988: rename d1/d2/d28/d65/d72/c93 to d1/d2/d28/d65/d19/d96/d13d/c13f 0 2024-03-18T14:43:30.355 INFO:tasks.workunit.client.1.smithi129.stdout:3/985: dwrite d4/dd/d1f/f121 [0,4194304] 0 2024-03-18T14:43:30.356 INFO:tasks.workunit.client.1.smithi129.stdout:1/989: stat d1/d2/d28/d65/d19/dc9/d87/c117 0 2024-03-18T14:43:30.357 INFO:tasks.workunit.client.1.smithi129.stdout:4/953: unlink d0/d3c/d6c/fd2 0 2024-03-18T14:43:30.360 INFO:tasks.workunit.client.1.smithi129.stdout:3/986: creat d4/dd/d1f/d111/d1d/d50/d90/dac/f159 x:0 0 0 2024-03-18T14:43:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:1/990: creat d1/d2/d28/d65/d19/dc9/d87/f140 x:0 0 0 2024-03-18T14:43:30.365 INFO:tasks.workunit.client.1.smithi129.stdout:1/991: write d1/d2/d28/d65/d19/f4a [4492745,110422] 0 2024-03-18T14:43:30.370 INFO:tasks.workunit.client.1.smithi129.stdout:1/992: dwrite d1/d2/d28/d65/d19/d96/d13d/faf [0,4194304] 0 2024-03-18T14:43:30.375 INFO:tasks.workunit.client.1.smithi129.stdout:4/954: dread d0/d19/d46/d3e/d21/d4d/d70/dfe/f7d [0,4194304] 0 2024-03-18T14:43:30.376 INFO:tasks.workunit.client.1.smithi129.stdout:3/987: dwrite d4/dd/d1f/d5f/d82/da6/fa7 [0,4194304] 0 2024-03-18T14:43:30.382 INFO:tasks.workunit.client.1.smithi129.stdout:3/988: dwrite d4/dd/d1f/d5f/de2/d11b/d97/fa2 [0,4194304] 0 2024-03-18T14:43:30.383 INFO:tasks.workunit.client.1.smithi129.stdout:1/993: write d1/d2/d28/d65/f30 [1674718,9300] 0 2024-03-18T14:43:30.386 INFO:tasks.workunit.client.1.smithi129.stdout:1/994: mknod d1/db2/dc3/c141 0 2024-03-18T14:43:30.387 INFO:tasks.workunit.client.1.smithi129.stdout:4/955: dwrite d0/d19/d46/d3e/d21/d4d/d70/fe1 [0,4194304] 0 2024-03-18T14:43:30.388 INFO:tasks.workunit.client.1.smithi129.stdout:1/995: write d1/d2/d28/d65/d72/f121 [378616,5980] 0 2024-03-18T14:43:30.388 INFO:tasks.workunit.client.1.smithi129.stdout:4/956: dread - d0/d19/d46/d3e/d21/d4d/d58/d61/dd5/ff1 zero size 2024-03-18T14:43:30.389 INFO:tasks.workunit.client.1.smithi129.stdout:4/957: chown d0/d19/d46/d3e/dc0/c119 94522390 1 2024-03-18T14:43:30.390 INFO:tasks.workunit.client.1.smithi129.stdout:4/958: chown d0/d19/d46/d3e/f42 24845 1 2024-03-18T14:43:30.392 INFO:tasks.workunit.client.1.smithi129.stdout:1/996: chown d1/d2/d28/d65/d7c/fd4 24046358 1 2024-03-18T14:43:30.394 INFO:tasks.workunit.client.1.smithi129.stdout:4/959: symlink d0/d19/l131 0 2024-03-18T14:43:30.395 INFO:tasks.workunit.client.1.smithi129.stdout:1/997: mkdir d1/d2/d28/d65/d19/dc9/d56/d11a/d142 0 2024-03-18T14:43:30.396 INFO:tasks.workunit.client.1.smithi129.stdout:1/998: fdatasync d1/d2/d28/d65/d19/dc9/d87/d8c/dc4/fed 0 2024-03-18T14:43:30.397 INFO:tasks.workunit.client.1.smithi129.stdout:1/999: read - d1/d35/db8/f116 zero size 2024-03-18T14:43:30.402 INFO:tasks.workunit.client.1.smithi129.stdout:4/960: write d0/d19/f54 [900090,15653] 0 2024-03-18T14:43:30.404 INFO:tasks.workunit.client.1.smithi129.stdout:4/961: dread d0/d9/f51 [0,4194304] 0 2024-03-18T14:43:30.406 INFO:tasks.workunit.client.1.smithi129.stdout:4/962: symlink d0/d19/l132 0 2024-03-18T14:43:30.409 INFO:tasks.workunit.client.1.smithi129.stdout:4/963: creat d0/d19/d46/d3e/d21/d4d/d58/d61/d7e/d116/f133 x:0 0 0 2024-03-18T14:43:30.410 INFO:tasks.workunit.client.1.smithi129.stdout:4/964: write d0/d19/d46/d3e/d21/d4d/d70/fe1 [1271645,74821] 0 2024-03-18T14:43:30.414 INFO:tasks.workunit.client.1.smithi129.stdout:4/965: fdatasync d0/d19/d46/d2e/ff8 0 2024-03-18T14:43:30.418 INFO:tasks.workunit.client.1.smithi129.stdout:4/966: dread d0/d3c/fdf [0,4194304] 0 2024-03-18T14:43:30.421 INFO:tasks.workunit.client.1.smithi129.stdout:4/967: creat d0/d9/d4c/f134 x:0 0 0 2024-03-18T14:43:30.423 INFO:tasks.workunit.client.1.smithi129.stdout:4/968: creat d0/f135 x:0 0 0 2024-03-18T14:43:30.427 INFO:tasks.workunit.client.1.smithi129.stdout:4/969: creat d0/d9/d40/d5f/d77/f136 x:0 0 0 2024-03-18T14:43:30.431 INFO:tasks.workunit.client.1.smithi129.stdout:3/989: sync 2024-03-18T14:43:30.434 INFO:tasks.workunit.client.1.smithi129.stdout:4/970: mkdir d0/d3c/d6c/d105/d106/d137 0 2024-03-18T14:43:30.438 INFO:tasks.workunit.client.1.smithi129.stdout:3/990: creat d4/dd/d1f/d111/d34/d3c/f15a x:0 0 0 2024-03-18T14:43:30.440 INFO:tasks.workunit.client.1.smithi129.stdout:3/991: write d4/dd/d1f/d111/d34/d3c/d95/dff/f100 [1440695,5352] 0 2024-03-18T14:43:30.443 INFO:tasks.workunit.client.1.smithi129.stdout:3/992: dwrite d4/dd/d1f/d2f/fc5 [0,4194304] 0 2024-03-18T14:43:30.450 INFO:tasks.workunit.client.1.smithi129.stdout:3/993: dwrite d4/d38/da3/dc9/feb [0,4194304] 0 2024-03-18T14:43:30.454 INFO:tasks.workunit.client.1.smithi129.stdout:4/971: dwrite d0/d3c/fc1 [0,4194304] 0 2024-03-18T14:43:30.454 INFO:tasks.workunit.client.1.smithi129.stdout:4/972: chown d0/d19/d46/d2e/d66/dea 152772063 1 2024-03-18T14:43:30.456 INFO:tasks.workunit.client.1.smithi129.stdout:3/994: unlink d4/dd/d1f/d5f/d31/f49 0 2024-03-18T14:43:30.459 INFO:tasks.workunit.client.1.smithi129.stdout:3/995: read d4/d38/f2c [1063376,91510] 0 2024-03-18T14:43:30.459 INFO:tasks.workunit.client.1.smithi129.stdout:4/973: dwrite d0/d19/d46/d3e/d21/d4d/d58/f96 [0,4194304] 0 2024-03-18T14:43:30.460 INFO:tasks.workunit.client.1.smithi129.stdout:4/974: readlink d0/d19/d46/l99 0 2024-03-18T14:43:30.462 INFO:tasks.workunit.client.1.smithi129.stdout:3/996: creat d4/dd/d1f/d111/d1d/d50/f15b x:0 0 0 2024-03-18T14:43:30.462 INFO:tasks.workunit.client.1.smithi129.stdout:4/975: mknod d0/d3c/c138 0 2024-03-18T14:43:30.463 INFO:tasks.workunit.client.1.smithi129.stdout:3/997: chown d4/dd/d1f/d111/d34/d4c/l68 4939 1 2024-03-18T14:43:30.463 INFO:tasks.workunit.client.1.smithi129.stdout:4/976: fsync d0/d19/d46/d3e/d21/d4d/fef 0 2024-03-18T14:43:30.467 INFO:tasks.workunit.client.1.smithi129.stdout:3/998: mkdir d4/dd/d1f/d111/d1d/d36/d113/d15c 0 2024-03-18T14:43:30.470 INFO:tasks.workunit.client.1.smithi129.stdout:4/977: creat d0/d19/d46/d3e/f139 x:0 0 0 2024-03-18T14:43:30.472 INFO:tasks.workunit.client.1.smithi129.stdout:4/978: symlink d0/d9/d6a/d7b/dd0/d12d/l13a 0 2024-03-18T14:43:30.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/979: truncate d0/f1c 1528697 0 2024-03-18T14:43:30.475 INFO:tasks.workunit.client.1.smithi129.stdout:4/980: chown d0/d19/d46/d3e/dc0/fd1 1274316118 1 2024-03-18T14:43:30.476 INFO:tasks.workunit.client.1.smithi129.stdout:4/981: chown d0/d19/d5d/l78 11 1 2024-03-18T14:43:30.485 INFO:tasks.workunit.client.1.smithi129.stdout:4/982: dwrite d0/d19/d46/d3e/d21/d7f/fd4 [0,4194304] 0 2024-03-18T14:43:30.489 INFO:tasks.workunit.client.1.smithi129.stdout:4/983: creat d0/d19/d46/d3e/d21/d4d/d58/f13b x:0 0 0 2024-03-18T14:43:30.493 INFO:tasks.workunit.client.1.smithi129.stdout:4/984: dwrite d0/d9/f20 [0,4194304] 0 2024-03-18T14:43:30.496 INFO:tasks.workunit.client.1.smithi129.stdout:4/985: symlink d0/d3c/d6c/d89/l13c 0 2024-03-18T14:43:30.499 INFO:tasks.workunit.client.1.smithi129.stdout:4/986: mkdir d0/d19/d46/d3e/d21/d7f/d13d 0 2024-03-18T14:43:30.499 INFO:tasks.workunit.client.1.smithi129.stdout:4/987: chown d0/d9/d6a/d7b 41 1 2024-03-18T14:43:30.501 INFO:tasks.workunit.client.1.smithi129.stdout:4/988: mkdir d0/d3c/d6c/d89/de7/d13e 0 2024-03-18T14:43:30.506 INFO:tasks.workunit.client.1.smithi129.stdout:3/999: sync 2024-03-18T14:43:30.517 INFO:tasks.workunit.client.1.smithi129.stdout:4/989: dread d0/d9/d6a/d7b/fae [0,4194304] 0 2024-03-18T14:43:30.520 INFO:tasks.workunit.client.1.smithi129.stdout:4/990: creat d0/d19/d46/d3e/d21/d4d/d70/dc3/f13f x:0 0 0 2024-03-18T14:43:30.521 INFO:tasks.workunit.client.1.smithi129.stdout:4/991: readlink d0/d19/d46/l111 0 2024-03-18T14:43:30.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/992: fdatasync d0/d19/d46/d3e/d21/d4d/fd7 0 2024-03-18T14:43:30.523 INFO:tasks.workunit.client.1.smithi129.stdout:4/993: stat d0/l10f 0 2024-03-18T14:43:30.524 INFO:tasks.workunit.client.1.smithi129.stdout:4/994: chown d0/d19/d46/d3e/d21/d4d/d70/dfe/c3a 54281 1 2024-03-18T14:43:30.525 INFO:tasks.workunit.client.1.smithi129.stdout:4/995: dread d0/fa7 [0,4194304] 0 2024-03-18T14:43:30.528 INFO:tasks.workunit.client.1.smithi129.stdout:4/996: creat d0/d19/d46/d2e/d66/f140 x:0 0 0 2024-03-18T14:43:30.530 INFO:tasks.workunit.client.1.smithi129.stdout:4/997: truncate d0/d3c/d6c/d89/de7/fff 564218 0 2024-03-18T14:43:30.532 INFO:tasks.workunit.client.1.smithi129.stdout:4/998: creat d0/d19/d46/d3e/d21/d4d/d58/f141 x:0 0 0 2024-03-18T14:43:30.534 INFO:tasks.workunit.client.1.smithi129.stdout:4/999: getdents d0/d9/d4c/dca 0 2024-03-18T14:43:30.537 INFO:tasks.workunit.client.1.smithi129.stderr:+ rm -rf -- ./tmp.7ELo3txtyD 2024-03-18T14:43:41.687 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-18T14:43:41.688 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-18T14:43:43.664 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-18T14:43:43.664 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-18T14:44:38.472 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-18T14:44:38.472 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-18T14:44:38.736 DEBUG:teuthology.parallel:result is None 2024-03-18T14:44:41.980 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-03-18T14:44:41.980 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-18T14:44:42.247 DEBUG:teuthology.parallel:result is None 2024-03-18T14:44:42.248 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-18T14:44:42.311 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-18T14:44:42.311 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-18T14:44:42.375 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-18T14:44:42.375 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:44:42.386 INFO:teuthology.task.print:**** done fsstress 2024-03-18T14:44:42.386 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2024-03-18T14:44:42.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:44:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.501+0000 7f5f41b61700 1 Processor -- start 2024-03-18T14:44:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.501+0000 7f5f41b61700 1 -- start start 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f41b61700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 0x7f5f3c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f41b61700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f41b61700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c09b2a0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f41b61700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c09bc50 con 0x7f5f3c09aa10 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f41b61700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1367e0 con 0x7f5f3c064700 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 0x7f5f3c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60824/0 (socket says 172.21.15.57:60824) 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3affd700 1 -- 172.21.15.57:0/3125506598 learned_addr learned my addr 172.21.15.57:0/3125506598 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5f3c09adf0 0x7f5f3c132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56464/0 (socket says 172.21.15.57:56464) 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3b7fe700 1 -- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 msgr2=0x7f5f3c136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3b7fe700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3a7fc700 1 -- 172.21.15.57:0/3125506598 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657329958 0 0) 0x7f5f34001490 con 0x7f5f3c09adf0 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3b7fe700 1 -- 172.21.15.57:0/3125506598 >> v1:172.21.15.57:6789/0 conn(0x7f5f3c09adf0 legacy=0x7f5f3c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3b7fe700 1 -- 172.21.15.57:0/3125506598 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c136aa0 con 0x7f5f3c09aa10 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.502+0000 7f5f3affd700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f3b7fe700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 0x7f5f3c0621e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5f30002f70 tx=0x7f5f30006e80).ready entity=mon.1 client_cookie=a2c98c2730fd2c71 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f3a7fc700 1 -- 172.21.15.57:0/3125506598 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f30012070 con 0x7f5f3c09aa10 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f3a7fc700 1 -- 172.21.15.57:0/3125506598 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f30000e90 con 0x7f5f3c09aa10 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f3a7fc700 1 -- 172.21.15.57:0/3125506598 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3000f7f0 con 0x7f5f3c09aa10 2024-03-18T14:44:42.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 -- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 msgr2=0x7f5f3c0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 0x7f5f3c0621e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f5f30002f70 tx=0x7f5f30006e80).stop 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 -- 172.21.15.57:0/3125506598 shutdown_connections 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c09aa10 0x7f5f3c0621e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 --2- 172.21.15.57:0/3125506598 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c064700 0x7f5f3c136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 -- 172.21.15.57:0/3125506598 >> 172.21.15.57:0/3125506598 conn(0x7f5f3c06c0c0 msgr2=0x7f5f3c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 -- 172.21.15.57:0/3125506598 shutdown_connections 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.503+0000 7f5f41b61700 1 -- 172.21.15.57:0/3125506598 wait complete. 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.504+0000 7f5f41b61700 1 Processor -- start 2024-03-18T14:44:42.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.504+0000 7f5f41b61700 1 -- start start 2024-03-18T14:44:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 0x7f5f3c141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 0x7f5f3c130e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0935d0 con 0x7f5f3c09aa10 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1420e0 con 0x7f5f3c064700 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f41b61700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1423a0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 0x7f5f3c130e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55710/0 (socket says 172.21.15.57:55710) 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3b7fe700 1 -- 172.21.15.57:0/4160166165 learned_addr learned my addr 172.21.15.57:0/4160166165 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3affd700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 0x7f5f3c141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 -- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 msgr2=0x7f5f3c0967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 -- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 msgr2=0x7f5f3c141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 0x7f5f3c141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3bfff700 1 -- 172.21.15.57:0/4160166165 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c00b1e0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3b7fe700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.505+0000 7f5f3affd700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 0x7f5f3c141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f3bfff700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 0x7f5f3c130e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5f34001250 tx=0x7f5f34007f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f3400ce80 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f34005ae0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3000d590 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f34005e40 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.506+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0a8ad0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.507+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c136570 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.507+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5f34010070 con 0x7f5f3c09adf0 2024-03-18T14:44:42.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.507+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5f34049f10 con 0x7f5f3c09adf0 2024-03-18T14:44:42.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.510+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5f3402ee10 con 0x7f5f3c09adf0 2024-03-18T14:44:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.627+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f3c09b2a0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.628+0000 7f5f38ff9700 1 -- 172.21.15.57:0/4160166165 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f5f3c09b2a0 con 0x7f5f3c09adf0 2024-03-18T14:44:42.629 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:42.629 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:28.287790+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:44:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 >> v1:172.21.15.57:6816/39496 conn(0x7f5f1c038e30 legacy=0x7f5f1c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 msgr2=0x7f5f3c130e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 0x7f5f3c130e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f5f34001250 tx=0x7f5f34007f20).stop 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 shutdown_connections 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5f3c09adf0 0x7f5f3c130e00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5f3c064700 0x7f5f3c0967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 --2- 172.21.15.57:0/4160166165 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5f3c09aa10 0x7f5f3c141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 >> 172.21.15.57:0/4160166165 conn(0x7f5f3c06c0c0 msgr2=0x7f5f3c0a7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 shutdown_connections 2024-03-18T14:44:42.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.629+0000 7f5f41b61700 1 -- 172.21.15.57:0/4160166165 wait complete. 2024-03-18T14:44:42.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:44:42.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-18T14:44:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 Processor -- start 2024-03-18T14:44:42.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 -- start start 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a94063520 con 0x7f8a94133e30 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94134310 con 0x7f8a94063c30 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9c41d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94063750 con 0x7f8a9413c690 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9a9ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.749+0000 7f8a9a1b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60834/0 (socket says 172.21.15.57:60834) 2024-03-18T14:44:42.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 -- 172.21.15.57:0/2101573299 learned_addr learned my addr 172.21.15.57:0/2101573299 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a1b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55718/0 (socket says 172.21.15.57:55718) 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a999b8700 1 --1- 172.21.15.57:0/2101573299 >> v1:172.21.15.57:6789/0 conn(0x7f8a94133e30 0x7f8a94064010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56466/0 (socket says 172.21.15.57:56466) 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 -- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 msgr2=0x7f8a94134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 -- 172.21.15.57:0/2101573299 >> v1:172.21.15.57:6789/0 conn(0x7f8a94133e30 legacy=0x7f8a94064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 -- 172.21.15.57:0/2101573299 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94063a10 con 0x7f8a9413c690 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a991b7700 1 -- 172.21.15.57:0/2101573299 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112424361 0 0) 0x7f8a94063520 con 0x7f8a94133e30 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a1b9700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a9a9ba700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8a9405b550 tx=0x7f8a8c009290).ready entity=mon.2 client_cookie=d7c4bba18ae54eff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a991b7700 1 -- 172.21.15.57:0/2101573299 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c00b860 con 0x7f8a9413c690 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a991b7700 1 -- 172.21.15.57:0/2101573299 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00b9c0 con 0x7f8a9413c690 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.750+0000 7f8a991b7700 1 -- 172.21.15.57:0/2101573299 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a8c00bb30 con 0x7f8a9413c690 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 -- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 msgr2=0x7f8a9413ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f8a9405b550 tx=0x7f8a8c009290).stop 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 -- 172.21.15.57:0/2101573299 shutdown_connections 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a9413c690 0x7f8a9413ea80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/2101573299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a94063c30 0x7f8a94134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 -- 172.21.15.57:0/2101573299 >> 172.21.15.57:0/2101573299 conn(0x7f8a9406c0c0 msgr2=0x7f8a9406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 -- 172.21.15.57:0/2101573299 shutdown_connections 2024-03-18T14:44:42.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.751+0000 7f8a9c41d700 1 -- 172.21.15.57:0/2101573299 wait complete. 2024-03-18T14:44:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 Processor -- start 2024-03-18T14:44:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 -- start start 2024-03-18T14:44:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 0x7f8a94135930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 0x7f8a940a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94130810 con 0x7f8a94133e30 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940a82d0 con 0x7f8a9413c690 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9c41d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940a8570 con 0x7f8a94063c30 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9a1b9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9a1b9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60844/0 (socket says 172.21.15.57:60844) 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9a1b9700 1 -- 172.21.15.57:0/373108044 learned_addr learned my addr 172.21.15.57:0/373108044 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a9a9ba700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 0x7f8a940a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.752+0000 7f8a999b8700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 0x7f8a94135930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 -- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 msgr2=0x7f8a940a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 0x7f8a940a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 -- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 msgr2=0x7f8a94135930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 0x7f8a94135930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 -- 172.21.15.57:0/373108044 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9000b180 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a9ba700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 0x7f8a940a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a999b8700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 0x7f8a94135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9a1b9700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8a94130950 tx=0x7f8a90006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a90013b80 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90013ce0 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c009530 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a9001c610 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.753+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9413b070 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.754+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8a90023070 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.754+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8a9004e870 con 0x7f8a94063c30 2024-03-18T14:44:42.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.754+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9413b070 con 0x7f8a94063c30 2024-03-18T14:44:42.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.757+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8a9413b070 con 0x7f8a94063c30 2024-03-18T14:44:42.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.874+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8a9413b070 con 0x7f8a94063c30 2024-03-18T14:44:42.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.875+0000 7f8a877fe700 1 -- 172.21.15.57:0/373108044 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8a9413b070 con 0x7f8a94063c30 2024-03-18T14:44:42.876 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:44:42.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 >> v1:172.21.15.57:6816/39496 conn(0x7f8a74038dd0 legacy=0x7f8a7403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 msgr2=0x7f8a94130320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f8a94130950 tx=0x7f8a90006df0).stop 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 shutdown_connections 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8a9413c690 0x7f8a940a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8a94063c30 0x7f8a94130320 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 --2- 172.21.15.57:0/373108044 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8a94133e30 0x7f8a94135930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 >> 172.21.15.57:0/373108044 conn(0x7f8a9406c0c0 msgr2=0x7f8a9413bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 shutdown_connections 2024-03-18T14:44:42.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.876+0000 7f8a9c41d700 1 -- 172.21.15.57:0/373108044 wait complete. 2024-03-18T14:44:42.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:44:42.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.995+0000 7f62cdad3700 1 Processor -- start 2024-03-18T14:44:42.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.995+0000 7f62cdad3700 1 -- start start 2024-03-18T14:44:42.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62cdad3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 0x7f62c80621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62cdad3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c809adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62cdad3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62c809bc50 con 0x7f62c809aa10 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62cdad3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c809b2e0 con 0x7f62c8064700 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62cdad3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81365d0 con 0x7f62c8136140 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 0x7f62c80621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f62c809aa10 0x7f62c8132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56476/0 (socket says 172.21.15.57:56476) 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c809adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c77fe700 1 -- 172.21.15.57:0/1903967174 learned_addr learned my addr 172.21.15.57:0/1903967174 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 -- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 msgr2=0x7f62c809adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c809adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c67fc700 1 -- 172.21.15.57:0/1903967174 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304477489 0 0) 0x7f62c809bc50 con 0x7f62c809aa10 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 -- 172.21.15.57:0/1903967174 >> v1:172.21.15.57:6789/0 conn(0x7f62c809aa10 legacy=0x7f62c8132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:42.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 -- 172.21.15.57:0/1903967174 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c81367e0 con 0x7f62c8064700 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c7fff700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.996+0000 7f62c6ffd700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 0x7f62c80621e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f62b8002f70 tx=0x7f62b8006d90).ready entity=mon.1 client_cookie=e72240ae57037b84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62c67fc700 1 -- 172.21.15.57:0/1903967174 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b800d4a0 con 0x7f62c8064700 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62c67fc700 1 -- 172.21.15.57:0/1903967174 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8000e90 con 0x7f62c8064700 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62c67fc700 1 -- 172.21.15.57:0/1903967174 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b800d7f0 con 0x7f62c8064700 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 -- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 msgr2=0x7f62c80621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 0x7f62c80621e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f62b8002f70 tx=0x7f62b8006d90).stop 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 -- 172.21.15.57:0/1903967174 shutdown_connections 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c809adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 --2- 172.21.15.57:0/1903967174 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c8064700 0x7f62c80621e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 -- 172.21.15.57:0/1903967174 >> 172.21.15.57:0/1903967174 conn(0x7f62c806c0c0 msgr2=0x7f62c806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 -- 172.21.15.57:0/1903967174 shutdown_connections 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.997+0000 7f62cdad3700 1 -- 172.21.15.57:0/1903967174 wait complete. 2024-03-18T14:44:43.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.998+0000 7f62cdad3700 1 Processor -- start 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.998+0000 7f62cdad3700 1 -- start start 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 0x7f62c809e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c8149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c809ec10 con 0x7f62c8064700 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c80990b0 con 0x7f62c809aa10 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62cdad3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8148d50 con 0x7f62c8136140 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 0x7f62c809e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47140/0 (socket says 172.21.15.57:47140) 2024-03-18T14:44:43.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c77fe700 1 -- 172.21.15.57:0/3109183198 learned_addr learned my addr 172.21.15.57:0/3109183198 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c7fff700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c8149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 -- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 msgr2=0x7f62c8149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c8149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 -- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 msgr2=0x7f62c8098540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 -- 172.21.15.57:0/3109183198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c000b710 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c77fe700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c6ffd700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 0x7f62c809e720 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f62c809f260 tx=0x7f62b8014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b80117c0 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:42.999+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8011920 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.000+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b800b120 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.000+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62b8011c80 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.000+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c809cda0 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.000+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f62b800f070 con 0x7f62c809aa10 2024-03-18T14:44:43.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.000+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c8136aa0 con 0x7f62c809aa10 2024-03-18T14:44:43.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.001+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f62b804bb40 con 0x7f62c809aa10 2024-03-18T14:44:43.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.004+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f62b80123b0 con 0x7f62c809aa10 2024-03-18T14:44:43.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.119+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f62c809d8c0 con 0x7f62c809aa10 2024-03-18T14:44:43.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.119+0000 7f62c4ff9700 1 -- 172.21.15.57:0/3109183198 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f62b8006420 con 0x7f62c809aa10 2024-03-18T14:44:43.120 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:44:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 >> v1:172.21.15.57:6816/39496 conn(0x7f62ac038da0 legacy=0x7f62ac03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 msgr2=0x7f62c809e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 0x7f62c809e720 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f62c809f260 tx=0x7f62b8014000).stop 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 shutdown_connections 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62c8136140 0x7f62c8149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62c8064700 0x7f62c8098540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 --2- 172.21.15.57:0/3109183198 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62c809aa10 0x7f62c809e720 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 >> 172.21.15.57:0/3109183198 conn(0x7f62c806c0c0 msgr2=0x7f62c81350c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 shutdown_connections 2024-03-18T14:44:43.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.120+0000 7f62cdad3700 1 -- 172.21.15.57:0/3109183198 wait complete. 2024-03-18T14:44:43.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:44:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.250+0000 7f4ab7564700 1 Processor -- start 2024-03-18T14:44:43.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 -- start start 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab009f800 con 0x7f4ab005e170 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00a50b0 con 0x7f4ab009d570 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab7564700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00a4190 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab5300700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab5b01700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab4aff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab5300700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47146/0 (socket says 172.21.15.57:47146) 2024-03-18T14:44:43.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab5b01700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60882/0 (socket says 172.21.15.57:60882) 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab4aff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:55752/0 (socket says 172.21.15.57:55752) 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.251+0000 7f4ab5300700 1 -- 172.21.15.57:0/2965778530 learned_addr learned my addr 172.21.15.57:0/2965778530 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 -- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 msgr2=0x7f4ab00a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 -- 172.21.15.57:0/2965778530 >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 msgr2=0x7f4ab00a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 --2- 172.21.15.57:0/2965778530 >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 -- 172.21.15.57:0/2965778530 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab005e550 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5300700 1 --2- 172.21.15.57:0/2965778530 >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab4aff700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4ab5b01700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4ab009f940 tx=0x7f4aa80091d0).ready entity=mon.2 client_cookie=e14d06938aa4972 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4a9ffff700 1 -- 172.21.15.57:0/2965778530 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa800b600 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4a9ffff700 1 -- 172.21.15.57:0/2965778530 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800b760 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.252+0000 7f4a9ffff700 1 -- 172.21.15.57:0/2965778530 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa800b8d0 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 -- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 msgr2=0x7f4ab00a24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4ab009f940 tx=0x7f4aa80091d0).stop 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 -- 172.21.15.57:0/2965778530 shutdown_connections 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a24d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 --2- 172.21.15.57:0/2965778530 >> v2:172.21.15.57:3300/0 conn(0x7f4ab005e170 0x7f4ab00a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 --2- 172.21.15.57:0/2965778530 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab009d570 0x7f4ab00a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 -- 172.21.15.57:0/2965778530 >> 172.21.15.57:0/2965778530 conn(0x7f4ab00a93f0 msgr2=0x7f4ab00a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 -- 172.21.15.57:0/2965778530 shutdown_connections 2024-03-18T14:44:43.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.253+0000 7f4ab7564700 1 -- 172.21.15.57:0/2965778530 wait complete. 2024-03-18T14:44:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 Processor -- start 2024-03-18T14:44:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 -- start start 2024-03-18T14:44:43.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 0x7f4ab0145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab01466a0 con 0x7f4ab009d570 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0146400 con 0x7f4ab005e170 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab7564700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00a08f0 con 0x7f4ab00a4ab0 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab4aff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab5300700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 0x7f4ab0145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab4aff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47156/0 (socket says 172.21.15.57:47156) 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab5b01700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.254+0000 7f4ab4aff700 1 -- 172.21.15.57:0/828246196 learned_addr learned my addr 172.21.15.57:0/828246196 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 -- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 msgr2=0x7f4ab00a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 -- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 msgr2=0x7f4ab00a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 -- 172.21.15.57:0/828246196 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa000b1e0 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab4aff700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5b01700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab5300700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 0x7f4ab0145a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4ab006bbf0 tx=0x7f4aa0006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0012600 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa0012760 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac00b180 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa0012ac0 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.255+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8009470 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.256+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4aa0022070 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.256+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4aa004ac70 con 0x7f4ab005e170 2024-03-18T14:44:43.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.256+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab009df90 con 0x7f4ab005e170 2024-03-18T14:44:43.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.260+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4aa0033500 con 0x7f4ab005e170 2024-03-18T14:44:43.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.380+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ab0057a60 con 0x7f4ab005e170 2024-03-18T14:44:43.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.380+0000 7f4a9e7fc700 1 -- 172.21.15.57:0/828246196 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4aa00330f0 con 0x7f4ab005e170 2024-03-18T14:44:43.381 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.381+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 >> v1:172.21.15.57:6816/39496 conn(0x7f4a90038da0 legacy=0x7f4a9003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.381+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 msgr2=0x7f4ab0145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.381+0000 7f4ab7564700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 0x7f4ab0145a30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f4ab006bbf0 tx=0x7f4aa0006eb0).stop 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 shutdown_connections 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4ab00a4ab0 0x7f4ab00a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4ab005e170 0x7f4ab0145a30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 --2- 172.21.15.57:0/828246196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ab009d570 0x7f4ab00a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 >> 172.21.15.57:0/828246196 conn(0x7f4ab00a93f0 msgr2=0x7f4ab00a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 shutdown_connections 2024-03-18T14:44:43.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.382+0000 7f4ab7564700 1 -- 172.21.15.57:0/828246196 wait complete. 2024-03-18T14:44:43.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:44:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.502+0000 7f0998fe9700 1 Processor -- start 2024-03-18T14:44:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.502+0000 7f0998fe9700 1 -- start start 2024-03-18T14:44:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0998fe9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0998fe9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0998fe9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0994099e70 con 0x7f0994099a00 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0998fe9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f099409a380 con 0x7f099409b520 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0998fe9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0994135fe0 con 0x7f09941366f0 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0991d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0991d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58908/0 (socket says 172.21.15.57:58908) 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0991d9b700 1 -- 172.21.15.57:0/2740826640 learned_addr learned my addr 172.21.15.57:0/2740826640 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58906/0 (socket says 172.21.15.57:58906) 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0992d9d700 1 --1- 172.21.15.57:0/2740826640 >> v1:172.21.15.57:6789/0 conn(0x7f0994099a00 0x7f0994139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43292/0 (socket says 172.21.15.57:43292) 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 -- 172.21.15.57:0/2740826640 >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 msgr2=0x7f0994136ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 --2- 172.21.15.57:0/2740826640 >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 -- 172.21.15.57:0/2740826640 >> v1:172.21.15.57:6789/0 conn(0x7f0994099a00 legacy=0x7f0994139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f099259c700 1 -- 172.21.15.57:0/2740826640 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f099409a0c0 con 0x7f09941366f0 2024-03-18T14:44:43.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.503+0000 7f0991d9b700 1 --2- 172.21.15.57:0/2740826640 >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f099259c700 1 --2- 172.21.15.57:0/2740826640 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0988002f70 tx=0x7f0988006df0).ready entity=mon.2 client_cookie=fde9fef82321ba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f099159a700 1 -- 172.21.15.57:0/2740826640 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098800d570 con 0x7f09941366f0 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f099159a700 1 -- 172.21.15.57:0/2740826640 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988000e90 con 0x7f09941366f0 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f099159a700 1 -- 172.21.15.57:0/2740826640 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098800d8c0 con 0x7f09941366f0 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 -- 172.21.15.57:0/2740826640 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 msgr2=0x7f099409bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 --2- 172.21.15.57:0/2740826640 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f0988002f70 tx=0x7f0988006df0).stop 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 -- 172.21.15.57:0/2740826640 shutdown_connections 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 --2- 172.21.15.57:0/2740826640 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f09941366f0 0x7f099409bbb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 --2- 172.21.15.57:0/2740826640 >> v2:172.21.15.57:3300/0 conn(0x7f099409b520 0x7f0994136ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 -- 172.21.15.57:0/2740826640 >> 172.21.15.57:0/2740826640 conn(0x7f099406c0c0 msgr2=0x7f099406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 -- 172.21.15.57:0/2740826640 shutdown_connections 2024-03-18T14:44:43.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.504+0000 7f0998fe9700 1 -- 172.21.15.57:0/2740826640 wait complete. 2024-03-18T14:44:43.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.505+0000 7f0998fe9700 1 Processor -- start 2024-03-18T14:44:43.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.505+0000 7f0998fe9700 1 -- start start 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 0x7f09940943f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09941366f0 0x7f0994148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09940963c0 con 0x7f099409b520 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09940976d0 con 0x7f09941366f0 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0998fe9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0994093aa0 con 0x7f0994099a00 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f099259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 0x7f09940943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58918/0 (socket says 172.21.15.57:58918) 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f099259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 0x7f09940943f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58912/0 (socket says 172.21.15.57:58912) 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 -- 172.21.15.57:0/3779005880 learned_addr learned my addr 172.21.15.57:0/3779005880 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0992d9d700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09941366f0 0x7f0994148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 -- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 msgr2=0x7f09940943f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 0x7f09940943f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 -- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09941366f0 msgr2=0x7f0994148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09941366f0 0x7f0994148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 -- 172.21.15.57:0/3779005880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098400b1e0 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f0991d9b700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0994097810 tx=0x7f0984006e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.506+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098400c830 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.507+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098400c990 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.507+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098800b180 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.507+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f098400ccf0 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.507+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0994096ff0 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.507+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f098401b400 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.508+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f098404a9a0 con 0x7f099409b520 2024-03-18T14:44:43.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.508+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994057a60 con 0x7f099409b520 2024-03-18T14:44:43.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.511+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f098402de60 con 0x7f099409b520 2024-03-18T14:44:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.627+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0994060880 con 0x7f099409b520 2024-03-18T14:44:43.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.628+0000 7f09837fe700 1 -- 172.21.15.57:0/3779005880 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7f098402de60 con 0x7f099409b520 2024-03-18T14:44:43.629 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 >> v1:172.21.15.57:6816/39496 conn(0x7f0970038da0 legacy=0x7f097003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 msgr2=0x7f0994094d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f0994097810 tx=0x7f0984006e50).stop 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 shutdown_connections 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f09941366f0 0x7f0994148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0994099a00 0x7f09940943f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 --2- 172.21.15.57:0/3779005880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f099409b520 0x7f0994094d70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 >> 172.21.15.57:0/3779005880 conn(0x7f099406c0c0 msgr2=0x7f09941350b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 shutdown_connections 2024-03-18T14:44:43.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.629+0000 7f0998fe9700 1 -- 172.21.15.57:0/3779005880 wait complete. 2024-03-18T14:44:43.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.745+0000 7fadd94a3700 1 Processor -- start 2024-03-18T14:44:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.745+0000 7fadd94a3700 1 -- start start 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd94a3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd94a3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd94a3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd40603c0 con 0x7fadd40674b0 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd94a3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40aa230 con 0x7fadd40aae90 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd94a3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40aa4d0 con 0x7fadd4132df0 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58918/0 (socket says 172.21.15.57:58918) 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40742/0 (socket says 172.21.15.57:40742) 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd2ffd700 1 -- 172.21.15.57:0/1958586965 learned_addr learned my addr 172.21.15.57:0/1958586965 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd27fc700 1 -- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 msgr2=0x7fadd4060dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:43.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd27fc700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.746+0000 7fadd1ffb700 1 -- 172.21.15.57:0/1958586965 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354173225 0 0) 0x7fadd40603c0 con 0x7fadd40674b0 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd27fc700 1 -- 172.21.15.57:0/1958586965 >> v1:172.21.15.57:6789/0 conn(0x7fadd40674b0 legacy=0x7fadd4067960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd27fc700 1 -- 172.21.15.57:0/1958586965 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40aa790 con 0x7fadd40aae90 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd2ffd700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd27fc700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fadc4002f70 tx=0x7fadc4006df0).ready entity=mon.1 client_cookie=cb05a49492dcf12a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd1ffb700 1 -- 172.21.15.57:0/1958586965 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc400d570 con 0x7fadd40aae90 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd1ffb700 1 -- 172.21.15.57:0/1958586965 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc4000e90 con 0x7fadd40aae90 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd1ffb700 1 -- 172.21.15.57:0/1958586965 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc400d8c0 con 0x7fadd40aae90 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 -- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 msgr2=0x7fadd41331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fadc4002f70 tx=0x7fadc4006df0).stop 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 -- 172.21.15.57:0/1958586965 shutdown_connections 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd4132df0 0x7fadd4060dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 --2- 172.21.15.57:0/1958586965 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd41331d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 -- 172.21.15.57:0/1958586965 >> 172.21.15.57:0/1958586965 conn(0x7fadd405c300 msgr2=0x7fadd406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 -- 172.21.15.57:0/1958586965 shutdown_connections 2024-03-18T14:44:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.747+0000 7fadd94a3700 1 -- 172.21.15.57:0/1958586965 wait complete. 2024-03-18T14:44:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.748+0000 7fadd94a3700 1 Processor -- start 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.748+0000 7fadd94a3700 1 -- start start 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd40982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 0x7fadd4145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4097910 con 0x7fadd4132df0 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4095cb0 con 0x7fadd40aae90 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd94a3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4142cb0 con 0x7fadd40674b0 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 0x7fadd4145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58920/0 (socket says 172.21.15.57:58920) 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd2ffd700 1 -- 172.21.15.57:0/2485374657 learned_addr learned my addr 172.21.15.57:0/2485374657 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd40982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 -- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 msgr2=0x7fadd4097080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 -- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 msgr2=0x7fadd4145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 0x7fadd4145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd27fc700 1 -- 172.21.15.57:0/2485374657 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc800b1e0 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd2ffd700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.749+0000 7fadd37fe700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 0x7fadd4145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadd27fc700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd40982d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fadd4098f40 tx=0x7fadc4014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc4016070 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc4013b70 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc400b180 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadc401e450 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.750+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd4097af0 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.751+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fadc4025030 con 0x7fadd40aae90 2024-03-18T14:44:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.751+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd4095e20 con 0x7fadd40aae90 2024-03-18T14:44:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.751+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fadc404b6a0 con 0x7fadd40aae90 2024-03-18T14:44:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.754+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fadd4095e20 con 0x7fadd40aae90 2024-03-18T14:44:43.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.903+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadd4095df0 con 0x7fadd40aae90 2024-03-18T14:44:43.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.904+0000 7fadc3fff700 1 -- 172.21.15.57:0/2485374657 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2322 (secure 0 0 0) 0x7fadc4023030 con 0x7fadd40aae90 2024-03-18T14:44:43.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:43.905 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:00.390077+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 >> v1:172.21.15.57:6816/39496 conn(0x7fadb0038da0 legacy=0x7fadb003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 msgr2=0x7fadd40982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd40982d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fadd4098f40 tx=0x7fadc4014000).stop 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 shutdown_connections 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fadd4132df0 0x7fadd4145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fadd40674b0 0x7fadd4097080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 --2- 172.21.15.57:0/2485374657 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fadd40aae90 0x7fadd40982d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:43.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 >> 172.21.15.57:0/2485374657 conn(0x7fadd405c300 msgr2=0x7fadd4139920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 shutdown_connections 2024-03-18T14:44:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:43.905+0000 7fadd94a3700 1 -- 172.21.15.57:0/2485374657 wait complete. 2024-03-18T14:44:43.907 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 11 2024-03-18T14:44:43.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:44:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.021+0000 7f042c185700 1 Processor -- start 2024-03-18T14:44:44.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.021+0000 7f042c185700 1 -- start start 2024-03-18T14:44:44.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042c185700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042c185700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042c185700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042409bc50 con 0x7f042409aa10 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042c185700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042409b2e0 con 0x7f0424064700 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042c185700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04241365d0 con 0x7f0424136140 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f0429720700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042a722700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f0429720700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40758/0 (socket says 172.21.15.57:40758) 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f042a722700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58932/0 (socket says 172.21.15.57:58932) 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f0429720700 1 -- 172.21.15.57:0/1813154070 learned_addr learned my addr 172.21.15.57:0/1813154070 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.022+0000 7f0429f21700 1 --1- 172.21.15.57:0/1813154070 >> v1:172.21.15.57:6789/0 conn(0x7f042409aa10 0x7f0424132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43308/0 (socket says 172.21.15.57:43308) 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0429720700 1 -- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 msgr2=0x7f042409adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0429720700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0428f1f700 1 -- 172.21.15.57:0/1813154070 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331026452 0 0) 0x7f042409bc50 con 0x7f042409aa10 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0429720700 1 -- 172.21.15.57:0/1813154070 >> v1:172.21.15.57:6789/0 conn(0x7f042409aa10 legacy=0x7f0424132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0429720700 1 -- 172.21.15.57:0/1813154070 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04241367e0 con 0x7f0424064700 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042a722700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0429720700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0420002f70 tx=0x7f0420006ee0).ready entity=mon.1 client_cookie=f936755c67d01401 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0428f1f700 1 -- 172.21.15.57:0/1813154070 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f042000ba70 con 0x7f0424064700 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0428f1f700 1 -- 172.21.15.57:0/1813154070 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420000e90 con 0x7f0424064700 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f0428f1f700 1 -- 172.21.15.57:0/1813154070 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f042000bdc0 con 0x7f0424064700 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 -- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 msgr2=0x7f04240621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0420002f70 tx=0x7f0420006ee0).stop 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 -- 172.21.15.57:0/1813154070 shutdown_connections 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0424136140 0x7f042409adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 --2- 172.21.15.57:0/1813154070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424064700 0x7f04240621e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 -- 172.21.15.57:0/1813154070 >> 172.21.15.57:0/1813154070 conn(0x7f042406c0c0 msgr2=0x7f042406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.023+0000 7f042c185700 1 -- 172.21.15.57:0/1813154070 shutdown_connections 2024-03-18T14:44:44.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.024+0000 7f042c185700 1 -- 172.21.15.57:0/1813154070 wait complete. 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.024+0000 7f042c185700 1 Processor -- start 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.024+0000 7f042c185700 1 -- start start 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0424064700 0x7f0424092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424092f00 con 0x7f0424064700 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0424095290 con 0x7f0424136140 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042c185700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0424093cf0 con 0x7f042409aa10 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f0429720700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40766/0 (socket says 172.21.15.57:40766) 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f0429720700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58946/0 (socket says 172.21.15.57:58946) 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 -- 172.21.15.57:0/4214111488 learned_addr learned my addr 172.21.15.57:0/4214111488 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f0429f21700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0424064700 0x7f0424092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 -- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 msgr2=0x7f0424092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 -- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0424064700 msgr2=0x7f0424092030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0424064700 0x7f0424092030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 -- 172.21.15.57:0/4214111488 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009470 con 0x7f0424136140 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f0429720700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.025+0000 7f042a722700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f041c00c000 tx=0x7f041c0091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.026+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f041c0096b0 con 0x7f0424136140 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.026+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00c850 con 0x7f0424136140 2024-03-18T14:44:44.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.026+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042000d410 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.026+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f041c00cbb0 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.026+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424067060 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.027+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f041c022070 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.027+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04240672b0 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.027+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f041c04ae80 con 0x7f0424136140 2024-03-18T14:44:44.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.030+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f04240672b0 con 0x7f0424136140 2024-03-18T14:44:44.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.149+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04240672b0 con 0x7f0424136140 2024-03-18T14:44:44.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.150+0000 7f0412ffd700 1 -- 172.21.15.57:0/4214111488 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10534 (secure 0 0 0) 0x7f04240672b0 con 0x7f0424136140 2024-03-18T14:44:44.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:44.151 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:28.287790+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-03-18T14:44:44.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.151+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 >> v1:172.21.15.57:6816/39496 conn(0x7f0404038e30 legacy=0x7f040403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.151+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 msgr2=0x7f0424092a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.151+0000 7f042c185700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f041c00c000 tx=0x7f041c0091d0).stop 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 shutdown_connections 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0424136140 0x7f0424092a10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0424064700 0x7f0424092030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 --2- 172.21.15.57:0/4214111488 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f042409aa10 0x7f0424092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 >> 172.21.15.57:0/4214111488 conn(0x7f042406c0c0 msgr2=0x7f042405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 shutdown_connections 2024-03-18T14:44:44.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.152+0000 7f042c185700 1 -- 172.21.15.57:0/4214111488 wait complete. 2024-03-18T14:44:44.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T14:44:44.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.272+0000 7ff7a2220700 1 Processor -- start 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.272+0000 7ff7a2220700 1 -- start start 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff7a2220700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 0x7ff79c13b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff7a2220700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff79c13b6a0 0x7ff79c13da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff7a2220700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff79c0a1f10 con 0x7ff79c05dfb0 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff7a2220700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79c0a0f60 con 0x7ff79c13b6a0 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff7a2220700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c0a1200 con 0x7ff79c09f5d0 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79affd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 0x7ff79c13b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff79c05dfb0 0x7ff79c0a2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43322/0 (socket says 172.21.15.57:43322) 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79b7fe700 1 -- 172.21.15.57:0/2062756516 learned_addr learned my addr 172.21.15.57:0/2062756516 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 --2- 172.21.15.57:0/2062756516 >> v2:172.21.15.57:3300/0 conn(0x7ff79c13b6a0 0x7ff79c13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79a7fc700 1 -- 172.21.15.57:0/2062756516 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252541775 0 0) 0x7ff79c0a1f10 con 0x7ff79c05dfb0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79a7fc700 1 -- 172.21.15.57:0/2062756516 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c003260 con 0x7ff79c05dfb0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 -- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 msgr2=0x7ff79c13b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 0x7ff79c13b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 -- 172.21.15.57:0/2062756516 >> v1:172.21.15.57:6789/0 conn(0x7ff79c05dfb0 legacy=0x7ff79c0a2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 -- 172.21.15.57:0/2062756516 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c060520 con 0x7ff79c13b6a0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79affd700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 0x7ff79c13b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.273+0000 7ff79bfff700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c13da90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff7940032f0 tx=0x7ff7940091d0).ready entity=mon.0 client_cookie=cec85e00ce0913e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff79a7fc700 1 -- 172.21.15.57:0/2062756516 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79400b600 con 0x7ff79c13b6a0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff79a7fc700 1 -- 172.21.15.57:0/2062756516 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400b760 con 0x7ff79c13b6a0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff79a7fc700 1 -- 172.21.15.57:0/2062756516 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff79400b8d0 con 0x7ff79c13b6a0 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 -- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 msgr2=0x7ff79c13da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c13da90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff7940032f0 tx=0x7ff7940091d0).stop 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 -- 172.21.15.57:0/2062756516 shutdown_connections 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c13da90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 --2- 172.21.15.57:0/2062756516 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c09f5d0 0x7ff79c13b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 -- 172.21.15.57:0/2062756516 >> 172.21.15.57:0/2062756516 conn(0x7ff79c0a93f0 msgr2=0x7ff79c0a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 -- 172.21.15.57:0/2062756516 shutdown_connections 2024-03-18T14:44:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.274+0000 7ff7a2220700 1 -- 172.21.15.57:0/2062756516 wait complete. 2024-03-18T14:44:44.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.275+0000 7ff7a2220700 1 Processor -- start 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.275+0000 7ff7a2220700 1 -- start start 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff79c09f5d0 0x7ff79c1346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c134ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c063650 con 0x7ff79c13b6a0 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c063930 con 0x7ff79c05dfb0 2024-03-18T14:44:44.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff7a2220700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff79c1499d0 con 0x7ff79c09f5d0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff79c09f5d0 0x7ff79c1346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40788/0 (socket says 172.21.15.57:40788) 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 -- 172.21.15.57:0/3420612798 learned_addr learned my addr 172.21.15.57:0/3420612798 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79bfff700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c134ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 -- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff79c09f5d0 msgr2=0x7ff79c1346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff79c09f5d0 0x7ff79c1346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 -- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 msgr2=0x7ff79c134ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c134ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 -- 172.21.15.57:0/3420612798 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c00b180 con 0x7ff79c05dfb0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff79b7fe700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff784001110 tx=0x7ff784007ad0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.276+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7840070d0 con 0x7ff79c05dfb0 2024-03-18T14:44:44.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff784007230 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff784005610 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff794009470 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79c149f00 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff784010070 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.277+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79c057a60 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.278+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff784049f60 con 0x7ff79c05dfb0 2024-03-18T14:44:44.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.281+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff78402edc0 con 0x7ff79c05dfb0 2024-03-18T14:44:44.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:44.432+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff79c063a70 con 0x7ff79c05dfb0 2024-03-18T14:44:45.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.277+0000 7ff798ff9700 1 -- 172.21.15.57:0/3420612798 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff79c063a70 con 0x7ff79c05dfb0 2024-03-18T14:44:45.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 >> v1:172.21.15.57:6816/39496 conn(0x7ff780038ec0 legacy=0x7ff78003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 msgr2=0x7ff79c1494e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7ff784001110 tx=0x7ff784007ad0).stop 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 shutdown_connections 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff79c13b6a0 0x7ff79c134ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff79c05dfb0 0x7ff79c1494e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 --2- 172.21.15.57:0/3420612798 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff79c09f5d0 0x7ff79c1346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.279+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 >> 172.21.15.57:0/3420612798 conn(0x7ff79c0a93f0 msgr2=0x7ff79c09e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.280+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 shutdown_connections 2024-03-18T14:44:45.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.280+0000 7ff7a2220700 1 -- 172.21.15.57:0/3420612798 wait complete. 2024-03-18T14:44:45.293 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-03-18T14:44:45.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.408+0000 7ffabe5eb700 1 Processor -- start 2024-03-18T14:44:45.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.408+0000 7ffabe5eb700 1 -- start start 2024-03-18T14:44:45.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabe5eb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 0x7ffab809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:45.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabe5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 0x7ffab8136ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabe5eb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab8099e50 con 0x7ffab8099a00 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabe5eb700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab809a380 con 0x7ffab81366f0 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabe5eb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8135fe0 con 0x7ffab809b520 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 0x7ffab8136ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 0x7ffab809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabcb88700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffab8099a00 0x7ffab8139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43324/0 (socket says 172.21.15.57:43324) 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffabcb88700 1 -- 172.21.15.57:0/552748487 learned_addr learned my addr 172.21.15.57:0/552748487 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 -- 172.21.15.57:0/552748487 >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 msgr2=0x7ffab809bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 --2- 172.21.15.57:0/552748487 >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 0x7ffab809bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 -- 172.21.15.57:0/552748487 >> v1:172.21.15.57:6789/0 conn(0x7ffab8099a00 legacy=0x7ffab8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 -- 172.21.15.57:0/552748487 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab809a0c0 con 0x7ffab809b520 2024-03-18T14:44:45.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab7fff700 1 --2- 172.21.15.57:0/552748487 >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 0x7ffab809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab77fe700 1 --2- 172.21.15.57:0/552748487 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 0x7ffab8136ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffab8099fe0 tx=0x7ffaa8006d90).ready entity=mon.2 client_cookie=ce1537b3eda699e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab6ffd700 1 -- 172.21.15.57:0/552748487 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa800d4a0 con 0x7ffab809b520 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab6ffd700 1 -- 172.21.15.57:0/552748487 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8000e90 con 0x7ffab809b520 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.409+0000 7ffab6ffd700 1 -- 172.21.15.57:0/552748487 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa800d7f0 con 0x7ffab809b520 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 -- 172.21.15.57:0/552748487 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 msgr2=0x7ffab8136ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/552748487 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 0x7ffab8136ad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7ffab8099fe0 tx=0x7ffaa8006d90).stop 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 -- 172.21.15.57:0/552748487 shutdown_connections 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/552748487 >> v2:172.21.15.57:3300/0 conn(0x7ffab81366f0 0x7ffab809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/552748487 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab809b520 0x7ffab8136ad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 -- 172.21.15.57:0/552748487 >> 172.21.15.57:0/552748487 conn(0x7ffab806c0c0 msgr2=0x7ffab806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 -- 172.21.15.57:0/552748487 shutdown_connections 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.410+0000 7ffabe5eb700 1 -- 172.21.15.57:0/552748487 wait complete. 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.411+0000 7ffabe5eb700 1 Processor -- start 2024-03-18T14:44:45.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.411+0000 7ffabe5eb700 1 -- start start 2024-03-18T14:44:45.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.411+0000 7ffabe5eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 0x7ffab8097ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:45.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.411+0000 7ffabe5eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 0x7ffab8145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.411+0000 7ffabe5eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffab81366f0 0x7ffab8149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabe5eb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80945d0 con 0x7ffab809b520 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabe5eb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81465d0 con 0x7ffab81366f0 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabe5eb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80947f0 con 0x7ffab8099a00 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 0x7ffab8097ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 0x7ffab8145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 0x7ffab8097ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58970/0 (socket says 172.21.15.57:58970) 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab7fff700 1 -- 172.21.15.57:0/217414455 learned_addr learned my addr 172.21.15.57:0/217414455 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabcb88700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffab81366f0 0x7ffab8149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 -- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 msgr2=0x7ffab8097ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 0x7ffab8097ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 -- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffab81366f0 msgr2=0x7ffab8149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:45.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffab81366f0 0x7ffab8149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 -- 172.21.15.57:0/217414455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa000b180 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab77fe700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 0x7ffab8145be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ffab8099fe0 tx=0x7ffaa8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa80114d0 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa8011630 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa800b120 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffaa80119d0 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.412+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab8096ce0 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.413+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ffaa8022030 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.413+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8067cb0 con 0x7ffab809b520 2024-03-18T14:44:45.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.413+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ffaa804aa10 con 0x7ffab809b520 2024-03-18T14:44:45.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.417+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ffaa8024b20 con 0x7ffab809b520 2024-03-18T14:44:45.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:45.569+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7ffab8057a60 con 0x7ffab809b520 2024-03-18T14:44:46.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.287+0000 7ffab57fa700 1 -- 172.21.15.57:0/217414455 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v13) v1 ==== 105+0+0 (secure 0 0 0) 0x7ffaa8032f20 con 0x7ffab809b520 2024-03-18T14:44:46.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.289+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 >> v1:172.21.15.57:6816/39496 conn(0x7ffa9c038e30 legacy=0x7ffa9c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.289+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 msgr2=0x7ffab8145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.289+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 0x7ffab8145be0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ffab8099fe0 tx=0x7ffaa8014000).stop 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.289+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 shutdown_connections 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.289+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ffab81366f0 0x7ffab8149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.290+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ffab8099a00 0x7ffab8097ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.290+0000 7ffabe5eb700 1 --2- 172.21.15.57:0/217414455 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffab809b520 0x7ffab8145be0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.290+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 >> 172.21.15.57:0/217414455 conn(0x7ffab806c0c0 msgr2=0x7ffab81376d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.290+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 shutdown_connections 2024-03-18T14:44:46.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.290+0000 7ffabe5eb700 1 -- 172.21.15.57:0/217414455 wait complete. 2024-03-18T14:44:46.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:46.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 Processor -- start 2024-03-18T14:44:46.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 -- start start 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b84132df0 0x7f4b84060dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b840603c0 con 0x7f4b84132df0 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840aa230 con 0x7f4b840aae90 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.418+0000 7f4b8c723700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840aa4d0 con 0x7f4b840674b0 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8acc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b89cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4b84132df0 0x7f4b84060dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8acc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58984/0 (socket says 172.21.15.57:58984) 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b89cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40804/0 (socket says 172.21.15.57:40804) 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8acc0700 1 -- 172.21.15.57:0/2333129314 learned_addr learned my addr 172.21.15.57:0/2333129314 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 msgr2=0x7f4b84067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 msgr2=0x7f4b841331d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/2333129314 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b840aa790 con 0x7f4b84132df0 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8acc0700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b89cbe700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b84132df0 0x7f4b84060dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80006df0).ready entity=mon.0 client_cookie=500c944c93875c52 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:46.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b894bd700 1 -- 172.21.15.57:0/2333129314 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d4a0 con 0x7f4b84132df0 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b894bd700 1 -- 172.21.15.57:0/2333129314 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80000e90 con 0x7f4b84132df0 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.419+0000 7f4b894bd700 1 -- 172.21.15.57:0/2333129314 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b8000d7f0 con 0x7f4b84132df0 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 -- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b84132df0 msgr2=0x7f4b84060dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b84132df0 0x7f4b84060dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80006df0).stop 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 -- 172.21.15.57:0/2333129314 shutdown_connections 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b840674b0 0x7f4b84067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b84132df0 0x7f4b84060dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 --2- 172.21.15.57:0/2333129314 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b841331d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 -- 172.21.15.57:0/2333129314 >> 172.21.15.57:0/2333129314 conn(0x7f4b8405c300 msgr2=0x7f4b8406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 -- 172.21.15.57:0/2333129314 shutdown_connections 2024-03-18T14:44:46.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.420+0000 7f4b8c723700 1 -- 172.21.15.57:0/2333129314 wait complete. 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 Processor -- start 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 -- start start 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 0x7f4b84095310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84095120 con 0x7f4b840674b0 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b84097880 con 0x7f4b840aae90 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.421+0000 7f4b8c723700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b840959d0 con 0x7f4b84132df0 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b89cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8acc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 0x7f4b84095310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b89cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40814/0 (socket says 172.21.15.57:40814) 2024-03-18T14:44:46.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8acc0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:58996/0 (socket says 172.21.15.57:58996) 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b89cbe700 1 -- 172.21.15.57:0/1012739608 learned_addr learned my addr 172.21.15.57:0/1012739608 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 msgr2=0x7f4b84130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 msgr2=0x7f4b84130a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 -- 172.21.15.57:0/1012739608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c009530 con 0x7f4b840674b0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8acc0700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b89cbe700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8a4bf700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 0x7f4b84095310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b80012930 con 0x7f4b840674b0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80012a90 con 0x7f4b840674b0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7400b180 con 0x7f4b840674b0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b80012df0 con 0x7f4b840674b0 2024-03-18T14:44:46.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.422+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8000b180 con 0x7f4b840674b0 2024-03-18T14:44:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.423+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4b8001c070 con 0x7f4b840674b0 2024-03-18T14:44:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.423+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4b8004b380 con 0x7f4b840674b0 2024-03-18T14:44:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.424+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b840a9a90 con 0x7f4b840674b0 2024-03-18T14:44:46.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.427+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4b80002450 con 0x7f4b840674b0 2024-03-18T14:44:46.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.575+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b84057a60 con 0x7f4b840674b0 2024-03-18T14:44:46.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.576+0000 7f4b737fe700 1 -- 172.21.15.57:0/1012739608 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f4b80002280 con 0x7f4b840674b0 2024-03-18T14:44:46.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:46.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 >> v1:172.21.15.57:6816/39496 conn(0x7f4b64038da0 legacy=0x7f4b6403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 msgr2=0x7f4b84095310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:46.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 0x7f4b84095310 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4b80002f70 tx=0x7f4b80014000).stop 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 shutdown_connections 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4b84132df0 0x7f4b84130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4b840674b0 0x7f4b84095310 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 --2- 172.21.15.57:0/1012739608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4b840aae90 0x7f4b84130a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 >> 172.21.15.57:0/1012739608 conn(0x7f4b8405c300 msgr2=0x7f4b840a8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 shutdown_connections 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:46.577+0000 7f4b8c723700 1 -- 172.21.15.57:0/1012739608 wait complete. 2024-03-18T14:44:46.579 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:46.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:46.891 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:47.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.011+0000 7f9dfc905700 1 Processor -- start 2024-03-18T14:44:48.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.011+0000 7f9dfc905700 1 -- start start 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80649c0 con 0x7f9df8137860 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8063a70 con 0x7f9df8063590 2024-03-18T14:44:48.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9dfc905700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8064bc0 con 0x7f9df80650c0 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df6d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59010/0 (socket says 172.21.15.57:59010) 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df659c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58984/0 (socket says 172.21.15.57:58984) 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df5d9b700 1 -- 172.21.15.57:0/265181350 learned_addr learned my addr 172.21.15.57:0/265181350 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.012+0000 7f9df6d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40826/0 (socket says 172.21.15.57:40826) 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 -- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 msgr2=0x7f9df80630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 -- 172.21.15.57:0/265181350 >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 msgr2=0x7f9df8137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/265181350 >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 -- 172.21.15.57:0/265181350 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80ab0d0 con 0x7f9df8063590 2024-03-18T14:44:48.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df5d9b700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df659c700 1 --2- 172.21.15.57:0/265181350 >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9df00032f0 tx=0x7f9df00091d0).ready entity=mon.1 client_cookie=1818d3e32b9b04a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df559a700 1 -- 172.21.15.57:0/265181350 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df000b600 con 0x7f9df8063590 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df559a700 1 -- 172.21.15.57:0/265181350 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df000b760 con 0x7f9df8063590 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9df559a700 1 -- 172.21.15.57:0/265181350 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df000b8d0 con 0x7f9df8063590 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9dfc905700 1 -- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 msgr2=0x7f9df80a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.013+0000 7f9dfc905700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f9df00032f0 tx=0x7f9df00091d0).stop 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 -- 172.21.15.57:0/265181350 shutdown_connections 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8063590 0x7f9df80a92a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 --2- 172.21.15.57:0/265181350 >> v2:172.21.15.57:3300/0 conn(0x7f9df8137860 0x7f9df8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 --2- 172.21.15.57:0/265181350 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df80650c0 0x7f9df80630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 -- 172.21.15.57:0/265181350 >> 172.21.15.57:0/265181350 conn(0x7f9df805c300 msgr2=0x7f9df806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:48.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 -- 172.21.15.57:0/265181350 shutdown_connections 2024-03-18T14:44:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 -- 172.21.15.57:0/265181350 wait complete. 2024-03-18T14:44:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.014+0000 7f9dfc905700 1 Processor -- start 2024-03-18T14:44:48.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 -- start start 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df8063590 0x7f9df8148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 0x7f9df8060260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8098280 con 0x7f9df80650c0 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8149450 con 0x7f9df8137860 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9dfc905700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9df8149710 con 0x7f9df8063590 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9df5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9df6d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 0x7f9df8060260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9df659c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df8063590 0x7f9df8148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:48.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9df5d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58986/0 (socket says 172.21.15.57:58986) 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.015+0000 7f9df5d9b700 1 -- 172.21.15.57:0/3974585617 learned_addr learned my addr 172.21.15.57:0/3974585617 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 -- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df8063590 msgr2=0x7f9df8148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df8063590 0x7f9df8148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 -- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 msgr2=0x7f9df805fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 -- 172.21.15.57:0/3974585617 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de000b1e0 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df5d9b700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9df6d9d700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 0x7f9df8060260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9df00032f0 tx=0x7f9df0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df000b600 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0011ae0 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de800b180 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df0011e40 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.016+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df0009470 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.017+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9df0026030 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.017+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df8096600 con 0x7f9df8137860 2024-03-18T14:44:48.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.017+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9df004b260 con 0x7f9df8137860 2024-03-18T14:44:48.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.020+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9df8096600 con 0x7f9df8137860 2024-03-18T14:44:48.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.171+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9df8149210 con 0x7f9df8137860 2024-03-18T14:44:48.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.172+0000 7f9def7fe700 1 -- 172.21.15.57:0/3974585617 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f9df8149210 con 0x7f9df8137860 2024-03-18T14:44:48.172 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:48.173 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 >> v1:172.21.15.57:6816/39496 conn(0x7f9ddc038dd0 legacy=0x7f9ddc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 msgr2=0x7f9df8060260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 0x7f9df8060260 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9df00032f0 tx=0x7f9df0016000).stop 2024-03-18T14:44:48.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 shutdown_connections 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9df8137860 0x7f9df8060260 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9df8063590 0x7f9df8148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 --2- 172.21.15.57:0/3974585617 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9df80650c0 0x7f9df805fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 >> 172.21.15.57:0/3974585617 conn(0x7f9df805c300 msgr2=0x7f9df81365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 shutdown_connections 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:48.173+0000 7f9dfc905700 1 -- 172.21.15.57:0/3974585617 wait complete. 2024-03-18T14:44:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:48.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:48.487 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:49.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:49.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.609+0000 7fe8cad89700 1 Processor -- start 2024-03-18T14:44:49.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.609+0000 7fe8cad89700 1 -- start start 2024-03-18T14:44:49.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.609+0000 7fe8cad89700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8c4136210 0x7fe8c405bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:49.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.609+0000 7fe8cad89700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:49.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8cad89700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c405b970 con 0x7fe8c4136bf0 2024-03-18T14:44:49.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8cad89700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c405d590 con 0x7fe8c4136210 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8cad89700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4136710 con 0x7fe8c413eb70 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c9326700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8c4136210 0x7fe8c405bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c8b25700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe8c4136bf0 0x7fe8c405ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43338/0 (socket says 172.21.15.57:43338) 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c9326700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59032/0 (socket says 172.21.15.57:59032) 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8c4136210 0x7fe8c405bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58996/0 (socket says 172.21.15.57:58996) 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c8b25700 1 -- 172.21.15.57:0/261794326 learned_addr learned my addr 172.21.15.57:0/261794326 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 -- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 msgr2=0x7fe8c4140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 -- 172.21.15.57:0/261794326 >> v1:172.21.15.57:6789/0 conn(0x7fe8c4136bf0 legacy=0x7fe8c405ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c37fe700 1 -- 172.21.15.57:0/261794326 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071272205 0 0) 0x7fe8c405b970 con 0x7fe8c4136bf0 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 -- 172.21.15.57:0/261794326 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c41369d0 con 0x7fe8c4136210 2024-03-18T14:44:49.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c9326700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c3fff700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136210 0x7fe8c405bde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe8b0002f70 tx=0x7fe8b0006df0).ready entity=mon.0 client_cookie=c742602e106ab42d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c37fe700 1 -- 172.21.15.57:0/261794326 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b000d570 con 0x7fe8c4136210 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c37fe700 1 -- 172.21.15.57:0/261794326 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0000e90 con 0x7fe8c4136210 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.610+0000 7fe8c37fe700 1 -- 172.21.15.57:0/261794326 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b000d8c0 con 0x7fe8c4136210 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 -- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136210 msgr2=0x7fe8c405bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136210 0x7fe8c405bde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe8b0002f70 tx=0x7fe8b0006df0).stop 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 -- 172.21.15.57:0/261794326 shutdown_connections 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c413eb70 0x7fe8c4140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 --2- 172.21.15.57:0/261794326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136210 0x7fe8c405bde0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 -- 172.21.15.57:0/261794326 >> 172.21.15.57:0/261794326 conn(0x7fe8c4066a50 msgr2=0x7fe8c406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 -- 172.21.15.57:0/261794326 shutdown_connections 2024-03-18T14:44:49.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.611+0000 7fe8cad89700 1 -- 172.21.15.57:0/261794326 wait complete. 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.612+0000 7fe8cad89700 1 Processor -- start 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.612+0000 7fe8cad89700 1 -- start start 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 0x7fe8c40a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 0x7fe8c4146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 0x7fe8c413ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40a0ec0 con 0x7fe8c4136bf0 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4146ed0 con 0x7fe8c413eb70 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8cad89700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4147190 con 0x7fe8c4136210 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8c8b25700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 0x7fe8c40a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8c3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 0x7fe8c4146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8c8b25700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 0x7fe8c40a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59042/0 (socket says 172.21.15.57:59042) 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8c8b25700 1 -- 172.21.15.57:0/645176227 learned_addr learned my addr 172.21.15.57:0/645176227 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.613+0000 7fe8c9326700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 0x7fe8c413ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:49.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 -- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 msgr2=0x7fe8c40a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 0x7fe8c40a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 -- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 msgr2=0x7fe8c413ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 0x7fe8c413ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 -- 172.21.15.57:0/645176227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009470 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c9326700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 0x7fe8c413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c3fff700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 0x7fe8c4146500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe8b0002f70 tx=0x7fe8b0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b0013e90 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b001e400 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b000b180 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8b001e760 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.614+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c40a1ab0 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.615+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe8b0025030 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.615+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4060150 con 0x7fe8c4136bf0 2024-03-18T14:44:49.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.615+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe8b004b5c0 con 0x7fe8c4136bf0 2024-03-18T14:44:49.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.618+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe8b001ffd0 con 0x7fe8c4136bf0 2024-03-18T14:44:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.769+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8c4057a60 con 0x7fe8c4136bf0 2024-03-18T14:44:49.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.769+0000 7fe8c1ffb700 1 -- 172.21.15.57:0/645176227 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fe8b001fbc0 con 0x7fe8c4136bf0 2024-03-18T14:44:49.770 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:49.771 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:49.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 >> v1:172.21.15.57:6816/39496 conn(0x7fe8a4038f50 legacy=0x7fe8a403b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 msgr2=0x7fe8c4146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:49.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 0x7fe8c4146500 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe8b0002f70 tx=0x7fe8b0014000).stop 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 shutdown_connections 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8c413eb70 0x7fe8c413ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8c4136210 0x7fe8c40a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 --2- 172.21.15.57:0/645176227 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8c4136bf0 0x7fe8c4146500 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 >> 172.21.15.57:0/645176227 conn(0x7fe8c4066a50 msgr2=0x7fe8c406a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 shutdown_connections 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:49.771+0000 7fe8cad89700 1 -- 172.21.15.57:0/645176227 wait complete. 2024-03-18T14:44:49.773 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:50.084 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:50.085 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:51.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.205+0000 7f87f9358700 1 Processor -- start 2024-03-18T14:44:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.205+0000 7f87f9358700 1 -- start start 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f9358700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f4136bf0 0x7f87f405bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f9358700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 0x7f87f4140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f9358700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f405b970 con 0x7f87f4136210 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f9358700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f405d590 con 0x7f87f4136bf0 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f9358700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4136710 con 0x7f87f413eb70 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 0x7f87f4140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f4136bf0 0x7f87f405bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f27fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f87f4136210 0x7f87f405ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43340/0 (socket says 172.21.15.57:43340) 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f27fc700 1 -- 172.21.15.57:0/1255117308 learned_addr learned my addr 172.21.15.57:0/1255117308 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f37fe700 1 -- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f4136bf0 msgr2=0x7f87f405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f37fe700 1 --2- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f4136bf0 0x7f87f405bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f37fe700 1 -- 172.21.15.57:0/1255117308 >> v1:172.21.15.57:6789/0 conn(0x7f87f4136210 legacy=0x7f87f405ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.206+0000 7f87f1ffb700 1 -- 172.21.15.57:0/1255117308 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082523893 0 0) 0x7f87f405b970 con 0x7f87f4136210 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f37fe700 1 -- 172.21.15.57:0/1255117308 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f41369d0 con 0x7f87f413eb70 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f37fe700 1 --2- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 0x7f87f4140f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f87ec0032f0 tx=0x7f87ec0091d0).ready entity=mon.2 client_cookie=2b7120e7728aa947 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f1ffb700 1 -- 172.21.15.57:0/1255117308 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87ec00b6c0 con 0x7f87f413eb70 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f1ffb700 1 -- 172.21.15.57:0/1255117308 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00b820 con 0x7f87f413eb70 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f1ffb700 1 -- 172.21.15.57:0/1255117308 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87ec00b990 con 0x7f87f413eb70 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f9358700 1 -- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 msgr2=0x7f87f4140f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.207+0000 7f87f9358700 1 --2- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 0x7f87f4140f60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f87ec0032f0 tx=0x7f87ec0091d0).stop 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 -- 172.21.15.57:0/1255117308 shutdown_connections 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 --2- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f413eb70 0x7f87f4140f60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 --2- 172.21.15.57:0/1255117308 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f4136bf0 0x7f87f405bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 -- 172.21.15.57:0/1255117308 >> 172.21.15.57:0/1255117308 conn(0x7f87f4066a50 msgr2=0x7f87f406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:51.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 -- 172.21.15.57:0/1255117308 shutdown_connections 2024-03-18T14:44:51.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.208+0000 7f87f9358700 1 -- 172.21.15.57:0/1255117308 wait complete. 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.209+0000 7f87f9358700 1 Processor -- start 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.209+0000 7f87f9358700 1 -- start start 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.209+0000 7f87f9358700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 0x7f87f413bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 0x7f87f41493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 0x7f87f41498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f41336e0 con 0x7f87f4136210 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4132100 con 0x7f87f413eb70 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40a0b40 con 0x7f87f4136bf0 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 0x7f87f413bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 0x7f87f413bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59016/0 (socket says 172.21.15.57:59016) 2024-03-18T14:44:51.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 0x7f87f41493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f2ffd700 1 -- 172.21.15.57:0/2942634185 learned_addr learned my addr 172.21.15.57:0/2942634185 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f37fe700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 0x7f87f41498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 -- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 msgr2=0x7f87f41498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 0x7f87f41498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 -- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 msgr2=0x7f87f413bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 0x7f87f413bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 -- 172.21.15.57:0/2942634185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009470 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f37fe700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 0x7f87f41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f27fc700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 0x7f87f41493b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f87e8000bc0 tx=0x7f87e80079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e800cd70 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e80070d0 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87e8007430 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40a1850 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.210+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f413b050 con 0x7f87f4136bf0 2024-03-18T14:44:51.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.211+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f87e8010070 con 0x7f87f4136bf0 2024-03-18T14:44:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.212+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f87e8049cb0 con 0x7f87f4136bf0 2024-03-18T14:44:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.212+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f4060150 con 0x7f87f4136bf0 2024-03-18T14:44:51.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.215+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f87e8018020 con 0x7f87f4136bf0 2024-03-18T14:44:51.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.369+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f4057a60 con 0x7f87f4136bf0 2024-03-18T14:44:51.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.369+0000 7f87e3fff700 1 -- 172.21.15.57:0/2942634185 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f87e8018020 con 0x7f87f4136bf0 2024-03-18T14:44:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:51.370 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 >> v1:172.21.15.57:6816/39496 conn(0x7f87d0038ec0 legacy=0x7f87d003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 msgr2=0x7f87f41493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 0x7f87f41493b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f87e8000bc0 tx=0x7f87e80079e0).stop 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 shutdown_connections 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87f413eb70 0x7f87f41498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87f4136210 0x7f87f413bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 --2- 172.21.15.57:0/2942634185 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87f4136bf0 0x7f87f41493b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 >> 172.21.15.57:0/2942634185 conn(0x7f87f4066a50 msgr2=0x7f87f40aa590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 shutdown_connections 2024-03-18T14:44:51.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:51.371+0000 7f87f9358700 1 -- 172.21.15.57:0/2942634185 wait complete. 2024-03-18T14:44:51.373 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:51.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:51.685 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:52.685 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:52.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.804+0000 7f316b0d1700 1 Processor -- start 2024-03-18T14:44:52.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.804+0000 7f316b0d1700 1 -- start start 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316b0d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316b0d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316b0d1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3164063520 con 0x7f3164063c30 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316b0d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164134310 con 0x7f316413c690 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316b0d1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3164063750 con 0x7f3164133e30 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316966e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f3168e6d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3164063c30 0x7f3164134730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43352/0 (socket says 172.21.15.57:43352) 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f316966e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:40856/0 (socket says 172.21.15.57:40856) 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f3163fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.805+0000 7f3168e6d700 1 -- 172.21.15.57:0/1253834099 learned_addr learned my addr 172.21.15.57:0/1253834099 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f31637fe700 1 -- 172.21.15.57:0/1253834099 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32066419 0 0) 0x7f3164063520 con 0x7f3164063c30 2024-03-18T14:44:52.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f31637fe700 1 -- 172.21.15.57:0/1253834099 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3148003260 con 0x7f3164063c30 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f3163fff700 1 -- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 msgr2=0x7f316413ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f3163fff700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f3163fff700 1 -- 172.21.15.57:0/1253834099 >> v1:172.21.15.57:6789/0 conn(0x7f3164063c30 legacy=0x7f3164134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f3163fff700 1 -- 172.21.15.57:0/1253834099 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164063a10 con 0x7f3164133e30 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316966e700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f3163fff700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164064010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3150002f70 tx=0x7f3150006d90).ready entity=mon.2 client_cookie=5c2a19712f31d472 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f31637fe700 1 -- 172.21.15.57:0/1253834099 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315000d4a0 con 0x7f3164133e30 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f31637fe700 1 -- 172.21.15.57:0/1253834099 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150000e90 con 0x7f3164133e30 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f31637fe700 1 -- 172.21.15.57:0/1253834099 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315000d7f0 con 0x7f3164133e30 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316b0d1700 1 -- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 msgr2=0x7f3164064010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164064010 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f3150002f70 tx=0x7f3150006d90).stop 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316b0d1700 1 -- 172.21.15.57:0/1253834099 shutdown_connections 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f316413ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.806+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1253834099 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164064010 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.807+0000 7f316b0d1700 1 -- 172.21.15.57:0/1253834099 >> 172.21.15.57:0/1253834099 conn(0x7f316406c0c0 msgr2=0x7f316406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.807+0000 7f316b0d1700 1 -- 172.21.15.57:0/1253834099 shutdown_connections 2024-03-18T14:44:52.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.807+0000 7f316b0d1700 1 -- 172.21.15.57:0/1253834099 wait complete. 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.807+0000 7f316b0d1700 1 Processor -- start 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.807+0000 7f316b0d1700 1 -- start start 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3164063c30 0x7f3164135b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f3164147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164138050 con 0x7f3164063c30 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164135330 con 0x7f316413c690 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316b0d1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31640a8920 con 0x7f3164133e30 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f3163fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:52.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f3168e6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3164063c30 0x7f3164135b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f316966e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f3164147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f3163fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59080/0 (socket says 172.21.15.57:59080) 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.808+0000 7f3163fff700 1 -- 172.21.15.57:0/1761757493 learned_addr learned my addr 172.21.15.57:0/1761757493 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 -- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 msgr2=0x7f3164147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f3164147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 -- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3164063c30 msgr2=0x7f3164135b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3164063c30 0x7f3164135b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 -- 172.21.15.57:0/1761757493 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009470 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3163fff700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31641354c0 tx=0x7f3150014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315001c5f0 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315001c750 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315000b120 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f315001cab0 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.809+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316413ad80 con 0x7f3164133e30 2024-03-18T14:44:52.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.810+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f315000f070 con 0x7f3164133e30 2024-03-18T14:44:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.810+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f315004ba00 con 0x7f3164133e30 2024-03-18T14:44:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.810+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31641381c0 con 0x7f3164133e30 2024-03-18T14:44:52.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.813+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f31500123b0 con 0x7f3164133e30 2024-03-18T14:44:52.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.964+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f316405c980 con 0x7f3164133e30 2024-03-18T14:44:52.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.964+0000 7f3161ffb700 1 -- 172.21.15.57:0/1761757493 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f3150035090 con 0x7f3164133e30 2024-03-18T14:44:52.965 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:52.965 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 >> v1:172.21.15.57:6816/39496 conn(0x7f3144038dd0 legacy=0x7f314403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 msgr2=0x7f3164146c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f31641354c0 tx=0x7f3150014000).stop 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 shutdown_connections 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f316413c690 0x7f3164147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3164063c30 0x7f3164135b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 --2- 172.21.15.57:0/1761757493 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3164133e30 0x7f3164146c50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:52.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 >> 172.21.15.57:0/1761757493 conn(0x7f316406c0c0 msgr2=0x7f3164062720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:52.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 shutdown_connections 2024-03-18T14:44:52.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:52.966+0000 7f316b0d1700 1 -- 172.21.15.57:0/1761757493 wait complete. 2024-03-18T14:44:52.968 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:53.280 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:53.280 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:54.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.401+0000 7f52dcd11700 1 Processor -- start 2024-03-18T14:44:54.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.401+0000 7f52dcd11700 1 -- start start 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 0x7f52d8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80650c0 0x7f52d80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80649c0 con 0x7f52d80650c0 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8063a70 con 0x7f52d8137860 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52dcd11700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8064bc0 con 0x7f52d8063590 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d6d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80650c0 0x7f52d80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 0x7f52d8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d6d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:41208/0 (socket says 172.21.15.57:41208) 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d5d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f52d80650c0 0x7f52d80630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57996/0 (socket says 172.21.15.57:57996) 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.402+0000 7f52d6d9d700 1 -- 172.21.15.57:0/215001761 learned_addr learned my addr 172.21.15.57:0/215001761 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:54.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 -- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 msgr2=0x7f52d80a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 -- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 msgr2=0x7f52d8137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 0x7f52d8137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 -- 172.21.15.57:0/215001761 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80ab0d0 con 0x7f52d80650c0 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d6d9d700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d659c700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 0x7f52d8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d5d9b700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80650c0 0x7f52d80630a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f52c8002f70 tx=0x7f52c8006df0).ready entity=mon.0 client_cookie=3edd4da36ab3df8b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d559a700 1 -- 172.21.15.57:0/215001761 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c800d4a0 con 0x7f52d80650c0 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d559a700 1 -- 172.21.15.57:0/215001761 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8000e90 con 0x7f52d80650c0 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.403+0000 7f52d559a700 1 -- 172.21.15.57:0/215001761 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c800d7f0 con 0x7f52d80650c0 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 -- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80650c0 msgr2=0x7f52d80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80650c0 0x7f52d80630a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f52c8002f70 tx=0x7f52c8006df0).stop 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 -- 172.21.15.57:0/215001761 shutdown_connections 2024-03-18T14:44:54.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8063590 0x7f52d80a92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d8137860 0x7f52d8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 --2- 172.21.15.57:0/215001761 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d80650c0 0x7f52d80630a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 -- 172.21.15.57:0/215001761 >> 172.21.15.57:0/215001761 conn(0x7f52d805c300 msgr2=0x7f52d806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:54.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 -- 172.21.15.57:0/215001761 shutdown_connections 2024-03-18T14:44:54.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.404+0000 7f52dcd11700 1 -- 172.21.15.57:0/215001761 wait complete. 2024-03-18T14:44:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 Processor -- start 2024-03-18T14:44:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 -- start start 2024-03-18T14:44:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d80650c0 0x7f52d8092520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 0x7f52d8092a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8092f00 con 0x7f52d8063590 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80968a0 con 0x7f52d80650c0 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52dcd11700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8094990 con 0x7f52d8137860 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52d659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52d659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58004/0 (socket says 172.21.15.57:58004) 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52d659c700 1 -- 172.21.15.57:0/2442331451 learned_addr learned my addr 172.21.15.57:0/2442331451 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.405+0000 7f52d6d9d700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 0x7f52d8092a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d5d9b700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d80650c0 0x7f52d8092520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 -- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 msgr2=0x7f52d8092a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 0x7f52d8092a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 -- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d80650c0 msgr2=0x7f52d8092520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d80650c0 0x7f52d8092520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 -- 172.21.15.57:0/2442331451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d0009530 con 0x7f52d8063590 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d6d9d700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 0x7f52d8092a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:54.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52d659c700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f52d80939d0 tx=0x7f52c0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c0010590 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00106f0 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c000b180 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c0010a50 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.406+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c800b180 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.407+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f52c0010bb0 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.407+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d8096a30 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.407+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f52c004add0 con 0x7f52d8063590 2024-03-18T14:44:54.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.410+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f52d8096a30 con 0x7f52d8063590 2024-03-18T14:44:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.559+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52d8096a30 con 0x7f52d8063590 2024-03-18T14:44:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.559+0000 7f52cf7fe700 1 -- 172.21.15.57:0/2442331451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f52d8096a30 con 0x7f52d8063590 2024-03-18T14:44:54.560 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:54.560 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 >> v1:172.21.15.57:6816/39496 conn(0x7f52bc038da0 legacy=0x7f52bc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 msgr2=0x7f52d8092030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f52d80939d0 tx=0x7f52c0006df0).stop 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 shutdown_connections 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f52d8137860 0x7f52d8092a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f52d8063590 0x7f52d8092030 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 --2- 172.21.15.57:0/2442331451 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f52d80650c0 0x7f52d8092520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:54.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 >> 172.21.15.57:0/2442331451 conn(0x7f52d805c300 msgr2=0x7f52d80aa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 shutdown_connections 2024-03-18T14:44:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:54.561+0000 7f52dcd11700 1 -- 172.21.15.57:0/2442331451 wait complete. 2024-03-18T14:44:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:54.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:54.874 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:55.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:55.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 Processor -- start 2024-03-18T14:44:55.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 -- start start 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a98136bf0 0x7f6a9805bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a9805ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9805b970 con 0x7f6a98136bf0 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a98136710 con 0x7f6a98136210 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.995+0000 7f6a9d68b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981369d0 con 0x7f6a9805d370 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a98136bf0 0x7f6a9805bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a967fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a9805ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:55.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6a98136bf0 0x7f6a9805bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58006/0 (socket says 172.21.15.57:58006) 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:41230/0 (socket says 172.21.15.57:41230) 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 -- 172.21.15.57:0/3566369931 learned_addr learned my addr 172.21.15.57:0/3566369931 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a967fc700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a9805ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56300/0 (socket says 172.21.15.57:56300) 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 -- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 msgr2=0x7f6a981397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 -- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 msgr2=0x7f6a9805ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a9805ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 -- 172.21.15.57:0/3566369931 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98136fd0 con 0x7f6a98136bf0 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a977fe700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a96ffd700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a98136bf0 0x7f6a9805bde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88006eb0).ready entity=mon.0 client_cookie=3090b61197004aac server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a95ffb700 1 -- 172.21.15.57:0/3566369931 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8800d570 con 0x7f6a98136bf0 2024-03-18T14:44:55.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a95ffb700 1 -- 172.21.15.57:0/3566369931 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88000e90 con 0x7f6a98136bf0 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.996+0000 7f6a95ffb700 1 -- 172.21.15.57:0/3566369931 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a8800d900 con 0x7f6a98136bf0 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a98136bf0 msgr2=0x7f6a9805bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a98136bf0 0x7f6a9805bde0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f6a88002f70 tx=0x7f6a88006eb0).stop 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3566369931 shutdown_connections 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a9805d370 0x7f6a981397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a98136bf0 0x7f6a9805bde0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3566369931 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a9805ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3566369931 >> 172.21.15.57:0/3566369931 conn(0x7f6a98066a50 msgr2=0x7f6a9806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3566369931 shutdown_connections 2024-03-18T14:44:56.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.997+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3566369931 wait complete. 2024-03-18T14:44:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 Processor -- start 2024-03-18T14:44:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 -- start start 2024-03-18T14:44:56.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 0x7f6a98146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980a3fc0 con 0x7f6a9805d370 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980a4280 con 0x7f6a98136210 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.998+0000 7f6a9d68b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980a34a0 con 0x7f6a98136bf0 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a967fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 0x7f6a98146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a96ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58010/0 (socket says 172.21.15.57:58010) 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a96ffd700 1 -- 172.21.15.57:0/3629780509 learned_addr learned my addr 172.21.15.57:0/3629780509 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a967fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56306/0 (socket says 172.21.15.57:56306) 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 -- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 msgr2=0x7f6a98145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 -- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 msgr2=0x7f6a980a3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 -- 172.21.15.57:0/3629780509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a90009470 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a967fc700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a96ffd700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a977fe700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 0x7f6a98146440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6a9000c000 tx=0x7f6a900091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000c850 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9000c9b0 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8800b1e0 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6a9000cd10 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:55.999+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a980a30b0 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.000+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6a90022070 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.001+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6a9004afe0 con 0x7f6a98136bf0 2024-03-18T14:44:56.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.001+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a980a67f0 con 0x7f6a98136bf0 2024-03-18T14:44:56.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.004+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6a90016070 con 0x7f6a98136bf0 2024-03-18T14:44:56.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.155+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a98060150 con 0x7f6a98136bf0 2024-03-18T14:44:56.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.156+0000 7f6a87fff700 1 -- 172.21.15.57:0/3629780509 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f6a90016020 con 0x7f6a98136bf0 2024-03-18T14:44:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:56.157 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 >> v1:172.21.15.57:6816/39496 conn(0x7f6a74038e30 legacy=0x7f6a7403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 msgr2=0x7f6a98146440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:56.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 0x7f6a98146440 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f6a9000c000 tx=0x7f6a900091d0).stop 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 shutdown_connections 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6a98136bf0 0x7f6a98146440 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6a9805d370 0x7f6a980a3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 --2- 172.21.15.57:0/3629780509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6a98136210 0x7f6a98145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 >> 172.21.15.57:0/3629780509 conn(0x7f6a98066a50 msgr2=0x7f6a980a9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 shutdown_connections 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:56.157+0000 7f6a9d68b700 1 -- 172.21.15.57:0/3629780509 wait complete. 2024-03-18T14:44:56.159 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:56.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:56.471 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:57.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:57.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 Processor -- start 2024-03-18T14:44:57.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 -- start start 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 0x7fd7e8137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 0x7fd7e80630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e8063a70 con 0x7fd7e8063590 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80649c0 con 0x7fd7e8137860 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7edc4f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8064bc0 con 0x7fd7e80650c0 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7e77fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 0x7fd7e8137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7e7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd7e8063590 0x7fd7e80a92a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45492/0 (socket says 172.21.15.57:45492) 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7e6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 0x7fd7e80630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.594+0000 7fd7e7fff700 1 -- 172.21.15.57:0/3922935041 learned_addr learned my addr 172.21.15.57:0/3922935041 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e6ffd700 1 -- 172.21.15.57:0/3922935041 >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 msgr2=0x7fd7e8137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:57.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e6ffd700 1 --2- 172.21.15.57:0/3922935041 >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 0x7fd7e8137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e6ffd700 1 -- 172.21.15.57:0/3922935041 >> v1:172.21.15.57:6789/0 conn(0x7fd7e8063590 legacy=0x7fd7e80a92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e6ffd700 1 -- 172.21.15.57:0/3922935041 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80ab0d0 con 0x7fd7e80650c0 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e77fe700 1 --2- 172.21.15.57:0/3922935041 >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 0x7fd7e8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e6ffd700 1 --2- 172.21.15.57:0/3922935041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 0x7fd7e80630a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd7dc002f70 tx=0x7fd7dc006e80).ready entity=mon.1 client_cookie=cf39b9a7f0b4079d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e67fc700 1 -- 172.21.15.57:0/3922935041 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc012070 con 0x7fd7e80650c0 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e67fc700 1 -- 172.21.15.57:0/3922935041 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc000e90 con 0x7fd7e80650c0 2024-03-18T14:44:57.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.595+0000 7fd7e67fc700 1 -- 172.21.15.57:0/3922935041 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc00f7f0 con 0x7fd7e80650c0 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3922935041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 msgr2=0x7fd7e80630a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3922935041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 0x7fd7e80630a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fd7dc002f70 tx=0x7fd7dc006e80).stop 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3922935041 shutdown_connections 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3922935041 >> v2:172.21.15.57:3300/0 conn(0x7fd7e8137860 0x7fd7e8137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3922935041 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e80650c0 0x7fd7e80630a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3922935041 >> 172.21.15.57:0/3922935041 conn(0x7fd7e805c300 msgr2=0x7fd7e806c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3922935041 shutdown_connections 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.596+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3922935041 wait complete. 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 Processor -- start 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 -- start start 2024-03-18T14:44:57.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 0x7fd7e812ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 0x7fd7e812f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8133da0 con 0x7fd7e80650c0 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8134040 con 0x7fd7e8063590 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7edc4f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e8092030 con 0x7fd7e8137860 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56324/0 (socket says 172.21.15.57:56324) 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 -- 172.21.15.57:0/3254094287 learned_addr learned my addr 172.21.15.57:0/3254094287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.597+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 0x7fd7e812f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e6ffd700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 0x7fd7e812ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 -- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 msgr2=0x7fd7e812f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 0x7fd7e812f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 -- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 msgr2=0x7fd7e812ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 0x7fd7e812ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 -- 172.21.15.57:0/3254094287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d800b180 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e6ffd700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 0x7fd7e812ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e7fff700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 0x7fd7e812f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e77fe700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd7d800c000 tx=0x7fd7d8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7d8010590 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80106f0 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7dc00d590 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7d8010a50 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.598+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e80a9f50 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.599+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd7d8010bb0 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.599+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e80654c0 con 0x7fd7e8063590 2024-03-18T14:44:57.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.599+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd7d804ae50 con 0x7fd7e8063590 2024-03-18T14:44:57.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.602+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd7d80336e0 con 0x7fd7e8063590 2024-03-18T14:44:57.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.751+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7e8057a60 con 0x7fd7e8063590 2024-03-18T14:44:57.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.751+0000 7fd7e4ff9700 1 -- 172.21.15.57:0/3254094287 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fd7d80332d0 con 0x7fd7e8063590 2024-03-18T14:44:57.753 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:57.753 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:57.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.752+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 >> v1:172.21.15.57:6816/39496 conn(0x7fd7c8038da0 legacy=0x7fd7c803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.752+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 msgr2=0x7fd7e8093760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.752+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fd7d800c000 tx=0x7fd7d8006df0).stop 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 shutdown_connections 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd7e8137860 0x7fd7e812f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd7e8063590 0x7fd7e8093760 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 --2- 172.21.15.57:0/3254094287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd7e80650c0 0x7fd7e812ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 >> 172.21.15.57:0/3254094287 conn(0x7fd7e805c300 msgr2=0x7fd7e81365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 shutdown_connections 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:57.753+0000 7fd7edc4f700 1 -- 172.21.15.57:0/3254094287 wait complete. 2024-03-18T14:44:57.755 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:58.067 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:58.067 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:44:59.068 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:44:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.186+0000 7f785a6ff700 1 Processor -- start 2024-03-18T14:44:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.186+0000 7f785a6ff700 1 -- start start 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f785a6ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7854137c40 0x7f78540650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f785a6ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 0x7f785413e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f785a6ff700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7854063a70 con 0x7f7854137860 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f785a6ff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78540649c0 con 0x7f7854137c40 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f785a6ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540655b0 con 0x7f785413c420 2024-03-18T14:44:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7854137c40 0x7f78540650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f7853fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7854137860 0x7f78540630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45498/0 (socket says 172.21.15.57:45498) 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f7853fff700 1 -- 172.21.15.57:0/786524823 learned_addr learned my addr 172.21.15.57:0/786524823 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f7858c9c700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 0x7f785413e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 -- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 msgr2=0x7f785413e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 0x7f785413e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 -- 172.21.15.57:0/786524823 >> v1:172.21.15.57:6789/0 conn(0x7f7854137860 legacy=0x7f78540630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 -- 172.21.15.57:0/786524823 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854064bc0 con 0x7f7854137c40 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f7852ffd700 1 -- 172.21.15.57:0/786524823 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629053450 0 0) 0x7f7854063a70 con 0x7f7854137860 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f7858c9c700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 0x7f785413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.187+0000 7f78537fe700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7854137c40 0x7f78540650c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7848002f70 tx=0x7f7848006df0).ready entity=mon.0 client_cookie=f2ec95e8c91d5bab server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f7852ffd700 1 -- 172.21.15.57:0/786524823 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784800d570 con 0x7f7854137c40 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f7852ffd700 1 -- 172.21.15.57:0/786524823 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7848000e90 con 0x7f7854137c40 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f7852ffd700 1 -- 172.21.15.57:0/786524823 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f784800d8c0 con 0x7f7854137c40 2024-03-18T14:44:59.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 -- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7854137c40 msgr2=0x7f78540650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7854137c40 0x7f78540650c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f7848002f70 tx=0x7f7848006df0).stop 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 -- 172.21.15.57:0/786524823 shutdown_connections 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f785413c420 0x7f785413e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 --2- 172.21.15.57:0/786524823 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7854137c40 0x7f78540650c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 -- 172.21.15.57:0/786524823 >> 172.21.15.57:0/786524823 conn(0x7f785405c300 msgr2=0x7f785406c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 -- 172.21.15.57:0/786524823 shutdown_connections 2024-03-18T14:44:59.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.188+0000 7f785a6ff700 1 -- 172.21.15.57:0/786524823 wait complete. 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.189+0000 7f785a6ff700 1 Processor -- start 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.189+0000 7f785a6ff700 1 -- start start 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7854137c40 0x7f7854143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785413b280 con 0x7f785413c420 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854139a40 con 0x7f7854137860 2024-03-18T14:44:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f785a6ff700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7854139d90 con 0x7f7854137c40 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7858c9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7858c9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58042/0 (socket says 172.21.15.57:58042) 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7858c9c700 1 -- 172.21.15.57:0/1639978608 learned_addr learned my addr 172.21.15.57:0/1639978608 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56344/0 (socket says 172.21.15.57:56344) 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f78537fe700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7854137c40 0x7f7854143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 -- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7854137c40 msgr2=0x7f7854143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7854137c40 0x7f7854143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 -- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 msgr2=0x7f7854143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7853fff700 1 -- 172.21.15.57:0/1639978608 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c009470 con 0x7f7854137860 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.190+0000 7f7858c9c700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f7853fff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7844000bc0 tx=0x7f7844007a70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7844013070 con 0x7f7854137860 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78440072c0 con 0x7f7854137860 2024-03-18T14:44:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784800b180 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7844005610 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.191+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7854067080 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.192+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7844020070 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.192+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854067300 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.192+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f784404df50 con 0x7f7854137860 2024-03-18T14:44:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.195+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7844032e50 con 0x7f7854137860 2024-03-18T14:44:59.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.343+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7854057a60 con 0x7f7854137860 2024-03-18T14:44:59.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.343+0000 7f78517fa700 1 -- 172.21.15.57:0/1639978608 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7844036470 con 0x7f7854137860 2024-03-18T14:44:59.346 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:44:59.346 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 >> v1:172.21.15.57:6816/39496 conn(0x7f7834038dd0 legacy=0x7f783403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 msgr2=0x7f785413a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f7844000bc0 tx=0x7f7844007a70).stop 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 shutdown_connections 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f785413c420 0x7f7854143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7854137860 0x7f785413a8b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 --2- 172.21.15.57:0/1639978608 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7854137c40 0x7f7854143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:44:59.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 >> 172.21.15.57:0/1639978608 conn(0x7f785405c300 msgr2=0x7f78541365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:44:59.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 shutdown_connections 2024-03-18T14:44:59.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:44:59.345+0000 7f785a6ff700 1 -- 172.21.15.57:0/1639978608 wait complete. 2024-03-18T14:44:59.348 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:44:59.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:44:59.659 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:00.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 Processor -- start 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 -- start start 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 0x7fb6b0134730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b0134310 con 0x7fb6b0133e30 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0063520 con 0x7fb6b0137360 2024-03-18T14:45:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b6434700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b0063750 con 0x7fb6b0063c30 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6af7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b49d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6affff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 0x7fb6b0134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b49d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56358/0 (socket says 172.21.15.57:56358) 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6b49d1700 1 -- 172.21.15.57:0/2431561809 learned_addr learned my addr 172.21.15.57:0/2431561809 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.778+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/2431561809 >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58054/0 (socket says 172.21.15.57:58054) 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 -- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 msgr2=0x7fb6b0134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 0x7fb6b0134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 -- 172.21.15.57:0/2431561809 >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 msgr2=0x7fb6b0064010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 --2- 172.21.15.57:0/2431561809 >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 -- 172.21.15.57:0/2431561809 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b0063a10 con 0x7fb6b0137360 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/2431561809 >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6affff700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 0x7fb6b0134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6b49d1700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb6a80032f0 tx=0x7fb6a8009290).ready entity=mon.1 client_cookie=24ed50ed9d039654 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6aeffd700 1 -- 172.21.15.57:0/2431561809 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a800b6c0 con 0x7fb6b0137360 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6aeffd700 1 -- 172.21.15.57:0/2431561809 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a800b820 con 0x7fb6b0137360 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.779+0000 7fb6aeffd700 1 -- 172.21.15.57:0/2431561809 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6a800b990 con 0x7fb6b0137360 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 -- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 msgr2=0x7fb6b0137810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb6a80032f0 tx=0x7fb6a8009290).stop 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 -- 172.21.15.57:0/2431561809 shutdown_connections 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0137360 0x7fb6b0137810 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 --2- 172.21.15.57:0/2431561809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0063c30 0x7fb6b0134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 --2- 172.21.15.57:0/2431561809 >> v2:172.21.15.57:3300/0 conn(0x7fb6b0133e30 0x7fb6b0064010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 -- 172.21.15.57:0/2431561809 >> 172.21.15.57:0/2431561809 conn(0x7fb6b006c0c0 msgr2=0x7fb6b006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 -- 172.21.15.57:0/2431561809 shutdown_connections 2024-03-18T14:45:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.780+0000 7fb6b6434700 1 -- 172.21.15.57:0/2431561809 wait complete. 2024-03-18T14:45:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.781+0000 7fb6b6434700 1 Processor -- start 2024-03-18T14:45:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.781+0000 7fb6b6434700 1 -- start start 2024-03-18T14:45:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.781+0000 7fb6b6434700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 0x7fb6b01491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b013d2a0 con 0x7fb6b0063c30 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b013a2e0 con 0x7fb6b0133e30 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00a9f70 con 0x7fb6b0137360 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6affff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b49d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 0x7fb6b01491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6affff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58064/0 (socket says 172.21.15.57:58064) 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6affff700 1 -- 172.21.15.57:0/1273352388 learned_addr learned my addr 172.21.15.57:0/1273352388 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56360/0 (socket says 172.21.15.57:56360) 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 -- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 msgr2=0x7fb6b01491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 0x7fb6b01491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 -- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 msgr2=0x7fb6b0138870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 -- 172.21.15.57:0/1273352388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a000b180 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6affff700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b49d1700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 0x7fb6b01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6af7fe700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb6b013aa10 tx=0x7fb698008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6980127f0 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698012950 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69800b120 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb698012cb0 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.782+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a8009530 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.783+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb69801b460 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.783+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b013d3e0 con 0x7fb6b0133e30 2024-03-18T14:45:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.784+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb69804a720 con 0x7fb6b0133e30 2024-03-18T14:45:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.787+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb69802f620 con 0x7fb6b0133e30 2024-03-18T14:45:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.934+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6b005c980 con 0x7fb6b0133e30 2024-03-18T14:45:00.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.935+0000 7fb6ad7fa700 1 -- 172.21.15.57:0/1273352388 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fb698032c40 con 0x7fb6b0133e30 2024-03-18T14:45:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:00.937 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 >> v1:172.21.15.57:6816/39496 conn(0x7fb694038da0 legacy=0x7fb69403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:00.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 msgr2=0x7fb6b0148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb6b013aa10 tx=0x7fb698008040).stop 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 shutdown_connections 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb6b0137360 0x7fb6b01491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6b0063c30 0x7fb6b0138870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 --2- 172.21.15.57:0/1273352388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb6b0133e30 0x7fb6b0148cc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 >> 172.21.15.57:0/1273352388 conn(0x7fb6b006c0c0 msgr2=0x7fb6b0137770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 shutdown_connections 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:00.936+0000 7fb6b6434700 1 -- 172.21.15.57:0/1273352388 wait complete. 2024-03-18T14:45:00.939 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:01.251 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:01.251 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:02.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:02.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 Processor -- start 2024-03-18T14:45:02.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 -- start start 2024-03-18T14:45:02.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 0x7f85cc137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85cc063590 0x7f85cc0a92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85cc0649c0 con 0x7f85cc063590 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc063a70 con 0x7f85cc0650c0 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d248e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc064bc0 con 0x7f85cc137860 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85cbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 0x7f85cc137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56374/0 (socket says 172.21.15.57:56374) 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85d0a2b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f85cc063590 0x7f85cc0a92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.371+0000 7f85cb7fe700 1 -- 172.21.15.57:0/1659794432 learned_addr learned my addr 172.21.15.57:0/1659794432 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 -- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 msgr2=0x7f85cc137c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 0x7f85cc137c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 -- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 msgr2=0x7f85cc0630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:02.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 -- 172.21.15.57:0/1659794432 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85cc0ab0d0 con 0x7f85cc063590 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85cb7fe700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85cbfff700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 0x7f85cc137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85d0a2b700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc063590 0x7f85cc0a92a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f85c40032f0 tx=0x7f85c400d670).ready entity=mon.0 client_cookie=bf70b7940488dffd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85caffd700 1 -- 172.21.15.57:0/1659794432 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c4012070 con 0x7f85cc063590 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85caffd700 1 -- 172.21.15.57:0/1659794432 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c400fad0 con 0x7f85cc063590 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.372+0000 7f85caffd700 1 -- 172.21.15.57:0/1659794432 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c400fe30 con 0x7f85cc063590 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 -- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc063590 msgr2=0x7f85cc0a92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc063590 0x7f85cc0a92a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f85c40032f0 tx=0x7f85c400d670).stop 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 -- 172.21.15.57:0/1659794432 shutdown_connections 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc063590 0x7f85cc0a92a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc137860 0x7f85cc137c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 --2- 172.21.15.57:0/1659794432 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc0630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 -- 172.21.15.57:0/1659794432 >> 172.21.15.57:0/1659794432 conn(0x7f85cc05c300 msgr2=0x7f85cc06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 -- 172.21.15.57:0/1659794432 shutdown_connections 2024-03-18T14:45:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.373+0000 7f85d248e700 1 -- 172.21.15.57:0/1659794432 wait complete. 2024-03-18T14:45:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 Processor -- start 2024-03-18T14:45:02.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 -- start start 2024-03-18T14:45:02.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 0x7f85cc092030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc093550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 0x7f85cc133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc092cc0 con 0x7f85cc137860 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc131520 con 0x7f85cc0650c0 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d248e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85cc1317e0 con 0x7f85cc063590 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc093550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85cbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 0x7f85cc092030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85cb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc093550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56378/0 (socket says 172.21.15.57:56378) 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cb7fe700 1 -- 172.21.15.57:0/600532880 learned_addr learned my addr 172.21.15.57:0/600532880 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.374+0000 7f85d0a2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 0x7f85cc133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 -- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 msgr2=0x7f85cc093550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc093550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 -- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 msgr2=0x7f85cc133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 0x7f85cc133990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 -- 172.21.15.57:0/600532880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc00b1e0 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85d0a2b700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 0x7f85cc133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85cbfff700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 0x7f85cc092030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f85c000c000 tx=0x7f85c0006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c0010780 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c00108e0 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85c0010c40 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c000b180 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.375+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c400d910 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.376+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f85c001c460 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.376+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85cc0931c0 con 0x7f85cc063590 2024-03-18T14:45:02.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.376+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f85c004ac60 con 0x7f85cc063590 2024-03-18T14:45:02.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.379+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f85c0050020 con 0x7f85cc063590 2024-03-18T14:45:02.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.528+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85cc0654c0 con 0x7f85cc063590 2024-03-18T14:45:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.528+0000 7f85c97fa700 1 -- 172.21.15.57:0/600532880 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f85c0033590 con 0x7f85cc063590 2024-03-18T14:45:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:02.530 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 >> v1:172.21.15.57:6816/39496 conn(0x7f85ac038da0 legacy=0x7f85ac03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 msgr2=0x7f85cc092030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 0x7f85cc092030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f85c000c000 tx=0x7f85c0006df0).stop 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 shutdown_connections 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f85cc137860 0x7f85cc133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f85cc063590 0x7f85cc092030 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 --2- 172.21.15.57:0/600532880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f85cc0650c0 0x7f85cc093550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 >> 172.21.15.57:0/600532880 conn(0x7f85cc05c300 msgr2=0x7f85cc1365d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 shutdown_connections 2024-03-18T14:45:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:02.530+0000 7f85d248e700 1 -- 172.21.15.57:0/600532880 wait complete. 2024-03-18T14:45:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:02.845 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:02.845 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:03.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:03.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.964+0000 7ff62c120700 1 Processor -- start 2024-03-18T14:45:03.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.964+0000 7ff62c120700 1 -- start start 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62c120700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62c120700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff62409adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62c120700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62409bc50 con 0x7ff62409aa10 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62c120700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6241365f0 con 0x7ff624064700 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62c120700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff62409b2e0 con 0x7ff624136140 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff6296bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff62409adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:03.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff6296bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41454/0 (socket says 172.21.15.57:41454) 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff629ebc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff62409aa10 0x7ff624132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37216/0 (socket says 172.21.15.57:37216) 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff6296bb700 1 -- 172.21.15.57:0/3110288210 learned_addr learned my addr 172.21.15.57:0/3110288210 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 -- 172.21.15.57:0/3110288210 >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 msgr2=0x7ff6240621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 --2- 172.21.15.57:0/3110288210 >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 -- 172.21.15.57:0/3110288210 >> v1:172.21.15.57:6789/0 conn(0x7ff62409aa10 legacy=0x7ff624132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff628eba700 1 -- 172.21.15.57:0/3110288210 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018085592 0 0) 0x7ff62409bc50 con 0x7ff62409aa10 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 -- 172.21.15.57:0/3110288210 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6241367e0 con 0x7ff624136140 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff6296bb700 1 --2- 172.21.15.57:0/3110288210 >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.965+0000 7ff62a6bd700 1 --2- 172.21.15.57:0/3110288210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff62409adf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff61c0032f0 tx=0x7ff61c00b470).ready entity=mon.2 client_cookie=1021817e4ef37c44 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff628eba700 1 -- 172.21.15.57:0/3110288210 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c00dd70 con 0x7ff624136140 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff628eba700 1 -- 172.21.15.57:0/3110288210 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c010470 con 0x7ff624136140 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff628eba700 1 -- 172.21.15.57:0/3110288210 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c0107d0 con 0x7ff624136140 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 -- 172.21.15.57:0/3110288210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 msgr2=0x7ff62409adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:03.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 --2- 172.21.15.57:0/3110288210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff62409adf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7ff61c0032f0 tx=0x7ff61c00b470).stop 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 -- 172.21.15.57:0/3110288210 shutdown_connections 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 --2- 172.21.15.57:0/3110288210 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff62409adf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 --2- 172.21.15.57:0/3110288210 >> v2:172.21.15.57:3300/0 conn(0x7ff624064700 0x7ff6240621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 -- 172.21.15.57:0/3110288210 >> 172.21.15.57:0/3110288210 conn(0x7ff62406c0c0 msgr2=0x7ff62406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 -- 172.21.15.57:0/3110288210 shutdown_connections 2024-03-18T14:45:03.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.966+0000 7ff62c120700 1 -- 172.21.15.57:0/3110288210 wait complete. 2024-03-18T14:45:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.967+0000 7ff62c120700 1 Processor -- start 2024-03-18T14:45:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.967+0000 7ff62c120700 1 -- start start 2024-03-18T14:45:03.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 0x7ff624096800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff624096cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff624098c00 con 0x7ff624064700 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62409e5b0 con 0x7ff62409aa10 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62c120700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff624098e40 con 0x7ff624136140 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62a6bd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff624096cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41462/0 (socket says 172.21.15.57:41462) 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff6296bb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 0x7ff624096800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 -- 172.21.15.57:0/3655840382 learned_addr learned my addr 172.21.15.57:0/3655840382 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 -- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 msgr2=0x7ff624096cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff624096cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 -- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 msgr2=0x7ff624096800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:03.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 0x7ff624096800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 -- 172.21.15.57:0/3655840382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61400b1e0 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff62a6bd700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff624096cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff6296bb700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 0x7ff624096800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff629ebc700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff620000bc0 tx=0x7ff620007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.968+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6200070d0 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.969+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620007230 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.969+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c00b710 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.969+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff620005740 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.969+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62409d300 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.970+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff62001a060 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.970+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff620049c80 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.970+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62409d160 con 0x7ff624064700 2024-03-18T14:45:03.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:03.973+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff62409d160 con 0x7ff624064700 2024-03-18T14:45:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.122+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff62409d160 con 0x7ff624064700 2024-03-18T14:45:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.123+0000 7ff612ffd700 1 -- 172.21.15.57:0/3655840382 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7ff62409d160 con 0x7ff624064700 2024-03-18T14:45:04.125 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:04.125 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:04.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 >> v1:172.21.15.57:6816/39496 conn(0x7ff604038da0 legacy=0x7ff60403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 msgr2=0x7ff624098710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ff620000bc0 tx=0x7ff620007a60).stop 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 shutdown_connections 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff624136140 0x7ff624096cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff624064700 0x7ff624098710 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 --2- 172.21.15.57:0/3655840382 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff62409aa10 0x7ff624096800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 >> 172.21.15.57:0/3655840382 conn(0x7ff62406c0c0 msgr2=0x7ff624135180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 shutdown_connections 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:04.124+0000 7ff62c120700 1 -- 172.21.15.57:0/3655840382 wait complete. 2024-03-18T14:45:04.127 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:04.438 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:04.438 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:05.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.561+0000 7f0a749bf700 1 Processor -- start 2024-03-18T14:45:05.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.561+0000 7f0a749bf700 1 -- start start 2024-03-18T14:45:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a749bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70137c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:05.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a749bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 0x7f0a7013e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a749bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a70063a70 con 0x7f0a700650c0 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a749bf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a700649c0 con 0x7f0a7013c420 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a749bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70064bc0 con 0x7f0a70137860 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6ed9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 0x7f0a7013e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6e59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70137c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6dd9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0a700650c0 0x7f0a700630a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37220/0 (socket says 172.21.15.57:37220) 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6dd9b700 1 -- 172.21.15.57:0/3798068999 learned_addr learned my addr 172.21.15.57:0/3798068999 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6e59c700 1 -- 172.21.15.57:0/3798068999 >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 msgr2=0x7f0a7013e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6e59c700 1 --2- 172.21.15.57:0/3798068999 >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 0x7f0a7013e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6e59c700 1 -- 172.21.15.57:0/3798068999 >> v1:172.21.15.57:6789/0 conn(0x7f0a700650c0 legacy=0x7f0a700630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6e59c700 1 -- 172.21.15.57:0/3798068999 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700ab0d0 con 0x7f0a70137860 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.562+0000 7f0a6ed9d700 1 --2- 172.21.15.57:0/3798068999 >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 0x7f0a7013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a6e59c700 1 --2- 172.21.15.57:0/3798068999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70137c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0a64002f70 tx=0x7f0a64006df0).ready entity=mon.2 client_cookie=1bcd8cdd38806eb3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a6d59a700 1 -- 172.21.15.57:0/3798068999 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a6400d570 con 0x7f0a70137860 2024-03-18T14:45:05.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a6d59a700 1 -- 172.21.15.57:0/3798068999 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a64000e90 con 0x7f0a70137860 2024-03-18T14:45:05.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a6d59a700 1 -- 172.21.15.57:0/3798068999 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a6400d8c0 con 0x7f0a70137860 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 -- 172.21.15.57:0/3798068999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 msgr2=0x7f0a70137c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3798068999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70137c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f0a64002f70 tx=0x7f0a64006df0).stop 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 -- 172.21.15.57:0/3798068999 shutdown_connections 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3798068999 >> v2:172.21.15.57:3300/0 conn(0x7f0a7013c420 0x7f0a7013e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3798068999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70137c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 -- 172.21.15.57:0/3798068999 >> 172.21.15.57:0/3798068999 conn(0x7f0a7005c300 msgr2=0x7f0a7006c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 -- 172.21.15.57:0/3798068999 shutdown_connections 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.563+0000 7f0a749bf700 1 -- 172.21.15.57:0/3798068999 wait complete. 2024-03-18T14:45:05.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.564+0000 7f0a749bf700 1 Processor -- start 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.564+0000 7f0a749bf700 1 -- start start 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a700650c0 0x7f0a70139110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a7013c420 0x7f0a7005fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70099fc0 con 0x7f0a7013c420 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a701349e0 con 0x7f0a700650c0 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a749bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a70138770 con 0x7f0a70137860 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6ed9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a7013c420 0x7f0a7005fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:47302/0 (socket says 172.21.15.57:47302) 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 -- 172.21.15.57:0/3524232129 learned_addr learned my addr 172.21.15.57:0/3524232129 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6e59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a700650c0 0x7f0a70139110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 -- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a700650c0 msgr2=0x7f0a70139110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a700650c0 0x7f0a70139110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 -- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a7013c420 msgr2=0x7f0a7005fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a7013c420 0x7f0a7005fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 -- 172.21.15.57:0/3524232129 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a68009470 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.565+0000 7f0a6dd9b700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0a7009a100 tx=0x7f0a60007c10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a600070d0 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a60007230 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6400b180 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a60005610 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a701347b0 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.566+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0a60010070 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.567+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0a60049dd0 con 0x7f0a70137860 2024-03-18T14:45:05.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.567+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a70061870 con 0x7f0a70137860 2024-03-18T14:45:05.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.570+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0a6002ecd0 con 0x7f0a70137860 2024-03-18T14:45:05.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.720+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a700637b0 con 0x7f0a70137860 2024-03-18T14:45:05.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.720+0000 7f0a5f7fe700 1 -- 172.21.15.57:0/3524232129 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f0a60020070 con 0x7f0a70137860 2024-03-18T14:45:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:05.722 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:05.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.721+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 >> v1:172.21.15.57:6816/39496 conn(0x7f0a4c038da0 legacy=0x7f0a4c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.721+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 msgr2=0x7f0a70066d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.721+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f0a7009a100 tx=0x7f0a60007c10).stop 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 shutdown_connections 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a7013c420 0x7f0a7005fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0a700650c0 0x7f0a70139110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 --2- 172.21.15.57:0/3524232129 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0a70137860 0x7f0a70066d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 >> 172.21.15.57:0/3524232129 conn(0x7f0a7005c300 msgr2=0x7f0a7013b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 shutdown_connections 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:05.722+0000 7f0a749bf700 1 -- 172.21.15.57:0/3524232129 wait complete. 2024-03-18T14:45:05.724 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:06.036 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:06.036 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:07.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:07.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.154+0000 7f54457f2700 1 Processor -- start 2024-03-18T14:45:07.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.154+0000 7f54457f2700 1 -- start start 2024-03-18T14:45:07.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f54457f2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f544009b520 0x7f544009bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f54457f2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f54457f2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5440136ef0 con 0x7f54401366f0 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f54457f2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544009a380 con 0x7f544009b520 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f54457f2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5440135fe0 con 0x7f5440136ad0 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f544009b520 0x7f544009bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543effd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f54401366f0 0x7f5440139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37226/0 (socket says 172.21.15.57:37226) 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543effd700 1 -- 172.21.15.57:0/3277282280 learned_addr learned my addr 172.21.15.57:0/3277282280 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:47316/0 (socket says 172.21.15.57:47316) 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.155+0000 7f543e7fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f544009b520 0x7f544009bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41480/0 (socket says 172.21.15.57:41480) 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543e7fc700 1 -- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 msgr2=0x7f5440099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543e7fc700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543e7fc700 1 -- 172.21.15.57:0/3277282280 >> v1:172.21.15.57:6789/0 conn(0x7f54401366f0 legacy=0x7f5440139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543e7fc700 1 -- 172.21.15.57:0/3277282280 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544009a0c0 con 0x7f544009b520 2024-03-18T14:45:07.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543dffb700 1 -- 172.21.15.57:0/3277282280 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789803749 0 0) 0x7f5440136ef0 con 0x7f54401366f0 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543f7fe700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543e7fc700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f544009b520 0x7f544009bbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5428002f70 tx=0x7f5428006d90).ready entity=mon.0 client_cookie=55849e6f956a390c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543dffb700 1 -- 172.21.15.57:0/3277282280 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800d4a0 con 0x7f544009b520 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543dffb700 1 -- 172.21.15.57:0/3277282280 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428000e90 con 0x7f544009b520 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.156+0000 7f543dffb700 1 -- 172.21.15.57:0/3277282280 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f542800d7f0 con 0x7f544009b520 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 -- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f544009b520 msgr2=0x7f544009bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f544009b520 0x7f544009bbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f5428002f70 tx=0x7f5428006d90).stop 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 -- 172.21.15.57:0/3277282280 shutdown_connections 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5440136ad0 0x7f5440099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 --2- 172.21.15.57:0/3277282280 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f544009b520 0x7f544009bbb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 -- 172.21.15.57:0/3277282280 >> 172.21.15.57:0/3277282280 conn(0x7f544006c0c0 msgr2=0x7f544006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 -- 172.21.15.57:0/3277282280 shutdown_connections 2024-03-18T14:45:07.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.157+0000 7f54457f2700 1 -- 172.21.15.57:0/3277282280 wait complete. 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 Processor -- start 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 -- start start 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f544009b520 0x7f5440145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 0x7f54401492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54401458f0 con 0x7f5440136ad0 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5440146710 con 0x7f54401366f0 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f54457f2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5440148ea0 con 0x7f544009b520 2024-03-18T14:45:07.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f543effd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f544009b520 0x7f5440145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f543f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41488/0 (socket says 172.21.15.57:41488) 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f543f7fe700 1 -- 172.21.15.57:0/3944191172 learned_addr learned my addr 172.21.15.57:0/3944191172 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.158+0000 7f543e7fc700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 0x7f54401492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 -- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f544009b520 msgr2=0x7f5440145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f544009b520 0x7f5440145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 -- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 msgr2=0x7f54401492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 0x7f54401492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 -- 172.21.15.57:0/3944191172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009470 con 0x7f5440136ad0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543e7fc700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 0x7f54401492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f543f7fe700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f543800c000 tx=0x7f54380091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543800ee60 con 0x7f5440136ad0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800c850 con 0x7f5440136ad0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542800b120 con 0x7f5440136ad0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f543800cbb0 con 0x7f5440136ad0 2024-03-18T14:45:07.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.159+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5440094910 con 0x7f5440136ad0 2024-03-18T14:45:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.160+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5440145a60 con 0x7f5440136ad0 2024-03-18T14:45:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.161+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5438022070 con 0x7f5440136ad0 2024-03-18T14:45:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.161+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f543804b430 con 0x7f5440136ad0 2024-03-18T14:45:07.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.163+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5438033d60 con 0x7f5440136ad0 2024-03-18T14:45:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.313+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5440145a30 con 0x7f5440136ad0 2024-03-18T14:45:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.314+0000 7f5437fff700 1 -- 172.21.15.57:0/3944191172 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f5438029030 con 0x7f5440136ad0 2024-03-18T14:45:07.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:07.316 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 >> v1:172.21.15.57:6816/39496 conn(0x7f5424038da0 legacy=0x7f542403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 msgr2=0x7f54401497e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f543800c000 tx=0x7f54380091d0).stop 2024-03-18T14:45:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 shutdown_connections 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5440136ad0 0x7f54401497e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f544009b520 0x7f5440145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 --2- 172.21.15.57:0/3944191172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f54401366f0 0x7f54401492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 >> 172.21.15.57:0/3944191172 conn(0x7f544006c0c0 msgr2=0x7f5440132390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 shutdown_connections 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:07.315+0000 7f54457f2700 1 -- 172.21.15.57:0/3944191172 wait complete. 2024-03-18T14:45:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:07.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:07.630 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:08.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:08.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.749+0000 7fcd823d9700 1 Processor -- start 2024-03-18T14:45:08.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.749+0000 7fcd823d9700 1 -- start start 2024-03-18T14:45:08.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd823d9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd7c064700 0x7fcd7c0621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:08.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd823d9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c09adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:08.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd823d9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c09bc50 con 0x7fcd7c09aa10 2024-03-18T14:45:08.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd823d9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c1365f0 con 0x7fcd7c064700 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd823d9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c09b2e0 con 0x7fcd7c136140 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcd7c064700 0x7fcd7c0621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd80976700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c09adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcd7c09aa10 0x7fcd7c132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37232/0 (socket says 172.21.15.57:37232) 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7bfff700 1 -- 172.21.15.57:0/3163786128 learned_addr learned my addr 172.21.15.57:0/3163786128 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7b7fe700 1 -- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 msgr2=0x7fcd7c09adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7b7fe700 1 --2- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c09adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7b7fe700 1 -- 172.21.15.57:0/3163786128 >> v1:172.21.15.57:6789/0 conn(0x7fcd7c09aa10 legacy=0x7fcd7c132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7affd700 1 -- 172.21.15.57:0/3163786128 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135071825 0 0) 0x7fcd7c09bc50 con 0x7fcd7c09aa10 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.750+0000 7fcd7b7fe700 1 -- 172.21.15.57:0/3163786128 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c1367e0 con 0x7fcd7c064700 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd7b7fe700 1 --2- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c0621e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcd6c002f70 tx=0x7fcd6c006d90).ready entity=mon.0 client_cookie=53759c67cf09ca45 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd7affd700 1 -- 172.21.15.57:0/3163786128 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00d4a0 con 0x7fcd7c064700 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd7affd700 1 -- 172.21.15.57:0/3163786128 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c000e90 con 0x7fcd7c064700 2024-03-18T14:45:08.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd7affd700 1 -- 172.21.15.57:0/3163786128 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd6c00d7f0 con 0x7fcd7c064700 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 -- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 msgr2=0x7fcd7c0621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 --2- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c0621e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fcd6c002f70 tx=0x7fcd6c006d90).stop 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 -- 172.21.15.57:0/3163786128 shutdown_connections 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 --2- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c09adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 --2- 172.21.15.57:0/3163786128 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c0621e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 -- 172.21.15.57:0/3163786128 >> 172.21.15.57:0/3163786128 conn(0x7fcd7c06c0c0 msgr2=0x7fcd7c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 -- 172.21.15.57:0/3163786128 shutdown_connections 2024-03-18T14:45:08.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.751+0000 7fcd823d9700 1 -- 172.21.15.57:0/3163786128 wait complete. 2024-03-18T14:45:08.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.752+0000 7fcd823d9700 1 Processor -- start 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.752+0000 7fcd823d9700 1 -- start start 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcd7c09aa10 0x7fcd7c0971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0643f0 con 0x7fcd7c064700 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c064560 con 0x7fcd7c136140 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd823d9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0a7e70 con 0x7fcd7c09aa10 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54166/0 (socket says 172.21.15.57:54166) 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 -- 172.21.15.57:0/1402796021 learned_addr learned my addr 172.21.15.57:0/1402796021 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd7bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41502/0 (socket says 172.21.15.57:41502) 2024-03-18T14:45:08.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd7b7fe700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcd7c09aa10 0x7fcd7c0971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 -- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcd7c09aa10 msgr2=0x7fcd7c0971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcd7c09aa10 0x7fcd7c0971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 -- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 msgr2=0x7fcd7c1336c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.753+0000 7fcd80976700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd80976700 1 -- 172.21.15.57:0/1402796021 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c00b120 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd7bfff700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd80976700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcd74006e00 tx=0x7fcd740091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd74012600 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd74012760 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c0a8d60 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd74012ac0 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.754+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0a9010 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.755+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcd74022070 con 0x7fcd7c136140 2024-03-18T14:45:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.755+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c136aa0 con 0x7fcd7c136140 2024-03-18T14:45:08.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.755+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcd7404adc0 con 0x7fcd7c136140 2024-03-18T14:45:08.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.758+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcd74033650 con 0x7fcd7c136140 2024-03-18T14:45:08.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.905+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd7c057a60 con 0x7fcd7c136140 2024-03-18T14:45:08.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.906+0000 7fcd797fa700 1 -- 172.21.15.57:0/1402796021 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fcd74016070 con 0x7fcd7c136140 2024-03-18T14:45:08.908 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:08.908 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 >> v1:172.21.15.57:6816/39496 conn(0x7fcd60038e60 legacy=0x7fcd6003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 msgr2=0x7fcd7c0a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fcd74006e00 tx=0x7fcd740091d0).stop 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 shutdown_connections 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcd7c136140 0x7fcd7c0a8870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcd7c064700 0x7fcd7c1336c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 --2- 172.21.15.57:0/1402796021 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcd7c09aa10 0x7fcd7c0971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 >> 172.21.15.57:0/1402796021 conn(0x7fcd7c06c0c0 msgr2=0x7fcd7c133fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 shutdown_connections 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:08.907+0000 7fcd823d9700 1 -- 172.21.15.57:0/1402796021 wait complete. 2024-03-18T14:45:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:09.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:09.222 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:10.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:10.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.341+0000 7f3156a82700 1 Processor -- start 2024-03-18T14:45:10.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.341+0000 7f3156a82700 1 -- start start 2024-03-18T14:45:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f3156a82700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315009aa10 0x7f31500621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f3156a82700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150136140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f3156a82700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315009b280 con 0x7f315009adf0 2024-03-18T14:45:10.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f3156a82700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f315009bc50 con 0x7f315009aa10 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f3156a82700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31501367e0 con 0x7f3150064700 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315009aa10 0x7f31500621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f314ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315501f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f315009adf0 0x7f3150132c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37236/0 (socket says 172.21.15.57:37236) 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315501f700 1 -- 172.21.15.57:0/1123030910 learned_addr learned my addr 172.21.15.57:0/1123030910 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 -- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 msgr2=0x7f3150136140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 --2- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150136140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 -- 172.21.15.57:0/1123030910 >> v1:172.21.15.57:6789/0 conn(0x7f315009adf0 legacy=0x7f3150132c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f314f7fe700 1 -- 172.21.15.57:0/1123030910 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051946618 0 0) 0x7f315009b280 con 0x7f315009adf0 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 -- 172.21.15.57:0/1123030910 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150136aa0 con 0x7f315009aa10 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.342+0000 7f315481e700 1 --2- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f31500621e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3144002f70 tx=0x7f3144006df0).ready entity=mon.0 client_cookie=9f403cf667c631a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f314f7fe700 1 -- 172.21.15.57:0/1123030910 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314400d570 con 0x7f315009aa10 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f314f7fe700 1 -- 172.21.15.57:0/1123030910 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3144000e90 con 0x7f315009aa10 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f314f7fe700 1 -- 172.21.15.57:0/1123030910 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314400d8c0 con 0x7f315009aa10 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 -- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 msgr2=0x7f31500621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 --2- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f31500621e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3144002f70 tx=0x7f3144006df0).stop 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 -- 172.21.15.57:0/1123030910 shutdown_connections 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 --2- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f31500621e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 --2- 172.21.15.57:0/1123030910 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150136140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 -- 172.21.15.57:0/1123030910 >> 172.21.15.57:0/1123030910 conn(0x7f315006c0c0 msgr2=0x7f315006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 -- 172.21.15.57:0/1123030910 shutdown_connections 2024-03-18T14:45:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.343+0000 7f3156a82700 1 -- 172.21.15.57:0/1123030910 wait complete. 2024-03-18T14:45:10.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.344+0000 7f3156a82700 1 Processor -- start 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.344+0000 7f3156a82700 1 -- start start 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150098aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 0x7f3150149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3150098f90 con 0x7f315009aa10 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f315009d450 con 0x7f315009adf0 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f3156a82700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3150098510 con 0x7f3150064700 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f315501f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 0x7f3150149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f315501f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 0x7f3150149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54182/0 (socket says 172.21.15.57:54182) 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41516/0 (socket says 172.21.15.57:41516) 2024-03-18T14:45:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f315501f700 1 -- 172.21.15.57:0/111453177 learned_addr learned my addr 172.21.15.57:0/111453177 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f315481e700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150098aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 -- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 msgr2=0x7f3150098aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150098aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 -- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 msgr2=0x7f3150149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 0x7f3150149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 -- 172.21.15.57:0/111453177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314400b180 con 0x7f315009aa10 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f315481e700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.345+0000 7f314ffff700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f313c00c000 tx=0x7f313c006d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.346+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f313c0104c0 con 0x7f315009aa10 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.346+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c010620 con 0x7f315009aa10 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.346+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31500987d0 con 0x7f315009aa10 2024-03-18T14:45:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.346+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f313c010980 con 0x7f315009aa10 2024-03-18T14:45:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.346+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315009dcd0 con 0x7f315009aa10 2024-03-18T14:45:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.347+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f313c010ae0 con 0x7f315009aa10 2024-03-18T14:45:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.347+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3150057a60 con 0x7f315009aa10 2024-03-18T14:45:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.347+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f313c04a420 con 0x7f315009aa10 2024-03-18T14:45:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.350+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f313c02f320 con 0x7f315009aa10 2024-03-18T14:45:10.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.499+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31500a7b30 con 0x7f315009aa10 2024-03-18T14:45:10.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.500+0000 7f314dffb700 1 -- 172.21.15.57:0/111453177 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f313c032940 con 0x7f315009aa10 2024-03-18T14:45:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:10.501 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 >> v1:172.21.15.57:6816/39496 conn(0x7f3130038da0 legacy=0x7f313003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 msgr2=0x7f3150148fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f313c00c000 tx=0x7f313c006d90).stop 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 shutdown_connections 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f315009adf0 0x7f3150149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3150064700 0x7f3150098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 --2- 172.21.15.57:0/111453177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315009aa10 0x7f3150148fa0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:10.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 >> 172.21.15.57:0/111453177 conn(0x7f315006c0c0 msgr2=0x7f315006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:10.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 shutdown_connections 2024-03-18T14:45:10.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:10.501+0000 7f3156a82700 1 -- 172.21.15.57:0/111453177 wait complete. 2024-03-18T14:45:10.504 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:10.815 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:10.816 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:11.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.935+0000 7fe7da1bd700 1 Processor -- start 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.935+0000 7fe7da1bd700 1 -- start start 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7da1bd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d4067570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7da1bd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7d4139fa0 0x7fe7d413a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7da1bd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40a4c50 con 0x7fe7d41337e0 2024-03-18T14:45:11.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7da1bd700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d4133fe0 con 0x7fe7d4139fa0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7da1bd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40a4f10 con 0x7fe7d4133bc0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d4067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe7d4139fa0 0x7fe7d413a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d37fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe7d41337e0 0x7fe7d4139890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37238/0 (socket says 172.21.15.57:37238) 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d37fe700 1 -- 172.21.15.57:0/2401530570 learned_addr learned my addr 172.21.15.57:0/2401530570 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d27fc700 1 -- 172.21.15.57:0/2401530570 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527578128 0 0) 0x7fe7d40a4c50 con 0x7fe7d41337e0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d3fff700 1 -- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 msgr2=0x7fe7d4067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d3fff700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d4067570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d3fff700 1 -- 172.21.15.57:0/2401530570 >> v1:172.21.15.57:6789/0 conn(0x7fe7d41337e0 legacy=0x7fe7d4139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d3fff700 1 -- 172.21.15.57:0/2401530570 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4060520 con 0x7fe7d4139fa0 2024-03-18T14:45:11.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.936+0000 7fe7d2ffd700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d4067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7d3fff700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d413a400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe7cc0032f0 tx=0x7fe7cc0091d0).ready entity=mon.0 client_cookie=2d2e11fb22855532 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7d27fc700 1 -- 172.21.15.57:0/2401530570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc00b6c0 con 0x7fe7d4139fa0 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7d27fc700 1 -- 172.21.15.57:0/2401530570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00b820 con 0x7fe7d4139fa0 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7d27fc700 1 -- 172.21.15.57:0/2401530570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc00b990 con 0x7fe7d4139fa0 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 -- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 msgr2=0x7fe7d413a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d413a400 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe7cc0032f0 tx=0x7fe7cc0091d0).stop 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 -- 172.21.15.57:0/2401530570 shutdown_connections 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d413a400 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/2401530570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d4067570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 -- 172.21.15.57:0/2401530570 >> 172.21.15.57:0/2401530570 conn(0x7fe7d40a93f0 msgr2=0x7fe7d40a53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 -- 172.21.15.57:0/2401530570 shutdown_connections 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.937+0000 7fe7da1bd700 1 -- 172.21.15.57:0/2401530570 wait complete. 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.938+0000 7fe7da1bd700 1 Processor -- start 2024-03-18T14:45:11.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.938+0000 7fe7da1bd700 1 -- start start 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d40a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40a29b0 con 0x7fe7d4139fa0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40a20b0 con 0x7fe7d4133bc0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7da1bd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4148d50 con 0x7fe7d41337e0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d40a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:11.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:47348/0 (socket says 172.21.15.57:47348) 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41528/0 (socket says 172.21.15.57:41528) 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d37fe700 1 -- 172.21.15.57:0/1705989471 learned_addr learned my addr 172.21.15.57:0/1705989471 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 -- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 msgr2=0x7fe7d4134320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 -- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 msgr2=0x7fe7d40a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d2ffd700 1 -- 172.21.15.57:0/1705989471 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc00b180 con 0x7fe7d4133bc0 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d3fff700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.939+0000 7fe7d37fe700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:11.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7d2ffd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d40a1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe7d40a2d90 tx=0x7fe7bc006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc010780 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc0108e0 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc009470 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7bc010c40 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.940+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d409f550 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.941+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe7bc01c460 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.941+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d4065a50 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.941+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe7bc04ade0 con 0x7fe7d4133bc0 2024-03-18T14:45:11.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:11.944+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe7bc033670 con 0x7fe7d4133bc0 2024-03-18T14:45:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.092+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d4057a60 con 0x7fe7d4133bc0 2024-03-18T14:45:12.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.093+0000 7fe7d0ff9700 1 -- 172.21.15.57:0/1705989471 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7fe7bc033440 con 0x7fe7d4133bc0 2024-03-18T14:45:12.095 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:12.095 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 >> v1:172.21.15.57:6816/39496 conn(0x7fe7b8038ec0 legacy=0x7fe7b803b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 msgr2=0x7fe7d40a1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d40a1bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe7d40a2d90 tx=0x7fe7bc006df0).stop 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 shutdown_connections 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe7d4139fa0 0x7fe7d40a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:12.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe7d41337e0 0x7fe7d4134320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 --2- 172.21.15.57:0/1705989471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe7d4133bc0 0x7fe7d40a1bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 >> 172.21.15.57:0/1705989471 conn(0x7fe7d40a93f0 msgr2=0x7fe7d405b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 shutdown_connections 2024-03-18T14:45:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:12.094+0000 7fe7da1bd700 1 -- 172.21.15.57:0/1705989471 wait complete. 2024-03-18T14:45:12.097 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:12.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:12.408 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:13.409 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:13.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.530+0000 7f7edca37700 1 Processor -- start 2024-03-18T14:45:13.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.530+0000 7f7edca37700 1 -- start start 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7edca37700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7edca37700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ed8136ad0 0x7f7ed8099a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7edca37700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed8136f20 con 0x7f7ed81366f0 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7edca37700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed809a380 con 0x7f7ed8136ad0 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7edca37700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8135fe0 con 0x7f7ed809b520 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ed8136ad0 0x7f7ed8099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:13.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7ed81366f0 0x7f7ed8139530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47562/0 (socket says 172.21.15.57:47562) 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed659c700 1 -- 172.21.15.57:0/4174965057 learned_addr learned my addr 172.21.15.57:0/4174965057 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed5d9b700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39140/0 (socket says 172.21.15.57:39140) 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 -- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 msgr2=0x7f7ed809bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 -- 172.21.15.57:0/4174965057 >> v1:172.21.15.57:6789/0 conn(0x7f7ed81366f0 legacy=0x7f7ed8139530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 -- 172.21.15.57:0/4174965057 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed809a0c0 con 0x7f7ed8136ad0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed559a700 1 -- 172.21.15.57:0/4174965057 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796493231 0 0) 0x7f7ed8136f20 con 0x7f7ed81366f0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed5d9b700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.531+0000 7f7ed6d9d700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed8136ad0 0x7f7ed8099a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7ed805c360 tx=0x7f7ed00091d0).ready entity=mon.0 client_cookie=d97b97381c1f0f68 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7ed559a700 1 -- 172.21.15.57:0/4174965057 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed000b680 con 0x7f7ed8136ad0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7ed559a700 1 -- 172.21.15.57:0/4174965057 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed000b7e0 con 0x7f7ed8136ad0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7ed559a700 1 -- 172.21.15.57:0/4174965057 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed000b950 con 0x7f7ed8136ad0 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 -- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed8136ad0 msgr2=0x7f7ed8099a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed8136ad0 0x7f7ed8099a00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f7ed805c360 tx=0x7f7ed00091d0).stop 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 -- 172.21.15.57:0/4174965057 shutdown_connections 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed8136ad0 0x7f7ed8099a00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 --2- 172.21.15.57:0/4174965057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed809b520 0x7f7ed809bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 -- 172.21.15.57:0/4174965057 >> 172.21.15.57:0/4174965057 conn(0x7f7ed806c0c0 msgr2=0x7f7ed806c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 -- 172.21.15.57:0/4174965057 shutdown_connections 2024-03-18T14:45:13.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.532+0000 7f7edca37700 1 -- 172.21.15.57:0/4174965057 wait complete. 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.533+0000 7f7edca37700 1 Processor -- start 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.533+0000 7f7edca37700 1 -- start start 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 0x7f7ed8148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ed8136ad0 0x7f7ed81492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80962f0 con 0x7f7ed809b520 2024-03-18T14:45:13.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8097400 con 0x7f7ed81366f0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7edca37700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8095770 con 0x7f7ed8136ad0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed5d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 0x7f7ed8148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45586/0 (socket says 172.21.15.57:45586) 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 -- 172.21.15.57:0/3109753263 learned_addr learned my addr 172.21.15.57:0/3109753263 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed6d9d700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ed8136ad0 0x7f7ed81492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 -- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ed8136ad0 msgr2=0x7f7ed81492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ed8136ad0 0x7f7ed81492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 -- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 msgr2=0x7f7ed8148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 0x7f7ed8148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 -- 172.21.15.57:0/3109753263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec800b120 con 0x7f7ed809b520 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed5d9b700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 0x7f7ed8148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.534+0000 7f7ed659c700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f7ecc000bc0 tx=0x7f7ecc007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.535+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ecc0070d0 con 0x7f7ed809b520 2024-03-18T14:45:13.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.535+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc007230 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.535+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed0009470 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.535+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ecc005610 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.535+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed8097900 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.536+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7ecc010070 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.536+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7ecc049f40 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.536+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed8097b50 con 0x7f7ed809b520 2024-03-18T14:45:13.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.539+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7ed8097b50 con 0x7f7ed809b520 2024-03-18T14:45:13.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.687+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ed8097b50 con 0x7f7ed809b520 2024-03-18T14:45:13.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.687+0000 7f7ec77fe700 1 -- 172.21.15.57:0/3109753263 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+2324 (secure 0 0 0) 0x7f7ed8097b50 con 0x7f7ed809b520 2024-03-18T14:45:13.689 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:13.689 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:44:46.288098+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4242,"mds_1":4193},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4193":{"gid":4193,"name":"c","rank":1,"incarnation":8,"state":"up:stopping","state_seq":4,"addr":"172.21.15.57:6818/3757846201","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":3757846201}]},"join_fscid":-1,"export_targets":[0],"features":4540138292840890367,"flags":0},"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 >> v1:172.21.15.57:6816/39496 conn(0x7f7eb4038e30 legacy=0x7f7eb403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 msgr2=0x7f7ed80951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f7ecc000bc0 tx=0x7f7ecc007a60).stop 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 shutdown_connections 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7ed8136ad0 0x7f7ed81492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ed809b520 0x7f7ed80951c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 --2- 172.21.15.57:0/3109753263 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7ed81366f0 0x7f7ed8148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 >> 172.21.15.57:0/3109753263 conn(0x7f7ed806c0c0 msgr2=0x7f7ed8133330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.688+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 shutdown_connections 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:13.689+0000 7f7edca37700 1 -- 172.21.15.57:0/3109753263 wait complete. 2024-03-18T14:45:13.691 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 14 2024-03-18T14:45:14.004 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:44:46.288098+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4242, 'mds_1': 4193}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4193': {'gid': 4193, 'name': 'c', 'rank': 1, 'incarnation': 8, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.57:6818/3757846201', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 3757846201}]}, 'join_fscid': -1, 'export_targets': [0], 'features': 4540138292840890367, 'flags': 0}, 'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:14.004 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4193:up:stopping 2024-03-18T14:45:15.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:45:15.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.123+0000 7f22f1341700 1 Processor -- start 2024-03-18T14:45:15.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.123+0000 7f22f1341700 1 -- start start 2024-03-18T14:45:15.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22f1341700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 0x7f22ec05bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22f1341700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 0x7f22ec140f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22f1341700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ec05b970 con 0x7f22ec136bf0 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22f1341700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec05d590 con 0x7f22ec136210 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22f1341700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec136710 con 0x7f22ec13eb70 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 0x7f22ec140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 0x7f22ec05bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22eaffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f22ec136bf0 0x7f22ec05ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47566/0 (socket says 172.21.15.57:47566) 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22eaffd700 1 -- 172.21.15.57:0/803638795 learned_addr learned my addr 172.21.15.57:0/803638795 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22e9ffb700 1 -- 172.21.15.57:0/803638795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891193108 0 0) 0x7f22ec05b970 con 0x7f22ec136bf0 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22e9ffb700 1 -- 172.21.15.57:0/803638795 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22cc003260 con 0x7f22ec136bf0 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22ea7fc700 1 -- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 msgr2=0x7f22ec140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22ea7fc700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 0x7f22ec140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22ea7fc700 1 -- 172.21.15.57:0/803638795 >> v1:172.21.15.57:6789/0 conn(0x7f22ec136bf0 legacy=0x7f22ec05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22ea7fc700 1 -- 172.21.15.57:0/803638795 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec1369d0 con 0x7f22ec136210 2024-03-18T14:45:15.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.124+0000 7f22eb7fe700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 0x7f22ec140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22ea7fc700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 0x7f22ec05bde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f22dc002f70 tx=0x7f22dc006df0).ready entity=mon.1 client_cookie=bb761eafa1dbbc5b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22e9ffb700 1 -- 172.21.15.57:0/803638795 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00d570 con 0x7f22ec136210 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22e9ffb700 1 -- 172.21.15.57:0/803638795 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc000e90 con 0x7f22ec136210 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22e9ffb700 1 -- 172.21.15.57:0/803638795 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22dc00d8c0 con 0x7f22ec136210 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 -- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 msgr2=0x7f22ec05bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 0x7f22ec05bde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f22dc002f70 tx=0x7f22dc006df0).stop 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 -- 172.21.15.57:0/803638795 shutdown_connections 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec13eb70 0x7f22ec140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 --2- 172.21.15.57:0/803638795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136210 0x7f22ec05bde0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.125+0000 7f22f1341700 1 -- 172.21.15.57:0/803638795 >> 172.21.15.57:0/803638795 conn(0x7f22ec066a50 msgr2=0x7f22ec06c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.126+0000 7f22f1341700 1 -- 172.21.15.57:0/803638795 shutdown_connections 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.126+0000 7f22f1341700 1 -- 172.21.15.57:0/803638795 wait complete. 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.126+0000 7f22f1341700 1 Processor -- start 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.126+0000 7f22f1341700 1 -- start start 2024-03-18T14:45:15.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec136210 0x7f22ec13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 0x7f22ec14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec13c160 con 0x7f22ec13eb70 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec130680 con 0x7f22ec136bf0 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22f1341700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec13d990 con 0x7f22ec136210 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 0x7f22ec14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22ea7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39178/0 (socket says 172.21.15.57:39178) 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22ea7fc700 1 -- 172.21.15.57:0/2342413585 learned_addr learned my addr 172.21.15.57:0/2342413585 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eaffd700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec136210 0x7f22ec13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 -- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec136210 msgr2=0x7f22ec13d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec136210 0x7f22ec13d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 -- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 msgr2=0x7f22ec149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22eb7fe700 1 -- 172.21.15.57:0/2342413585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4009470 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.127+0000 7f22ea7fc700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22eb7fe700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 0x7f22ec14a160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f22e400c000 tx=0x7f22e40091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e4012600 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e4012760 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc00b180 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22e4012ac0 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.128+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec13dc60 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.129+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f22e4022070 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.129+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f22e404ae20 con 0x7f22ec13eb70 2024-03-18T14:45:15.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.129+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec060150 con 0x7f22ec13eb70 2024-03-18T14:45:15.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.132+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f22e4033750 con 0x7f22ec13eb70 2024-03-18T14:45:15.282 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-03-18T14:45:15.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.284+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22ec057a60 con 0x7f22ec13eb70 2024-03-18T14:45:15.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.284+0000 7f22e3fff700 1 -- 172.21.15.57:0/2342413585 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+2016 (secure 0 0 0) 0x7f22e4033340 con 0x7f22ec13eb70 2024-03-18T14:45:15.286 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:15.286 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:45:15.229181+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[1],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:45:15.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 >> v1:172.21.15.57:6816/39496 conn(0x7f22d0038da0 legacy=0x7f22d003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 msgr2=0x7f22ec14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 0x7f22ec14a160 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f22e400c000 tx=0x7f22e40091d0).stop 2024-03-18T14:45:15.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 shutdown_connections 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22ec13eb70 0x7f22ec14a160 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22ec136210 0x7f22ec13d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 --2- 172.21.15.57:0/2342413585 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22ec136bf0 0x7f22ec149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 >> 172.21.15.57:0/2342413585 conn(0x7f22ec066a50 msgr2=0x7f22ec1358d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 shutdown_connections 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.286+0000 7f22f1341700 1 -- 172.21.15.57:0/2342413585 wait complete. 2024-03-18T14:45:15.289 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 15 2024-03-18T14:45:15.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:45:15.229181+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4242}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [1], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:45:15.600 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T14:45:15.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-18T14:45:15.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.710+0000 7fc633222700 1 Processor -- start 2024-03-18T14:45:15.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.710+0000 7fc633222700 1 -- start start 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc633222700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 0x7fc62c1337e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc633222700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 0x7fc62c13d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc633222700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c136680 con 0x7fc62c136b20 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc633222700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c136920 con 0x7fc62c066ae0 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc633222700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1362d0 con 0x7fc62c136f00 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 0x7fc62c1337e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 0x7fc62c13d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc630fbe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc62c136b20 0x7fc62c132d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:47594/0 (socket says 172.21.15.57:47594) 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc630fbe700 1 -- 172.21.15.57:0/2609910776 learned_addr learned my addr 172.21.15.57:0/2609910776 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc62b7fe700 1 -- 172.21.15.57:0/2609910776 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610590629 0 0) 0x7fc62c136680 con 0x7fc62c136b20 2024-03-18T14:45:15.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc62b7fe700 1 -- 172.21.15.57:0/2609910776 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc610003260 con 0x7fc62c136b20 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc6317bf700 1 -- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 msgr2=0x7fc62c1337e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc6317bf700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 0x7fc62c1337e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc6317bf700 1 -- 172.21.15.57:0/2609910776 >> v1:172.21.15.57:6789/0 conn(0x7fc62c136b20 legacy=0x7fc62c132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc6317bf700 1 -- 172.21.15.57:0/2609910776 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c061160 con 0x7fc62c136f00 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.711+0000 7fc62bfff700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 0x7fc62c1337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc6317bf700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 0x7fc62c13d670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc6240032f0 tx=0x7fc62400b470).ready entity=mon.2 client_cookie=5804922d4820ea89 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc62b7fe700 1 -- 172.21.15.57:0/2609910776 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc62400dd70 con 0x7fc62c136f00 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc62b7fe700 1 -- 172.21.15.57:0/2609910776 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624010470 con 0x7fc62c136f00 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc62b7fe700 1 -- 172.21.15.57:0/2609910776 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6240107d0 con 0x7fc62c136f00 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 -- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 msgr2=0x7fc62c13d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 0x7fc62c13d670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fc6240032f0 tx=0x7fc62400b470).stop 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 -- 172.21.15.57:0/2609910776 shutdown_connections 2024-03-18T14:45:15.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136f00 0x7fc62c13d670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 --2- 172.21.15.57:0/2609910776 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c066ae0 0x7fc62c1337e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 -- 172.21.15.57:0/2609910776 >> 172.21.15.57:0/2609910776 conn(0x7fc62c06c0c0 msgr2=0x7fc62c06c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 -- 172.21.15.57:0/2609910776 shutdown_connections 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.712+0000 7fc633222700 1 -- 172.21.15.57:0/2609910776 wait complete. 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.713+0000 7fc633222700 1 Processor -- start 2024-03-18T14:45:15.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.713+0000 7fc633222700 1 -- start start 2024-03-18T14:45:15.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 0x7fc62c097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c1424a0 0x7fc62c093fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c142010 con 0x7fc62c136f00 2024-03-18T14:45:15.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0960c0 con 0x7fc62c1424a0 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc633222700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c096380 con 0x7fc62c136b20 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:43736/0 (socket says 172.21.15.57:43736) 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 -- 172.21.15.57:0/1772033460 learned_addr learned my addr 172.21.15.57:0/1772033460 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c1424a0 0x7fc62c093fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc62bfff700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 0x7fc62c097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 -- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c1424a0 msgr2=0x7fc62c093fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c1424a0 0x7fc62c093fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 -- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 msgr2=0x7fc62c097a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 0x7fc62c097a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 -- 172.21.15.57:0/1772033460 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61800b180 con 0x7fc62c136b20 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc62bfff700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 0x7fc62c097a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.714+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc620001110 tx=0x7fc620007ad0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc629ffb700 1 -- 172.21.15.57:0/1772033460 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6200070d0 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc629ffb700 1 -- 172.21.15.57:0/1772033460 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620007230 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62400b710 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc629ffb700 1 -- 172.21.15.57:0/1772033460 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc620005610 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c097f30 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.715+0000 7fc629ffb700 1 -- 172.21.15.57:0/1772033460 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc620010070 con 0x7fc62c136b20 2024-03-18T14:45:15.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.716+0000 7fc629ffb700 1 -- 172.21.15.57:0/1772033460 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc620049ec0 con 0x7fc62c136b20 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 Processor -- start 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 -- start start 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e824a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839e7d2a10 con 0x55839e8315b0 2024-03-18T14:45:15.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839e777e10 con 0x55839e8311d0 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55839e7488b0 con 0x55839e836590 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.719+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e824a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:43740/0 (socket says 172.21.15.57:43740) 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45632/0 (socket says 172.21.15.57:45632) 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc6317bf700 1 -- 172.21.15.57:0/1338536879 learned_addr learned my addr 172.21.15.57:0/1338536879 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 -- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 msgr2=0x55839e836a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 -- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 msgr2=0x55839e8319b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 -- 172.21.15.57:0/1338536879 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55839e7dee20 con 0x55839e8311d0 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc62bfff700 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc630fbe700 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e824a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc6200083d0 tx=0x7fc620015000).ready entity=mon.1 client_cookie=6b3098dc5a46bb6f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc633222700 1 -- 172.21.15.57:0/1338536879 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6200323e0 con 0x55839e8311d0 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc633222700 1 -- 172.21.15.57:0/1338536879 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620030e20 con 0x55839e8311d0 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.720+0000 7fc633222700 1 -- 172.21.15.57:0/1338536879 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc620008040 con 0x55839e8311d0 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 msgr2=0x55839e824a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e824a60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc6200083d0 tx=0x7fc620015000).stop 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1338536879 shutdown_connections 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e836590 0x55839e836a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e824a60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1338536879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e8319b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1338536879 >> 172.21.15.57:0/1338536879 conn(0x55839e7d0970 msgr2=0x55839e72a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1338536879 shutdown_connections 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1338536879 wait complete. 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 -- start start 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.721+0000 7fc644ca9b80 1 Processor -- start 2024-03-18T14:45:15.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e829860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8315b0 0x55839e83c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839e75c180 con 0x55839e836590 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839e73c7f0 con 0x55839e8311d0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55839e72c710 con 0x55839e8315b0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc644ca9b80 10 client.0 ll_register_callbacks cb 0x55839e751570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e829860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8315b0 0x55839e83c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45638/0 (socket says 172.21.15.57:45638) 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 -- 172.21.15.57:0/318374542 learned_addr learned my addr 172.21.15.57:0/318374542 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 -- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8315b0 msgr2=0x55839e83c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8315b0 0x55839e83c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.722+0000 7fc6317bf700 1 -- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 msgr2=0x55839e829860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc6317bf700 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e829860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc6317bf700 1 -- 172.21.15.57:0/318374542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc618013300 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc630fbe700 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e829860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc6317bf700 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x55839e83c7a0 tx=0x7fc62400b470).ready entity=mon.0 client_cookie=a2cb00ecf029bc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc624006cc0 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc624010c50 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55839e6d30c0 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc624010e10 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 10 client.4947 fetch_fsmap learned FSMap version 15 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x7fc62c061160 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55839e6d30c0 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 15) v1 ==== 1185+0+0 (secure 0 0 0) 0x7fc624018920 con 0x55839e836590 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 10 client.4947 fetch_fsmap finished waiting for FSMap version 15 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 10 client.4947 resolve_mds: resolved ID 'a' to GID 4242 2024-03-18T14:45:15.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 20 client.4947 populate_metadata read hostname 'smithi057' 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 4 client.4947 mds_command: new command op to 4242 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55839e752230 con 0x55839e826e30 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.723+0000 7fc60b7fe700 10 client.4947 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc60b7fe700 1 -- 172.21.15.57:0/318374542 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55839e752230 con 0x55839e826e30 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc60b7fe700 10 client.4947 handle_command_reply: tid=0 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 client.4947 shutdown 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 msgr2=0x55839e83ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x55839e83c7a0 tx=0x7fc62400b470).stop 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 shutdown_connections 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e83ccf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc60b7fe700 0 client.4947 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8311d0 0x55839e829860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/318374542 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8315b0 0x55839e83c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 >> 172.21.15.57:0/318374542 conn(0x55839e7d0970 msgr2=0x55839e72a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 shutdown_connections 2024-03-18T14:45:15.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.724+0000 7fc644ca9b80 1 -- 172.21.15.57:0/318374542 wait complete. 2024-03-18T14:45:15.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.725+0000 7fc644ca9b80 20 client.4947 trim_cache size 0 max 16384 2024-03-18T14:45:15.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.741+0000 7fc644ca9b80 1 Processor -- start 2024-03-18T14:45:15.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.741+0000 7fc644ca9b80 1 -- start start 2024-03-18T14:45:15.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e839990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839e803a80 con 0x55839e8315b0 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839e72cda0 con 0x55839e836590 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55839e826320 con 0x55839e8311d0 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e839990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e839990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:43752/0 (socket says 172.21.15.57:43752) 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45644/0 (socket says 172.21.15.57:45644) 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc630fbe700 1 -- 172.21.15.57:0/1783598812 learned_addr learned my addr 172.21.15.57:0/1783598812 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39220/0 (socket says 172.21.15.57:39220) 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 -- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 msgr2=0x55839e839990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e839990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 -- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 msgr2=0x55839e827ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 -- 172.21.15.57:0/1783598812 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c097f30 con 0x55839e836590 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc62bfff700 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.742+0000 7fc6317bf700 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x55839e824780 tx=0x7fc624026000).ready entity=mon.1 client_cookie=476aa3b5369a412c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc615ffb700 1 -- 172.21.15.57:0/1783598812 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc624006be0 con 0x55839e836590 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc615ffb700 1 -- 172.21.15.57:0/1783598812 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624006d40 con 0x55839e836590 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc615ffb700 1 -- 172.21.15.57:0/1783598812 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc624010c50 con 0x55839e836590 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 msgr2=0x55839e825710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x55839e824780 tx=0x7fc624026000).stop 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1783598812 shutdown_connections 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e836590 0x55839e825710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e839990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/1783598812 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e8315b0 0x55839e827ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1783598812 >> 172.21.15.57:0/1783598812 conn(0x55839e7d0970 msgr2=0x55839e829660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1783598812 shutdown_connections 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.743+0000 7fc644ca9b80 1 -- 172.21.15.57:0/1783598812 wait complete. 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.744+0000 7fc644ca9b80 1 -- start start 2024-03-18T14:45:15.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.744+0000 7fc644ca9b80 1 Processor -- start 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 0x55839e8925e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55839e726330 con 0x55839e836590 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55839e825ca0 con 0x55839e8315b0 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55839e8260f0 con 0x55839e8311d0 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc644ca9b80 10 client.0 ll_register_callbacks cb 0x55839e829ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 0x55839e8925e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:43768/0 (socket says 172.21.15.57:43768) 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc62bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 0x55839e8925e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39236/0 (socket says 172.21.15.57:39236) 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc6317bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45656/0 (socket says 172.21.15.57:45656) 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 -- 172.21.15.57:0/3166049250 learned_addr learned my addr 172.21.15.57:0/3166049250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 -- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 msgr2=0x55839e8925e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 0x55839e8925e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 -- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 msgr2=0x55839e892ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc630fbe700 1 -- 172.21.15.57:0/3166049250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc618013810 con 0x55839e8311d0 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.745+0000 7fc6317bf700 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc630fbe700 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x55839e839e10 tx=0x7fc620013000).ready entity=mon.2 client_cookie=716203f56e5d8203 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 10 client.0 ms_handle_connect on v2:172.21.15.57:3302/0 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc620032160 con 0x55839e8311d0 2024-03-18T14:45:15.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mon.2 v2:172.21.15.57:3302/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc6200319e0 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc620030e20 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc620031ba0 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 10 client.4697 fetch_fsmap learned FSMap version 15 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x7fc62c061160 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mon.2 v2:172.21.15.57:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620036080 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mon.2 v2:172.21.15.57:3302/0 5 ==== fsmap(e 15) v1 ==== 1185+0+0 (secure 0 0 0) 0x7fc62002ad00 con 0x55839e8311d0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 10 client.4697 fetch_fsmap finished waiting for FSMap version 15 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 10 client.4697 resolve_mds: resolved ID 'a' to GID 4242 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 20 client.4697 populate_metadata read hostname 'smithi057' 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 4 client.4697 mds_command: new command op to 4242 tid=0[{"prefix": "status"}] 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55839e74a570 con 0x55839e835d90 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.746+0000 7fc614ff9700 10 client.4697 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc614ff9700 1 -- 172.21.15.57:0/3166049250 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+301 (unknown 0 0 1071004383) 0x55839e74a570 con 0x55839e835d90 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc614ff9700 10 client.4697 handle_command_reply: tid=0 2024-03-18T14:45:15.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 client.4697 shutdown 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 msgr2=0x55839e82d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x55839e839e10 tx=0x7fc620013000).stop 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 shutdown_connections 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55839e836590 0x55839e892ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55839e8311d0 0x55839e82d570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc614ff9700 0 client.4697 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 --2- 172.21.15.57:0/3166049250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55839e8315b0 0x55839e8925e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 >> 172.21.15.57:0/3166049250 conn(0x55839e7d0970 msgr2=0x55839e829560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 shutdown_connections 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 1 -- 172.21.15.57:0/3166049250 wait complete. 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc644ca9b80 20 client.4697 trim_cache size 0 max 16384 2024-03-18T14:45:15.755 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4242, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 242.28900555000001, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 15, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 19, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 19, 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 251.104818397 2024-03-18T14:45:15.756 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 >> v1:172.21.15.57:6816/39496 conn(0x7fc60c038e30 legacy=0x7fc60c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 msgr2=0x7fc62c095b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.747+0000 7fc633222700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc620001110 tx=0x7fc620007ad0).stop 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 shutdown_connections 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc62c1424a0 0x7fc62c093fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc62c136b20 0x7fc62c095b10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 --2- 172.21.15.57:0/1772033460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc62c136f00 0x7fc62c097a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 >> 172.21.15.57:0/1772033460 conn(0x7fc62c06c0c0 msgr2=0x7fc62c0a66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:45:15.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 shutdown_connections 2024-03-18T14:45:15.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:45:15.748+0000 7fc633222700 1 -- 172.21.15.57:0/1772033460 wait complete. 2024-03-18T14:45:15.760 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:45:15.769 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2024-03-18T14:45:15.769 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-03-18T14:45:15.801 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-18T14:45:15.801 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-03-18T14:45:15.801 INFO:teuthology.task.install:remote ubuntu@smithi057.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-03-18T14:45:15.801 INFO:teuthology.task.install:extra packages: [] 2024-03-18T14:45:15.807 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-18T14:45:15.807 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-03-18T14:45:15.807 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:45:15.830 INFO:teuthology.orchestra.run.smithi057.stdout:15.2.17-0.el8 2024-03-18T14:45:15.830 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-03-18T14:45:15.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-03-18T14:45:16.311 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-684.g6716c9f3 2024-03-18T14:45:16.311 INFO:teuthology.task.install.rpm:Host smithi057 is: centos 8 x86_64 2024-03-18T14:45:16.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-03-18T14:45:16.800 INFO:teuthology.task.install.rpm:Repo base URL: https://4.chacra.ceph.com/r/ceph/quincy/6716c9f3976cf9fc2fd546e9f1182c2d4421b451/centos/8/flavors/default/ 2024-03-18T14:45:16.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-03-18T14:45:16.946 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6716c9f3976cf9fc2fd546e9f1182c2d4421b451/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6716c9f3976cf9fc2fd546e9f1182c2d4421b451/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/quincy/6716c9f3976cf9fc2fd546e9f1182c2d4421b451/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:45:16.947 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-18T14:45:16.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:45:16.980 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:45:17.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:45:17.125 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:45:17.184 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-03-18T14:45:17.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-03-18T14:45:17.477 INFO:teuthology.orchestra.run.smithi057.stdout:71 files removed 2024-03-18T14:45:17.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-03-18T14:45:18.507 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 142 kB/s | 78 kB 00:00 2024-03-18T14:45:19.000 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 20 kB/s | 9.1 kB 00:00 2024-03-18T14:45:19.492 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 3.2 kB/s | 1.5 kB 00:00 2024-03-18T14:45:20.418 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - AppStream 31 MB/s | 28 MB 00:00 2024-03-18T14:45:27.451 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - BaseOS 5.6 MB/s | 10 MB 00:01 2024-03-18T14:45:30.502 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras 13 kB/s | 18 kB 00:01 2024-03-18T14:45:30.969 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.5 kB 00:00 2024-03-18T14:45:31.799 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 8 - PowerTools 6.7 MB/s | 4.9 MB 00:00 2024-03-18T14:45:33.030 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2024-03-18T14:45:36.209 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 16 MB 00:03 2024-03-18T14:45:40.164 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 406 kB/s | 24 kB 00:00 2024-03-18T14:45:43.941 INFO:teuthology.orchestra.run.smithi057.stderr:Package cephadm available, but not installed. 2024-03-18T14:45:43.942 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: cephadm 2024-03-18T14:45:43.947 INFO:teuthology.orchestra.run.smithi057.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-03-18T14:45:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: ceph-mgr-dashboard 2024-03-18T14:45:43.947 INFO:teuthology.orchestra.run.smithi057.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-03-18T14:45:43.948 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-03-18T14:45:43.948 INFO:teuthology.orchestra.run.smithi057.stderr:Package ceph-mgr-rook available, but not installed. 2024-03-18T14:45:43.948 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: ceph-mgr-rook 2024-03-18T14:45:43.949 INFO:teuthology.orchestra.run.smithi057.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-03-18T14:45:43.949 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: ceph-mgr-cephadm 2024-03-18T14:45:43.951 INFO:teuthology.orchestra.run.smithi057.stderr:Package ceph-volume available, but not installed. 2024-03-18T14:45:43.952 INFO:teuthology.orchestra.run.smithi057.stdout:No match for argument: ceph-volume 2024-03-18T14:45:44.058 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-18T14:45:44.063 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:45:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-18T14:45:44.063 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:45:44.063 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-03-18T14:45:44.063 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 6.4 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 5.2 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 23 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 876 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 162 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 2.3 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 1.6 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:17.2.7-684.g6716c9f3.el8 ceph-noarch 239 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 3.9 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 17 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 17 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 24 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 52 M 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 25 k 2024-03-18T14:45:44.064 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 798 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 130 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 3.5 M 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 505 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 3.6 M 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 5.6 M 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 45 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 117 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 190 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 370 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 358 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 107 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 90 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 3.5 M 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 175 k 2024-03-18T14:45:44.065 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:17.2.7-684.g6716c9f3.el8 ceph 179 k 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 29 Packages 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:45:44.066 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 144 M 2024-03-18T14:45:44.067 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-18T14:45:44.458 INFO:teuthology.orchestra.run.smithi057.stdout:(1/31): libcephsqlite-17.2.7-684.g6716c9f3.el8. 968 kB/s | 179 kB 00:00 2024-03-18T14:45:44.616 INFO:teuthology.orchestra.run.smithi057.stdout:(2/31): ceph-17.2.7-684.g6716c9f3.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2024-03-18T14:45:44.858 INFO:teuthology.orchestra.run.smithi057.stdout:(3/31): ceph-base-17.2.7-684.g6716c9f3.el8.x86_ 13 MB/s | 5.2 MB 00:00 2024-03-18T14:45:44.900 INFO:teuthology.orchestra.run.smithi057.stdout:(4/31): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2024-03-18T14:45:44.934 INFO:teuthology.orchestra.run.smithi057.stdout:(5/31): ceph-fuse-17.2.7-684.g6716c9f3.el8.x86_ 11 MB/s | 876 kB 00:00 2024-03-18T14:45:45.126 INFO:teuthology.orchestra.run.smithi057.stdout:(6/31): ceph-mds-17.2.7-684.g6716c9f3.el8.x86_6 12 MB/s | 2.3 MB 00:00 2024-03-18T14:45:45.176 INFO:teuthology.orchestra.run.smithi057.stdout:(7/31): ceph-immutable-object-cache-17.2.7-684. 587 kB/s | 162 kB 00:00 2024-03-18T14:45:45.318 INFO:teuthology.orchestra.run.smithi057.stdout:(8/31): ceph-mgr-17.2.7-684.g6716c9f3.el8.x86_6 8.2 MB/s | 1.6 MB 00:00 2024-03-18T14:45:46.468 INFO:teuthology.orchestra.run.smithi057.stdout:(9/31): ceph-osd-17.2.7-684.g6716c9f3.el8.x86_6 15 MB/s | 17 MB 00:01 2024-03-18T14:45:46.785 INFO:teuthology.orchestra.run.smithi057.stdout:(10/31): ceph-mon-17.2.7-684.g6716c9f3.el8.x86_ 2.4 MB/s | 3.9 MB 00:01 2024-03-18T14:45:46.910 INFO:teuthology.orchestra.run.smithi057.stdout:(11/31): ceph-selinux-17.2.7-684.g6716c9f3.el8. 194 kB/s | 24 kB 00:00 2024-03-18T14:45:47.577 INFO:teuthology.orchestra.run.smithi057.stdout:(12/31): ceph-radosgw-17.2.7-684.g6716c9f3.el8. 15 MB/s | 17 MB 00:01 2024-03-18T14:45:47.828 INFO:teuthology.orchestra.run.smithi057.stdout:(13/31): ceph-common-17.2.7-684.g6716c9f3.el8.x 7.3 MB/s | 23 MB 00:03 2024-03-18T14:45:47.853 INFO:teuthology.orchestra.run.smithi057.stdout:(14/31): libcephfs-devel-17.2.7-684.g6716c9f3.e 90 kB/s | 25 kB 00:00 2024-03-18T14:45:47.903 INFO:teuthology.orchestra.run.smithi057.stdout:(15/31): librados-devel-17.2.7-684.g6716c9f3.el 2.5 MB/s | 130 kB 00:00 2024-03-18T14:45:47.945 INFO:teuthology.orchestra.run.smithi057.stdout:(16/31): libcephfs2-17.2.7-684.g6716c9f3.el8.x8 6.7 MB/s | 798 kB 00:00 2024-03-18T14:45:48.078 INFO:teuthology.orchestra.run.smithi057.stdout:(17/31): libradosstriper1-17.2.7-684.g6716c9f3. 3.7 MB/s | 505 kB 00:00 2024-03-18T14:45:48.162 INFO:teuthology.orchestra.run.smithi057.stdout:(18/31): librados2-17.2.7-684.g6716c9f3.el8.x86 13 MB/s | 3.5 MB 00:00 2024-03-18T14:45:48.496 INFO:teuthology.orchestra.run.smithi057.stdout:(19/31): librbd1-17.2.7-684.g6716c9f3.el8.x86_6 8.6 MB/s | 3.6 MB 00:00 2024-03-18T14:45:48.579 INFO:teuthology.orchestra.run.smithi057.stdout:(20/31): librgw2-17.2.7-684.g6716c9f3.el8.x86_6 13 MB/s | 5.6 MB 00:00 2024-03-18T14:45:48.630 INFO:teuthology.orchestra.run.smithi057.stdout:(21/31): python3-ceph-argparse-17.2.7-684.g6716 335 kB/s | 45 kB 00:00 2024-03-18T14:45:48.655 INFO:teuthology.orchestra.run.smithi057.stdout:(22/31): python3-ceph-common-17.2.7-684.g6716c9 1.5 MB/s | 117 kB 00:00 2024-03-18T14:45:48.697 INFO:teuthology.orchestra.run.smithi057.stdout:(23/31): python3-cephfs-17.2.7-684.g6716c9f3.el 2.8 MB/s | 190 kB 00:00 2024-03-18T14:45:48.722 INFO:teuthology.orchestra.run.smithi057.stdout:(24/31): python3-rados-17.2.7-684.g6716c9f3.el8 5.4 MB/s | 370 kB 00:00 2024-03-18T14:45:48.772 INFO:teuthology.orchestra.run.smithi057.stdout:(25/31): python3-rgw-17.2.7-684.g6716c9f3.el8.x 2.1 MB/s | 107 kB 00:00 2024-03-18T14:45:48.806 INFO:teuthology.orchestra.run.smithi057.stdout:(26/31): python3-rbd-17.2.7-684.g6716c9f3.el8.x 3.2 MB/s | 358 kB 00:00 2024-03-18T14:45:48.832 INFO:teuthology.orchestra.run.smithi057.stdout:(27/31): rbd-fuse-17.2.7-684.g6716c9f3.el8.x86_ 1.5 MB/s | 90 kB 00:00 2024-03-18T14:45:48.907 INFO:teuthology.orchestra.run.smithi057.stdout:(28/31): rbd-nbd-17.2.7-684.g6716c9f3.el8.x86_6 2.3 MB/s | 175 kB 00:00 2024-03-18T14:45:48.974 INFO:teuthology.orchestra.run.smithi057.stdout:(29/31): ceph-mgr-modules-core-17.2.7-684.g6716 3.5 MB/s | 239 kB 00:00 2024-03-18T14:45:49.217 INFO:teuthology.orchestra.run.smithi057.stdout:(30/31): rbd-mirror-17.2.7-684.g6716c9f3.el8.x8 8.4 MB/s | 3.5 MB 00:00 2024-03-18T14:45:53.483 INFO:teuthology.orchestra.run.smithi057.stdout:(31/31): ceph-test-17.2.7-684.g6716c9f3.el8.x86 7.9 MB/s | 52 MB 00:06 2024-03-18T14:45:53.486 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:45:53.487 INFO:teuthology.orchestra.run.smithi057.stdout:Total 15 MB/s | 144 MB 00:09 2024-03-18T14:45:53.487 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-18T14:45:53.556 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-18T14:45:53.556 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-18T14:45:54.290 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-18T14:45:54.293 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-18T14:45:56.555 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-18T14:45:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:17.2.7-684.g6716c9f3.el8.x86_64 1/1 2024-03-18T14:45:57.182 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:17.2.7-684.g6716c9f3.el8.x86_64 1/60 2024-03-18T14:45:57.604 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:17.2.7-684.g6716c9f3.el8.x86_64 1/60 2024-03-18T14:45:57.849 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:17.2.7-684.g6716c9f3.el8.x86_64 2/60 2024-03-18T14:45:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:17.2.7-684.g6716c9f3.el8.x86_64 2/60 2024-03-18T14:45:58.232 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libcephfs2-2:17.2.7-684.g6716c9f3.el8.x86_64 3/60 2024-03-18T14:45:58.335 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:17.2.7-684.g6716c9f3.el8.x86_64 3/60 2024-03-18T14:45:58.787 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-rados-2:17.2.7-684.g6716c9f3.el8.x86_64 4/60 2024-03-18T14:45:59.639 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-03-18T14:45:59.999 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librgw2-2:17.2.7-684.g6716c9f3.el8.x86_64 6/60 2024-03-18T14:46:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:17.2.7-684.g6716c9f3.el8.x86_64 6/60 2024-03-18T14:46:00.482 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:17.2.7-684.g6716c9f3.el8.x86_64 7/60 2024-03-18T14:46:00.595 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:17.2.7-684.g6716c9f3.el8.x86_64 7/60 2024-03-18T14:46:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libradosstriper1-2:17.2.7-684.g6716c9f3.el8.x86_64 8/60 2024-03-18T14:46:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:17.2.7-684.g6716c9f3.el8.x86_64 8/60 2024-03-18T14:46:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-684.g6716c9f3.el8.x 9/60 2024-03-18T14:46:01.321 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-cephfs-2:17.2.7-684.g6716c9f3.el8.x86_64 10/60 2024-03-18T14:46:01.579 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-rgw-2:17.2.7-684.g6716c9f3.el8.x86_64 11/60 2024-03-18T14:46:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-rbd-2:17.2.7-684.g6716c9f3.el8.x86_64 12/60 2024-03-18T14:46:02.161 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 13/60 2024-03-18T14:46:02.443 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-684.g6716c9f3.el8.n 14/60 2024-03-18T14:46:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-ceph-common-2:17.2.7-684.g6716c9f3.el8.x86 15/60 2024-03-18T14:46:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 16/60 2024-03-18T14:46:05.432 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 16/60 2024-03-18T14:46:06.110 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 16/60 2024-03-18T14:46:06.442 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-base-2:17.2.7-684.g6716c9f3.el8.x86_64 17/60 2024-03-18T14:46:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:17.2.7-684.g6716c9f3.el8.x86_64 17/60 2024-03-18T14:46:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-selinux-2:17.2.7-684.g6716c9f3.el8.x86_64 18/60 2024-03-18T14:46:26.110 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:17.2.7-684.g6716c9f3.el8.x86_64 18/60 2024-03-18T14:46:26.404 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-mds-2:17.2.7-684.g6716c9f3.el8.x86_64 19/60 2024-03-18T14:46:26.586 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:17.2.7-684.g6716c9f3.el8.x86_64 19/60 2024-03-18T14:46:26.889 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-mgr-2:17.2.7-684.g6716c9f3.el8.x86_64 20/60 2024-03-18T14:46:27.295 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:17.2.7-684.g6716c9f3.el8.x86_64 20/60 2024-03-18T14:46:27.570 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-mon-2:17.2.7-684.g6716c9f3.el8.x86_64 21/60 2024-03-18T14:46:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:17.2.7-684.g6716c9f3.el8.x86_64 21/60 2024-03-18T14:46:29.764 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-osd-2:17.2.7-684.g6716c9f3.el8.x86_64 22/60 2024-03-18T14:46:29.775 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:17.2.7-684.g6716c9f3.el8.x86_64 22/60 2024-03-18T14:46:32.009 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-2:17.2.7-684.g6716c9f3.el8.x86_64 23/60 2024-03-18T14:46:32.272 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-radosgw-2:17.2.7-684.g6716c9f3.el8.x86_64 24/60 2024-03-18T14:46:32.354 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-684.g6716c9f3.el8.x86_64 24/60 2024-03-18T14:46:32.637 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-684.g6716c9f3 25/60 2024-03-18T14:46:33.047 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-684.g6716c9f3 25/60 2024-03-18T14:46:33.344 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : rbd-mirror-2:17.2.7-684.g6716c9f3.el8.x86_64 26/60 2024-03-18T14:46:39.193 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:17.2.7-684.g6716c9f3.el8.x86_64 26/60 2024-03-18T14:46:39.664 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-test-2:17.2.7-684.g6716c9f3.el8.x86_64 27/60 2024-03-18T14:46:39.919 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libcephfs-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 28/60 2024-03-18T14:46:40.206 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : rbd-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 29/60 2024-03-18T14:46:40.517 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : rbd-nbd-2:17.2.7-684.g6716c9f3.el8.x86_64 30/60 2024-03-18T14:46:40.778 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : ceph-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 31/60 2024-03-18T14:46:40.886 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-03-18T14:46:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-03-18T14:46:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-03-18T14:46:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-03-18T14:46:41.388 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-03-18T14:46:41.586 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-03-18T14:46:41.592 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-03-18T14:46:41.593 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-03-18T14:46:41.794 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-03-18T14:46:41.952 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-03-18T14:46:41.959 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-03-18T14:46:41.959 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-03-18T14:46:42.161 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-03-18T14:46:42.319 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-03-18T14:46:42.494 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-03-18T14:46:42.501 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-03-18T14:46:42.501 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-03-18T14:46:42.705 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-03-18T14:46:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-03-18T14:46:42.713 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-03-18T14:46:43.027 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-03-18T14:46:43.033 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-03-18T14:46:43.034 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-03-18T14:46:43.236 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-03-18T14:46:43.242 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-03-18T14:46:43.243 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-03-18T14:46:43.427 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-03-18T14:46:43.427 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-03-18T14:46:43.562 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-03-18T14:46:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-03-18T14:46:43.590 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-03-18T14:46:43.925 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-03-18T14:46:43.925 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-03-18T14:46:44.135 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-03-18T14:46:44.136 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-03-18T14:46:44.336 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-03-18T14:46:44.552 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-03-18T14:46:44.777 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-03-18T14:46:44.777 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-03-18T14:46:45.061 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-03-18T14:46:45.277 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-03-18T14:46:45.277 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-03-18T14:46:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-03-18T14:46:45.768 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-03-18T14:46:45.768 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-03-18T14:46:46.045 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-03-18T14:46:46.201 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-03-18T14:46:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-03-18T14:46:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-03-18T14:46:46.720 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-03-18T14:46:46.721 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:17.2.7-684.g6716c9f3.el8.x86_64 1/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:17.2.7-684.g6716c9f3.el8.x86_64 3/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:17.2.7-684.g6716c9f3.el8.x86_64 5/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 7/60 2024-03-18T14:46:47.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 9/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-684.g6716c9f3 11/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:17.2.7-684.g6716c9f3.el8.x86_64 13/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:17.2.7-684.g6716c9f3.el8.x86_64 15/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:17.2.7-684.g6716c9f3.el8.x86_64 17/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:17.2.7-684.g6716c9f3.el8.x86_64 19/60 2024-03-18T14:46:47.494 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:17.2.7-684.g6716c9f3.el8.x86_64 21/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:17.2.7-684.g6716c9f3.el8.x86_64 23/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:17.2.7-684.g6716c9f3.el8.x86_64 25/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 27/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:17.2.7-684.g6716c9f3.el8.x86_64 29/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-03-18T14:46:47.495 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 31/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:17.2.7-684.g6716c9f3.el8.x86_64 33/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:17.2.7-684.g6716c9f3.el8.x86_64 35/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:17.2.7-684.g6716c9f3.el8.x86_64 37/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:17.2.7-684.g6716c9f3.el8.x86_64 39/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:17.2.7-684.g6716c9f3.el8.x 41/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-03-18T14:46:47.498 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:17.2.7-684.g6716c9f3.el8.x86 43/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:17.2.7-684.g6716c9f3.el8.x86_64 45/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:17.2.7-684.g6716c9f3.el8.x86_64 47/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:17.2.7-684.g6716c9f3.el8.x86_64 49/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:17.2.7-684.g6716c9f3.el8.x86_64 51/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 53/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:17.2.7-684.g6716c9f3.el8.x86_64 55/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:17.2.7-684.g6716c9f3.el8.x86_64 57/60 2024-03-18T14:46:47.499 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-03-18T14:46:47.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-684.g6716c9f3.el8.n 59/60 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.701 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:17.2.7-684.g6716c9f3.el8.noarch 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.702 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:17.2.7-684.g6716c9f3.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:17.2.7-684.g6716c9f3.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-03-18T14:46:48.703 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:48.704 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-18T14:46:48.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-03-18T14:46:49.144 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:46:49.170 INFO:teuthology.orchestra.run.smithi057.stdout:17.2.7-684.g6716c9f3.el8 2024-03-18T14:46:49.170 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-684.g6716c9f3.el8 2024-03-18T14:46:49.170 INFO:teuthology.task.install:The correct ceph version 17.2.7-684.g6716c9f3 is installed. 2024-03-18T14:46:49.172 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:46:49.182 INFO:teuthology.task.print:**** done install.upgrade the host 2024-03-18T14:46:49.182 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-03-18T14:46:49.206 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T14:46:49.207 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:46:49.222 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T14:46:49.223 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-18T14:46:49.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-18T14:46:49.265 INFO:tasks.ceph.mon.a:Started 2024-03-18T14:46:49.266 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T14:46:49.266 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:46:49.279 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T14:46:49.279 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-18T14:46:49.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-18T14:46:49.321 INFO:tasks.ceph.mon.b:Started 2024-03-18T14:46:49.322 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T14:46:49.322 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:46:49.334 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T14:46:49.334 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-18T14:46:49.334 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-18T14:46:49.376 INFO:tasks.ceph.mon.c:Started 2024-03-18T14:46:49.376 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T14:46:49.376 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:46:49.395 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T14:46:49.395 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-18T14:46:49.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-18T14:46:49.437 INFO:tasks.ceph.mgr.x:Started 2024-03-18T14:46:49.437 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T14:46:49.438 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:46:49.459 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T14:46:49.460 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-18T14:46:49.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-18T14:46:49.502 INFO:tasks.ceph.mgr.y:Started 2024-03-18T14:46:49.502 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-03-18T14:46:49.513 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T14:46:49.513 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T14:46:49.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T14:46:49.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.646+0000 7f35dc0c7700 1 Processor -- start 2024-03-18T14:46:49.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 -- start start 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d40a77d0 con 0x7f35d40a4cb0 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d413fc50 con 0x7f35d40b3550 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35dc0c7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d413fef0 con 0x7f35d40a72d0 2024-03-18T14:46:49.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35d9e63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35da664700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35d9e63700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33372/0 (socket says 172.21.15.57:33372) 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35d9e63700 1 -- 172.21.15.57:0/4094045864 learned_addr learned my addr 172.21.15.57:0/4094045864 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.647+0000 7f35da664700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54102/0 (socket says 172.21.15.57:54102) 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35da664700 1 -- 172.21.15.57:0/4094045864 >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 msgr2=0x7f35d40a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35da664700 1 --2- 172.21.15.57:0/4094045864 >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35da664700 1 -- 172.21.15.57:0/4094045864 >> v1:172.21.15.57:6789/0 conn(0x7f35d40a4cb0 legacy=0x7f35d40afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35da664700 1 -- 172.21.15.57:0/4094045864 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d40b0220 con 0x7f35d40a72d0 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35d9e63700 1 --2- 172.21.15.57:0/4094045864 >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:49.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35da664700 1 --2- 172.21.15.57:0/4094045864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e60 tx=0x7f35cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe2b14d7842adbb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35d8e61700 1 -- 172.21.15.57:0/4094045864 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc00e070 con 0x7f35d40a72d0 2024-03-18T14:46:49.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35d8e61700 1 -- 172.21.15.57:0/4094045864 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc00bb60 con 0x7f35d40a72d0 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.648+0000 7f35d8e61700 1 -- 172.21.15.57:0/4094045864 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc012430 con 0x7f35d40a72d0 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 -- 172.21.15.57:0/4094045864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 msgr2=0x7f35d4146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/4094045864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009e60 tx=0x7f35cc009780 comp rx=0 tx=0).stop 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 -- 172.21.15.57:0/4094045864 shutdown_connections 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/4094045864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a72d0 0x7f35d4146be0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/4094045864 >> v2:172.21.15.57:3300/0 conn(0x7f35d40b3550 0x7f35d40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 -- 172.21.15.57:0/4094045864 >> 172.21.15.57:0/4094045864 conn(0x7f35d406e2c0 msgr2=0x7f35d406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 -- 172.21.15.57:0/4094045864 shutdown_connections 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.649+0000 7f35dc0c7700 1 -- 172.21.15.57:0/4094045864 wait complete. 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.650+0000 7f35dc0c7700 1 Processor -- start 2024-03-18T14:46:49.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.650+0000 7f35dc0c7700 1 -- start start 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35d40a72d0 0x7f35d40adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 0x7f35d414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40aea50 con 0x7f35d40b3550 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40ae7b0 con 0x7f35d40a72d0 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35dc0c7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35d40a2c20 con 0x7f35d40a4cb0 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35da664700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 0x7f35d414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54110/0 (socket says 172.21.15.57:54110) 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 -- 172.21.15.57:0/1846247381 learned_addr learned my addr 172.21.15.57:0/1846247381 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9662700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35d40a72d0 0x7f35d40adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 -- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35d40a72d0 msgr2=0x7f35d40adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35d40a72d0 0x7f35d40adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 -- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 msgr2=0x7f35d414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 0x7f35d414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.651+0000 7f35d9e63700 1 -- 172.21.15.57:0/1846247381 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00094f0 con 0x7f35d40a4cb0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35da664700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 0x7f35d414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35d9e63700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009f70 tx=0x7f35d0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0013930 con 0x7f35d40a4cb0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0013a90 con 0x7f35d40a4cb0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0013e10 con 0x7f35d40a4cb0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc009a20 con 0x7f35d40a4cb0 2024-03-18T14:46:49.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.652+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d40ae320 con 0x7f35d40a4cb0 2024-03-18T14:46:49.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.654+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d40a2e40 con 0x7f35d40a4cb0 2024-03-18T14:46:49.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.655+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f35d000c7f0 con 0x7f35d40a4cb0 2024-03-18T14:46:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.655+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f35d004fe30 con 0x7f35d40a4cb0 2024-03-18T14:46:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.655+0000 7f35d9662700 1 -- 172.21.15.57:0/1846247381 >> v1:172.21.15.57:6816/39496 conn(0x7f35b80394d0 legacy=0x7f35b803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:49.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.657+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f35d000caa0 con 0x7f35d40a4cb0 2024-03-18T14:46:49.761 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:49.759+0000 7f08da5be1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T14:46:49.763 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:49.761+0000 7f22215ba1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T14:46:49.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.819+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f35d4065180 con 0x7f35d40a4cb0 2024-03-18T14:46:49.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.821+0000 7f35c9ffb700 1 -- 172.21.15.57:0/1846247381 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+85064 (secure 0 0 0) 0x7f35d000cd20 con 0x7f35d40a4cb0 2024-03-18T14:46:49.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:49.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 >> v1:172.21.15.57:6816/39496 conn(0x7f35b80394d0 legacy=0x7f35b803b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:49.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 msgr2=0x7f35d40af3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009f70 tx=0x7f35d0009250 comp rx=0 tx=0).stop 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 shutdown_connections 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f35d40b3550 0x7f35d414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f35d40a4cb0 0x7f35d40af3f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 --2- 172.21.15.57:0/1846247381 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f35d40a72d0 0x7f35d40adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 >> 172.21.15.57:0/1846247381 conn(0x7f35d406e2c0 msgr2=0x7f35d40b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 shutdown_connections 2024-03-18T14:46:49.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.823+0000 7f35dc0c7700 1 -- 172.21.15.57:0/1846247381 wait complete. 2024-03-18T14:46:49.837 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":6,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":39496}]},"active_addr":"172.21.15.57:6816/39496","active_change":"2024-03-18T14:40:56.396537+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2355346234}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2550387238}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1711862619}]}]} 2024-03-18T14:46:49.839 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T14:46:49.840 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T14:46:49.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:46:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.963+0000 7facb6e81700 1 Processor -- start 2024-03-18T14:46:49.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.963+0000 7facb6e81700 1 -- start start 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facb6e81700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00ac250 0x7facb0139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facb6e81700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0139cc0 0x7facb0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facb6e81700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb00ada50 con 0x7facb0063ac0 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facb6e81700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb00a6370 con 0x7facb00ac250 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facb6e81700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb0063e90 con 0x7facb0139cc0 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.964+0000 7facaffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00ac250 0x7facb0139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7facb00ac250 0x7facb0139780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33392/0 (socket says 172.21.15.57:33392) 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 -- 172.21.15.57:0/3825888674 learned_addr learned my addr 172.21.15.57:0/3825888674 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:49.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facb4c1d700 1 --1- 172.21.15.57:0/3825888674 >> v1:172.21.15.57:6789/0 conn(0x7facb0063ac0 0x7facb00a5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49680/0 (socket says 172.21.15.57:49680) 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facb541e700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0139cc0 0x7facb0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 -- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0139cc0 msgr2=0x7facb0146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0139cc0 0x7facb0146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 -- 172.21.15.57:0/3825888674 >> v1:172.21.15.57:6789/0 conn(0x7facb0063ac0 legacy=0x7facb00a5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 -- 172.21.15.57:0/3825888674 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb00aae00 con 0x7facb00ac250 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaf7fe700 1 -- 172.21.15.57:0/3825888674 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705172143 0 0) 0x7facb00ada50 con 0x7facb0063ac0 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaffff700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb0139780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1866aa5c96daeeeb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaf7fe700 1 -- 172.21.15.57:0/3825888674 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c009ea0 con 0x7facb00ac250 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaf7fe700 1 -- 172.21.15.57:0/3825888674 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00b8f0 con 0x7facb00ac250 2024-03-18T14:46:49.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.965+0000 7facaf7fe700 1 -- 172.21.15.57:0/3825888674 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00bc90 con 0x7facb00ac250 2024-03-18T14:46:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 -- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 msgr2=0x7facb0139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb0139780 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0099b0 tx=0x7fac9c009250 comp rx=0 tx=0).stop 2024-03-18T14:46:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 -- 172.21.15.57:0/3825888674 shutdown_connections 2024-03-18T14:46:49.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0139cc0 0x7facb0146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 --2- 172.21.15.57:0/3825888674 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb0139780 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 -- 172.21.15.57:0/3825888674 >> 172.21.15.57:0/3825888674 conn(0x7facb006f4f0 msgr2=0x7facb006f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 -- 172.21.15.57:0/3825888674 shutdown_connections 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.966+0000 7facb6e81700 1 -- 172.21.15.57:0/3825888674 wait complete. 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.967+0000 7facb6e81700 1 Processor -- start 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 -- start start 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0063ac0 0x7facb00a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7facb0139cc0 0x7facb01374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb00a9770 con 0x7facb00ac250 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb00a9970 con 0x7facb0063ac0 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facb6e81700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facb014bf60 con 0x7facb0139cc0 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.968+0000 7facaffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33396/0 (socket says 172.21.15.57:33396) 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 -- 172.21.15.57:0/2432743743 learned_addr learned my addr 172.21.15.57:0/2432743743 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facb4c1d700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0063ac0 0x7facb00a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facb541e700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7facb0139cc0 0x7facb01374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 -- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7facb0139cc0 msgr2=0x7facb01374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7facb0139cc0 0x7facb01374a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 -- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0063ac0 msgr2=0x7facb00a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0063ac0 0x7facb00a8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 -- 172.21.15.57:0/2432743743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0094f0 con 0x7facb00ac250 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facaffff700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7facb013a120 tx=0x7fac9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c000d10 con 0x7facb00ac250 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00bc70 con 0x7facb00ac250 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb014c200 con 0x7facb00ac250 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011670 con 0x7facb00ac250 2024-03-18T14:46:49.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.969+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb00a6ad0 con 0x7facb00ac250 2024-03-18T14:46:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.970+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fac9c011a20 con 0x7facb00ac250 2024-03-18T14:46:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.971+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb01405b0 con 0x7facb00ac250 2024-03-18T14:46:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.971+0000 7facb4c1d700 1 -- 172.21.15.57:0/2432743743 >> v1:172.21.15.57:6816/39496 conn(0x7fac940394d0 legacy=0x7fac9403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:49.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.971+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fac9c04d0e0 con 0x7facb00ac250 2024-03-18T14:46:49.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:49.974+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fac9c0085f0 con 0x7facb00ac250 2024-03-18T14:46:50.039 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.037+0000 7f22215ba1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T14:46:50.039 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.037+0000 7f08da5be1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T14:46:50.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.102+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facb00abfa0 con 0x7facb00ac250 2024-03-18T14:46:50.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.103+0000 7facacff9700 1 -- 172.21.15.57:0/2432743743 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11292 (secure 0 0 0) 0x7fac9c015090 con 0x7facb00ac250 2024-03-18T14:46:50.105 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:50.105 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:28.287790+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 >> v1:172.21.15.57:6816/39496 conn(0x7fac940394d0 legacy=0x7fac9403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 msgr2=0x7facb00a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7facb013a120 tx=0x7fac9c017000 comp rx=0 tx=0).stop 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 shutdown_connections 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7facb0139cc0 0x7facb01374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7facb0063ac0 0x7facb00a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 --2- 172.21.15.57:0/2432743743 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7facb00ac250 0x7facb00a9e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.104+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 >> 172.21.15.57:0/2432743743 conn(0x7facb006f4f0 msgr2=0x7facb00a5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.105+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 shutdown_connections 2024-03-18T14:46:50.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.105+0000 7facb6e81700 1 -- 172.21.15.57:0/2432743743 wait complete. 2024-03-18T14:46:50.119 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T14:46:50.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:46:50.178 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.176+0000 7f22215ba1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T14:46:50.180 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.178+0000 7f08da5be1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T14:46:50.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.251+0000 7f9de369e700 1 Processor -- start 2024-03-18T14:46:50.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.251+0000 7f9de369e700 1 -- start start 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.251+0000 7f9de369e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 0x7f9ddc06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de369e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de369e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc0ac720 con 0x7f9ddc063a90 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de369e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ddc06d230 con 0x7f9ddc0ad300 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de369e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0ac9c0 con 0x7f9ddc13dd60 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de0c39700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 0x7f9ddc06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53496/0 (socket says 172.21.15.57:53496) 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 -- 172.21.15.57:0/856368589 learned_addr learned my addr 172.21.15.57:0/856368589 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 -- 172.21.15.57:0/856368589 >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 msgr2=0x7f9ddc06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 --2- 172.21.15.57:0/856368589 >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 0x7f9ddc06dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 -- 172.21.15.57:0/856368589 >> v1:172.21.15.57:6789/0 conn(0x7f9ddc063a90 legacy=0x7f9ddc13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 -- 172.21.15.57:0/856368589 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc0ad810 con 0x7f9ddc13dd60 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de0c39700 1 --2- 172.21.15.57:0/856368589 >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 0x7f9ddc06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9de1c3b700 1 --2- 172.21.15.57:0/856368589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009f20 tx=0x7f9dd4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=918de093acf0c5fb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.252+0000 7f9dd3fff700 1 -- 172.21.15.57:0/856368589 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400e070 con 0x7f9ddc13dd60 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9dd3fff700 1 -- 172.21.15.57:0/856368589 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd400b9d0 con 0x7f9ddc13dd60 2024-03-18T14:46:50.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9dd3fff700 1 -- 172.21.15.57:0/856368589 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40092e0 con 0x7f9ddc13dd60 2024-03-18T14:46:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 -- 172.21.15.57:0/856368589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 msgr2=0x7f9ddc148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 --2- 172.21.15.57:0/856368589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009f20 tx=0x7f9dd4009840 comp rx=0 tx=0).stop 2024-03-18T14:46:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 -- 172.21.15.57:0/856368589 shutdown_connections 2024-03-18T14:46:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 --2- 172.21.15.57:0/856368589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc13dd60 0x7f9ddc148ae0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 --2- 172.21.15.57:0/856368589 >> v2:172.21.15.57:3300/0 conn(0x7f9ddc0ad300 0x7f9ddc06dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.253+0000 7f9de369e700 1 -- 172.21.15.57:0/856368589 >> 172.21.15.57:0/856368589 conn(0x7f9ddc06f500 msgr2=0x7f9ddc06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.254+0000 7f9de369e700 1 -- 172.21.15.57:0/856368589 shutdown_connections 2024-03-18T14:46:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.254+0000 7f9de369e700 1 -- 172.21.15.57:0/856368589 wait complete. 2024-03-18T14:46:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.255+0000 7f9de369e700 1 Processor -- start 2024-03-18T14:46:50.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.255+0000 7f9de369e700 1 -- start start 2024-03-18T14:46:50.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc063a90 0x7f9ddc0b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9ddc13dd60 0x7f9ddc14ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc13b050 con 0x7f9ddc0ad300 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0b0000 con 0x7f9ddc063a90 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de369e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc14dc10 con 0x7f9ddc13dd60 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de0c39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de143a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc063a90 0x7f9ddc0b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de0c39700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33412/0 (socket says 172.21.15.57:33412) 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de0c39700 1 -- 172.21.15.57:0/3237648907 learned_addr learned my addr 172.21.15.57:0/3237648907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.256+0000 7f9de1c3b700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9ddc13dd60 0x7f9ddc14ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 -- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9ddc13dd60 msgr2=0x7f9ddc14ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9ddc13dd60 0x7f9ddc14ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 -- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc063a90 msgr2=0x7f9ddc0b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc063a90 0x7f9ddc0b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 -- 172.21.15.57:0/3237648907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc009420 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de0c39700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00ec80 tx=0x7f9dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00c920 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00ca80 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd4009ae0 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00ce00 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.257+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc11aa80 con 0x7f9ddc0ad300 2024-03-18T14:46:50.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.258+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f9dcc013680 con 0x7f9ddc0ad300 2024-03-18T14:46:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.258+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9dcc04bb70 con 0x7f9ddc0ad300 2024-03-18T14:46:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.258+0000 7f9de143a700 1 -- 172.21.15.57:0/3237648907 >> v1:172.21.15.57:6816/39496 conn(0x7f9dc00394d0 legacy=0x7f9dc003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.258+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc0b2190 con 0x7f9ddc0ad300 2024-03-18T14:46:50.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.262+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f9ddc0b2190 con 0x7f9ddc0ad300 2024-03-18T14:46:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.409+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ddc0b2190 con 0x7f9ddc0ad300 2024-03-18T14:46:50.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.410+0000 7f9dd17fa700 1 -- 172.21.15.57:0/3237648907 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11292 (secure 0 0 0) 0x7f9ddc0b2190 con 0x7f9ddc0ad300 2024-03-18T14:46:50.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:50.411 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":19,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:41:28.287790+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:46:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 >> v1:172.21.15.57:6816/39496 conn(0x7f9dc00394d0 legacy=0x7f9dc003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 msgr2=0x7f9ddc11a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00ec80 tx=0x7f9dcc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 shutdown_connections 2024-03-18T14:46:50.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9ddc13dd60 0x7f9ddc14ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9ddc063a90 0x7f9ddc0b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 --2- 172.21.15.57:0/3237648907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ddc0ad300 0x7f9ddc11a020 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 >> 172.21.15.57:0/3237648907 conn(0x7f9ddc06f500 msgr2=0x7f9ddc144d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 shutdown_connections 2024-03-18T14:46:50.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.411+0000 7f9de369e700 1 -- 172.21.15.57:0/3237648907 wait complete. 2024-03-18T14:46:50.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T14:46:50.426 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T14:46:50.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T14:46:50.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T14:46:50.520 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.518+0000 7f08da5be1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T14:46:50.537 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.536+0000 7f22215ba1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T14:46:50.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.579+0000 7f8b0cd68700 1 Processor -- start 2024-03-18T14:46:50.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.580+0000 7f8b0cd68700 1 -- start start 2024-03-18T14:46:50.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0cd68700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080b23a0 0x7f8b080a1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0cd68700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b080a2390 0x7f8b080679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0cd68700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b080a2dc0 con 0x7f8b08067f20 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0cd68700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b080a4080 con 0x7f8b080a2390 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0cd68700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080a4320 con 0x7f8b080b23a0 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b080a2390 0x7f8b080679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b080a2390 0x7f8b080679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33428/0 (socket says 172.21.15.57:33428) 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 -- 172.21.15.57:0/4202373419 learned_addr learned my addr 172.21.15.57:0/4202373419 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b0659c700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080b23a0 0x7f8b080a1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 -- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080b23a0 msgr2=0x7f8b080a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080b23a0 0x7f8b080a1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 -- 172.21.15.57:0/4202373419 >> v1:172.21.15.57:6789/0 conn(0x7f8b08067f20 legacy=0x7f8b081465b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.581+0000 7f8b05d9b700 1 -- 172.21.15.57:0/4202373419 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b080a2ae0 con 0x7f8b080a2390 2024-03-18T14:46:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.582+0000 7fc5f54eb700 1 Processor -- start 2024-03-18T14:46:50.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.582+0000 7f8b05d9b700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b080a2390 0x7f8b080679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8af80099b0 tx=0x7f8af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd885cd150ed7cc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.582+0000 7fc5f54eb700 1 -- start start 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5f54eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f0063820 0x7fc5f00a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5f54eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f0146990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5f54eb700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f00ae140 con 0x7fc5f00adb90 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5f54eb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00adf60 con 0x7fc5f0132800 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5f54eb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00aed80 con 0x7fc5f0063820 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ee7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc5f00adb90 0x7fc5f01320f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49716/0 (socket says 172.21.15.57:49716) 2024-03-18T14:46:50.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ee7fc700 1 -- 172.21.15.57:0/3935565841 learned_addr learned my addr 172.21.15.57:0/3935565841 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5eeffd700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f0063820 0x7fc5f00a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ef7fe700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f0146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ef7fe700 1 -- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f0063820 msgr2=0x7fc5f00a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ef7fe700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f0063820 0x7fc5f00a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ef7fe700 1 -- 172.21.15.57:0/3935565841 >> v1:172.21.15.57:6789/0 conn(0x7fc5f00adb90 legacy=0x7fc5f01320f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.583+0000 7fc5ef7fe700 1 -- 172.21.15.57:0/3935565841 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f00ae3e0 con 0x7fc5f0132800 2024-03-18T14:46:50.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7fc5ef7fe700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f0146990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009e90 tx=0x7fc5e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b3cb0ebee1652ff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7fc5edffb700 1 -- 172.21.15.57:0/3935565841 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e800e070 con 0x7fc5f0132800 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7fc5edffb700 1 -- 172.21.15.57:0/3935565841 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e800bc30 con 0x7fc5f0132800 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7fc5edffb700 1 -- 172.21.15.57:0/3935565841 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8012430 con 0x7fc5f0132800 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7f8b0559a700 1 -- 172.21.15.57:0/4202373419 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800b860 con 0x7f8b080a2390 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7f8b0559a700 1 -- 172.21.15.57:0/4202373419 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800b9c0 con 0x7f8b080a2390 2024-03-18T14:46:50.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.584+0000 7f8b0559a700 1 -- 172.21.15.57:0/4202373419 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800bd60 con 0x7f8b080a2390 2024-03-18T14:46:50.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.585+0000 7fc5f54eb700 1 -- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 msgr2=0x7fc5f0146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.585+0000 7fc5f54eb700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f0146990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009e90 tx=0x7fc5e8009780 comp rx=0 tx=0).stop 2024-03-18T14:46:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 -- 172.21.15.57:0/3935565841 shutdown_connections 2024-03-18T14:46:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f0146990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 --2- 172.21.15.57:0/3935565841 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f0063820 0x7fc5f00a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 -- 172.21.15.57:0/3935565841 >> 172.21.15.57:0/3935565841 conn(0x7fc5f006a4d0 msgr2=0x7fc5f006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 -- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b080a2390 msgr2=0x7f8b080679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b080a2390 0x7f8b080679e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8af80099b0 tx=0x7f8af8009250 comp rx=0 tx=0).stop 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 -- 172.21.15.57:0/3935565841 shutdown_connections 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 -- 172.21.15.57:0/4202373419 shutdown_connections 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080b23a0 0x7f8b080a1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 --2- 172.21.15.57:0/4202373419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b080a2390 0x7f8b080679e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 -- 172.21.15.57:0/4202373419 >> 172.21.15.57:0/4202373419 conn(0x7f8b0806d1f0 msgr2=0x7f8b0806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7fc5f54eb700 1 -- 172.21.15.57:0/3935565841 wait complete. 2024-03-18T14:46:50.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 -- 172.21.15.57:0/4202373419 shutdown_connections 2024-03-18T14:46:50.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.589+0000 7f8b0cd68700 1 -- 172.21.15.57:0/4202373419 wait complete. 2024-03-18T14:46:50.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.590+0000 7f8b0cd68700 1 Processor -- start 2024-03-18T14:46:50.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.590+0000 7f8b0cd68700 1 -- start start 2024-03-18T14:46:50.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.590+0000 7fc5f54eb700 1 Processor -- start 2024-03-18T14:46:50.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 -- start start 2024-03-18T14:46:50.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b08067f20 0x7f8b080ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080a2390 0x7f8b080ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 0x7fc5f00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f00adb90 0x7fc5f015ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f015e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00a6ab0 con 0x7fc5f0063820 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00a9ea0 con 0x7fc5f0132800 2024-03-18T14:46:50.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7fc5f54eb700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f00ab3c0 con 0x7fc5f00adb90 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b080b23a0 0x7f8b08155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b08148ae0 con 0x7f8b08067f20 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080aa840 con 0x7f8b080a2390 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.591+0000 7f8b0cd68700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b080aaae0 con 0x7f8b080b23a0 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b0659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b08067f20 0x7f8b080ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b0659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b08067f20 0x7f8b080ae430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33440/0 (socket says 172.21.15.57:33440) 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b0659c700 1 -- 172.21.15.57:0/2534190709 learned_addr learned my addr 172.21.15.57:0/2534190709 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 --2- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b080b23a0 0x7f8b08155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7fc5eeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 0x7fc5f00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7fc5eeffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 0x7fc5f00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33454/0 (socket says 172.21.15.57:33454) 2024-03-18T14:46:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7fc5eeffd700 1 -- 172.21.15.57:0/4288338799 learned_addr learned my addr 172.21.15.57:0/4288338799 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 -- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080a2390 msgr2=0x7f8b080ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 --2- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b080a2390 0x7f8b080ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 -- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b08067f20 msgr2=0x7f8b080ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 --2- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b08067f20 0x7f8b080ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.592+0000 7f8b06d9d700 1 -- 172.21.15.57:0/2534190709 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80094f0 con 0x7f8b080b23a0 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8b06d9d700 1 --2- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b080b23a0 0x7f8b08155df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c790 tx=0x7f8b000015f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00012630 con 0x7f8b080b23a0 2024-03-18T14:46:50.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 -- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f00adb90 msgr2=0x7fc5f015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 --2- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5f00adb90 0x7fc5f015ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 -- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 msgr2=0x7fc5f015e2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 --2- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc5f0132800 0x7fc5f015e2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 -- 172.21.15.57:0/4288338799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e8009a20 con 0x7fc5f0063820 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5eeffd700 1 --2- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 0x7fc5f00a94d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ec80 tx=0x7fc5e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b000127b0 con 0x7f8b080b23a0 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b00012b70 con 0x7f8b080b23a0 2024-03-18T14:46:50.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b080adff0 con 0x7f8b080b23a0 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b080ac420 con 0x7f8b080b23a0 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e000c9d0 con 0x7fc5f0063820 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e000cb30 con 0x7fc5f0063820 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.593+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0013470 con 0x7fc5f0063820 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.594+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f00ab040 con 0x7fc5f0063820 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.594+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f00a9a10 con 0x7fc5f0063820 2024-03-18T14:46:50.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f8b00011380 con 0x7f8b080b23a0 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8b0004b710 con 0x7f8b080b23a0 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7f8b0659c700 1 -- 172.21.15.57:0/2534190709 >> v1:172.21.15.57:6816/39496 conn(0x7f8ae8039520 legacy=0x7f8ae803b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5f0065180 con 0x7fc5f0063820 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fc5e00137e0 con 0x7fc5f0063820 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc5e004bc00 con 0x7fc5f0063820 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.595+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 --> v1:172.21.15.57:6812/40093 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5dc045ea0 con 0x7fc5dc0421c0 2024-03-18T14:46:50.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.596+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 --> v1:172.21.15.57:6808/40092 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8b0809f260 con 0x7f8b08128620 2024-03-18T14:46:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.596+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5e0033f40 con 0x7fc5f0063820 2024-03-18T14:46:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.596+0000 7fc5ee7fc700 1 -- 172.21.15.57:0/4288338799 >> v1:172.21.15.57:6816/39496 conn(0x7fc5dc039520 legacy=0x7fc5dc03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.597+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== osd.2 v1:172.21.15.57:6808/40092 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f8b0809f260 con 0x7f8b08128620 2024-03-18T14:46:50.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.601+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== osd.3 v1:172.21.15.57:6812/40093 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fc5dc045ea0 con 0x7fc5dc0421c0 2024-03-18T14:46:50.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.617+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 --> v1:172.21.15.57:6808/40092 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b080aef40 con 0x7f8b08128620 2024-03-18T14:46:50.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.617+0000 7f8afe7fc700 1 -- 172.21.15.57:0/2534190709 <== osd.2 v1:172.21.15.57:6808/40092 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2086242460) 0x7f8b080aef40 con 0x7f8b08128620 2024-03-18T14:46:50.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.618+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 >> v1:172.21.15.57:6808/40092 conn(0x7f8b08128620 legacy=0x7f8b08156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.618+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 >> v1:172.21.15.57:6816/39496 conn(0x7f8ae8039520 legacy=0x7f8ae803b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.618+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b080b23a0 msgr2=0x7f8b08155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.618+0000 7f8b0cd68700 1 --2- 172.21.15.57:0/2534190709 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b080b23a0 0x7f8b08155df0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c790 tx=0x7f8b000015f0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.619+0000 7f8b06d9d700 1 -- 172.21.15.57:0/2534190709 reap_dead start 2024-03-18T14:46:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.619+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 shutdown_connections 2024-03-18T14:46:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.619+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 >> 172.21.15.57:0/2534190709 conn(0x7f8b0806d1f0 msgr2=0x7f8b081499c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.620+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 shutdown_connections 2024-03-18T14:46:50.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.620+0000 7f8b0cd68700 1 -- 172.21.15.57:0/2534190709 wait complete. 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.621+0000 7fecd7015700 1 Processor -- start 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.621+0000 7fecd7015700 1 -- start start 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd7015700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 0x7fecd006f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd7015700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd7015700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd006e750 con 0x7fecd006df00 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd7015700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd013f680 con 0x7fecd0069450 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd7015700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00a36c0 con 0x7fecd013f240 2024-03-18T14:46:50.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd55b2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd55b2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53536/0 (socket says 172.21.15.57:53536) 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.622+0000 7fecd55b2700 1 -- 172.21.15.57:0/2684624755 learned_addr learned my addr 172.21.15.57:0/2684624755 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd55b2700 1 -- 172.21.15.57:0/2684624755 >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 msgr2=0x7fecd006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd4db1700 1 --2- 172.21.15.57:0/2684624755 >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 0x7fecd006f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd55b2700 1 --2- 172.21.15.57:0/2684624755 >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 0x7fecd006f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd55b2700 1 -- 172.21.15.57:0/2684624755 >> v1:172.21.15.57:6789/0 conn(0x7fecd006df00 legacy=0x7fecd013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd55b2700 1 -- 172.21.15.57:0/2684624755 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd006eed0 con 0x7fecd013f240 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd4db1700 1 --2- 172.21.15.57:0/2684624755 >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 0x7fecd006f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:46:50.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.623+0000 7fecd55b2700 1 --2- 172.21.15.57:0/2684624755 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009f20 tx=0x7fecc8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ed17a37fa53cb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 --> v1:172.21.15.57:6812/40093 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5f012a820 con 0x7fc5dc0421c0 2024-03-18T14:46:50.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.628+0000 7fc5d6ffd700 1 -- 172.21.15.57:0/4288338799 <== osd.3 v1:172.21.15.57:6812/40093 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2385644447) 0x7fc5f012a820 con 0x7fc5dc0421c0 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.626+0000 7feccf7fe700 1 -- 172.21.15.57:0/2684624755 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800e070 con 0x7fecd013f240 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.626+0000 7feccf7fe700 1 -- 172.21.15.57:0/2684624755 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc800ba80 con 0x7fecd013f240 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.626+0000 7feccf7fe700 1 -- 172.21.15.57:0/2684624755 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80092e0 con 0x7fecd013f240 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 -- 172.21.15.57:0/2684624755 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 msgr2=0x7fecd0145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 --2- 172.21.15.57:0/2684624755 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009f20 tx=0x7fecc8009840 comp rx=0 tx=0).stop 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 -- 172.21.15.57:0/2684624755 shutdown_connections 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 --2- 172.21.15.57:0/2684624755 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0145b60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 --2- 172.21.15.57:0/2684624755 >> v2:172.21.15.57:3300/0 conn(0x7fecd0069450 0x7fecd006f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.627+0000 7fecd7015700 1 -- 172.21.15.57:0/2684624755 >> 172.21.15.57:0/2684624755 conn(0x7fecd006ce30 msgr2=0x7fecd0068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.628+0000 7fecd7015700 1 -- 172.21.15.57:0/2684624755 shutdown_connections 2024-03-18T14:46:50.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.628+0000 7f79b1fc7700 1 Processor -- start 2024-03-18T14:46:50.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.628+0000 7f79b1fc7700 1 -- start start 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7f79b1fc7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 0x7f79ac0a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7f79b1fc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac145c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7f79b1fc7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac13be70 con 0x7f79ac0a4910 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7f79b1fc7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac13af20 con 0x7f79ac143850 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7f79b1fc7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0a3c40 con 0x7f79ac0b22a0 2024-03-18T14:46:50.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.630+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 >> v1:172.21.15.57:6812/40093 conn(0x7fc5dc0421c0 legacy=0x7fc5dc044630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.630+0000 7f79abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53552/0 (socket says 172.21.15.57:53552) 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79abfff700 1 -- 172.21.15.57:0/422994775 learned_addr learned my addr 172.21.15.57:0/422994775 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79ab7fe700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 0x7f79ac0a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79ab7fe700 1 -- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 msgr2=0x7f79ac145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79ab7fe700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79ab7fe700 1 -- 172.21.15.57:0/422994775 >> v1:172.21.15.57:6789/0 conn(0x7f79ac0a4910 legacy=0x7f79ac13b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7f79ab7fe700 1 -- 172.21.15.57:0/422994775 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac13b110 con 0x7f79ac0b22a0 2024-03-18T14:46:50.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 >> v1:172.21.15.57:6816/39496 conn(0x7fc5dc039520 legacy=0x7fc5dc03b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 msgr2=0x7fc5f00a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fc5f54eb700 1 --2- 172.21.15.57:0/4288338799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc5f0063820 0x7fc5f00a94d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000ec80 tx=0x7fc5e00091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fc5ef7fe700 1 -- 172.21.15.57:0/4288338799 reap_dead start 2024-03-18T14:46:50.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 shutdown_connections 2024-03-18T14:46:50.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 >> 172.21.15.57:0/4288338799 conn(0x7fc5f006a4d0 msgr2=0x7fc5f006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 shutdown_connections 2024-03-18T14:46:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fc5f54eb700 1 -- 172.21.15.57:0/4288338799 wait complete. 2024-03-18T14:46:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7f79ab7fe700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 0x7f79ac0a3030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7994009910 tx=0x7f79940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d21a32e923a35a5a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.629+0000 7fecd7015700 1 -- 172.21.15.57:0/2684624755 wait complete. 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.630+0000 7fecd7015700 1 Processor -- start 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 -- start start 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd0069450 0x7fecd013c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fecd006df00 0x7fecd01400d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0087510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd013fc40 con 0x7fecd0069450 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd013e030 con 0x7fecd013f240 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.631+0000 7fecd7015700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecd013b3e0 con 0x7fecd006df00 2024-03-18T14:46:50.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fecd55b2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0087510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fecd55b2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0087510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53558/0 (socket says 172.21.15.57:53558) 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7fecd55b2700 1 -- 172.21.15.57:0/898687380 learned_addr learned my addr 172.21.15.57:0/898687380 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 --2- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fecd006df00 0x7fecd01400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 -- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 msgr2=0x7fecd0087510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 --2- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fecd013f240 0x7fecd0087510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 -- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd0069450 msgr2=0x7fecd013c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 --2- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fecd0069450 0x7fecd013c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.632+0000 7feccffff700 1 -- 172.21.15.57:0/898687380 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009ae0 con 0x7fecd006df00 2024-03-18T14:46:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.633+0000 7feccffff700 1 --2- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fecd006df00 0x7fecd01400d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c5f0 tx=0x7fecc4007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.641 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.636+0000 7f08da5be1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T14:46:50.641 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.638+0000 7f22215ba1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7f79aaffd700 1 -- 172.21.15.57:0/422994775 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994011630 con 0x7f79ac0b22a0 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7f79aaffd700 1 -- 172.21.15.57:0/422994775 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994011790 con 0x7f79ac0b22a0 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7f79aaffd700 1 -- 172.21.15.57:0/422994775 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994011b50 con 0x7f79ac0b22a0 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 -- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 msgr2=0x7f79ac0a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 0x7f79ac0a3030 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7994009910 tx=0x7f79940091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 -- 172.21.15.57:0/422994775 shutdown_connections 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 --2- 172.21.15.57:0/422994775 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0b22a0 0x7f79ac0a3030 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 -- 172.21.15.57:0/422994775 >> 172.21.15.57:0/422994775 conn(0x7f79ac06d1f0 msgr2=0x7f79ac06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 -- 172.21.15.57:0/422994775 shutdown_connections 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011590 con 0x7fecd006df00 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0140610 con 0x7fecd006df00 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.641+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd013db50 con 0x7fecd006df00 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4011710 con 0x7fecd006df00 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4011ad0 con 0x7fecd006df00 2024-03-18T14:46:50.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecd006a8b0 con 0x7fecd006df00 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.642+0000 7f79b1fc7700 1 -- 172.21.15.57:0/422994775 wait complete. 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7f79b1fc7700 1 Processor -- start 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.643+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fecc401b3b0 con 0x7fecd006df00 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fecc404b4e0 con 0x7fecd006df00 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 --> v1:172.21.15.57:6804/40091 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecb4045dd0 con 0x7fecb40420f0 2024-03-18T14:46:50.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7fecd4db1700 1 -- 172.21.15.57:0/898687380 >> v1:172.21.15.57:6816/39496 conn(0x7fecb40394d0 legacy=0x7fecb403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc4033820 con 0x7fecd006df00 2024-03-18T14:46:50.648 INFO:teuthology.orchestra.run.smithi057.stdout:38654705737 2024-03-18T14:46:50.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.644+0000 7f79b1fc7700 1 -- start start 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0a4910 0x7f79ac09f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ac0b22a0 0x7f79ac09f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac09fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac13d610 con 0x7f79ac0b22a0 2024-03-18T14:46:50.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac13c520 con 0x7f79ac143850 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79b1fc7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac13c7c0 con 0x7f79ac0a4910 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ac0b22a0 0x7f79ac09f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79abfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac09fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79a3fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ac0b22a0 0x7f79ac09f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33488/0 (socket says 172.21.15.57:33488) 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79a3fff700 1 -- 172.21.15.57:0/3639206034 learned_addr learned my addr 172.21.15.57:0/3639206034 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.645+0000 7f79ab7fe700 1 --2- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0a4910 0x7f79ac09f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 -- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0a4910 msgr2=0x7f79ac09f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 --2- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f79ac0a4910 0x7f79ac09f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 -- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ac0b22a0 msgr2=0x7f79ac09f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 --2- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79ac0b22a0 0x7f79ac09f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 -- 172.21.15.57:0/3639206034 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7994009420 con 0x7f79ac143850 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79abfff700 1 --2- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac09fce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f79a400ec90 tx=0x7f79a400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400c730 con 0x7f79ac143850 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0a18e0 con 0x7f79ac143850 2024-03-18T14:46:50.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.646+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac13c090 con 0x7f79ac143850 2024-03-18T14:46:50.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.647+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a400f040 con 0x7f79ac143850 2024-03-18T14:46:50.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.647+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a400cae0 con 0x7f79ac143850 2024-03-18T14:46:50.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.647+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7990000fd0 con 0x7f79ac143850 2024-03-18T14:46:50.652 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:50.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:46:50.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.648+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f79a4014440 con 0x7f79ac143850 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.649+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f79a404caa0 con 0x7f79ac143850 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.649+0000 7f79ab7fe700 1 -- 172.21.15.57:0/3639206034 >> v1:172.21.15.57:6816/39496 conn(0x7f798c0394d0 legacy=0x7f798c03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.649+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 --> v1:172.21.15.57:6800/40076 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f798c045d50 con 0x7f798c042070 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.649+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79a404ce10 con 0x7f79ac143850 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.649+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== osd.1 v1:172.21.15.57:6804/40091 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fecb4045dd0 con 0x7fecb40420f0 2024-03-18T14:46:50.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.650+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== osd.0 v1:172.21.15.57:6800/40076 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f798c045d50 con 0x7f798c042070 2024-03-18T14:46:50.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.665+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 --> v1:172.21.15.57:6804/40091 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecd0065180 con 0x7fecb40420f0 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.665+0000 7fecccff9700 1 -- 172.21.15.57:0/898687380 <== osd.1 v1:172.21.15.57:6804/40091 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2385644447) 0x7fecd0065180 con 0x7fecb40420f0 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 >> v1:172.21.15.57:6804/40091 conn(0x7fecb40420f0 legacy=0x7fecb4044560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 >> v1:172.21.15.57:6816/39496 conn(0x7fecb40394d0 legacy=0x7fecb403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fecd006df00 msgr2=0x7fecd01400d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 --2- 172.21.15.57:0/898687380 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fecd006df00 0x7fecd01400d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c5f0 tx=0x7fecc4007ec0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd55b2700 1 -- 172.21.15.57:0/898687380 reap_dead start 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 shutdown_connections 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.666+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 >> 172.21.15.57:0/898687380 conn(0x7fecd006ce30 msgr2=0x7fecd00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.667+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 shutdown_connections 2024-03-18T14:46:50.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.668+0000 7fecd7015700 1 -- 172.21.15.57:0/898687380 wait complete. 2024-03-18T14:46:50.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.680+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 --> v1:172.21.15.57:6800/40076 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7990002d00 con 0x7f798c042070 2024-03-18T14:46:50.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.680+0000 7f79a37fe700 1 -- 172.21.15.57:0/3639206034 <== osd.0 v1:172.21.15.57:6800/40076 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2385644447) 0x7f7990002d00 con 0x7f798c042070 2024-03-18T14:46:50.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.685+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 >> v1:172.21.15.57:6800/40076 conn(0x7f798c042070 legacy=0x7f798c0444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.685+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 >> v1:172.21.15.57:6816/39496 conn(0x7f798c0394d0 legacy=0x7f798c03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.685+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 msgr2=0x7f79ac09fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.685+0000 7f79b1fc7700 1 --2- 172.21.15.57:0/3639206034 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f79ac143850 0x7f79ac09fce0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f79a400ec90 tx=0x7f79a400b040 comp rx=0 tx=0).stop 2024-03-18T14:46:50.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.686+0000 7f79abfff700 1 -- 172.21.15.57:0/3639206034 reap_dead start 2024-03-18T14:46:50.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.686+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 shutdown_connections 2024-03-18T14:46:50.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.686+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 >> 172.21.15.57:0/3639206034 conn(0x7f79ac06d1f0 msgr2=0x7f79ac142a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.687+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 shutdown_connections 2024-03-18T14:46:50.689 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:50.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:46:50.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.688+0000 7f79b1fc7700 1 -- 172.21.15.57:0/3639206034 wait complete. 2024-03-18T14:46:50.709 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:50.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:46:50.786 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.785+0000 7f08da5be1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T14:46:50.787 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.786+0000 7f22215ba1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T14:46:50.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.821+0000 7f496eea7700 1 Processor -- start 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.821+0000 7f496eea7700 1 -- start start 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49680a7590 0x7f496813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a49d0 0x7f496813e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49680a4590 con 0x7f49680a7590 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680b5b50 con 0x7f49680b5780 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496eea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49680a1d50 con 0x7f49680a49d0 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496cc43700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496cc43700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53578/0 (socket says 172.21.15.57:53578) 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496cc43700 1 -- 172.21.15.57:0/4226135813 learned_addr learned my addr 172.21.15.57:0/4226135813 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.822+0000 7f496d444700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a49d0 0x7f496813e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 -- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a49d0 msgr2=0x7f496813e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a49d0 0x7f496813e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 -- 172.21.15.57:0/4226135813 >> v2:172.21.15.57:3300/0 conn(0x7f49680a7590 msgr2=0x7f496813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 --2- 172.21.15.57:0/4226135813 >> v2:172.21.15.57:3300/0 conn(0x7f49680a7590 0x7f496813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 -- 172.21.15.57:0/4226135813 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49680a2010 con 0x7f49680b5780 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f496cc43700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f495c0099e0 tx=0x7f495c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79d647c85eae1ead server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f49677fe700 1 -- 172.21.15.57:0/4226135813 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00b8b0 con 0x7f49680b5780 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f49677fe700 1 -- 172.21.15.57:0/4226135813 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00ba10 con 0x7f49680b5780 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.823+0000 7f49677fe700 1 -- 172.21.15.57:0/4226135813 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bdb0 con 0x7f49680b5780 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 -- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 msgr2=0x7f49680a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f495c0099e0 tx=0x7f495c009250 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 -- 172.21.15.57:0/4226135813 shutdown_connections 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a49d0 0x7f496813e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 --2- 172.21.15.57:0/4226135813 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680b5780 0x7f49680a4050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 --2- 172.21.15.57:0/4226135813 >> v2:172.21.15.57:3300/0 conn(0x7f49680a7590 0x7f496813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.824+0000 7f496eea7700 1 -- 172.21.15.57:0/4226135813 >> 172.21.15.57:0/4226135813 conn(0x7f496806fb90 msgr2=0x7f49680b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.825+0000 7f496eea7700 1 -- 172.21.15.57:0/4226135813 shutdown_connections 2024-03-18T14:46:50.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.825+0000 7f496eea7700 1 -- 172.21.15.57:0/4226135813 wait complete. 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.826+0000 7f496eea7700 1 Processor -- start 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.826+0000 7f496eea7700 1 -- start start 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.827+0000 7f496eea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680a49d0 0x7f4968144ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.827+0000 7f496eea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496eea7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 0x7f49681434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496eea7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4968140cb0 con 0x7f49680b5780 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496eea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4968145530 con 0x7f49680a49d0 2024-03-18T14:46:50.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496eea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4968140a40 con 0x7f49680a7590 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54226/0 (socket says 172.21.15.57:54226) 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 -- 172.21.15.57:0/714245415 learned_addr learned my addr 172.21.15.57:0/714245415 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496d444700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 0x7f49681434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 -- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680a49d0 msgr2=0x7f4968144ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680a49d0 0x7f4968144ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 -- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 msgr2=0x7f49681434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 0x7f49681434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f4967fff700 1 -- 172.21.15.57:0/714245415 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0094f0 con 0x7f49680a7590 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.828+0000 7f496d444700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 0x7f49681434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f4967fff700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f495800b7e0 tx=0x7f4958009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800f510 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495800f690 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495800fa50 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4968141330 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.829+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4968140410 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.830+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f495801a400 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.833+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f495804b210 con 0x7f49680a7590 2024-03-18T14:46:50.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.833+0000 7f496cc43700 1 -- 172.21.15.57:0/714245415 >> v1:172.21.15.57:6816/39496 conn(0x7f4954039500 legacy=0x7f495403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.834+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4968140260 con 0x7f49680a7590 2024-03-18T14:46:50.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.840+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f495802fc20 con 0x7f49680a7590 2024-03-18T14:46:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.851+0000 7fe8a74ef700 1 Processor -- start 2024-03-18T14:46:50.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.851+0000 7fe8a74ef700 1 -- start start 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 0x7fe8a00a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8a00a4910 0x7fe8a013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a013af20 con 0x7fe8a00a4910 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a00a3c40 con 0x7fe8a00b22a0 2024-03-18T14:46:50.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.852+0000 7fe8a74ef700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a013b110 con 0x7fe8a006daa0 2024-03-18T14:46:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54238/0 (socket says 172.21.15.57:54238) 2024-03-18T14:46:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a528b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 0x7fe8a00a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/2338208991 learned_addr learned my addr 172.21.15.57:0/2338208991 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 msgr2=0x7fe8a00a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 0x7fe8a00a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/2338208991 >> v2:172.21.15.57:3300/0 conn(0x7fe8a00a4910 msgr2=0x7fe8a013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/2338208991 >> v2:172.21.15.57:3300/0 conn(0x7fe8a00a4910 0x7fe8a013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/2338208991 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a013b3b0 con 0x7fe8a006daa0 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.853+0000 7fe8a528b700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 0x7fe8a00a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.854+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0099b0 tx=0x7fe89c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35a93cf41d1d34df server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.855+0000 7fe897fff700 1 -- 172.21.15.57:0/2338208991 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c009ea0 con 0x7fe8a006daa0 2024-03-18T14:46:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.855+0000 7fe897fff700 1 -- 172.21.15.57:0/2338208991 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00b860 con 0x7fe8a006daa0 2024-03-18T14:46:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.855+0000 7fe897fff700 1 -- 172.21.15.57:0/2338208991 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00bc00 con 0x7fe8a006daa0 2024-03-18T14:46:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 -- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 msgr2=0x7fe8a006df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe89c0099b0 tx=0x7fe89c009250 comp rx=0 tx=0).stop 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 -- 172.21.15.57:0/2338208991 shutdown_connections 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a006df00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 --2- 172.21.15.57:0/2338208991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00b22a0 0x7fe8a00a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 --2- 172.21.15.57:0/2338208991 >> v2:172.21.15.57:3300/0 conn(0x7fe8a00a4910 0x7fe8a013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 -- 172.21.15.57:0/2338208991 >> 172.21.15.57:0/2338208991 conn(0x7fe8a006d1f0 msgr2=0x7fe8a006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 -- 172.21.15.57:0/2338208991 shutdown_connections 2024-03-18T14:46:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.856+0000 7fe8a74ef700 1 -- 172.21.15.57:0/2338208991 wait complete. 2024-03-18T14:46:50.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.858+0000 7fe8a74ef700 1 Processor -- start 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.858+0000 7fe8a74ef700 1 -- start start 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a0134b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 0x7fe8a00a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 0x7fe8a00a1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0134360 con 0x7fe8a00b22a0 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0135390 con 0x7fe8a00a4910 2024-03-18T14:46:50.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a74ef700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a0135650 con 0x7fe8a006daa0 2024-03-18T14:46:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a4a8a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 0x7fe8a00a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a5a8c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 0x7fe8a00a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a4a8a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 0x7fe8a00a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53598/0 (socket says 172.21.15.57:53598) 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.859+0000 7fe8a4a8a700 1 -- 172.21.15.57:0/961697565 learned_addr learned my addr 172.21.15.57:0/961697565 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 msgr2=0x7fe8a0134b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a0134b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 msgr2=0x7fe8a00a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 0x7fe8a00a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 -- 172.21.15.57:0/961697565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe898009a20 con 0x7fe8a00b22a0 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a5a8c700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 0x7fe8a00a1030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00b1c80 tx=0x7fe89c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c026480 con 0x7fe8a00b22a0 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8a74ef700 1 -- 172.21.15.57:0/961697565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0094f0 con 0x7fe8a00b22a0 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c01f070 con 0x7fe8a00b22a0 2024-03-18T14:46:50.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.860+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c026850 con 0x7fe8a00b22a0 2024-03-18T14:46:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.861+0000 7fe8a74ef700 1 -- 172.21.15.57:0/961697565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a0068a80 con 0x7fe8a00b22a0 2024-03-18T14:46:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.862+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fe89c026c00 con 0x7fe8a00b22a0 2024-03-18T14:46:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.863+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe89c021070 con 0x7fe8a00b22a0 2024-03-18T14:46:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.863+0000 7fe8a528b700 1 -- 172.21.15.57:0/961697565 >> v1:172.21.15.57:6816/39496 conn(0x7fe884039500 legacy=0x7fe88403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.863+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a0065180 con 0x7fe8a00b22a0 2024-03-18T14:46:50.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.869+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fe89c001b00 con 0x7fe8a00b22a0 2024-03-18T14:46:50.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.941+0000 7f6832705700 1 Processor -- start 2024-03-18T14:46:50.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.941+0000 7f6832705700 1 -- start start 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6832705700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f682c063a70 0x7f682c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6832705700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f682c145ca0 0x7f682c146070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6832705700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682c0ac600 con 0x7f682c1465b0 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6832705700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ac8a0 con 0x7f682c063a70 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6832705700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ad8c0 con 0x7f682c145ca0 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6830ca2700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f682c1465b0 0x7f682c142980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49748/0 (socket says 172.21.15.57:49748) 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.942+0000 7f6830ca2700 1 -- 172.21.15.57:0/3712110113 learned_addr learned my addr 172.21.15.57:0/3712110113 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:50.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640821083 0 0) 0x7f682c0ac600 con 0x7f682c1465b0 2024-03-18T14:46:50.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682b7fe700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f682c145ca0 0x7f682c146070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6814003570 con 0x7f682c1465b0 2024-03-18T14:46:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 568002824 0 0) 0x7f6814003570 con 0x7f682c1465b0 2024-03-18T14:46:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682bfff700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f682c063a70 0x7f682c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f682c145ca0 msgr2=0x7f682c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f682c145ca0 0x7f682c146070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f682c063a70 msgr2=0x7f682c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f682c063a70 0x7f682c06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c146a00 con 0x7f682c1465b0 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3363477552 0 0) 0x7f68240017f0 con 0x7f682c1465b0 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 >> v1:172.21.15.57:6789/0 conn(0x7f682c1465b0 legacy=0x7f682c142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f6814003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f6814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f681400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ac8a0 con 0x7f6814004810 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0ad8c0 con 0x7f6814003ae0 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.943+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f681400c130 con 0x7f6814005210 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f6814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682bfff700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f682c063a70 0x7f682c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 -- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 msgr2=0x7f681400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f681400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 -- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 msgr2=0x7f6814003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f6814003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 -- 172.21.15.57:0/3712110113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6814003570 con 0x7f6814004810 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682b7fe700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f6814004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f682c06be40 tx=0x7f681c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eacc881288fe02 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.944+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c014430 con 0x7f6814004810 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c014590 con 0x7f6814004810 2024-03-18T14:46:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f682affd700 1 -- 172.21.15.57:0/3712110113 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c014950 con 0x7f6814004810 2024-03-18T14:46:50.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 -- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 msgr2=0x7f6814004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f6814004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f682c06be40 tx=0x7f681c008040 comp rx=0 tx=0).stop 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 -- 172.21.15.57:0/3712110113 shutdown_connections 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f681400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f6814003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 --2- 172.21.15.57:0/3712110113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f6814004c80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 -- 172.21.15.57:0/3712110113 >> 172.21.15.57:0/3712110113 conn(0x7f682c06a4d0 msgr2=0x7f682c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.945+0000 7f6832705700 1 -- 172.21.15.57:0/3712110113 shutdown_connections 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.946+0000 7f6832705700 1 -- 172.21.15.57:0/3712110113 wait complete. 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.946+0000 7f6832705700 1 Processor -- start 2024-03-18T14:46:50.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.947+0000 7f6832705700 1 -- start start 2024-03-18T14:46:50.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f24a7649700 1 Processor -- start 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f682c0a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f682c155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0aa220 con 0x7f6814004810 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682c0a8720 con 0x7f6814003ae0 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f6832705700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f682c1551b0 con 0x7f6814005210 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33546/0 (socket says 172.21.15.57:33546) 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 -- 172.21.15.57:0/1592823771 learned_addr learned my addr 172.21.15.57:0/1592823771 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 -- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 msgr2=0x7f682c155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f682c155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 -- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 msgr2=0x7f682c0a81e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f682c0a81e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f682b7fe700 1 -- 172.21.15.57:0/1592823771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c0a9630 con 0x7f6814004810 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f682b7fe700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f681c001eb0 tx=0x7f681c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.948+0000 7f24a7649700 1 -- start start 2024-03-18T14:46:50.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f24a7649700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24a00b1950 0x7f24a006ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00dbe0 con 0x7f6814004810 2024-03-18T14:46:50.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f24a7649700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a006e200 0x7f24a013e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f24a7649700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a013dbf0 con 0x7f24a006e630 2024-03-18T14:46:50.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f24a7649700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a006da20 con 0x7f24a00b1950 2024-03-18T14:46:50.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00dd60 con 0x7f6814004810 2024-03-18T14:46:50.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c028660 con 0x7f6814004810 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f24a7649700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a013de20 con 0x7f24a006e200 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24a00b1950 0x7f24a006ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f24a00b1950 0x7f24a006ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33550/0 (socket says 172.21.15.57:33550) 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 -- 172.21.15.57:0/2721723687 learned_addr learned my addr 172.21.15.57:0/2721723687 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 -- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a006e200 msgr2=0x7f24a013e310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 --2- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a006e200 0x7f24a013e310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 -- 172.21.15.57:0/2721723687 >> v1:172.21.15.57:6789/0 conn(0x7f24a006e630 legacy=0x7f24a013a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.950+0000 7f24a53e5700 1 -- 172.21.15.57:0/2721723687 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a006f350 con 0x7f24a00b1950 2024-03-18T14:46:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682c0aa920 con 0x7f6814004810 2024-03-18T14:46:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.949+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682c121930 con 0x7f6814004810 2024-03-18T14:46:50.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.951+0000 7f24a53e5700 1 --2- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a00b1950 0x7f24a006ee10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f249c00bc40 tx=0x7f249c00b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874295ce2bed635 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.951+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f681c01e400 con 0x7f6814004810 2024-03-18T14:46:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.951+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f681c000e40 con 0x7f6814004810 2024-03-18T14:46:50.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.951+0000 7f682bfff700 1 -- 172.21.15.57:0/1592823771 >> v1:172.21.15.57:6816/39496 conn(0x7f6818039500 legacy=0x7f681803b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.958 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:50.952+0000 7f22215ba1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T14:46:50.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.953+0000 7f2497fff700 1 -- 172.21.15.57:0/2721723687 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00db40 con 0x7f24a00b1950 2024-03-18T14:46:50.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.953+0000 7f2497fff700 1 -- 172.21.15.57:0/2721723687 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c00dcc0 con 0x7f24a00b1950 2024-03-18T14:46:50.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.953+0000 7f2497fff700 1 -- 172.21.15.57:0/2721723687 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c017660 con 0x7f24a00b1950 2024-03-18T14:46:50.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.953+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682c065180 con 0x7f6814004810 2024-03-18T14:46:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 -- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a00b1950 msgr2=0x7f24a006ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 --2- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a00b1950 0x7f24a006ee10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f249c00bc40 tx=0x7f249c00b4e0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 -- 172.21.15.57:0/2721723687 shutdown_connections 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 --2- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a00b1950 0x7f24a006ee10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 --2- 172.21.15.57:0/2721723687 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a006e200 0x7f24a013e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 -- 172.21.15.57:0/2721723687 >> 172.21.15.57:0/2721723687 conn(0x7f24a006f530 msgr2=0x7f24a006f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 -- 172.21.15.57:0/2721723687 shutdown_connections 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.954+0000 7f24a7649700 1 -- 172.21.15.57:0/2721723687 wait complete. 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.956+0000 7f24a7649700 1 Processor -- start 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.956+0000 7f24a7649700 1 -- start start 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f24a006e200 0x7f24a00aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a00b1950 0x7f24a01559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00a9060 con 0x7f24a006e630 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00a9ba0 con 0x7f24a006e200 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a7649700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00a92c0 con 0x7f24a00b1950 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33556/0 (socket says 172.21.15.57:33556) 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 -- 172.21.15.57:0/2522590642 learned_addr learned my addr 172.21.15.57:0/2522590642 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 -- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a00b1950 msgr2=0x7f24a01559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a00b1950 0x7f24a01559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 -- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f24a006e200 msgr2=0x7f24a00aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f24a006e200 0x7f24a00aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.957+0000 7f24a4be4700 1 -- 172.21.15.57:0/2522590642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c00b780 con 0x7f24a006e630 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.958+0000 7f24a4be4700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f249000b600 tx=0x7f24900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.959+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000f510 con 0x7f24a006e630 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.959+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000f670 con 0x7f24a006e630 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.959+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000fa30 con 0x7f24a006e630 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.959+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00a8410 con 0x7f24a006e630 2024-03-18T14:46:50.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.959+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a00a95e0 con 0x7f24a006e630 2024-03-18T14:46:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.960+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f681c00c360 con 0x7f6814004810 2024-03-18T14:46:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.961+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f249001a400 con 0x7f24a006e630 2024-03-18T14:46:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.962+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f249004b140 con 0x7f24a006e630 2024-03-18T14:46:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.962+0000 7f24a53e5700 1 -- 172.21.15.57:0/2522590642 >> v1:172.21.15.57:6816/39496 conn(0x7f24840394d0 legacy=0x7f248403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:50.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.962+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00a95e0 con 0x7f24a006e630 2024-03-18T14:46:50.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.968+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f24a00a95e0 con 0x7f24a006e630 2024-03-18T14:46:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.983+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4968065180 con 0x7f49680a7590 2024-03-18T14:46:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.984+0000 7f4964ff9700 1 -- 172.21.15.57:0/714245415 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f495800fe00 con 0x7f49680a7590 2024-03-18T14:46:50.985 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.985+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 >> v1:172.21.15.57:6816/39496 conn(0x7f4954039500 legacy=0x7f495403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.985+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 msgr2=0x7f4968142f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.985+0000 7f496eea7700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f495800b7e0 tx=0x7f4958009220 comp rx=0 tx=0).stop 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 shutdown_connections 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49680b5780 0x7f49681434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f49680a49d0 0x7f4968144ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 --2- 172.21.15.57:0/714245415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f49680a7590 0x7f4968142f80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 >> 172.21.15.57:0/714245415 conn(0x7f496806fb90 msgr2=0x7f49680a6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 shutdown_connections 2024-03-18T14:46:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:50.986+0000 7f496eea7700 1 -- 172.21.15.57:0/714245415 wait complete. 2024-03-18T14:46:50.998 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:50.997+0000 7f08da5be1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T14:46:51.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.3 2024-03-18T14:46:51.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.064+0000 7fe8a528b700 1 -- 172.21.15.57:0/961697565 >> v1:172.21.15.57:6816/39496 conn(0x7fe884039500 legacy=0x7fe88403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:51.068 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.066+0000 7f22215ba1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T14:46:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.090+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f682c0698f0 con 0x7f6814004810 2024-03-18T14:46:51.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.090+0000 7f6813fff700 1 -- 172.21.15.57:0/1592823771 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f681c006730 con 0x7f6814004810 2024-03-18T14:46:51.092 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:51.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.091+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 >> v1:172.21.15.57:6816/39496 conn(0x7f6818039500 legacy=0x7f681803b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:51.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.091+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 msgr2=0x7f682c0a90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:51.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.091+0000 7f6832705700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f681c001eb0 tx=0x7f681c01b000 comp rx=0 tx=0).stop 2024-03-18T14:46:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 shutdown_connections 2024-03-18T14:46:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6814005210 0x7f682c155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6814003ae0 0x7f682c0a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 --2- 172.21.15.57:0/1592823771 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6814004810 0x7f682c0a90f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 >> 172.21.15.57:0/1592823771 conn(0x7f682c06a4d0 msgr2=0x7f682c0addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 shutdown_connections 2024-03-18T14:46:51.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.094+0000 7f6832705700 1 -- 172.21.15.57:0/1592823771 wait complete. 2024-03-18T14:46:51.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.1 2024-03-18T14:46:51.114 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.112+0000 7f08da5be1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T14:46:51.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.134+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8a00a1f60 con 0x7fe8a00b22a0 2024-03-18T14:46:51.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.134+0000 7fe8957fa700 1 -- 172.21.15.57:0/961697565 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe89c0080a0 con 0x7fe8a00b22a0 2024-03-18T14:46:51.136 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 >> v1:172.21.15.57:6816/39496 conn(0x7fe884039500 legacy=0x7fe88403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 msgr2=0x7fe8a00a1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 0x7fe8a00a1030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00b1c80 tx=0x7fe89c017000 comp rx=0 tx=0).stop 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 shutdown_connections 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8a00b22a0 0x7fe8a00a1030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe8a006daa0 0x7fe8a0134b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 --2- 172.21.15.57:0/961697565 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe8a00a4910 0x7fe8a00a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 >> 172.21.15.57:0/961697565 conn(0x7fe8a006d1f0 msgr2=0x7fe8a006aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 shutdown_connections 2024-03-18T14:46:51.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.136+0000 7fe88affd700 1 -- 172.21.15.57:0/961697565 wait complete. 2024-03-18T14:46:51.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705736 for osd.2 2024-03-18T14:46:51.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.163+0000 7f24a53e5700 1 -- 172.21.15.57:0/2522590642 >> v1:172.21.15.57:6816/39496 conn(0x7f24840394d0 legacy=0x7f248403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:51.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.174+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f24a00a8610 con 0x7f24a006e630 2024-03-18T14:46:51.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.175+0000 7f24957fa700 1 -- 172.21.15.57:0/2522590642 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f24a00a8610 con 0x7f24a006e630 2024-03-18T14:46:51.176 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 >> v1:172.21.15.57:6816/39496 conn(0x7f24840394d0 legacy=0x7f248403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 msgr2=0x7f24a00a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f249000b600 tx=0x7f24900091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 shutdown_connections 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f24a00b1950 0x7f24a01559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f24a006e200 0x7f24a00aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 --2- 172.21.15.57:0/2522590642 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24a006e630 0x7f24a00a8b20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 >> 172.21.15.57:0/2522590642 conn(0x7f24a006f530 msgr2=0x7f24a00b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:51.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 shutdown_connections 2024-03-18T14:46:51.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:51.176+0000 7f24a7649700 1 -- 172.21.15.57:0/2522590642 wait complete. 2024-03-18T14:46:51.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.0 2024-03-18T14:46:51.224 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.222+0000 7f22215ba1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T14:46:51.257 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.255+0000 7f08da5be1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T14:46:51.303 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.302+0000 7f22215ba1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T14:46:51.335 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.333+0000 7f08da5be1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T14:46:51.381 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.379+0000 7f22215ba1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T14:46:51.411 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.410+0000 7f08da5be1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T14:46:51.588 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.586+0000 7f08da5be1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T14:46:51.588 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.586+0000 7f22215ba1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T14:46:51.768 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.767+0000 7f22215ba1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T14:46:51.769 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.767+0000 7f08da5be1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T14:46:51.861 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:51.860+0000 7f08da5be1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T14:46:51.862 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:51.860+0000 7f22215ba1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T14:46:52.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:46:52.018 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:52.016+0000 7f08da5be1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T14:46:52.018 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:52.016+0000 7f22215ba1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T14:46:52.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:46:52.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.129+0000 7f69867b5700 1 Processor -- start 2024-03-18T14:46:52.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.130+0000 7f69867b5700 1 -- start start 2024-03-18T14:46:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.130+0000 7f69867b5700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f69867b5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 0x7f6980145b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f69867b5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698006e750 con 0x7f698006df00 2024-03-18T14:46:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f69867b5700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f698013f680 con 0x7f6980069450 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f69867b5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a36c0 con 0x7f698013f240 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33568/0 (socket says 172.21.15.57:33568) 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f698006df00 0x7f698013eb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49772/0 (socket says 172.21.15.57:49772) 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697ffff700 1 -- 172.21.15.57:0/729422250 learned_addr learned my addr 172.21.15.57:0/729422250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 --2- 172.21.15.57:0/729422250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 0x7f6980145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 -- 172.21.15.57:0/729422250 >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 msgr2=0x7f698006f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 --2- 172.21.15.57:0/729422250 >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697effd700 1 -- 172.21.15.57:0/729422250 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992306308 0 0) 0x7f698006e750 con 0x7f698006df00 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 -- 172.21.15.57:0/729422250 >> v1:172.21.15.57:6789/0 conn(0x7f698006df00 legacy=0x7f698013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 -- 172.21.15.57:0/729422250 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698006eed0 con 0x7f698013f240 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f697ffff700 1 --2- 172.21.15.57:0/729422250 >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.131+0000 7f6984d52700 1 --2- 172.21.15.57:0/729422250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 0x7f6980145b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f6978009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a3dbc430d52641 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.132+0000 7f697effd700 1 -- 172.21.15.57:0/729422250 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800e070 con 0x7f698013f240 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.132+0000 7f697effd700 1 -- 172.21.15.57:0/729422250 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800bb60 con 0x7f698013f240 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.132+0000 7f697effd700 1 -- 172.21.15.57:0/729422250 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978012430 con 0x7f698013f240 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.132+0000 7f69867b5700 1 -- 172.21.15.57:0/729422250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 msgr2=0x7f6980145b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.132+0000 7f69867b5700 1 --2- 172.21.15.57:0/729422250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 0x7f6980145b60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f6978009780 comp rx=0 tx=0).stop 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 -- 172.21.15.57:0/729422250 shutdown_connections 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 --2- 172.21.15.57:0/729422250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f698013f240 0x7f6980145b60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 --2- 172.21.15.57:0/729422250 >> v2:172.21.15.57:3300/0 conn(0x7f6980069450 0x7f698006f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 -- 172.21.15.57:0/729422250 >> 172.21.15.57:0/729422250 conn(0x7f698006ce30 msgr2=0x7f6980068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 -- 172.21.15.57:0/729422250 shutdown_connections 2024-03-18T14:46:52.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.133+0000 7f69867b5700 1 -- 172.21.15.57:0/729422250 wait complete. 2024-03-18T14:46:52.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.134+0000 7f69867b5700 1 Processor -- start 2024-03-18T14:46:52.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.134+0000 7f69867b5700 1 -- start start 2024-03-18T14:46:52.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6980069450 0x7f69800a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698006df00 0x7f698014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69800a8c90 con 0x7f698006df00 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69801395e0 con 0x7f698013f240 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f69867b5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69800acad0 con 0x7f6980069450 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f6984d52700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f6984d52700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53626/0 (socket says 172.21.15.57:53626) 2024-03-18T14:46:52.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f6984d52700 1 -- 172.21.15.57:0/3589353260 learned_addr learned my addr 172.21.15.57:0/3589353260 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f697f7fe700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698006df00 0x7f698014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.135+0000 7f697ffff700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6980069450 0x7f69800a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 -- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6980069450 msgr2=0x7f69800a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6980069450 0x7f69800a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 -- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698006df00 msgr2=0x7f698014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698006df00 0x7f698014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 -- 172.21.15.57:0/3589353260 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697000b790 con 0x7f698013f240 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6984d52700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69800a3800 tx=0x7f6978019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978012ea0 con 0x7f698013f240 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6978027470 con 0x7f698013f240 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6978009a20 con 0x7f698013f240 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.136+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780277f0 con 0x7f698013f240 2024-03-18T14:46:52.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.137+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69800a9270 con 0x7f698013f240 2024-03-18T14:46:52.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.138+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f6978024070 con 0x7f698013f240 2024-03-18T14:46:52.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.138+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f697804de10 con 0x7f698013f240 2024-03-18T14:46:52.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.138+0000 7f697ffff700 1 -- 172.21.15.57:0/3589353260 >> v1:172.21.15.57:6816/39496 conn(0x7f696c039520 legacy=0x7f696c03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.138+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69600052b0 con 0x7f698013f240 2024-03-18T14:46:52.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.142+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f6978031c50 con 0x7f698013f240 2024-03-18T14:46:52.152 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:46:52.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:46:52.205 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:52.203+0000 7f22215ba1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T14:46:52.205 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:52.203+0000 7f08da5be1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T14:46:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.271+0000 7f5ed8ef2700 1 Processor -- start 2024-03-18T14:46:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.271+0000 7f5ed8ef2700 1 -- start start 2024-03-18T14:46:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.272+0000 7f5ed8ef2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 0x7f5ed40a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.272+0000 7f5ed8ef2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed40679e0 0x7f5ed4067e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.272+0000 7f5ed8ef2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed413be70 con 0x7f5ed40a4910 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.272+0000 7f5ed8ef2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed413af20 con 0x7f5ed40679e0 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.272+0000 7f5ed8ef2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40a3c40 con 0x7f5ed40b22a0 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 0x7f5ed40a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed40679e0 0x7f5ed4067e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 0x7f5ed40a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53636/0 (socket says 172.21.15.57:53636) 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed259c700 1 -- 172.21.15.57:0/1621298244 learned_addr learned my addr 172.21.15.57:0/1621298244 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ed40679e0 0x7f5ed4067e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33580/0 (socket says 172.21.15.57:33580) 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 msgr2=0x7f5ed40a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 --2- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 0x7f5ed40a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/1621298244 >> v1:172.21.15.57:6789/0 conn(0x7f5ed40a4910 legacy=0x7f5ed413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/1621298244 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed413b110 con 0x7f5ed40679e0 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.273+0000 7f5ed2d9d700 1 --2- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40679e0 0x7f5ed4067e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009e60 tx=0x7f5ecc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e07f1dd3f38e5d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.274+0000 7f5ed159a700 1 -- 172.21.15.57:0/1621298244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc00e070 con 0x7f5ed40679e0 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.274+0000 7f5ed159a700 1 -- 172.21.15.57:0/1621298244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc00bbf0 con 0x7f5ed40679e0 2024-03-18T14:46:52.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.274+0000 7f5ed159a700 1 -- 172.21.15.57:0/1621298244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc012430 con 0x7f5ed40679e0 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40679e0 msgr2=0x7f5ed4067e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 --2- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40679e0 0x7f5ed4067e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009e60 tx=0x7f5ecc009780 comp rx=0 tx=0).stop 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/1621298244 shutdown_connections 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 --2- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40679e0 0x7f5ed4067e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 --2- 172.21.15.57:0/1621298244 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40b22a0 0x7f5ed40a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/1621298244 >> 172.21.15.57:0/1621298244 conn(0x7f5ed406d1f0 msgr2=0x7f5ed406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/1621298244 shutdown_connections 2024-03-18T14:46:52.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.275+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/1621298244 wait complete. 2024-03-18T14:46:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.276+0000 7f5ed8ef2700 1 Processor -- start 2024-03-18T14:46:52.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.276+0000 7f5ed8ef2700 1 -- start start 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40679e0 0x7f5ed4140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ed40a4910 0x7f5ed40a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed413efc0 con 0x7f5ed40b22a0 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed4140260 con 0x7f5ed40679e0 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.277+0000 7f5ed8ef2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed413fff0 con 0x7f5ed40a4910 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33592/0 (socket says 172.21.15.57:33592) 2024-03-18T14:46:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/3645958589 learned_addr learned my addr 172.21.15.57:0/3645958589 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ed40a4910 msgr2=0x7f5ed40a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ed40a4910 0x7f5ed40a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40679e0 msgr2=0x7f5ed4140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40679e0 0x7f5ed4140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 -- 172.21.15.57:0/3645958589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc009a20 con 0x7f5ed40b22a0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.278+0000 7f5ed2d9d700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0097c0 tx=0x7f5ecc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.279+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc01e640 con 0x7f5ed40b22a0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.279+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc01e7c0 con 0x7f5ed40b22a0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.279+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/3645958589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed413dca0 con 0x7f5ed40b22a0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.279+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc01eb80 con 0x7f5ed40b22a0 2024-03-18T14:46:52.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.279+0000 7f5ed8ef2700 1 -- 172.21.15.57:0/3645958589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed413ab70 con 0x7f5ed40b22a0 2024-03-18T14:46:52.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.281+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f5ecc024070 con 0x7f5ed40b22a0 2024-03-18T14:46:52.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.281+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5ecc04dfa0 con 0x7f5ed40b22a0 2024-03-18T14:46:52.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.281+0000 7f5ed259c700 1 -- 172.21.15.57:0/3645958589 >> v1:172.21.15.57:6816/39496 conn(0x7f5eb40394d0 legacy=0x7f5eb403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.281+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eac0052b0 con 0x7f5ed40b22a0 2024-03-18T14:46:52.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.287+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f5ecc00e240 con 0x7f5ed40b22a0 2024-03-18T14:46:52.294 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:52.292+0000 7f22215ba1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T14:46:52.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.298+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6960005560 con 0x7f698013f240 2024-03-18T14:46:52.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.298+0000 7f6967fff700 1 -- 172.21.15.57:0/3589353260 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6978008810 con 0x7f698013f240 2024-03-18T14:46:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 >> v1:172.21.15.57:6816/39496 conn(0x7f696c039520 legacy=0x7f696c03b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 msgr2=0x7f698014d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f69800a3800 tx=0x7f6978019000 comp rx=0 tx=0).stop 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 shutdown_connections 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f698013f240 0x7f698014d320 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6980069450 0x7f69800a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 --2- 172.21.15.57:0/3589353260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f698006df00 0x7f698014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.301+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 >> 172.21.15.57:0/3589353260 conn(0x7f698006ce30 msgr2=0x7f69800a2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.303+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 shutdown_connections 2024-03-18T14:46:52.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.303+0000 7f69867b5700 1 -- 172.21.15.57:0/3589353260 wait complete. 2024-03-18T14:46:52.320 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:52.319+0000 7f08da5be1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T14:46:52.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.3 2024-03-18T14:46:52.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.345+0000 7f5ae8aad700 1 Processor -- start 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.345+0000 7f5ae8aad700 1 -- start start 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae8aad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae8aad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae8aad700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40a3c00 con 0x7f5ae40aeda0 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae8aad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40a36d0 con 0x7f5ae40b2310 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae8aad700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae413e920 con 0x7f5ae40a48b0 2024-03-18T14:46:52.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ae259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.346+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53650/0 (socket says 172.21.15.57:53650) 2024-03-18T14:46:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 -- 172.21.15.57:0/1502127426 learned_addr learned my addr 172.21.15.57:0/1502127426 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae2d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ae40aeda0 0x7f5ae406dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49782/0 (socket says 172.21.15.57:49782) 2024-03-18T14:46:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 -- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 msgr2=0x7f5ae40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 --2- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 -- 172.21.15.57:0/1502127426 >> v1:172.21.15.57:6789/0 conn(0x7f5ae40aeda0 legacy=0x7f5ae406dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 -- 172.21.15.57:0/1502127426 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae413ebc0 con 0x7f5ae40b2310 2024-03-18T14:46:52.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae259c700 1 --2- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009a10 tx=0x7f5ad4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd2ae9d22428b54 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.347+0000 7f5ae1d9b700 1 -- 172.21.15.57:0/1502127426 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400b8b0 con 0x7f5ae40b2310 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.348+0000 7f5ae1d9b700 1 -- 172.21.15.57:0/1502127426 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400ba10 con 0x7f5ae40b2310 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.348+0000 7f5ae1d9b700 1 -- 172.21.15.57:0/1502127426 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400bdb0 con 0x7f5ae40b2310 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.348+0000 7f5ae8aad700 1 -- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 msgr2=0x7f5ae40a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.348+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009a10 tx=0x7f5ad4009250 comp rx=0 tx=0).stop 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 -- 172.21.15.57:0/1502127426 shutdown_connections 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae40a3190 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/1502127426 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 -- 172.21.15.57:0/1502127426 >> 172.21.15.57:0/1502127426 conn(0x7f5ae406b180 msgr2=0x7f5ae406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 -- 172.21.15.57:0/1502127426 shutdown_connections 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.349+0000 7f5ae8aad700 1 -- 172.21.15.57:0/1502127426 wait complete. 2024-03-18T14:46:52.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.350+0000 7f5ae8aad700 1 Processor -- start 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.350+0000 7f5ae8aad700 1 -- start start 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40a9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40a19f0 0x7f5ae4156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40a0900 con 0x7f5ae40a19f0 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40a9f50 con 0x7f5ae40b2310 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ae8aad700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40aa210 con 0x7f5ae40a48b0 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.351+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53664/0 (socket says 172.21.15.57:53664) 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 -- 172.21.15.57:0/2506315287 learned_addr learned my addr 172.21.15.57:0/2506315287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ae259c700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40a9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ae2d9d700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40a19f0 0x7f5ae4156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 -- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 msgr2=0x7f5ae40a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40a9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 -- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40a19f0 msgr2=0x7f5ae4156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40a19f0 0x7f5ae4156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 -- 172.21.15.57:0/2506315287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40094f0 con 0x7f5ae40b2310 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ae259c700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ad9d9b700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ede0 tx=0x7f5acc00b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc00eee0 con 0x7f5ae40b2310 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc00dde0 con 0x7f5ae40b2310 2024-03-18T14:46:52.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc010650 con 0x7f5ae40b2310 2024-03-18T14:46:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae40ab530 con 0x7f5ae40b2310 2024-03-18T14:46:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.352+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae40a0d90 con 0x7f5ae40b2310 2024-03-18T14:46:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.354+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae40a3510 con 0x7f5ae40b2310 2024-03-18T14:46:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.354+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7f5acc010a00 con 0x7f5ae40b2310 2024-03-18T14:46:52.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.354+0000 7f5ae259c700 1 -- 172.21.15.57:0/2506315287 >> v1:172.21.15.57:6816/39496 conn(0x7f5ac40394d0 legacy=0x7f5ac403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.357+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5acc014030 con 0x7f5ae40b2310 2024-03-18T14:46:52.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.358+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f5acc051060 con 0x7f5ae40b2310 2024-03-18T14:46:52.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.382+0000 7fee6462a700 1 Processor -- start 2024-03-18T14:46:52.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.382+0000 7fee6462a700 1 -- start start 2024-03-18T14:46:52.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee6462a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fee5c063a70 0x7fee5c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee6462a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee6462a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c0ac600 con 0x7fee5c145ca0 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee6462a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c0ac8a0 con 0x7fee5c063a70 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee6462a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0ad8c0 con 0x7fee5c146780 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53672/0 (socket says 172.21.15.57:53672) 2024-03-18T14:46:52.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 -- 172.21.15.57:0/117747792 learned_addr learned my addr 172.21.15.57:0/117747792 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 -- 172.21.15.57:0/117747792 >> v2:172.21.15.57:3300/0 conn(0x7fee5c063a70 msgr2=0x7fee5c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 --2- 172.21.15.57:0/117747792 >> v2:172.21.15.57:3300/0 conn(0x7fee5c063a70 0x7fee5c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 -- 172.21.15.57:0/117747792 >> v1:172.21.15.57:6789/0 conn(0x7fee5c145ca0 legacy=0x7fee5c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.383+0000 7fee62bc7700 1 -- 172.21.15.57:0/117747792 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c06e600 con 0x7fee5c146780 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee62bc7700 1 --2- 172.21.15.57:0/117747792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee54009f20 tx=0x7fee54009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1790e0f9f33b865 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee613c4700 1 -- 172.21.15.57:0/117747792 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5400e070 con 0x7fee5c146780 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee613c4700 1 -- 172.21.15.57:0/117747792 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5400ba40 con 0x7fee5c146780 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee613c4700 1 -- 172.21.15.57:0/117747792 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540092e0 con 0x7fee5c146780 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee6462a700 1 -- 172.21.15.57:0/117747792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 msgr2=0x7fee5c14d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.384+0000 7fee6462a700 1 --2- 172.21.15.57:0/117747792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fee54009f20 tx=0x7fee54009840 comp rx=0 tx=0).stop 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 -- 172.21.15.57:0/117747792 shutdown_connections 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 --2- 172.21.15.57:0/117747792 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c14d1f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 --2- 172.21.15.57:0/117747792 >> v2:172.21.15.57:3300/0 conn(0x7fee5c063a70 0x7fee5c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 -- 172.21.15.57:0/117747792 >> 172.21.15.57:0/117747792 conn(0x7fee5c06a4d0 msgr2=0x7fee5c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 -- 172.21.15.57:0/117747792 shutdown_connections 2024-03-18T14:46:52.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.385+0000 7fee6462a700 1 -- 172.21.15.57:0/117747792 wait complete. 2024-03-18T14:46:52.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 Processor -- start 2024-03-18T14:46:52.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 -- start start 2024-03-18T14:46:52.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 0x7fee5c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee5c145ca0 0x7fee5c145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c149750 con 0x7fee5c145ca0 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1459b0 con 0x7fee5c146780 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.386+0000 7fee6462a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c14d020 con 0x7fee5c063a70 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53678/0 (socket says 172.21.15.57:53678) 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 -- 172.21.15.57:0/3245848221 learned_addr learned my addr 172.21.15.57:0/3245848221 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee623c6700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 0x7fee5c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 -- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 msgr2=0x7fee5c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 0x7fee5c14bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 -- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee5c145ca0 msgr2=0x7fee5c145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee5c145ca0 0x7fee5c145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 -- 172.21.15.57:0/3245848221 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54009ae0 con 0x7fee5c146780 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee623c6700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 0x7fee5c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.387+0000 7fee62bc7700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ada00 tx=0x7fee54017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.388+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee540092e0 con 0x7fee5c146780 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.388+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54012db0 con 0x7fee5c146780 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.388+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5401e660 con 0x7fee5c146780 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.388+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c14cb20 con 0x7fee5c146780 2024-03-18T14:46:52.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.388+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c14ba50 con 0x7fee5c146780 2024-03-18T14:46:52.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.389+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c14b790 con 0x7fee5c146780 2024-03-18T14:46:52.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.389+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fee5401ea10 con 0x7fee5c146780 2024-03-18T14:46:52.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.390+0000 7fee623c6700 1 -- 172.21.15.57:0/3245848221 >> v1:172.21.15.57:6816/39496 conn(0x7fee40039500 legacy=0x7fee4003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.390+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fee5404d430 con 0x7fee5c146780 2024-03-18T14:46:52.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.395+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fee5c14b790 con 0x7fee5c146780 2024-03-18T14:46:52.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.482+0000 7f5ed259c700 1 -- 172.21.15.57:0/3645958589 >> v1:172.21.15.57:6816/39496 conn(0x7f5eb40394d0 legacy=0x7f5eb403b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.489 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:52.488+0000 7f22215ba1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T14:46:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.490+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5ae406d560 con 0x7f5ae40b2310 2024-03-18T14:46:52.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.490+0000 7f5adaffd700 1 -- 172.21.15.57:0/2506315287 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5acc051070 con 0x7f5ae40b2310 2024-03-18T14:46:52.492 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 >> v1:172.21.15.57:6816/39496 conn(0x7f5ac40394d0 legacy=0x7f5ac403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 msgr2=0x7f5ae4155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00ede0 tx=0x7f5acc00b430 comp rx=0 tx=0).stop 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 shutdown_connections 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ae40a19f0 0x7f5ae4156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ae40a48b0 0x7f5ae40a9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 --2- 172.21.15.57:0/2506315287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ae40b2310 0x7f5ae4155bf0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 >> 172.21.15.57:0/2506315287 conn(0x7f5ae406b180 msgr2=0x7f5ae413dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 shutdown_connections 2024-03-18T14:46:52.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.491+0000 7f5ae8aad700 1 -- 172.21.15.57:0/2506315287 wait complete. 2024-03-18T14:46:52.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705736 for osd.2 2024-03-18T14:46:52.506 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:52.505+0000 7f08da5be1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T14:46:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.526+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5eac005560 con 0x7f5ed40b22a0 2024-03-18T14:46:52.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.527+0000 7f5ec27fc700 1 -- 172.21.15.57:0/3645958589 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ecc00a040 con 0x7f5ed40b22a0 2024-03-18T14:46:52.528 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 >> v1:172.21.15.57:6816/39496 conn(0x7f5eb40394d0 legacy=0x7f5eb403b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 msgr2=0x7f5ed40a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc0097c0 tx=0x7f5ecc018000 comp rx=0 tx=0).stop 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 shutdown_connections 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ed40b22a0 0x7f5ed40a1590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5ed40679e0 0x7f5ed4140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 --2- 172.21.15.57:0/3645958589 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5ed40a4910 0x7f5ed40a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 >> 172.21.15.57:0/3645958589 conn(0x7f5ed406d1f0 msgr2=0x7f5ed40648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 shutdown_connections 2024-03-18T14:46:52.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.529+0000 7f5eb3fff700 1 -- 172.21.15.57:0/3645958589 wait complete. 2024-03-18T14:46:52.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.1 2024-03-18T14:46:52.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.591+0000 7fee623c6700 1 -- 172.21.15.57:0/3245848221 >> v1:172.21.15.57:6816/39496 conn(0x7fee40039500 legacy=0x7fee4003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:52.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.599+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee5c14b790 con 0x7fee5c146780 2024-03-18T14:46:52.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.600+0000 7fee527fc700 1 -- 172.21.15.57:0/3245848221 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee5c14b790 con 0x7fee5c146780 2024-03-18T14:46:52.601 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 >> v1:172.21.15.57:6816/39496 conn(0x7fee40039500 legacy=0x7fee4003b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 msgr2=0x7fee5c144100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ada00 tx=0x7fee54017000 comp rx=0 tx=0).stop 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 shutdown_connections 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fee5c146780 0x7fee5c144100 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fee5c063a70 0x7fee5c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 --2- 172.21.15.57:0/3245848221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fee5c145ca0 0x7fee5c145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:52.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 >> 172.21.15.57:0/3245848221 conn(0x7fee5c06a4d0 msgr2=0x7fee5c068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:52.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 shutdown_connections 2024-03-18T14:46:52.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:52.601+0000 7fee6462a700 1 -- 172.21.15.57:0/3245848221 wait complete. 2024-03-18T14:46:52.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.0 2024-03-18T14:46:52.625 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:52.624+0000 7f22215ba1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T14:46:52.636 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:52.635+0000 7f08da5be1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T14:46:53.113 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.112+0000 7f22215ba1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T14:46:53.115 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:53.114+0000 7f08da5be1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T14:46:53.234 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.232+0000 7f22215ba1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T14:46:53.235 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:53.234+0000 7f08da5be1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T14:46:53.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:46:53.391 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:53.389+0000 7f08da5be1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T14:46:53.391 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.390+0000 7f22215ba1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T14:46:53.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.449+0000 7fe6fa9f0700 1 Processor -- start 2024-03-18T14:46:53.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.449+0000 7fe6fa9f0700 1 -- start start 2024-03-18T14:46:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6fa9f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6fa9f0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 0x7fe6f4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6fa9f0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f40a3c00 con 0x7fe6f40b2310 2024-03-18T14:46:53.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6fa9f0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f40a36d0 con 0x7fe6f4143940 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6fa9f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f413e920 con 0x7fe6f40a48b0 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f8f8d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 0x7fe6f4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54352/0 (socket says 172.21.15.57:54352) 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 -- 172.21.15.57:0/4170416219 learned_addr learned my addr 172.21.15.57:0/4170416219 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f3fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe6f40b2310 0x7fe6f40ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49806/0 (socket says 172.21.15.57:49806) 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 -- 172.21.15.57:0/4170416219 >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 msgr2=0x7fe6f4145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 --2- 172.21.15.57:0/4170416219 >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 0x7fe6f4145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 -- 172.21.15.57:0/4170416219 >> v1:172.21.15.57:6789/0 conn(0x7fe6f40b2310 legacy=0x7fe6f40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 -- 172.21.15.57:0/4170416219 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f413ebc0 con 0x7fe6f40a48b0 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f2ffd700 1 -- 172.21.15.57:0/4170416219 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637049803 0 0) 0x7fe6f40a3c00 con 0x7fe6f40b2310 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f8f8d700 1 --2- 172.21.15.57:0/4170416219 >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 0x7fe6f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.450+0000 7fe6f37fe700 1 --2- 172.21.15.57:0/4170416219 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ba60 tx=0x7fe6e80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eea6237c8032be6b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6f2ffd700 1 -- 172.21.15.57:0/4170416219 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800caf0 con 0x7fe6f40a48b0 2024-03-18T14:46:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6f2ffd700 1 -- 172.21.15.57:0/4170416219 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e800cc50 con 0x7fe6f40a48b0 2024-03-18T14:46:53.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6f2ffd700 1 -- 172.21.15.57:0/4170416219 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e800f460 con 0x7fe6f40a48b0 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/4170416219 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 msgr2=0x7fe6f40a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/4170416219 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe6e800ba60 tx=0x7fe6e80090f0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/4170416219 shutdown_connections 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/4170416219 >> v2:172.21.15.57:3300/0 conn(0x7fe6f4143940 0x7fe6f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/4170416219 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a3190 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/4170416219 >> 172.21.15.57:0/4170416219 conn(0x7fe6f406b180 msgr2=0x7fe6f406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/4170416219 shutdown_connections 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.451+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/4170416219 wait complete. 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.452+0000 7fe6fa9f0700 1 Processor -- start 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 -- start start 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 0x7fe6f40a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6f4143940 0x7fe6f40a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40a8040 con 0x7fe6f40b2310 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f40a8300 con 0x7fe6f4143940 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6fa9f0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f413e1b0 con 0x7fe6f40a48b0 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6f37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 0x7fe6f40a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6f3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:54360/0 (socket says 172.21.15.57:54360) 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6f3fff700 1 -- 172.21.15.57:0/3913715868 learned_addr learned my addr 172.21.15.57:0/3913715868 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.453+0000 7fe6f8f8d700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6f4143940 0x7fe6f40a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 -- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 msgr2=0x7fe6f40a7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 -- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6f4143940 msgr2=0x7fe6f40a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6f4143940 0x7fe6f40a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 -- 172.21.15.57:0/3913715868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec00de30 con 0x7fe6f40b2310 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6f37fe700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 0x7fe6f40a57d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40b1cd0 tx=0x7fe6e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017610 con 0x7fe6f40b2310 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e801d040 con 0x7fe6f40b2310 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e800b5a0 con 0x7fe6f40b2310 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e8017a20 con 0x7fe6f40b2310 2024-03-18T14:46:53.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.454+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f40a76a0 con 0x7fe6f40b2310 2024-03-18T14:46:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.455+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f4065180 con 0x7fe6f40b2310 2024-03-18T14:46:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.455+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 6) v1 ==== 42198+0+0 (secure 0 0 0) 0x7fe6e800e3c0 con 0x7fe6f40b2310 2024-03-18T14:46:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.455+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe6e804cd50 con 0x7fe6f40b2310 2024-03-18T14:46:53.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.455+0000 7fe6f3fff700 1 -- 172.21.15.57:0/3913715868 >> v1:172.21.15.57:6816/39496 conn(0x7fe6e00394d0 legacy=0x7fe6e003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.57:6816/39496 2024-03-18T14:46:53.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.461+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fe6e8050030 con 0x7fe6f40b2310 2024-03-18T14:46:53.498 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.497+0000 7f22215ba1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T14:46:53.499 INFO:tasks.ceph.mgr.x.smithi057.stderr:2024-03-18T14:46:53.498+0000 7f08da5be1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T14:46:53.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:46:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.523+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 7) v1 ==== 53236+0+0 (secure 0 0 0) 0x7fe6e8018ad0 con 0x7fe6f40b2310 2024-03-18T14:46:53.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.523+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 >> v1:172.21.15.57:6816/39496 conn(0x7fe6e00394d0 legacy=0x7fe6e003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:46:53.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:46:53.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.612+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe6f4069120 con 0x7fe6f40b2310 2024-03-18T14:46:53.614 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.612+0000 7f21e2c6d700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.614 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.612+0000 7f21e2c6d700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.614 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.612+0000 7f21e2c6d700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.614 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.612+0000 7f21e2c6d700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.614 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.612+0000 7f21e2c6d700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:46:53.616 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.614+0000 7f21e5472700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.616 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.614+0000 7f21e5472700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.616 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.614+0000 7f21e5472700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.616 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.614+0000 7f21e5472700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.616 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:53.614+0000 7f21e5472700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-18T14:46:53.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.615+0000 7fe6dbfff700 1 -- 172.21.15.57:0/3913715868 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe6e8026020 con 0x7fe6f40b2310 2024-03-18T14:46:53.619 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:53.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 msgr2=0x7fe6f40a57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 0x7fe6f40a57d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe6f40b1cd0 tx=0x7fe6e8017000 comp rx=0 tx=0).stop 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 shutdown_connections 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6f4143940 0x7fe6f40a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6f40a48b0 0x7fe6f40a7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 --2- 172.21.15.57:0/3913715868 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6f40b2310 0x7fe6f40a57d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 >> 172.21.15.57:0/3913715868 conn(0x7fe6f406b180 msgr2=0x7fe6f4068750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 shutdown_connections 2024-03-18T14:46:53.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.619+0000 7fe6fa9f0700 1 -- 172.21.15.57:0/3913715868 wait complete. 2024-03-18T14:46:53.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.3 2024-03-18T14:46:53.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.669+0000 7f016e553700 1 Processor -- start 2024-03-18T14:46:53.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.669+0000 7f016e553700 1 -- start start 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016e553700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 0x7f0168139270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016e553700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 0x7f0168146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016e553700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01680a6170 con 0x7f01680638c0 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016e553700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016813c2b0 con 0x7f01681448c0 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016e553700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f016813c550 con 0x7f01680ad270 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f01677fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 0x7f0168139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f0167fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f01680638c0 0x7f01680a5a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40618/0 (socket says 172.21.15.57:40618) 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f0167fff700 1 -- 172.21.15.57:0/2488689899 learned_addr learned my addr 172.21.15.57:0/2488689899 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:53.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016caf0700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 0x7f0168146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f0166ffd700 1 -- 172.21.15.57:0/2488689899 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784447724 0 0) 0x7f01680a6170 con 0x7f01680638c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f0166ffd700 1 -- 172.21.15.57:0/2488689899 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0150003570 con 0x7f01680638c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016caf0700 1 -- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 msgr2=0x7f0168139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016caf0700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 0x7f0168139270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016caf0700 1 -- 172.21.15.57:0/2488689899 >> v1:172.21.15.57:6789/0 conn(0x7f01680638c0 legacy=0x7f01680a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f016caf0700 1 -- 172.21.15.57:0/2488689899 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680add50 con 0x7f01681448c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.670+0000 7f01677fe700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 0x7f0168139270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f016caf0700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 0x7f0168146ca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e90 tx=0x7f0160009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95a77b58f68a97c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f0166ffd700 1 -- 172.21.15.57:0/2488689899 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016000e070 con 0x7f01681448c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f0166ffd700 1 -- 172.21.15.57:0/2488689899 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016000bb80 con 0x7f01681448c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f0166ffd700 1 -- 172.21.15.57:0/2488689899 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160012430 con 0x7f01681448c0 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f016e553700 1 -- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 msgr2=0x7f0168146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.671+0000 7f016e553700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 0x7f0168146ca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e90 tx=0x7f0160009780 comp rx=0 tx=0).stop 2024-03-18T14:46:53.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 -- 172.21.15.57:0/2488689899 shutdown_connections 2024-03-18T14:46:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01681448c0 0x7f0168146ca0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 --2- 172.21.15.57:0/2488689899 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01680ad270 0x7f0168139270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 -- 172.21.15.57:0/2488689899 >> 172.21.15.57:0/2488689899 conn(0x7f016806b160 msgr2=0x7f016806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 -- 172.21.15.57:0/2488689899 shutdown_connections 2024-03-18T14:46:53.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.672+0000 7f016e553700 1 -- 172.21.15.57:0/2488689899 wait complete. 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 Processor -- start 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 -- start start 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01681448c0 0x7f0168138b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01680aa8d0 con 0x7f01680ad270 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01680a9550 con 0x7f01680638c0 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f016e553700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01680a9830 con 0x7f01681448c0 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f0167fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f01677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f0167fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41844/0 (socket says 172.21.15.57:41844) 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f0167fff700 1 -- 172.21.15.57:0/3625344196 learned_addr learned my addr 172.21.15.57:0/3625344196 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.673+0000 7f01677fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55194/0 (socket says 172.21.15.57:55194) 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f016caf0700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01681448c0 0x7f0168138b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 -- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01681448c0 msgr2=0x7f0168138b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01681448c0 0x7f0168138b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 -- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 msgr2=0x7f01680a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 -- 172.21.15.57:0/3625344196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c009420 con 0x7f01680ad270 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f0167fff700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f01677fe700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f015c00ec80 tx=0x7f015c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c00c850 con 0x7f01680ad270 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c00c9b0 con 0x7f01680ad270 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0160009a20 con 0x7f01680ad270 2024-03-18T14:46:53.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01680b1b30 con 0x7f01680ad270 2024-03-18T14:46:53.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.674+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c00cd70 con 0x7f01680ad270 2024-03-18T14:46:53.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.675+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 53236+0+0 (secure 0 0 0) 0x7f015c013680 con 0x7f01680ad270 2024-03-18T14:46:53.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.675+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480052b0 con 0x7f01680ad270 2024-03-18T14:46:53.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.676+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f015c05ad70 con 0x7f01680ad270 2024-03-18T14:46:53.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.679+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7f015c039420 con 0x7f01680ad270 2024-03-18T14:46:53.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.702+0000 7fd3769f5700 1 Processor -- start 2024-03-18T14:46:53.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 -- start start 2024-03-18T14:46:53.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 0x7fd3700a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd3701495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700a2dc0 con 0x7fd3700b2620 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37006e1b0 con 0x7fd3700680f0 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd3769f5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700a26a0 con 0x7fd37006f580 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd36ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 0x7fd3700a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd36f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd3700b2620 0x7fd3700679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40632/0 (socket says 172.21.15.57:40632) 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd374f92700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd3701495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.703+0000 7fd36f7fe700 1 -- 172.21.15.57:0/3481606135 learned_addr learned my addr 172.21.15.57:0/3481606135 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36effd700 1 -- 172.21.15.57:0/3481606135 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413092281 0 0) 0x7fd3700a2dc0 con 0x7fd3700b2620 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36effd700 1 -- 172.21.15.57:0/3481606135 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd358003570 con 0x7fd3700b2620 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36ffff700 1 -- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 msgr2=0x7fd3701495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:53.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36ffff700 1 --2- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd3701495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36ffff700 1 -- 172.21.15.57:0/3481606135 >> v1:172.21.15.57:6789/0 conn(0x7fd3700b2620 legacy=0x7fd3700679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36ffff700 1 -- 172.21.15.57:0/3481606135 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700a46d0 con 0x7fd37006f580 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36ffff700 1 --2- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 0x7fd3700a32c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd360009910 tx=0x7fd3600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=801257e8e84bb19e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36effd700 1 -- 172.21.15.57:0/3481606135 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360011630 con 0x7fd37006f580 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36effd700 1 -- 172.21.15.57:0/3481606135 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360011790 con 0x7fd37006f580 2024-03-18T14:46:53.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.704+0000 7fd36effd700 1 -- 172.21.15.57:0/3481606135 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360011b30 con 0x7fd37006f580 2024-03-18T14:46:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 -- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 msgr2=0x7fd3700a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 --2- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 0x7fd3700a32c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd360009910 tx=0x7fd3600091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 -- 172.21.15.57:0/3481606135 shutdown_connections 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 --2- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd3701495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 --2- 172.21.15.57:0/3481606135 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd37006f580 0x7fd3700a32c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 -- 172.21.15.57:0/3481606135 >> 172.21.15.57:0/3481606135 conn(0x7fd37006d1f0 msgr2=0x7fd37006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 -- 172.21.15.57:0/3481606135 shutdown_connections 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.705+0000 7fd3769f5700 1 -- 172.21.15.57:0/3481606135 wait complete. 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 Processor -- start 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 -- start start 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd37014dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3700b2620 0x7fd370142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37014e890 con 0x7fd37006f580 2024-03-18T14:46:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37014eac0 con 0x7fd3700680f0 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.706+0000 7fd3769f5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700ad310 con 0x7fd3700b2620 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55198/0 (socket says 172.21.15.57:55198) 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 -- 172.21.15.57:0/2273754651 learned_addr learned my addr 172.21.15.57:0/2273754651 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd374f92700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3700b2620 0x7fd370142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36ffff700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd37014dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 -- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3700b2620 msgr2=0x7fd370142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3700b2620 0x7fd370142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 -- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 msgr2=0x7fd37014dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd37014dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 -- 172.21.15.57:0/2273754651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009420 con 0x7fd37006f580 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd36f7fe700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c590 tx=0x7fd364007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364005b30 con 0x7fd37006f580 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364005c90 con 0x7fd37006f580 2024-03-18T14:46:53.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364007320 con 0x7fd37006f580 2024-03-18T14:46:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37014e530 con 0x7fd37006f580 2024-03-18T14:46:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.707+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700abfa0 con 0x7fd37006f580 2024-03-18T14:46:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.708+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370065180 con 0x7fd37006f580 2024-03-18T14:46:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.709+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 7) v1 ==== 53236+0+0 (secure 0 0 0) 0x7fd36401b3b0 con 0x7fd37006f580 2024-03-18T14:46:53.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.709+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fd36405a330 con 0x7fd37006f580 2024-03-18T14:46:53.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.715+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fd364038a60 con 0x7fd37006f580 2024-03-18T14:46:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.750+0000 7fb0a7a9b700 1 Processor -- start 2024-03-18T14:46:53.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 -- start start 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb0a00b22a0 0x7fb0a00a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a013af20 con 0x7fb0a00b22a0 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00a3c40 con 0x7fb0a006daa0 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a7a9b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a013b110 con 0x7fb0a00a4910 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.751+0000 7fb0a5837700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb0a00b22a0 0x7fb0a00a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb0a00b22a0 0x7fb0a00a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55214/0 (socket says 172.21.15.57:55214) 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 -- 172.21.15.57:0/2094286225 learned_addr learned my addr 172.21.15.57:0/2094286225 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5036700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a6038700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 -- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 msgr2=0x7fb0a013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 -- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 msgr2=0x7fb0a006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 -- 172.21.15.57:0/2094286225 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a013b3b0 con 0x7fb0a00b22a0 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5036700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a5837700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a00a3030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ba60 tx=0x7fb09c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14f32bdc7dfae95 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a4835700 1 -- 172.21.15.57:0/2094286225 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00bea0 con 0x7fb0a00b22a0 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a4835700 1 -- 172.21.15.57:0/2094286225 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c00ca60 con 0x7fb0a00b22a0 2024-03-18T14:46:53.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.752+0000 7fb0a4835700 1 -- 172.21.15.57:0/2094286225 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00ce20 con 0x7fb0a00b22a0 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 msgr2=0x7fb0a00a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a00a3030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00ba60 tx=0x7fb09c0090f0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2094286225 shutdown_connections 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a00a3030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2094286225 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2094286225 >> 172.21.15.57:0/2094286225 conn(0x7fb0a006d1f0 msgr2=0x7fb0a006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2094286225 shutdown_connections 2024-03-18T14:46:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.753+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2094286225 wait complete. 2024-03-18T14:46:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.754+0000 7fb0a7a9b700 1 Processor -- start 2024-03-18T14:46:53.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.754+0000 7fb0a7a9b700 1 -- start start 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a00a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a013e950 con 0x7fb0a00b22a0 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00a9280 con 0x7fb0a006daa0 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a7a9b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a00a7b80 con 0x7fb0a00a4910 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a5036700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.755+0000 7fb0a5036700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50380/0 (socket says 172.21.15.57:50380) 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 -- 172.21.15.57:0/2959396057 learned_addr learned my addr 172.21.15.57:0/2959396057 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:53.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5837700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a00a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a6038700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 -- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 msgr2=0x7fb0a00a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a00a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 -- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 msgr2=0x7fb0a014cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a014cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 -- 172.21.15.57:0/2959396057 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb090009420 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a6038700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a5036700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ec80 tx=0x7fb0900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000c850 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09000c9b0 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c00b5a0 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.756+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000cd50 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.757+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a013f160 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.757+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a0065180 con 0x7fb0a00a4910 2024-03-18T14:46:53.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.758+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 7) v1 ==== 53236+0+0 (secure 0 0 0) 0x7fb090013680 con 0x7fb0a00a4910 2024-03-18T14:46:53.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.758+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fb09005af20 con 0x7fb0a00a4910 2024-03-18T14:46:53.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.761+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+111804 (secure 0 0 0) 0x7fb09007d4d0 con 0x7fb0a00a4910 2024-03-18T14:46:53.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.810+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0148005560 con 0x7f01680ad270 2024-03-18T14:46:53.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.810+0000 7f014ffff700 1 -- 172.21.15.57:0/3625344196 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f015c021030 con 0x7f01680ad270 2024-03-18T14:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 msgr2=0x7f01681385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f015c00ec80 tx=0x7f015c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 shutdown_connections 2024-03-18T14:46:53.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f01681448c0 0x7f0168138b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f01680638c0 0x7f01680a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.811+0000 7f016e553700 1 --2- 172.21.15.57:0/3625344196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01680ad270 0x7f01681385c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.812+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 >> 172.21.15.57:0/3625344196 conn(0x7f016806b160 msgr2=0x7f01680a5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.812+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 shutdown_connections 2024-03-18T14:46:53.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.812+0000 7f016e553700 1 -- 172.21.15.57:0/3625344196 wait complete. 2024-03-18T14:46:53.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705736 for osd.2 2024-03-18T14:46:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.844+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3700a3f70 con 0x7fd37006f580 2024-03-18T14:46:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.845+0000 7fd357fff700 1 -- 172.21.15.57:0/2273754651 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd364017030 con 0x7fd37006f580 2024-03-18T14:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 msgr2=0x7fd3700ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c590 tx=0x7fd364007d70 comp rx=0 tx=0).stop 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 shutdown_connections 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd3700b2620 0x7fd370142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3700680f0 0x7fd37014dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 --2- 172.21.15.57:0/2273754651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd37006f580 0x7fd3700ab950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 >> 172.21.15.57:0/2273754651 conn(0x7fd37006d1f0 msgr2=0x7fd370069190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 shutdown_connections 2024-03-18T14:46:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.846+0000 7fd3769f5700 1 -- 172.21.15.57:0/2273754651 wait complete. 2024-03-18T14:46:53.859 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.1 2024-03-18T14:46:53.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.888+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0a006f9d0 con 0x7fb0a00a4910 2024-03-18T14:46:53.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.888+0000 7fb095ffb700 1 -- 172.21.15.57:0/2959396057 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb090021030 con 0x7fb0a00a4910 2024-03-18T14:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 msgr2=0x7fb0a013e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ec80 tx=0x7fb0900091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 shutdown_connections 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb0a00b22a0 0x7fb0a014cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb0a006daa0 0x7fb0a00a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 --2- 172.21.15.57:0/2959396057 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb0a00a4910 0x7fb0a013e410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:53.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 >> 172.21.15.57:0/2959396057 conn(0x7fb0a006d1f0 msgr2=0x7fb0a006dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:53.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 shutdown_connections 2024-03-18T14:46:53.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:53.890+0000 7fb0a7a9b700 1 -- 172.21.15.57:0/2959396057 wait complete. 2024-03-18T14:46:53.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.0 2024-03-18T14:46:54.536 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:54.534+0000 7f22004a8700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-18T14:46:54.539 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:54.538+0000 7f22004a8700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-18T14:46:54.539 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-18T14:46:54.538+0000 7f22004a8700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-18T14:46:54.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:46:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.768+0000 7f58efbd2700 1 Processor -- start 2024-03-18T14:46:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 -- start start 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58e80a4910 0x7f58e813b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 0x7f58e806df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e813af20 con 0x7f58e80a4910 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e80a3c40 con 0x7f58e806daa0 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58efbd2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58e813b110 con 0x7f58e80b22a0 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ed96e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ed16d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58e80a4910 0x7f58e813b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ee16f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 0x7f58e806df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ed16d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58e80a4910 0x7f58e813b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55230/0 (socket says 172.21.15.57:55230) 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ed96e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50388/0 (socket says 172.21.15.57:50388) 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.769+0000 7f58ed16d700 1 -- 172.21.15.57:0/1934027018 learned_addr learned my addr 172.21.15.57:0/1934027018 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:54.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 -- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 msgr2=0x7f58e80a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 -- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 msgr2=0x7f58e806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 0x7f58e806df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 -- 172.21.15.57:0/1934027018 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e813b3b0 con 0x7f58e80a4910 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed96e700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ee16f700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 0x7f58e806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ed16d700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e80a4910 0x7f58e813b760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0099b0 tx=0x7f58dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f84e4bddd781d60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ec96c700 1 -- 172.21.15.57:0/1934027018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00b680 con 0x7f58e80a4910 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ec96c700 1 -- 172.21.15.57:0/1934027018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58dc00b7e0 con 0x7f58e80a4910 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.770+0000 7f58ec96c700 1 -- 172.21.15.57:0/1934027018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58dc00bb80 con 0x7f58e80a4910 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 -- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e80a4910 msgr2=0x7f58e813b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e80a4910 0x7f58e813b760 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f58dc0099b0 tx=0x7f58dc009250 comp rx=0 tx=0).stop 2024-03-18T14:46:54.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 -- 172.21.15.57:0/1934027018 shutdown_connections 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e806daa0 0x7f58e806df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e80a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 --2- 172.21.15.57:0/1934027018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e80a4910 0x7f58e813b760 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 -- 172.21.15.57:0/1934027018 >> 172.21.15.57:0/1934027018 conn(0x7f58e806d1f0 msgr2=0x7f58e806af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 -- 172.21.15.57:0/1934027018 shutdown_connections 2024-03-18T14:46:54.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.771+0000 7f58efbd2700 1 -- 172.21.15.57:0/1934027018 wait complete. 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 Processor -- start 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 -- start start 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e80a4910 0x7f58e813d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e8151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e813e740 con 0x7f58e806daa0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e813e170 con 0x7f58e80a4910 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58efbd2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58e81518f0 con 0x7f58e80b22a0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58ed96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58ed96e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55236/0 (socket says 172.21.15.57:55236) 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58ed96e700 1 -- 172.21.15.57:0/3298872885 learned_addr learned my addr 172.21.15.57:0/3298872885 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.772+0000 7f58ee16f700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e8151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed16d700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e80a4910 0x7f58e813d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 -- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 msgr2=0x7f58e8151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e8151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 -- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e80a4910 msgr2=0x7f58e813d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e80a4910 0x7f58e813d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 -- 172.21.15.57:0/3298872885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0009a20 con 0x7f58e806daa0 2024-03-18T14:46:54.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58ed96e700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58e400ec80 tx=0x7f58e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400c850 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400c9b0 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400cd30 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e4009420 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.773+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc0094f0 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.774+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7f58e4013680 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.774+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e8065180 con 0x7f58e806daa0 2024-03-18T14:46:54.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.774+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f58e405af10 con 0x7f58e806daa0 2024-03-18T14:46:54.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.778+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f58e40395d0 con 0x7f58e806daa0 2024-03-18T14:46:54.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:46:54.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:46:54.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:46:54.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.946+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f58e813e880 con 0x7f58e806daa0 2024-03-18T14:46:54.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.946+0000 7f58d9ffb700 1 -- 172.21.15.57:0/3298872885 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58e813e880 con 0x7f58e806daa0 2024-03-18T14:46:54.948 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.948+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 >> v1:172.21.15.57:6816/47480 conn(0x7f58cc045d40 legacy=0x7f58cc0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.948+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 msgr2=0x7f58e813dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.948+0000 7f58efbd2700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f58e400ec80 tx=0x7f58e40091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 shutdown_connections 2024-03-18T14:46:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f58e80b22a0 0x7f58e8151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58e806daa0 0x7f58e813dc30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 --2- 172.21.15.57:0/3298872885 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f58e80a4910 0x7f58e813d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 >> 172.21.15.57:0/3298872885 conn(0x7f58e806d1f0 msgr2=0x7f58e806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 shutdown_connections 2024-03-18T14:46:54.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.949+0000 7f58efbd2700 1 -- 172.21.15.57:0/3298872885 wait complete. 2024-03-18T14:46:54.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.958+0000 7fbe592e9700 1 Processor -- start 2024-03-18T14:46:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.958+0000 7fbe592e9700 1 -- start start 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe592e9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe592e9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe5406da20 0x7fbe5413d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe592e9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe540ae920 con 0x7fbe5406de30 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe592e9700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe540ac3d0 con 0x7fbe5406da20 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe592e9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540ac670 con 0x7fbe54063af0 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50412/0 (socket says 172.21.15.57:50412) 2024-03-18T14:46:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 -- 172.21.15.57:0/1774418694 learned_addr learned my addr 172.21.15.57:0/1774418694 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 -- 172.21.15.57:0/1774418694 >> v2:172.21.15.57:3300/0 conn(0x7fbe5406da20 msgr2=0x7fbe5413d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 --2- 172.21.15.57:0/1774418694 >> v2:172.21.15.57:3300/0 conn(0x7fbe5406da20 0x7fbe5413d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 -- 172.21.15.57:0/1774418694 >> v1:172.21.15.57:6789/0 conn(0x7fbe5406de30 legacy=0x7fbe54141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.959+0000 7fbe52ffd700 1 -- 172.21.15.57:0/1774418694 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540ad740 con 0x7fbe54063af0 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe52ffd700 1 --2- 172.21.15.57:0/1774418694 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe440099b0 tx=0x7fbe44009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7847af4d73ab9d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe51ffb700 1 -- 172.21.15.57:0/1774418694 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400b820 con 0x7fbe54063af0 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe51ffb700 1 -- 172.21.15.57:0/1774418694 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4400b980 con 0x7fbe54063af0 2024-03-18T14:46:54.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe51ffb700 1 -- 172.21.15.57:0/1774418694 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4400bd20 con 0x7fbe54063af0 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe592e9700 1 -- 172.21.15.57:0/1774418694 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 msgr2=0x7fbe5406e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.960+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1774418694 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe440099b0 tx=0x7fbe44009250 comp rx=0 tx=0).stop 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 -- 172.21.15.57:0/1774418694 shutdown_connections 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1774418694 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe54063af0 0x7fbe5406e4f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1774418694 >> v2:172.21.15.57:3300/0 conn(0x7fbe5406da20 0x7fbe5413d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 -- 172.21.15.57:0/1774418694 >> 172.21.15.57:0/1774418694 conn(0x7fbe5406f510 msgr2=0x7fbe5406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 -- 172.21.15.57:0/1774418694 shutdown_connections 2024-03-18T14:46:54.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.961+0000 7fbe592e9700 1 -- 172.21.15.57:0/1774418694 wait complete. 2024-03-18T14:46:54.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.3 2024-03-18T14:46:54.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 Processor -- start 2024-03-18T14:46:54.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 -- start start 2024-03-18T14:46:54.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe5406de30 0x7fbe5413a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5411bf80 con 0x7fbe54063af0 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54151840 con 0x7fbe5406da20 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.962+0000 7fbe592e9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54151b00 con 0x7fbe5406de30 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41924/0 (socket says 172.21.15.57:41924) 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 -- 172.21.15.57:0/1620168267 learned_addr learned my addr 172.21.15.57:0/1620168267 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe52ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55264/0 (socket says 172.21.15.57:55264) 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe537fe700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe5406de30 0x7fbe5413a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 -- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe5406de30 msgr2=0x7fbe5413a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe5406de30 0x7fbe5413a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 -- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 msgr2=0x7fbe5411ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:54.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 -- 172.21.15.57:0/1620168267 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440094f0 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe52ffd700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe527fc700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800b810 tx=0x7fbe48009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800f510 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54151500 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4800f670 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.963+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4800fa30 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.964+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe541194a0 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.964+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5411b7a0 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.965+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7fbe4801a400 con 0x7fbe5406da20 2024-03-18T14:46:54.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.965+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fbe4805a840 con 0x7fbe5406da20 2024-03-18T14:46:54.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:54.969+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fbe5411b7a0 con 0x7fbe5406da20 2024-03-18T14:46:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.000+0000 7fda6f9a0700 1 Processor -- start 2024-03-18T14:46:55.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.000+0000 7fda6f9a0700 1 -- start start 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6f9a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda6813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6f9a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda681401c0 0x7fda68146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6f9a0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680a5590 con 0x7fda680680f0 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6f9a0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6813f710 con 0x7fda681401c0 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6f9a0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda6813f9d0 con 0x7fda680a70f0 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda6813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6d73c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda680680f0 0x7fda680a4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40656/0 (socket says 172.21.15.57:40656) 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6d73c700 1 -- 172.21.15.57:0/2706577208 learned_addr learned my addr 172.21.15.57:0/2706577208 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6df3d700 1 --2- 172.21.15.57:0/2706577208 >> v2:172.21.15.57:3300/0 conn(0x7fda681401c0 0x7fda68146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda5ffff700 1 -- 172.21.15.57:0/2706577208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294703381 0 0) 0x7fda680a5590 con 0x7fda680680f0 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 -- 172.21.15.57:0/2706577208 >> v2:172.21.15.57:3300/0 conn(0x7fda681401c0 msgr2=0x7fda68146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 --2- 172.21.15.57:0/2706577208 >> v2:172.21.15.57:3300/0 conn(0x7fda681401c0 0x7fda68146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 -- 172.21.15.57:0/2706577208 >> v1:172.21.15.57:6789/0 conn(0x7fda680680f0 legacy=0x7fda680a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 -- 172.21.15.57:0/2706577208 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680a44c0 con 0x7fda680a70f0 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda6cf3b700 1 --2- 172.21.15.57:0/2706577208 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda6813fc80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda580098e0 tx=0x7fda580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc8b0534e3f196f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda5ffff700 1 -- 172.21.15.57:0/2706577208 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800b640 con 0x7fda680a70f0 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda5ffff700 1 -- 172.21.15.57:0/2706577208 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5800b7a0 con 0x7fda680a70f0 2024-03-18T14:46:55.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.001+0000 7fda5ffff700 1 -- 172.21.15.57:0/2706577208 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800bb40 con 0x7fda680a70f0 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 -- 172.21.15.57:0/2706577208 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 msgr2=0x7fda6813fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 --2- 172.21.15.57:0/2706577208 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda6813fc80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda580098e0 tx=0x7fda580091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 -- 172.21.15.57:0/2706577208 shutdown_connections 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 --2- 172.21.15.57:0/2706577208 >> v2:172.21.15.57:3300/0 conn(0x7fda681401c0 0x7fda68146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 --2- 172.21.15.57:0/2706577208 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda6813fc80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 -- 172.21.15.57:0/2706577208 >> 172.21.15.57:0/2706577208 conn(0x7fda6806be90 msgr2=0x7fda680679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:55.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 -- 172.21.15.57:0/2706577208 shutdown_connections 2024-03-18T14:46:55.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.002+0000 7fda6f9a0700 1 -- 172.21.15.57:0/2706577208 wait complete. 2024-03-18T14:46:55.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.004+0000 7fda6f9a0700 1 Processor -- start 2024-03-18T14:46:55.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.004+0000 7fda6f9a0700 1 -- start start 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda680680f0 0x7fda680a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681401c0 0x7fda6814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680aa160 con 0x7fda681401c0 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda68149f60 con 0x7fda680680f0 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6f9a0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda6813c430 con 0x7fda680a70f0 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6d73c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda680680f0 0x7fda680a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50434/0 (socket says 172.21.15.57:50434) 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 -- 172.21.15.57:0/4262572337 learned_addr learned my addr 172.21.15.57:0/4262572337 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:55.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6df3d700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681401c0 0x7fda6814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 -- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda680680f0 msgr2=0x7fda680a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda680680f0 0x7fda680a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 -- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681401c0 msgr2=0x7fda6814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681401c0 0x7fda6814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.005+0000 7fda6cf3b700 1 -- 172.21.15.57:0/4262572337 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58009420 con 0x7fda680a70f0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda6cf3b700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda680a5720 tx=0x7fda58017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5800bb20 con 0x7fda680a70f0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58000c90 con 0x7fda680a70f0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda6f9a0700 1 -- 172.21.15.57:0/4262572337 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6806a950 con 0x7fda680a70f0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58011630 con 0x7fda680a70f0 2024-03-18T14:46:55.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.006+0000 7fda6f9a0700 1 -- 172.21.15.57:0/4262572337 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6813cda0 con 0x7fda680a70f0 2024-03-18T14:46:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.007+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda400052b0 con 0x7fda680a70f0 2024-03-18T14:46:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.007+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7fda580119a0 con 0x7fda680a70f0 2024-03-18T14:46:55.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.008+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fda5805bfa0 con 0x7fda680a70f0 2024-03-18T14:46:55.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.011+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fda58084dc0 con 0x7fda680a70f0 2024-03-18T14:46:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.042+0000 7fda4828b700 1 Processor -- start 2024-03-18T14:46:55.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.042+0000 7fda4828b700 1 -- start start 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda4828b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 0x7fda400a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda4828b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 0x7fda40146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda4828b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda400a41f0 con 0x7fda400b23a0 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda4828b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda400a27c0 con 0x7fda400a33b0 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda4828b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda400a6260 con 0x7fda40140190 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda46027700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda400b23a0 0x7fda4013fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40660/0 (socket says 172.21.15.57:40660) 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda46027700 1 -- 172.21.15.57:0/1798072368 learned_addr learned my addr 172.21.15.57:0/1798072368 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda45826700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 0x7fda400a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.043+0000 7fda46828700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 0x7fda40146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45025700 1 -- 172.21.15.57:0/1798072368 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348303082 0 0) 0x7fda400a41f0 con 0x7fda400b23a0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45025700 1 -- 172.21.15.57:0/1798072368 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda2c003570 con 0x7fda400b23a0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda46828700 1 -- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 msgr2=0x7fda400a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda46828700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 0x7fda400a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda46828700 1 -- 172.21.15.57:0/1798072368 >> v1:172.21.15.57:6789/0 conn(0x7fda400b23a0 legacy=0x7fda4013fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda46828700 1 -- 172.21.15.57:0/1798072368 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4013f650 con 0x7fda400a33b0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45826700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 0x7fda400a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda46828700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 0x7fda40146930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda38009e90 tx=0x7fda38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd80a8c11d8e9c02 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45025700 1 -- 172.21.15.57:0/1798072368 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3800e070 con 0x7fda400a33b0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45025700 1 -- 172.21.15.57:0/1798072368 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3800bb80 con 0x7fda400a33b0 2024-03-18T14:46:55.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.044+0000 7fda45025700 1 -- 172.21.15.57:0/1798072368 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38012430 con 0x7fda400a33b0 2024-03-18T14:46:55.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 -- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 msgr2=0x7fda40146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 0x7fda40146930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fda38009e90 tx=0x7fda38009780 comp rx=0 tx=0).stop 2024-03-18T14:46:55.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 -- 172.21.15.57:0/1798072368 shutdown_connections 2024-03-18T14:46:55.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400a33b0 0x7fda40146930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 --2- 172.21.15.57:0/1798072368 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda40140190 0x7fda400a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 -- 172.21.15.57:0/1798072368 >> 172.21.15.57:0/1798072368 conn(0x7fda4006d1f0 msgr2=0x7fda4006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 -- 172.21.15.57:0/1798072368 shutdown_connections 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.045+0000 7fda4828b700 1 -- 172.21.15.57:0/1798072368 wait complete. 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.047+0000 7fda4828b700 1 Processor -- start 2024-03-18T14:46:55.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.047+0000 7fda4828b700 1 -- start start 2024-03-18T14:46:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400b23a0 0x7fda4014f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 0x7fda4014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:55.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda40098a00 con 0x7fda40140190 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda40097a20 con 0x7fda400b23a0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda4828b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fda40096a50 con 0x7fda400a33b0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50446/0 (socket says 172.21.15.57:50446) 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 -- 172.21.15.57:0/3047267321 learned_addr learned my addr 172.21.15.57:0/3047267321 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46828700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 0x7fda4014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda45826700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400b23a0 0x7fda4014f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 -- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400b23a0 msgr2=0x7fda4014f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400b23a0 0x7fda4014f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 -- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 msgr2=0x7fda4014f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 0x7fda4014f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 -- 172.21.15.57:0/3047267321 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009420 con 0x7fda400a33b0 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46828700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 0x7fda4014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:55.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda46027700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c7c0 tx=0x7fda3c007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.048+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c005cd0 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.049+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c005e30 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.049+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c007320 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.049+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda38009a20 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.049+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda40097590 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.050+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 8) v1 ==== 53328+0+0 (secure 0 0 0) 0x7fda3c01b3b0 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.050+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fda3c05a400 con 0x7fda400a33b0 2024-03-18T14:46:55.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.050+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda40096db0 con 0x7fda400a33b0 2024-03-18T14:46:55.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.054+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fda40096db0 con 0x7fda400a33b0 2024-03-18T14:46:55.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.134+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbe5411b7a0 con 0x7fbe5406da20 2024-03-18T14:46:55.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.134+0000 7fbe3affd700 1 -- 172.21.15.57:0/1620168267 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe5411b7a0 con 0x7fbe5406da20 2024-03-18T14:46:55.136 INFO:teuthology.orchestra.run.smithi057.stdout:38654705736 2024-03-18T14:46:55.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 >> v1:172.21.15.57:6816/47480 conn(0x7fbe40045d40 legacy=0x7fbe400481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 msgr2=0x7fbe54118f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800b810 tx=0x7fbe48009220 comp rx=0 tx=0).stop 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 shutdown_connections 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbe5406de30 0x7fbe5413a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe54063af0 0x7fbe5411ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 --2- 172.21.15.57:0/1620168267 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbe5406da20 0x7fbe54118f60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 >> 172.21.15.57:0/1620168267 conn(0x7fbe5406f510 msgr2=0x7fbe54144150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 shutdown_connections 2024-03-18T14:46:55.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.137+0000 7fbe592e9700 1 -- 172.21.15.57:0/1620168267 wait complete. 2024-03-18T14:46:55.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705736 for osd.2 2024-03-18T14:46:55.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.179+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fda40005560 con 0x7fda680a70f0 2024-03-18T14:46:55.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.180+0000 7fda5d7fa700 1 -- 172.21.15.57:0/4262572337 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda5802c3f0 con 0x7fda680a70f0 2024-03-18T14:46:55.181 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.181+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 >> v1:172.21.15.57:6816/47480 conn(0x7fda4c045d40 legacy=0x7fda4c0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.181+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 msgr2=0x7fda680a86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.181+0000 7fda52ffd700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fda680a5720 tx=0x7fda58017000 comp rx=0 tx=0).stop 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.181+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 shutdown_connections 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda681401c0 0x7fda6814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda680680f0 0x7fda680a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 --2- 172.21.15.57:0/4262572337 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda680a70f0 0x7fda680a86e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 >> 172.21.15.57:0/4262572337 conn(0x7fda6806be90 msgr2=0x7fda6813d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 shutdown_connections 2024-03-18T14:46:55.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.182+0000 7fda52ffd700 1 -- 172.21.15.57:0/4262572337 wait complete. 2024-03-18T14:46:55.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.1 2024-03-18T14:46:55.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.217+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fda40096db0 con 0x7fda400a33b0 2024-03-18T14:46:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.217+0000 7fda367fc700 1 -- 172.21.15.57:0/3047267321 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fda40096db0 con 0x7fda400a33b0 2024-03-18T14:46:55.219 INFO:teuthology.orchestra.run.smithi057.stdout:38654705735 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 >> v1:172.21.15.57:6816/47480 conn(0x7fda24045d40 legacy=0x7fda240481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 msgr2=0x7fda40097050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00c7c0 tx=0x7fda3c007e00 comp rx=0 tx=0).stop 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 shutdown_connections 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda40140190 0x7fda4014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fda400a33b0 0x7fda40097050 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 --2- 172.21.15.57:0/3047267321 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fda400b23a0 0x7fda4014f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 >> 172.21.15.57:0/3047267321 conn(0x7fda4006d1f0 msgr2=0x7fda400679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 shutdown_connections 2024-03-18T14:46:55.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:55.219+0000 7fda4828b700 1 -- 172.21.15.57:0/3047267321 wait complete. 2024-03-18T14:46:55.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705735 for osd.0 2024-03-18T14:46:55.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:46:56.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.100+0000 7fb9a2221700 1 Processor -- start 2024-03-18T14:46:56.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.100+0000 7fb9a2221700 1 -- start start 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.100+0000 7fb9a2221700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb99c0aded0 0x7fb99c0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb9a2221700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb9a2221700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb99c0ae8a0 con 0x7fb99c063a70 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb9a2221700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb99c0aeb40 con 0x7fb99c0aded0 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb9a2221700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c0ac110 con 0x7fb99c13b180 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb99c0aded0 0x7fb99c0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb99c063a70 0x7fb99c0aa1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40676/0 (socket says 172.21.15.57:40676) 2024-03-18T14:46:56.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41966/0 (socket says 172.21.15.57:41966) 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99b7fe700 1 -- 172.21.15.57:0/3106659481 learned_addr learned my addr 172.21.15.57:0/3106659481 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 -- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 msgr2=0x7fb99c13b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 -- 172.21.15.57:0/3106659481 >> v1:172.21.15.57:6789/0 conn(0x7fb99c063a70 legacy=0x7fb99c0aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 -- 172.21.15.57:0/3106659481 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb99c0ac280 con 0x7fb99c0aded0 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99bfff700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99a7fc700 1 -- 172.21.15.57:0/3106659481 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887160352 0 0) 0x7fb99c0ae8a0 con 0x7fb99c063a70 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99affd700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c0ae2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9900098e0 tx=0x7fb9900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58de7da38a9c5d84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99a7fc700 1 -- 172.21.15.57:0/3106659481 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000b6d0 con 0x7fb99c0aded0 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99a7fc700 1 -- 172.21.15.57:0/3106659481 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99000b830 con 0x7fb99c0aded0 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.101+0000 7fb99a7fc700 1 -- 172.21.15.57:0/3106659481 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99000bbd0 con 0x7fb99c0aded0 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 -- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 msgr2=0x7fb99c0ae2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c0ae2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9900098e0 tx=0x7fb9900091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 -- 172.21.15.57:0/3106659481 shutdown_connections 2024-03-18T14:46:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c13b180 0x7fb99c13b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 --2- 172.21.15.57:0/3106659481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c0ae2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 -- 172.21.15.57:0/3106659481 >> 172.21.15.57:0/3106659481 conn(0x7fb99c06a4d0 msgr2=0x7fb99c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 -- 172.21.15.57:0/3106659481 shutdown_connections 2024-03-18T14:46:56.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.102+0000 7fb9a2221700 1 -- 172.21.15.57:0/3106659481 wait complete. 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.103+0000 7fb9a2221700 1 Processor -- start 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.103+0000 7fb9a2221700 1 -- start start 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb99c13b180 0x7fb99c0aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c14da30 con 0x7fb99c0aded0 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c119b20 con 0x7fb99c063a70 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb99c14e930 con 0x7fb99c13b180 2024-03-18T14:46:56.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb99c13b180 0x7fb99c0aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:41982/0 (socket says 172.21.15.57:41982) 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 -- 172.21.15.57:0/1525726920 learned_addr learned my addr 172.21.15.57:0/1525726920 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55314/0 (socket says 172.21.15.57:55314) 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 -- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb99c13b180 msgr2=0x7fb99c0aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb99c13b180 0x7fb99c0aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 -- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 msgr2=0x7fb99c14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 -- 172.21.15.57:0/1525726920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994009420 con 0x7fb99c063a70 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99affd700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb99b7fe700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ccc0 tx=0x7fb98c001a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00a990 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990009420 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.104+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99c0b2170 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.105+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98c00aaf0 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.105+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98c0070f0 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.105+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c0052b0 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.106+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fb98c007520 con 0x7fb99c063a70 2024-03-18T14:46:56.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.106+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fb98c05b280 con 0x7fb99c063a70 2024-03-18T14:46:56.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.110+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fb98c039720 con 0x7fb99c063a70 2024-03-18T14:46:56.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:46:56.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:46:56.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:46:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.275+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb97c005830 con 0x7fb99c063a70 2024-03-18T14:46:56.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.276+0000 7fb9837fe700 1 -- 172.21.15.57:0/1525726920 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb98c03cf10 con 0x7fb99c063a70 2024-03-18T14:46:56.278 INFO:teuthology.orchestra.run.smithi057.stdout:38654705737 2024-03-18T14:46:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.277+0000 7f53a09fe700 1 Processor -- start 2024-03-18T14:46:56.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.277+0000 7f53a09fe700 1 -- start start 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f539c06a920 0x7f539c0a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c0b2fa0 0x7f539c06e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c06ee40 0x7f539c06f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c0a52f0 con 0x7f539c06a920 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c068e10 con 0x7f539c0b2fa0 2024-03-18T14:46:56.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f53a09fe700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0b05c0 con 0x7f539c06ee40 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f539c06a920 0x7f539c0a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f539c06a920 0x7f539c0a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55330/0 (socket says 172.21.15.57:55330) 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 -- 172.21.15.57:0/1333139631 learned_addr learned my addr 172.21.15.57:0/1333139631 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 -- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c06ee40 msgr2=0x7f539c06f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c06ee40 0x7f539c06f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 -- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c0b2fa0 msgr2=0x7f539c06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c0b2fa0 0x7f539c06e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 -- 172.21.15.57:0/1333139631 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0a5530 con 0x7f539c06a920 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.278+0000 7f539ad9d700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06a920 0x7f539c0a4db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f538c0099b0 tx=0x7f538c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9ad3d9732cedc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7f5399d9b700 1 -- 172.21.15.57:0/1333139631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c00b860 con 0x7f539c06a920 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7f5399d9b700 1 -- 172.21.15.57:0/1333139631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c00b9c0 con 0x7f539c06a920 2024-03-18T14:46:56.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7f5399d9b700 1 -- 172.21.15.57:0/1333139631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c00bd60 con 0x7f539c06a920 2024-03-18T14:46:56.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 >> v1:172.21.15.57:6816/47480 conn(0x7fb988045f80 legacy=0x7fb988048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 msgr2=0x7fb99c14deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00ccc0 tx=0x7fb98c001a80 comp rx=0 tx=0).stop 2024-03-18T14:46:56.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 shutdown_connections 2024-03-18T14:46:56.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb99c13b180 0x7fb99c0aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb99c063a70 0x7fb99c14deb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 --2- 172.21.15.57:0/1525726920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb99c0aded0 0x7fb99c14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.279+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 >> 172.21.15.57:0/1525726920 conn(0x7fb99c06a4d0 msgr2=0x7fb99c13ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 shutdown_connections 2024-03-18T14:46:56.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7fb9a2221700 1 -- 172.21.15.57:0/1525726920 wait complete. 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 -- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06a920 msgr2=0x7f539c0a4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06a920 0x7f539c0a4db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f538c0099b0 tx=0x7f538c009250 comp rx=0 tx=0).stop 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 -- 172.21.15.57:0/1333139631 shutdown_connections 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c06ee40 0x7f539c06f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06a920 0x7f539c0a4db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 --2- 172.21.15.57:0/1333139631 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c0b2fa0 0x7f539c06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 -- 172.21.15.57:0/1333139631 >> 172.21.15.57:0/1333139631 conn(0x7f539c06bad0 msgr2=0x7f539c06bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 -- 172.21.15.57:0/1333139631 shutdown_connections 2024-03-18T14:46:56.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.280+0000 7f53a09fe700 1 -- 172.21.15.57:0/1333139631 wait complete. 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.281+0000 7f53a09fe700 1 Processor -- start 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 -- start start 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 0x7f539c140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c097cf0 0x7f539c140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0ae2e0 con 0x7f539c06ee40 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c099a90 con 0x7f539c097cf0 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.282+0000 7f53a09fe700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f539c141300 con 0x7f539c0b2fa0 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539ad9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55342/0 (socket says 172.21.15.57:55342) 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539ad9d700 1 -- 172.21.15.57:0/2316367947 learned_addr learned my addr 172.21.15.57:0/2316367947 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 0x7f539c140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539b59e700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c097cf0 0x7f539c140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 -- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c097cf0 msgr2=0x7f539c140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c097cf0 0x7f539c140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 -- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 msgr2=0x7f539c099f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 -- 172.21.15.57:0/2316367947 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c0094f0 con 0x7f539c0b2fa0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539ad9d700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f539a59c700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 0x7f539c140880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f539000b510 tx=0x7f53900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000be80 con 0x7f539c0b2fa0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539000f510 con 0x7f539c0b2fa0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.283+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c099820 con 0x7f539c0b2fa0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.284+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c097850 con 0x7f539c0b2fa0 2024-03-18T14:46:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.284+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539000f8b0 con 0x7f539c0b2fa0 2024-03-18T14:46:56.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.285+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f539000fc60 con 0x7f539c0b2fa0 2024-03-18T14:46:56.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.285+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f539005a880 con 0x7f539c0b2fa0 2024-03-18T14:46:56.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.286+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537c0052b0 con 0x7f539c0b2fa0 2024-03-18T14:46:56.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.290+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f5390038ca0 con 0x7f539c0b2fa0 2024-03-18T14:46:56.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705737 for osd.3 2024-03-18T14:46:56.299 DEBUG:teuthology.parallel:result is None 2024-03-18T14:46:56.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.326+0000 7f1a67780700 1 Processor -- start 2024-03-18T14:46:56.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.326+0000 7f1a67780700 1 -- start start 2024-03-18T14:46:56.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a67780700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a60063a70 0x7f1a6006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a67780700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a67780700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6013be70 con 0x7f1a6013ae40 2024-03-18T14:46:56.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a67780700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6006ead0 con 0x7f1a60063a70 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a67780700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6013b340 con 0x7f1a60138860 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a64d1b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1a6013ae40 0x7f1a60138150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40690/0 (socket says 172.21.15.57:40690) 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a6551c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a60063a70 0x7f1a6006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a64d1b700 1 -- 172.21.15.57:0/2025031881 learned_addr learned my addr 172.21.15.57:0/2025031881 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 --2- 172.21.15.57:0/2025031881 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50476/0 (socket says 172.21.15.57:50476) 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a57fff700 1 -- 172.21.15.57:0/2025031881 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367906194 0 0) 0x7f1a50001110 con 0x7f1a6013ae40 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 -- 172.21.15.57:0/2025031881 >> v2:172.21.15.57:3300/0 conn(0x7f1a60063a70 msgr2=0x7f1a6006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 --2- 172.21.15.57:0/2025031881 >> v2:172.21.15.57:3300/0 conn(0x7f1a60063a70 0x7f1a6006d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 -- 172.21.15.57:0/2025031881 >> v1:172.21.15.57:6789/0 conn(0x7f1a6013ae40 legacy=0x7f1a60138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.327+0000 7f1a65d1d700 1 -- 172.21.15.57:0/2025031881 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6013b5e0 con 0x7f1a60138860 2024-03-18T14:46:56.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a65d1d700 1 --2- 172.21.15.57:0/2025031881 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e60 tx=0x7f1a58009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1db723894e4a10c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a57fff700 1 -- 172.21.15.57:0/2025031881 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5800e070 con 0x7f1a60138860 2024-03-18T14:46:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a57fff700 1 -- 172.21.15.57:0/2025031881 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5800bb60 con 0x7f1a60138860 2024-03-18T14:46:56.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a57fff700 1 -- 172.21.15.57:0/2025031881 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a58012430 con 0x7f1a60138860 2024-03-18T14:46:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 -- 172.21.15.57:0/2025031881 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 msgr2=0x7f1a601457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 --2- 172.21.15.57:0/2025031881 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009e60 tx=0x7f1a58009780 comp rx=0 tx=0).stop 2024-03-18T14:46:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 -- 172.21.15.57:0/2025031881 shutdown_connections 2024-03-18T14:46:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 --2- 172.21.15.57:0/2025031881 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a60138860 0x7f1a601457e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 --2- 172.21.15.57:0/2025031881 >> v2:172.21.15.57:3300/0 conn(0x7f1a60063a70 0x7f1a6006d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.328+0000 7f1a67780700 1 -- 172.21.15.57:0/2025031881 >> 172.21.15.57:0/2025031881 conn(0x7f1a6006a4d0 msgr2=0x7f1a6006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.329+0000 7f1a67780700 1 -- 172.21.15.57:0/2025031881 shutdown_connections 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.329+0000 7f1a67780700 1 -- 172.21.15.57:0/2025031881 wait complete. 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.330+0000 7f1a67780700 1 Processor -- start 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.330+0000 7f1a67780700 1 -- start start 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 0x7f1a600a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a6013ae40 0x7f1a600abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600ab0b0 con 0x7f1a60138860 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600a8d00 con 0x7f1a60063a70 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a67780700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600a8fa0 con 0x7f1a6013ae40 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42010/0 (socket says 172.21.15.57:42010) 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 -- 172.21.15.57:0/3683654262 learned_addr learned my addr 172.21.15.57:0/3683654262 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a64d1b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 0x7f1a600a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a65d1d700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a6013ae40 0x7f1a600abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 -- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a6013ae40 msgr2=0x7f1a600abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a6013ae40 0x7f1a600abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 -- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 msgr2=0x7f1a600a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 0x7f1a600a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 -- 172.21.15.57:0/3683654262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58009a20 con 0x7f1a60063a70 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a64d1b700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 0x7f1a600a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.331+0000 7f1a6551c700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ecb0 tx=0x7f1a5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.332+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00c850 con 0x7f1a60063a70 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.332+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00c9b0 con 0x7f1a60063a70 2024-03-18T14:46:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.332+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a600a8150 con 0x7f1a60063a70 2024-03-18T14:46:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.332+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00cd50 con 0x7f1a60063a70 2024-03-18T14:46:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.332+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a600a5600 con 0x7f1a60063a70 2024-03-18T14:46:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.333+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a600a61f0 con 0x7f1a60063a70 2024-03-18T14:46:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.334+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f1a5c013680 con 0x7f1a60063a70 2024-03-18T14:46:56.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.334+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f1a5c05b9d0 con 0x7f1a60063a70 2024-03-18T14:46:56.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.337+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1a5c039f20 con 0x7f1a60063a70 2024-03-18T14:46:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.370+0000 7f07a919f700 1 Processor -- start 2024-03-18T14:46:56.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.370+0000 7f07a919f700 1 -- start start 2024-03-18T14:46:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a919f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40b4e00 0x7f07a40a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a919f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 0x7f07a413e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a919f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a40b51d0 con 0x7f07a413ed90 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a919f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40a75c0 con 0x7f07a40b4e00 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a919f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40a65b0 con 0x7f07a40a7190 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a899e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f07a413ed90 0x7f07a40a5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40706/0 (socket says 172.21.15.57:40706) 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a899e700 1 -- 172.21.15.57:0/3587441218 learned_addr learned my addr 172.21.15.57:0/3587441218 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a37fe700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 0x7f07a413e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a3fff700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40b4e00 0x7f07a40a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a2ffd700 1 -- 172.21.15.57:0/3587441218 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173855425 0 0) 0x7f07a40b51d0 con 0x7f07a413ed90 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a2ffd700 1 -- 172.21.15.57:0/3587441218 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f078c003570 con 0x7f07a413ed90 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a37fe700 1 -- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40b4e00 msgr2=0x7f07a40a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a37fe700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40b4e00 0x7f07a40a8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a37fe700 1 -- 172.21.15.57:0/3587441218 >> v1:172.21.15.57:6789/0 conn(0x7f07a413ed90 legacy=0x7f07a40a5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.371+0000 7f07a37fe700 1 -- 172.21.15.57:0/3587441218 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40aa5e0 con 0x7f07a40a7190 2024-03-18T14:46:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a37fe700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 0x7f07a413e850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0798009910 tx=0x7f07980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d257edc1cc186854 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a2ffd700 1 -- 172.21.15.57:0/3587441218 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798011630 con 0x7f07a40a7190 2024-03-18T14:46:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a2ffd700 1 -- 172.21.15.57:0/3587441218 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0798011790 con 0x7f07a40a7190 2024-03-18T14:46:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a2ffd700 1 -- 172.21.15.57:0/3587441218 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0798011b30 con 0x7f07a40a7190 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 -- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 msgr2=0x7f07a413e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 0x7f07a413e850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0798009910 tx=0x7f07980091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 -- 172.21.15.57:0/3587441218 shutdown_connections 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40b4e00 0x7f07a40a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 --2- 172.21.15.57:0/3587441218 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a40a7190 0x7f07a413e850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 -- 172.21.15.57:0/3587441218 >> 172.21.15.57:0/3587441218 conn(0x7f07a4068ad0 msgr2=0x7f07a4068ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 -- 172.21.15.57:0/3587441218 shutdown_connections 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.372+0000 7f07a919f700 1 -- 172.21.15.57:0/3587441218 wait complete. 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.373+0000 7f07a919f700 1 Processor -- start 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 -- start start 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 0x7f07a40b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 0x7f07a4151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b0c60 con 0x7f07a40b4e00 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b09a0 con 0x7f07a40a7190 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a919f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40a42a0 con 0x7f07a413ed90 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a37fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55368/0 (socket says 172.21.15.57:55368) 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 0x7f07a40b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a37fe700 1 -- 172.21.15.57:0/2927099367 learned_addr learned my addr 172.21.15.57:0/2927099367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.374+0000 7f07a899e700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 0x7f07a4151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 -- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 msgr2=0x7f07a4151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 0x7f07a4151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 -- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 msgr2=0x7f07a41512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 -- 172.21.15.57:0/2927099367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798009420 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a37fe700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a899e700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 0x7f07a4151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a3fff700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 0x7f07a40b0150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f079400ea50 tx=0x7f07940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400c880 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400ca00 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400cdc0 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a40b0690 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.375+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a40af0a0 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.376+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a40648f0 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.376+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f0794013680 con 0x7f07a40a7190 2024-03-18T14:46:56.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.376+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f079405b300 con 0x7f07a40a7190 2024-03-18T14:46:56.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.380+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0794039660 con 0x7f07a40a7190 2024-03-18T14:46:56.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.509+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f537c005830 con 0x7f539c0b2fa0 2024-03-18T14:46:56.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.509+0000 7f5382ffd700 1 -- 172.21.15.57:0/2316367947 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f539003c490 con 0x7f539c0b2fa0 2024-03-18T14:46:56.511 INFO:teuthology.orchestra.run.smithi057.stdout:38654705738 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 >> v1:172.21.15.57:6816/47480 conn(0x7f5388045f80 legacy=0x7f5388048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 msgr2=0x7f539c140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 0x7f539c140880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f539000b510 tx=0x7f53900090f0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 shutdown_connections 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f539c097cf0 0x7f539c140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f539c06ee40 0x7f539c099f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 --2- 172.21.15.57:0/2316367947 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f539c0b2fa0 0x7f539c140880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 >> 172.21.15.57:0/2316367947 conn(0x7f539c06bad0 msgr2=0x7f539c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 shutdown_connections 2024-03-18T14:46:56.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.511+0000 7f53a09fe700 1 -- 172.21.15.57:0/2316367947 wait complete. 2024-03-18T14:46:56.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705737 got 38654705738 for osd.2 2024-03-18T14:46:56.525 DEBUG:teuthology.parallel:result is None 2024-03-18T14:46:56.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.548+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07a40a4a30 con 0x7f07a40a7190 2024-03-18T14:46:56.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.548+0000 7f078bfff700 1 -- 172.21.15.57:0/2927099367 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f079403ce50 con 0x7f07a40a7190 2024-03-18T14:46:56.550 INFO:teuthology.orchestra.run.smithi057.stdout:38654705737 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 >> v1:172.21.15.57:6816/47480 conn(0x7f0790045f80 legacy=0x7f0790048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 msgr2=0x7f07a40b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 0x7f07a40b0150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f079400ea50 tx=0x7f07940091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 shutdown_connections 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f07a413ed90 0x7f07a4151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f07a40a7190 0x7f07a40b0150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 --2- 172.21.15.57:0/2927099367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a40b4e00 0x7f07a41512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 >> 172.21.15.57:0/2927099367 conn(0x7f07a4068ad0 msgr2=0x7f07a40a5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 shutdown_connections 2024-03-18T14:46:56.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.550+0000 7f07a919f700 1 -- 172.21.15.57:0/2927099367 wait complete. 2024-03-18T14:46:56.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.555+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a600651b0 con 0x7f1a60063a70 2024-03-18T14:46:56.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.555+0000 7f1a557fa700 1 -- 172.21.15.57:0/3683654262 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a5c021070 con 0x7f1a60063a70 2024-03-18T14:46:56.556 INFO:teuthology.orchestra.run.smithi057.stdout:38654705737 2024-03-18T14:46:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 >> v1:172.21.15.57:6816/47480 conn(0x7f1a44045f80 legacy=0x7f1a44048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 msgr2=0x7f1a600a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00ecb0 tx=0x7f1a5c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 shutdown_connections 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1a6013ae40 0x7f1a600abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1a60063a70 0x7f1a600a78e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 --2- 172.21.15.57:0/3683654262 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a60138860 0x7f1a600a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 >> 172.21.15.57:0/3683654262 conn(0x7f1a6006a4d0 msgr2=0x7f1a600ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 shutdown_connections 2024-03-18T14:46:56.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.557+0000 7f1a67780700 1 -- 172.21.15.57:0/3683654262 wait complete. 2024-03-18T14:46:56.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705737 for osd.0 2024-03-18T14:46:56.564 DEBUG:teuthology.parallel:result is None 2024-03-18T14:46:56.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705736 got 38654705737 for osd.1 2024-03-18T14:46:56.571 DEBUG:teuthology.parallel:result is None 2024-03-18T14:46:56.571 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T14:46:56.571 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:46:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.731+0000 7f8b283a3700 1 Processor -- start 2024-03-18T14:46:56.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.731+0000 7f8b283a3700 1 -- start start 2024-03-18T14:46:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b283a3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 0x7f8b20146b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b283a3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b201490d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b283a3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b200aa1c0 con 0x7f8b200b2560 2024-03-18T14:46:56.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b283a3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b200a9a50 con 0x7f8b200a87d0 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b283a3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200a8c60 con 0x7f8b200aa610 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b26940700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b201490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b2593e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 0x7f8b20146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b2613f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8b200b2560 0x7f8b2013e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40712/0 (socket says 172.21.15.57:40712) 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.732+0000 7f8b2613f700 1 -- 172.21.15.57:0/3632427650 learned_addr learned my addr 172.21.15.57:0/3632427650 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b26940700 1 -- 172.21.15.57:0/3632427650 >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 msgr2=0x7f8b20146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b26940700 1 --2- 172.21.15.57:0/3632427650 >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 0x7f8b20146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b26940700 1 -- 172.21.15.57:0/3632427650 >> v1:172.21.15.57:6789/0 conn(0x7f8b200b2560 legacy=0x7f8b2013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b26940700 1 -- 172.21.15.57:0/3632427650 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b200a8f00 con 0x7f8b200aa610 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b2593e700 1 --2- 172.21.15.57:0/3632427650 >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 0x7f8b20146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b26940700 1 --2- 172.21.15.57:0/3632427650 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b201490d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e60 tx=0x7f8b18009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fca063fd199533b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b2513d700 1 -- 172.21.15.57:0/3632427650 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1800e070 con 0x7f8b200aa610 2024-03-18T14:46:56.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b2513d700 1 -- 172.21.15.57:0/3632427650 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1800bbf0 con 0x7f8b200aa610 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b2513d700 1 -- 172.21.15.57:0/3632427650 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18012430 con 0x7f8b200aa610 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b283a3700 1 -- 172.21.15.57:0/3632427650 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 msgr2=0x7f8b201490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.733+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3632427650 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b201490d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009e60 tx=0x7f8b18009780 comp rx=0 tx=0).stop 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 -- 172.21.15.57:0/3632427650 shutdown_connections 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3632427650 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b201490d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3632427650 >> v2:172.21.15.57:3300/0 conn(0x7f8b200a87d0 0x7f8b20146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 -- 172.21.15.57:0/3632427650 >> 172.21.15.57:0/3632427650 conn(0x7f8b20068a10 msgr2=0x7f8b20068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 -- 172.21.15.57:0/3632427650 shutdown_connections 2024-03-18T14:46:56.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.734+0000 7f8b283a3700 1 -- 172.21.15.57:0/3632427650 wait complete. 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.735+0000 7f8b283a3700 1 Processor -- start 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.735+0000 7f8b283a3700 1 -- start start 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 0x7f8b200b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 0x7f8b20151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200ac390 con 0x7f8b200b2560 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200a47f0 con 0x7f8b200aa610 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b283a3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b200b0c80 con 0x7f8b200a87d0 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2613f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 0x7f8b200b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42054/0 (socket says 172.21.15.57:42054) 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2613f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 0x7f8b200b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50520/0 (socket says 172.21.15.57:50520) 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 -- 172.21.15.57:0/3209022513 learned_addr learned my addr 172.21.15.57:0/3209022513 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b26940700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 0x7f8b20151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 -- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 msgr2=0x7f8b200b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 0x7f8b200b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 -- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 msgr2=0x7f8b20151360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 0x7f8b20151360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 -- 172.21.15.57:0/3209022513 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10009420 con 0x7f8b200aa610 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b26940700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 0x7f8b20151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b2593e700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000ec80 tx=0x7f8b100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000c9b0 con 0x7f8b200aa610 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.736+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1000cb10 con 0x7f8b200aa610 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.737+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b18009a20 con 0x7f8b200aa610 2024-03-18T14:46:56.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.737+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000ce90 con 0x7f8b200aa610 2024-03-18T14:46:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.737+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b200af650 con 0x7f8b200aa610 2024-03-18T14:46:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.737+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b20065180 con 0x7f8b200aa610 2024-03-18T14:46:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.737+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f8b10013680 con 0x7f8b200aa610 2024-03-18T14:46:56.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.738+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f8b1005b430 con 0x7f8b200aa610 2024-03-18T14:46:56.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.742+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f8b10039740 con 0x7f8b200aa610 2024-03-18T14:46:56.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.899+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8b200b1ee0 con 0x7f8b04045fb0 2024-03-18T14:46:56.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.907+0000 7f8b167fc700 1 -- 172.21.15.57:0/3209022513 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272480 (unknown 2965378022 0 3931481024) 0x7f8b200b1ee0 con 0x7f8b04045fb0 2024-03-18T14:46:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 >> v1:172.21.15.57:6816/47480 conn(0x7f8b04045fb0 legacy=0x7f8b04048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 msgr2=0x7f8b200af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000ec80 tx=0x7f8b100091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 shutdown_connections 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b200b2560 0x7f8b20151360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8b200a87d0 0x7f8b200b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 --2- 172.21.15.57:0/3209022513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8b200aa610 0x7f8b200af110 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 >> 172.21.15.57:0/3209022513 conn(0x7f8b20068a10 msgr2=0x7f8b200b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 shutdown_connections 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:56.910+0000 7f8b283a3700 1 -- 172.21.15.57:0/3209022513 wait complete. 2024-03-18T14:46:56.915 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:46:56.923 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-03-18T14:46:56.542380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137119479,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":6113,"num_read_kb":2925843,"num_write":64890,"num_write_kb":8746724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71323,"ondisk_log_size":71323,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4462928,"kb_used_data":268592,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373024432,"statfs":{"total":386547056640,"available":381977018368,"internally_reserved":4294967296,"allocated":275038208,"data_stored":274474654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003479"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":855,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234944+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:44:43.234944+0000","last_peered":"2024-03-18T14:44:43.234944+0000","last_clean":"2024-03-18T14:44:43.234944+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:44:43.234944+0000","last_undegraded":"2024-03-18T14:44:43.234944+0000","last_fullsized":"2024-03-18T14:44:43.234944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":899,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231000+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:44:43.231000+0000","last_peered":"2024-03-18T14:44:43.231000+0000","last_clean":"2024-03-18T14:44:43.231000+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:44:43.231000+0000","last_undegraded":"2024-03-18T14:44:43.231000+0000","last_fullsized":"2024-03-18T14:44:43.231000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":920,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338882+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:44:42.338882+0000","last_peered":"2024-03-18T14:44:42.338882+0000","last_clean":"2024-03-18T14:44:42.338882+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:44:42.338882+0000","last_undegraded":"2024-03-18T14:44:42.338882+0000","last_fullsized":"2024-03-18T14:44:42.338882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":900,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.347875+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:44:42.347875+0000","last_peered":"2024-03-18T14:44:42.347875+0000","last_clean":"2024-03-18T14:44:42.347875+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:44:42.347875+0000","last_undegraded":"2024-03-18T14:44:42.347875+0000","last_fullsized":"2024-03-18T14:44:42.347875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":854,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.306429+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:44:42.306429+0000","last_peered":"2024-03-18T14:44:42.306429+0000","last_clean":"2024-03-18T14:44:42.306429+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:44:42.306429+0000","last_undegraded":"2024-03-18T14:44:42.306429+0000","last_fullsized":"2024-03-18T14:44:42.306429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":878,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231069+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:44:43.231069+0000","last_peered":"2024-03-18T14:44:43.231069+0000","last_clean":"2024-03-18T14:44:43.231069+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:44:43.231069+0000","last_undegraded":"2024-03-18T14:44:43.231069+0000","last_fullsized":"2024-03-18T14:44:43.231069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":926,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.318203+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:44:42.318203+0000","last_peered":"2024-03-18T14:44:42.318203+0000","last_clean":"2024-03-18T14:44:42.318203+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:44:42.318203+0000","last_undegraded":"2024-03-18T14:44:42.318203+0000","last_fullsized":"2024-03-18T14:44:42.318203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":777,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.272937+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:44:42.272937+0000","last_peered":"2024-03-18T14:44:42.272937+0000","last_clean":"2024-03-18T14:44:42.272937+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:44:42.272937+0000","last_undegraded":"2024-03-18T14:44:42.272937+0000","last_fullsized":"2024-03-18T14:44:42.272937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":919,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.327298+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:44:42.327298+0000","last_peered":"2024-03-18T14:44:42.327298+0000","last_clean":"2024-03-18T14:44:42.327298+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:44:42.327298+0000","last_undegraded":"2024-03-18T14:44:42.327298+0000","last_fullsized":"2024-03-18T14:44:42.327298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331718+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:44:42.331718+0000","last_peered":"2024-03-18T14:44:42.331718+0000","last_clean":"2024-03-18T14:44:42.331718+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:44:42.331718+0000","last_undegraded":"2024-03-18T14:44:42.331718+0000","last_fullsized":"2024-03-18T14:44:42.331718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":779,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337864+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:44:42.337864+0000","last_peered":"2024-03-18T14:44:42.337864+0000","last_clean":"2024-03-18T14:44:42.337864+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:44:42.337864+0000","last_undegraded":"2024-03-18T14:44:42.337864+0000","last_fullsized":"2024-03-18T14:44:42.337864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":807,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.234128+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:44:42.234128+0000","last_peered":"2024-03-18T14:44:42.234128+0000","last_clean":"2024-03-18T14:44:42.234128+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:44:42.234128+0000","last_undegraded":"2024-03-18T14:44:42.234128+0000","last_fullsized":"2024-03-18T14:44:42.234128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":861,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237957+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:44:43.237957+0000","last_peered":"2024-03-18T14:44:43.237957+0000","last_clean":"2024-03-18T14:44:43.237957+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:44:43.237957+0000","last_undegraded":"2024-03-18T14:44:43.237957+0000","last_fullsized":"2024-03-18T14:44:43.237957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":984,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349053+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:44:42.349053+0000","last_peered":"2024-03-18T14:44:42.349053+0000","last_clean":"2024-03-18T14:44:42.349053+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:44:42.349053+0000","last_undegraded":"2024-03-18T14:44:42.349053+0000","last_fullsized":"2024-03-18T14:44:42.349053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1025,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345045+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:44:42.345045+0000","last_peered":"2024-03-18T14:44:42.345045+0000","last_clean":"2024-03-18T14:44:42.345045+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:44:42.345045+0000","last_undegraded":"2024-03-18T14:44:42.345045+0000","last_fullsized":"2024-03-18T14:44:42.345045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237069+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:44:43.237069+0000","last_peered":"2024-03-18T14:44:43.237069+0000","last_clean":"2024-03-18T14:44:43.237069+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:44:43.237069+0000","last_undegraded":"2024-03-18T14:44:43.237069+0000","last_fullsized":"2024-03-18T14:44:43.237069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":984,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.344044+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:44:42.344044+0000","last_peered":"2024-03-18T14:44:42.344044+0000","last_clean":"2024-03-18T14:44:42.344044+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:44:42.344044+0000","last_undegraded":"2024-03-18T14:44:42.344044+0000","last_fullsized":"2024-03-18T14:44:42.344044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":983,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.339184+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:44:42.339184+0000","last_peered":"2024-03-18T14:44:42.339184+0000","last_clean":"2024-03-18T14:44:42.339184+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:44:42.339184+0000","last_undegraded":"2024-03-18T14:44:42.339184+0000","last_fullsized":"2024-03-18T14:44:42.339184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":974,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.295627+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:44:42.295627+0000","last_peered":"2024-03-18T14:44:42.295627+0000","last_clean":"2024-03-18T14:44:42.295627+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:44:42.295627+0000","last_undegraded":"2024-03-18T14:44:42.295627+0000","last_fullsized":"2024-03-18T14:44:42.295627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1020,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231841+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:44:43.231841+0000","last_peered":"2024-03-18T14:44:43.231841+0000","last_clean":"2024-03-18T14:44:43.231841+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:44:43.231841+0000","last_undegraded":"2024-03-18T14:44:43.231841+0000","last_fullsized":"2024-03-18T14:44:43.231841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1002,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.232118+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:44:43.232118+0000","last_peered":"2024-03-18T14:44:43.232118+0000","last_clean":"2024-03-18T14:44:43.232118+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:44:43.232118+0000","last_undegraded":"2024-03-18T14:44:43.232118+0000","last_fullsized":"2024-03-18T14:44:43.232118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.316334+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:44:42.316334+0000","last_peered":"2024-03-18T14:44:42.316334+0000","last_clean":"2024-03-18T14:44:42.316334+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:44:42.316334+0000","last_undegraded":"2024-03-18T14:44:42.316334+0000","last_fullsized":"2024-03-18T14:44:42.316334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":988,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.274879+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:44:42.274879+0000","last_peered":"2024-03-18T14:44:42.274879+0000","last_clean":"2024-03-18T14:44:42.274879+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:44:42.274879+0000","last_undegraded":"2024-03-18T14:44:42.274879+0000","last_fullsized":"2024-03-18T14:44:42.274879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":909,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.314174+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:44:42.314174+0000","last_peered":"2024-03-18T14:44:42.314174+0000","last_clean":"2024-03-18T14:44:42.314174+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:44:42.314174+0000","last_undegraded":"2024-03-18T14:44:42.314174+0000","last_fullsized":"2024-03-18T14:44:42.314174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":939,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.300510+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:44:42.300510+0000","last_peered":"2024-03-18T14:44:42.300510+0000","last_clean":"2024-03-18T14:44:42.300510+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:44:42.300510+0000","last_undegraded":"2024-03-18T14:44:42.300510+0000","last_fullsized":"2024-03-18T14:44:42.300510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":895,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234444+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:44:43.234444+0000","last_peered":"2024-03-18T14:44:43.234444+0000","last_clean":"2024-03-18T14:44:43.234444+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:44:43.234444+0000","last_undegraded":"2024-03-18T14:44:43.234444+0000","last_fullsized":"2024-03-18T14:44:43.234444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":903,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345783+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:44:42.345783+0000","last_peered":"2024-03-18T14:44:42.345783+0000","last_clean":"2024-03-18T14:44:42.345783+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:44:42.345783+0000","last_undegraded":"2024-03-18T14:44:42.345783+0000","last_fullsized":"2024-03-18T14:44:42.345783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1502,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.765332+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:45:04.765332+0000","last_peered":"2024-03-18T14:45:04.765332+0000","last_clean":"2024-03-18T14:45:04.765332+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:45:04.765332+0000","last_undegraded":"2024-03-18T14:45:04.765332+0000","last_fullsized":"2024-03-18T14:45:04.765332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":899,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.350076+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:44:42.350076+0000","last_peered":"2024-03-18T14:44:42.350076+0000","last_clean":"2024-03-18T14:44:42.350076+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:44:42.350076+0000","last_undegraded":"2024-03-18T14:44:42.350076+0000","last_fullsized":"2024-03-18T14:44:42.350076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1372,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.781400+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:45:04.781400+0000","last_peered":"2024-03-18T14:45:04.781400+0000","last_clean":"2024-03-18T14:45:04.781400+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:45:04.781400+0000","last_undegraded":"2024-03-18T14:45:04.781400+0000","last_fullsized":"2024-03-18T14:45:04.781400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":1697,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349167+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:44:42.349167+0000","last_peered":"2024-03-18T14:44:42.349167+0000","last_clean":"2024-03-18T14:44:42.349167+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:44:42.349167+0000","last_undegraded":"2024-03-18T14:44:42.349167+0000","last_fullsized":"2024-03-18T14:44:42.349167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1027,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.748799+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:45:04.748799+0000","last_peered":"2024-03-18T14:45:04.748799+0000","last_clean":"2024-03-18T14:45:04.748799+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:45:04.748799+0000","last_undegraded":"2024-03-18T14:45:04.748799+0000","last_fullsized":"2024-03-18T14:45:04.748799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":843,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.306178+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:44:42.306178+0000","last_peered":"2024-03-18T14:44:42.306178+0000","last_clean":"2024-03-18T14:44:42.306178+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:44:42.306178+0000","last_undegraded":"2024-03-18T14:44:42.306178+0000","last_fullsized":"2024-03-18T14:44:42.306178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:09.742987+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:45:09.742987+0000","last_peered":"2024-03-18T14:45:09.742987+0000","last_clean":"2024-03-18T14:45:09.742987+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:45:09.742987+0000","last_undegraded":"2024-03-18T14:45:09.742987+0000","last_fullsized":"2024-03-18T14:45:09.742987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":816,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.347446+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:44:42.347446+0000","last_peered":"2024-03-18T14:44:42.347446+0000","last_clean":"2024-03-18T14:44:42.347446+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:44:42.347446+0000","last_undegraded":"2024-03-18T14:44:42.347446+0000","last_fullsized":"2024-03-18T14:44:42.347446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1660,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.782722+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:45:04.782722+0000","last_peered":"2024-03-18T14:45:04.782722+0000","last_clean":"2024-03-18T14:45:04.782722+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:45:04.782722+0000","last_undegraded":"2024-03-18T14:45:04.782722+0000","last_fullsized":"2024-03-18T14:45:04.782722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1028,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331491+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:44:42.331491+0000","last_peered":"2024-03-18T14:44:42.331491+0000","last_clean":"2024-03-18T14:44:42.331491+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:44:42.331491+0000","last_undegraded":"2024-03-18T14:44:42.331491+0000","last_fullsized":"2024-03-18T14:44:42.331491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'227","reported_seq":239,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.742558+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:45:04.742558+0000","last_peered":"2024-03-18T14:45:04.742558+0000","last_clean":"2024-03-18T14:45:04.742558+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:45:04.742558+0000","last_undegraded":"2024-03-18T14:45:04.742558+0000","last_fullsized":"2024-03-18T14:45:04.742558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1009,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332473+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:44:42.332473+0000","last_peered":"2024-03-18T14:44:42.332473+0000","last_clean":"2024-03-18T14:44:42.332473+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:44:42.332473+0000","last_undegraded":"2024-03-18T14:44:42.332473+0000","last_fullsized":"2024-03-18T14:44:42.332473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'648","reported_seq":660,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T14:46:53.527616+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:46:53.527616+0000","last_peered":"2024-03-18T14:46:53.527616+0000","last_clean":"2024-03-18T14:46:53.527616+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:46:53.527616+0000","last_undegraded":"2024-03-18T14:46:53.527616+0000","last_fullsized":"2024-03-18T14:46:53.527616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":549,"num_write_kb":12563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":955,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.232120+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:44:43.232120+0000","last_peered":"2024-03-18T14:44:43.232120+0000","last_clean":"2024-03-18T14:44:43.232120+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:44:43.232120+0000","last_undegraded":"2024-03-18T14:44:43.232120+0000","last_fullsized":"2024-03-18T14:44:43.232120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":569,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:59.749817+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:44:59.749817+0000","last_peered":"2024-03-18T14:44:59.749817+0000","last_clean":"2024-03-18T14:44:59.749817+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:44:59.749817+0000","last_undegraded":"2024-03-18T14:44:59.749817+0000","last_fullsized":"2024-03-18T14:44:59.749817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":935,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338013+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:44:42.338013+0000","last_peered":"2024-03-18T14:44:42.338013+0000","last_clean":"2024-03-18T14:44:42.338013+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:44:42.338013+0000","last_undegraded":"2024-03-18T14:44:42.338013+0000","last_fullsized":"2024-03-18T14:44:42.338013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":188,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.749536+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:45:04.749536+0000","last_peered":"2024-03-18T14:45:04.749536+0000","last_clean":"2024-03-18T14:45:04.749536+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:45:04.749536+0000","last_undegraded":"2024-03-18T14:45:04.749536+0000","last_fullsized":"2024-03-18T14:45:04.749536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":910,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332164+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:44:42.332164+0000","last_peered":"2024-03-18T14:44:42.332164+0000","last_clean":"2024-03-18T14:44:42.332164+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:44:42.332164+0000","last_undegraded":"2024-03-18T14:44:42.332164+0000","last_fullsized":"2024-03-18T14:44:42.332164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.757398+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:45:04.757398+0000","last_peered":"2024-03-18T14:45:04.757398+0000","last_clean":"2024-03-18T14:45:04.757398+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:45:04.757398+0000","last_undegraded":"2024-03-18T14:45:04.757398+0000","last_fullsized":"2024-03-18T14:45:04.757398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":835,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.327096+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:44:42.327096+0000","last_peered":"2024-03-18T14:44:42.327096+0000","last_clean":"2024-03-18T14:44:42.327096+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:44:42.327096+0000","last_undegraded":"2024-03-18T14:44:42.327096+0000","last_fullsized":"2024-03-18T14:44:42.327096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'151","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T14:46:53.625544+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:46:53.625544+0000","last_peered":"2024-03-18T14:46:53.625544+0000","last_clean":"2024-03-18T14:46:53.625544+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:46:53.625544+0000","last_undegraded":"2024-03-18T14:46:53.625544+0000","last_fullsized":"2024-03-18T14:46:53.625544+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194627,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":39,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":814,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.351408+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:44:42.351408+0000","last_peered":"2024-03-18T14:44:42.351408+0000","last_clean":"2024-03-18T14:44:42.351408+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:44:42.351408+0000","last_undegraded":"2024-03-18T14:44:42.351408+0000","last_fullsized":"2024-03-18T14:44:42.351408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":444,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:39.375676+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:44:39.375676+0000","last_peered":"2024-03-18T14:44:39.375676+0000","last_clean":"2024-03-18T14:44:39.375676+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:44:39.375676+0000","last_undegraded":"2024-03-18T14:44:39.375676+0000","last_fullsized":"2024-03-18T14:44:39.375676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":994,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237601+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:44:43.237601+0000","last_peered":"2024-03-18T14:44:43.237601+0000","last_clean":"2024-03-18T14:44:43.237601+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:44:43.237601+0000","last_undegraded":"2024-03-18T14:44:43.237601+0000","last_fullsized":"2024-03-18T14:44:43.237601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:39.340684+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:44:39.340684+0000","last_peered":"2024-03-18T14:44:39.340684+0000","last_clean":"2024-03-18T14:44:39.340684+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:44:39.340684+0000","last_undegraded":"2024-03-18T14:44:39.340684+0000","last_fullsized":"2024-03-18T14:44:39.340684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.326263+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:44:42.326263+0000","last_peered":"2024-03-18T14:44:42.326263+0000","last_clean":"2024-03-18T14:44:42.326263+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:44:42.326263+0000","last_undegraded":"2024-03-18T14:44:42.326263+0000","last_fullsized":"2024-03-18T14:44:42.326263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":864,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.782042+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:45:04.782042+0000","last_peered":"2024-03-18T14:45:04.782042+0000","last_clean":"2024-03-18T14:45:04.782042+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:45:04.782042+0000","last_undegraded":"2024-03-18T14:45:04.782042+0000","last_fullsized":"2024-03-18T14:45:04.782042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":867,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.342452+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:44:42.342452+0000","last_peered":"2024-03-18T14:44:42.342452+0000","last_clean":"2024-03-18T14:44:42.342452+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:44:42.342452+0000","last_undegraded":"2024-03-18T14:44:42.342452+0000","last_fullsized":"2024-03-18T14:44:42.342452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.254867+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:44:42.254867+0000","last_peered":"2024-03-18T14:44:42.254867+0000","last_clean":"2024-03-18T14:44:42.254867+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:44:42.254867+0000","last_undegraded":"2024-03-18T14:44:42.254867+0000","last_fullsized":"2024-03-18T14:44:42.254867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":904,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.344719+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:44:42.344719+0000","last_peered":"2024-03-18T14:44:42.344719+0000","last_clean":"2024-03-18T14:44:42.344719+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:44:42.344719+0000","last_undegraded":"2024-03-18T14:44:42.344719+0000","last_fullsized":"2024-03-18T14:44:42.344719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":596,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.781941+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:45:04.781941+0000","last_peered":"2024-03-18T14:45:04.781941+0000","last_clean":"2024-03-18T14:45:04.781941+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:45:04.781941+0000","last_undegraded":"2024-03-18T14:45:04.781941+0000","last_fullsized":"2024-03-18T14:45:04.781941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":980,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237552+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:44:43.237552+0000","last_peered":"2024-03-18T14:44:43.237552+0000","last_clean":"2024-03-18T14:44:43.237552+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:44:43.237552+0000","last_undegraded":"2024-03-18T14:44:43.237552+0000","last_fullsized":"2024-03-18T14:44:43.237552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":640,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.766352+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:45:04.766352+0000","last_peered":"2024-03-18T14:45:04.766352+0000","last_clean":"2024-03-18T14:45:04.766352+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:45:04.766352+0000","last_undegraded":"2024-03-18T14:45:04.766352+0000","last_fullsized":"2024-03-18T14:45:04.766352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":868,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.252432+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:44:42.252432+0000","last_peered":"2024-03-18T14:44:42.252432+0000","last_clean":"2024-03-18T14:44:42.252432+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:44:42.252432+0000","last_undegraded":"2024-03-18T14:44:42.252432+0000","last_fullsized":"2024-03-18T14:44:42.252432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'291","reported_seq":303,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.750662+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:45:04.750662+0000","last_peered":"2024-03-18T14:45:04.750662+0000","last_clean":"2024-03-18T14:45:04.750662+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:45:04.750662+0000","last_undegraded":"2024-03-18T14:45:04.750662+0000","last_fullsized":"2024-03-18T14:45:04.750662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":871,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.233976+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:44:43.233976+0000","last_peered":"2024-03-18T14:44:43.233976+0000","last_clean":"2024-03-18T14:44:43.233976+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:44:43.233976+0000","last_undegraded":"2024-03-18T14:44:43.233976+0000","last_fullsized":"2024-03-18T14:44:43.233976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1538,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.777727+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:45:04.777727+0000","last_peered":"2024-03-18T14:45:04.777727+0000","last_clean":"2024-03-18T14:45:04.777727+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:45:04.777727+0000","last_undegraded":"2024-03-18T14:45:04.777727+0000","last_fullsized":"2024-03-18T14:45:04.777727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":869,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.351013+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:44:42.351013+0000","last_peered":"2024-03-18T14:44:42.351013+0000","last_clean":"2024-03-18T14:44:42.351013+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:44:42.351013+0000","last_undegraded":"2024-03-18T14:44:42.351013+0000","last_fullsized":"2024-03-18T14:44:42.351013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318472+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:28.318472+0000","last_peered":"2024-03-18T14:41:28.318472+0000","last_clean":"2024-03-18T14:41:28.318472+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:28.318472+0000","last_undegraded":"2024-03-18T14:41:28.318472+0000","last_fullsized":"2024-03-18T14:41:28.318472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":518,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.300783+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:44:43.300783+0000","last_peered":"2024-03-18T14:44:43.300783+0000","last_clean":"2024-03-18T14:44:43.300783+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:44:43.300783+0000","last_undegraded":"2024-03-18T14:44:43.300783+0000","last_fullsized":"2024-03-18T14:44:43.300783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":911,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.236612+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:44:43.236612+0000","last_peered":"2024-03-18T14:44:43.236612+0000","last_clean":"2024-03-18T14:44:43.236612+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:44:43.236612+0000","last_undegraded":"2024-03-18T14:44:43.236612+0000","last_fullsized":"2024-03-18T14:44:43.236612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.316904+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:28.316904+0000","last_peered":"2024-03-18T14:41:28.316904+0000","last_clean":"2024-03-18T14:41:28.316904+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:28.316904+0000","last_undegraded":"2024-03-18T14:41:28.316904+0000","last_fullsized":"2024-03-18T14:41:28.316904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":724,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.765773+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:45:04.765773+0000","last_peered":"2024-03-18T14:45:04.765773+0000","last_clean":"2024-03-18T14:45:04.765773+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:45:04.765773+0000","last_undegraded":"2024-03-18T14:45:04.765773+0000","last_fullsized":"2024-03-18T14:45:04.765773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":914,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231477+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:44:43.231477+0000","last_peered":"2024-03-18T14:44:43.231477+0000","last_clean":"2024-03-18T14:44:43.231477+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:44:43.231477+0000","last_undegraded":"2024-03-18T14:44:43.231477+0000","last_fullsized":"2024-03-18T14:44:43.231477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:29.298416+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:29.298416+0000","last_peered":"2024-03-18T14:41:29.298416+0000","last_clean":"2024-03-18T14:41:29.298416+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:29.298416+0000","last_undegraded":"2024-03-18T14:41:29.298416+0000","last_fullsized":"2024-03-18T14:41:29.298416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'829","reported_seq":841,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.780700+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:45:04.780700+0000","last_peered":"2024-03-18T14:45:04.780700+0000","last_clean":"2024-03-18T14:45:04.780700+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:45:04.780700+0000","last_undegraded":"2024-03-18T14:45:04.780700+0000","last_fullsized":"2024-03-18T14:45:04.780700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":833,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331637+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:44:42.331637+0000","last_peered":"2024-03-18T14:44:42.331637+0000","last_clean":"2024-03-18T14:44:42.331637+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:44:42.331637+0000","last_undegraded":"2024-03-18T14:44:42.331637+0000","last_fullsized":"2024-03-18T14:44:42.331637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317380+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:28.317380+0000","last_peered":"2024-03-18T14:41:28.317380+0000","last_clean":"2024-03-18T14:41:28.317380+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:28.317380+0000","last_undegraded":"2024-03-18T14:41:28.317380+0000","last_fullsized":"2024-03-18T14:41:28.317380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317013+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:28.317013+0000","last_peered":"2024-03-18T14:41:28.317013+0000","last_clean":"2024-03-18T14:41:28.317013+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:28.317013+0000","last_undegraded":"2024-03-18T14:41:28.317013+0000","last_fullsized":"2024-03-18T14:41:28.317013+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1025,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.766010+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:45:04.766010+0000","last_peered":"2024-03-18T14:45:04.766010+0000","last_clean":"2024-03-18T14:45:04.766010+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:45:04.766010+0000","last_undegraded":"2024-03-18T14:45:04.766010+0000","last_fullsized":"2024-03-18T14:45:04.766010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338228+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:44:42.338228+0000","last_peered":"2024-03-18T14:44:42.338228+0000","last_clean":"2024-03-18T14:44:42.338228+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:44:42.338228+0000","last_undegraded":"2024-03-18T14:44:42.338228+0000","last_fullsized":"2024-03-18T14:44:42.338228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.316173+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:28.316173+0000","last_peered":"2024-03-18T14:41:28.316173+0000","last_clean":"2024-03-18T14:41:28.316173+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:28.316173+0000","last_undegraded":"2024-03-18T14:41:28.316173+0000","last_fullsized":"2024-03-18T14:41:28.316173+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":978,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.778594+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:45:04.778594+0000","last_peered":"2024-03-18T14:45:04.778594+0000","last_clean":"2024-03-18T14:45:04.778594+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:45:04.778594+0000","last_undegraded":"2024-03-18T14:45:04.778594+0000","last_fullsized":"2024-03-18T14:45:04.778594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":245,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":997,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237975+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:44:43.237975+0000","last_peered":"2024-03-18T14:44:43.237975+0000","last_clean":"2024-03-18T14:44:43.237975+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:44:43.237975+0000","last_undegraded":"2024-03-18T14:44:43.237975+0000","last_fullsized":"2024-03-18T14:44:43.237975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318256+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:28.318256+0000","last_peered":"2024-03-18T14:41:28.318256+0000","last_clean":"2024-03-18T14:41:28.318256+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:28.318256+0000","last_undegraded":"2024-03-18T14:41:28.318256+0000","last_fullsized":"2024-03-18T14:41:28.318256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":467,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.779903+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:45:04.779903+0000","last_peered":"2024-03-18T14:45:04.779903+0000","last_clean":"2024-03-18T14:45:04.779903+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:45:04.779903+0000","last_undegraded":"2024-03-18T14:45:04.779903+0000","last_fullsized":"2024-03-18T14:45:04.779903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":871,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345987+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:44:42.345987+0000","last_peered":"2024-03-18T14:44:42.345987+0000","last_clean":"2024-03-18T14:44:42.345987+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:44:42.345987+0000","last_undegraded":"2024-03-18T14:44:42.345987+0000","last_fullsized":"2024-03-18T14:44:42.345987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'510","reported_seq":522,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.783159+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:45:04.783159+0000","last_peered":"2024-03-18T14:45:04.783159+0000","last_clean":"2024-03-18T14:45:04.783159+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:45:04.783159+0000","last_undegraded":"2024-03-18T14:45:04.783159+0000","last_fullsized":"2024-03-18T14:45:04.783159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317954+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:28.317954+0000","last_peered":"2024-03-18T14:41:28.317954+0000","last_clean":"2024-03-18T14:41:28.317954+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:28.317954+0000","last_undegraded":"2024-03-18T14:41:28.317954+0000","last_fullsized":"2024-03-18T14:41:28.317954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1010,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349594+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:44:42.349594+0000","last_peered":"2024-03-18T14:44:42.349594+0000","last_clean":"2024-03-18T14:44:42.349594+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:44:42.349594+0000","last_undegraded":"2024-03-18T14:44:42.349594+0000","last_fullsized":"2024-03-18T14:44:42.349594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318359+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:28.318359+0000","last_peered":"2024-03-18T14:41:28.318359+0000","last_clean":"2024-03-18T14:41:28.318359+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:28.318359+0000","last_undegraded":"2024-03-18T14:41:28.318359+0000","last_fullsized":"2024-03-18T14:41:28.318359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'665","reported_seq":677,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.764078+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:45:04.764078+0000","last_peered":"2024-03-18T14:45:04.764078+0000","last_clean":"2024-03-18T14:45:04.764078+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:45:04.764078+0000","last_undegraded":"2024-03-18T14:45:04.764078+0000","last_fullsized":"2024-03-18T14:45:04.764078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":894,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337415+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:44:42.337415+0000","last_peered":"2024-03-18T14:44:42.337415+0000","last_clean":"2024-03-18T14:44:42.337415+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:44:42.337415+0000","last_undegraded":"2024-03-18T14:44:42.337415+0000","last_fullsized":"2024-03-18T14:44:42.337415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.750152+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:45:04.750152+0000","last_peered":"2024-03-18T14:45:04.750152+0000","last_clean":"2024-03-18T14:45:04.750152+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:45:04.750152+0000","last_undegraded":"2024-03-18T14:45:04.750152+0000","last_fullsized":"2024-03-18T14:45:04.750152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":925,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337545+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:44:42.337545+0000","last_peered":"2024-03-18T14:44:42.337545+0000","last_clean":"2024-03-18T14:44:42.337545+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:44:42.337545+0000","last_undegraded":"2024-03-18T14:44:42.337545+0000","last_fullsized":"2024-03-18T14:44:42.337545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:40.290227+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:44:40.290227+0000","last_peered":"2024-03-18T14:44:40.290227+0000","last_clean":"2024-03-18T14:44:40.290227+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:44:40.290227+0000","last_undegraded":"2024-03-18T14:44:40.290227+0000","last_fullsized":"2024-03-18T14:44:40.290227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":812,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.346656+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:44:42.346656+0000","last_peered":"2024-03-18T14:44:42.346656+0000","last_clean":"2024-03-18T14:44:42.346656+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:44:42.346656+0000","last_undegraded":"2024-03-18T14:44:42.346656+0000","last_fullsized":"2024-03-18T14:44:42.346656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":645,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.773140+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:45:04.773140+0000","last_peered":"2024-03-18T14:45:04.773140+0000","last_clean":"2024-03-18T14:45:04.773140+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:45:04.773140+0000","last_undegraded":"2024-03-18T14:45:04.773140+0000","last_fullsized":"2024-03-18T14:45:04.773140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.235714+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:44:43.235714+0000","last_peered":"2024-03-18T14:44:43.235714+0000","last_clean":"2024-03-18T14:44:43.235714+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:44:43.235714+0000","last_undegraded":"2024-03-18T14:44:43.235714+0000","last_fullsized":"2024-03-18T14:44:43.235714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":496,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:59.745669+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:44:59.745669+0000","last_peered":"2024-03-18T14:44:59.745669+0000","last_clean":"2024-03-18T14:44:59.745669+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:44:59.745669+0000","last_undegraded":"2024-03-18T14:44:59.745669+0000","last_fullsized":"2024-03-18T14:44:59.745669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332217+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:44:42.332217+0000","last_peered":"2024-03-18T14:44:42.332217+0000","last_clean":"2024-03-18T14:44:42.332217+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:44:42.332217+0000","last_undegraded":"2024-03-18T14:44:42.332217+0000","last_fullsized":"2024-03-18T14:44:42.332217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":227,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.326567+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:44:42.326567+0000","last_peered":"2024-03-18T14:44:42.326567+0000","last_clean":"2024-03-18T14:44:42.326567+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:44:42.326567+0000","last_undegraded":"2024-03-18T14:44:42.326567+0000","last_fullsized":"2024-03-18T14:44:42.326567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":974,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.235017+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:44:43.235017+0000","last_peered":"2024-03-18T14:44:43.235017+0000","last_clean":"2024-03-18T14:44:43.235017+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:44:43.235017+0000","last_undegraded":"2024-03-18T14:44:43.235017+0000","last_fullsized":"2024-03-18T14:44:43.235017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1068,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.343183+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:44:42.343183+0000","last_peered":"2024-03-18T14:44:42.343183+0000","last_clean":"2024-03-18T14:44:42.343183+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:44:42.343183+0000","last_undegraded":"2024-03-18T14:44:42.343183+0000","last_fullsized":"2024-03-18T14:44:42.343183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":981,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332113+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:44:42.332113+0000","last_peered":"2024-03-18T14:44:42.332113+0000","last_clean":"2024-03-18T14:44:42.332113+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:44:42.332113+0000","last_undegraded":"2024-03-18T14:44:42.332113+0000","last_fullsized":"2024-03-18T14:44:42.332113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234960+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:44:43.234960+0000","last_peered":"2024-03-18T14:44:43.234960+0000","last_clean":"2024-03-18T14:44:43.234960+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:44:43.234960+0000","last_undegraded":"2024-03-18T14:44:43.234960+0000","last_fullsized":"2024-03-18T14:44:43.234960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":890,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338701+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:44:42.338701+0000","last_peered":"2024-03-18T14:44:42.338701+0000","last_clean":"2024-03-18T14:44:42.338701+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:44:42.338701+0000","last_undegraded":"2024-03-18T14:44:42.338701+0000","last_fullsized":"2024-03-18T14:44:42.338701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338563+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:44:42.338563+0000","last_peered":"2024-03-18T14:44:42.338563+0000","last_clean":"2024-03-18T14:44:42.338563+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:44:42.338563+0000","last_undegraded":"2024-03-18T14:44:42.338563+0000","last_fullsized":"2024-03-18T14:44:42.338563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137119479,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":551,"num_read_kb":3219,"num_write":16035,"num_write_kb":262677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274350080,"data_stored":274238958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19601,"ondisk_log_size":19601,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705737,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1144292,"kb_used_data":95708,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93227548,"statfs":{"total":96636764160,"available":95465009152,"internally_reserved":1073741824,"allocated":98004992,"data_stored":97846422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.875,"15min":0.50900000000000001},"min":{"1min":0.17000000000000001,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.41299999999999998,"5min":57.850000000000001,"15min":57.850000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.91600000000000004,"15min":0.52800000000000002},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.432,"5min":57.902000000000001,"15min":57.902000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.93000000000000005,"15min":0.54600000000000004},"min":{"1min":0.23000000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.51500000000000001,"5min":57.866999999999997,"15min":57.866999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.93000000000000005,"15min":0.53400000000000003},"min":{"1min":0.20300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.52400000000000002,"5min":58.351999999999997,"15min":58.351999999999997},"last":0.246}]},{"osd":2,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52400000000000002,"5min":1.173,"15min":1.173},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.39700000000000002,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48999999999999999,"5min":4.2770000000000001,"15min":4.2770000000000001},"last":0.27100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705738,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111348,"kb_used_data":62764,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93260492,"statfs":{"total":96636764160,"available":95498743808,"internally_reserved":1073741824,"allocated":64270336,"data_stored":64138088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.34699999999999998,"15min":0.318},"min":{"1min":0.16400000000000001,"5min":0.14699999999999999,"15min":0.14699999999999999},"max":{"1min":0.41099999999999998,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.38600000000000001,"15min":0.35099999999999998},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.44400000000000001,"5min":3.6320000000000001,"15min":3.6320000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.42699999999999999,"15min":0.35399999999999998},"min":{"1min":0.186,"5min":0.183,"15min":0.183},"max":{"1min":0.443,"5min":4.2140000000000004,"15min":4.2140000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.44900000000000001,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.46800000000000003,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.314}]},{"osd":3,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41599999999999998,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48399999999999999,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.39300000000000002,"15min":0.36699999999999999},"min":{"1min":0.218,"5min":0.215,"15min":0.215},"max":{"1min":0.48599999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.32200000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1107672,"kb_used_data":59088,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93264168,"statfs":{"total":96636764160,"available":95502508032,"internally_reserved":1073741824,"allocated":60506112,"data_stored":60363242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.38800000000000001,"15min":0.33100000000000002},"min":{"1min":0.192,"5min":0.152,"15min":0.152},"max":{"1min":0.45500000000000002,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":0.311},{"interface":"front","average":{"1min":0.311,"5min":0.41699999999999998,"15min":0.35399999999999998},"min":{"1min":0.221,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.42799999999999999,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.47399999999999998,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47199999999999998,"5min":6.3739999999999997,"15min":6.3739999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.52000000000000002,"5min":1.589,"15min":1.589},"last":0.26100000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.55700000000000005,"5min":3.5830000000000002,"15min":3.5830000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.49299999999999999,"5min":1.524,"15min":1.524},"last":0.252}]}]},{"osd":1,"up_from":9,"seq":38654705737,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099616,"kb_used_data":51032,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93272224,"statfs":{"total":96636764160,"available":95510757376,"internally_reserved":1073741824,"allocated":52256768,"data_stored":52126902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.499,"15min":0.371},"min":{"1min":0.20200000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.40200000000000002,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.34699999999999998,"15min":0.33300000000000002},"min":{"1min":0.21199999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.436,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.371,"15min":0.34399999999999997},"min":{"1min":0.216,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.40600000000000003,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.46600000000000003,"15min":0.38700000000000001},"min":{"1min":0.249,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45000000000000001,"5min":3.262,"15min":3.262},"last":0.27500000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.47699999999999998,"15min":0.39900000000000002},"min":{"1min":0.23200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39200000000000002,"5min":6.6420000000000003,"15min":6.6420000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.437,"15min":0.39100000000000001},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60334080,"data_stored":60304318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52084736,"data_stored":52067978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:46:56.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:46:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.083+0000 7fc85d65a700 1 Processor -- start 2024-03-18T14:46:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.083+0000 7fc85d65a700 1 -- start start 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc85d65a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc858063f60 0x7fc8580aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc85d65a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc85d65a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8581419d0 con 0x7fc858142500 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc85d65a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8580aaa80 con 0x7fc858063f60 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc85d65a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580a7400 con 0x7fc8580a8a80 2024-03-18T14:46:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42066/0 (socket says 172.21.15.57:42066) 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 -- 172.21.15.57:0/1449581053 learned_addr learned my addr 172.21.15.57:0/1449581053 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc856ffd700 1 --2- 172.21.15.57:0/1449581053 >> v2:172.21.15.57:3300/0 conn(0x7fc858063f60 0x7fc8580aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 -- 172.21.15.57:0/1449581053 >> v2:172.21.15.57:3300/0 conn(0x7fc858063f60 msgr2=0x7fc8580aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 --2- 172.21.15.57:0/1449581053 >> v2:172.21.15.57:3300/0 conn(0x7fc858063f60 0x7fc8580aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 -- 172.21.15.57:0/1449581053 >> v1:172.21.15.57:6789/0 conn(0x7fc858142500 legacy=0x7fc8580a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 -- 172.21.15.57:0/1449581053 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8580a8e70 con 0x7fc8580a8a80 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc8567fc700 1 --2- 172.21.15.57:0/1449581053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0099b0 tx=0x7fc84c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6822cbf5e8abcd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc855ffb700 1 -- 172.21.15.57:0/1449581053 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c009ea0 con 0x7fc8580a8a80 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc855ffb700 1 -- 172.21.15.57:0/1449581053 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00b860 con 0x7fc8580a8a80 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.084+0000 7fc855ffb700 1 -- 172.21.15.57:0/1449581053 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00bc00 con 0x7fc8580a8a80 2024-03-18T14:46:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 -- 172.21.15.57:0/1449581053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 msgr2=0x7fc858141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 --2- 172.21.15.57:0/1449581053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0099b0 tx=0x7fc84c009250 comp rx=0 tx=0).stop 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 -- 172.21.15.57:0/1449581053 shutdown_connections 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 --2- 172.21.15.57:0/1449581053 >> v2:172.21.15.57:3300/0 conn(0x7fc858063f60 0x7fc8580aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 --2- 172.21.15.57:0/1449581053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8580a8a80 0x7fc858141fc0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 -- 172.21.15.57:0/1449581053 >> 172.21.15.57:0/1449581053 conn(0x7fc858087fe0 msgr2=0x7fc858063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 -- 172.21.15.57:0/1449581053 shutdown_connections 2024-03-18T14:46:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.085+0000 7fc85d65a700 1 -- 172.21.15.57:0/1449581053 wait complete. 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.086+0000 7fc85d65a700 1 Processor -- start 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.086+0000 7fc85d65a700 1 -- start start 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 0x7fc8581513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580b1c10 con 0x7fc858063f60 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85814e2e0 con 0x7fc858142500 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc85814e5a0 con 0x7fc8580a8a80 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc8567fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55400/0 (socket says 172.21.15.57:55400) 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc8577fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 0x7fc8581513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 -- 172.21.15.57:0/3864252173 learned_addr learned my addr 172.21.15.57:0/3864252173 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc8567fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50534/0 (socket says 172.21.15.57:50534) 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 -- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 msgr2=0x7fc8580ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 -- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 msgr2=0x7fc8581513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 0x7fc8581513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 -- 172.21.15.57:0/3864252173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0094f0 con 0x7fc858063f60 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc8567fc700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc8577fe700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 0x7fc8581513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc856ffd700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc84800e930 tx=0x7fc8480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848013680 con 0x7fc858063f60 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8480137e0 con 0x7fc858063f60 2024-03-18T14:46:57.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848013b80 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc858097ef0 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.087+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580af310 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.088+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8580648f0 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.089+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fc84800c3e0 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.089+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fc84805b0f0 con 0x7fc858063f60 2024-03-18T14:46:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.093+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc848039400 con 0x7fc858063f60 2024-03-18T14:46:57.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.253+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8580a7640 con 0x7fc844045fb0 2024-03-18T14:46:57.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.260+0000 7fc83effd700 1 -- 172.21.15.57:0/3864252173 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272480 (unknown 2965378022 0 3931481024) 0x7fc8580a7640 con 0x7fc844045fb0 2024-03-18T14:46:57.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 >> v1:172.21.15.57:6816/47480 conn(0x7fc844045fb0 legacy=0x7fc844048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 msgr2=0x7fc8580979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc84800e930 tx=0x7fc8480091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 shutdown_connections 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc858142500 0x7fc8581513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc858063f60 0x7fc8580979b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 --2- 172.21.15.57:0/3864252173 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8580a8a80 0x7fc8580ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 >> 172.21.15.57:0/3864252173 conn(0x7fc858087fe0 msgr2=0x7fc8580b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 shutdown_connections 2024-03-18T14:46:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.263+0000 7fc85d65a700 1 -- 172.21.15.57:0/3864252173 wait complete. 2024-03-18T14:46:57.269 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:46:57.277 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-03-18T14:46:56.542380+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137119479,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":6113,"num_read_kb":2925843,"num_write":64890,"num_write_kb":8746724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71323,"ondisk_log_size":71323,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4462928,"kb_used_data":268592,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373024432,"statfs":{"total":386547056640,"available":381977018368,"internally_reserved":4294967296,"allocated":275038208,"data_stored":274474654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.003479"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":855,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234944+0000","last_change":"2024-03-18T14:41:13.498758+0000","last_active":"2024-03-18T14:44:43.234944+0000","last_peered":"2024-03-18T14:44:43.234944+0000","last_clean":"2024-03-18T14:44:43.234944+0000","last_became_active":"2024-03-18T14:41:13.498342+0000","last_became_peered":"2024-03-18T14:41:13.498342+0000","last_unstale":"2024-03-18T14:44:43.234944+0000","last_undegraded":"2024-03-18T14:44:43.234944+0000","last_fullsized":"2024-03-18T14:44:43.234944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":899,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231000+0000","last_change":"2024-03-18T14:41:13.495655+0000","last_active":"2024-03-18T14:44:43.231000+0000","last_peered":"2024-03-18T14:44:43.231000+0000","last_clean":"2024-03-18T14:44:43.231000+0000","last_became_active":"2024-03-18T14:41:13.495328+0000","last_became_peered":"2024-03-18T14:41:13.495328+0000","last_unstale":"2024-03-18T14:44:43.231000+0000","last_undegraded":"2024-03-18T14:44:43.231000+0000","last_fullsized":"2024-03-18T14:44:43.231000+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":920,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338882+0000","last_change":"2024-03-18T14:41:13.508134+0000","last_active":"2024-03-18T14:44:42.338882+0000","last_peered":"2024-03-18T14:44:42.338882+0000","last_clean":"2024-03-18T14:44:42.338882+0000","last_became_active":"2024-03-18T14:41:13.507794+0000","last_became_peered":"2024-03-18T14:41:13.507794+0000","last_unstale":"2024-03-18T14:44:42.338882+0000","last_undegraded":"2024-03-18T14:44:42.338882+0000","last_fullsized":"2024-03-18T14:44:42.338882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":900,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.347875+0000","last_change":"2024-03-18T14:41:13.515033+0000","last_active":"2024-03-18T14:44:42.347875+0000","last_peered":"2024-03-18T14:44:42.347875+0000","last_clean":"2024-03-18T14:44:42.347875+0000","last_became_active":"2024-03-18T14:41:13.514677+0000","last_became_peered":"2024-03-18T14:41:13.514677+0000","last_unstale":"2024-03-18T14:44:42.347875+0000","last_undegraded":"2024-03-18T14:44:42.347875+0000","last_fullsized":"2024-03-18T14:44:42.347875+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":854,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.306429+0000","last_change":"2024-03-18T14:41:13.506108+0000","last_active":"2024-03-18T14:44:42.306429+0000","last_peered":"2024-03-18T14:44:42.306429+0000","last_clean":"2024-03-18T14:44:42.306429+0000","last_became_active":"2024-03-18T14:41:13.500848+0000","last_became_peered":"2024-03-18T14:41:13.500848+0000","last_unstale":"2024-03-18T14:44:42.306429+0000","last_undegraded":"2024-03-18T14:44:42.306429+0000","last_fullsized":"2024-03-18T14:44:42.306429+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":878,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231069+0000","last_change":"2024-03-18T14:41:13.501923+0000","last_active":"2024-03-18T14:44:43.231069+0000","last_peered":"2024-03-18T14:44:43.231069+0000","last_clean":"2024-03-18T14:44:43.231069+0000","last_became_active":"2024-03-18T14:41:13.501605+0000","last_became_peered":"2024-03-18T14:41:13.501605+0000","last_unstale":"2024-03-18T14:44:43.231069+0000","last_undegraded":"2024-03-18T14:44:43.231069+0000","last_fullsized":"2024-03-18T14:44:43.231069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":926,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.318203+0000","last_change":"2024-03-18T14:41:13.493708+0000","last_active":"2024-03-18T14:44:42.318203+0000","last_peered":"2024-03-18T14:44:42.318203+0000","last_clean":"2024-03-18T14:44:42.318203+0000","last_became_active":"2024-03-18T14:41:13.493271+0000","last_became_peered":"2024-03-18T14:41:13.493271+0000","last_unstale":"2024-03-18T14:44:42.318203+0000","last_undegraded":"2024-03-18T14:44:42.318203+0000","last_fullsized":"2024-03-18T14:44:42.318203+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":777,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.272937+0000","last_change":"2024-03-18T14:41:13.513803+0000","last_active":"2024-03-18T14:44:42.272937+0000","last_peered":"2024-03-18T14:44:42.272937+0000","last_clean":"2024-03-18T14:44:42.272937+0000","last_became_active":"2024-03-18T14:41:13.505191+0000","last_became_peered":"2024-03-18T14:41:13.505191+0000","last_unstale":"2024-03-18T14:44:42.272937+0000","last_undegraded":"2024-03-18T14:44:42.272937+0000","last_fullsized":"2024-03-18T14:44:42.272937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":919,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.327298+0000","last_change":"2024-03-18T14:41:13.496173+0000","last_active":"2024-03-18T14:44:42.327298+0000","last_peered":"2024-03-18T14:44:42.327298+0000","last_clean":"2024-03-18T14:44:42.327298+0000","last_became_active":"2024-03-18T14:41:13.495392+0000","last_became_peered":"2024-03-18T14:41:13.495392+0000","last_unstale":"2024-03-18T14:44:42.327298+0000","last_undegraded":"2024-03-18T14:44:42.327298+0000","last_fullsized":"2024-03-18T14:44:42.327298+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331718+0000","last_change":"2024-03-18T14:41:13.509839+0000","last_active":"2024-03-18T14:44:42.331718+0000","last_peered":"2024-03-18T14:44:42.331718+0000","last_clean":"2024-03-18T14:44:42.331718+0000","last_became_active":"2024-03-18T14:41:13.502922+0000","last_became_peered":"2024-03-18T14:41:13.502922+0000","last_unstale":"2024-03-18T14:44:42.331718+0000","last_undegraded":"2024-03-18T14:44:42.331718+0000","last_fullsized":"2024-03-18T14:44:42.331718+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":779,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337864+0000","last_change":"2024-03-18T14:41:13.503848+0000","last_active":"2024-03-18T14:44:42.337864+0000","last_peered":"2024-03-18T14:44:42.337864+0000","last_clean":"2024-03-18T14:44:42.337864+0000","last_became_active":"2024-03-18T14:41:13.503528+0000","last_became_peered":"2024-03-18T14:41:13.503528+0000","last_unstale":"2024-03-18T14:44:42.337864+0000","last_undegraded":"2024-03-18T14:44:42.337864+0000","last_fullsized":"2024-03-18T14:44:42.337864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":807,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.234128+0000","last_change":"2024-03-18T14:41:13.496892+0000","last_active":"2024-03-18T14:44:42.234128+0000","last_peered":"2024-03-18T14:44:42.234128+0000","last_clean":"2024-03-18T14:44:42.234128+0000","last_became_active":"2024-03-18T14:41:13.492562+0000","last_became_peered":"2024-03-18T14:41:13.492562+0000","last_unstale":"2024-03-18T14:44:42.234128+0000","last_undegraded":"2024-03-18T14:44:42.234128+0000","last_fullsized":"2024-03-18T14:44:42.234128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":861,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237957+0000","last_change":"2024-03-18T14:41:13.499161+0000","last_active":"2024-03-18T14:44:43.237957+0000","last_peered":"2024-03-18T14:44:43.237957+0000","last_clean":"2024-03-18T14:44:43.237957+0000","last_became_active":"2024-03-18T14:41:13.498828+0000","last_became_peered":"2024-03-18T14:41:13.498828+0000","last_unstale":"2024-03-18T14:44:43.237957+0000","last_undegraded":"2024-03-18T14:44:43.237957+0000","last_fullsized":"2024-03-18T14:44:43.237957+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":984,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349053+0000","last_change":"2024-03-18T14:41:13.501845+0000","last_active":"2024-03-18T14:44:42.349053+0000","last_peered":"2024-03-18T14:44:42.349053+0000","last_clean":"2024-03-18T14:44:42.349053+0000","last_became_active":"2024-03-18T14:41:13.501168+0000","last_became_peered":"2024-03-18T14:41:13.501168+0000","last_unstale":"2024-03-18T14:44:42.349053+0000","last_undegraded":"2024-03-18T14:44:42.349053+0000","last_fullsized":"2024-03-18T14:44:42.349053+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1025,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345045+0000","last_change":"2024-03-18T14:41:13.502741+0000","last_active":"2024-03-18T14:44:42.345045+0000","last_peered":"2024-03-18T14:44:42.345045+0000","last_clean":"2024-03-18T14:44:42.345045+0000","last_became_active":"2024-03-18T14:41:13.502378+0000","last_became_peered":"2024-03-18T14:41:13.502378+0000","last_unstale":"2024-03-18T14:44:42.345045+0000","last_undegraded":"2024-03-18T14:44:42.345045+0000","last_fullsized":"2024-03-18T14:44:42.345045+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":852,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237069+0000","last_change":"2024-03-18T14:41:13.496276+0000","last_active":"2024-03-18T14:44:43.237069+0000","last_peered":"2024-03-18T14:44:43.237069+0000","last_clean":"2024-03-18T14:44:43.237069+0000","last_became_active":"2024-03-18T14:41:13.494167+0000","last_became_peered":"2024-03-18T14:41:13.494167+0000","last_unstale":"2024-03-18T14:44:43.237069+0000","last_undegraded":"2024-03-18T14:44:43.237069+0000","last_fullsized":"2024-03-18T14:44:43.237069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":984,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.344044+0000","last_change":"2024-03-18T14:41:13.499688+0000","last_active":"2024-03-18T14:44:42.344044+0000","last_peered":"2024-03-18T14:44:42.344044+0000","last_clean":"2024-03-18T14:44:42.344044+0000","last_became_active":"2024-03-18T14:41:13.495806+0000","last_became_peered":"2024-03-18T14:41:13.495806+0000","last_unstale":"2024-03-18T14:44:42.344044+0000","last_undegraded":"2024-03-18T14:44:42.344044+0000","last_fullsized":"2024-03-18T14:44:42.344044+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":983,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.339184+0000","last_change":"2024-03-18T14:41:13.496636+0000","last_active":"2024-03-18T14:44:42.339184+0000","last_peered":"2024-03-18T14:44:42.339184+0000","last_clean":"2024-03-18T14:44:42.339184+0000","last_became_active":"2024-03-18T14:41:13.496282+0000","last_became_peered":"2024-03-18T14:41:13.496282+0000","last_unstale":"2024-03-18T14:44:42.339184+0000","last_undegraded":"2024-03-18T14:44:42.339184+0000","last_fullsized":"2024-03-18T14:44:42.339184+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":974,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.295627+0000","last_change":"2024-03-18T14:41:13.495441+0000","last_active":"2024-03-18T14:44:42.295627+0000","last_peered":"2024-03-18T14:44:42.295627+0000","last_clean":"2024-03-18T14:44:42.295627+0000","last_became_active":"2024-03-18T14:41:13.494804+0000","last_became_peered":"2024-03-18T14:41:13.494804+0000","last_unstale":"2024-03-18T14:44:42.295627+0000","last_undegraded":"2024-03-18T14:44:42.295627+0000","last_fullsized":"2024-03-18T14:44:42.295627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1020,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231841+0000","last_change":"2024-03-18T14:41:13.512466+0000","last_active":"2024-03-18T14:44:43.231841+0000","last_peered":"2024-03-18T14:44:43.231841+0000","last_clean":"2024-03-18T14:44:43.231841+0000","last_became_active":"2024-03-18T14:41:13.512120+0000","last_became_peered":"2024-03-18T14:41:13.512120+0000","last_unstale":"2024-03-18T14:44:43.231841+0000","last_undegraded":"2024-03-18T14:44:43.231841+0000","last_fullsized":"2024-03-18T14:44:43.231841+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1002,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.232118+0000","last_change":"2024-03-18T14:41:13.512700+0000","last_active":"2024-03-18T14:44:43.232118+0000","last_peered":"2024-03-18T14:44:43.232118+0000","last_clean":"2024-03-18T14:44:43.232118+0000","last_became_active":"2024-03-18T14:41:13.512360+0000","last_became_peered":"2024-03-18T14:41:13.512360+0000","last_unstale":"2024-03-18T14:44:43.232118+0000","last_undegraded":"2024-03-18T14:44:43.232118+0000","last_fullsized":"2024-03-18T14:44:43.232118+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.316334+0000","last_change":"2024-03-18T14:41:13.502116+0000","last_active":"2024-03-18T14:44:42.316334+0000","last_peered":"2024-03-18T14:44:42.316334+0000","last_clean":"2024-03-18T14:44:42.316334+0000","last_became_active":"2024-03-18T14:41:13.500356+0000","last_became_peered":"2024-03-18T14:41:13.500356+0000","last_unstale":"2024-03-18T14:44:42.316334+0000","last_undegraded":"2024-03-18T14:44:42.316334+0000","last_fullsized":"2024-03-18T14:44:42.316334+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":988,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.274879+0000","last_change":"2024-03-18T14:41:13.494003+0000","last_active":"2024-03-18T14:44:42.274879+0000","last_peered":"2024-03-18T14:44:42.274879+0000","last_clean":"2024-03-18T14:44:42.274879+0000","last_became_active":"2024-03-18T14:41:13.493214+0000","last_became_peered":"2024-03-18T14:41:13.493214+0000","last_unstale":"2024-03-18T14:44:42.274879+0000","last_undegraded":"2024-03-18T14:44:42.274879+0000","last_fullsized":"2024-03-18T14:44:42.274879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":909,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.314174+0000","last_change":"2024-03-18T14:41:13.514577+0000","last_active":"2024-03-18T14:44:42.314174+0000","last_peered":"2024-03-18T14:44:42.314174+0000","last_clean":"2024-03-18T14:44:42.314174+0000","last_became_active":"2024-03-18T14:41:13.510020+0000","last_became_peered":"2024-03-18T14:41:13.510020+0000","last_unstale":"2024-03-18T14:44:42.314174+0000","last_undegraded":"2024-03-18T14:44:42.314174+0000","last_fullsized":"2024-03-18T14:44:42.314174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":939,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.300510+0000","last_change":"2024-03-18T14:41:13.514800+0000","last_active":"2024-03-18T14:44:42.300510+0000","last_peered":"2024-03-18T14:44:42.300510+0000","last_clean":"2024-03-18T14:44:42.300510+0000","last_became_active":"2024-03-18T14:41:13.514450+0000","last_became_peered":"2024-03-18T14:41:13.514450+0000","last_unstale":"2024-03-18T14:44:42.300510+0000","last_undegraded":"2024-03-18T14:44:42.300510+0000","last_fullsized":"2024-03-18T14:44:42.300510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":895,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234444+0000","last_change":"2024-03-18T14:41:13.510242+0000","last_active":"2024-03-18T14:44:43.234444+0000","last_peered":"2024-03-18T14:44:43.234444+0000","last_clean":"2024-03-18T14:44:43.234444+0000","last_became_active":"2024-03-18T14:41:13.509744+0000","last_became_peered":"2024-03-18T14:41:13.509744+0000","last_unstale":"2024-03-18T14:44:43.234444+0000","last_undegraded":"2024-03-18T14:44:43.234444+0000","last_fullsized":"2024-03-18T14:44:43.234444+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":903,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345783+0000","last_change":"2024-03-18T14:41:13.497727+0000","last_active":"2024-03-18T14:44:42.345783+0000","last_peered":"2024-03-18T14:44:42.345783+0000","last_clean":"2024-03-18T14:44:42.345783+0000","last_became_active":"2024-03-18T14:41:13.493167+0000","last_became_peered":"2024-03-18T14:41:13.493167+0000","last_unstale":"2024-03-18T14:44:42.345783+0000","last_undegraded":"2024-03-18T14:44:42.345783+0000","last_fullsized":"2024-03-18T14:44:42.345783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1502,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.765332+0000","last_change":"2024-03-18T14:41:13.163760+0000","last_active":"2024-03-18T14:45:04.765332+0000","last_peered":"2024-03-18T14:45:04.765332+0000","last_clean":"2024-03-18T14:45:04.765332+0000","last_became_active":"2024-03-18T14:41:13.163368+0000","last_became_peered":"2024-03-18T14:41:13.163368+0000","last_unstale":"2024-03-18T14:45:04.765332+0000","last_undegraded":"2024-03-18T14:45:04.765332+0000","last_fullsized":"2024-03-18T14:45:04.765332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":899,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.350076+0000","last_change":"2024-03-18T14:41:13.507020+0000","last_active":"2024-03-18T14:44:42.350076+0000","last_peered":"2024-03-18T14:44:42.350076+0000","last_clean":"2024-03-18T14:44:42.350076+0000","last_became_active":"2024-03-18T14:41:13.506628+0000","last_became_peered":"2024-03-18T14:41:13.506628+0000","last_unstale":"2024-03-18T14:44:42.350076+0000","last_undegraded":"2024-03-18T14:44:42.350076+0000","last_fullsized":"2024-03-18T14:44:42.350076+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1372,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.781400+0000","last_change":"2024-03-18T14:41:13.176650+0000","last_active":"2024-03-18T14:45:04.781400+0000","last_peered":"2024-03-18T14:45:04.781400+0000","last_clean":"2024-03-18T14:45:04.781400+0000","last_became_active":"2024-03-18T14:41:13.176289+0000","last_became_peered":"2024-03-18T14:41:13.176289+0000","last_unstale":"2024-03-18T14:45:04.781400+0000","last_undegraded":"2024-03-18T14:45:04.781400+0000","last_fullsized":"2024-03-18T14:45:04.781400+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":295,"num_read_kb":1697,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":803,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349167+0000","last_change":"2024-03-18T14:41:13.506818+0000","last_active":"2024-03-18T14:44:42.349167+0000","last_peered":"2024-03-18T14:44:42.349167+0000","last_clean":"2024-03-18T14:44:42.349167+0000","last_became_active":"2024-03-18T14:41:13.506489+0000","last_became_peered":"2024-03-18T14:41:13.506489+0000","last_unstale":"2024-03-18T14:44:42.349167+0000","last_undegraded":"2024-03-18T14:44:42.349167+0000","last_fullsized":"2024-03-18T14:44:42.349167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1027,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.748799+0000","last_change":"2024-03-18T14:41:13.174563+0000","last_active":"2024-03-18T14:45:04.748799+0000","last_peered":"2024-03-18T14:45:04.748799+0000","last_clean":"2024-03-18T14:45:04.748799+0000","last_became_active":"2024-03-18T14:41:13.174173+0000","last_became_peered":"2024-03-18T14:41:13.174173+0000","last_unstale":"2024-03-18T14:45:04.748799+0000","last_undegraded":"2024-03-18T14:45:04.748799+0000","last_fullsized":"2024-03-18T14:45:04.748799+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":843,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.306178+0000","last_change":"2024-03-18T14:41:13.496989+0000","last_active":"2024-03-18T14:44:42.306178+0000","last_peered":"2024-03-18T14:44:42.306178+0000","last_clean":"2024-03-18T14:44:42.306178+0000","last_became_active":"2024-03-18T14:41:13.496311+0000","last_became_peered":"2024-03-18T14:41:13.496311+0000","last_unstale":"2024-03-18T14:44:42.306178+0000","last_undegraded":"2024-03-18T14:44:42.306178+0000","last_fullsized":"2024-03-18T14:44:42.306178+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:09.742987+0000","last_change":"2024-03-18T14:41:13.179035+0000","last_active":"2024-03-18T14:45:09.742987+0000","last_peered":"2024-03-18T14:45:09.742987+0000","last_clean":"2024-03-18T14:45:09.742987+0000","last_became_active":"2024-03-18T14:41:13.178315+0000","last_became_peered":"2024-03-18T14:41:13.178315+0000","last_unstale":"2024-03-18T14:45:09.742987+0000","last_undegraded":"2024-03-18T14:45:09.742987+0000","last_fullsized":"2024-03-18T14:45:09.742987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":816,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.347446+0000","last_change":"2024-03-18T14:41:13.508680+0000","last_active":"2024-03-18T14:44:42.347446+0000","last_peered":"2024-03-18T14:44:42.347446+0000","last_clean":"2024-03-18T14:44:42.347446+0000","last_became_active":"2024-03-18T14:41:13.508214+0000","last_became_peered":"2024-03-18T14:41:13.508214+0000","last_unstale":"2024-03-18T14:44:42.347446+0000","last_undegraded":"2024-03-18T14:44:42.347446+0000","last_fullsized":"2024-03-18T14:44:42.347446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1660,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.782722+0000","last_change":"2024-03-18T14:41:13.172121+0000","last_active":"2024-03-18T14:45:04.782722+0000","last_peered":"2024-03-18T14:45:04.782722+0000","last_clean":"2024-03-18T14:45:04.782722+0000","last_became_active":"2024-03-18T14:41:13.171746+0000","last_became_peered":"2024-03-18T14:41:13.171746+0000","last_unstale":"2024-03-18T14:45:04.782722+0000","last_undegraded":"2024-03-18T14:45:04.782722+0000","last_fullsized":"2024-03-18T14:45:04.782722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1028,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331491+0000","last_change":"2024-03-18T14:41:13.494766+0000","last_active":"2024-03-18T14:44:42.331491+0000","last_peered":"2024-03-18T14:44:42.331491+0000","last_clean":"2024-03-18T14:44:42.331491+0000","last_became_active":"2024-03-18T14:41:13.494393+0000","last_became_peered":"2024-03-18T14:41:13.494393+0000","last_unstale":"2024-03-18T14:44:42.331491+0000","last_undegraded":"2024-03-18T14:44:42.331491+0000","last_fullsized":"2024-03-18T14:44:42.331491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'227","reported_seq":239,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.742558+0000","last_change":"2024-03-18T14:41:13.179680+0000","last_active":"2024-03-18T14:45:04.742558+0000","last_peered":"2024-03-18T14:45:04.742558+0000","last_clean":"2024-03-18T14:45:04.742558+0000","last_became_active":"2024-03-18T14:41:13.175447+0000","last_became_peered":"2024-03-18T14:41:13.175447+0000","last_unstale":"2024-03-18T14:45:04.742558+0000","last_undegraded":"2024-03-18T14:45:04.742558+0000","last_fullsized":"2024-03-18T14:45:04.742558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1009,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332473+0000","last_change":"2024-03-18T14:41:13.501662+0000","last_active":"2024-03-18T14:44:42.332473+0000","last_peered":"2024-03-18T14:44:42.332473+0000","last_clean":"2024-03-18T14:44:42.332473+0000","last_became_active":"2024-03-18T14:41:13.500766+0000","last_became_peered":"2024-03-18T14:41:13.500766+0000","last_unstale":"2024-03-18T14:44:42.332473+0000","last_undegraded":"2024-03-18T14:44:42.332473+0000","last_fullsized":"2024-03-18T14:44:42.332473+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'648","reported_seq":660,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T14:46:53.527616+0000","last_change":"2024-03-18T14:41:13.173804+0000","last_active":"2024-03-18T14:46:53.527616+0000","last_peered":"2024-03-18T14:46:53.527616+0000","last_clean":"2024-03-18T14:46:53.527616+0000","last_became_active":"2024-03-18T14:41:13.173394+0000","last_became_peered":"2024-03-18T14:41:13.173394+0000","last_unstale":"2024-03-18T14:46:53.527616+0000","last_undegraded":"2024-03-18T14:46:53.527616+0000","last_fullsized":"2024-03-18T14:46:53.527616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":549,"num_write_kb":12563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":955,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.232120+0000","last_change":"2024-03-18T14:41:13.498986+0000","last_active":"2024-03-18T14:44:43.232120+0000","last_peered":"2024-03-18T14:44:43.232120+0000","last_clean":"2024-03-18T14:44:43.232120+0000","last_became_active":"2024-03-18T14:41:13.498496+0000","last_became_peered":"2024-03-18T14:41:13.498496+0000","last_unstale":"2024-03-18T14:44:43.232120+0000","last_undegraded":"2024-03-18T14:44:43.232120+0000","last_fullsized":"2024-03-18T14:44:43.232120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":569,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:59.749817+0000","last_change":"2024-03-18T14:41:13.173871+0000","last_active":"2024-03-18T14:44:59.749817+0000","last_peered":"2024-03-18T14:44:59.749817+0000","last_clean":"2024-03-18T14:44:59.749817+0000","last_became_active":"2024-03-18T14:41:13.173434+0000","last_became_peered":"2024-03-18T14:41:13.173434+0000","last_unstale":"2024-03-18T14:44:59.749817+0000","last_undegraded":"2024-03-18T14:44:59.749817+0000","last_fullsized":"2024-03-18T14:44:59.749817+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":935,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338013+0000","last_change":"2024-03-18T14:41:13.514149+0000","last_active":"2024-03-18T14:44:42.338013+0000","last_peered":"2024-03-18T14:44:42.338013+0000","last_clean":"2024-03-18T14:44:42.338013+0000","last_became_active":"2024-03-18T14:41:13.513714+0000","last_became_peered":"2024-03-18T14:41:13.513714+0000","last_unstale":"2024-03-18T14:44:42.338013+0000","last_undegraded":"2024-03-18T14:44:42.338013+0000","last_fullsized":"2024-03-18T14:44:42.338013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":188,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.749536+0000","last_change":"2024-03-18T14:41:13.175337+0000","last_active":"2024-03-18T14:45:04.749536+0000","last_peered":"2024-03-18T14:45:04.749536+0000","last_clean":"2024-03-18T14:45:04.749536+0000","last_became_active":"2024-03-18T14:41:13.174382+0000","last_became_peered":"2024-03-18T14:41:13.174382+0000","last_unstale":"2024-03-18T14:45:04.749536+0000","last_undegraded":"2024-03-18T14:45:04.749536+0000","last_fullsized":"2024-03-18T14:45:04.749536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":910,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332164+0000","last_change":"2024-03-18T14:41:13.494849+0000","last_active":"2024-03-18T14:44:42.332164+0000","last_peered":"2024-03-18T14:44:42.332164+0000","last_clean":"2024-03-18T14:44:42.332164+0000","last_became_active":"2024-03-18T14:41:13.493587+0000","last_became_peered":"2024-03-18T14:41:13.493587+0000","last_unstale":"2024-03-18T14:44:42.332164+0000","last_undegraded":"2024-03-18T14:44:42.332164+0000","last_fullsized":"2024-03-18T14:44:42.332164+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":387,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.757398+0000","last_change":"2024-03-18T14:41:13.173900+0000","last_active":"2024-03-18T14:45:04.757398+0000","last_peered":"2024-03-18T14:45:04.757398+0000","last_clean":"2024-03-18T14:45:04.757398+0000","last_became_active":"2024-03-18T14:41:13.173216+0000","last_became_peered":"2024-03-18T14:41:13.173216+0000","last_unstale":"2024-03-18T14:45:04.757398+0000","last_undegraded":"2024-03-18T14:45:04.757398+0000","last_fullsized":"2024-03-18T14:45:04.757398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":835,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.327096+0000","last_change":"2024-03-18T14:41:13.495875+0000","last_active":"2024-03-18T14:44:42.327096+0000","last_peered":"2024-03-18T14:44:42.327096+0000","last_clean":"2024-03-18T14:44:42.327096+0000","last_became_active":"2024-03-18T14:41:13.495528+0000","last_became_peered":"2024-03-18T14:41:13.495528+0000","last_unstale":"2024-03-18T14:44:42.327096+0000","last_undegraded":"2024-03-18T14:44:42.327096+0000","last_fullsized":"2024-03-18T14:44:42.327096+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'151","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T14:46:53.625544+0000","last_change":"2024-03-18T14:41:13.165577+0000","last_active":"2024-03-18T14:46:53.625544+0000","last_peered":"2024-03-18T14:46:53.625544+0000","last_clean":"2024-03-18T14:46:53.625544+0000","last_became_active":"2024-03-18T14:41:13.165216+0000","last_became_peered":"2024-03-18T14:41:13.165216+0000","last_unstale":"2024-03-18T14:46:53.625544+0000","last_undegraded":"2024-03-18T14:46:53.625544+0000","last_fullsized":"2024-03-18T14:46:53.625544+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194627,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":39,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":814,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.351408+0000","last_change":"2024-03-18T14:41:13.497209+0000","last_active":"2024-03-18T14:44:42.351408+0000","last_peered":"2024-03-18T14:44:42.351408+0000","last_clean":"2024-03-18T14:44:42.351408+0000","last_became_active":"2024-03-18T14:41:13.496668+0000","last_became_peered":"2024-03-18T14:41:13.496668+0000","last_unstale":"2024-03-18T14:44:42.351408+0000","last_undegraded":"2024-03-18T14:44:42.351408+0000","last_fullsized":"2024-03-18T14:44:42.351408+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":444,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:39.375676+0000","last_change":"2024-03-18T14:41:13.165211+0000","last_active":"2024-03-18T14:44:39.375676+0000","last_peered":"2024-03-18T14:44:39.375676+0000","last_clean":"2024-03-18T14:44:39.375676+0000","last_became_active":"2024-03-18T14:41:13.164806+0000","last_became_peered":"2024-03-18T14:41:13.164806+0000","last_unstale":"2024-03-18T14:44:39.375676+0000","last_undegraded":"2024-03-18T14:44:39.375676+0000","last_fullsized":"2024-03-18T14:44:39.375676+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":994,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237601+0000","last_change":"2024-03-18T14:41:13.513382+0000","last_active":"2024-03-18T14:44:43.237601+0000","last_peered":"2024-03-18T14:44:43.237601+0000","last_clean":"2024-03-18T14:44:43.237601+0000","last_became_active":"2024-03-18T14:41:13.513005+0000","last_became_peered":"2024-03-18T14:41:13.513005+0000","last_unstale":"2024-03-18T14:44:43.237601+0000","last_undegraded":"2024-03-18T14:44:43.237601+0000","last_fullsized":"2024-03-18T14:44:43.237601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":415,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:39.340684+0000","last_change":"2024-03-18T14:41:13.167260+0000","last_active":"2024-03-18T14:44:39.340684+0000","last_peered":"2024-03-18T14:44:39.340684+0000","last_clean":"2024-03-18T14:44:39.340684+0000","last_became_active":"2024-03-18T14:41:13.166929+0000","last_became_peered":"2024-03-18T14:41:13.166929+0000","last_unstale":"2024-03-18T14:44:39.340684+0000","last_undegraded":"2024-03-18T14:44:39.340684+0000","last_fullsized":"2024-03-18T14:44:39.340684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.326263+0000","last_change":"2024-03-18T14:41:13.500834+0000","last_active":"2024-03-18T14:44:42.326263+0000","last_peered":"2024-03-18T14:44:42.326263+0000","last_clean":"2024-03-18T14:44:42.326263+0000","last_became_active":"2024-03-18T14:41:13.500513+0000","last_became_peered":"2024-03-18T14:41:13.500513+0000","last_unstale":"2024-03-18T14:44:42.326263+0000","last_undegraded":"2024-03-18T14:44:42.326263+0000","last_fullsized":"2024-03-18T14:44:42.326263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":864,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.782042+0000","last_change":"2024-03-18T14:41:13.175808+0000","last_active":"2024-03-18T14:45:04.782042+0000","last_peered":"2024-03-18T14:45:04.782042+0000","last_clean":"2024-03-18T14:45:04.782042+0000","last_became_active":"2024-03-18T14:41:13.175308+0000","last_became_peered":"2024-03-18T14:41:13.175308+0000","last_unstale":"2024-03-18T14:45:04.782042+0000","last_undegraded":"2024-03-18T14:45:04.782042+0000","last_fullsized":"2024-03-18T14:45:04.782042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":867,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.342452+0000","last_change":"2024-03-18T14:41:13.491641+0000","last_active":"2024-03-18T14:44:42.342452+0000","last_peered":"2024-03-18T14:44:42.342452+0000","last_clean":"2024-03-18T14:44:42.342452+0000","last_became_active":"2024-03-18T14:41:13.490999+0000","last_became_peered":"2024-03-18T14:41:13.490999+0000","last_unstale":"2024-03-18T14:44:42.342452+0000","last_undegraded":"2024-03-18T14:44:42.342452+0000","last_fullsized":"2024-03-18T14:44:42.342452+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":156,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.254867+0000","last_change":"2024-03-18T14:41:13.175706+0000","last_active":"2024-03-18T14:44:42.254867+0000","last_peered":"2024-03-18T14:44:42.254867+0000","last_clean":"2024-03-18T14:44:42.254867+0000","last_became_active":"2024-03-18T14:41:13.174506+0000","last_became_peered":"2024-03-18T14:41:13.174506+0000","last_unstale":"2024-03-18T14:44:42.254867+0000","last_undegraded":"2024-03-18T14:44:42.254867+0000","last_fullsized":"2024-03-18T14:44:42.254867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":904,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.344719+0000","last_change":"2024-03-18T14:41:13.505634+0000","last_active":"2024-03-18T14:44:42.344719+0000","last_peered":"2024-03-18T14:44:42.344719+0000","last_clean":"2024-03-18T14:44:42.344719+0000","last_became_active":"2024-03-18T14:41:13.505260+0000","last_became_peered":"2024-03-18T14:41:13.505260+0000","last_unstale":"2024-03-18T14:44:42.344719+0000","last_undegraded":"2024-03-18T14:44:42.344719+0000","last_fullsized":"2024-03-18T14:44:42.344719+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":596,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.781941+0000","last_change":"2024-03-18T14:41:13.174552+0000","last_active":"2024-03-18T14:45:04.781941+0000","last_peered":"2024-03-18T14:45:04.781941+0000","last_clean":"2024-03-18T14:45:04.781941+0000","last_became_active":"2024-03-18T14:41:13.174184+0000","last_became_peered":"2024-03-18T14:41:13.174184+0000","last_unstale":"2024-03-18T14:45:04.781941+0000","last_undegraded":"2024-03-18T14:45:04.781941+0000","last_fullsized":"2024-03-18T14:45:04.781941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":980,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237552+0000","last_change":"2024-03-18T14:41:13.491731+0000","last_active":"2024-03-18T14:44:43.237552+0000","last_peered":"2024-03-18T14:44:43.237552+0000","last_clean":"2024-03-18T14:44:43.237552+0000","last_became_active":"2024-03-18T14:41:13.491415+0000","last_became_peered":"2024-03-18T14:41:13.491415+0000","last_unstale":"2024-03-18T14:44:43.237552+0000","last_undegraded":"2024-03-18T14:44:43.237552+0000","last_fullsized":"2024-03-18T14:44:43.237552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":640,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.766352+0000","last_change":"2024-03-18T14:41:13.175491+0000","last_active":"2024-03-18T14:45:04.766352+0000","last_peered":"2024-03-18T14:45:04.766352+0000","last_clean":"2024-03-18T14:45:04.766352+0000","last_became_active":"2024-03-18T14:41:13.175082+0000","last_became_peered":"2024-03-18T14:41:13.175082+0000","last_unstale":"2024-03-18T14:45:04.766352+0000","last_undegraded":"2024-03-18T14:45:04.766352+0000","last_fullsized":"2024-03-18T14:45:04.766352+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":868,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.252432+0000","last_change":"2024-03-18T14:41:13.507091+0000","last_active":"2024-03-18T14:44:42.252432+0000","last_peered":"2024-03-18T14:44:42.252432+0000","last_clean":"2024-03-18T14:44:42.252432+0000","last_became_active":"2024-03-18T14:41:13.506720+0000","last_became_peered":"2024-03-18T14:41:13.506720+0000","last_unstale":"2024-03-18T14:44:42.252432+0000","last_undegraded":"2024-03-18T14:44:42.252432+0000","last_fullsized":"2024-03-18T14:44:42.252432+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"19'291","reported_seq":303,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.750662+0000","last_change":"2024-03-18T14:41:13.173641+0000","last_active":"2024-03-18T14:45:04.750662+0000","last_peered":"2024-03-18T14:45:04.750662+0000","last_clean":"2024-03-18T14:45:04.750662+0000","last_became_active":"2024-03-18T14:41:13.172721+0000","last_became_peered":"2024-03-18T14:41:13.172721+0000","last_unstale":"2024-03-18T14:45:04.750662+0000","last_undegraded":"2024-03-18T14:45:04.750662+0000","last_fullsized":"2024-03-18T14:45:04.750662+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":871,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.233976+0000","last_change":"2024-03-18T14:41:13.495777+0000","last_active":"2024-03-18T14:44:43.233976+0000","last_peered":"2024-03-18T14:44:43.233976+0000","last_clean":"2024-03-18T14:44:43.233976+0000","last_became_active":"2024-03-18T14:41:13.495384+0000","last_became_peered":"2024-03-18T14:41:13.495384+0000","last_unstale":"2024-03-18T14:44:43.233976+0000","last_undegraded":"2024-03-18T14:44:43.233976+0000","last_fullsized":"2024-03-18T14:44:43.233976+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1538,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.777727+0000","last_change":"2024-03-18T14:41:13.175585+0000","last_active":"2024-03-18T14:45:04.777727+0000","last_peered":"2024-03-18T14:45:04.777727+0000","last_clean":"2024-03-18T14:45:04.777727+0000","last_became_active":"2024-03-18T14:41:13.175222+0000","last_became_peered":"2024-03-18T14:41:13.175222+0000","last_unstale":"2024-03-18T14:45:04.777727+0000","last_undegraded":"2024-03-18T14:45:04.777727+0000","last_fullsized":"2024-03-18T14:45:04.777727+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":869,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.351013+0000","last_change":"2024-03-18T14:41:13.508071+0000","last_active":"2024-03-18T14:44:42.351013+0000","last_peered":"2024-03-18T14:44:42.351013+0000","last_clean":"2024-03-18T14:44:42.351013+0000","last_became_active":"2024-03-18T14:41:13.507812+0000","last_became_peered":"2024-03-18T14:41:13.507812+0000","last_unstale":"2024-03-18T14:44:42.351013+0000","last_undegraded":"2024-03-18T14:44:42.351013+0000","last_fullsized":"2024-03-18T14:44:42.351013+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318472+0000","last_change":"2024-03-18T14:41:04.836393+0000","last_active":"2024-03-18T14:41:28.318472+0000","last_peered":"2024-03-18T14:41:28.318472+0000","last_clean":"2024-03-18T14:41:28.318472+0000","last_became_active":"2024-03-18T14:41:04.836033+0000","last_became_peered":"2024-03-18T14:41:04.836033+0000","last_unstale":"2024-03-18T14:41:28.318472+0000","last_undegraded":"2024-03-18T14:41:28.318472+0000","last_fullsized":"2024-03-18T14:41:28.318472+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":518,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.300783+0000","last_change":"2024-03-18T14:41:13.174079+0000","last_active":"2024-03-18T14:44:43.300783+0000","last_peered":"2024-03-18T14:44:43.300783+0000","last_clean":"2024-03-18T14:44:43.300783+0000","last_became_active":"2024-03-18T14:41:13.173807+0000","last_became_peered":"2024-03-18T14:41:13.173807+0000","last_unstale":"2024-03-18T14:44:43.300783+0000","last_undegraded":"2024-03-18T14:44:43.300783+0000","last_fullsized":"2024-03-18T14:44:43.300783+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":911,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.236612+0000","last_change":"2024-03-18T14:41:13.501483+0000","last_active":"2024-03-18T14:44:43.236612+0000","last_peered":"2024-03-18T14:44:43.236612+0000","last_clean":"2024-03-18T14:44:43.236612+0000","last_became_active":"2024-03-18T14:41:13.500249+0000","last_became_peered":"2024-03-18T14:41:13.500249+0000","last_unstale":"2024-03-18T14:44:43.236612+0000","last_undegraded":"2024-03-18T14:44:43.236612+0000","last_fullsized":"2024-03-18T14:44:43.236612+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.316904+0000","last_change":"2024-03-18T14:41:04.536270+0000","last_active":"2024-03-18T14:41:28.316904+0000","last_peered":"2024-03-18T14:41:28.316904+0000","last_clean":"2024-03-18T14:41:28.316904+0000","last_became_active":"2024-03-18T14:41:04.535290+0000","last_became_peered":"2024-03-18T14:41:04.535290+0000","last_unstale":"2024-03-18T14:41:28.316904+0000","last_undegraded":"2024-03-18T14:41:28.316904+0000","last_fullsized":"2024-03-18T14:41:28.316904+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":724,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.765773+0000","last_change":"2024-03-18T14:41:13.171186+0000","last_active":"2024-03-18T14:45:04.765773+0000","last_peered":"2024-03-18T14:45:04.765773+0000","last_clean":"2024-03-18T14:45:04.765773+0000","last_became_active":"2024-03-18T14:41:13.170842+0000","last_became_peered":"2024-03-18T14:41:13.170842+0000","last_unstale":"2024-03-18T14:45:04.765773+0000","last_undegraded":"2024-03-18T14:45:04.765773+0000","last_fullsized":"2024-03-18T14:45:04.765773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":914,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.231477+0000","last_change":"2024-03-18T14:41:13.509496+0000","last_active":"2024-03-18T14:44:43.231477+0000","last_peered":"2024-03-18T14:44:43.231477+0000","last_clean":"2024-03-18T14:44:43.231477+0000","last_became_active":"2024-03-18T14:41:13.505495+0000","last_became_peered":"2024-03-18T14:41:13.505495+0000","last_unstale":"2024-03-18T14:44:43.231477+0000","last_undegraded":"2024-03-18T14:44:43.231477+0000","last_fullsized":"2024-03-18T14:44:43.231477+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:29.298416+0000","last_change":"2024-03-18T14:41:04.545146+0000","last_active":"2024-03-18T14:41:29.298416+0000","last_peered":"2024-03-18T14:41:29.298416+0000","last_clean":"2024-03-18T14:41:29.298416+0000","last_became_active":"2024-03-18T14:41:04.544721+0000","last_became_peered":"2024-03-18T14:41:04.544721+0000","last_unstale":"2024-03-18T14:41:29.298416+0000","last_undegraded":"2024-03-18T14:41:29.298416+0000","last_fullsized":"2024-03-18T14:41:29.298416+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"19'829","reported_seq":841,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.780700+0000","last_change":"2024-03-18T14:41:13.170682+0000","last_active":"2024-03-18T14:45:04.780700+0000","last_peered":"2024-03-18T14:45:04.780700+0000","last_clean":"2024-03-18T14:45:04.780700+0000","last_became_active":"2024-03-18T14:41:13.170338+0000","last_became_peered":"2024-03-18T14:41:13.170338+0000","last_unstale":"2024-03-18T14:45:04.780700+0000","last_undegraded":"2024-03-18T14:45:04.780700+0000","last_fullsized":"2024-03-18T14:45:04.780700+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":833,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.331637+0000","last_change":"2024-03-18T14:41:13.501651+0000","last_active":"2024-03-18T14:44:42.331637+0000","last_peered":"2024-03-18T14:44:42.331637+0000","last_clean":"2024-03-18T14:44:42.331637+0000","last_became_active":"2024-03-18T14:41:13.500940+0000","last_became_peered":"2024-03-18T14:41:13.500940+0000","last_unstale":"2024-03-18T14:44:42.331637+0000","last_undegraded":"2024-03-18T14:44:42.331637+0000","last_fullsized":"2024-03-18T14:44:42.331637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317380+0000","last_change":"2024-03-18T14:41:04.546085+0000","last_active":"2024-03-18T14:41:28.317380+0000","last_peered":"2024-03-18T14:41:28.317380+0000","last_clean":"2024-03-18T14:41:28.317380+0000","last_became_active":"2024-03-18T14:41:04.545660+0000","last_became_peered":"2024-03-18T14:41:04.545660+0000","last_unstale":"2024-03-18T14:41:28.317380+0000","last_undegraded":"2024-03-18T14:41:28.317380+0000","last_fullsized":"2024-03-18T14:41:28.317380+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317013+0000","last_change":"2024-03-18T14:41:01.290386+0000","last_active":"2024-03-18T14:41:28.317013+0000","last_peered":"2024-03-18T14:41:28.317013+0000","last_clean":"2024-03-18T14:41:28.317013+0000","last_became_active":"2024-03-18T14:41:01.289650+0000","last_became_peered":"2024-03-18T14:41:01.289650+0000","last_unstale":"2024-03-18T14:41:28.317013+0000","last_undegraded":"2024-03-18T14:41:28.317013+0000","last_fullsized":"2024-03-18T14:41:28.317013+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1025,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.766010+0000","last_change":"2024-03-18T14:41:13.174035+0000","last_active":"2024-03-18T14:45:04.766010+0000","last_peered":"2024-03-18T14:45:04.766010+0000","last_clean":"2024-03-18T14:45:04.766010+0000","last_became_active":"2024-03-18T14:41:13.173638+0000","last_became_peered":"2024-03-18T14:41:13.173638+0000","last_unstale":"2024-03-18T14:45:04.766010+0000","last_undegraded":"2024-03-18T14:45:04.766010+0000","last_fullsized":"2024-03-18T14:45:04.766010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":872,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338228+0000","last_change":"2024-03-18T14:41:13.507742+0000","last_active":"2024-03-18T14:44:42.338228+0000","last_peered":"2024-03-18T14:44:42.338228+0000","last_clean":"2024-03-18T14:44:42.338228+0000","last_became_active":"2024-03-18T14:41:13.507249+0000","last_became_peered":"2024-03-18T14:41:13.507249+0000","last_unstale":"2024-03-18T14:44:42.338228+0000","last_undegraded":"2024-03-18T14:44:42.338228+0000","last_fullsized":"2024-03-18T14:44:42.338228+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.316173+0000","last_change":"2024-03-18T14:41:04.535743+0000","last_active":"2024-03-18T14:41:28.316173+0000","last_peered":"2024-03-18T14:41:28.316173+0000","last_clean":"2024-03-18T14:41:28.316173+0000","last_became_active":"2024-03-18T14:41:04.535278+0000","last_became_peered":"2024-03-18T14:41:04.535278+0000","last_unstale":"2024-03-18T14:41:28.316173+0000","last_undegraded":"2024-03-18T14:41:28.316173+0000","last_fullsized":"2024-03-18T14:41:28.316173+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":978,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.778594+0000","last_change":"2024-03-18T14:41:13.162167+0000","last_active":"2024-03-18T14:45:04.778594+0000","last_peered":"2024-03-18T14:45:04.778594+0000","last_clean":"2024-03-18T14:45:04.778594+0000","last_became_active":"2024-03-18T14:41:13.161827+0000","last_became_peered":"2024-03-18T14:41:13.161827+0000","last_unstale":"2024-03-18T14:45:04.778594+0000","last_undegraded":"2024-03-18T14:45:04.778594+0000","last_fullsized":"2024-03-18T14:45:04.778594+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":245,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":997,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.237975+0000","last_change":"2024-03-18T14:41:13.506405+0000","last_active":"2024-03-18T14:44:43.237975+0000","last_peered":"2024-03-18T14:44:43.237975+0000","last_clean":"2024-03-18T14:44:43.237975+0000","last_became_active":"2024-03-18T14:41:13.502607+0000","last_became_peered":"2024-03-18T14:41:13.502607+0000","last_unstale":"2024-03-18T14:44:43.237975+0000","last_undegraded":"2024-03-18T14:44:43.237975+0000","last_fullsized":"2024-03-18T14:44:43.237975+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318256+0000","last_change":"2024-03-18T14:41:04.836429+0000","last_active":"2024-03-18T14:41:28.318256+0000","last_peered":"2024-03-18T14:41:28.318256+0000","last_clean":"2024-03-18T14:41:28.318256+0000","last_became_active":"2024-03-18T14:41:04.836069+0000","last_became_peered":"2024-03-18T14:41:04.836069+0000","last_unstale":"2024-03-18T14:41:28.318256+0000","last_undegraded":"2024-03-18T14:41:28.318256+0000","last_fullsized":"2024-03-18T14:41:28.318256+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":467,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.779903+0000","last_change":"2024-03-18T14:41:13.164584+0000","last_active":"2024-03-18T14:45:04.779903+0000","last_peered":"2024-03-18T14:45:04.779903+0000","last_clean":"2024-03-18T14:45:04.779903+0000","last_became_active":"2024-03-18T14:41:13.163838+0000","last_became_peered":"2024-03-18T14:41:13.163838+0000","last_unstale":"2024-03-18T14:45:04.779903+0000","last_undegraded":"2024-03-18T14:45:04.779903+0000","last_fullsized":"2024-03-18T14:45:04.779903+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":871,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.345987+0000","last_change":"2024-03-18T14:41:13.494352+0000","last_active":"2024-03-18T14:44:42.345987+0000","last_peered":"2024-03-18T14:44:42.345987+0000","last_clean":"2024-03-18T14:44:42.345987+0000","last_became_active":"2024-03-18T14:41:13.494025+0000","last_became_peered":"2024-03-18T14:41:13.494025+0000","last_unstale":"2024-03-18T14:44:42.345987+0000","last_undegraded":"2024-03-18T14:44:42.345987+0000","last_fullsized":"2024-03-18T14:44:42.345987+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"19'510","reported_seq":522,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.783159+0000","last_change":"2024-03-18T14:41:13.177493+0000","last_active":"2024-03-18T14:45:04.783159+0000","last_peered":"2024-03-18T14:45:04.783159+0000","last_clean":"2024-03-18T14:45:04.783159+0000","last_became_active":"2024-03-18T14:41:13.177130+0000","last_became_peered":"2024-03-18T14:41:13.177130+0000","last_unstale":"2024-03-18T14:45:04.783159+0000","last_undegraded":"2024-03-18T14:45:04.783159+0000","last_fullsized":"2024-03-18T14:45:04.783159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.317954+0000","last_change":"2024-03-18T14:41:04.837055+0000","last_active":"2024-03-18T14:41:28.317954+0000","last_peered":"2024-03-18T14:41:28.317954+0000","last_clean":"2024-03-18T14:41:28.317954+0000","last_became_active":"2024-03-18T14:41:04.836757+0000","last_became_peered":"2024-03-18T14:41:04.836757+0000","last_unstale":"2024-03-18T14:41:28.317954+0000","last_undegraded":"2024-03-18T14:41:28.317954+0000","last_fullsized":"2024-03-18T14:41:28.317954+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1010,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.349594+0000","last_change":"2024-03-18T14:41:13.508501+0000","last_active":"2024-03-18T14:44:42.349594+0000","last_peered":"2024-03-18T14:44:42.349594+0000","last_clean":"2024-03-18T14:44:42.349594+0000","last_became_active":"2024-03-18T14:41:13.507961+0000","last_became_peered":"2024-03-18T14:41:13.507961+0000","last_unstale":"2024-03-18T14:44:42.349594+0000","last_undegraded":"2024-03-18T14:44:42.349594+0000","last_fullsized":"2024-03-18T14:44:42.349594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:41:28.318359+0000","last_change":"2024-03-18T14:41:04.836334+0000","last_active":"2024-03-18T14:41:28.318359+0000","last_peered":"2024-03-18T14:41:28.318359+0000","last_clean":"2024-03-18T14:41:28.318359+0000","last_became_active":"2024-03-18T14:41:04.835995+0000","last_became_peered":"2024-03-18T14:41:04.835995+0000","last_unstale":"2024-03-18T14:41:28.318359+0000","last_undegraded":"2024-03-18T14:41:28.318359+0000","last_fullsized":"2024-03-18T14:41:28.318359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'665","reported_seq":677,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.764078+0000","last_change":"2024-03-18T14:41:13.164870+0000","last_active":"2024-03-18T14:45:04.764078+0000","last_peered":"2024-03-18T14:45:04.764078+0000","last_clean":"2024-03-18T14:45:04.764078+0000","last_became_active":"2024-03-18T14:41:13.164439+0000","last_became_peered":"2024-03-18T14:41:13.164439+0000","last_unstale":"2024-03-18T14:45:04.764078+0000","last_undegraded":"2024-03-18T14:45:04.764078+0000","last_fullsized":"2024-03-18T14:45:04.764078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":894,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337415+0000","last_change":"2024-03-18T14:41:13.495797+0000","last_active":"2024-03-18T14:44:42.337415+0000","last_peered":"2024-03-18T14:44:42.337415+0000","last_clean":"2024-03-18T14:44:42.337415+0000","last_became_active":"2024-03-18T14:41:13.494586+0000","last_became_peered":"2024-03-18T14:41:13.494586+0000","last_unstale":"2024-03-18T14:44:42.337415+0000","last_undegraded":"2024-03-18T14:44:42.337415+0000","last_fullsized":"2024-03-18T14:44:42.337415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":142,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.750152+0000","last_change":"2024-03-18T14:41:13.180531+0000","last_active":"2024-03-18T14:45:04.750152+0000","last_peered":"2024-03-18T14:45:04.750152+0000","last_clean":"2024-03-18T14:45:04.750152+0000","last_became_active":"2024-03-18T14:41:13.179967+0000","last_became_peered":"2024-03-18T14:41:13.179967+0000","last_unstale":"2024-03-18T14:45:04.750152+0000","last_undegraded":"2024-03-18T14:45:04.750152+0000","last_fullsized":"2024-03-18T14:45:04.750152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":925,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.337545+0000","last_change":"2024-03-18T14:41:13.511510+0000","last_active":"2024-03-18T14:44:42.337545+0000","last_peered":"2024-03-18T14:44:42.337545+0000","last_clean":"2024-03-18T14:44:42.337545+0000","last_became_active":"2024-03-18T14:41:13.510958+0000","last_became_peered":"2024-03-18T14:41:13.510958+0000","last_unstale":"2024-03-18T14:44:42.337545+0000","last_undegraded":"2024-03-18T14:44:42.337545+0000","last_fullsized":"2024-03-18T14:44:42.337545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":398,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:40.290227+0000","last_change":"2024-03-18T14:41:13.165885+0000","last_active":"2024-03-18T14:44:40.290227+0000","last_peered":"2024-03-18T14:44:40.290227+0000","last_clean":"2024-03-18T14:44:40.290227+0000","last_became_active":"2024-03-18T14:41:13.165522+0000","last_became_peered":"2024-03-18T14:41:13.165522+0000","last_unstale":"2024-03-18T14:44:40.290227+0000","last_undegraded":"2024-03-18T14:44:40.290227+0000","last_fullsized":"2024-03-18T14:44:40.290227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":812,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.346656+0000","last_change":"2024-03-18T14:41:13.498823+0000","last_active":"2024-03-18T14:44:42.346656+0000","last_peered":"2024-03-18T14:44:42.346656+0000","last_clean":"2024-03-18T14:44:42.346656+0000","last_became_active":"2024-03-18T14:41:13.498385+0000","last_became_peered":"2024-03-18T14:41:13.498385+0000","last_unstale":"2024-03-18T14:44:42.346656+0000","last_undegraded":"2024-03-18T14:44:42.346656+0000","last_fullsized":"2024-03-18T14:44:42.346656+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":645,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:45:04.773140+0000","last_change":"2024-03-18T14:41:13.173133+0000","last_active":"2024-03-18T14:45:04.773140+0000","last_peered":"2024-03-18T14:45:04.773140+0000","last_clean":"2024-03-18T14:45:04.773140+0000","last_became_active":"2024-03-18T14:41:13.172740+0000","last_became_peered":"2024-03-18T14:41:13.172740+0000","last_unstale":"2024-03-18T14:45:04.773140+0000","last_undegraded":"2024-03-18T14:45:04.773140+0000","last_fullsized":"2024-03-18T14:45:04.773140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":866,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.235714+0000","last_change":"2024-03-18T14:41:13.491774+0000","last_active":"2024-03-18T14:44:43.235714+0000","last_peered":"2024-03-18T14:44:43.235714+0000","last_clean":"2024-03-18T14:44:43.235714+0000","last_became_active":"2024-03-18T14:41:13.491341+0000","last_became_peered":"2024-03-18T14:41:13.491341+0000","last_unstale":"2024-03-18T14:44:43.235714+0000","last_undegraded":"2024-03-18T14:44:43.235714+0000","last_fullsized":"2024-03-18T14:44:43.235714+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":496,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:59.745669+0000","last_change":"2024-03-18T14:41:13.173638+0000","last_active":"2024-03-18T14:44:59.745669+0000","last_peered":"2024-03-18T14:44:59.745669+0000","last_clean":"2024-03-18T14:44:59.745669+0000","last_became_active":"2024-03-18T14:41:13.173202+0000","last_became_peered":"2024-03-18T14:41:13.173202+0000","last_unstale":"2024-03-18T14:44:59.745669+0000","last_undegraded":"2024-03-18T14:44:59.745669+0000","last_fullsized":"2024-03-18T14:44:59.745669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332217+0000","last_change":"2024-03-18T14:41:13.503948+0000","last_active":"2024-03-18T14:44:42.332217+0000","last_peered":"2024-03-18T14:44:42.332217+0000","last_clean":"2024-03-18T14:44:42.332217+0000","last_became_active":"2024-03-18T14:41:13.503388+0000","last_became_peered":"2024-03-18T14:41:13.503388+0000","last_unstale":"2024-03-18T14:44:42.332217+0000","last_undegraded":"2024-03-18T14:44:42.332217+0000","last_fullsized":"2024-03-18T14:44:42.332217+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":227,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.326567+0000","last_change":"2024-03-18T14:41:13.164760+0000","last_active":"2024-03-18T14:44:42.326567+0000","last_peered":"2024-03-18T14:44:42.326567+0000","last_clean":"2024-03-18T14:44:42.326567+0000","last_became_active":"2024-03-18T14:41:13.164330+0000","last_became_peered":"2024-03-18T14:41:13.164330+0000","last_unstale":"2024-03-18T14:44:42.326567+0000","last_undegraded":"2024-03-18T14:44:42.326567+0000","last_fullsized":"2024-03-18T14:44:42.326567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":974,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.235017+0000","last_change":"2024-03-18T14:41:13.506570+0000","last_active":"2024-03-18T14:44:43.235017+0000","last_peered":"2024-03-18T14:44:43.235017+0000","last_clean":"2024-03-18T14:44:43.235017+0000","last_became_active":"2024-03-18T14:41:13.506234+0000","last_became_peered":"2024-03-18T14:41:13.506234+0000","last_unstale":"2024-03-18T14:44:43.235017+0000","last_undegraded":"2024-03-18T14:44:43.235017+0000","last_fullsized":"2024-03-18T14:44:43.235017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1068,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.343183+0000","last_change":"2024-03-18T14:41:13.513745+0000","last_active":"2024-03-18T14:44:42.343183+0000","last_peered":"2024-03-18T14:44:42.343183+0000","last_clean":"2024-03-18T14:44:42.343183+0000","last_became_active":"2024-03-18T14:41:13.500408+0000","last_became_peered":"2024-03-18T14:41:13.500408+0000","last_unstale":"2024-03-18T14:44:42.343183+0000","last_undegraded":"2024-03-18T14:44:42.343183+0000","last_fullsized":"2024-03-18T14:44:42.343183+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":981,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.332113+0000","last_change":"2024-03-18T14:41:13.494354+0000","last_active":"2024-03-18T14:44:42.332113+0000","last_peered":"2024-03-18T14:44:42.332113+0000","last_clean":"2024-03-18T14:44:42.332113+0000","last_became_active":"2024-03-18T14:41:13.493951+0000","last_became_peered":"2024-03-18T14:41:13.493951+0000","last_unstale":"2024-03-18T14:44:42.332113+0000","last_undegraded":"2024-03-18T14:44:42.332113+0000","last_fullsized":"2024-03-18T14:44:42.332113+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":893,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:43.234960+0000","last_change":"2024-03-18T14:41:13.481344+0000","last_active":"2024-03-18T14:44:43.234960+0000","last_peered":"2024-03-18T14:44:43.234960+0000","last_clean":"2024-03-18T14:44:43.234960+0000","last_became_active":"2024-03-18T14:41:13.480927+0000","last_became_peered":"2024-03-18T14:41:13.480927+0000","last_unstale":"2024-03-18T14:44:43.234960+0000","last_undegraded":"2024-03-18T14:44:43.234960+0000","last_fullsized":"2024-03-18T14:44:43.234960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":890,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338701+0000","last_change":"2024-03-18T14:41:13.501246+0000","last_active":"2024-03-18T14:44:42.338701+0000","last_peered":"2024-03-18T14:44:42.338701+0000","last_clean":"2024-03-18T14:44:42.338701+0000","last_became_active":"2024-03-18T14:41:13.500903+0000","last_became_peered":"2024-03-18T14:41:13.500903+0000","last_unstale":"2024-03-18T14:44:42.338701+0000","last_undegraded":"2024-03-18T14:44:42.338701+0000","last_fullsized":"2024-03-18T14:44:42.338701+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":858,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-03-18T14:44:42.338563+0000","last_change":"2024-03-18T14:41:13.508737+0000","last_active":"2024-03-18T14:44:42.338563+0000","last_peered":"2024-03-18T14:44:42.338563+0000","last_clean":"2024-03-18T14:44:42.338563+0000","last_became_active":"2024-03-18T14:41:13.508430+0000","last_became_peered":"2024-03-18T14:41:13.508430+0000","last_unstale":"2024-03-18T14:44:42.338563+0000","last_undegraded":"2024-03-18T14:44:42.338563+0000","last_fullsized":"2024-03-18T14:44:42.338563+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137119479,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":551,"num_read_kb":3219,"num_write":16035,"num_write_kb":262677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274350080,"data_stored":274238958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19601,"ondisk_log_size":19601,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705737,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1144292,"kb_used_data":95708,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93227548,"statfs":{"total":96636764160,"available":95465009152,"internally_reserved":1073741824,"allocated":98004992,"data_stored":97846422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.875,"15min":0.50900000000000001},"min":{"1min":0.17000000000000001,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.41299999999999998,"5min":57.850000000000001,"15min":57.850000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.91600000000000004,"15min":0.52800000000000002},"min":{"1min":0.192,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.432,"5min":57.902000000000001,"15min":57.902000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.93000000000000005,"15min":0.54600000000000004},"min":{"1min":0.23000000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.51500000000000001,"5min":57.866999999999997,"15min":57.866999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.93000000000000005,"15min":0.53400000000000003},"min":{"1min":0.20300000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.52400000000000002,"5min":58.351999999999997,"15min":58.351999999999997},"last":0.246}]},{"osd":2,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.223,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.52400000000000002,"5min":1.173,"15min":1.173},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.39700000000000002,"15min":0.376},"min":{"1min":0.21199999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48999999999999999,"5min":4.2770000000000001,"15min":4.2770000000000001},"last":0.27100000000000002}]}]},{"osd":2,"up_from":9,"seq":38654705738,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1111348,"kb_used_data":62764,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93260492,"statfs":{"total":96636764160,"available":95498743808,"internally_reserved":1073741824,"allocated":64270336,"data_stored":64138088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.34699999999999998,"15min":0.318},"min":{"1min":0.16400000000000001,"5min":0.14699999999999999,"15min":0.14699999999999999},"max":{"1min":0.41099999999999998,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.38600000000000001,"15min":0.35099999999999998},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.44400000000000001,"5min":3.6320000000000001,"15min":3.6320000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.42699999999999999,"15min":0.35399999999999998},"min":{"1min":0.186,"5min":0.183,"15min":0.183},"max":{"1min":0.443,"5min":4.2140000000000004,"15min":4.2140000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.44900000000000001,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.46800000000000003,"5min":5.5099999999999998,"15min":5.5099999999999998},"last":0.314}]},{"osd":3,"last update":"Mon Mar 18 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.41599999999999998,"15min":0.36199999999999999},"min":{"1min":0.224,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48399999999999999,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.39300000000000002,"15min":0.36699999999999999},"min":{"1min":0.218,"5min":0.215,"15min":0.215},"max":{"1min":0.48599999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":0.32200000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1107672,"kb_used_data":59088,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93264168,"statfs":{"total":96636764160,"available":95502508032,"internally_reserved":1073741824,"allocated":60506112,"data_stored":60363242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.29399999999999998,"5min":0.38800000000000001,"15min":0.33100000000000002},"min":{"1min":0.192,"5min":0.152,"15min":0.152},"max":{"1min":0.45500000000000002,"5min":4.3380000000000001,"15min":4.3380000000000001},"last":0.311},{"interface":"front","average":{"1min":0.311,"5min":0.41699999999999998,"15min":0.35399999999999998},"min":{"1min":0.221,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.42799999999999999,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.30499999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.47399999999999998,"15min":0.36399999999999999},"min":{"1min":0.20100000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.47199999999999998,"5min":6.3739999999999997,"15min":6.3739999999999997},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.35099999999999998,"15min":0.311},"min":{"1min":0.22900000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.52000000000000002,"5min":1.589,"15min":1.589},"last":0.26100000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:46:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.20999999999999999,"5min":0.188,"15min":0.188},"max":{"1min":0.55700000000000005,"5min":3.5830000000000002,"15min":3.5830000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.23300000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.49299999999999999,"5min":1.524,"15min":1.524},"last":0.252}]}]},{"osd":1,"up_from":9,"seq":38654705737,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1099616,"kb_used_data":51032,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93272224,"statfs":{"total":96636764160,"available":95510757376,"internally_reserved":1073741824,"allocated":52256768,"data_stored":52126902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.499,"15min":0.371},"min":{"1min":0.20200000000000001,"5min":0.158,"15min":0.158},"max":{"1min":0.40200000000000002,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.34699999999999998,"15min":0.33300000000000002},"min":{"1min":0.21199999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.436,"5min":2.7250000000000001,"15min":2.7250000000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.371,"15min":0.34399999999999997},"min":{"1min":0.216,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.40600000000000003,"5min":3.0099999999999998,"15min":3.0099999999999998},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.46600000000000003,"15min":0.38700000000000001},"min":{"1min":0.249,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.45000000000000001,"5min":3.262,"15min":3.262},"last":0.27500000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.47699999999999998,"15min":0.39900000000000002},"min":{"1min":0.23200000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.39200000000000002,"5min":6.6420000000000003,"15min":6.6420000000000003},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.437,"15min":0.39100000000000001},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.45000000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.34799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60334080,"data_stored":60304318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52084736,"data_stored":52067978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:46:57.281 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T14:46:57.281 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T14:46:57.281 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T14:46:57.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T14:46:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 Processor -- start 2024-03-18T14:46:57.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 -- start start 2024-03-18T14:46:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f196813c1d0 0x7f19680a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1968146fd0 0x7f19681493b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19680a9e20 con 0x7f1968063f60 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19680a8f40 con 0x7f1968146fd0 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f196d723700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19680aa960 con 0x7f196813c1d0 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f1966ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1968063f60 0x7f196813bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40730/0 (socket says 172.21.15.57:40730) 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f1966ffd700 1 -- 172.21.15.57:0/1253897422 learned_addr learned my addr 172.21.15.57:0/1253897422 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f19667fc700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f196813c1d0 0x7f19680a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.436+0000 7f19677fe700 1 --2- 172.21.15.57:0/1253897422 >> v2:172.21.15.57:3300/0 conn(0x7f1968146fd0 0x7f19681493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f19677fe700 1 -- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f196813c1d0 msgr2=0x7f19680a8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f19677fe700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f196813c1d0 0x7f19680a8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f19677fe700 1 -- 172.21.15.57:0/1253897422 >> v1:172.21.15.57:6789/0 conn(0x7f1968063f60 legacy=0x7f196813bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f19677fe700 1 -- 172.21.15.57:0/1253897422 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19680aac20 con 0x7f1968146fd0 2024-03-18T14:46:57.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f19677fe700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1968146fd0 0x7f19681493b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1960009e60 tx=0x7f1960009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ae177730555652 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f1965ffb700 1 -- 172.21.15.57:0/1253897422 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000e070 con 0x7f1968146fd0 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f1965ffb700 1 -- 172.21.15.57:0/1253897422 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196000ba60 con 0x7f1968146fd0 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.437+0000 7f1965ffb700 1 -- 172.21.15.57:0/1253897422 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196000be20 con 0x7f1968146fd0 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 -- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1968146fd0 msgr2=0x7f19681493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1968146fd0 0x7f19681493b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1960009e60 tx=0x7f1960009780 comp rx=0 tx=0).stop 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 -- 172.21.15.57:0/1253897422 shutdown_connections 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1968146fd0 0x7f19681493b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 --2- 172.21.15.57:0/1253897422 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f196813c1d0 0x7f19680a8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 -- 172.21.15.57:0/1253897422 >> 172.21.15.57:0/1253897422 conn(0x7f1968087fe0 msgr2=0x7f1968063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 -- 172.21.15.57:0/1253897422 shutdown_connections 2024-03-18T14:46:57.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.438+0000 7f196d723700 1 -- 172.21.15.57:0/1253897422 wait complete. 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 Processor -- start 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 -- start start 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 0x7f19680b4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1968146fd0 0x7f19680a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1968142480 con 0x7f196813c1d0 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19680b4da0 con 0x7f1968063f60 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.439+0000 7f196d723700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19680b55e0 con 0x7f1968146fd0 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f1966ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f1966ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42078/0 (socket says 172.21.15.57:42078) 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f1966ffd700 1 -- 172.21.15.57:0/2835918616 learned_addr learned my addr 172.21.15.57:0/2835918616 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 0x7f19680b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19677fe700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1968146fd0 0x7f19680a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 -- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1968146fd0 msgr2=0x7f19680a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1968146fd0 0x7f19680a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 -- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 msgr2=0x7f19680b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 -- 172.21.15.57:0/2835918616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1960009a20 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f1966ffd700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f19667fc700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 0x7f19680b4860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f195000ea50 tx=0x7f19500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000ee90 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195000c7f0 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1968140a70 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195000cb90 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.440+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1968142a40 con 0x7f196813c1d0 2024-03-18T14:46:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.441+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19681425d0 con 0x7f196813c1d0 2024-03-18T14:46:57.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.441+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f1950013470 con 0x7f196813c1d0 2024-03-18T14:46:57.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.441+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f195005b590 con 0x7f196813c1d0 2024-03-18T14:46:57.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.446+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f19500398a0 con 0x7f196813c1d0 2024-03-18T14:46:57.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.673+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f19680648f0 con 0x7f196813c1d0 2024-03-18T14:46:57.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.673+0000 7f195effd700 1 -- 172.21.15.57:0/2835918616 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f195003d090 con 0x7f196813c1d0 2024-03-18T14:46:57.675 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:57.675 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 >> v1:172.21.15.57:6816/47480 conn(0x7f1948045f80 legacy=0x7f1948048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 msgr2=0x7f19680b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 0x7f19680b4860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f195000ea50 tx=0x7f19500091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 shutdown_connections 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1968146fd0 0x7f19680a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1968063f60 0x7f19680b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 --2- 172.21.15.57:0/2835918616 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f196813c1d0 0x7f19680b4860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 >> 172.21.15.57:0/2835918616 conn(0x7f1968087fe0 msgr2=0x7f196813b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:57.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 shutdown_connections 2024-03-18T14:46:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.675+0000 7f196d723700 1 -- 172.21.15.57:0/2835918616 wait complete. 2024-03-18T14:46:57.688 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T14:46:57.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:46:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 Processor -- start 2024-03-18T14:46:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 -- start start 2024-03-18T14:46:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 0x7fc4780aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 0x7fc478141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4781419d0 con 0x7fc478063f60 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780aaa80 con 0x7fc4780a8a80 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.816+0000 7fc480363700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780a7400 con 0x7fc478142500 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e0ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 0x7fc4780aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47d8fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 0x7fc478141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50588/0 (socket says 172.21.15.57:50588) 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e0ff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 0x7fc4780aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55430/0 (socket says 172.21.15.57:55430) 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 -- 172.21.15.57:0/3970438698 learned_addr learned my addr 172.21.15.57:0/3970438698 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 -- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 msgr2=0x7fc478141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 0x7fc478141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 -- 172.21.15.57:0/3970438698 >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 msgr2=0x7fc4780aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 --2- 172.21.15.57:0/3970438698 >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 0x7fc4780aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 -- 172.21.15.57:0/3970438698 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4780a8e70 con 0x7fc478142500 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47d8fe700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 0x7fc478141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47e900700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc470009f20 tx=0x7fc470009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f728563515e33d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47d0fd700 1 -- 172.21.15.57:0/3970438698 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47000e070 con 0x7fc478142500 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47d0fd700 1 -- 172.21.15.57:0/3970438698 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000b970 con 0x7fc478142500 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.817+0000 7fc47d0fd700 1 -- 172.21.15.57:0/3970438698 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700092e0 con 0x7fc478142500 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 -- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 msgr2=0x7fc4780a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc470009f20 tx=0x7fc470009840 comp rx=0 tx=0).stop 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 -- 172.21.15.57:0/3970438698 shutdown_connections 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc478142500 0x7fc4780a53d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 --2- 172.21.15.57:0/3970438698 >> v2:172.21.15.57:3300/0 conn(0x7fc478063f60 0x7fc4780aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 --2- 172.21.15.57:0/3970438698 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4780a8a80 0x7fc478141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 -- 172.21.15.57:0/3970438698 >> 172.21.15.57:0/3970438698 conn(0x7fc478087fe0 msgr2=0x7fc478063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 -- 172.21.15.57:0/3970438698 shutdown_connections 2024-03-18T14:46:57.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.818+0000 7fc480363700 1 -- 172.21.15.57:0/3970438698 wait complete. 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.819+0000 7fc480363700 1 Processor -- start 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.819+0000 7fc480363700 1 -- start start 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4780a8a80 0x7fc4780978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 0x7fc4781511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:57.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478097e10 con 0x7fc478142500 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780b1010 con 0x7fc478063f60 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc480363700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780b1cf0 con 0x7fc4780a8a80 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42102/0 (socket says 172.21.15.57:42102) 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 -- 172.21.15.57:0/791736366 learned_addr learned my addr 172.21.15.57:0/791736366 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47d8fe700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4780a8a80 0x7fc4780978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e900700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 0x7fc4781511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 -- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4780a8a80 msgr2=0x7fc4780978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4780a8a80 0x7fc4780978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 -- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 msgr2=0x7fc4781511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 0x7fc4781511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:57.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e0ff700 1 -- 172.21.15.57:0/791736366 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc468009420 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.820+0000 7fc47e900700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 0x7fc4781511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc47e0ff700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc47400e960 tx=0x7fc4740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474013680 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4740137e0 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc470009ae0 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474013ba0 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.821+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4780b0dd0 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.822+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4780648f0 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.822+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fc47400c490 con 0x7fc478063f60 2024-03-18T14:46:57.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.822+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc47405b140 con 0x7fc478063f60 2024-03-18T14:46:57.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.831+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc474039470 con 0x7fc478063f60 2024-03-18T14:46:57.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.997+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4780a7640 con 0x7fc478063f60 2024-03-18T14:46:57.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.997+0000 7fc46e7fc700 1 -- 172.21.15.57:0/791736366 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7fc474021090 con 0x7fc478063f60 2024-03-18T14:46:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:57.998 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:46:57.541889+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:46:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 >> v1:172.21.15.57:6816/47480 conn(0x7fc45c045f80 legacy=0x7fc45c048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 msgr2=0x7fc4780b1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc47400e960 tx=0x7fc4740091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 shutdown_connections 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc478142500 0x7fc4781511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc478063f60 0x7fc4780b1480 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 --2- 172.21.15.57:0/791736366 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4780a8a80 0x7fc4780978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:57.999+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 >> 172.21.15.57:0/791736366 conn(0x7fc478087fe0 msgr2=0x7fc4780a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.000+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 shutdown_connections 2024-03-18T14:46:58.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.000+0000 7fc480363700 1 -- 172.21.15.57:0/791736366 wait complete. 2024-03-18T14:46:58.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:46:58.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:46:58.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.137+0000 7ff3b1a21700 1 Processor -- start 2024-03-18T14:46:58.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.137+0000 7ff3b1a21700 1 -- start start 2024-03-18T14:46:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3b1a21700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3ac0a42a0 0x7ff3ac0a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3b1a21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac147170 0x7ff3ac149550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3b1a21700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3ac0a7500 con 0x7ff3ac0a27d0 2024-03-18T14:46:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3b1a21700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3ac13ebd0 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3b1a21700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a3290 con 0x7ff3ac147170 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3ac0a42a0 0x7ff3ac0a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aa7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff3ac0a27d0 0x7ff3ac13f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40736/0 (socket says 172.21.15.57:40736) 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/1779485618 learned_addr learned my addr 172.21.15.57:0/1779485618 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac147170 0x7ff3ac149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aaffd700 1 -- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac147170 msgr2=0x7ff3ac149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aaffd700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac147170 0x7ff3ac149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aaffd700 1 -- 172.21.15.57:0/1779485618 >> v1:172.21.15.57:6789/0 conn(0x7ff3ac0a27d0 legacy=0x7ff3ac13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3aaffd700 1 -- 172.21.15.57:0/1779485618 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0a3850 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.138+0000 7ff3a9ffb700 1 -- 172.21.15.57:0/1779485618 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451270615 0 0) 0x7ff3ac0a7500 con 0x7ff3ac0a27d0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3aaffd700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a42a0 0x7ff3ac0a2290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098e0 tx=0x7ff39c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14b05274355c908 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3a9ffb700 1 -- 172.21.15.57:0/1779485618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c00b640 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3a9ffb700 1 -- 172.21.15.57:0/1779485618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c00b7a0 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3a9ffb700 1 -- 172.21.15.57:0/1779485618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c00bb40 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 -- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a42a0 msgr2=0x7ff3ac0a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a42a0 0x7ff3ac0a2290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098e0 tx=0x7ff39c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 -- 172.21.15.57:0/1779485618 shutdown_connections 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac147170 0x7ff3ac149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/1779485618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a42a0 0x7ff3ac0a2290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 -- 172.21.15.57:0/1779485618 >> 172.21.15.57:0/1779485618 conn(0x7ff3ac0b4eb0 msgr2=0x7ff3ac0b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 -- 172.21.15.57:0/1779485618 shutdown_connections 2024-03-18T14:46:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.139+0000 7ff3b1a21700 1 -- 172.21.15.57:0/1779485618 wait complete. 2024-03-18T14:46:58.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.140+0000 7ff3b1a21700 1 Processor -- start 2024-03-18T14:46:58.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 -- start start 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a27d0 0x7ff3ac151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 0x7ff3ac1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac145f30 con 0x7ff3ac0a27d0 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a9530 con 0x7ff3ac0a42a0 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3b1a21700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac0a9810 con 0x7ff3ac147170 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3aa7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3aa7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42128/0 (socket says 172.21.15.57:42128) 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3aa7fc700 1 -- 172.21.15.57:0/850914602 learned_addr learned my addr 172.21.15.57:0/850914602 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3aaffd700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a27d0 0x7ff3ac151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.141+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 0x7ff3ac1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 -- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 msgr2=0x7ff3ac151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 -- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a27d0 msgr2=0x7ff3ac151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a27d0 0x7ff3ac151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 -- 172.21.15.57:0/850914602 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39c009420 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3aa7fc700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3ab7fe700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 0x7ff3ac1521d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400ec90 tx=0x7ff3a400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400c890 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a400f040 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac0aa2e0 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400cc40 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.142+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac1452d0 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.143+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7ff3a4014690 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.143+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac142990 con 0x7ff3ac147170 2024-03-18T14:46:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.144+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7ff3a405ba10 con 0x7ff3ac147170 2024-03-18T14:46:58.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.147+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7ff3a4039e60 con 0x7ff3ac147170 2024-03-18T14:46:58.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.312+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3ac0648f0 con 0x7ff3ac147170 2024-03-18T14:46:58.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.313+0000 7ff392ffd700 1 -- 172.21.15.57:0/850914602 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff3a403d480 con 0x7ff3ac147170 2024-03-18T14:46:58.313 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:46:58.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 >> v1:172.21.15.57:6816/47480 conn(0x7ff398045f80 legacy=0x7ff398048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 msgr2=0x7ff3ac1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 0x7ff3ac1521d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400ec90 tx=0x7ff3a400b040 comp rx=0 tx=0).stop 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 shutdown_connections 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff3ac147170 0x7ff3ac1521d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3ac0a27d0 0x7ff3ac151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 --2- 172.21.15.57:0/850914602 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff3ac0a42a0 0x7ff3ac151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 >> 172.21.15.57:0/850914602 conn(0x7ff3ac0b4eb0 msgr2=0x7ff3ac13edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 shutdown_connections 2024-03-18T14:46:58.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.315+0000 7ff3b1a21700 1 -- 172.21.15.57:0/850914602 wait complete. 2024-03-18T14:46:58.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:46:58.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.451+0000 7f8e4d6d1700 1 Processor -- start 2024-03-18T14:46:58.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.451+0000 7f8e4d6d1700 1 -- start start 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e4d6d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 0x7f8e4813f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e4d6d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 0x7f8e48149550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e4d6d1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e480a7500 con 0x7f8e480a42a0 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e4d6d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4813ebd0 con 0x7f8e4813f000 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e4d6d1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480a29a0 con 0x7f8e48147170 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e46ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8e480a42a0 0x7f8e480a2290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40750/0 (socket says 172.21.15.57:40750) 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e467fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 0x7f8e4813f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e46ffd700 1 -- 172.21.15.57:0/887224401 learned_addr learned my addr 172.21.15.57:0/887224401 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.452+0000 7f8e477fe700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 0x7f8e48149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e45ffb700 1 -- 172.21.15.57:0/887224401 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305767986 0 0) 0x7f8e480a7500 con 0x7f8e480a42a0 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e467fc700 1 -- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 msgr2=0x7f8e48149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e467fc700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 0x7f8e48149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e467fc700 1 -- 172.21.15.57:0/887224401 >> v1:172.21.15.57:6789/0 conn(0x7f8e480a42a0 legacy=0x7f8e480a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e467fc700 1 -- 172.21.15.57:0/887224401 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480a3290 con 0x7f8e4813f000 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e477fe700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 0x7f8e48149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e467fc700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 0x7f8e4813f3d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009910 tx=0x7f8e3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d735c72a3a79bf07 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e45ffb700 1 -- 172.21.15.57:0/887224401 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00b680 con 0x7f8e4813f000 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e45ffb700 1 -- 172.21.15.57:0/887224401 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00b7e0 con 0x7f8e4813f000 2024-03-18T14:46:58.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.453+0000 7f8e45ffb700 1 -- 172.21.15.57:0/887224401 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00bba0 con 0x7f8e4813f000 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 msgr2=0x7f8e4813f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 0x7f8e4813f3d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009910 tx=0x7f8e3c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/887224401 shutdown_connections 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e48147170 0x7f8e48149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/887224401 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e4813f000 0x7f8e4813f3d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/887224401 >> 172.21.15.57:0/887224401 conn(0x7f8e480b4eb0 msgr2=0x7f8e480b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/887224401 shutdown_connections 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.454+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/887224401 wait complete. 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.455+0000 7f8e4d6d1700 1 Processor -- start 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.455+0000 7f8e4d6d1700 1 -- start start 2024-03-18T14:46:58.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 0x7f8e481516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e48147170 0x7f8e48151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480a9fa0 con 0x7f8e480a42a0 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e480a8ce0 con 0x7f8e48147170 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e4d6d1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e48145510 con 0x7f8e4813f000 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e46ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e46ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55478/0 (socket says 172.21.15.57:55478) 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e46ffd700 1 -- 172.21.15.57:0/4006538163 learned_addr learned my addr 172.21.15.57:0/4006538163 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e467fc700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 0x7f8e481516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.456+0000 7f8e477fe700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e48147170 0x7f8e48151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 -- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 msgr2=0x7f8e481516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 0x7f8e481516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 -- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e48147170 msgr2=0x7f8e48151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e48147170 0x7f8e48151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 -- 172.21.15.57:0/4006538163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e40009a20 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e467fc700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 0x7f8e481516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e46ffd700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c810 tx=0x7f8e38007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38005c00 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e38005d60 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e38007300 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3c009420 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.457+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e480aaf80 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.458+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e480aace0 con 0x7f8e480a42a0 2024-03-18T14:46:58.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.459+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f8e3801b3b0 con 0x7f8e480a42a0 2024-03-18T14:46:58.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.459+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f8e3805a580 con 0x7f8e480a42a0 2024-03-18T14:46:58.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.465+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f8e38038870 con 0x7f8e480a42a0 2024-03-18T14:46:58.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.629+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e480648f0 con 0x7f8e480a42a0 2024-03-18T14:46:58.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.629+0000 7f8e2effd700 1 -- 172.21.15.57:0/4006538163 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e3803c060 con 0x7f8e480a42a0 2024-03-18T14:46:58.630 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:46:58.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.630+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 >> v1:172.21.15.57:6816/47480 conn(0x7f8e34046030 legacy=0x7f8e340484e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 msgr2=0x7f8e480a9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e3800c810 tx=0x7f8e38007d90 comp rx=0 tx=0).stop 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 shutdown_connections 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f8e48147170 0x7f8e48151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e480a42a0 0x7f8e480a9670 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 --2- 172.21.15.57:0/4006538163 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8e4813f000 0x7f8e481516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 >> 172.21.15.57:0/4006538163 conn(0x7f8e480b4eb0 msgr2=0x7f8e480710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 shutdown_connections 2024-03-18T14:46:58.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.631+0000 7f8e4d6d1700 1 -- 172.21.15.57:0/4006538163 wait complete. 2024-03-18T14:46:58.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 Processor -- start 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 -- start start 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91ec069e80 con 0x7f91ec0a4ee0 2024-03-18T14:46:58.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91ec0a3dd0 con 0x7f91ec06a860 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f2f34700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0a4910 con 0x7f91ec146600 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.766+0000 7f91f14d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f0cd0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42160/0 (socket says 172.21.15.57:42160) 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91ebfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f91ec0a4ee0 0x7f91ec0b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40754/0 (socket says 172.21.15.57:40754) 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f0cd0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55494/0 (socket says 172.21.15.57:55494) 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 -- 172.21.15.57:0/1962768053 learned_addr learned my addr 172.21.15.57:0/1962768053 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 -- 172.21.15.57:0/1962768053 >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 msgr2=0x7f91ec0a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 --2- 172.21.15.57:0/1962768053 >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 -- 172.21.15.57:0/1962768053 >> v1:172.21.15.57:6789/0 conn(0x7f91ec0a4ee0 legacy=0x7f91ec0b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 -- 172.21.15.57:0/1962768053 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0694c0 con 0x7f91ec146600 2024-03-18T14:46:58.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f0cd0700 1 --2- 172.21.15.57:0/1962768053 >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91eb7fe700 1 -- 172.21.15.57:0/1962768053 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846176297 0 0) 0x7f91ec069e80 con 0x7f91ec0a4ee0 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91f14d1700 1 --2- 172.21.15.57:0/1962768053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009f20 tx=0x7f91e4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8d06f75554cc75a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91eb7fe700 1 -- 172.21.15.57:0/1962768053 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400e070 con 0x7f91ec146600 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91eb7fe700 1 -- 172.21.15.57:0/1962768053 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400b9d0 con 0x7f91ec146600 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.767+0000 7f91eb7fe700 1 -- 172.21.15.57:0/1962768053 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e40092e0 con 0x7f91ec146600 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 -- 172.21.15.57:0/1962768053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 msgr2=0x7f91ec1489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 --2- 172.21.15.57:0/1962768053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009f20 tx=0x7f91e4009840 comp rx=0 tx=0).stop 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 -- 172.21.15.57:0/1962768053 shutdown_connections 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 --2- 172.21.15.57:0/1962768053 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec146600 0x7f91ec1489e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 --2- 172.21.15.57:0/1962768053 >> v2:172.21.15.57:3300/0 conn(0x7f91ec06a860 0x7f91ec0a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 -- 172.21.15.57:0/1962768053 >> 172.21.15.57:0/1962768053 conn(0x7f91ec06e250 msgr2=0x7f91ec06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 -- 172.21.15.57:0/1962768053 shutdown_connections 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.768+0000 7f91f2f34700 1 -- 172.21.15.57:0/1962768053 wait complete. 2024-03-18T14:46:58.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 Processor -- start 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 -- start start 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91ec0a4ee0 0x7f91ec09af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f91ec146600 0x7f91ec096a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec09b6f0 con 0x7f91ec0a4ee0 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0ae9a0 con 0x7f91ec06a860 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.769+0000 7f91f2f34700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91ec0985e0 con 0x7f91ec146600 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42162/0 (socket says 172.21.15.57:42162) 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 -- 172.21.15.57:0/3275191388 learned_addr learned my addr 172.21.15.57:0/3275191388 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:58.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f14d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f91ec146600 0x7f91ec096a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91ebfff700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91ec0a4ee0 0x7f91ec09af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 -- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f91ec146600 msgr2=0x7f91ec096a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f91ec146600 0x7f91ec096a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 -- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91ec0a4ee0 msgr2=0x7f91ec09af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91ec0a4ee0 0x7f91ec09af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 -- 172.21.15.57:0/3275191388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0009420 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f0cd0700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91e000ec80 tx=0x7f91e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000c920 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000ca80 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e4009ae0 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000ce00 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.770+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ec0aeeb0 con 0x7f91ec06a860 2024-03-18T14:46:58.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.771+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ec0aec80 con 0x7f91ec06a860 2024-03-18T14:46:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.772+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f91e0013680 con 0x7f91ec06a860 2024-03-18T14:46:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.772+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f91e005bc40 con 0x7f91ec06a860 2024-03-18T14:46:58.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.775+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f91e003a0c0 con 0x7f91ec06a860 2024-03-18T14:46:58.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.934+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91ec065180 con 0x7f91ec06a860 2024-03-18T14:46:58.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.935+0000 7f91e8ff9700 1 -- 172.21.15.57:0/3275191388 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91e003d6e0 con 0x7f91ec06a860 2024-03-18T14:46:58.935 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:46:58.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.936+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 >> v1:172.21.15.57:6816/47480 conn(0x7f91d0046000 legacy=0x7f91d00484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.936+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 msgr2=0x7f91ec0980a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:58.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.936+0000 7f91f2f34700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f91e000ec80 tx=0x7f91e00091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 shutdown_connections 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f91ec146600 0x7f91ec096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f91ec06a860 0x7f91ec0980a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 --2- 172.21.15.57:0/3275191388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f91ec0a4ee0 0x7f91ec09af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 >> 172.21.15.57:0/3275191388 conn(0x7f91ec06e250 msgr2=0x7f91ec0b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 shutdown_connections 2024-03-18T14:46:58.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:58.937+0000 7f91f2f34700 1 -- 172.21.15.57:0/3275191388 wait complete. 2024-03-18T14:46:58.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.072+0000 7eff31aa6700 1 Processor -- start 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.072+0000 7eff31aa6700 1 -- start start 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff31aa6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff31aa6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff2c0a4730 0x7eff2c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff31aa6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06fd10 con 0x7eff2c06ea90 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff31aa6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c0b07e0 con 0x7eff2c0a4730 2024-03-18T14:46:59.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff31aa6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0697a0 con 0x7eff2c068340 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff2c0a4730 0x7eff2c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7eff2c06ea90 0x7eff2c06ef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40756/0 (socket says 172.21.15.57:40756) 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff2c0a4730 0x7eff2c06a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55510/0 (socket says 172.21.15.57:55510) 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42174/0 (socket says 172.21.15.57:42174) 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2bfff700 1 -- 172.21.15.57:0/4100055213 learned_addr learned my addr 172.21.15.57:0/4100055213 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 -- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 msgr2=0x7eff2c0a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 -- 172.21.15.57:0/4100055213 >> v1:172.21.15.57:6789/0 conn(0x7eff2c06ea90 legacy=0x7eff2c06ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 -- 172.21.15.57:0/4100055213 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c069a40 con 0x7eff2c0a4730 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2a7fc700 1 -- 172.21.15.57:0/4100055213 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334432070 0 0) 0x7eff2c06fd10 con 0x7eff2c06ea90 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2b7fe700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.073+0000 7eff2affd700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c0a4730 0x7eff2c06a0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0098e0 tx=0x7eff1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3857017dceeaa583 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff2a7fc700 1 -- 172.21.15.57:0/4100055213 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00b640 con 0x7eff2c0a4730 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff2a7fc700 1 -- 172.21.15.57:0/4100055213 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b7a0 con 0x7eff2c0a4730 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff2a7fc700 1 -- 172.21.15.57:0/4100055213 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00bb40 con 0x7eff2c0a4730 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 -- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c0a4730 msgr2=0x7eff2c06a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c0a4730 0x7eff2c06a0c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0098e0 tx=0x7eff1c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 -- 172.21.15.57:0/4100055213 shutdown_connections 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c068340 0x7eff2c0a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 --2- 172.21.15.57:0/4100055213 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c0a4730 0x7eff2c06a0c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 -- 172.21.15.57:0/4100055213 >> 172.21.15.57:0/4100055213 conn(0x7eff2c06be90 msgr2=0x7eff2c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 -- 172.21.15.57:0/4100055213 shutdown_connections 2024-03-18T14:46:59.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.074+0000 7eff31aa6700 1 -- 172.21.15.57:0/4100055213 wait complete. 2024-03-18T14:46:59.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.075+0000 7eff31aa6700 1 Processor -- start 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.075+0000 7eff31aa6700 1 -- start start 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 0x7eff2c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 0x7eff2c1400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0992e0 con 0x7eff2c068340 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0990c0 con 0x7eff2c0a4730 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff31aa6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c097010 con 0x7eff2c06ea90 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55514/0 (socket says 172.21.15.57:55514) 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 0x7eff2c1400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 -- 172.21.15.57:0/1460798625 learned_addr learned my addr 172.21.15.57:0/1460798625 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:59.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2affd700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 0x7eff2c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 -- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 msgr2=0x7eff2c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 0x7eff2c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 -- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 msgr2=0x7eff2c1400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 0x7eff2c1400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 -- 172.21.15.57:0/1460798625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff20009420 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2affd700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 0x7eff2c13fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2bfff700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 0x7eff2c1400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.076+0000 7eff2b7fe700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ec80 tx=0x7eff200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.077+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000c850 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.077+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000c9b0 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.077+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c009420 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.077+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000cd30 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.077+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0995b0 con 0x7eff2c068340 2024-03-18T14:46:59.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.078+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7eff20013680 con 0x7eff2c068340 2024-03-18T14:46:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.078+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c065180 con 0x7eff2c068340 2024-03-18T14:46:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.078+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7eff2005b230 con 0x7eff2c068340 2024-03-18T14:46:59.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.082+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7eff20039560 con 0x7eff2c068340 2024-03-18T14:46:59.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.243+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff2c0a4510 con 0x7eff2c068340 2024-03-18T14:46:59.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.244+0000 7eff137fe700 1 -- 172.21.15.57:0/1460798625 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff20021020 con 0x7eff2c068340 2024-03-18T14:46:59.244 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 >> v1:172.21.15.57:6816/47480 conn(0x7eff18045f80 legacy=0x7eff18048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 msgr2=0x7eff2c13f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7eff2000ec80 tx=0x7eff200091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 shutdown_connections 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7eff2c0a4730 0x7eff2c1400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff2c068340 0x7eff2c13f640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 --2- 172.21.15.57:0/1460798625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7eff2c06ea90 0x7eff2c13fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 >> 172.21.15.57:0/1460798625 conn(0x7eff2c06be90 msgr2=0x7eff2c0b2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 shutdown_connections 2024-03-18T14:46:59.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.245+0000 7eff31aa6700 1 -- 172.21.15.57:0/1460798625 wait complete. 2024-03-18T14:46:59.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:46:59.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.378+0000 7fc4b8e06700 1 Processor -- start 2024-03-18T14:46:59.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.378+0000 7fc4b8e06700 1 -- start start 2024-03-18T14:46:59.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b40a77d0 con 0x7fc4b40b3550 2024-03-18T14:46:59.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b413fc50 con 0x7fc4b40b0050 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b8e06700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b413fef0 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b1d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b259c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55524/0 (socket says 172.21.15.57:55524) 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b1d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50656/0 (socket says 172.21.15.57:50656) 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b259c700 1 -- 172.21.15.57:0/3903879942 learned_addr learned my addr 172.21.15.57:0/3903879942 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 -- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 msgr2=0x7fc4b40afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 --2- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40afb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 -- 172.21.15.57:0/3903879942 >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 msgr2=0x7fc4b40a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 --2- 172.21.15.57:0/3903879942 >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b2d9d700 1 -- 172.21.15.57:0/3903879942 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40a5980 con 0x7fc4b40b0050 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.379+0000 7fc4b259c700 1 --2- 172.21.15.57:0/3903879942 >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b2d9d700 1 --2- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b406eb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009e60 tx=0x7fc4ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556cca18dcde9473 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b159a700 1 -- 172.21.15.57:0/3903879942 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00e070 con 0x7fc4b40b0050 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b159a700 1 -- 172.21.15.57:0/3903879942 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac00bab0 con 0x7fc4b40b0050 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b159a700 1 -- 172.21.15.57:0/3903879942 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac00be70 con 0x7fc4b40b0050 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 -- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 msgr2=0x7fc4b406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b406eb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009e60 tx=0x7fc4ac009780 comp rx=0 tx=0).stop 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 -- 172.21.15.57:0/3903879942 shutdown_connections 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b406eb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/3903879942 >> v2:172.21.15.57:3300/0 conn(0x7fc4b40b3550 0x7fc4b40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/3903879942 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40afb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 -- 172.21.15.57:0/3903879942 >> 172.21.15.57:0/3903879942 conn(0x7fc4b406e2c0 msgr2=0x7fc4b406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 -- 172.21.15.57:0/3903879942 shutdown_connections 2024-03-18T14:46:59.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.380+0000 7fc4b8e06700 1 -- 172.21.15.57:0/3903879942 wait complete. 2024-03-18T14:46:59.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.381+0000 7fc4b8e06700 1 Processor -- start 2024-03-18T14:46:59.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.381+0000 7fc4b8e06700 1 -- start start 2024-03-18T14:46:59.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b40b3550 0x7fc4b414e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b40af6a0 con 0x7fc4b40b3550 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b4151670 con 0x7fc4b40b0050 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b8e06700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b406a920 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b2d9d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b40b3550 0x7fc4b414e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50672/0 (socket says 172.21.15.57:50672) 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 -- 172.21.15.57:0/2354501884 learned_addr learned my addr 172.21.15.57:0/2354501884 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 -- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 msgr2=0x7fc4b4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 -- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b40b3550 msgr2=0x7fc4b414e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b40b3550 0x7fc4b414e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b259c700 1 -- 172.21.15.57:0/2354501884 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a40094f0 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.382+0000 7fc4b1d9b700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4b259c700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ec50 tx=0x7fc4a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400c850 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400c9b0 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac009a20 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400cd30 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.383+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b4152230 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.384+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b4065180 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.384+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fc4a4013680 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.384+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc4a405b270 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.388+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc4a4039600 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.578+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4b40af900 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.579+0000 7fc4aa7fc700 1 -- 172.21.15.57:0/2354501884 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3659 (secure 0 0 0) 0x7fc4a403cdf0 con 0x7fc4b40a4cb0 2024-03-18T14:46:59.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:59.580 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4935,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6818/2627465465","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":2627465465}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:45:40.147227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 >> v1:172.21.15.57:6816/47480 conn(0x7fc494045f80 legacy=0x7fc494048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 msgr2=0x7fc4b40adc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ec50 tx=0x7fc4a4009250 comp rx=0 tx=0).stop 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 shutdown_connections 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4b40b3550 0x7fc4b414e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc4b40a4cb0 0x7fc4b40adc60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 --2- 172.21.15.57:0/2354501884 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc4b40b0050 0x7fc4b4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.580+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 >> 172.21.15.57:0/2354501884 conn(0x7fc4b406e2c0 msgr2=0x7fc4b406eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.581+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 shutdown_connections 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.581+0000 7fc4b8e06700 1 -- 172.21.15.57:0/2354501884 wait complete. 2024-03-18T14:46:59.582 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2024-03-18T14:46:59.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.713+0000 7f218289c700 1 Processor -- start 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.713+0000 7f218289c700 1 -- start start 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f218289c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 0x7f217c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f218289c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c13d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f218289c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217c0a4ce0 con 0x7f217c13dea0 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f218289c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0a3ad0 con 0x7f217c0a1d30 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f218289c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f217c0a7230 con 0x7f217c0b56e0 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 0x7f217c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f2180e39700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f217c13dea0 0x7f217c0a5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40770/0 (socket says 172.21.15.57:40770) 2024-03-18T14:46:59.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f2180e39700 1 -- 172.21.15.57:0/785502997 learned_addr learned my addr 172.21.15.57:0/785502997 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c13d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217affd700 1 -- 172.21.15.57:0/785502997 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 508714725 0 0) 0x7f217c0a4ce0 con 0x7f217c13dea0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 -- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 msgr2=0x7f217c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c13d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 -- 172.21.15.57:0/785502997 >> v1:172.21.15.57:6789/0 conn(0x7f217c13dea0 legacy=0x7f217c0a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 -- 172.21.15.57:0/785502997 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217c0a3230 con 0x7f217c0b56e0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217b7fe700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217bfff700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 0x7f217c0a4600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f216c009910 tx=0x7f216c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b9c159bfa2dc320 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217affd700 1 -- 172.21.15.57:0/785502997 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00b680 con 0x7f217c0b56e0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217affd700 1 -- 172.21.15.57:0/785502997 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00b7e0 con 0x7f217c0b56e0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.714+0000 7f217affd700 1 -- 172.21.15.57:0/785502997 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00bba0 con 0x7f217c0b56e0 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 -- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 msgr2=0x7f217c0a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 0x7f217c0a4600 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f216c009910 tx=0x7f216c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 -- 172.21.15.57:0/785502997 shutdown_connections 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c0b56e0 0x7f217c0a4600 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 --2- 172.21.15.57:0/785502997 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c13d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 -- 172.21.15.57:0/785502997 >> 172.21.15.57:0/785502997 conn(0x7f217c06fb90 msgr2=0x7f217c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 -- 172.21.15.57:0/785502997 shutdown_connections 2024-03-18T14:46:59.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.715+0000 7f218289c700 1 -- 172.21.15.57:0/785502997 wait complete. 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.716+0000 7f218289c700 1 Processor -- start 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.716+0000 7f218289c700 1 -- start start 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 0x7f217c141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 0x7f217c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c139080 con 0x7f217c0b56e0 2024-03-18T14:46:59.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217c141c90 con 0x7f217c0a1d30 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f217c136740 con 0x7f217c13dea0 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f2180e39700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 0x7f217c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 0x7f217c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42220/0 (socket says 172.21.15.57:42220) 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 -- 172.21.15.57:0/2862383791 learned_addr learned my addr 172.21.15.57:0/2862383791 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 -- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 msgr2=0x7f217c1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 0x7f217c1517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 -- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 msgr2=0x7f217c141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 0x7f217c141540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 -- 172.21.15.57:0/2862383791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2170009420 con 0x7f217c0a1d30 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217b7fe700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 0x7f217c141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f2180e39700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 0x7f217c1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f217bfff700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f217c0a7370 tx=0x7f216c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00b950 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00baf0 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c009420 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c01a680 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.717+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c140de0 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.718+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c139360 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.719+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f216c01aa70 con 0x7f217c0a1d30 2024-03-18T14:46:59.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.719+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f216c05cc30 con 0x7f217c0a1d30 2024-03-18T14:46:59.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.723+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f216c001d20 con 0x7f217c0a1d30 2024-03-18T14:46:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.887+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f217c065180 con 0x7f217c0a1d30 2024-03-18T14:46:59.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.887+0000 7f2163fff700 1 -- 172.21.15.57:0/2862383791 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7f216c015030 con 0x7f217c0a1d30 2024-03-18T14:46:59.888 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:46:59.888 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:46:57.541889+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:46:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 >> v1:172.21.15.57:6816/47480 conn(0x7f2168045f80 legacy=0x7f2168048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 msgr2=0x7f217c1404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f217c0a7370 tx=0x7f216c017000 comp rx=0 tx=0).stop 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 shutdown_connections 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f217c13dea0 0x7f217c1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f217c0a1d30 0x7f217c1404f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 --2- 172.21.15.57:0/2862383791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f217c0b56e0 0x7f217c141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 >> 172.21.15.57:0/2862383791 conn(0x7f217c06fb90 msgr2=0x7f217c0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 shutdown_connections 2024-03-18T14:46:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:46:59.889+0000 7f218289c700 1 -- 172.21.15.57:0/2862383791 wait complete. 2024-03-18T14:46:59.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:46:59.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.025+0000 7fcbb5559700 1 Processor -- start 2024-03-18T14:47:00.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 -- start start 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcbb013e340 0x7fcbb00a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00b5b50 con 0x7fcbb00b5780 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00a4590 con 0x7fcbb013e340 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbb5559700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00a1d50 con 0x7fcbb00a7590 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbaf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbaf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50696/0 (socket says 172.21.15.57:50696) 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbaf7fe700 1 -- 172.21.15.57:0/89244697 learned_addr learned my addr 172.21.15.57:0/89244697 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.026+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/89244697 >> v2:172.21.15.57:3300/0 conn(0x7fcbb013e340 0x7fcbb00a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbae7fc700 1 -- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 msgr2=0x7fcbb0148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbae7fc700 1 -- 172.21.15.57:0/89244697 >> v1:172.21.15.57:6789/0 conn(0x7fcbb00b5780 legacy=0x7fcbb013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbae7fc700 1 -- 172.21.15.57:0/89244697 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00a2010 con 0x7fcbb013e340 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbadffb700 1 -- 172.21.15.57:0/89244697 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903855824 0 0) 0x7fcbb00b5b50 con 0x7fcbb00b5780 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbaf7fe700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb013e340 0x7fcbb00a4050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb980098e0 tx=0x7fcb980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ead8af56c841ab server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbadffb700 1 -- 172.21.15.57:0/89244697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800b640 con 0x7fcbb013e340 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbadffb700 1 -- 172.21.15.57:0/89244697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800b7a0 con 0x7fcbb013e340 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbadffb700 1 -- 172.21.15.57:0/89244697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800bb40 con 0x7fcbb013e340 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbb5559700 1 -- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb013e340 msgr2=0x7fcbb00a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.027+0000 7fcbb5559700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb013e340 0x7fcbb00a4050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb980098e0 tx=0x7fcb980091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 -- 172.21.15.57:0/89244697 shutdown_connections 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb00a7590 0x7fcbb0148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 --2- 172.21.15.57:0/89244697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb013e340 0x7fcbb00a4050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 -- 172.21.15.57:0/89244697 >> 172.21.15.57:0/89244697 conn(0x7fcbb006fb90 msgr2=0x7fcbb00b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 -- 172.21.15.57:0/89244697 shutdown_connections 2024-03-18T14:47:00.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.028+0000 7fcbb5559700 1 -- 172.21.15.57:0/89244697 wait complete. 2024-03-18T14:47:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 Processor -- start 2024-03-18T14:47:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 -- start start 2024-03-18T14:47:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 0x7fcbb00acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb0141f80 0x7fcbb00a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ac8c0 con 0x7fcbb00b5780 2024-03-18T14:47:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00aa840 con 0x7fcbb00a7590 2024-03-18T14:47:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbb5559700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00aaae0 con 0x7fcbb0141f80 2024-03-18T14:47:00.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbae7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbaeffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 0x7fcbb00acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbae7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55546/0 (socket says 172.21.15.57:55546) 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbae7fc700 1 -- 172.21.15.57:0/1067838791 learned_addr learned my addr 172.21.15.57:0/1067838791 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.029+0000 7fcbaf7fe700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb0141f80 0x7fcbb00a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 -- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb0141f80 msgr2=0x7fcbb00a8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb0141f80 0x7fcbb00a8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 -- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 msgr2=0x7fcbb00acee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 0x7fcbb00acee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 -- 172.21.15.57:0/1067838791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8009ae0 con 0x7fcbb00b5780 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbaeffd700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 0x7fcbb00acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbae7fc700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00b5ce0 tx=0x7fcb98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800bb20 con 0x7fcbb00b5780 2024-03-18T14:47:00.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb98000c90 con 0x7fcbb00b5780 2024-03-18T14:47:00.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98011650 con 0x7fcbb00b5780 2024-03-18T14:47:00.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb98009420 con 0x7fcbb00b5780 2024-03-18T14:47:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.030+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb00a9a20 con 0x7fcbb00b5780 2024-03-18T14:47:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.031+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb0065180 con 0x7fcbb00b5780 2024-03-18T14:47:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.031+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7fcb98011a00 con 0x7fcbb00b5780 2024-03-18T14:47:00.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.031+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fcb9805c4c0 con 0x7fcbb00b5780 2024-03-18T14:47:00.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.035+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fcb9803e450 con 0x7fcbb00b5780 2024-03-18T14:47:00.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.196+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbb00a47b0 con 0x7fcbb00b5780 2024-03-18T14:47:00.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.197+0000 7fcba6ffd700 1 -- 172.21.15.57:0/1067838791 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb980290a0 con 0x7fcbb00b5780 2024-03-18T14:47:00.198 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:00.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 >> v1:172.21.15.57:6816/47480 conn(0x7fcb90045fb0 legacy=0x7fcb90048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 msgr2=0x7fcbb00a8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcbb00b5ce0 tx=0x7fcb98017000 comp rx=0 tx=0).stop 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 shutdown_connections 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcbb0141f80 0x7fcbb00a8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcbb00a7590 0x7fcbb00acee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 --2- 172.21.15.57:0/1067838791 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcbb00b5780 0x7fcbb00a8870 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.198+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 >> 172.21.15.57:0/1067838791 conn(0x7fcbb006fb90 msgr2=0x7fcbb013da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.199+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 shutdown_connections 2024-03-18T14:47:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.199+0000 7fcbb5559700 1 -- 172.21.15.57:0/1067838791 wait complete. 2024-03-18T14:47:00.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.333+0000 7f185f635700 1 Processor -- start 2024-03-18T14:47:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 -- start start 2024-03-18T14:47:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18580a70f0 0x7f185813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18580a5590 con 0x7f18581401c0 2024-03-18T14:47:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185813f710 con 0x7f18580a70f0 2024-03-18T14:47:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185f635700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185813f9d0 con 0x7f18580680f0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185d3d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185cbd0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18580a70f0 0x7f185813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185d3d1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42236/0 (socket says 172.21.15.57:42236) 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185d3d1700 1 -- 172.21.15.57:0/2835552853 learned_addr learned my addr 172.21.15.57:0/2835552853 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.334+0000 7f185dbd2700 1 --1- 172.21.15.57:0/2835552853 >> v1:172.21.15.57:6789/0 conn(0x7f18581401c0 0x7f185806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40794/0 (socket says 172.21.15.57:40794) 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185cbd0700 1 -- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 msgr2=0x7f18580a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185cbd0700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185cbd0700 1 -- 172.21.15.57:0/2835552853 >> v1:172.21.15.57:6789/0 conn(0x7f18581401c0 legacy=0x7f185806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185cbd0700 1 -- 172.21.15.57:0/2835552853 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18580a4f50 con 0x7f18580a70f0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f184bfff700 1 -- 172.21.15.57:0/2835552853 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516183998 0 0) 0x7f18580a5590 con 0x7f18581401c0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185d3d1700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185cbd0700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18580a70f0 0x7f185813fc80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f185400dd10 tx=0x7f185400d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be0de5600c79b4a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f184bfff700 1 -- 172.21.15.57:0/2835552853 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854012070 con 0x7f18580a70f0 2024-03-18T14:47:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f184bfff700 1 -- 172.21.15.57:0/2835552853 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400de70 con 0x7f18580a70f0 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f184bfff700 1 -- 172.21.15.57:0/2835552853 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400fb60 con 0x7f18580a70f0 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 -- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18580a70f0 msgr2=0x7f185813fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18580a70f0 0x7f185813fc80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f185400dd10 tx=0x7f185400d630 comp rx=0 tx=0).stop 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 -- 172.21.15.57:0/2835552853 shutdown_connections 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580680f0 0x7f18580a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 --2- 172.21.15.57:0/2835552853 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18580a70f0 0x7f185813fc80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.335+0000 7f185f635700 1 -- 172.21.15.57:0/2835552853 >> 172.21.15.57:0/2835552853 conn(0x7f185806be90 msgr2=0x7f18580679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.336+0000 7f185f635700 1 -- 172.21.15.57:0/2835552853 shutdown_connections 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.336+0000 7f185f635700 1 -- 172.21.15.57:0/2835552853 wait complete. 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 Processor -- start 2024-03-18T14:47:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 -- start start 2024-03-18T14:47:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 0x7f185813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 0x7f185814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185813ce60 con 0x7f18581401c0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185813c9b0 con 0x7f18580a70f0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185f635700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18580a8000 con 0x7f18580680f0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185cbd0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185dbd2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 0x7f185814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185d3d1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 0x7f185813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185cbd0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42250/0 (socket says 172.21.15.57:42250) 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.337+0000 7f185cbd0700 1 -- 172.21.15.57:0/3919790571 learned_addr learned my addr 172.21.15.57:0/3919790571 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 -- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 msgr2=0x7f185813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 0x7f185813c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 -- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 msgr2=0x7f185814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 0x7f185814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 -- 172.21.15.57:0/3919790571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184c0094f0 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185d3d1700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 0x7f185813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185dbd2700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 0x7f185814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185cbd0700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1854016000 tx=0x7f185401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400c840 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400c9a0 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185400d8d0 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400cd60 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.338+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18580a8e30 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.339+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18580b2120 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.340+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 9) v1 ==== 53536+0+0 (secure 0 0 0) 0x7f1854020650 con 0x7f18580a70f0 2024-03-18T14:47:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.340+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f18540609c0 con 0x7f18580a70f0 2024-03-18T14:47:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.344+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1854006870 con 0x7f18580a70f0 2024-03-18T14:47:00.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.415+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1854029800 con 0x7f18580a70f0 2024-03-18T14:47:00.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.508+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f185806c260 con 0x7f18580a70f0 2024-03-18T14:47:00.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.509+0000 7f18497fa700 1 -- 172.21.15.57:0/3919790571 <== mon.1 v2:172.21.15.57:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f185405dd80 con 0x7f18580a70f0 2024-03-18T14:47:00.510 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:00.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 >> v1:172.21.15.57:6816/47480 conn(0x7f183c045f80 legacy=0x7f183c048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 msgr2=0x7f185814da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1854016000 tx=0x7f185401c000 comp rx=0 tx=0).stop 2024-03-18T14:47:00.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 shutdown_connections 2024-03-18T14:47:00.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18581401c0 0x7f185814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f18580680f0 0x7f185813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 --2- 172.21.15.57:0/3919790571 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f18580a70f0 0x7f185814da70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 >> 172.21.15.57:0/3919790571 conn(0x7f185806be90 msgr2=0x7f18580b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 shutdown_connections 2024-03-18T14:47:00.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.510+0000 7f185f635700 1 -- 172.21.15.57:0/3919790571 wait complete. 2024-03-18T14:47:00.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:00.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 Processor -- start 2024-03-18T14:47:00.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 -- start start 2024-03-18T14:47:00.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ad8069200 0x7f0ad80679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 0x7f0ad8067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ad80a4b40 con 0x7f0ad80a32d0 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ad80a2b60 con 0x7f0ad8069200 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ade52d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad806e630 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ad7fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ad8069200 0x7f0ad80679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0ad77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 0x7f0ad8067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0adcaca700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0ad80a32d0 0x7f0ad8148500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40808/0 (socket says 172.21.15.57:40808) 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.647+0000 7f0adcaca700 1 -- 172.21.15.57:0/984762365 learned_addr learned my addr 172.21.15.57:0/984762365 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad77fe700 1 -- 172.21.15.57:0/984762365 >> v2:172.21.15.57:3300/0 conn(0x7f0ad8069200 msgr2=0x7f0ad80679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad77fe700 1 --2- 172.21.15.57:0/984762365 >> v2:172.21.15.57:3300/0 conn(0x7f0ad8069200 0x7f0ad80679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad77fe700 1 -- 172.21.15.57:0/984762365 >> v1:172.21.15.57:6789/0 conn(0x7f0ad80a32d0 legacy=0x7f0ad8148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad77fe700 1 -- 172.21.15.57:0/984762365 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad80a38a0 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad77fe700 1 --2- 172.21.15.57:0/984762365 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 0x7f0ad8067f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0098e0 tx=0x7f0acc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c4bae9e483ca887 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad6ffd700 1 -- 172.21.15.57:0/984762365 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00b640 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad6ffd700 1 -- 172.21.15.57:0/984762365 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc00b7a0 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ad6ffd700 1 -- 172.21.15.57:0/984762365 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00bb40 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ade52d700 1 -- 172.21.15.57:0/984762365 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 msgr2=0x7f0ad8067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.648+0000 7f0ade52d700 1 --2- 172.21.15.57:0/984762365 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 0x7f0ad8067f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0acc0098e0 tx=0x7f0acc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 -- 172.21.15.57:0/984762365 shutdown_connections 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 --2- 172.21.15.57:0/984762365 >> v2:172.21.15.57:3300/0 conn(0x7f0ad8069200 0x7f0ad80679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 --2- 172.21.15.57:0/984762365 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a3ee0 0x7f0ad8067f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 -- 172.21.15.57:0/984762365 >> 172.21.15.57:0/984762365 conn(0x7f0ad806abe0 msgr2=0x7f0ad8068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 -- 172.21.15.57:0/984762365 shutdown_connections 2024-03-18T14:47:00.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 -- 172.21.15.57:0/984762365 wait complete. 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.649+0000 7f0ade52d700 1 Processor -- start 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 -- start start 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ad80a3ee0 0x7f0ad813edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad80ada60 con 0x7f0ad8069200 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad813f300 con 0x7f0ad80a32d0 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ade52d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad8097c60 con 0x7f0ad80a3ee0 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ad7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ad77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ad7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55584/0 (socket says 172.21.15.57:55584) 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ad7fff700 1 -- 172.21.15.57:0/3248913847 learned_addr learned my addr 172.21.15.57:0/3248913847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0ad77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42276/0 (socket says 172.21.15.57:42276) 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.650+0000 7f0adcaca700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ad80a3ee0 0x7f0ad813edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 -- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ad80a3ee0 msgr2=0x7f0ad813edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ad80a3ee0 0x7f0ad813edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 -- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 msgr2=0x7f0ad80ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 -- 172.21.15.57:0/3248913847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009420 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad7fff700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ad77fe700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0acc016000 tx=0x7f0acc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc01bc40 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc01bde0 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc011670 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad80ad7c0 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.651+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad80ac540 con 0x7f0ad80a32d0 2024-03-18T14:47:00.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.652+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad8068fc0 con 0x7f0ad80a32d0 2024-03-18T14:47:00.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.652+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0acc0119e0 con 0x7f0ad80a32d0 2024-03-18T14:47:00.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.653+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f0acc05c560 con 0x7f0ad80a32d0 2024-03-18T14:47:00.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.656+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0acc011c90 con 0x7f0ad80a32d0 2024-03-18T14:47:00.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.817+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ad8065180 con 0x7f0ad80a32d0 2024-03-18T14:47:00.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.817+0000 7f0abffff700 1 -- 172.21.15.57:0/3248913847 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0acc011c90 con 0x7f0ad80a32d0 2024-03-18T14:47:00.818 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:00.819 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 >> v1:172.21.15.57:6816/47480 conn(0x7f0ac4046010 legacy=0x7f0ac40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 msgr2=0x7f0ad813e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0acc016000 tx=0x7f0acc017000 comp rx=0 tx=0).stop 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 shutdown_connections 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ad80a3ee0 0x7f0ad813edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ad8069200 0x7f0ad80ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 --2- 172.21.15.57:0/3248913847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ad80a32d0 0x7f0ad813e880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 >> 172.21.15.57:0/3248913847 conn(0x7f0ad806abe0 msgr2=0x7f0ad8068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 shutdown_connections 2024-03-18T14:47:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.819+0000 7f0ade52d700 1 -- 172.21.15.57:0/3248913847 wait complete. 2024-03-18T14:47:00.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:00.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 Processor -- start 2024-03-18T14:47:00.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 -- start start 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 0x7efcbc06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 0x7efcbc148a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcbc06fd10 con 0x7efcbc068340 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0b07e0 con 0x7efcbc0a4730 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.954+0000 7efcc23f5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc0697a0 con 0x7efcbc146690 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 0x7efcbc06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcc0992700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 0x7efcbc148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efcbc068340 0x7efcbc0a3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40816/0 (socket says 172.21.15.57:40816) 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbbfff700 1 -- 172.21.15.57:0/1631763663 learned_addr learned my addr 172.21.15.57:0/1631763663 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbaffd700 1 -- 172.21.15.57:0/1631763663 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917121784 0 0) 0x7efcbc06fd10 con 0x7efcbc068340 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 -- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 msgr2=0x7efcbc148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 0x7efcbc148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 -- 172.21.15.57:0/1631763663 >> v1:172.21.15.57:6789/0 conn(0x7efcbc068340 legacy=0x7efcbc0a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 -- 172.21.15.57:0/1631763663 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc069a40 con 0x7efcbc0a4730 2024-03-18T14:47:00.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcc0992700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 0x7efcbc148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbb7fe700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 0x7efcbc06a0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009910 tx=0x7efcb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e509ccb4b89946bf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbaffd700 1 -- 172.21.15.57:0/1631763663 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000b680 con 0x7efcbc0a4730 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbaffd700 1 -- 172.21.15.57:0/1631763663 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb000b7e0 con 0x7efcbc0a4730 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.955+0000 7efcbaffd700 1 -- 172.21.15.57:0/1631763663 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000bba0 con 0x7efcbc0a4730 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 -- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 msgr2=0x7efcbc06a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 0x7efcbc06a0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009910 tx=0x7efcb00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 -- 172.21.15.57:0/1631763663 shutdown_connections 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc146690 0x7efcbc148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 --2- 172.21.15.57:0/1631763663 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc0a4730 0x7efcbc06a0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 -- 172.21.15.57:0/1631763663 >> 172.21.15.57:0/1631763663 conn(0x7efcbc06be90 msgr2=0x7efcbc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 -- 172.21.15.57:0/1631763663 shutdown_connections 2024-03-18T14:47:00.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.956+0000 7efcc23f5700 1 -- 172.21.15.57:0/1631763663 wait complete. 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 Processor -- start 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 -- start start 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 0x7efcbc0997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 0x7efcbc0ae380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc14e620 con 0x7efcbc068340 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc14e8e0 con 0x7efcbc146690 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.957+0000 7efcc23f5700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcbc099d30 con 0x7efcbc0a4730 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 0x7efcbc0ae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbbfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55598/0 (socket says 172.21.15.57:55598) 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbbfff700 1 -- 172.21.15.57:0/2277291860 learned_addr learned my addr 172.21.15.57:0/2277291860 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbb7fe700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 0x7efcbc0997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 -- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 msgr2=0x7efcbc0997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 0x7efcbc0997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 -- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 msgr2=0x7efcbc1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 -- 172.21.15.57:0/2277291860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4009a20 con 0x7efcbc146690 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbb7fe700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 0x7efcbc0997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcbbfff700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc0992700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 0x7efcbc0ae380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e70 tx=0x7efcb400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb400cb30 con 0x7efcbc146690 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb400f040 con 0x7efcbc146690 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4014480 con 0x7efcbc146690 2024-03-18T14:47:00.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb0009420 con 0x7efcbc146690 2024-03-18T14:47:00.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.958+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcbc0af100 con 0x7efcbc146690 2024-03-18T14:47:00.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.959+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcbc065180 con 0x7efcbc146690 2024-03-18T14:47:00.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.959+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7efcb4003020 con 0x7efcbc146690 2024-03-18T14:47:00.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.960+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7efcb405ba50 con 0x7efcbc146690 2024-03-18T14:47:00.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:00.963+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7efcb4039d60 con 0x7efcbc146690 2024-03-18T14:47:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.122+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efcbc0af680 con 0x7efcbc146690 2024-03-18T14:47:01.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.122+0000 7efca3fff700 1 -- 172.21.15.57:0/2277291860 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7efcb4018070 con 0x7efcbc146690 2024-03-18T14:47:01.123 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 >> v1:172.21.15.57:6816/47480 conn(0x7efca8046040 legacy=0x7efca80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 msgr2=0x7efcbc0ae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 0x7efcbc0ae380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efcb4009e70 tx=0x7efcb400b040 comp rx=0 tx=0).stop 2024-03-18T14:47:01.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 shutdown_connections 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efcbc146690 0x7efcbc0ae380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efcbc068340 0x7efcbc1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 --2- 172.21.15.57:0/2277291860 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efcbc0a4730 0x7efcbc0997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 >> 172.21.15.57:0/2277291860 conn(0x7efcbc06be90 msgr2=0x7efcbc0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 shutdown_connections 2024-03-18T14:47:01.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.124+0000 7efcc23f5700 1 -- 172.21.15.57:0/2277291860 wait complete. 2024-03-18T14:47:01.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:01.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.256+0000 7f37d0cbe700 1 Processor -- start 2024-03-18T14:47:01.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.256+0000 7f37d0cbe700 1 -- start start 2024-03-18T14:47:01.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37d0cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37d0cbe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37cc0a4050 0x7f37cc0a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37d0cbe700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37cc0a4580 con 0x7f37cc0a4d80 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37d0cbe700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc06c550 con 0x7f37cc0a4050 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37d0cbe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0696b0 con 0x7f37cc06a4a0 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37ca59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37cc0a4050 0x7f37cc0a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37ca59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42296/0 (socket says 172.21.15.57:42296) 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37cc0a4050 0x7f37cc0a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55600/0 (socket says 172.21.15.57:55600) 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37cad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f37cc0a4d80 0x7f37cc06eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40830/0 (socket says 172.21.15.57:40830) 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37ca59c700 1 -- 172.21.15.57:0/2783648346 learned_addr learned my addr 172.21.15.57:0/2783648346 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 -- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 msgr2=0x7f37cc0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 -- 172.21.15.57:0/2783648346 >> v1:172.21.15.57:6789/0 conn(0x7f37cc0a4d80 legacy=0x7f37cc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c9d9b700 1 -- 172.21.15.57:0/2783648346 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc069950 con 0x7f37cc0a4050 2024-03-18T14:47:01.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37c959a700 1 -- 172.21.15.57:0/2783648346 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841827046 0 0) 0x7f37cc0a4580 con 0x7f37cc0a4d80 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.257+0000 7f37ca59c700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37c9d9b700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc0a4050 0x7f37cc0a4840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0098e0 tx=0x7f37bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfca9851bc8521b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37c959a700 1 -- 172.21.15.57:0/2783648346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00b640 con 0x7f37cc0a4050 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37c959a700 1 -- 172.21.15.57:0/2783648346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc00b7a0 con 0x7f37cc0a4050 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37c959a700 1 -- 172.21.15.57:0/2783648346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00bb40 con 0x7f37cc0a4050 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 -- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc0a4050 msgr2=0x7f37cc0a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc0a4050 0x7f37cc0a4840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0098e0 tx=0x7f37bc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 -- 172.21.15.57:0/2783648346 shutdown_connections 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc06a4a0 0x7f37cc0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/2783648346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc0a4050 0x7f37cc0a4840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 -- 172.21.15.57:0/2783648346 >> 172.21.15.57:0/2783648346 conn(0x7f37cc06bfc0 msgr2=0x7f37cc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 -- 172.21.15.57:0/2783648346 shutdown_connections 2024-03-18T14:47:01.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.258+0000 7f37d0cbe700 1 -- 172.21.15.57:0/2783648346 wait complete. 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.260+0000 7f37d0cbe700 1 Processor -- start 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.260+0000 7f37d0cbe700 1 -- start start 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.260+0000 7f37d0cbe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 0x7f37cc1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 0x7f37cc151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc098a50 con 0x7f37cc06a4a0 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc099aa0 con 0x7f37cc0a4d80 2024-03-18T14:47:01.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0987b0 con 0x7f37cc0a4050 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55616/0 (socket says 172.21.15.57:55616) 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 -- 172.21.15.57:0/61784714 learned_addr learned my addr 172.21.15.57:0/61784714 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37cad9d700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 0x7f37cc151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37c9d9b700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 0x7f37cc1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 -- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 msgr2=0x7f37cc1513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 0x7f37cc1513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 -- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 msgr2=0x7f37cc151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 0x7f37cc151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 -- 172.21.15.57:0/61784714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00094f0 con 0x7f37cc06a4a0 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37c9d9b700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 0x7f37cc1513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37cad9d700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 0x7f37cc151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ca59c700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c000ec80 tx=0x7f37c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000c920 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c000ca80 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000ce00 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc009420 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.261+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc096e70 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.262+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc097b20 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.262+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f37c0013680 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.263+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f37c005b520 con 0x7f37cc06a4a0 2024-03-18T14:47:01.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.266+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f37cc097b20 con 0x7f37cc06a4a0 2024-03-18T14:47:01.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.456+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37cc097b20 con 0x7f37cc06a4a0 2024-03-18T14:47:01.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.456+0000 7f37ba7fc700 1 -- 172.21.15.57:0/61784714 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3659 (secure 0 0 0) 0x7f37cc097b20 con 0x7f37cc06a4a0 2024-03-18T14:47:01.457 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:01.457 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4935,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6818/2627465465","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":2627465465}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:45:40.147227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:01.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 >> v1:172.21.15.57:6816/47480 conn(0x7f37ac046040 legacy=0x7f37ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 msgr2=0x7f37cc097de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f37c000ec80 tx=0x7f37c0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 shutdown_connections 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37cc0a4d80 0x7f37cc151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37cc06a4a0 0x7f37cc097de0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 --2- 172.21.15.57:0/61784714 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37cc0a4050 0x7f37cc1513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 >> 172.21.15.57:0/61784714 conn(0x7f37cc06bfc0 msgr2=0x7f37cc0b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 shutdown_connections 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.458+0000 7f37d0cbe700 1 -- 172.21.15.57:0/61784714 wait complete. 2024-03-18T14:47:01.460 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2024-03-18T14:47:01.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:01.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.593+0000 7f1c759a0700 1 Processor -- start 2024-03-18T14:47:01.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.593+0000 7f1c759a0700 1 -- start start 2024-03-18T14:47:01.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c759a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c7006f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c759a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c70149910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c759a0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c700a4870 con 0x7f1c70063e30 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c759a0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c700a38e0 con 0x7f1c700a4460 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c759a0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7006a3d0 con 0x7f1c70147530 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c7499e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c70063e30 0x7f1c7006e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40844/0 (socket says 172.21.15.57:40844) 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c7006f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c7499e700 1 -- 172.21.15.57:0/207496357 learned_addr learned my addr 172.21.15.57:0/207496357 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c7519f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c70149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6f7fe700 1 -- 172.21.15.57:0/207496357 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633452706 0 0) 0x7f1c64001110 con 0x7f1c70063e30 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6f7fe700 1 -- 172.21.15.57:0/207496357 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c60003570 con 0x7f1c70063e30 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 -- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 msgr2=0x7f1c70149910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c70149910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 -- 172.21.15.57:0/207496357 >> v1:172.21.15.57:6789/0 conn(0x7f1c70063e30 legacy=0x7f1c7006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 -- 172.21.15.57:0/207496357 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7006a670 con 0x7f1c700a4460 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c7519f700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c70149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.594+0000 7f1c6ffff700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c7006f050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009910 tx=0x7f1c5c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=100996ea0affafbe server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c6f7fe700 1 -- 172.21.15.57:0/207496357 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c011630 con 0x7f1c700a4460 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c6f7fe700 1 -- 172.21.15.57:0/207496357 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c011790 con 0x7f1c700a4460 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c6f7fe700 1 -- 172.21.15.57:0/207496357 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c011b30 con 0x7f1c700a4460 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 -- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 msgr2=0x7f1c7006f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c7006f050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c009910 tx=0x7f1c5c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 -- 172.21.15.57:0/207496357 shutdown_connections 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c70149910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 --2- 172.21.15.57:0/207496357 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c7006f050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 -- 172.21.15.57:0/207496357 >> 172.21.15.57:0/207496357 conn(0x7f1c7006bd40 msgr2=0x7f1c70063720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 -- 172.21.15.57:0/207496357 shutdown_connections 2024-03-18T14:47:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.595+0000 7f1c759a0700 1 -- 172.21.15.57:0/207496357 wait complete. 2024-03-18T14:47:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.596+0000 7f1c759a0700 1 Processor -- start 2024-03-18T14:47:01.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.596+0000 7f1c759a0700 1 -- start start 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c700aec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70097d30 con 0x7f1c70063e30 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70097090 con 0x7f1c700a4460 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c759a0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c70097ad0 con 0x7f1c70147530 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c7499e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42324/0 (socket says 172.21.15.57:42324) 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c7499e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55620/0 (socket says 172.21.15.57:55620) 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 -- 172.21.15.57:0/1900163847 learned_addr learned my addr 172.21.15.57:0/1900163847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c7519f700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c700aec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 -- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 msgr2=0x7f1c700aec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c700aec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 -- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 msgr2=0x7f1c700ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 -- 172.21.15.57:0/1900163847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68009a20 con 0x7f1c700a4460 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c7499e700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.597+0000 7f1c6ffff700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0091e0 tx=0x7f1c5c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.598+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c011900 con 0x7f1c700a4460 2024-03-18T14:47:01.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.598+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c011a80 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.598+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c009420 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.598+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c025670 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.598+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7014dee0 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.599+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1c5c023070 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.599+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c70065180 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.599+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f1c5c05c540 con 0x7f1c700a4460 2024-03-18T14:47:01.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.602+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1c5c00af40 con 0x7f1c700a4460 2024-03-18T14:47:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.764+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c700a4ab0 con 0x7f1c700a4460 2024-03-18T14:47:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.764+0000 7f1c6cff9700 1 -- 172.21.15.57:0/1900163847 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11529 (secure 0 0 0) 0x7f1c5c02f910 con 0x7f1c700a4460 2024-03-18T14:47:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:01.765 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:46:57.541889+0000","last_up_change":"2024-03-18T14:40:59.413584+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 >> v1:172.21.15.57:6816/47480 conn(0x7f1c54046010 legacy=0x7f1c540484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 msgr2=0x7f1c70097590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0091e0 tx=0x7f1c5c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 shutdown_connections 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1c70147530 0x7f1c700aec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c70063e30 0x7f1c700ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 --2- 172.21.15.57:0/1900163847 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1c700a4460 0x7f1c70097590 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 >> 172.21.15.57:0/1900163847 conn(0x7f1c7006bd40 msgr2=0x7f1c7006f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 shutdown_connections 2024-03-18T14:47:01.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.766+0000 7f1c759a0700 1 -- 172.21.15.57:0/1900163847 wait complete. 2024-03-18T14:47:01.779 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:01.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.898+0000 7f80ac9f1700 1 Processor -- start 2024-03-18T14:47:01.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.898+0000 7f80ac9f1700 1 -- start start 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 0x7f80a80679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 0x7f80a80683a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a80a3b00 con 0x7f80a8067f20 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a806f730 con 0x7f80a8069200 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80ac9f1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a806f9d0 con 0x7f80a80a2390 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 0x7f80a80679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 0x7f80a80683a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42332/0 (socket says 172.21.15.57:42332) 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 -- 172.21.15.57:0/2529284678 learned_addr learned my addr 172.21.15.57:0/2529284678 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 -- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 msgr2=0x7f80a80679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 0x7f80a80679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 -- 172.21.15.57:0/2529284678 >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 msgr2=0x7f80a80683a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 --2- 172.21.15.57:0/2529284678 >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 0x7f80a80683a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 -- 172.21.15.57:0/2529284678 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a806f460 con 0x7f80a8069200 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a5d9b700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 0x7f80a80679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a6d9d700 1 --2- 172.21.15.57:0/2529284678 >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 0x7f80a80683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a659c700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80980099b0 tx=0x7f8098009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539b69b832075531 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a559a700 1 -- 172.21.15.57:0/2529284678 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800b680 con 0x7f80a8069200 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a559a700 1 -- 172.21.15.57:0/2529284678 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800b7e0 con 0x7f80a8069200 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.899+0000 7f80a559a700 1 -- 172.21.15.57:0/2529284678 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800bb80 con 0x7f80a8069200 2024-03-18T14:47:01.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 -- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 msgr2=0x7f80a80a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f80980099b0 tx=0x7f8098009250 comp rx=0 tx=0).stop 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 -- 172.21.15.57:0/2529284678 shutdown_connections 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/2529284678 >> v2:172.21.15.57:3300/0 conn(0x7f80a8067f20 0x7f80a80683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a8069200 0x7f80a80a35c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/2529284678 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a80a2390 0x7f80a80679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 -- 172.21.15.57:0/2529284678 >> 172.21.15.57:0/2529284678 conn(0x7f80a806af40 msgr2=0x7f80a8068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 -- 172.21.15.57:0/2529284678 shutdown_connections 2024-03-18T14:47:01.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.900+0000 7f80ac9f1700 1 -- 172.21.15.57:0/2529284678 wait complete. 2024-03-18T14:47:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 Processor -- start 2024-03-18T14:47:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 -- start start 2024-03-18T14:47:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a8067f20 0x7f80a80984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a80a2390 0x7f80a8152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.901+0000 7f80ac9f1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80ac3b0 con 0x7f80a8067f20 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80ac9f1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8097d40 con 0x7f80a80a2390 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80ac9f1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8151c60 con 0x7f80a8069200 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a6d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a80a2390 0x7f80a8152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50756/0 (socket says 172.21.15.57:50756) 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a8067f20 0x7f80a80984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 -- 172.21.15.57:0/1667166509 learned_addr learned my addr 172.21.15.57:0/1667166509 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 -- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a80a2390 msgr2=0x7f80a8152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a80a2390 0x7f80a8152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 -- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a8067f20 msgr2=0x7f80a80984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a8067f20 0x7f80a80984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 -- 172.21.15.57:0/1667166509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0009a20 con 0x7f80a8069200 2024-03-18T14:47:01.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80a5d9b700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f809c00ecb0 tx=0x7f809c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00c850 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00c9b0 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c009420 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00cd50 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.902+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80980094f0 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.903+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f809c013680 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.903+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8065180 con 0x7f80a8069200 2024-03-18T14:47:01.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.903+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f809c05b760 con 0x7f80a8069200 2024-03-18T14:47:01.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:01.907+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f809c039be0 con 0x7f80a8069200 2024-03-18T14:47:02.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.096+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80a80aaa30 con 0x7f80a8069200 2024-03-18T14:47:02.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.096+0000 7f80967fc700 1 -- 172.21.15.57:0/1667166509 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+3659 (secure 0 0 0) 0x7f809c03d200 con 0x7f80a8069200 2024-03-18T14:47:02.097 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:02.097 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4187,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/708761552","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":708761552}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4935,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6818/2627465465","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":2627465465}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:45:40.147227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4242},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4242":{"gid":4242,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6819/2329339569","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2329339569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 >> v1:172.21.15.57:6816/47480 conn(0x7f8088046010 legacy=0x7f80880484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 msgr2=0x7f80a8151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f809c00ecb0 tx=0x7f809c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 shutdown_connections 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f80a80a2390 0x7f80a8152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f80a8067f20 0x7f80a80984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 --2- 172.21.15.57:0/1667166509 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f80a8069200 0x7f80a8151ee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 >> 172.21.15.57:0/1667166509 conn(0x7f80a806af40 msgr2=0x7f80a8145030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 shutdown_connections 2024-03-18T14:47:02.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.098+0000 7f80ac9f1700 1 -- 172.21.15.57:0/1667166509 wait complete. 2024-03-18T14:47:02.100 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 17 2024-03-18T14:47:02.412 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:45:40.147227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4242}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4242': {'gid': 4242, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6819/2329339569', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 2329339569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:47:02.413 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T14:47:02.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-18T14:47:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.538+0000 7f2a4c13e700 1 Processor -- start 2024-03-18T14:47:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.538+0000 7f2a4c13e700 1 -- start start 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a4406a860 0x7f2a440a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a44069e80 con 0x7f2a4406a860 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440a3dd0 con 0x7f2a440a4ee0 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4c13e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a440a4910 con 0x7f2a4406eb00 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a4406a860 0x7f2a440a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a496d9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4a6db700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4a6db700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50760/0 (socket says 172.21.15.57:50760) 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2a4406a860 0x7f2a440a42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55642/0 (socket says 172.21.15.57:55642) 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a496d9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42352/0 (socket says 172.21.15.57:42352) 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4a6db700 1 -- 172.21.15.57:0/2811045224 learned_addr learned my addr 172.21.15.57:0/2811045224 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 -- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 msgr2=0x7f2a4406ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 -- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 msgr2=0x7f2a440b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 -- 172.21.15.57:0/2811045224 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a440b3790 con 0x7f2a4406a860 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a496d9700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a4406a860 0x7f2a440a42d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098e0 tx=0x7f2a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff06a9cda0d55747 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a48ed8700 1 -- 172.21.15.57:0/2811045224 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40011630 con 0x7f2a4406a860 2024-03-18T14:47:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a48ed8700 1 -- 172.21.15.57:0/2811045224 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40011790 con 0x7f2a4406a860 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.539+0000 7f2a48ed8700 1 -- 172.21.15.57:0/2811045224 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40011b30 con 0x7f2a4406a860 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a4406a860 msgr2=0x7f2a440a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a4406a860 0x7f2a440a42d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098e0 tx=0x7f2a400091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2811045224 shutdown_connections 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406eb00 0x7f2a4406ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a4406a860 0x7f2a440a42d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2811045224 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a440a4ee0 0x7f2a440b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2811045224 >> 172.21.15.57:0/2811045224 conn(0x7f2a4406e250 msgr2=0x7f2a4406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2811045224 shutdown_connections 2024-03-18T14:47:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.540+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2811045224 wait complete. 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.541+0000 7f2a4c13e700 1 Processor -- start 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.541+0000 7f2a4c13e700 1 -- start start 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a4406eb00 0x7f2a4413f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a440a4ee0 0x7f2a4413fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44099780 con 0x7f2a440a4ee0 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44140400 con 0x7f2a4406eb00 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4c13e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44098720 con 0x7f2a4406a860 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50768/0 (socket says 172.21.15.57:50768) 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a49eda700 1 -- 172.21.15.57:0/2943583315 learned_addr learned my addr 172.21.15.57:0/2943583315 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a440a4ee0 0x7f2a4413fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.542+0000 7f2a496d9700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a4406eb00 0x7f2a4413f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 -- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a4406eb00 msgr2=0x7f2a4413f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a4406eb00 0x7f2a4413f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 -- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a440a4ee0 msgr2=0x7f2a4413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a440a4ee0 0x7f2a4413fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 -- 172.21.15.57:0/2943583315 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c009ae0 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a49eda700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406fe70 tx=0x7f2a40017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a39ffb700 1 -- 172.21.15.57:0/2943583315 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a40011900 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a39ffb700 1 -- 172.21.15.57:0/2943583315 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a40011a80 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a34009420 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a39ffb700 1 -- 172.21.15.57:0/2943583315 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4001a680 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.543+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40009420 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.544+0000 7f2a39ffb700 1 -- 172.21.15.57:0/2943583315 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2a4001aa70 con 0x7f2a4406a860 2024-03-18T14:47:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.545+0000 7f2a39ffb700 1 -- 172.21.15.57:0/2943583315 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2a4005cbb0 con 0x7f2a4406a860 2024-03-18T14:47:02.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 Processor -- start 2024-03-18T14:47:02.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 -- start start 2024-03-18T14:47:02.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca82b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 0x55883ca830a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883c9a57b0 con 0x55883ca4fa80 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883c9a3170 con 0x55883ca50150 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55883c99ef60 con 0x55883ca6dc10 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a496d9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca82b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55668/0 (socket says 172.21.15.57:55668) 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a49eda700 1 -- 172.21.15.57:0/21097925 learned_addr learned my addr 172.21.15.57:0/21097925 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.547+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 0x55883ca830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 -- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 msgr2=0x55883ca830a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 0x55883ca830a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 -- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 msgr2=0x55883ca4e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 -- 172.21.15.57:0/21097925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55883c81b040 con 0x55883ca6dc10 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a49eda700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 0x55883ca830a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a496d9700 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca82b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a440b0020 tx=0x7f2a340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd877d8bbe71f61 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a2effd700 1 -- 172.21.15.57:0/21097925 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34015630 con 0x55883ca6dc10 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a2effd700 1 -- 172.21.15.57:0/21097925 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34015790 con 0x55883ca6dc10 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.548+0000 7f2a2effd700 1 -- 172.21.15.57:0/21097925 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34015b30 con 0x55883ca6dc10 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 msgr2=0x55883ca82b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca82b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2a440b0020 tx=0x7f2a340091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- 172.21.15.57:0/21097925 shutdown_connections 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca50150 0x55883ca830a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca4e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 --2- 172.21.15.57:0/21097925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca82b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- 172.21.15.57:0/21097925 >> 172.21.15.57:0/21097925 conn(0x55883ca4d3a0 msgr2=0x55883ca50810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- 172.21.15.57:0/21097925 shutdown_connections 2024-03-18T14:47:02.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- 172.21.15.57:0/21097925 wait complete. 2024-03-18T14:47:02.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 -- start start 2024-03-18T14:47:02.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.549+0000 7f2a55453b80 1 Processor -- start 2024-03-18T14:47:02.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca8d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca8d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883c949d70 con 0x55883ca50150 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883c949a10 con 0x55883ca4fa80 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.550+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55883c897290 con 0x55883ca6dc10 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a55453b80 10 client.0 _ll_register_callbacks cb 0x55883c94be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42376/0 (socket says 172.21.15.57:42376) 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 -- 172.21.15.57:0/3423953216 learned_addr learned my addr 172.21.15.57:0/3423953216 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca8d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a496d9700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca8d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 -- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 msgr2=0x55883ca8d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca8d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 -- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 msgr2=0x55883ca8d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca8d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 -- 172.21.15.57:0/3423953216 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0112b0 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a496d9700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca8d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a49eda700 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a400265c0 tx=0x7f2a40012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1334f43c2649a2b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a23fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3301/0 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400201b0 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55883c9c8690 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mon.1 v2:172.21.15.57:3301/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2a400093f0 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a40013030 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a55453b80 10 client.14356 fetch_fsmap learned FSMap version 17 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=3+}) v3 -- 0x7f2a34013340 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.551+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mon.1 v2:172.21.15.57:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55883c9c8690 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mon.1 v2:172.21.15.57:3301/0 5 ==== fsmap(e 17) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f2a4005b1f0 con 0x55883ca4fa80 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a55453b80 10 client.14356 fetch_fsmap finished waiting for FSMap version 17 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a55453b80 10 client.14356 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-18T14:47:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a55453b80 20 client.14356 populate_metadata read hostname 'smithi057' 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a55453b80 4 client.14356 mds_command: new command op to 4242 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55883c9410e0 con 0x55883ca6cb40 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.552+0000 7f2a23fff700 10 client.14356 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a23fff700 1 -- 172.21.15.57:0/3423953216 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55883c9410e0 con 0x55883ca6cb40 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a23fff700 10 client.14356 handle_command_reply: tid=0 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 client.14356 shutdown 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 msgr2=0x55883ca8cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a400265c0 tx=0x7f2a40012000 comp rx=0 tx=0).stop 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 shutdown_connections 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca8d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a23fff700 0 client.14356 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca8cc00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 --2- 172.21.15.57:0/3423953216 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca8d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 >> 172.21.15.57:0/3423953216 conn(0x55883ca4d3a0 msgr2=0x55883ca70010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 shutdown_connections 2024-03-18T14:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 1 -- 172.21.15.57:0/3423953216 wait complete. 2024-03-18T14:47:02.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.553+0000 7f2a55453b80 20 client.14356 trim_cache size 0 max 16384 2024-03-18T14:47:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 Processor -- start 2024-03-18T14:47:02.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 -- start start 2024-03-18T14:47:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca77340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca762d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883ca6e5b0 con 0x55883ca50150 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883ca78730 con 0x55883ca4fa80 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55883ca468e0 con 0x55883ca6dc10 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42380/0 (socket says 172.21.15.57:42380) 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a4a6db700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca762d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a49eda700 1 -- 172.21.15.57:0/1384572172 learned_addr learned my addr 172.21.15.57:0/1384572172 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.570+0000 7f2a496d9700 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca77340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 -- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 msgr2=0x55883ca762d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca762d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 -- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 msgr2=0x55883ca77340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca77340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 -- 172.21.15.57:0/1384572172 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55883c7dd230 con 0x55883ca4fa80 2024-03-18T14:47:02.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a40001660 tx=0x7f2a40043030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548e6dc553596aa server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a2f7fe700 1 -- 172.21.15.57:0/1384572172 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4005b570 con 0x55883ca4fa80 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a2f7fe700 1 -- 172.21.15.57:0/1384572172 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400078b0 con 0x55883ca4fa80 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a2f7fe700 1 -- 172.21.15.57:0/1384572172 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400093f0 con 0x55883ca4fa80 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 -- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 msgr2=0x55883ca70010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a40001660 tx=0x7f2a40043030 comp rx=0 tx=0).stop 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 -- 172.21.15.57:0/1384572172 shutdown_connections 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca6dc10 0x55883ca762d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca4fa80 0x55883ca70010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1384572172 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca50150 0x55883ca77340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.571+0000 7f2a55453b80 1 -- 172.21.15.57:0/1384572172 >> 172.21.15.57:0/1384572172 conn(0x55883ca4d3a0 msgr2=0x55883ca6cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.572+0000 7f2a55453b80 1 -- 172.21.15.57:0/1384572172 shutdown_connections 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.572+0000 7f2a55453b80 1 -- 172.21.15.57:0/1384572172 wait complete. 2024-03-18T14:47:02.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.572+0000 7f2a55453b80 1 -- start start 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.572+0000 7f2a55453b80 1 Processor -- start 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca50150 0x55883cadac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 0x55883cadb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x55883ca75280 con 0x55883ca4fa80 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x55883ca74af0 con 0x55883ca6dc10 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x55883ca767b0 con 0x55883ca50150 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 10 client.0 _ll_register_callbacks cb 0x55883c94be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a4a6db700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 0x55883cadb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55698/0 (socket says 172.21.15.57:55698) 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 -- 172.21.15.57:0/1701359246 learned_addr learned my addr 172.21.15.57:0/1701359246 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a496d9700 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca50150 0x55883cadac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 -- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca50150 msgr2=0x55883cadac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca50150 0x55883cadac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 -- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 msgr2=0x55883cadb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 0x55883cadb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 -- 172.21.15.57:0/1701359246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0112b0 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a4a6db700 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 0x55883cadb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a49eda700 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a400265c0 tx=0x7f2a40058070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddf5c33aec10c64 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a23fff700 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400093f0 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2a40007e50 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.573+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55883ca94000 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a4001ad20 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 10 client.14448 fetch_fsmap learned FSMap version 17 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=3+}) v3 -- 0x55883c96c970 con 0x55883ca4fa80 2024-03-18T14:47:02.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55883ca94000 con 0x55883ca4fa80 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 17) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f2a40041a10 con 0x55883ca4fa80 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 10 client.14448 fetch_fsmap finished waiting for FSMap version 17 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 10 client.14448 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 20 client.14448 populate_metadata read hostname 'smithi057' 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 4 client.14448 mds_command: new command op to 4242 tid=0[{"prefix": "status"}] 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 --> v1:172.21.15.57:6819/2329339569 -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f2a34015790 con 0x55883caddfd0 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 10 client.14448 ms_handle_connect on v1:172.21.15.57:6819/2329339569 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 1 -- 172.21.15.57:0/1701359246 <== mds.0 v1:172.21.15.57:6819/2329339569 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 2248160497) 0x7f2a34015790 con 0x55883caddfd0 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a23fff700 10 client.14448 handle_command_reply: tid=0 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.574+0000 7f2a55453b80 1 client.14448 shutdown 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 msgr2=0x55883ca76190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2a400265c0 tx=0x7f2a40058070 comp rx=0 tx=0).stop 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 shutdown_connections 2024-03-18T14:47:02.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x55883ca6dc10 0x55883cadb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55883ca4fa80 0x55883ca76190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 --2- 172.21.15.57:0/1701359246 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x55883ca50150 0x55883cadac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 >> 172.21.15.57:0/1701359246 conn(0x55883ca4d3a0 msgr2=0x55883ca6f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a23fff700 0 client.14448 ms_handle_reset on v1:172.21.15.57:6819/2329339569 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 shutdown_connections 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 1 -- 172.21.15.57:0/1701359246 wait complete. 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a55453b80 20 client.14448 trim_cache size 0 max 16384 2024-03-18T14:47:02.582 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4242, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 349.11589151099997, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 17, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 22, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 19, 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 357.93170335399998 2024-03-18T14:47:02.583 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 >> v1:172.21.15.57:6816/47480 conn(0x7f2a28046010 legacy=0x7f2a280484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 msgr2=0x7f2a44097d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2a4406fe70 tx=0x7f2a40017000 comp rx=0 tx=0).stop 2024-03-18T14:47:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 shutdown_connections 2024-03-18T14:47:02.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a440a4ee0 0x7f2a4413fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a4406a860 0x7f2a44097d50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 --2- 172.21.15.57:0/2943583315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a4406eb00 0x7f2a4413f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 >> 172.21.15.57:0/2943583315 conn(0x7f2a4406e250 msgr2=0x7f2a4406ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 shutdown_connections 2024-03-18T14:47:02.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.575+0000 7f2a4c13e700 1 -- 172.21.15.57:0/2943583315 wait complete. 2024-03-18T14:47:02.588 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-03-18T14:47:02.599 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T14:47:02.599 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:02.635 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T14:47:02.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2024-03-18T14:47:02.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.796+0000 7f1094121700 1 Processor -- start 2024-03-18T14:47:02.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.796+0000 7f1094121700 1 -- start start 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1094121700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f108c06f580 0x7f108c0a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1094121700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c1495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1094121700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0a2dc0 con 0x7f108c0b2620 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1094121700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c06e1b0 con 0x7f108c06f580 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1094121700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0a26a0 con 0x7f108c0680f0 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f108c06f580 0x7f108c0a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f10926be700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c1495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f10916bc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f108c0b2620 0x7f108c0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40860/0 (socket says 172.21.15.57:40860) 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f10916bc700 1 -- 172.21.15.57:0/182472780 learned_addr learned my addr 172.21.15.57:0/182472780 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f108c06f580 0x7f108c0a32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55702/0 (socket says 172.21.15.57:55702) 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 -- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 msgr2=0x7f108c1495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c1495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 -- 172.21.15.57:0/182472780 >> v1:172.21.15.57:6789/0 conn(0x7f108c0b2620 legacy=0x7f108c0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 -- 172.21.15.57:0/182472780 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0a46d0 con 0x7f108c06f580 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1090ebb700 1 -- 172.21.15.57:0/182472780 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961096363 0 0) 0x7f108c0a2dc0 con 0x7f108c0b2620 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f10926be700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1091ebd700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c06f580 0x7f108c0a32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f107c0098e0 tx=0x7f107c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a44841b4771ead server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.797+0000 7f1090ebb700 1 -- 172.21.15.57:0/182472780 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00b640 con 0x7f108c06f580 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1090ebb700 1 -- 172.21.15.57:0/182472780 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00b7a0 con 0x7f108c06f580 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1090ebb700 1 -- 172.21.15.57:0/182472780 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00bb40 con 0x7f108c06f580 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 -- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c06f580 msgr2=0x7f108c0a32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c06f580 0x7f108c0a32c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f107c0098e0 tx=0x7f107c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 -- 172.21.15.57:0/182472780 shutdown_connections 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c1495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 --2- 172.21.15.57:0/182472780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c06f580 0x7f108c0a32c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 -- 172.21.15.57:0/182472780 >> 172.21.15.57:0/182472780 conn(0x7f108c06d1f0 msgr2=0x7f108c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 -- 172.21.15.57:0/182472780 shutdown_connections 2024-03-18T14:47:02.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.798+0000 7f1094121700 1 -- 172.21.15.57:0/182472780 wait complete. 2024-03-18T14:47:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.799+0000 7f1094121700 1 Processor -- start 2024-03-18T14:47:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.799+0000 7f1094121700 1 -- start start 2024-03-18T14:47:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 0x7f108c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 0x7f108c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0acba0 con 0x7f108c0b2620 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0ab2c0 con 0x7f108c06f580 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0ab580 con 0x7f108c0680f0 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f10926be700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 0x7f108c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50844/0 (socket says 172.21.15.57:50844) 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 -- 172.21.15.57:0/2507552653 learned_addr learned my addr 172.21.15.57:0/2507552653 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f10916bc700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 0x7f108c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 -- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 msgr2=0x7f108c0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 0x7f108c0ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 -- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 msgr2=0x7f108c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 0x7f108c1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 -- 172.21.15.57:0/2507552653 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084009a20 con 0x7f108c0680f0 2024-03-18T14:47:02.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f10916bc700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 0x7f108c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f10926be700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 0x7f108c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1091ebd700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f108c0a2f50 tx=0x7f107c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c000d10 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00bb20 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c009420 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.800+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c011670 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.801+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c0aabd0 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.801+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c0aec00 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.801+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f107c011a20 con 0x7f108c0680f0 2024-03-18T14:47:02.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.802+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f107c05c5a0 con 0x7f108c0680f0 2024-03-18T14:47:02.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.805+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f107c005f50 con 0x7f108c0680f0 2024-03-18T14:47:02.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:02.980+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f108c065180 con 0x7f108c0680f0 2024-03-18T14:47:02.981 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-18T14:47:02.980+0000 7f83c5ece700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2024-03-18T14:47:03.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.631+0000 7f1081ffb700 1 -- 172.21.15.57:0/2507552653 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7f107c015030 con 0x7f108c0680f0 2024-03-18T14:47:03.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 >> v1:172.21.15.57:6816/47480 conn(0x7f1070046010 legacy=0x7f10700484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 msgr2=0x7f108c0adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f108c0a2f50 tx=0x7f107c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 shutdown_connections 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f108c0b2620 0x7f108c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f108c0680f0 0x7f108c0adf00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 --2- 172.21.15.57:0/2507552653 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f108c06f580 0x7f108c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 >> 172.21.15.57:0/2507552653 conn(0x7f108c06d1f0 msgr2=0x7f108c069190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 shutdown_connections 2024-03-18T14:47:03.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.636+0000 7f1094121700 1 -- 172.21.15.57:0/2507552653 wait complete. 2024-03-18T14:47:03.638 INFO:teuthology.orchestra.run.smithi057.stderr:marked down osd.0. 2024-03-18T14:47:03.654 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-18T14:47:03.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-18T14:47:03.657 INFO:tasks.ceph.osd.0:Started 2024-03-18T14:47:03.657 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T14:47:03.657 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:03.709 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T14:47:03.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2024-03-18T14:47:03.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.833+0000 7fc91bfb1700 1 Processor -- start 2024-03-18T14:47:03.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.833+0000 7fc91bfb1700 1 -- start start 2024-03-18T14:47:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91bfb1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91bfb1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91bfb1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91413aae0 con 0x7fc9140aca50 2024-03-18T14:47:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91bfb1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc914138380 con 0x7fc9140b16c0 2024-03-18T14:47:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91bfb1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91413ad80 con 0x7fc91413a650 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc919d4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91a54e700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9140aca50 0x7fc9140ae290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60494/0 (socket says 172.21.15.57:60494) 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc919d4d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39010/0 (socket says 172.21.15.57:39010) 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48742/0 (socket says 172.21.15.57:48742) 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91a54e700 1 -- 172.21.15.57:0/1502035060 learned_addr learned my addr 172.21.15.57:0/1502035060 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 -- 172.21.15.57:0/1502035060 >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 msgr2=0x7fc91406e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 --2- 172.21.15.57:0/1502035060 >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 -- 172.21.15.57:0/1502035060 >> v1:172.21.15.57:6789/0 conn(0x7fc9140aca50 legacy=0x7fc9140ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc91954c700 1 -- 172.21.15.57:0/1502035060 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91406f400 con 0x7fc91413a650 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.834+0000 7fc919d4d700 1 --2- 172.21.15.57:0/1502035060 >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91954c700 1 --2- 172.21.15.57:0/1502035060 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc910009910 tx=0x7fc9100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74d4bc46a2133b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc918d4b700 1 -- 172.21.15.57:0/1502035060 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000b640 con 0x7fc91413a650 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc918d4b700 1 -- 172.21.15.57:0/1502035060 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000b7a0 con 0x7fc91413a650 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc918d4b700 1 -- 172.21.15.57:0/1502035060 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000bb60 con 0x7fc91413a650 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 -- 172.21.15.57:0/1502035060 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 msgr2=0x7fc91406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/1502035060 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc910009910 tx=0x7fc9100091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 -- 172.21.15.57:0/1502035060 shutdown_connections 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/1502035060 >> v2:172.21.15.57:3300/0 conn(0x7fc9140b16c0 0x7fc91406e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/1502035060 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc91413a650 0x7fc91406eec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 -- 172.21.15.57:0/1502035060 >> 172.21.15.57:0/1502035060 conn(0x7fc91406a4d0 msgr2=0x7fc91406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 -- 172.21.15.57:0/1502035060 shutdown_connections 2024-03-18T14:47:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.835+0000 7fc91bfb1700 1 -- 172.21.15.57:0/1502035060 wait complete. 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 Processor -- start 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 -- start start 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 0x7fc9140a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc91413a650 0x7fc914149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140a6be0 con 0x7fc9140aca50 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc914149a90 con 0x7fc91413a650 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.837+0000 7fc91bfb1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91413ce10 con 0x7fc9140b16c0 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc919d4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 0x7fc9140a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc919d4d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39020/0 (socket says 172.21.15.57:39020) 2024-03-18T14:47:03.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc919d4d700 1 -- 172.21.15.57:0/744934957 learned_addr learned my addr 172.21.15.57:0/744934957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91a54e700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc91413a650 0x7fc914149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 -- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc91413a650 msgr2=0x7fc914149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc91413a650 0x7fc914149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 -- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 msgr2=0x7fc9140a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 -- 172.21.15.57:0/744934957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc904009420 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc919d4d700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91954c700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 0x7fc9140a61a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc910017000 tx=0x7fc910018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91001d070 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910000bc0 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910009420 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000bb40 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.838+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9140a66e0 con 0x7fc9140b16c0 2024-03-18T14:47:03.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.839+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914065180 con 0x7fc9140b16c0 2024-03-18T14:47:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.839+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc910021070 con 0x7fc9140b16c0 2024-03-18T14:47:03.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.840+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc91005c200 con 0x7fc9140b16c0 2024-03-18T14:47:03.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:03.843+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc91000ad50 con 0x7fc9140b16c0 2024-03-18T14:47:04.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.018+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fc91406eca0 con 0x7fc9140b16c0 2024-03-18T14:47:04.019 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-18T14:47:04.019+0000 7f83c5ece700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2024-03-18T14:47:04.254 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:04.253+0000 7f866d600540 -1 Falling back to public interface 2024-03-18T14:47:04.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.618+0000 7fc909ffb700 1 -- 172.21.15.57:0/744934957 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc910028070 con 0x7fc9140b16c0 2024-03-18T14:47:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.622+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 >> v1:172.21.15.57:6816/47480 conn(0x7fc8f8046010 legacy=0x7fc8f80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.622+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 msgr2=0x7fc9140a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.622+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 0x7fc9140a61a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc910017000 tx=0x7fc910018000 comp rx=0 tx=0).stop 2024-03-18T14:47:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.625+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 shutdown_connections 2024-03-18T14:47:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.625+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc91413a650 0x7fc914149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.625+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9140aca50 0x7fc9140a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.625+0000 7fc91bfb1700 1 --2- 172.21.15.57:0/744934957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc9140b16c0 0x7fc9140a61a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.625+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 >> 172.21.15.57:0/744934957 conn(0x7fc91406a4d0 msgr2=0x7fc914139840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:04.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.626+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 shutdown_connections 2024-03-18T14:47:04.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.626+0000 7fc91bfb1700 1 -- 172.21.15.57:0/744934957 wait complete. 2024-03-18T14:47:04.629 INFO:teuthology.orchestra.run.smithi057.stderr:marked down osd.1. 2024-03-18T14:47:04.651 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-18T14:47:04.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-18T14:47:04.653 INFO:tasks.ceph.osd.1:Started 2024-03-18T14:47:04.654 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T14:47:04.654 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:04.686 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T14:47:04.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2024-03-18T14:47:04.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.848+0000 7fdef0b04700 1 Processor -- start 2024-03-18T14:47:04.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.848+0000 7fdef0b04700 1 -- start start 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdef0b04700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdef0b04700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdeec146600 0x7fdeec1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdef0b04700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeec069e80 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdef0b04700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeec0a3dd0 con 0x7fdeec146600 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdef0b04700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0a4910 con 0x7fdeec06a860 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeead9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdeec146600 0x7fdeec1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdee9d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdeec0a4ee0 0x7fdeec0b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60520/0 (socket says 172.21.15.57:60520) 2024-03-18T14:47:04.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdee9d9b700 1 -- 172.21.15.57:0/2310982038 learned_addr learned my addr 172.21.15.57:0/2310982038 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 -- 172.21.15.57:0/2310982038 >> v2:172.21.15.57:3300/0 conn(0x7fdeec146600 msgr2=0x7fdeec1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 --2- 172.21.15.57:0/2310982038 >> v2:172.21.15.57:3300/0 conn(0x7fdeec146600 0x7fdeec1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 -- 172.21.15.57:0/2310982038 >> v1:172.21.15.57:6789/0 conn(0x7fdeec0a4ee0 legacy=0x7fdeec0b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 -- 172.21.15.57:0/2310982038 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeec0694c0 con 0x7fdeec06a860 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.849+0000 7fdeea59c700 1 --2- 172.21.15.57:0/2310982038 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec0a42d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009e60 tx=0x7fdedc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66cae48989ce6e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdee959a700 1 -- 172.21.15.57:0/2310982038 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc00e070 con 0x7fdeec06a860 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdee959a700 1 -- 172.21.15.57:0/2310982038 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc00bb60 con 0x7fdeec06a860 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdee959a700 1 -- 172.21.15.57:0/2310982038 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc012430 con 0x7fdeec06a860 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 -- 172.21.15.57:0/2310982038 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 msgr2=0x7fdeec0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 --2- 172.21.15.57:0/2310982038 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec0a42d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009e60 tx=0x7fdedc009780 comp rx=0 tx=0).stop 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 -- 172.21.15.57:0/2310982038 shutdown_connections 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 --2- 172.21.15.57:0/2310982038 >> v2:172.21.15.57:3300/0 conn(0x7fdeec146600 0x7fdeec1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 --2- 172.21.15.57:0/2310982038 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec0a42d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 -- 172.21.15.57:0/2310982038 >> 172.21.15.57:0/2310982038 conn(0x7fdeec06e250 msgr2=0x7fdeec06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:04.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 -- 172.21.15.57:0/2310982038 shutdown_connections 2024-03-18T14:47:04.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.850+0000 7fdef0b04700 1 -- 172.21.15.57:0/2310982038 wait complete. 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.851+0000 7fdef0b04700 1 Processor -- start 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.851+0000 7fdef0b04700 1 -- start start 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec099b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 0x7fdeec097bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdeec146600 0x7fdeec14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec098e80 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec0af080 con 0x7fdeec146600 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdef0b04700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdeec096b00 con 0x7fdeec06a860 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdeea59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec099b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 0x7fdeec097bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdeea59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec099b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48774/0 (socket says 172.21.15.57:48774) 2024-03-18T14:47:04.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdeea59c700 1 -- 172.21.15.57:0/1065372999 learned_addr learned my addr 172.21.15.57:0/1065372999 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdeead9d700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdeec146600 0x7fdeec14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 -- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 msgr2=0x7fdeec099b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec099b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 -- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdeec146600 msgr2=0x7fdeec14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdeec146600 0x7fdeec14e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 -- 172.21.15.57:0/1065372999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc009a20 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.852+0000 7fdee9d9b700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 0x7fdeec097bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fded400c790 tx=0x7fded4007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.853+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4005b30 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.853+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded4005cb0 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.853+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeec0ae7c0 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.853+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4004a80 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.853+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeec14e4b0 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.854+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fded40070d0 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.854+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeec098b50 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.854+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fded405a2b0 con 0x7fdeec0a4ee0 2024-03-18T14:47:04.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:04.858+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fded4038500 con 0x7fdeec0a4ee0 2024-03-18T14:47:05.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.030+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fdeec14e4b0 con 0x7fdeec0a4ee0 2024-03-18T14:47:05.031 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-18T14:47:05.031+0000 7f83c5ece700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2024-03-18T14:47:05.256 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:05.256+0000 7fde8a566540 -1 Falling back to public interface 2024-03-18T14:47:05.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.631+0000 7fdee27fc700 1 -- 172.21.15.57:0/1065372999 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fdeec14e4b0 con 0x7fdeec0a4ee0 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 >> v1:172.21.15.57:6816/47480 conn(0x7fdecc046010 legacy=0x7fdecc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 msgr2=0x7fdeec097bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 0x7fdeec097bd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fded400c790 tx=0x7fded4007eb0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 shutdown_connections 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdeec146600 0x7fdeec14e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdeec06a860 0x7fdeec099b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 --2- 172.21.15.57:0/1065372999 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeec0a4ee0 0x7fdeec097bd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.649+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 >> 172.21.15.57:0/1065372999 conn(0x7fdeec06e250 msgr2=0x7fdeec1436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:05.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.650+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 shutdown_connections 2024-03-18T14:47:05.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.652+0000 7fdef0b04700 1 -- 172.21.15.57:0/1065372999 wait complete. 2024-03-18T14:47:05.658 INFO:teuthology.orchestra.run.smithi057.stderr:marked down osd.2. 2024-03-18T14:47:05.674 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-18T14:47:05.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-18T14:47:05.676 INFO:tasks.ceph.osd.2:Started 2024-03-18T14:47:05.676 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T14:47:05.676 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:05.729 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T14:47:05.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2024-03-18T14:47:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.850+0000 7faff7dea700 1 Processor -- start 2024-03-18T14:47:05.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 -- start start 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faff00a70f0 0x7faff013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00a5590 con 0x7faff00a70f0 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff013f710 con 0x7faff01401c0 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff7dea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff013f9d0 con 0x7faff00680f0 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff5b86700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff5385700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faff00a70f0 0x7faff013fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff6387700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff5385700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faff00a70f0 0x7faff013fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39056/0 (socket says 172.21.15.57:39056) 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff5b86700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48786/0 (socket says 172.21.15.57:48786) 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff5385700 1 -- 172.21.15.57:0/2656078188 learned_addr learned my addr 172.21.15.57:0/2656078188 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.851+0000 7faff6387700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50232/0 (socket says 172.21.15.57:50232) 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 -- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 msgr2=0x7faff00a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 -- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 msgr2=0x7faff006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 -- 172.21.15.57:0/2656078188 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00a4f50 con 0x7faff00a70f0 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff6387700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff5385700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff00a70f0 0x7faff013fc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafec0099b0 tx=0x7fafec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d0e839bd39df6f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff4b84700 1 -- 172.21.15.57:0/2656078188 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00b680 con 0x7faff00a70f0 2024-03-18T14:47:05.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff4b84700 1 -- 172.21.15.57:0/2656078188 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafec00b7e0 con 0x7faff00a70f0 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff4b84700 1 -- 172.21.15.57:0/2656078188 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafec00bb80 con 0x7faff00a70f0 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.852+0000 7faff7dea700 1 -- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff00a70f0 msgr2=0x7faff013fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff00a70f0 0x7faff013fc80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafec0099b0 tx=0x7fafec009250 comp rx=0 tx=0).stop 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 -- 172.21.15.57:0/2656078188 shutdown_connections 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff01401c0 0x7faff006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 --2- 172.21.15.57:0/2656078188 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff00a70f0 0x7faff013fc80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 -- 172.21.15.57:0/2656078188 >> 172.21.15.57:0/2656078188 conn(0x7faff006be90 msgr2=0x7faff00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 -- 172.21.15.57:0/2656078188 shutdown_connections 2024-03-18T14:47:05.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.853+0000 7faff7dea700 1 -- 172.21.15.57:0/2656078188 wait complete. 2024-03-18T14:47:05.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.854+0000 7faff7dea700 1 Processor -- start 2024-03-18T14:47:05.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.854+0000 7faff7dea700 1 -- start start 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff00a70f0 0x7faff00a8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff01401c0 0x7faff01375c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff00a98b0 con 0x7faff01401c0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff00aa4d0 con 0x7faff00a70f0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff7dea700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faff00a87f0 con 0x7faff00680f0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5385700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff00a70f0 0x7faff00a8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48800/0 (socket says 172.21.15.57:48800) 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 -- 172.21.15.57:0/3189674873 learned_addr learned my addr 172.21.15.57:0/3189674873 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff6387700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff01401c0 0x7faff01375c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 -- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff00a70f0 msgr2=0x7faff00a8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:05.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff00a70f0 0x7faff00a8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 -- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff01401c0 msgr2=0x7faff01375c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff01401c0 0x7faff01375c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 -- 172.21.15.57:0/3189674873 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe8009a20 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7faff5b86700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e930 tx=0x7fafe40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.855+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4013680 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.856+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe40137e0 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.856+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafec0094f0 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.856+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe4013b80 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.856+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff00aa6e0 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.857+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fafe400c460 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.857+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff00a8930 con 0x7faff00680f0 2024-03-18T14:47:05.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.857+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fafe405b2c0 con 0x7faff00680f0 2024-03-18T14:47:05.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:05.861+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fafe4039570 con 0x7faff00680f0 2024-03-18T14:47:06.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.033+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7faff0065180 con 0x7faff00680f0 2024-03-18T14:47:06.034 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-18T14:47:06.034+0000 7f83c5ece700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2024-03-18T14:47:06.265 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:06.264+0000 7f5066ddf540 -1 Falling back to public interface 2024-03-18T14:47:06.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.640+0000 7fafe1ffb700 1 -- 172.21.15.57:0/3189674873 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7fafe403cd60 con 0x7faff00680f0 2024-03-18T14:47:06.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 >> v1:172.21.15.57:6816/47480 conn(0x7fafd4046010 legacy=0x7fafd40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 msgr2=0x7faff00ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafe400e930 tx=0x7fafe40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 shutdown_connections 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faff01401c0 0x7faff01375c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faff00680f0 0x7faff00ab0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 --2- 172.21.15.57:0/3189674873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faff00a70f0 0x7faff00a8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 >> 172.21.15.57:0/3189674873 conn(0x7faff006be90 msgr2=0x7faff006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 shutdown_connections 2024-03-18T14:47:06.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.642+0000 7faff7dea700 1 -- 172.21.15.57:0/3189674873 wait complete. 2024-03-18T14:47:06.644 INFO:teuthology.orchestra.run.smithi057.stderr:marked down osd.3. 2024-03-18T14:47:06.657 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-18T14:47:06.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-18T14:47:06.660 INFO:tasks.ceph.osd.3:Started 2024-03-18T14:47:06.660 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T14:47:06.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:06.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.786+0000 7fce0f08c700 1 Processor -- start 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.786+0000 7fce0f08c700 1 -- start start 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0f08c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce08140530 0x7fce080a3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0f08c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0f08c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce080a7020 con 0x7fce08063f60 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0f08c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce080a4110 con 0x7fce08140530 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0f08c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce080a74b0 con 0x7fce08144c60 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0d629700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce07fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce08140530 0x7fce080a3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0d629700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50246/0 (socket says 172.21.15.57:50246) 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0d629700 1 -- 172.21.15.57:0/3613883101 learned_addr learned my addr 172.21.15.57:0/3613883101 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce07fff700 1 -- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 msgr2=0x7fce08147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:06.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce07fff700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce07fff700 1 -- 172.21.15.57:0/3613883101 >> v1:172.21.15.57:6789/0 conn(0x7fce08063f60 legacy=0x7fce0813fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce07fff700 1 -- 172.21.15.57:0/3613883101 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0813f9d0 con 0x7fce08140530 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce077fe700 1 -- 172.21.15.57:0/3613883101 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496008663 0 0) 0x7fce080a7020 con 0x7fce08063f60 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.787+0000 7fce0d629700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce07fff700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080a3bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0098e0 tx=0x7fcdfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ce11b4caa38606 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce077fe700 1 -- 172.21.15.57:0/3613883101 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00b6d0 con 0x7fce08140530 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce077fe700 1 -- 172.21.15.57:0/3613883101 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc00b830 con 0x7fce08140530 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce077fe700 1 -- 172.21.15.57:0/3613883101 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc00bbd0 con 0x7fce08140530 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 -- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 msgr2=0x7fce080a3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080a3bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0098e0 tx=0x7fcdfc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 -- 172.21.15.57:0/3613883101 shutdown_connections 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce08147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 --2- 172.21.15.57:0/3613883101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080a3bd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 -- 172.21.15.57:0/3613883101 >> 172.21.15.57:0/3613883101 conn(0x7fce0806c020 msgr2=0x7fce08063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:06.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 -- 172.21.15.57:0/3613883101 shutdown_connections 2024-03-18T14:47:06.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.788+0000 7fce0f08c700 1 -- 172.21.15.57:0/3613883101 wait complete. 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.789+0000 7fce0f08c700 1 Processor -- start 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 -- start start 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce08063f60 0x7fce080ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080af120 con 0x7fce08140530 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce080aeeb0 con 0x7fce08144c60 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0f08c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce080ae800 con 0x7fce08063f60 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0d629700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:06.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0ce28700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce08063f60 0x7fce080ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0d629700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:50260/0 (socket says 172.21.15.57:50260) 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce0d629700 1 -- 172.21.15.57:0/1325112420 learned_addr learned my addr 172.21.15.57:0/1325112420 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.790+0000 7fce07fff700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 -- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce08063f60 msgr2=0x7fce080ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce08063f60 0x7fce080ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 -- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 msgr2=0x7fce080ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 -- 172.21.15.57:0/1325112420 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80094f0 con 0x7fce08144c60 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce07fff700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0d629700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009fd0 tx=0x7fcdf8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800c6a0 con 0x7fce08144c60 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800c800 con 0x7fce08144c60 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdfc009420 con 0x7fce08144c60 2024-03-18T14:47:06.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800cbc0 con 0x7fce08144c60 2024-03-18T14:47:06.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.791+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0806a8d0 con 0x7fce08144c60 2024-03-18T14:47:06.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.792+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce080648f0 con 0x7fce08144c60 2024-03-18T14:47:06.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.792+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fcdf8013470 con 0x7fce08144c60 2024-03-18T14:47:06.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.793+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fcdf805b170 con 0x7fce08144c60 2024-03-18T14:47:06.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.797+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fcdf8039360 con 0x7fce08144c60 2024-03-18T14:47:06.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.961+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce080b21f0 con 0x7fce08144c60 2024-03-18T14:47:06.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.961+0000 7fce04ff9700 1 -- 172.21.15.57:0/1325112420 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11539 (secure 0 0 0) 0x7fcdf803cb50 con 0x7fce08144c60 2024-03-18T14:47:06.962 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:06.962 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:06.627764+0000","last_up_change":"2024-03-18T14:47:06.627764+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 >> v1:172.21.15.57:6816/47480 conn(0x7fcdf4046010 legacy=0x7fcdf40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 msgr2=0x7fce0814e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009fd0 tx=0x7fcdf8009250 comp rx=0 tx=0).stop 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 shutdown_connections 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fce08144c60 0x7fce0814e6a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.963+0000 7fce0f08c700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fce08063f60 0x7fce080ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.964+0000 7fce0f08c700 1 --2- 172.21.15.57:0/1325112420 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08140530 0x7fce080ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:06.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.964+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 >> 172.21.15.57:0/1325112420 conn(0x7fce0806c020 msgr2=0x7fce0813fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.964+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 shutdown_connections 2024-03-18T14:47:06.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:06.964+0000 7fce0f08c700 1 -- 172.21.15.57:0/1325112420 wait complete. 2024-03-18T14:47:07.256 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:07.255+0000 7f1e08297540 -1 Falling back to public interface 2024-03-18T14:47:07.548 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.547+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2024-03-18T14:47:07.549 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.550 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.549+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.552 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.552+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.553 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.552+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.553 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.552+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.553 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.553+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.554 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.554+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.554 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.554+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.556 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.556+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.556 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.556+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.556 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.556+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.557 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.557+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.557 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.557+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.559 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.559+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.560 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.560+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:07.563 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:07.563+0000 7f866d600540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.678 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.677+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2024-03-18T14:47:08.679 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.679+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.681 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.681 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.682 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.682 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.682 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.682 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.681+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.683 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.683+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.684 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.684+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.687 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.687+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.689 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.689+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.689 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.689+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:08.691 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:08.691+0000 7fde8a566540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.391 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:09.390+0000 7f866d600540 -1 osd.0 22 log_to_monitors true 2024-03-18T14:47:09.736 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.736+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2024-03-18T14:47:09.738 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.738+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.740 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.740+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.742 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.741+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.747 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.747+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.748 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.748+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.750 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.750+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.751 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.751+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.751 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:09.751+0000 7f5066ddf540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:09.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.139+0000 7ff35e253700 1 Processor -- start 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.139+0000 7ff35e253700 1 -- start start 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 0x7ff35806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 0x7ff35806f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3580a34d0 con 0x7ff3580a3cb0 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35806a0e0 con 0x7ff35806f0b0 2024-03-18T14:47:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff35e253700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580a43e0 con 0x7ff358063d10 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff3577fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 0x7ff35806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff3577fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48824/0 (socket says 172.21.15.57:48824) 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff3577fe700 1 -- 172.21.15.57:0/1214224080 learned_addr learned my addr 172.21.15.57:0/1214224080 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff356ffd700 1 --2- 172.21.15.57:0/1214224080 >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 0x7ff35806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 -- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 msgr2=0x7ff358069ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 -- 172.21.15.57:0/1214224080 >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 msgr2=0x7ff35806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 --2- 172.21.15.57:0/1214224080 >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 0x7ff35806eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 -- 172.21.15.57:0/1214224080 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35806a340 con 0x7ff35806f0b0 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff3577fe700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff356ffd700 1 --2- 172.21.15.57:0/1214224080 >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 0x7ff35806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff357fff700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 0x7ff35806f550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3500098e0 tx=0x7ff3500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c816cc798153fb6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.140+0000 7ff3567fc700 1 -- 172.21.15.57:0/1214224080 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350011630 con 0x7ff35806f0b0 2024-03-18T14:47:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff3567fc700 1 -- 172.21.15.57:0/1214224080 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff350011790 con 0x7ff35806f0b0 2024-03-18T14:47:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff3567fc700 1 -- 172.21.15.57:0/1214224080 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff350011b30 con 0x7ff35806f0b0 2024-03-18T14:47:10.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 -- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 msgr2=0x7ff35806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 0x7ff35806f550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff3500098e0 tx=0x7ff3500091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 -- 172.21.15.57:0/1214224080 shutdown_connections 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff35806f0b0 0x7ff35806f550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 --2- 172.21.15.57:0/1214224080 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff358063d10 0x7ff358069ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 --2- 172.21.15.57:0/1214224080 >> v2:172.21.15.57:3300/0 conn(0x7ff3580a3cb0 0x7ff35806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 -- 172.21.15.57:0/1214224080 >> 172.21.15.57:0/1214224080 conn(0x7ff35806c020 msgr2=0x7ff358063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 -- 172.21.15.57:0/1214224080 shutdown_connections 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.141+0000 7ff35e253700 1 -- 172.21.15.57:0/1214224080 wait complete. 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.143+0000 7ff35e253700 1 Processor -- start 2024-03-18T14:47:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.143+0000 7ff35e253700 1 -- start start 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 0x7ff358097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3580a3cb0 0x7ff358151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff358098470 con 0x7ff3580a3cb0 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3580af030 con 0x7ff358063d10 2024-03-18T14:47:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff35e253700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff358097380 con 0x7ff35806f0b0 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:48826/0 (socket says 172.21.15.57:48826) 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 -- 172.21.15.57:0/1447741472 learned_addr learned my addr 172.21.15.57:0/1447741472 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff3577fe700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 0x7ff358097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 -- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 msgr2=0x7ff358097de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 0x7ff358097de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 -- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3580a3cb0 msgr2=0x7ff358151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3580a3cb0 0x7ff358151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 -- 172.21.15.57:0/1447741472 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009ae0 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff3577fe700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 0x7ff358097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.144+0000 7ff356ffd700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00ec50 tx=0x7ff34c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.145+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00c970 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.145+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34c00cad0 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.145+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c009420 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.145+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34c00ce70 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.145+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff350009420 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.146+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7ff34c013680 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.146+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3580970d0 con 0x7ff35806f0b0 2024-03-18T14:47:10.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.146+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3840+0+0 (secure 0 0 0) 0x7ff34c05b480 con 0x7ff35806f0b0 2024-03-18T14:47:10.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.151+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7ff34c03d2d0 con 0x7ff35806f0b0 2024-03-18T14:47:10.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.398+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff358099410 con 0x7ff35806f0b0 2024-03-18T14:47:10.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.399+0000 7ff33f7fe700 1 -- 172.21.15.57:0/1447741472 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11539 (secure 0 0 0) 0x7ff34c03cec0 con 0x7ff35806f0b0 2024-03-18T14:47:10.400 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:10.400 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":27,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:09.447110+0000","last_up_change":"2024-03-18T14:47:06.627764+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":40076}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":40076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":40076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":40076}]},"public_addr":"172.21.15.57:6800/40076","cluster_addr":"172.21.15.57:6801/40076","heartbeat_back_addr":"172.21.15.57:6803/40076","heartbeat_front_addr":"172.21.15.57:6802/40076","state":["exists"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":23,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":40091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":40091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":40091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":40091}]},"public_addr":"172.21.15.57:6804/40091","cluster_addr":"172.21.15.57:6805/40091","heartbeat_back_addr":"172.21.15.57:6807/40091","heartbeat_front_addr":"172.21.15.57:6806/40091","state":["exists"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":40092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":40092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":40092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":40092}]},"public_addr":"172.21.15.57:6808/40092","cluster_addr":"172.21.15.57:6809/40092","heartbeat_back_addr":"172.21.15.57:6811/40092","heartbeat_front_addr":"172.21.15.57:6810/40092","state":["exists"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.401+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 >> v1:172.21.15.57:6816/47480 conn(0x7ff344046010 legacy=0x7ff3440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.401+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 msgr2=0x7ff358096a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.401+0000 7ff35e253700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff34c00ec50 tx=0x7ff34c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.403+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 shutdown_connections 2024-03-18T14:47:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.403+0000 7ff35e253700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3580a3cb0 0x7ff358151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.403+0000 7ff35e253700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7ff358063d10 0x7ff358097de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.403+0000 7ff35e253700 1 --2- 172.21.15.57:0/1447741472 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7ff35806f0b0 0x7ff358096a50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.403+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 >> 172.21.15.57:0/1447741472 conn(0x7ff35806c020 msgr2=0x7ff3580b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:10.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.404+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 shutdown_connections 2024-03-18T14:47:10.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:10.404+0000 7ff35e253700 1 -- 172.21.15.57:0/1447741472 wait complete. 2024-03-18T14:47:10.517 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-18T14:47:10.517+0000 7f865cffc700 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:47:10.994 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:10.994+0000 7fde8a566540 -1 osd.1 23 log_to_monitors true 2024-03-18T14:47:11.294 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.293+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2024-03-18T14:47:11.296 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.295+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.296 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.296+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.301 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.301+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.303 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.303+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.307 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.307+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.308 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.308+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.310 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.310+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.312 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.312+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.316 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.316+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.318 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.317+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.321 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.321+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.322 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.322+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.323 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.323+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.325 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.325+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.326 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.326+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.326 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.326+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.326 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:11.326+0000 7f1e08297540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-03-18T14:47:11.658 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:11.657+0000 7f5066ddf540 -1 osd.2 24 log_to_monitors true 2024-03-18T14:47:12.416 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-18T14:47:12.415+0000 7fde79f62700 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:47:13.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:13.446 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-18T14:47:13.446+0000 7f50567db700 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:47:13.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.556+0000 7f0671523700 1 Processor -- start 2024-03-18T14:47:13.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.557+0000 7f0671523700 1 -- start start 2024-03-18T14:47:13.562 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f0671523700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f0671523700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f0671523700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c0a3bf0 con 0x7f066c06f620 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f0671523700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c06ed90 con 0x7f066c06f9f0 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f0671523700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f066c06b7b0 con 0x7f066c069200 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f066b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f066b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53964/0 (socket says 172.21.15.57:53964) 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.559+0000 7f066b7fe700 1 -- 172.21.15.57:0/1170843735 learned_addr learned my addr 172.21.15.57:0/1170843735 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f066b7fe700 1 -- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 msgr2=0x7f066c06e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c06e1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f066b7fe700 1 -- 172.21.15.57:0/1170843735 >> v1:172.21.15.57:6789/0 conn(0x7f066c06f620 legacy=0x7f066c13e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f066b7fe700 1 -- 172.21.15.57:0/1170843735 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c13e5e0 con 0x7f066c06f9f0 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06640145c0 tx=0x7f066400fd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e96ceaa035cf4f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f0669ffb700 1 -- 172.21.15.57:0/1170843735 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400f080 con 0x7f066c06f9f0 2024-03-18T14:47:13.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f0669ffb700 1 -- 172.21.15.57:0/1170843735 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066400f1e0 con 0x7f066c06f9f0 2024-03-18T14:47:13.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.560+0000 7f0669ffb700 1 -- 172.21.15.57:0/1170843735 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400a580 con 0x7f066c06f9f0 2024-03-18T14:47:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.564+0000 7f0671523700 1 -- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 msgr2=0x7f066c13ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:13.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.564+0000 7f0671523700 1 --2- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06640145c0 tx=0x7f066400fd70 comp rx=0 tx=0).stop 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 -- 172.21.15.57:0/1170843735 shutdown_connections 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 --2- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f9f0 0x7f066c13ef90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 --2- 172.21.15.57:0/1170843735 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 -- 172.21.15.57:0/1170843735 >> 172.21.15.57:0/1170843735 conn(0x7f066c06af90 msgr2=0x7f066c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 -- 172.21.15.57:0/1170843735 shutdown_connections 2024-03-18T14:47:13.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.568+0000 7f0671523700 1 -- 172.21.15.57:0/1170843735 wait complete. 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.569+0000 7f0671523700 1 Processor -- start 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.569+0000 7f0671523700 1 -- start start 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c0a73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f620 0x7f066c0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 0x7f066c14cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0a7930 con 0x7f066c06f9f0 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0a8df0 con 0x7f066c06f620 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.570+0000 7f0671523700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0a7b20 con 0x7f066c069200 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.571+0000 7f066affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c0a73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:13.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.571+0000 7f066affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c0a73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60836/0 (socket says 172.21.15.57:60836) 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.571+0000 7f066affd700 1 -- 172.21.15.57:0/1866390460 learned_addr learned my addr 172.21.15.57:0/1866390460 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.571+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 0x7f066c14cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066a7fc700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f620 0x7f066c0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 -- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 msgr2=0x7f066c0a73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c0a73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 -- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f620 msgr2=0x7f066c0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f620 0x7f066c0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 -- 172.21.15.57:0/1866390460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0664014100 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.572+0000 7f066b7fe700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 0x7f066c14cda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b1d10 tx=0x7f066400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.576+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400ae20 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.576+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066400d650 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.576+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066400d9d0 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.576+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c0a7de0 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.576+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c0a9b30 con 0x7f066c06f9f0 2024-03-18T14:47:13.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.578+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f066400dd40 con 0x7f066c06f9f0 2024-03-18T14:47:13.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.579+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f066407f430 con 0x7f066c06f9f0 2024-03-18T14:47:13.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.581+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0052b0 con 0x7f066c06f9f0 2024-03-18T14:47:13.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.590+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f066401f020 con 0x7f066c06f9f0 2024-03-18T14:47:13.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.790+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f064c005830 con 0x7f066c06f9f0 2024-03-18T14:47:13.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.791+0000 7f0652ffd700 1 -- 172.21.15.57:0/1866390460 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+11560 (secure 0 0 0) 0x7f066401b570 con 0x7f066c06f9f0 2024-03-18T14:47:13.792 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:13.792 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":30,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:13.548560+0000","last_up_change":"2024-03-18T14:47:13.548560+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":29,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":29,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":40093}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":40093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":40093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":40093}]},"public_addr":"172.21.15.57:6812/40093","cluster_addr":"172.21.15.57:6813/40093","heartbeat_back_addr":"172.21.15.57:6815/40093","heartbeat_front_addr":"172.21.15.57:6814/40093","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 >> v1:172.21.15.57:6816/47480 conn(0x7f0658046190 legacy=0x7f0658048640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 msgr2=0x7f066c14cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 0x7f066c14cda0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f066c0b1d10 tx=0x7f066400d000 comp rx=0 tx=0).stop 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 shutdown_connections 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066c06f9f0 0x7f066c14cda0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f066c069200 0x7f066c0a73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 --2- 172.21.15.57:0/1866390460 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f066c06f620 0x7f066c0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 >> 172.21.15.57:0/1866390460 conn(0x7f066c06af90 msgr2=0x7f066c13e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 shutdown_connections 2024-03-18T14:47:13.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:13.793+0000 7f0671523700 1 -- 172.21.15.57:0/1866390460 wait complete. 2024-03-18T14:47:13.982 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:13.982+0000 7f1e08297540 -1 osd.3 25 log_to_monitors true 2024-03-18T14:47:15.418 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-18T14:47:15.417+0000 7f1df7c93700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T14:47:16.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:16.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 Processor -- start 2024-03-18T14:47:16.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 -- start start 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e000a53f0 con 0x7f7e000a6c70 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a50a0 con 0x7f7e000a3e00 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.943+0000 7f7e08577700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a73c0 con 0x7f7e00068340 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05b12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06313700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05b12700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37452/0 (socket says 172.21.15.57:37452) 2024-03-18T14:47:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06313700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60844/0 (socket says 172.21.15.57:60844) 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05b12700 1 -- 172.21.15.57:0/2583399 learned_addr learned my addr 172.21.15.57:0/2583399 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:53978/0 (socket says 172.21.15.57:53978) 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 -- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 msgr2=0x7f7e000a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 -- 172.21.15.57:0/2583399 >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 msgr2=0x7f7e0013ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 --2- 172.21.15.57:0/2583399 >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 -- 172.21.15.57:0/2583399 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0006c520 con 0x7f7e000a3e00 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05b12700 1 --2- 172.21.15.57:0/2583399 >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06313700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e06b14700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009e60 tx=0x7f7df8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6914df980eaf543 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05311700 1 -- 172.21.15.57:0/2583399 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800e070 con 0x7f7e000a3e00 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05311700 1 -- 172.21.15.57:0/2583399 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df800bab0 con 0x7f7e000a3e00 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.944+0000 7f7e05311700 1 -- 172.21.15.57:0/2583399 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800be70 con 0x7f7e000a3e00 2024-03-18T14:47:16.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 -- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 msgr2=0x7f7e0013efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7df8009e60 tx=0x7f7df8009780 comp rx=0 tx=0).stop 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 -- 172.21.15.57:0/2583399 shutdown_connections 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e0013efd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 --2- 172.21.15.57:0/2583399 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 --2- 172.21.15.57:0/2583399 >> v2:172.21.15.57:3300/0 conn(0x7f7e000a6c70 0x7f7e0013ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 -- 172.21.15.57:0/2583399 >> 172.21.15.57:0/2583399 conn(0x7f7e0006c0a0 msgr2=0x7f7e000679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 -- 172.21.15.57:0/2583399 shutdown_connections 2024-03-18T14:47:16.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.945+0000 7f7e08577700 1 -- 172.21.15.57:0/2583399 wait complete. 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 Processor -- start 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 -- start start 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e000ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e000a6c70 0x7f7e00139d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a7d80 con 0x7f7e000a6c70 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a8040 con 0x7f7e000a3e00 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.946+0000 7f7e08577700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a78f0 con 0x7f7e00068340 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e05b12700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e000ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60848/0 (socket says 172.21.15.57:60848) 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 -- 172.21.15.57:0/3269635515 learned_addr learned my addr 172.21.15.57:0/3269635515 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06b14700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e000a6c70 0x7f7e00139d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 -- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 msgr2=0x7f7e000ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e000ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 -- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e000a6c70 msgr2=0x7f7e00139d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e000a6c70 0x7f7e00139d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 -- 172.21.15.57:0/3269635515 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc009420 con 0x7f7e00068340 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e05b12700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e000ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:16.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e06313700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009ed0 tx=0x7f7dfc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc015070 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dfc00bbf0 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df00094f0 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dfc019410 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.947+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df8009a20 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.948+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e00065180 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.948+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7dfc019780 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.949+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7dfc05ed70 con 0x7f7e00068340 2024-03-18T14:47:16.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:16.952+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f7dfc03d040 con 0x7f7e00068340 2024-03-18T14:47:17.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.113+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e000b20f0 con 0x7f7e00068340 2024-03-18T14:47:17.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.113+0000 7f7df67fc700 1 -- 172.21.15.57:0/3269635515 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+11567 (secure 0 0 0) 0x7f7dfc01e070 con 0x7f7e00068340 2024-03-18T14:47:17.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:17.115 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":32,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:16.428036+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 >> v1:172.21.15.57:6816/47480 conn(0x7f7de4046010 legacy=0x7f7de40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 msgr2=0x7f7e000a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc009ed0 tx=0x7f7dfc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 shutdown_connections 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e000a6c70 0x7f7e00139d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e00068340 0x7f7e000a9bb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 --2- 172.21.15.57:0/3269635515 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e000a3e00 0x7f7e000ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 >> 172.21.15.57:0/3269635515 conn(0x7f7e0006c0a0 msgr2=0x7f7e0013f6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 shutdown_connections 2024-03-18T14:47:17.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:17.115+0000 7f7e08577700 1 -- 172.21.15.57:0/3269635515 wait complete. 2024-03-18T14:47:17.128 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T14:47:17.128 INFO:teuthology.run_tasks:Running task ceph.stop... 2024-03-18T14:47:17.139 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T14:47:17.139 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:17.151 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T14:47:17.151 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T14:47:17.151 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:17.199 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T14:47:17.200 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T14:47:17.200 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:47:17.249 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T14:47:18.365 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2024-03-18T14:47:18.365 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-03-18T14:47:18.376 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-03-18T14:47:18.376 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T14:47:18.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T14:47:18.379 INFO:tasks.ceph.mds.a:Started 2024-03-18T14:47:18.379 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-03-18T14:47:18.379 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T14:47:18.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T14:47:18.381 INFO:tasks.ceph.mds.b:Started 2024-03-18T14:47:18.381 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-03-18T14:47:18.381 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T14:47:18.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T14:47:18.383 INFO:tasks.ceph.mds.c:Started 2024-03-18T14:47:18.384 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T14:47:18.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:18.475 INFO:tasks.ceph.mds.b.smithi057.stdout:starting mds.b at 2024-03-18T14:47:18.476 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-03-18T14:47:18.478 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-03-18T14:47:18.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.530+0000 7f4a1cadf700 1 Processor -- start 2024-03-18T14:47:18.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.530+0000 7f4a1cadf700 1 -- start start 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1cadf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 0x7f4a1806f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1cadf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 0x7f4a181499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1cadf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a180a3a80 con 0x7f4a180b3250 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1cadf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180b0350 con 0x7f4a18147610 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1cadf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180a4990 con 0x7f4a180a4e70 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a16d9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 0x7f4a181499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1659c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4a180b3250 0x7f4a1806eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36310/0 (socket says 172.21.15.57:36310) 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1659c700 1 -- 172.21.15.57:0/2639044864 learned_addr learned my addr 172.21.15.57:0/2639044864 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 0x7f4a1806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 -- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 msgr2=0x7f4a181499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 0x7f4a181499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a1559a700 1 -- 172.21.15.57:0/2639044864 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104752100 0 0) 0x7f4a180a3a80 con 0x7f4a180b3250 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 -- 172.21.15.57:0/2639044864 >> v1:172.21.15.57:6789/0 conn(0x7f4a180b3250 legacy=0x7f4a1806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 -- 172.21.15.57:0/2639044864 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1806a3f0 con 0x7f4a180a4e70 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a16d9d700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 0x7f4a181499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.531+0000 7f4a15d9b700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 0x7f4a1806f280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009910 tx=0x7f4a080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da06740dd344262d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1559a700 1 -- 172.21.15.57:0/2639044864 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800b680 con 0x7f4a180a4e70 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1559a700 1 -- 172.21.15.57:0/2639044864 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0800b7e0 con 0x7f4a180a4e70 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1559a700 1 -- 172.21.15.57:0/2639044864 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0800bba0 con 0x7f4a180a4e70 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 -- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 msgr2=0x7f4a1806f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 0x7f4a1806f280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a08009910 tx=0x7f4a080091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 -- 172.21.15.57:0/2639044864 shutdown_connections 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a18147610 0x7f4a181499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/2639044864 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a180a4e70 0x7f4a1806f280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 -- 172.21.15.57:0/2639044864 >> 172.21.15.57:0/2639044864 conn(0x7f4a1806e2c0 msgr2=0x7f4a1806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:18.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 -- 172.21.15.57:0/2639044864 shutdown_connections 2024-03-18T14:47:18.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.532+0000 7f4a1cadf700 1 -- 172.21.15.57:0/2639044864 wait complete. 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.533+0000 7f4a1cadf700 1 Processor -- start 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.533+0000 7f4a1cadf700 1 -- start start 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 0x7f4a180aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1814e2e0 con 0x7f4a180a4e70 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a18097000 con 0x7f4a180b3250 2024-03-18T14:47:18.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1cadf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a180ad630 con 0x7f4a18147610 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60866/0 (socket says 172.21.15.57:60866) 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37504/0 (socket says 172.21.15.57:37504) 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 -- 172.21.15.57:0/1417731109 learned_addr learned my addr 172.21.15.57:0/1417731109 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a15d9b700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 0x7f4a180aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 -- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 msgr2=0x7f4a180aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 0x7f4a180aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 -- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 msgr2=0x7f4a18097a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 -- 172.21.15.57:0/1417731109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a10009a20 con 0x7f4a18147610 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a1659c700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a15d9b700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 0x7f4a180aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:18.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.534+0000 7f4a16d9d700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009f20 tx=0x7f4a1000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.535+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1000cb70 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.535+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000f040 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.535+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a08009420 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.535+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a10014480 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.535+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a180acbc0 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.536+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a18065180 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.536+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f4a10003020 con 0x7f4a18147610 2024-03-18T14:47:18.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.536+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f4a1005ba70 con 0x7f4a18147610 2024-03-18T14:47:18.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.540+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f4a10039d80 con 0x7f4a18147610 2024-03-18T14:47:18.614 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-18T14:47:18.612+0000 7f83c36c9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-18T14:47:18.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.761+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a180ab130 con 0x7f4a18147610 2024-03-18T14:47:18.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.762+0000 7f4a067fc700 1 -- 172.21.15.57:0/1417731109 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+11632 (secure 0 0 0) 0x7f4a10018030 con 0x7f4a18147610 2024-03-18T14:47:18.764 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:18.764 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:18.629637+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 >> v1:172.21.15.57:6816/47480 conn(0x7f49f8046040 legacy=0x7f49f80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 msgr2=0x7f4a1814e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a10009f20 tx=0x7f4a1000b040 comp rx=0 tx=0).stop 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 shutdown_connections 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4a18147610 0x7f4a1814e790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4a180a4e70 0x7f4a18097a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 --2- 172.21.15.57:0/1417731109 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4a180b3250 0x7f4a180aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 >> 172.21.15.57:0/1417731109 conn(0x7f4a1806e2c0 msgr2=0x7f4a180648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:18.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 shutdown_connections 2024-03-18T14:47:18.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.764+0000 7f4a1cadf700 1 -- 172.21.15.57:0/1417731109 wait complete. 2024-03-18T14:47:18.778 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T14:47:18.778 INFO:teuthology.run_tasks:Running task exec... 2024-03-18T14:47:18.788 INFO:teuthology.task.exec:Executing custom commands... 2024-03-18T14:47:18.788 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:47:18.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2024-03-18T14:47:18.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.925+0000 7f0427e00700 1 Processor -- start 2024-03-18T14:47:18.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.925+0000 7f0427e00700 1 -- start start 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0427e00700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0427e00700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f042006d4e0 0x7f0420149480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0427e00700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04200a2610 con 0x7f04200b1ff0 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0427e00700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042006da10 con 0x7f042006d4e0 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0427e00700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04200a43c0 con 0x7f04200af530 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042539b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042539b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60868/0 (socket says 172.21.15.57:60868) 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f042006d4e0 0x7f0420149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042539b700 1 -- 172.21.15.57:0/59060014 learned_addr learned my addr 172.21.15.57:0/59060014 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 -- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 msgr2=0x7f0420063cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 -- 172.21.15.57:0/59060014 >> v1:172.21.15.57:6789/0 conn(0x7f04200b1ff0 legacy=0x7f04200635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 -- 172.21.15.57:0/59060014 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04200a4680 con 0x7f042006d4e0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f0424b9a700 1 -- 172.21.15.57:0/59060014 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841518050 0 0) 0x7f04200a2610 con 0x7f04200b1ff0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042539b700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.926+0000 7f042639d700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f042006d4e0 0x7f0420149480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e60 tx=0x7f0418009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cf1c19093fa4b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0424b9a700 1 -- 172.21.15.57:0/59060014 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800e070 con 0x7f042006d4e0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0424b9a700 1 -- 172.21.15.57:0/59060014 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800bbf0 con 0x7f042006d4e0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0424b9a700 1 -- 172.21.15.57:0/59060014 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418012430 con 0x7f042006d4e0 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 -- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f042006d4e0 msgr2=0x7f0420149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f042006d4e0 0x7f0420149480 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0418009e60 tx=0x7f0418009780 comp rx=0 tx=0).stop 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 -- 172.21.15.57:0/59060014 shutdown_connections 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f042006d4e0 0x7f0420149480 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 --2- 172.21.15.57:0/59060014 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420063cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 -- 172.21.15.57:0/59060014 >> 172.21.15.57:0/59060014 conn(0x7f0420069a60 msgr2=0x7f0420069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 -- 172.21.15.57:0/59060014 shutdown_connections 2024-03-18T14:47:18.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.927+0000 7f0427e00700 1 -- 172.21.15.57:0/59060014 wait complete. 2024-03-18T14:47:18.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 Processor -- start 2024-03-18T14:47:18.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 -- start start 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04200b1ff0 0x7f04201516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04200ad130 con 0x7f04200b1ff0 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042009ac80 con 0x7f042006d4e0 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.929+0000 7f0427e00700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04200999a0 con 0x7f04200af530 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f042539b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f042539b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60884/0 (socket says 172.21.15.57:60884) 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54044/0 (socket says 172.21.15.57:54044) 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f042539b700 1 -- 172.21.15.57:0/850623710 learned_addr learned my addr 172.21.15.57:0/850623710 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f042639d700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04200b1ff0 0x7f04201516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 -- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 msgr2=0x7f0420151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 -- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04200b1ff0 msgr2=0x7f04201516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04200b1ff0 0x7f04201516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 -- 172.21.15.57:0/850623710 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04100094f0 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0425b9c700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f041c00c490 tx=0x7f041c007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00ce40 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c011590 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0418009a20 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.930+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c011950 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.931+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420099510 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.931+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f041c011d00 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.931+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0420099730 con 0x7f042006d4e0 2024-03-18T14:47:18.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.932+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f041c05a510 con 0x7f042006d4e0 2024-03-18T14:47:18.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:18.935+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f041c0386d0 con 0x7f042006d4e0 2024-03-18T14:47:19.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.098+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f042009a8e0 con 0x7f042006d4e0 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.099+0000 7f0415ffb700 1 -- 172.21.15.57:0/850623710 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v36) v1 ==== 81+0+21154 (secure 0 0 0) 0x7f041c017070 con 0x7f042006d4e0 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 36, 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-03-18T14:40:54.335193+0000", 2024-03-18T14:47:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-03-18T14:47:18.629637+0000", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "last_up_change": "2024-03-18T14:47:16.428036+0000", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "last_in_change": "2024-03-18T14:40:59.413584+0000", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_num": 5799936, 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_set": [ 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "pglog_hardlimit", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "purged_snapdirs", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_deletes", 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "sortbitwise" 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_version": 8, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "full_ratio": 0.94999998807907104, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "nearfull_ratio": 0.85000002384185791, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_snapshot": "", 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_max": 4, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "max_osd": 4, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "require_min_compat_client": "octopus", 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "min_compat_client": "jewel", 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "require_osd_release": "octopus", 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "pools": [ 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 1, 2024-03-18T14:47:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": ".mgr", 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-03-18T14:40:56.461069+0000", 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-03-18T14:47:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 1, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 1, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 1, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 1, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 1, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "22", 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-03-18T14:47:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-03-18T14:47:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-03-18T14:47:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 1 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": {}, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr_devicehealth": {} 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 2, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "rbd", 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-03-18T14:41:03.450055+0000", 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-03-18T14:47:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 8, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 8, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 8, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 8, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 8, 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-03-18T14:47:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "14", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-03-18T14:47:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-18T14:47:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-03-18T14:47:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "options": {}, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "rbd": {} 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 3, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_metadata", 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-03-18T14:41:11.444063+0000", 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-03-18T14:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 32, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 32, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 32, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 32, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 32, 2024-03-18T14:47:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "17", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-03-18T14:47:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-03-18T14:47:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-03-18T14:47:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_bias": 4, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 16, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "recovery_priority": 5 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": "cephfs" 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "pool": 4, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_name": "cephfs_data", 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "create_time": "2024-03-18T14:41:12.438862+0000", 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 1, 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_names": "hashpspool", 2024-03-18T14:47:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "type": 1, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 2, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "min_size": 1, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_rule": 0, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_count": 0, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_target": 0, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_barrier": 0, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "object_hash": 2, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_autoscale_mode": "off", 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num": 64, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num": 64, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_placement_num_target": 64, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_target": 64, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_pending": 64, 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "last_pg_merge_meta": { 2024-03-18T14:47:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "source_pgid": "0.0", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "ready_epoch": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_started": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_epoch_clean": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "source_version": "0'0", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "target_version": "0'0" 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_change": "18", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend": "0", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_prenautilus": "0", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "last_force_op_resend_preluminous": "0", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "auid": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_mode": "selfmanaged", 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_seq": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "snap_epoch": 0, 2024-03-18T14:47:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "pool_snaps": [], 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps": "[]", 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_bytes": 0, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "quota_max_objects": 0, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "tiers": [], 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "tier_of": -1, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "read_tier": -1, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "write_tier": -1, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_mode": "none", 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_bytes": 0, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "target_max_objects": 0, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_target_full_ratio_micro": 800000, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_flush_age": 0, 2024-03-18T14:47:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "cache_min_evict_age": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profile": "", 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_params": { 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "none" 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_period": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_count": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "use_gmt_hitset": true, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "min_read_recency_for_promote": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "min_write_recency_for_promote": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_grade_decay_rate": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "hit_set_search_last_n": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "grade_table": [], 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "stripe_width": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "expected_num_objects": 0, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "fast_read": false, 2024-03-18T14:47:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "options": { 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_num_min": 64, 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "target_size_ratio": 0.89999997615814209 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "application_metadata": { 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "cephfs": { 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "data": "cephfs" 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "osds": [ 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "674b74ac-d72f-4d09-bacf-b63061fe0927", 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-03-18T14:47:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 9, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 22, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 28, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 23, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6800", 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50045 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6801", 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50045 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6803", 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50045 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6802", 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50045 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6800/50045", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6801/50045", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6803/50045", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6802/50045", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "eb13ed10-144d-4d6f-9b89-7b855befb612", 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-03-18T14:47:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 9, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 23, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 29, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 24, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6804", 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50128 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6805", 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50128 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6807", 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50128 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6806", 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50128 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6804/50128", 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6805/50128", 2024-03-18T14:47:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6807/50128", 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6806/50128", 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad", 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-03-18T14:47:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 9, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 24, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 30, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 25, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6808", 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50245 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-03-18T14:47:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6809", 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50245 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6811", 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50245 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6810", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50245 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6808/50245", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6809/50245", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6811/50245", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6810/50245", 2024-03-18T14:47:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "uuid": "208ece67-3817-45fa-9e1c-415cf5fd1e00", 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "up": 1, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "in": 1, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "weight": 1, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_affinity": 1, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_begin": 9, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "last_clean_end": 25, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "up_from": 32, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "up_thru": 32, 2024-03-18T14:47:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "down_at": 26, 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "lost_at": 0, 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addrs": { 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6812", 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50393 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addrs": { 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6813", 2024-03-18T14:47:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50393 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addrs": { 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6815", 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50393 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addrs": { 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6814", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 50393 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "public_addr": "172.21.15.57:6812/50393", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_addr": "172.21.15.57:6813/50393", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_back_addr": "172.21.15.57:6815/50393", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "heartbeat_front_addr": "172.21.15.57:6814/50393", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "state": [ 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "exists", 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "up" 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_xinfo": [ 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-03-18T14:40:58.334545+0000", 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 23 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 1, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-03-18T14:47:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-03-18T14:40:58.363433+0000", 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 24 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 2, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "0.000000", 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-03-18T14:40:58.321596+0000", 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 25 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": 3, 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "down_stamp": "2024-03-18T14:47:06.627764+0000", 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_probability": 0, 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "laggy_interval": 0, 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "old_weight": 0, 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "last_purged_snaps_scrub": "2024-03-18T14:40:58.351592+0000", 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "dead_epoch": 0 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap": [], 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_upmap_items": [], 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "pg_temp": [], 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "primary_temp": [], 2024-03-18T14:47:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklist": { 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6819/2329339569": "2024-03-19T14:47:18.613680+0000", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:0/1711862619": "2024-03-19T14:46:53.512574+0000", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:6816/39496": "2024-03-19T14:46:53.512574+0000", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:0/2550387238": "2024-03-19T14:46:53.512574+0000", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "172.21.15.57:0/2355346234": "2024-03-19T14:46:53.512574+0000" 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "range_blocklist": {}, 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "erasure_code_profiles": { 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "default": { 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "crush-failure-domain": "osd", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "k": "2", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "m": "1", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "plugin": "jerasure", 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "technique": "reed_sol_van" 2024-03-18T14:47:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "removed_snaps_queue": [], 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "new_removed_snaps": [], 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "new_purged_snaps": [], 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "crush_node_flags": {}, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "device_class_flags": {}, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode": { 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_enabled": false, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_bucket_count": 0, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "degraded_stretch_mode": 0, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "recovering_stretch_mode": 0, 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "stretch_mode_bucket": 0 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.144 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 >> v1:172.21.15.57:6816/47480 conn(0x7f0404046010 legacy=0x7f04040484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 msgr2=0x7f0420098fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f041c00c490 tx=0x7f041c007ea0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 shutdown_connections 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04200b1ff0 0x7f04201516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f042006d4e0 0x7f0420098fd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 --2- 172.21.15.57:0/850623710 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f04200af530 0x7f0420151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 >> 172.21.15.57:0/850623710 conn(0x7f0420069a60 msgr2=0x7f04200af930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 shutdown_connections 2024-03-18T14:47:19.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.101+0000 7f0427e00700 1 -- 172.21.15.57:0/850623710 wait complete. 2024-03-18T14:47:19.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2024-03-18T14:47:19.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.264+0000 7fc52c4a1700 1 Processor -- start 2024-03-18T14:47:19.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.264+0000 7fc52c4a1700 1 -- start start 2024-03-18T14:47:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.264+0000 7fc52c4a1700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.264+0000 7fc52c4a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 0x7fc52413e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.264+0000 7fc52c4a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 0x7fc52413e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52c4a1700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5240a5400 con 0x7fc5240a5030 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52c4a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52406f350 con 0x7fc52406ed90 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52c4a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc52406f610 con 0x7fc52406e980 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52a23d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52a23d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37530/0 (socket says 172.21.15.57:37530) 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52a23d700 1 -- 172.21.15.57:0/1737421838 learned_addr learned my addr 172.21.15.57:0/1737421838 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 0x7fc52413e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc529a3c700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 0x7fc52413e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 -- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 msgr2=0x7fc52413e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 0x7fc52413e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 -- 172.21.15.57:0/1737421838 >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 msgr2=0x7fc5240adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:19.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 --2- 172.21.15.57:0/1737421838 >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 -- 172.21.15.57:0/1737421838 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240ae4d0 con 0x7fc52406ed90 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52a23d700 1 --2- 172.21.15.57:0/1737421838 >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc529a3c700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 0x7fc52413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52aa3e700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 0x7fc52413e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009e60 tx=0x7fc51c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2319a1964356270 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52923b700 1 -- 172.21.15.57:0/1737421838 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c00bbf0 con 0x7fc52406ed90 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52923b700 1 -- 172.21.15.57:0/1737421838 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00bd50 con 0x7fc52406ed90 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.265+0000 7fc52923b700 1 -- 172.21.15.57:0/1737421838 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c010720 con 0x7fc52406ed90 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 -- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 msgr2=0x7fc52413e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 0x7fc52413e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009e60 tx=0x7fc51c009780 comp rx=0 tx=0).stop 2024-03-18T14:47:19.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 -- 172.21.15.57:0/1737421838 shutdown_connections 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406ed90 0x7fc52413e890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/1737421838 >> v2:172.21.15.57:3300/0 conn(0x7fc5240a5030 0x7fc5240adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/1737421838 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc52406e980 0x7fc52413e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 -- 172.21.15.57:0/1737421838 >> 172.21.15.57:0/1737421838 conn(0x7fc5240635c0 msgr2=0x7fc5240639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 -- 172.21.15.57:0/1737421838 shutdown_connections 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.266+0000 7fc52c4a1700 1 -- 172.21.15.57:0/1737421838 wait complete. 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.267+0000 7fc52c4a1700 1 Processor -- start 2024-03-18T14:47:19.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.267+0000 7fc52c4a1700 1 -- start start 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 0x7fc5240a7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5240a5030 0x7fc52414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240a87a0 con 0x7fc52406ed90 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5240a5760 con 0x7fc52406e980 2024-03-18T14:47:19.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52c4a1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc524137b40 con 0x7fc5240a5030 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52a23d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 0x7fc5240a7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52a23d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 0x7fc5240a7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54068/0 (socket says 172.21.15.57:54068) 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37534/0 (socket says 172.21.15.57:37534) 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52a23d700 1 -- 172.21.15.57:0/4107385066 learned_addr learned my addr 172.21.15.57:0/4107385066 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc52aa3e700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5240a5030 0x7fc52414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 -- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5240a5030 msgr2=0x7fc52414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5240a5030 0x7fc52414d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 -- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 msgr2=0x7fc5240a7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 0x7fc5240a7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 -- 172.21.15.57:0/4107385066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52000b780 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc529a3c700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc514006fd0 tx=0x7fc514008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514013410 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.268+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc514013570 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.269+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51c009a20 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.269+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514013930 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.269+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5240a8340 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.269+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc514013d20 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.270+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc51405ae60 con 0x7fc52406ed90 2024-03-18T14:47:19.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.270+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52404c710 con 0x7fc52406ed90 2024-03-18T14:47:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.274+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc51407ddc0 con 0x7fc52406ed90 2024-03-18T14:47:19.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.501+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc52406a0c0 con 0x7fc52406ed90 2024-03-18T14:47:19.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.501+0000 7fc51a7fc700 1 -- 172.21.15.57:0/4107385066 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fc514039140 con 0x7fc52406ed90 2024-03-18T14:47:19.503 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": { 2024-03-18T14:47:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)": 3 2024-03-18T14:47:19.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": { 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)": 2 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": { 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)": 4 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": { 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)": 3 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "overall": { 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)": 12 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:19.504 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:19.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 >> v1:172.21.15.57:6816/47480 conn(0x7fc508046040 legacy=0x7fc5080484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 msgr2=0x7fc5240a6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc514006fd0 tx=0x7fc514008040 comp rx=0 tx=0).stop 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 shutdown_connections 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc5240a5030 0x7fc52414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc52406e980 0x7fc5240a7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.503+0000 7fc52c4a1700 1 --2- 172.21.15.57:0/4107385066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc52406ed90 0x7fc5240a6c70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.504+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 >> 172.21.15.57:0/4107385066 conn(0x7fc5240635c0 msgr2=0x7fc5240aeb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.504+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 shutdown_connections 2024-03-18T14:47:19.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.504+0000 7fc52c4a1700 1 -- 172.21.15.57:0/4107385066 wait complete. 2024-03-18T14:47:19.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy' 2024-03-18T14:47:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.647+0000 7f2146b1f700 1 Processor -- start 2024-03-18T14:47:19.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.647+0000 7f2146b1f700 1 -- start start 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400acc00 con 0x7f2140070d50 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400acee0 con 0x7f2140139680 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f2146b1f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f214013f670 con 0x7f21400ad8d0 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21450bc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21448bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21448bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37548/0 (socket says 172.21.15.57:37548) 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60922/0 (socket says 172.21.15.57:60922) 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21450bc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54078/0 (socket says 172.21.15.57:54078) 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21448bb700 1 -- 172.21.15.57:0/3246439164 learned_addr learned my addr 172.21.15.57:0/3246439164 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 -- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 msgr2=0x7f214006e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 -- 172.21.15.57:0/3246439164 >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 msgr2=0x7f21400ac050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 --2- 172.21.15.57:0/3246439164 >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f213ffff700 1 -- 172.21.15.57:0/3246439164 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214013f910 con 0x7f21400ad8d0 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21448bb700 1 --2- 172.21.15.57:0/3246439164 >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.648+0000 7f21450bc700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f213ffff700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f212c0098e0 tx=0x7f212c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88ee84e3a2f52c43 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:19.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f213f7fe700 1 -- 172.21.15.57:0/3246439164 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c011630 con 0x7f21400ad8d0 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f213f7fe700 1 -- 172.21.15.57:0/3246439164 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c011790 con 0x7f21400ad8d0 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f213f7fe700 1 -- 172.21.15.57:0/3246439164 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c011b30 con 0x7f21400ad8d0 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 -- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 msgr2=0x7f2140139140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f212c0098e0 tx=0x7f212c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 -- 172.21.15.57:0/3246439164 shutdown_connections 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140139680 0x7f214006e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 --2- 172.21.15.57:0/3246439164 >> v2:172.21.15.57:3300/0 conn(0x7f2140070d50 0x7f21400ac050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 --2- 172.21.15.57:0/3246439164 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f2140139140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.649+0000 7f2146b1f700 1 -- 172.21.15.57:0/3246439164 >> 172.21.15.57:0/3246439164 conn(0x7f214006f480 msgr2=0x7f214006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.650+0000 7f2146b1f700 1 -- 172.21.15.57:0/3246439164 shutdown_connections 2024-03-18T14:47:19.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.650+0000 7f2146b1f700 1 -- 172.21.15.57:0/3246439164 wait complete. 2024-03-18T14:47:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.650+0000 7f2146b1f700 1 Processor -- start 2024-03-18T14:47:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 -- start start 2024-03-18T14:47:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 0x7f21400aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2140139680 0x7f21400a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2140138980 con 0x7f2140139680 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400ab590 con 0x7f2140070d50 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f2146b1f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21400aa8d0 con 0x7f21400ad8d0 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f213ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f21448bb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 0x7f21400aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f213ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60928/0 (socket says 172.21.15.57:60928) 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f213ffff700 1 -- 172.21.15.57:0/979148906 learned_addr learned my addr 172.21.15.57:0/979148906 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f21448bb700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 0x7f21400aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54084/0 (socket says 172.21.15.57:54084) 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.651+0000 7f21450bc700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2140139680 0x7f21400a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 -- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 msgr2=0x7f21400aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 0x7f21400aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 -- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2140139680 msgr2=0x7f21400a6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2140139680 0x7f21400a6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:19.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 -- 172.21.15.57:0/979148906 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340094f0 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213ffff700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f214013f7b0 tx=0x7f212c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c011b10 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c0253f0 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f2146b1f700 1 -- 172.21.15.57:0/979148906 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2138009a20 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c025790 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.652+0000 7f2146b1f700 1 -- 172.21.15.57:0/979148906 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c009420 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.653+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21180052b0 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.653+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f212c025b80 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.654+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f212c05c8e0 con 0x7f21400ad8d0 2024-03-18T14:47:19.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.657+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f212c02fd20 con 0x7f21400ad8d0 2024-03-18T14:47:19.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:19.831+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f2118005ae0 con 0x7f21400ad8d0 2024-03-18T14:47:20.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.620+0000 7f213cff9700 1 -- 172.21.15.57:0/979148906 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0 v37) v1 ==== 92+0+0 (secure 0 0 0) 0x7f212c02f910 con 0x7f21400ad8d0 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 >> v1:172.21.15.57:6816/47480 conn(0x7f2124046040 legacy=0x7f21240484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 msgr2=0x7f21400a6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f214013f7b0 tx=0x7f212c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 shutdown_connections 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2140139680 0x7f21400a6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2140070d50 0x7f21400aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 --2- 172.21.15.57:0/979148906 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f21400ad8d0 0x7f21400a6700 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 >> 172.21.15.57:0/979148906 conn(0x7f214006f480 msgr2=0x7f2140063d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 shutdown_connections 2024-03-18T14:47:20.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.622+0000 7f212a7fc700 1 -- 172.21.15.57:0/979148906 wait complete. 2024-03-18T14:47:20.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2024-03-18T14:47:20.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.758+0000 7f4031cd1700 1 Processor -- start 2024-03-18T14:47:20.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.758+0000 7f4031cd1700 1 -- start start 2024-03-18T14:47:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f4031cd1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f4031cd1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 0x7f402c13b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f4031cd1700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402c0a3470 con 0x7f402c13bc70 2024-03-18T14:47:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f4031cd1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c06ca50 con 0x7f402c0a4400 2024-03-18T14:47:20.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f4031cd1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402c06ccf0 con 0x7f402c06e290 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 0x7f402c13b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54098/0 (socket says 172.21.15.57:54098) 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 -- 172.21.15.57:0/1876042524 learned_addr learned my addr 172.21.15.57:0/1876042524 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 -- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 msgr2=0x7f402c13b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 0x7f402c13b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 -- 172.21.15.57:0/1876042524 >> v1:172.21.15.57:6789/0 conn(0x7f402c13bc70 legacy=0x7f402c13e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402b7fe700 1 -- 172.21.15.57:0/1876042524 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c06d990 con 0x7f402c0a4400 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.759+0000 7f402a7fc700 1 -- 172.21.15.57:0/1876042524 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965649725 0 0) 0x7f402c0a3470 con 0x7f402c13bc70 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f402affd700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 0x7f402c13b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f402b7fe700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f401c00de30 tx=0x7f401c00d6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3036aa4868f10736 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f402a7fc700 1 -- 172.21.15.57:0/1876042524 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c012070 con 0x7f402c0a4400 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f402a7fc700 1 -- 172.21.15.57:0/1876042524 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00d2e0 con 0x7f402c0a4400 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f402a7fc700 1 -- 172.21.15.57:0/1876042524 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00fb20 con 0x7f402c0a4400 2024-03-18T14:47:20.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 -- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 msgr2=0x7f402c0b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f401c00de30 tx=0x7f401c00d6f0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 -- 172.21.15.57:0/1876042524 shutdown_connections 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c0a4400 0x7f402c0b1f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 --2- 172.21.15.57:0/1876042524 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c06e290 0x7f402c13b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.760+0000 7f4031cd1700 1 -- 172.21.15.57:0/1876042524 >> 172.21.15.57:0/1876042524 conn(0x7f402c06be00 msgr2=0x7f402c069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.761+0000 7f4031cd1700 1 -- 172.21.15.57:0/1876042524 shutdown_connections 2024-03-18T14:47:20.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.761+0000 7f4031cd1700 1 -- 172.21.15.57:0/1876042524 wait complete. 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.762+0000 7f4031cd1700 1 Processor -- start 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.762+0000 7f4031cd1700 1 -- start start 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f402c0a4400 0x7f402c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c13bc70 0x7f402c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0a9050 con 0x7f402c0a4400 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402c0a92f0 con 0x7f402c06e290 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f4031cd1700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f402c139460 con 0x7f402c13bc70 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:20.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54106/0 (socket says 172.21.15.57:54106) 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 -- 172.21.15.57:0/3145040326 learned_addr learned my addr 172.21.15.57:0/3145040326 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402bfff700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c13bc70 0x7f402c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402affd700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f402c0a4400 0x7f402c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 -- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c13bc70 msgr2=0x7f402c14cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c13bc70 0x7f402c14cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 -- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f402c0a4400 msgr2=0x7f402c14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f402c0a4400 0x7f402c14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 -- 172.21.15.57:0/3145040326 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402000b4e0 con 0x7f402c06e290 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.763+0000 7f402b7fe700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f401c00d960 tx=0x7f401c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.764+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00c900 con 0x7f402c06e290 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.764+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00ca60 con 0x7f402c06e290 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.764+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c00d990 con 0x7f402c06e290 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.764+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00ce20 con 0x7f402c06e290 2024-03-18T14:47:20.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.764+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f402c0a8c10 con 0x7f402c06e290 2024-03-18T14:47:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.765+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f401c02a620 con 0x7f402c06e290 2024-03-18T14:47:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.765+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f402c0a8e00 con 0x7f402c06e290 2024-03-18T14:47:20.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.765+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f401c060c40 con 0x7f402c06e290 2024-03-18T14:47:20.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.769+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f401c006870 con 0x7f402c06e290 2024-03-18T14:47:20.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.951+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f402c04c710 con 0x7f402c06e290 2024-03-18T14:47:20.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.951+0000 7f40137fe700 1 -- 172.21.15.57:0/3145040326 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v37) v1 ==== 59+0+37 (secure 0 0 0) 0x7f401c02f020 con 0x7f402c06e290 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 >> v1:172.21.15.57:6816/47480 conn(0x7f4018046010 legacy=0x7f40180484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 msgr2=0x7f402c0a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f401c00d960 tx=0x7f401c01c000 comp rx=0 tx=0).stop 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 shutdown_connections 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f402c13bc70 0x7f402c14cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f402c06e290 0x7f402c0a7af0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 --2- 172.21.15.57:0/3145040326 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f402c0a4400 0x7f402c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:20.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 >> 172.21.15.57:0/3145040326 conn(0x7f402c06be00 msgr2=0x7f402c064ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:20.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 shutdown_connections 2024-03-18T14:47:20.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:20.953+0000 7f4031cd1700 1 -- 172.21.15.57:0/3145040326 wait complete. 2024-03-18T14:47:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 Processor -- start 2024-03-18T14:47:21.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 -- start start 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 0x7fdfa00a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 0x7fdfa0148d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfa00a2b60 con 0x7fdfa00a2790 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa00a3bb0 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.080+0000 7fdfa5a81700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa00a3e70 con 0x7fdfa00a20f0 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9ffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 0x7fdfa0148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9f7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdfa00a2790 0x7fdfa013ee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36340/0 (socket says 172.21.15.57:36340) 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 0x7fdfa00a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9f7fe700 1 -- 172.21.15.57:0/2498979747 learned_addr learned my addr 172.21.15.57:0/2498979747 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 -- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 msgr2=0x7fdfa0148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 0x7fdfa0148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 -- 172.21.15.57:0/2498979747 >> v1:172.21.15.57:6789/0 conn(0x7fdfa00a2790 legacy=0x7fdfa013ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 -- 172.21.15.57:0/2498979747 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa013f5a0 con 0x7fdfa00a20f0 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9ffff700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 0x7fdfa0148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9effd700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 0x7fdfa00a4cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009910 tx=0x7fdf940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82dea59b431c8196 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9e7fc700 1 -- 172.21.15.57:0/2498979747 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400b680 con 0x7fdfa00a20f0 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9e7fc700 1 -- 172.21.15.57:0/2498979747 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400b7e0 con 0x7fdfa00a20f0 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.081+0000 7fdf9e7fc700 1 -- 172.21.15.57:0/2498979747 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400bba0 con 0x7fdfa00a20f0 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 msgr2=0x7fdfa00a4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 0x7fdfa00a4cf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009910 tx=0x7fdf940091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2498979747 shutdown_connections 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00b4fe0 0x7fdfa0148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2498979747 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00a20f0 0x7fdfa00a4cf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2498979747 >> 172.21.15.57:0/2498979747 conn(0x7fdfa0070cd0 msgr2=0x7fdfa006f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:21.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2498979747 shutdown_connections 2024-03-18T14:47:21.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.082+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2498979747 wait complete. 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.083+0000 7fdfa5a81700 1 Processor -- start 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.083+0000 7fdfa5a81700 1 -- start start 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 0x7fdfa013cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfa00a2790 0x7fdfa013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa013dc30 con 0x7fdfa00a2790 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa013d450 con 0x7fdfa00a20f0 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdfa5a81700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa013d730 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60978/0 (socket says 172.21.15.57:60978) 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 -- 172.21.15.57:0/2786815223 learned_addr learned my addr 172.21.15.57:0/2786815223 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9f7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 0x7fdfa013cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9effd700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfa00a2790 0x7fdfa013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 -- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 msgr2=0x7fdfa013cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 0x7fdfa013cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 -- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfa00a2790 msgr2=0x7fdfa013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfa00a2790 0x7fdfa013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9ffff700 1 -- 172.21.15.57:0/2786815223 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009a20 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.084+0000 7fdf9f7fe700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 0x7fdfa013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdf9ffff700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009f20 tx=0x7fdf9800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9800cc00 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9800f040 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf98014480 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94009420 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.085+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa00a1af0 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.086+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdf98003020 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.086+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa013de00 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.086+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fdf9805bba0 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.090+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fdfa013de00 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.265+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fdfa013de00 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.667+0000 7fdf877fe700 1 -- 172.21.15.57:0/2786815223 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v38) v1 ==== 153+0+0 (secure 0 0 0) 0x7fdfa013de00 con 0x7fdfa00b4fe0 2024-03-18T14:47:21.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 >> v1:172.21.15.57:6816/47480 conn(0x7fdf8c046010 legacy=0x7fdf8c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 msgr2=0x7fdfa0151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009f20 tx=0x7fdf9800b040 comp rx=0 tx=0).stop 2024-03-18T14:47:21.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 shutdown_connections 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdfa00b4fe0 0x7fdfa0151710 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdfa00a20f0 0x7fdfa013cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.668+0000 7fdfa5a81700 1 --2- 172.21.15.57:0/2786815223 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdfa00a2790 0x7fdfa013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.669+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 >> 172.21.15.57:0/2786815223 conn(0x7fdfa0070cd0 msgr2=0x7fdfa00b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.669+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 shutdown_connections 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.669+0000 7fdfa5a81700 1 -- 172.21.15.57:0/2786815223 wait complete. 2024-03-18T14:47:21.671 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 1 pg_autoscale_mode to off 2024-03-18T14:47:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 Processor -- start 2024-03-18T14:47:21.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 -- start start 2024-03-18T14:47:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7da4063cd0 0x7f7da4149410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da406dab0 con 0x7f7da40a4190 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da40a4b90 con 0x7f7da4063cd0 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7daa77e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da40a2870 con 0x7f7da40b1e40 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7da3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7da8d1b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7da4063cd0 0x7f7da4149410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7da8d1b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7da4063cd0 0x7f7da4149410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37580/0 (socket says 172.21.15.57:37580) 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7da3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60986/0 (socket says 172.21.15.57:60986) 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.776+0000 7f7da8d1b700 1 -- 172.21.15.57:0/2851141447 learned_addr learned my addr 172.21.15.57:0/2851141447 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da8d1b700 1 -- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 msgr2=0x7f7da40a3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da8d1b700 1 -- 172.21.15.57:0/2851141447 >> v1:172.21.15.57:6789/0 conn(0x7f7da40a4190 legacy=0x7f7da40635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da8d1b700 1 -- 172.21.15.57:0/2851141447 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40a2ef0 con 0x7f7da4063cd0 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da3fff700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:21.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da2ffd700 1 -- 172.21.15.57:0/2851141447 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2581975248 0 0) 0x7f7d98001110 con 0x7f7da40a4190 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da4063cd0 0x7f7da4149410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009f20 tx=0x7f7d9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f64ca2ce69e63f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da2ffd700 1 -- 172.21.15.57:0/2851141447 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00e070 con 0x7f7da4063cd0 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da2ffd700 1 -- 172.21.15.57:0/2851141447 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c00b9d0 con 0x7f7da4063cd0 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.777+0000 7f7da2ffd700 1 -- 172.21.15.57:0/2851141447 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0092e0 con 0x7f7da4063cd0 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 -- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da4063cd0 msgr2=0x7f7da4149410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da4063cd0 0x7f7da4149410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c009f20 tx=0x7f7d9c009840 comp rx=0 tx=0).stop 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 -- 172.21.15.57:0/2851141447 shutdown_connections 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da4063cd0 0x7f7da4149410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 --2- 172.21.15.57:0/2851141447 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da40a3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 -- 172.21.15.57:0/2851141447 >> 172.21.15.57:0/2851141447 conn(0x7f7da4069940 msgr2=0x7f7da4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 -- 172.21.15.57:0/2851141447 shutdown_connections 2024-03-18T14:47:21.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.778+0000 7f7daa77e700 1 -- 172.21.15.57:0/2851141447 wait complete. 2024-03-18T14:47:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.779+0000 7f7daa77e700 1 Processor -- start 2024-03-18T14:47:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.779+0000 7f7daa77e700 1 -- start start 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 0x7f7da4098cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40a4190 0x7f7da4099f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da4099200 con 0x7f7da40a4190 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da409a900 con 0x7f7da4063cd0 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7daa77e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da414dbd0 con 0x7f7da40b1e40 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7da3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 0x7f7da4098cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7da3fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 0x7f7da4098cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54136/0 (socket says 172.21.15.57:54136) 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7da3fff700 1 -- 172.21.15.57:0/3043483159 learned_addr learned my addr 172.21.15.57:0/3043483159 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.780+0000 7f7da37fe700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40a4190 0x7f7da4099f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 -- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 msgr2=0x7f7da4098cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 0x7f7da4098cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 -- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40a4190 msgr2=0x7f7da4099f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40a4190 0x7f7da4099f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 -- 172.21.15.57:0/3043483159 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d94009420 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7da8d1b700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da414de90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7da4064600 tx=0x7f7d9c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c008b10 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c008c70 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c026460 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c009ae0 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.781+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da40993d0 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.782+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7d9c003040 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.782+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da404c710 con 0x7f7da40b1e40 2024-03-18T14:47:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.782+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f7d9c05d0d0 con 0x7f7da40b1e40 2024-03-18T14:47:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.786+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f7d9c007dd0 con 0x7f7da40b1e40 2024-03-18T14:47:21.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:21.948+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f7da40a3150 con 0x7f7da40b1e40 2024-03-18T14:47:22.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.682+0000 7f7d8bfff700 1 -- 172.21.15.57:0/3043483159 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v39) v1 ==== 152+0+0 (secure 0 0 0) 0x7f7d9c021020 con 0x7f7da40b1e40 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 >> v1:172.21.15.57:6816/47480 conn(0x7f7d90046010 legacy=0x7f7d900484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 msgr2=0x7f7da414de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da414de90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7da4064600 tx=0x7f7d9c018000 comp rx=0 tx=0).stop 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 shutdown_connections 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7da40b1e40 0x7f7da414de90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7da4063cd0 0x7f7da4098cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 --2- 172.21.15.57:0/3043483159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7da40a4190 0x7f7da4099f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 >> 172.21.15.57:0/3043483159 conn(0x7f7da4069940 msgr2=0x7f7da406dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 shutdown_connections 2024-03-18T14:47:22.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.685+0000 7f7daa77e700 1 -- 172.21.15.57:0/3043483159 wait complete. 2024-03-18T14:47:22.688 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 2 pg_autoscale_mode to off 2024-03-18T14:47:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.792+0000 7fc87b022700 1 Processor -- start 2024-03-18T14:47:22.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.792+0000 7fc87b022700 1 -- start start 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 0x7fc8740a4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a20f0 0x7fc8740b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc87413ee90 0x7fc8740a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740b5520 con 0x7fc87413ee90 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740a2b60 con 0x7fc8740a2790 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc87b022700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740a3bb0 con 0x7fc8740a20f0 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc878dbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 0x7fc8740a4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc8795bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc87413ee90 0x7fc8740a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc873fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a20f0 0x7fc8740b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc8795bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc87413ee90 0x7fc8740a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37600/0 (socket says 172.21.15.57:37600) 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc878dbe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 0x7fc8740a4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:54142/0 (socket says 172.21.15.57:54142) 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.793+0000 7fc8795bf700 1 -- 172.21.15.57:0/3361524457 learned_addr learned my addr 172.21.15.57:0/3361524457 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 -- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a20f0 msgr2=0x7fc8740b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a20f0 0x7fc8740b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 -- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 msgr2=0x7fc8740a4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 0x7fc8740a4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 -- 172.21.15.57:0/3361524457 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740a3e70 con 0x7fc87413ee90 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8795bf700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740a5620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009f20 tx=0x7fc86c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44e029ce9e6930e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8737fe700 1 -- 172.21.15.57:0/3361524457 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00e070 con 0x7fc87413ee90 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8737fe700 1 -- 172.21.15.57:0/3361524457 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00b970 con 0x7fc87413ee90 2024-03-18T14:47:22.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.794+0000 7fc8737fe700 1 -- 172.21.15.57:0/3361524457 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0092e0 con 0x7fc87413ee90 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 -- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 msgr2=0x7fc8740a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740a5620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc86c009f20 tx=0x7fc86c009840 comp rx=0 tx=0).stop 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 -- 172.21.15.57:0/3361524457 shutdown_connections 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740a5620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a2790 0x7fc8740a4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 --2- 172.21.15.57:0/3361524457 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a20f0 0x7fc8740b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 -- 172.21.15.57:0/3361524457 >> 172.21.15.57:0/3361524457 conn(0x7fc874070cd0 msgr2=0x7fc87406f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 -- 172.21.15.57:0/3361524457 shutdown_connections 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.795+0000 7fc87b022700 1 -- 172.21.15.57:0/3361524457 wait complete. 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.796+0000 7fc87b022700 1 Processor -- start 2024-03-18T14:47:22.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.796+0000 7fc87b022700 1 -- start start 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a20f0 0x7fc87409d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87409c7c0 con 0x7fc87413ee90 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87409d650 con 0x7fc8740a20f0 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc87b022700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc87409aae0 con 0x7fc8740a2790 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc873fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc873fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:32790/0 (socket says 172.21.15.57:32790) 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc873fff700 1 -- 172.21.15.57:0/1856149970 learned_addr learned my addr 172.21.15.57:0/1856149970 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc8795bf700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.797+0000 7fc878dbe700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a20f0 0x7fc87409d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 -- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a20f0 msgr2=0x7fc87409d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a20f0 0x7fc87409d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 -- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 msgr2=0x7fc8740989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:22.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 -- 172.21.15.57:0/1856149970 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c009ae0 con 0x7fc8740a2790 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc8795bf700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc873fff700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc86000ec50 tx=0x7fc8600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000c850 con 0x7fc8740a2790 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000c9b0 con 0x7fc8740a2790 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87409ad80 con 0x7fc8740a2790 2024-03-18T14:47:22.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000cd70 con 0x7fc8740a2790 2024-03-18T14:47:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.798+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874099b20 con 0x7fc8740a2790 2024-03-18T14:47:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.799+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87404c710 con 0x7fc8740a2790 2024-03-18T14:47:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.800+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc860013680 con 0x7fc8740a2790 2024-03-18T14:47:22.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.800+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc86005b870 con 0x7fc8740a2790 2024-03-18T14:47:22.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.803+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc860039c80 con 0x7fc8740a2790 2024-03-18T14:47:22.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:22.975+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fc8740a41d0 con 0x7fc8740a2790 2024-03-18T14:47:23.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.711+0000 7fc870ff9700 1 -- 172.21.15.57:0/1856149970 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v40) v1 ==== 164+0+0 (secure 0 0 0) 0x7fc860021030 con 0x7fc8740a2790 2024-03-18T14:47:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.713+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 >> v1:172.21.15.57:6816/47480 conn(0x7fc858046010 legacy=0x7fc8580484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 msgr2=0x7fc874140d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc86000ec50 tx=0x7fc8600091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 shutdown_connections 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc87413ee90 0x7fc8740989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc8740a20f0 0x7fc87409d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 --2- 172.21.15.57:0/1856149970 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc8740a2790 0x7fc874140d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 >> 172.21.15.57:0/1856149970 conn(0x7fc874070cd0 msgr2=0x7fc8740b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 shutdown_connections 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.714+0000 7fc87b022700 1 -- 172.21.15.57:0/1856149970 wait complete. 2024-03-18T14:47:23.716 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 3 pg_autoscale_mode to off 2024-03-18T14:47:23.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.821+0000 7f3cd087e700 1 Processor -- start 2024-03-18T14:47:23.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.821+0000 7f3cd087e700 1 -- start start 2024-03-18T14:47:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cd087e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ccc1444f0 0x7f3ccc1468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cd087e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc146e10 0x7f3ccc1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cd087e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc06fa10 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cd087e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc0693d0 con 0x7f3ccc1444f0 2024-03-18T14:47:23.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cd087e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc06eec0 con 0x7f3ccc146e10 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ccc1444f0 0x7f3ccc1468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3ccc1444f0 0x7f3ccc1468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34068/0 (socket says 172.21.15.57:34068) 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 -- 172.21.15.57:0/672607906 learned_addr learned my addr 172.21.15.57:0/672607906 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3ccad9d700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc146e10 0x7f3ccc1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 -- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc146e10 msgr2=0x7f3ccc1491f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc146e10 0x7f3ccc1491f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 -- 172.21.15.57:0/672607906 >> v1:172.21.15.57:6789/0 conn(0x7f3ccc0b30d0 legacy=0x7f3ccc06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc959a700 1 -- 172.21.15.57:0/672607906 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761475069 0 0) 0x7f3ccc06fa10 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.822+0000 7f3cc9d9b700 1 -- 172.21.15.57:0/672607906 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc06f160 con 0x7f3ccc1444f0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cc9d9b700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1468d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a20128356c2046 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cc959a700 1 -- 172.21.15.57:0/672607906 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4009ea0 con 0x7f3ccc1444f0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cc959a700 1 -- 172.21.15.57:0/672607906 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb400b860 con 0x7f3ccc1444f0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cc959a700 1 -- 172.21.15.57:0/672607906 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb400bc00 con 0x7f3ccc1444f0 2024-03-18T14:47:23.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 -- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 msgr2=0x7f3ccc1468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1468d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40099b0 tx=0x7f3cb4009250 comp rx=0 tx=0).stop 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 -- 172.21.15.57:0/672607906 shutdown_connections 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc146e10 0x7f3ccc1491f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 --2- 172.21.15.57:0/672607906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1468d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.823+0000 7f3cd087e700 1 -- 172.21.15.57:0/672607906 >> 172.21.15.57:0/672607906 conn(0x7f3ccc06d120 msgr2=0x7f3ccc06ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.824+0000 7f3cd087e700 1 -- 172.21.15.57:0/672607906 shutdown_connections 2024-03-18T14:47:23.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.824+0000 7f3cd087e700 1 -- 172.21.15.57:0/672607906 wait complete. 2024-03-18T14:47:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.824+0000 7f3cd087e700 1 Processor -- start 2024-03-18T14:47:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 -- start start 2024-03-18T14:47:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:23.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ccc146e10 0x7f3ccc151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc145bf0 con 0x7f3ccc1444f0 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc145110 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.825+0000 7f3cd087e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc145370 con 0x7f3ccc146e10 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42924/0 (socket says 172.21.15.57:42924) 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 -- 172.21.15.57:0/32705988 learned_addr learned my addr 172.21.15.57:0/32705988 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3ccad9d700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ccc146e10 0x7f3ccc151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cc9d9b700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 -- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ccc146e10 msgr2=0x7f3ccc151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ccc146e10 0x7f3ccc151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 -- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 msgr2=0x7f3ccc1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:23.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 -- 172.21.15.57:0/32705988 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40094f0 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cca59c700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00c7e0 tx=0x7f3cbc007da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc011590 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc011710 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc011ad0 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc146ad0 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.826+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc13f840 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.828+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc145690 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.829+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3cbc01b3b0 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.829+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3cbc05ab40 con 0x7f3ccc0b30d0 2024-03-18T14:47:23.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:23.832+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f3cbc038ce0 con 0x7f3ccc0b30d0 2024-03-18T14:47:24.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.009+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f3ccc04c710 con 0x7f3ccc0b30d0 2024-03-18T14:47:24.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.709+0000 7f3cc27fc700 1 -- 172.21.15.57:0/32705988 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v41) v1 ==== 160+0+0 (secure 0 0 0) 0x7f3cbc017030 con 0x7f3ccc0b30d0 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 >> v1:172.21.15.57:6816/47480 conn(0x7f3cac046010 legacy=0x7f3cac0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 msgr2=0x7f3ccc144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc00c7e0 tx=0x7f3cbc007da0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 shutdown_connections 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3ccc146e10 0x7f3ccc151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3ccc0b30d0 0x7f3ccc144bd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 --2- 172.21.15.57:0/32705988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3ccc1444f0 0x7f3ccc1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 >> 172.21.15.57:0/32705988 conn(0x7f3ccc06d120 msgr2=0x7f3ccc0635c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 shutdown_connections 2024-03-18T14:47:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.712+0000 7f3cd087e700 1 -- 172.21.15.57:0/32705988 wait complete. 2024-03-18T14:47:24.715 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 4 pg_autoscale_mode to off 2024-03-18T14:47:24.726 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-03-18T14:47:24.738 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T14:47:24.738 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T14:47:24.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T14:47:24.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.857+0000 7fccf3899700 1 Processor -- start 2024-03-18T14:47:24.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.857+0000 7fccf3899700 1 -- start start 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf3899700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf3899700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 0x7fccec13d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf3899700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec0ac720 con 0x7fccec13db90 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf3899700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec06d230 con 0x7fccec0ad300 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf3899700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0ac9c0 con 0x7fccec063a90 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49126/0 (socket says 172.21.15.57:49126) 2024-03-18T14:47:24.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 -- 172.21.15.57:0/3803707465 learned_addr learned my addr 172.21.15.57:0/3803707465 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf0e34700 1 --2- 172.21.15.57:0/3803707465 >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 0x7fccec13d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccebfff700 1 -- 172.21.15.57:0/3803707465 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471315073 0 0) 0x7fccec0ac720 con 0x7fccec13db90 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 -- 172.21.15.57:0/3803707465 >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 msgr2=0x7fccec13d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 --2- 172.21.15.57:0/3803707465 >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 0x7fccec13d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 -- 172.21.15.57:0/3803707465 >> v1:172.21.15.57:6789/0 conn(0x7fccec13db90 legacy=0x7fccec1417a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 -- 172.21.15.57:0/3803707465 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0ad810 con 0x7fccec063a90 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf0e34700 1 --2- 172.21.15.57:0/3803707465 >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 0x7fccec13d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.858+0000 7fccf1635700 1 --2- 172.21.15.57:0/3803707465 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcce40099e0 tx=0x7fcce4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651fce1c81ac5d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccebfff700 1 -- 172.21.15.57:0/3803707465 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400b8b0 con 0x7fccec063a90 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccebfff700 1 -- 172.21.15.57:0/3803707465 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400ba10 con 0x7fccec063a90 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccebfff700 1 -- 172.21.15.57:0/3803707465 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce400bdb0 con 0x7fccec063a90 2024-03-18T14:47:24.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 -- 172.21.15.57:0/3803707465 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 msgr2=0x7fccec06dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 --2- 172.21.15.57:0/3803707465 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcce40099e0 tx=0x7fcce4009250 comp rx=0 tx=0).stop 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 -- 172.21.15.57:0/3803707465 shutdown_connections 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 --2- 172.21.15.57:0/3803707465 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec06dcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 --2- 172.21.15.57:0/3803707465 >> v2:172.21.15.57:3300/0 conn(0x7fccec0ad300 0x7fccec13d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 -- 172.21.15.57:0/3803707465 >> 172.21.15.57:0/3803707465 conn(0x7fccec06f500 msgr2=0x7fccec06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 -- 172.21.15.57:0/3803707465 shutdown_connections 2024-03-18T14:47:24.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.859+0000 7fccf3899700 1 -- 172.21.15.57:0/3803707465 wait complete. 2024-03-18T14:47:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.860+0000 7fccf3899700 1 Processor -- start 2024-03-18T14:47:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.860+0000 7fccf3899700 1 -- start start 2024-03-18T14:47:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:24.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccec13db90 0x7fccec1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0afc00 con 0x7fccec0ad300 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0afea0 con 0x7fccec13db90 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf3899700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccec119fa0 con 0x7fccec063a90 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf0e34700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49130/0 (socket says 172.21.15.57:49130) 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf0e34700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34108/0 (socket says 172.21.15.57:34108) 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 -- 172.21.15.57:0/1153827759 learned_addr learned my addr 172.21.15.57:0/1153827759 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1e36700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccec13db90 0x7fccec1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 -- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccec13db90 msgr2=0x7fccec1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccec13db90 0x7fccec1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 -- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 msgr2=0x7fccec1513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf1635700 1 -- 172.21.15.57:0/1153827759 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009420 con 0x7fccec063a90 2024-03-18T14:47:24.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.861+0000 7fccf0e34700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fccf1635700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccec0acb00 tx=0x7fcce4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4011d30 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce4011e90 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcce40094f0 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4024690 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.862+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec119600 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.863+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec11a160 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.863+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fcce401a420 con 0x7fccec063a90 2024-03-18T14:47:24.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.863+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fcce405bd60 con 0x7fccec063a90 2024-03-18T14:47:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:24.867+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fcce4028c60 con 0x7fccec063a90 2024-03-18T14:47:25.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.066+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fccec065180 con 0x7fccec063a90 2024-03-18T14:47:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.068+0000 7fcce97fa700 1 -- 172.21.15.57:0/1153827759 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+105262 (secure 0 0 0) 0x7fcce4015070 con 0x7fccec063a90 2024-03-18T14:47:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 >> v1:172.21.15.57:6816/47480 conn(0x7fccd8046010 legacy=0x7fccd80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 msgr2=0x7fccec11a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccec0acb00 tx=0x7fcce4017000 comp rx=0 tx=0).stop 2024-03-18T14:47:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 shutdown_connections 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fccec13db90 0x7fccec1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fccec063a90 0x7fccec11a440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 --2- 172.21.15.57:0/1153827759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fccec0ad300 0x7fccec1513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 >> 172.21.15.57:0/1153827759 conn(0x7fccec06f500 msgr2=0x7fccec13e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 shutdown_connections 2024-03-18T14:47:25.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.070+0000 7fccf3899700 1 -- 172.21.15.57:0/1153827759 wait complete. 2024-03-18T14:47:25.083 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"active_gid":14102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6816","nonce":47480}]},"active_addr":"172.21.15.57:6816/47480","active_change":"2024-03-18T14:46:53.512726+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14098,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":4171732849}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":314676276}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":77220221}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1158086678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3718804678}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":606709445}]}]} 2024-03-18T14:47:25.086 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T14:47:25.086 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T14:47:25.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:25.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.205+0000 7fc7fe0aa700 1 Processor -- start 2024-03-18T14:47:25.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.205+0000 7fc7fe0aa700 1 -- start start 2024-03-18T14:47:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7fe0aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 0x7fc7f8138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7fe0aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 0x7fc7f81457c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7fe0aa700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f813e420 con 0x7fc7f8063840 2024-03-18T14:47:25.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7fe0aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f806e560 con 0x7fc7f8138690 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7fe0aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f813e650 con 0x7fc7f806d7e0 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7f77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7f8063840 0x7fc7f806ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58520/0 (socket says 172.21.15.57:58520) 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7f77fe700 1 -- 172.21.15.57:0/1715815372 learned_addr learned my addr 172.21.15.57:0/1715815372 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7f7fff700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 0x7fc7f81457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.206+0000 7fc7f6ffd700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 0x7fc7f8138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f67fc700 1 -- 172.21.15.57:0/1715815372 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849890056 0 0) 0x7fc7f813e420 con 0x7fc7f8063840 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f67fc700 1 -- 172.21.15.57:0/1715815372 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4003570 con 0x7fc7f8063840 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f7fff700 1 -- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 msgr2=0x7fc7f8138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f7fff700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 0x7fc7f8138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f7fff700 1 -- 172.21.15.57:0/1715815372 >> v1:172.21.15.57:6789/0 conn(0x7fc7f8063840 legacy=0x7fc7f806ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f7fff700 1 -- 172.21.15.57:0/1715815372 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80aed20 con 0x7fc7f8138690 2024-03-18T14:47:25.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f6ffd700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 0x7fc7f8138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f7fff700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 0x7fc7f81457c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009e90 tx=0x7fc7f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7a1228a49444935 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f67fc700 1 -- 172.21.15.57:0/1715815372 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f000e070 con 0x7fc7f8138690 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f67fc700 1 -- 172.21.15.57:0/1715815372 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f000bb80 con 0x7fc7f8138690 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.207+0000 7fc7f67fc700 1 -- 172.21.15.57:0/1715815372 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0012430 con 0x7fc7f8138690 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 msgr2=0x7fc7f81457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 0x7fc7f81457c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009e90 tx=0x7fc7f0009780 comp rx=0 tx=0).stop 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/1715815372 shutdown_connections 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f8138690 0x7fc7f81457c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/1715815372 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f806d7e0 0x7fc7f8138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/1715815372 >> 172.21.15.57:0/1715815372 conn(0x7fc7f806f500 msgr2=0x7fc7f806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/1715815372 shutdown_connections 2024-03-18T14:47:25.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.208+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/1715815372 wait complete. 2024-03-18T14:47:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 Processor -- start 2024-03-18T14:47:25.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 -- start start 2024-03-18T14:47:25.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 0x7fc7f8149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 0x7fc7f80a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8149380 con 0x7fc7f8063840 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80a7820 con 0x7fc7f806d7e0 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.209+0000 7fc7fe0aa700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80a8e40 con 0x7fc7f8138690 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34120/0 (socket says 172.21.15.57:34120) 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f6ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 0x7fc7f8149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 -- 172.21.15.57:0/3550157618 learned_addr learned my addr 172.21.15.57:0/3550157618 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f7fff700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 0x7fc7f80a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 -- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 msgr2=0x7fc7f80a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 0x7fc7f80a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 -- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 msgr2=0x7fc7f8149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 0x7fc7f8149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 -- 172.21.15.57:0/3550157618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009420 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f6ffd700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 0x7fc7f8149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f7fff700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 0x7fc7f80a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7f77fe700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c7f0 tx=0x7fc7e0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0005cd0 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e0005e50 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f0009a20 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0007320 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.210+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f80a67f0 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.211+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc7e001b3b0 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.211+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8065180 con 0x7fc7f8063840 2024-03-18T14:47:25.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.212+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc7e005a8d0 con 0x7fc7f8063840 2024-03-18T14:47:25.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.215+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc7e0038a90 con 0x7fc7f8063840 2024-03-18T14:47:25.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.378+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7f80ae2c0 con 0x7fc7f8063840 2024-03-18T14:47:25.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.378+0000 7fc7ef7fe700 1 -- 172.21.15.57:0/3550157618 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11631 (secure 0 0 0) 0x7fc7e0017030 con 0x7fc7f8063840 2024-03-18T14:47:25.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:25.380 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:24.703821+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:25.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 >> v1:172.21.15.57:6816/47480 conn(0x7fc7d8046010 legacy=0x7fc7d80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 msgr2=0x7fc7f8149700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c7f0 tx=0x7fc7e0007e00 comp rx=0 tx=0).stop 2024-03-18T14:47:25.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 shutdown_connections 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7f8138690 0x7fc7f80a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7f8063840 0x7fc7f8149700 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 --2- 172.21.15.57:0/3550157618 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7f806d7e0 0x7fc7f8149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 >> 172.21.15.57:0/3550157618 conn(0x7fc7f806f500 msgr2=0x7fc7f813d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 shutdown_connections 2024-03-18T14:47:25.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.380+0000 7fc7fe0aa700 1 -- 172.21.15.57:0/3550157618 wait complete. 2024-03-18T14:47:25.394 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T14:47:25.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.517+0000 7f954ca15700 1 Processor -- start 2024-03-18T14:47:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.517+0000 7f954ca15700 1 -- start start 2024-03-18T14:47:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548063f60 0x7f95480aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95481419d0 con 0x7f95480a8a80 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95480aaa80 con 0x7f9548063f60 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954ca15700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95480a7400 con 0x7f9548142500 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9545d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f954659c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548063f60 0x7f95480aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9545d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34130/0 (socket says 172.21.15.57:34130) 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49158/0 (socket says 172.21.15.57:49158) 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9545d9b700 1 -- 172.21.15.57:0/1629866707 learned_addr learned my addr 172.21.15.57:0/1629866707 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 -- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548063f60 msgr2=0x7f95480aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 --2- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548063f60 0x7f95480aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 -- 172.21.15.57:0/1629866707 >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 msgr2=0x7f9548141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 --2- 172.21.15.57:0/1629866707 >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9546d9d700 1 -- 172.21.15.57:0/1629866707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480a8e70 con 0x7f9548142500 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.518+0000 7f9545d9b700 1 --2- 172.21.15.57:0/1629866707 >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f9546d9d700 1 --2- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9540009e60 tx=0x7f9540009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f867ac825b427629 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954559a700 1 -- 172.21.15.57:0/1629866707 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000e070 con 0x7f9548142500 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954559a700 1 -- 172.21.15.57:0/1629866707 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954000bab0 con 0x7f9548142500 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954559a700 1 -- 172.21.15.57:0/1629866707 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954000be70 con 0x7f9548142500 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954ca15700 1 -- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 msgr2=0x7f95480a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954ca15700 1 --2- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9540009e60 tx=0x7f9540009780 comp rx=0 tx=0).stop 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954ca15700 1 -- 172.21.15.57:0/1629866707 shutdown_connections 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954ca15700 1 --2- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548142500 0x7f95480a53d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.519+0000 7f954ca15700 1 --2- 172.21.15.57:0/1629866707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548063f60 0x7f95480aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.520+0000 7f954ca15700 1 --2- 172.21.15.57:0/1629866707 >> v2:172.21.15.57:3300/0 conn(0x7f95480a8a80 0x7f9548141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.520+0000 7f954ca15700 1 -- 172.21.15.57:0/1629866707 >> 172.21.15.57:0/1629866707 conn(0x7f9548087fe0 msgr2=0x7f9548063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.520+0000 7f954ca15700 1 -- 172.21.15.57:0/1629866707 shutdown_connections 2024-03-18T14:47:25.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.520+0000 7f954ca15700 1 -- 172.21.15.57:0/1629866707 wait complete. 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.520+0000 7f954ca15700 1 Processor -- start 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 -- start start 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 0x7f954813eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548142500 0x7f9548151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954813f400 con 0x7f95480a8a80 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9548098310 con 0x7f9548142500 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954ca15700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95480b1f90 con 0x7f9548063f60 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f9545d9b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 0x7f954813eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49162/0 (socket says 172.21.15.57:49162) 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 -- 172.21.15.57:0/3807327393 learned_addr learned my addr 172.21.15.57:0/3807327393 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f9546d9d700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548142500 0x7f9548151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 -- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548142500 msgr2=0x7f9548151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548142500 0x7f9548151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 -- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 msgr2=0x7f954813eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 0x7f954813eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f954659c700 1 -- 172.21.15.57:0/3807327393 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0094f0 con 0x7f9548063f60 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.521+0000 7f9545d9b700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 0x7f954813eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f954659c700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f953800e930 tx=0x7f95380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538013680 con 0x7f9548063f60 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95380137e0 con 0x7f9548063f60 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9540009a20 con 0x7f9548063f60 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9538013b80 con 0x7f9548063f60 2024-03-18T14:47:25.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.522+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95480af9a0 con 0x7f9548063f60 2024-03-18T14:47:25.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.523+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95480648f0 con 0x7f9548063f60 2024-03-18T14:47:25.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.523+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f953800c470 con 0x7f9548063f60 2024-03-18T14:47:25.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.523+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f953805b2f0 con 0x7f9548063f60 2024-03-18T14:47:25.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.527+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f95380394b0 con 0x7f9548063f60 2024-03-18T14:47:25.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.692+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95481407f0 con 0x7f9548063f60 2024-03-18T14:47:25.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.693+0000 7f95367fc700 1 -- 172.21.15.57:0/3807327393 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f953803cca0 con 0x7f9548063f60 2024-03-18T14:47:25.694 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:25.695 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:24.703821+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 >> v1:172.21.15.57:6816/47480 conn(0x7f9528046040 legacy=0x7f95280484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 msgr2=0x7f954813e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f953800e930 tx=0x7f95380091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 shutdown_connections 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9548142500 0x7f9548151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9548063f60 0x7f954813e980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 --2- 172.21.15.57:0/3807327393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95480a8a80 0x7f954813eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 >> 172.21.15.57:0/3807327393 conn(0x7f9548087fe0 msgr2=0x7f95480a52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 shutdown_connections 2024-03-18T14:47:25.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.694+0000 7f954ca15700 1 -- 172.21.15.57:0/3807327393 wait complete. 2024-03-18T14:47:25.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T14:47:25.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T14:47:25.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T14:47:25.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T14:47:25.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.840+0000 7f5c64a52700 1 Processor -- start 2024-03-18T14:47:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.840+0000 7f5c64a52700 1 -- start start 2024-03-18T14:47:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.840+0000 7f102bb1d700 1 Processor -- start 2024-03-18T14:47:25.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 -- start start 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c64a52700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c600b21f0 0x7f5c600a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c64a52700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c60067db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c64a52700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600a3460 con 0x7f5c600682f0 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c64a52700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c600a2390 con 0x7f5c600b21f0 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c64a52700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600af140 con 0x7f5c600679e0 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c5e59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c600b21f0 0x7f5c600a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c5ed9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c600682f0 0x7f5c601485a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58530/0 (socket says 172.21.15.57:58530) 2024-03-18T14:47:25.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c5ed9d700 1 -- 172.21.15.57:0/201925526 learned_addr learned my addr 172.21.15.57:0/201925526 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c5e59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c600b21f0 0x7f5c600a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34158/0 (socket says 172.21.15.57:34158) 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f5c5dd9b700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c60067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 0x7f1024063a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f10240aa1c0 0x7f10240ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10240aca40 con 0x7f10241416e0 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10240adac0 con 0x7f10240aa1c0 2024-03-18T14:47:25.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.841+0000 7f102bb1d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10240acce0 con 0x7f10240ad6f0 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5e59c700 1 -- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 msgr2=0x7f5c60067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5e59c700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c60067db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5e59c700 1 -- 172.21.15.57:0/201925526 >> v1:172.21.15.57:6789/0 conn(0x7f5c600682f0 legacy=0x7f5c601485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5e59c700 1 -- 172.21.15.57:0/201925526 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c600a36c0 con 0x7f5c600b21f0 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5dd9b700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c60067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5e59c700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600b21f0 0x7f5c600a47e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009910 tx=0x7f5c500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5e45218ea439e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f102a0ba700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f10241416e0 0x7f1024141b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58534/0 (socket says 172.21.15.57:58534) 2024-03-18T14:47:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f102a0ba700 1 -- 172.21.15.57:0/248368089 learned_addr learned my addr 172.21.15.57:0/248368089 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10290b8700 1 --2- 172.21.15.57:0/248368089 >> v2:172.21.15.57:3300/0 conn(0x7f10240aa1c0 0x7f10240ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 --2- 172.21.15.57:0/248368089 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 0x7f1024063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5d59a700 1 -- 172.21.15.57:0/201925526 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011630 con 0x7f5c600b21f0 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 -- 172.21.15.57:0/248368089 >> v2:172.21.15.57:3300/0 conn(0x7f10240aa1c0 msgr2=0x7f10240ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 --2- 172.21.15.57:0/248368089 >> v2:172.21.15.57:3300/0 conn(0x7f10240aa1c0 0x7f10240ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 -- 172.21.15.57:0/248368089 >> v1:172.21.15.57:6789/0 conn(0x7f10241416e0 legacy=0x7f1024141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 -- 172.21.15.57:0/248368089 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240aa590 con 0x7f10240ad6f0 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f10298b9700 1 --2- 172.21.15.57:0/248368089 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 0x7f1024063a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1020009910 tx=0x7f10200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73477c84e7a092a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5d59a700 1 -- 172.21.15.57:0/201925526 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50011790 con 0x7f5c600b21f0 2024-03-18T14:47:25.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.842+0000 7f5c5d59a700 1 -- 172.21.15.57:0/201925526 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011b50 con 0x7f5c600b21f0 2024-03-18T14:47:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f10288b7700 1 -- 172.21.15.57:0/248368089 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020011630 con 0x7f10240ad6f0 2024-03-18T14:47:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f10288b7700 1 -- 172.21.15.57:0/248368089 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020011790 con 0x7f10240ad6f0 2024-03-18T14:47:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f10288b7700 1 -- 172.21.15.57:0/248368089 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020011b30 con 0x7f10240ad6f0 2024-03-18T14:47:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 -- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600b21f0 msgr2=0x7f5c600a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600b21f0 0x7f5c600a47e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009910 tx=0x7f5c500091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 -- 172.21.15.57:0/248368089 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 msgr2=0x7f1024063a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 --2- 172.21.15.57:0/248368089 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 0x7f1024063a90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1020009910 tx=0x7f10200091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 -- 172.21.15.57:0/201925526 shutdown_connections 2024-03-18T14:47:25.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600b21f0 0x7f5c600a47e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 --2- 172.21.15.57:0/201925526 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c60067db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 -- 172.21.15.57:0/201925526 >> 172.21.15.57:0/201925526 conn(0x7f5c6006d1f0 msgr2=0x7f5c6006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 -- 172.21.15.57:0/248368089 shutdown_connections 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 --2- 172.21.15.57:0/248368089 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240ad6f0 0x7f1024063a90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 --2- 172.21.15.57:0/248368089 >> v2:172.21.15.57:3300/0 conn(0x7f10240aa1c0 0x7f10240ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f102bb1d700 1 -- 172.21.15.57:0/248368089 >> 172.21.15.57:0/248368089 conn(0x7f102406a4d0 msgr2=0x7f102406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.843+0000 7f5c64a52700 1 -- 172.21.15.57:0/201925526 shutdown_connections 2024-03-18T14:47:25.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.844+0000 7f102bb1d700 1 -- 172.21.15.57:0/248368089 shutdown_connections 2024-03-18T14:47:25.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.844+0000 7f102bb1d700 1 -- 172.21.15.57:0/248368089 wait complete. 2024-03-18T14:47:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.844+0000 7f5c64a52700 1 -- 172.21.15.57:0/201925526 wait complete. 2024-03-18T14:47:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.844+0000 7f5c64a52700 1 Processor -- start 2024-03-18T14:47:25.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.844+0000 7f102bb1d700 1 Processor -- start 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 -- start start 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c600ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600682f0 0x7f5c600aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c600b21f0 0x7f5c600ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600ade40 con 0x7f5c600682f0 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600acae0 con 0x7f5c600b21f0 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c64a52700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60151a50 con 0x7f5c600679e0 2024-03-18T14:47:25.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 -- start start 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240aa1c0 0x7f1024152750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10241416e0 0x7f10240a5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1024152c90 0x7f10240a6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10240a54c0 con 0x7f1024152c90 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102413d6b0 con 0x7f10241416e0 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102bb1d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10240a9000 con 0x7f10240aa1c0 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c5e59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c600ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c5e59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c600ad250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49202/0 (socket says 172.21.15.57:49202) 2024-03-18T14:47:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c5e59c700 1 -- 172.21.15.57:0/665209634 learned_addr learned my addr 172.21.15.57:0/665209634 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f5c5ed9d700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c600b21f0 0x7f5c600ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102a0ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1024152c90 0x7f10240a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102a0ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1024152c90 0x7f10240a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34190/0 (socket says 172.21.15.57:34190) 2024-03-18T14:47:25.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.845+0000 7f102a0ba700 1 -- 172.21.15.57:0/2338481925 learned_addr learned my addr 172.21.15.57:0/2338481925 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 --2- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240aa1c0 0x7f1024152750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 -- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10241416e0 msgr2=0x7f10240a5b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 --2- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f10241416e0 0x7f10240a5b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 -- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1024152c90 msgr2=0x7f10240a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 --2- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1024152c90 0x7f10240a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 -- 172.21.15.57:0/2338481925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020009420 con 0x7f10240aa1c0 2024-03-18T14:47:25.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f10298b9700 1 --2- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240aa1c0 0x7f1024152750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10240b1750 tx=0x7f1020016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5dd9b700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600682f0 0x7f5c600aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 -- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c600b21f0 msgr2=0x7f5c600ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5c600b21f0 0x7f5c600ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 -- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600682f0 msgr2=0x7f5c600aace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600682f0 0x7f5c600aace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 -- 172.21.15.57:0/665209634 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009420 con 0x7f5c600679e0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5dd9b700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c600682f0 0x7f5c600aace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c5e59c700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c600ad250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c600a35f0 tx=0x7f5c50016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011b10 con 0x7f5c600679e0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c50009420 con 0x7f5c600679e0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50020070 con 0x7f5c600679e0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500276d0 con 0x7f5c600679e0 2024-03-18T14:47:25.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.846+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c60143250 con 0x7f5c600679e0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.847+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c60065180 con 0x7f5c600679e0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.847+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5c50027a80 con 0x7f5c600679e0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.848+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5c50022070 con 0x7f5c600679e0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.847+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102001bca0 con 0x7f10240aa1c0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.847+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020020070 con 0x7f10240aa1c0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.847+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200276d0 con 0x7f10240aa1c0 2024-03-18T14:47:25.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.848+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 --> v1:172.21.15.57:6808/50245 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c40052a90 con 0x7f5c4004edd0 2024-03-18T14:47:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.848+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c5005f740 con 0x7f5c600679e0 2024-03-18T14:47:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.848+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10240a5710 con 0x7f10240aa1c0 2024-03-18T14:47:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.848+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1024152100 con 0x7f10240aa1c0 2024-03-18T14:47:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f10241523a0 con 0x7f10240aa1c0 2024-03-18T14:47:25.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== osd.2 v1:172.21.15.57:6808/50245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f5c40052a90 con 0x7f5c4004edd0 2024-03-18T14:47:25.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f102001c450 con 0x7f10240aa1c0 2024-03-18T14:47:25.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f1020022070 con 0x7f10240aa1c0 2024-03-18T14:47:25.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 --> v1:172.21.15.57:6804/50128 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1008052a10 con 0x7f100804ed50 2024-03-18T14:47:25.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.849+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102005ec10 con 0x7f10240aa1c0 2024-03-18T14:47:25.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.850+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== osd.1 v1:172.21.15.57:6804/50128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f1008052a10 con 0x7f100804ed50 2024-03-18T14:47:25.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.864+0000 7fa552957700 1 Processor -- start 2024-03-18T14:47:25.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.864+0000 7fa552957700 1 -- start start 2024-03-18T14:47:25.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.864+0000 7f7e7df6d700 1 Processor -- start 2024-03-18T14:47:25.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.864+0000 7f7e7df6d700 1 -- start start 2024-03-18T14:47:25.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7fa552957700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c0a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7fa552957700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7fa552957700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54c06e120 con 0x7fa54c0682f0 2024-03-18T14:47:25.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7fa552957700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0af140 con 0x7fa54c0679e0 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7fa552957700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0a46d0 con 0x7fa54c0b2150 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7f7e7df6d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7f7e7df6d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e78144c60 0x7f7e78147040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7f7e7df6d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e780a5820 con 0x7f7e780a5450 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7f7e7df6d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780a4920 con 0x7f7e78144c60 2024-03-18T14:47:25.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.865+0000 7f7e7df6d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e780b3670 con 0x7f7e780a41f0 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:42996/0 (socket says 172.21.15.57:42996) 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 -- 172.21.15.57:0/2344169071 learned_addr learned my addr 172.21.15.57:0/2344169071 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54bfff700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c0a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49230/0 (socket says 172.21.15.57:49230) 2024-03-18T14:47:25.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 -- 172.21.15.57:0/1826339448 learned_addr learned my addr 172.21.15.57:0/1826339448 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 --> v1:172.21.15.57:6808/50245 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5c600aa9a0 con 0x7f5c4004edd0 2024-03-18T14:47:25.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 -- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 msgr2=0x7fa54c0a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c0a32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 -- 172.21.15.57:0/2344169071 >> v1:172.21.15.57:6789/0 conn(0x7fa54c0682f0 legacy=0x7fa54c1485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 -- 172.21.15.57:0/2344169071 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c0a48c0 con 0x7fa54c0679e0 2024-03-18T14:47:25.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e77fff700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e78144c60 0x7f7e78147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7fa54b7fe700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5400099e0 tx=0x7fa540009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee3b4b17b49481cb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 -- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e78144c60 msgr2=0x7f7e78147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e78144c60 0x7f7e78147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 -- 172.21.15.57:0/1826339448 >> v1:172.21.15.57:6789/0 conn(0x7f7e780a5450 legacy=0x7f7e7813f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f7e76ffd700 1 -- 172.21.15.57:0/1826339448 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e780a7410 con 0x7f7e780a41f0 2024-03-18T14:47:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.866+0000 7f5c4e7fc700 1 -- 172.21.15.57:0/665209634 <== osd.2 v1:172.21.15.57:6808/50245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7f5c600aa9a0 con 0x7f5c4004edd0 2024-03-18T14:47:25.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f7e76ffd700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0099e0 tx=0x7f7e6c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83fa086d1898896d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa54affd700 1 -- 172.21.15.57:0/2344169071 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000b8f0 con 0x7fa54c0679e0 2024-03-18T14:47:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa54affd700 1 -- 172.21.15.57:0/2344169071 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54000ba50 con 0x7fa54c0679e0 2024-03-18T14:47:25.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa54affd700 1 -- 172.21.15.57:0/2344169071 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54000bdd0 con 0x7fa54c0679e0 2024-03-18T14:47:25.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f7e767fc700 1 -- 172.21.15.57:0/1826339448 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00b860 con 0x7f7e780a41f0 2024-03-18T14:47:25.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f7e767fc700 1 -- 172.21.15.57:0/1826339448 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c00b9c0 con 0x7f7e780a41f0 2024-03-18T14:47:25.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f7e767fc700 1 -- 172.21.15.57:0/1826339448 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00bd60 con 0x7f7e780a41f0 2024-03-18T14:47:25.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 >> v1:172.21.15.57:6808/50245 conn(0x7f5c4004edd0 legacy=0x7f5c40051220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 --> v1:172.21.15.57:6804/50128 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1024065180 con 0x7f100804ed50 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa552957700 1 -- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 msgr2=0x7fa54c067db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa552957700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa5400099e0 tx=0x7fa540009250 comp rx=0 tx=0).stop 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 >> v1:172.21.15.57:6816/47480 conn(0x7f5c40046040 legacy=0x7f5c400484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 msgr2=0x7f5c600ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f5c64a52700 1 --2- 172.21.15.57:0/665209634 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5c600679e0 0x7f5c600ad250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c600a35f0 tx=0x7f5c50016000 comp rx=0 tx=0).stop 2024-03-18T14:47:25.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7f5c5ed9d700 1 -- 172.21.15.57:0/665209634 reap_dead start 2024-03-18T14:47:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 -- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 msgr2=0x7f7e781400e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0099e0 tx=0x7f7e6c009250 comp rx=0 tx=0).stop 2024-03-18T14:47:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f1019ffb700 1 -- 172.21.15.57:0/2338481925 <== osd.1 v1:172.21.15.57:6804/50128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7f1024065180 con 0x7f100804ed50 2024-03-18T14:47:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 shutdown_connections 2024-03-18T14:47:25.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 >> 172.21.15.57:0/665209634 conn(0x7f5c6006d1f0 msgr2=0x7f5c60144210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 -- 172.21.15.57:0/1826339448 shutdown_connections 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e78144c60 0x7f7e78147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 --2- 172.21.15.57:0/1826339448 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e780a41f0 0x7f7e781400e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 -- 172.21.15.57:0/1826339448 >> 172.21.15.57:0/1826339448 conn(0x7f7e7806bda0 msgr2=0x7f7e7806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.867+0000 7fa552957700 1 -- 172.21.15.57:0/2344169071 shutdown_connections 2024-03-18T14:47:25.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7fa552957700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c0a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7fa552957700 1 --2- 172.21.15.57:0/2344169071 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c067db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7fa552957700 1 -- 172.21.15.57:0/2344169071 >> 172.21.15.57:0/2344169071 conn(0x7fa54c06d1f0 msgr2=0x7fa54c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7fa552957700 1 -- 172.21.15.57:0/2344169071 shutdown_connections 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 -- 172.21.15.57:0/1826339448 shutdown_connections 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f7e7df6d700 1 -- 172.21.15.57:0/1826339448 wait complete. 2024-03-18T14:47:25.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7fa552957700 1 -- 172.21.15.57:0/2344169071 wait complete. 2024-03-18T14:47:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 shutdown_connections 2024-03-18T14:47:25.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 >> v1:172.21.15.57:6804/50128 conn(0x7f100804ed50 legacy=0x7f10080511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 >> v1:172.21.15.57:6816/47480 conn(0x7f1008046040 legacy=0x7f10080484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240aa1c0 msgr2=0x7f1024152750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 --2- 172.21.15.57:0/2338481925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f10240aa1c0 0x7f1024152750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f10240b1750 tx=0x7f1020016000 comp rx=0 tx=0).stop 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102a0ba700 1 -- 172.21.15.57:0/2338481925 reap_dead start 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 shutdown_connections 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 >> 172.21.15.57:0/2338481925 conn(0x7f102406a4d0 msgr2=0x7f1024068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 shutdown_connections 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.868+0000 7f102bb1d700 1 -- 172.21.15.57:0/2338481925 wait complete. 2024-03-18T14:47:25.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.869+0000 7f5c64a52700 1 -- 172.21.15.57:0/665209634 wait complete. 2024-03-18T14:47:25.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.869+0000 7fa552957700 1 Processor -- start 2024-03-18T14:47:25.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.869+0000 7f7e7df6d700 1 Processor -- start 2024-03-18T14:47:25.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.869+0000 7f7e7df6d700 1 -- start start 2024-03-18T14:47:25.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.869+0000 7fa552957700 1 -- start start 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e780a41f0 0x7f7e780a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 0x7f7e7814cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c098360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e78144c60 0x7f7e7814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78143ac0 con 0x7f7e780a41f0 2024-03-18T14:47:25.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7814fbc0 con 0x7f7e780a5450 2024-03-18T14:47:25.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e7df6d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e78142c40 con 0x7f7e78144c60 2024-03-18T14:47:25.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa54c0682f0 0x7fa54c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c097970 con 0x7fa54c0682f0 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c0ab230 con 0x7fa54c0679e0 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa552957700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c097e60 con 0x7fa54c0b2150 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa550ef4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa550ef4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49246/0 (socket says 172.21.15.57:49246) 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa550ef4700 1 -- 172.21.15.57:0/3948163491 learned_addr learned my addr 172.21.15.57:0/3948163491 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 --2- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c098360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e76ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 0x7f7e7814cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e76ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 0x7f7e7814cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43024/0 (socket says 172.21.15.57:43024) 2024-03-18T14:47:25.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e76ffd700 1 -- 172.21.15.57:0/3194351683 learned_addr learned my addr 172.21.15.57:0/3194351683 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7f7e77fff700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e78144c60 0x7f7e7814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 -- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 msgr2=0x7fa54c152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 --2- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa54c0b2150 0x7fa54c152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 -- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa54c0682f0 msgr2=0x7fa54c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 --2- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa54c0682f0 0x7fa54c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.870+0000 7fa54bfff700 1 -- 172.21.15.57:0/3948163491 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400094f0 con 0x7fa54c0679e0 2024-03-18T14:47:25.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e777fe700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e780a41f0 0x7f7e780a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 -- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e78144c60 msgr2=0x7f7e7814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7e78144c60 0x7f7e7814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 -- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e780a41f0 msgr2=0x7f7e780a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7e780a41f0 0x7f7e780a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 -- 172.21.15.57:0/3194351683 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0094f0 con 0x7f7e780a5450 2024-03-18T14:47:25.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7fa54bfff700 1 --2- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c098360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00e900 tx=0x7fa53c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7f7e76ffd700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 0x7f7e7814cd00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009290 tx=0x7f7e6c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:25.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c013680 con 0x7fa54c0679e0 2024-03-18T14:47:25.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53c0137e0 con 0x7fa54c0679e0 2024-03-18T14:47:25.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.871+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53c013ba0 con 0x7fa54c0679e0 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.872+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011da0 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.872+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c024440 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.872+0000 7f7e7df6d700 1 -- 172.21.15.57:0/3194351683 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e780a9d40 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.872+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c024800 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.872+0000 7f7e7df6d700 1 -- 172.21.15.57:0/3194351683 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e780a90d0 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.873+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7e50000fd0 con 0x7f7e780a5450 2024-03-18T14:47:25.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.873+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7e6c01a420 con 0x7f7e780a5450 2024-03-18T14:47:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.874+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c13f750 con 0x7fa54c0679e0 2024-03-18T14:47:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.874+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54c097b80 con 0x7fa54c0679e0 2024-03-18T14:47:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.874+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f7e6c05cee0 con 0x7f7e780a5450 2024-03-18T14:47:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.874+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 --> v1:172.21.15.57:6800/50045 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7e64052b30 con 0x7f7e6404ee70 2024-03-18T14:47:25.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.874+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c05f440 con 0x7f7e780a5450 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.875+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa54c065180 con 0x7fa54c0679e0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.875+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa53c00c3e0 con 0x7fa54c0679e0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.875+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa53c05b750 con 0x7fa54c0679e0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.875+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 --> v1:172.21.15.57:6812/50393 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa538052a60 con 0x7fa53804eda0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.875+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa53c039a40 con 0x7fa54c0679e0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.877+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== osd.3 v1:172.21.15.57:6812/50393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fa538052a60 con 0x7fa53804eda0 2024-03-18T14:47:25.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.878+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== osd.0 v1:172.21.15.57:6800/50045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f7e64052b30 con 0x7f7e6404ee70 2024-03-18T14:47:25.891 INFO:teuthology.orchestra.run.smithi057.stdout:124554051588 2024-03-18T14:47:25.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:47:25.892 INFO:teuthology.orchestra.run.smithi057.stdout:128849018884 2024-03-18T14:47:25.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:47:25.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.894+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 --> v1:172.21.15.57:6800/50045 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7e50002d00 con 0x7f7e6404ee70 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.894+0000 7f7e5f7fe700 1 -- 172.21.15.57:0/3194351683 <== osd.0 v1:172.21.15.57:6800/50045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 851964294) 0x7f7e50002d00 con 0x7f7e6404ee70 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 >> v1:172.21.15.57:6800/50045 conn(0x7f7e6404ee70 legacy=0x7f7e640512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 >> v1:172.21.15.57:6816/47480 conn(0x7f7e640460e0 legacy=0x7f7e64048590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 msgr2=0x7f7e7814cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 --2- 172.21.15.57:0/3194351683 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7e780a5450 0x7f7e7814cd00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009290 tx=0x7f7e6c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e77fff700 1 -- 172.21.15.57:0/3194351683 reap_dead start 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 shutdown_connections 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 >> 172.21.15.57:0/3194351683 conn(0x7f7e7806bda0 msgr2=0x7f7e7813f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 shutdown_connections 2024-03-18T14:47:25.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.895+0000 7f7e5d7fa700 1 -- 172.21.15.57:0/3194351683 wait complete. 2024-03-18T14:47:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.897+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 --> v1:172.21.15.57:6812/50393 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa54c0aac10 con 0x7fa53804eda0 2024-03-18T14:47:25.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.897+0000 7fa533fff700 1 -- 172.21.15.57:0/3948163491 <== osd.3 v1:172.21.15.57:6812/50393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2909512871) 0x7fa54c0aac10 con 0x7fa53804eda0 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 >> v1:172.21.15.57:6812/50393 conn(0x7fa53804eda0 legacy=0x7fa5380511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 >> v1:172.21.15.57:6816/47480 conn(0x7fa538046090 legacy=0x7fa538048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 msgr2=0x7fa54c098360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 --2- 172.21.15.57:0/3948163491 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa54c0679e0 0x7fa54c098360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa53c00e900 tx=0x7fa53c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa550ef4700 1 -- 172.21.15.57:0/3948163491 reap_dead start 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 shutdown_connections 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.898+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 >> 172.21.15.57:0/3948163491 conn(0x7fa54c06d1f0 msgr2=0x7fa54c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.899+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 shutdown_connections 2024-03-18T14:47:25.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:25.899+0000 7fa552957700 1 -- 172.21.15.57:0/3948163491 wait complete. 2024-03-18T14:47:25.915 INFO:teuthology.orchestra.run.smithi057.stdout:120259084293 2024-03-18T14:47:25.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:47:25.918 INFO:teuthology.orchestra.run.smithi057.stdout:137438953476 2024-03-18T14:47:25.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:47:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.024+0000 7f70b2c43700 1 Processor -- start 2024-03-18T14:47:26.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.024+0000 7f70b2c43700 1 -- start start 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b2c43700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b2c43700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac067f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b2c43700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac0a4b40 con 0x7f70ac0a32d0 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b2c43700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0a2b60 con 0x7f70ac069200 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b2c43700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac06e630 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b09df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70abfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac067f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b09df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43048/0 (socket says 172.21.15.57:43048) 2024-03-18T14:47:26.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.025+0000 7f70b09df700 1 -- 172.21.15.57:0/1502120888 learned_addr learned my addr 172.21.15.57:0/1502120888 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70abfff700 1 -- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 msgr2=0x7f70ac0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70abfff700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70abfff700 1 -- 172.21.15.57:0/1502120888 >> v1:172.21.15.57:6789/0 conn(0x7f70ac0a32d0 legacy=0x7f70ac148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70abfff700 1 -- 172.21.15.57:0/1502120888 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0a38a0 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70b09df700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70abfff700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7098009910 tx=0x7f70980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8534486ac22dc276 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70ab7fe700 1 -- 172.21.15.57:0/1502120888 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800b680 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70ab7fe700 1 -- 172.21.15.57:0/1502120888 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800b7e0 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.026+0000 7f70ab7fe700 1 -- 172.21.15.57:0/1502120888 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800bba0 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 -- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 msgr2=0x7f70ac067f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac067f20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7098009910 tx=0x7f70980091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 -- 172.21.15.57:0/1502120888 shutdown_connections 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 --2- 172.21.15.57:0/1502120888 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac067f20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 -- 172.21.15.57:0/1502120888 >> 172.21.15.57:0/1502120888 conn(0x7f70ac06abe0 msgr2=0x7f70ac068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 -- 172.21.15.57:0/1502120888 shutdown_connections 2024-03-18T14:47:26.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.027+0000 7f70b2c43700 1 -- 172.21.15.57:0/1502120888 wait complete. 2024-03-18T14:47:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.028+0000 7f70b2c43700 1 Processor -- start 2024-03-18T14:47:26.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.028+0000 7f70b2c43700 1 -- start start 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 0x7f70ac151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0ad1c0 con 0x7f70ac0a32d0 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0ad3a0 con 0x7f70ac069200 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b2c43700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0978f0 con 0x7f70ac0a3ee0 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b09df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b09df700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43064/0 (socket says 172.21.15.57:43064) 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b09df700 1 -- 172.21.15.57:0/4076857785 learned_addr learned my addr 172.21.15.57:0/4076857785 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70abfff700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 0x7f70ac151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.029+0000 7f70b11e0700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 -- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 msgr2=0x7f70ac151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 -- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 msgr2=0x7f70ac151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 0x7f70ac151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 -- 172.21.15.57:0/4076857785 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a00094f0 con 0x7f70ac069200 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70abfff700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 0x7f70ac151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b09df700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70a000ec50 tx=0x7f70a0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00097d0 con 0x7f70ac069200 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a000c9d0 con 0x7f70ac069200 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a000cd50 con 0x7f70ac069200 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7098009420 con 0x7f70ac069200 2024-03-18T14:47:26.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.030+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac0a12c0 con 0x7f70ac069200 2024-03-18T14:47:26.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.031+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f70a0013680 con 0x7f70ac069200 2024-03-18T14:47:26.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.032+0000 7f62d7e7b700 1 Processor -- start 2024-03-18T14:47:26.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.032+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f70a005b960 con 0x7f70ac069200 2024-03-18T14:47:26.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.032+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70ac065180 con 0x7f70ac069200 2024-03-18T14:47:26.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.032+0000 7f62d7e7b700 1 -- start start 2024-03-18T14:47:26.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d00b16c0 0x7f62d006e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62d013a650 0x7f62d006eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d00ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d0138380 con 0x7f62d013a650 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d013aae0 con 0x7f62d00aca50 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d7e7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d013ad80 con 0x7f62d00b16c0 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62d013a650 0x7f62d006eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f62d013a650 0x7f62d006eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34230/0 (socket says 172.21.15.57:34230) 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 -- 172.21.15.57:0/1966737029 learned_addr learned my addr 172.21.15.57:0/1966737029 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d6418700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d00ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 -- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d00b16c0 msgr2=0x7f62d006e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d00b16c0 0x7f62d006e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 -- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 msgr2=0x7f62d00ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d00ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.033+0000 7f62d5416700 1 -- 172.21.15.57:0/1966737029 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d006f400 con 0x7f62d013a650 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.034+0000 7f62d5416700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d013a650 0x7f62d006eec0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62c00099b0 tx=0x7f62c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c80f34b99c958a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.034+0000 7f62d4c15700 1 -- 172.21.15.57:0/1966737029 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000c970 con 0x7f62d013a650 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.034+0000 7f62d4c15700 1 -- 172.21.15.57:0/1966737029 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000cad0 con 0x7f62d013a650 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.034+0000 7f62d4c15700 1 -- 172.21.15.57:0/1966737029 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000ce70 con 0x7f62d013a650 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 -- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d013a650 msgr2=0x7f62d006eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d013a650 0x7f62d006eec0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f62c00099b0 tx=0x7f62c0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 -- 172.21.15.57:0/1966737029 shutdown_connections 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d00ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d00b16c0 0x7f62d006e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 --2- 172.21.15.57:0/1966737029 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d013a650 0x7f62d006eec0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 -- 172.21.15.57:0/1966737029 >> 172.21.15.57:0/1966737029 conn(0x7f62d006a4d0 msgr2=0x7f62d006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 -- 172.21.15.57:0/1966737029 shutdown_connections 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.035+0000 7f62d7e7b700 1 -- 172.21.15.57:0/1966737029 wait complete. 2024-03-18T14:47:26.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.036+0000 7f62d7e7b700 1 Processor -- start 2024-03-18T14:47:26.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.036+0000 7f62d7e7b700 1 -- start start 2024-03-18T14:47:26.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d011b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d013a650 0x7f62d01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00ab460 con 0x7f62d00b16c0 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0119260 con 0x7f62d00aca50 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d7e7b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62d011af10 con 0x7f62d013a650 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d5416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d5416700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34244/0 (socket says 172.21.15.57:34244) 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d5416700 1 -- 172.21.15.57:0/292847138 learned_addr learned my addr 172.21.15.57:0/292847138 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f70a0039cb0 con 0x7f70ac069200 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d5c17700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d011b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.037+0000 7f62d6418700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d013a650 0x7f62d01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 -- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d013a650 msgr2=0x7f62d01518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d013a650 0x7f62d01518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 -- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 msgr2=0x7f62d011b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d011b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 -- 172.21.15.57:0/292847138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c00094f0 con 0x7f62d00b16c0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d5416700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62c00090b0 tx=0x7f62c0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c000fb30 con 0x7f62d00b16c0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c000fcb0 con 0x7f62d00b16c0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d7e7b700 1 -- 172.21.15.57:0/292847138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0119ba0 con 0x7f62d00b16c0 2024-03-18T14:47:26.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c0020680 con 0x7f62d00b16c0 2024-03-18T14:47:26.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.038+0000 7f62d7e7b700 1 -- 172.21.15.57:0/292847138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0118f60 con 0x7f62d00b16c0 2024-03-18T14:47:26.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.040+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a80052b0 con 0x7f62d00b16c0 2024-03-18T14:47:26.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.040+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f62c0020a70 con 0x7f62d00b16c0 2024-03-18T14:47:26.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.040+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f62c0013070 con 0x7f62d00b16c0 2024-03-18T14:47:26.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.048+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f62c0002040 con 0x7f62d00b16c0 2024-03-18T14:47:26.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.091+0000 7fdc27dbd700 1 Processor -- start 2024-03-18T14:47:26.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.091+0000 7fdc27dbd700 1 -- start start 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc27dbd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc27dbd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc27dbd700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc200a3460 con 0x7fdc200679e0 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc27dbd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200a2390 con 0x7fdc200b21f0 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc27dbd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200af140 con 0x7fdc200684c0 2024-03-18T14:47:26.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc2635a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc2635a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49316/0 (socket says 172.21.15.57:49316) 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc2635a700 1 -- 172.21.15.57:0/2812733817 learned_addr learned my addr 172.21.15.57:0/2812733817 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 -- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 msgr2=0x7fdc201495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 -- 172.21.15.57:0/2812733817 >> v1:172.21.15.57:6789/0 conn(0x7fdc200679e0 legacy=0x7fdc20067db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 -- 172.21.15.57:0/2812733817 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200a36c0 con 0x7fdc200b21f0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc2635a700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.092+0000 7fdc25b59700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200a47e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009910 tx=0x7fdc1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e81b9ee63a4f60b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc24b57700 1 -- 172.21.15.57:0/2812733817 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00b640 con 0x7fdc200b21f0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc24b57700 1 -- 172.21.15.57:0/2812733817 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1c00b7a0 con 0x7fdc200b21f0 2024-03-18T14:47:26.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc24b57700 1 -- 172.21.15.57:0/2812733817 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c00bb60 con 0x7fdc200b21f0 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 -- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 msgr2=0x7fdc200a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200a47e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009910 tx=0x7fdc1c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 -- 172.21.15.57:0/2812733817 shutdown_connections 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200684c0 0x7fdc201495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/2812733817 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200a47e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.093+0000 7fdc27dbd700 1 -- 172.21.15.57:0/2812733817 >> 172.21.15.57:0/2812733817 conn(0x7fdc2006d1f0 msgr2=0x7fdc2006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.094+0000 7fdc27dbd700 1 -- 172.21.15.57:0/2812733817 shutdown_connections 2024-03-18T14:47:26.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.094+0000 7fdc27dbd700 1 -- 172.21.15.57:0/2812733817 wait complete. 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.094+0000 7fdc27dbd700 1 Processor -- start 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 -- start start 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200679e0 0x7fdc20096fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc20143c00 con 0x7fdc200684c0 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200aeb60 con 0x7fdc200b21f0 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc27dbd700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc200ad100 con 0x7fdc200679e0 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc25358700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc2635a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc25358700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34246/0 (socket says 172.21.15.57:34246) 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc2635a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43118/0 (socket says 172.21.15.57:43118) 2024-03-18T14:47:26.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc25358700 1 -- 172.21.15.57:0/3766500300 learned_addr learned my addr 172.21.15.57:0/3766500300 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.095+0000 7fdc25b59700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200679e0 0x7fdc20096fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 -- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200679e0 msgr2=0x7fdc20096fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200679e0 0x7fdc20096fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 -- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 msgr2=0x7fdc200aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 -- 172.21.15.57:0/3766500300 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc18009ae0 con 0x7fdc200b21f0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc25358700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc2635a700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009f10 tx=0x7fdc1800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc18018070 con 0x7fdc200b21f0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1800f040 con 0x7fdc200b21f0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1800cb90 con 0x7fdc200b21f0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c009420 con 0x7fdc200b21f0 2024-03-18T14:47:26.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.096+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc200a1950 con 0x7fdc200b21f0 2024-03-18T14:47:26.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.098+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc20143d40 con 0x7fdc200b21f0 2024-03-18T14:47:26.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.098+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdc18003020 con 0x7fdc200b21f0 2024-03-18T14:47:26.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.098+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fdc1805b630 con 0x7fdc200b21f0 2024-03-18T14:47:26.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.099+0000 7fec7157e700 1 Processor -- start 2024-03-18T14:47:26.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.099+0000 7fec7157e700 1 -- start start 2024-03-18T14:47:26.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec7157e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 0x7fec6c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec7157e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c06eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec7157e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c13fb60 con 0x7fec6c0a54b0 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec7157e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c13fe00 con 0x7fec6c0a7060 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec7157e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0b3840 con 0x7fec6c139550 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 0x7fec6c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6a7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c06eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fec6c0a54b0 0x7fec6c06f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58578/0 (socket says 172.21.15.57:58578) 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6b7fe700 1 -- 172.21.15.57:0/3106979930 learned_addr learned my addr 172.21.15.57:0/3106979930 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec69ffb700 1 -- 172.21.15.57:0/3106979930 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380206632 0 0) 0x7fec6c13fb60 con 0x7fec6c0a54b0 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec69ffb700 1 -- 172.21.15.57:0/3106979930 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec54003570 con 0x7fec6c0a54b0 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6affd700 1 -- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 msgr2=0x7fec6c06eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6affd700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c06eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6affd700 1 -- 172.21.15.57:0/3106979930 >> v1:172.21.15.57:6789/0 conn(0x7fec6c0a54b0 legacy=0x7fec6c06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6affd700 1 -- 172.21.15.57:0/3106979930 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0a5cc0 con 0x7fec6c139550 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.100+0000 7fec6a7fc700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.101+0000 7fec6affd700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 0x7fec6c0b3300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009940 tx=0x7fec5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e6d639485d298b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.101+0000 7fec69ffb700 1 -- 172.21.15.57:0/3106979930 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011630 con 0x7fec6c139550 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.101+0000 7fec69ffb700 1 -- 172.21.15.57:0/3106979930 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5c011790 con 0x7fec6c139550 2024-03-18T14:47:26.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.101+0000 7fec69ffb700 1 -- 172.21.15.57:0/3106979930 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011b50 con 0x7fec6c139550 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 -- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 msgr2=0x7fec6c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 0x7fec6c0b3300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec5c009940 tx=0x7fec5c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 -- 172.21.15.57:0/3106979930 shutdown_connections 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c139550 0x7fec6c0b3300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 --2- 172.21.15.57:0/3106979930 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c06eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 -- 172.21.15.57:0/3106979930 >> 172.21.15.57:0/3106979930 conn(0x7fec6c06e250 msgr2=0x7fec6c06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 -- 172.21.15.57:0/3106979930 shutdown_connections 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.102+0000 7fec7157e700 1 -- 172.21.15.57:0/3106979930 wait complete. 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.103+0000 7fec7157e700 1 Processor -- start 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.103+0000 7fec7157e700 1 -- start start 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fdc20143d40 con 0x7fdc200b21f0 2024-03-18T14:47:26.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c0a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c14d320 con 0x7fec6c139550 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0a9c60 con 0x7fec6c0a7060 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec7157e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0aa980 con 0x7fec6c0a54b0 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6affd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49346/0 (socket says 172.21.15.57:49346) 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6affd700 1 -- 172.21.15.57:0/2086208702 learned_addr learned my addr 172.21.15.57:0/2086208702 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34254/0 (socket says 172.21.15.57:34254) 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6a7fc700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c0a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 -- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 msgr2=0x7fec6c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 -- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 msgr2=0x7fec6c0a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c0a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6b7fe700 1 -- 172.21.15.57:0/2086208702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6000d8d0 con 0x7fec6c139550 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6affd700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.104+0000 7fec6a7fc700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c0a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec6b7fe700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec6400cb60 tx=0x7fec640018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400a850 con 0x7fec6c139550 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c009420 con 0x7fec6c139550 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6400a9b0 con 0x7fec6c139550 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400ad70 con 0x7fec6c139550 2024-03-18T14:47:26.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.105+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c0a8910 con 0x7fec6c139550 2024-03-18T14:47:26.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.106+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c065180 con 0x7fec6c139550 2024-03-18T14:47:26.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.107+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fec64007300 con 0x7fec6c139550 2024-03-18T14:47:26.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.107+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fec6405b430 con 0x7fec6c139550 2024-03-18T14:47:26.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.114+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fec64039650 con 0x7fec6c139550 2024-03-18T14:47:26.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.211+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f70ac0a2830 con 0x7f70ac069200 2024-03-18T14:47:26.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.211+0000 7f70a8ff9700 1 -- 172.21.15.57:0/4076857785 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70a003d2d0 con 0x7f70ac069200 2024-03-18T14:47:26.213 INFO:teuthology.orchestra.run.smithi057.stdout:128849018883 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 >> v1:172.21.15.57:6816/47480 conn(0x7f7090046010 legacy=0x7f70900484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 msgr2=0x7f70ac0a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f70a000ec50 tx=0x7f70a0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 shutdown_connections 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f70ac0a3ee0 0x7f70ac151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f70ac069200 0x7f70ac0a17d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 --2- 172.21.15.57:0/4076857785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70ac0a32d0 0x7f70ac151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 >> 172.21.15.57:0/4076857785 conn(0x7f70ac06abe0 msgr2=0x7f70ac068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 shutdown_connections 2024-03-18T14:47:26.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.213+0000 7f70b2c43700 1 -- 172.21.15.57:0/4076857785 wait complete. 2024-03-18T14:47:26.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.223+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f62a8005830 con 0x7f62d00b16c0 2024-03-18T14:47:26.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.223+0000 7f62c5ffb700 1 -- 172.21.15.57:0/292847138 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62c0002040 con 0x7f62d00b16c0 2024-03-18T14:47:26.225 INFO:teuthology.orchestra.run.smithi057.stdout:124554051587 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.225+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 >> v1:172.21.15.57:6816/47480 conn(0x7f62b4046010 legacy=0x7f62b40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.225+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 msgr2=0x7f62d01513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.225+0000 7f62bb7fe700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f62c00090b0 tx=0x7f62c0018000 comp rx=0 tx=0).stop 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 shutdown_connections 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f62d013a650 0x7f62d01518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f62d00aca50 0x7f62d011b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.2 2024-03-18T14:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 --2- 172.21.15.57:0/292847138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f62d00b16c0 0x7f62d01513a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 >> 172.21.15.57:0/292847138 conn(0x7f62d006a4d0 msgr2=0x7f62d0063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 shutdown_connections 2024-03-18T14:47:26.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.226+0000 7f62bb7fe700 1 -- 172.21.15.57:0/292847138 wait complete. 2024-03-18T14:47:26.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.1 2024-03-18T14:47:26.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.295+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc20143d40 con 0x7fdc200b21f0 2024-03-18T14:47:26.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.296+0000 7fdc15ffb700 1 -- 172.21.15.57:0/3766500300 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc20143d40 con 0x7fdc200b21f0 2024-03-18T14:47:26.297 INFO:teuthology.orchestra.run.smithi057.stdout:120259084291 2024-03-18T14:47:26.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.297+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec6c0b25f0 con 0x7fec6c139550 2024-03-18T14:47:26.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.297+0000 7fec52ffd700 1 -- 172.21.15.57:0/2086208702 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec6403ce40 con 0x7fec6c139550 2024-03-18T14:47:26.298 INFO:teuthology.orchestra.run.smithi057.stdout:137438953474 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 >> v1:172.21.15.57:6816/47480 conn(0x7fdc04046010 legacy=0x7fdc040484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 msgr2=0x7fdc200ab050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009f10 tx=0x7fdc1800b040 comp rx=0 tx=0).stop 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 shutdown_connections 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdc200b21f0 0x7fdc200ab050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdc200679e0 0x7fdc20096fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 --2- 172.21.15.57:0/3766500300 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdc200684c0 0x7fdc200aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 >> 172.21.15.57:0/3766500300 conn(0x7fdc2006d1f0 msgr2=0x7fdc2006aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 shutdown_connections 2024-03-18T14:47:26.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.298+0000 7fdc27dbd700 1 -- 172.21.15.57:0/3766500300 wait complete. 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 >> v1:172.21.15.57:6816/47480 conn(0x7fec58046010 legacy=0x7fec580484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 msgr2=0x7fec6c0aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec6400cb60 tx=0x7fec640018f0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 shutdown_connections 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fec6c139550 0x7fec6c0aa440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fec6c0a54b0 0x7fec6c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 --2- 172.21.15.57:0/2086208702 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fec6c0a7060 0x7fec6c0a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:26.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 >> 172.21.15.57:0/2086208702 conn(0x7fec6c06e250 msgr2=0x7fec6c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:26.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 shutdown_connections 2024-03-18T14:47:26.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:26.299+0000 7fec7157e700 1 -- 172.21.15.57:0/2086208702 wait complete. 2024-03-18T14:47:26.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084291 for osd.0 2024-03-18T14:47:26.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953474 for osd.3 2024-03-18T14:47:27.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:47:27.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:47:27.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:47:27.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:47:27.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.379+0000 7fbea8074700 1 Processor -- start 2024-03-18T14:47:27.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.379+0000 7fbea8074700 1 -- start start 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0063a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbea00aa1c0 0x7fbea00ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea0141b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea00ada60 con 0x7fbea00aa1c0 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00aca40 con 0x7fbea00ad690 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea8074700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea00acce0 con 0x7fbea01416e0 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea5e10700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea5e10700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0063a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43146/0 (socket says 172.21.15.57:43146) 2024-03-18T14:47:27.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea5e10700 1 -- 172.21.15.57:0/1374588176 learned_addr learned my addr 172.21.15.57:0/1374588176 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.380+0000 7fbea6611700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea0141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea560f700 1 --2- 172.21.15.57:0/1374588176 >> v2:172.21.15.57:3300/0 conn(0x7fbea00aa1c0 0x7fbea00ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 -- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 msgr2=0x7fbea0063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0063a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 -- 172.21.15.57:0/1374588176 >> v2:172.21.15.57:3300/0 conn(0x7fbea00aa1c0 msgr2=0x7fbea00ac0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 --2- 172.21.15.57:0/1374588176 >> v2:172.21.15.57:3300/0 conn(0x7fbea00aa1c0 0x7fbea00ac0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 -- 172.21.15.57:0/1374588176 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea00aa5b0 con 0x7fbea01416e0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea6611700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea0141b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b62ea449878fe1cf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea4e0e700 1 -- 172.21.15.57:0/1374588176 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800e070 con 0x7fbea01416e0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea4e0e700 1 -- 172.21.15.57:0/1374588176 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9800bb40 con 0x7fbea01416e0 2024-03-18T14:47:27.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.381+0000 7fbea4e0e700 1 -- 172.21.15.57:0/1374588176 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98012430 con 0x7fbea01416e0 2024-03-18T14:47:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 -- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 msgr2=0x7fbea0141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea0141b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbe98009e60 tx=0x7fbe98009780 comp rx=0 tx=0).stop 2024-03-18T14:47:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 -- 172.21.15.57:0/1374588176 shutdown_connections 2024-03-18T14:47:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea0141b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 --2- 172.21.15.57:0/1374588176 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 --2- 172.21.15.57:0/1374588176 >> v2:172.21.15.57:3300/0 conn(0x7fbea00aa1c0 0x7fbea00ac0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.382+0000 7fbea8074700 1 -- 172.21.15.57:0/1374588176 >> 172.21.15.57:0/1374588176 conn(0x7fbea006a4d0 msgr2=0x7fbea006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.383+0000 7fbea8074700 1 -- 172.21.15.57:0/1374588176 shutdown_connections 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.383+0000 7fbea8074700 1 -- 172.21.15.57:0/1374588176 wait complete. 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.384+0000 7fbea8074700 1 Processor -- start 2024-03-18T14:47:27.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.384+0000 7fbea8074700 1 -- start start 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea00aa1c0 0x7fbea011cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea011d460 con 0x7fbea00aa1c0 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea013df90 con 0x7fbea00ad690 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea8074700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea011d940 con 0x7fbea01416e0 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea6611700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea6611700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49370/0 (socket says 172.21.15.57:49370) 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea6611700 1 -- 172.21.15.57:0/168214781 learned_addr learned my addr 172.21.15.57:0/168214781 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea560f700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.385+0000 7fbea5e10700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea00aa1c0 0x7fbea011cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 -- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 msgr2=0x7fbea0119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 -- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea00aa1c0 msgr2=0x7fbea011cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea00aa1c0 0x7fbea011cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 -- 172.21.15.57:0/168214781 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe98009a20 con 0x7fbea01416e0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea560f700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea6611700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe980099f0 tx=0x7fbe98019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe98027470 con 0x7fbea01416e0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe980275f0 con 0x7fbea01416e0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea011d650 con 0x7fbea01416e0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe980279b0 con 0x7fbea01416e0 2024-03-18T14:47:27.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.386+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea011ed80 con 0x7fbea01416e0 2024-03-18T14:47:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.388+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea011eb90 con 0x7fbea01416e0 2024-03-18T14:47:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.388+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbe98024070 con 0x7fbea01416e0 2024-03-18T14:47:27.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.389+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fbe9805db80 con 0x7fbea01416e0 2024-03-18T14:47:27.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.395+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fbe98008e70 con 0x7fbea01416e0 2024-03-18T14:47:27.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.422+0000 7f0d246ab700 1 Processor -- start 2024-03-18T14:47:27.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.422+0000 7f0d246ab700 1 -- start start 2024-03-18T14:47:27.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d246ab700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0d1c063ab0 0x7f0d1c06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d246ab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d246ab700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c0ac600 con 0x7f0d1c145ca0 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d246ab700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c0ac8a0 con 0x7f0d1c063ab0 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d246ab700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0ad8c0 con 0x7f0d1c146780 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49386/0 (socket says 172.21.15.57:49386) 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 -- 172.21.15.57:0/643194817 learned_addr learned my addr 172.21.15.57:0/643194817 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22447700 1 --2- 172.21.15.57:0/643194817 >> v2:172.21.15.57:3300/0 conn(0x7f0d1c063ab0 0x7f0d1c06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 -- 172.21.15.57:0/643194817 >> v2:172.21.15.57:3300/0 conn(0x7f0d1c063ab0 msgr2=0x7f0d1c06daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 --2- 172.21.15.57:0/643194817 >> v2:172.21.15.57:3300/0 conn(0x7f0d1c063ab0 0x7f0d1c06daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 -- 172.21.15.57:0/643194817 >> v1:172.21.15.57:6789/0 conn(0x7f0d1c145ca0 legacy=0x7f0d1c146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 -- 172.21.15.57:0/643194817 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c06e600 con 0x7f0d1c146780 2024-03-18T14:47:27.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.423+0000 7f0d22c48700 1 --2- 172.21.15.57:0/643194817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009f20 tx=0x7f0d14009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60869d77497f14a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.425+0000 7f0d21445700 1 -- 172.21.15.57:0/643194817 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400e070 con 0x7f0d1c146780 2024-03-18T14:47:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.425+0000 7f0d21445700 1 -- 172.21.15.57:0/643194817 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400b9d0 con 0x7f0d1c146780 2024-03-18T14:47:27.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.425+0000 7f0d21445700 1 -- 172.21.15.57:0/643194817 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d140092e0 con 0x7f0d1c146780 2024-03-18T14:47:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.426+0000 7f0d246ab700 1 -- 172.21.15.57:0/643194817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 msgr2=0x7f0d1c14d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.426+0000 7f0d246ab700 1 --2- 172.21.15.57:0/643194817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009f20 tx=0x7f0d14009840 comp rx=0 tx=0).stop 2024-03-18T14:47:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 -- 172.21.15.57:0/643194817 shutdown_connections 2024-03-18T14:47:27.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 --2- 172.21.15.57:0/643194817 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c14d1f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 --2- 172.21.15.57:0/643194817 >> v2:172.21.15.57:3300/0 conn(0x7f0d1c063ab0 0x7f0d1c06daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 -- 172.21.15.57:0/643194817 >> 172.21.15.57:0/643194817 conn(0x7f0d1c06a4d0 msgr2=0x7f0d1c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 -- 172.21.15.57:0/643194817 shutdown_connections 2024-03-18T14:47:27.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.427+0000 7f0d246ab700 1 -- 172.21.15.57:0/643194817 wait complete. 2024-03-18T14:47:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 Processor -- start 2024-03-18T14:47:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 -- start start 2024-03-18T14:47:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 0x7f0d1c0a8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c147170 con 0x7f0d1c145ca0 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0a7320 con 0x7f0d1c063ab0 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d246ab700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c0a8f60 con 0x7f0d1c146780 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d22c48700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d21c46700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d22c48700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49392/0 (socket says 172.21.15.57:49392) 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d22c48700 1 -- 172.21.15.57:0/2909810121 learned_addr learned my addr 172.21.15.57:0/2909810121 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.428+0000 7f0d21c46700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34300/0 (socket says 172.21.15.57:34300) 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22447700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 0x7f0d1c0a8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 -- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 msgr2=0x7f0d1c0a8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 0x7f0d1c0a8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 -- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 msgr2=0x7f0d1c1310e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 -- 172.21.15.57:0/2909810121 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14009ae0 con 0x7f0d1c146780 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d21c46700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22447700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 0x7f0d1c0a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d22c48700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400b610 tx=0x7f0d14018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14008b80 con 0x7f0d1c146780 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14008ce0 con 0x7f0d1c146780 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.429+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1401d650 con 0x7f0d1c146780 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.430+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c0a9210 con 0x7f0d1c146780 2024-03-18T14:47:27.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.430+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c0a9cf0 con 0x7f0d1c146780 2024-03-18T14:47:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.431+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c065180 con 0x7f0d1c146780 2024-03-18T14:47:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.431+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0d14003040 con 0x7f0d1c146780 2024-03-18T14:47:27.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.432+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0d1405ce60 con 0x7f0d1c146780 2024-03-18T14:47:27.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.447+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0d14007f60 con 0x7f0d1c146780 2024-03-18T14:47:27.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.456+0000 7fa27de12700 1 Processor -- start 2024-03-18T14:47:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.456+0000 7fa27de12700 1 -- start start 2024-03-18T14:47:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa27de12700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 0x7fa2780a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa27de12700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa27814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa27de12700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2780a4350 con 0x7fa2780b21e0 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa27de12700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a45f0 con 0x7fa2780680f0 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa27de12700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa27806dda0 con 0x7fa2780a3e10 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa2777fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa2780b21e0 0x7fa2780679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58600/0 (socket says 172.21.15.57:58600) 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa2777fe700 1 -- 172.21.15.57:0/3429411647 learned_addr learned my addr 172.21.15.57:0/3429411647 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa276ffd700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 0x7fa2780a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa277fff700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa27814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa276ffd700 1 -- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 msgr2=0x7fa27814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa276ffd700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa27814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa276ffd700 1 -- 172.21.15.57:0/3429411647 >> v1:172.21.15.57:6789/0 conn(0x7fa2780b21e0 legacy=0x7fa2780679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.457+0000 7fa276ffd700 1 -- 172.21.15.57:0/3429411647 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780a2aa0 con 0x7fa2780a3e10 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.458+0000 7fa276ffd700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 0x7fa2780a3620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009910 tx=0x7fa26c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316be086fd14b204 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.458+0000 7fa2767fc700 1 -- 172.21.15.57:0/3429411647 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00b680 con 0x7fa2780a3e10 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.458+0000 7fa2767fc700 1 -- 172.21.15.57:0/3429411647 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c00b7e0 con 0x7fa2780a3e10 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.458+0000 7fa2767fc700 1 -- 172.21.15.57:0/3429411647 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00bba0 con 0x7fa2780a3e10 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 -- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 msgr2=0x7fa2780a3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 0x7fa2780a3620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa26c009910 tx=0x7fa26c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 -- 172.21.15.57:0/3429411647 shutdown_connections 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa27814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 --2- 172.21.15.57:0/3429411647 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780a3e10 0x7fa2780a3620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 -- 172.21.15.57:0/3429411647 >> 172.21.15.57:0/3429411647 conn(0x7fa27806ac00 msgr2=0x7fa27806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 -- 172.21.15.57:0/3429411647 shutdown_connections 2024-03-18T14:47:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7fa27de12700 1 -- 172.21.15.57:0/3429411647 wait complete. 2024-03-18T14:47:27.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7f3e29562700 1 Processor -- start 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.459+0000 7f3e29562700 1 -- start start 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240b22a0 0x7f3e240a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e240a4910 0x7f3e2413b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e2413af20 con 0x7f3e240a4910 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240a3c40 con 0x7f3e2406daa0 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e29562700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2413b110 con 0x7f3e240b22a0 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7fa27de12700 1 Processor -- start 2024-03-18T14:47:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43164/0 (socket says 172.21.15.57:43164) 2024-03-18T14:47:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 -- 172.21.15.57:0/3026453939 learned_addr learned my addr 172.21.15.57:0/3026453939 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7fa27de12700 1 -- start start 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 -- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240b22a0 msgr2=0x7f3e240a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 --2- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240b22a0 0x7f3e240a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 -- 172.21.15.57:0/3026453939 >> v2:172.21.15.57:3300/0 conn(0x7f3e240a4910 msgr2=0x7f3e2413b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 --2- 172.21.15.57:0/3026453939 >> v2:172.21.15.57:3300/0 conn(0x7f3e240a4910 0x7f3e2413b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 -- 172.21.15.57:0/3026453939 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2413b3b0 con 0x7f3e2406daa0 2024-03-18T14:47:27.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.460+0000 7f3e237fe700 1 --2- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d1a0 tx=0x7f3e1c00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4bbee2c693c4ae server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7f3e21ffb700 1 -- 172.21.15.57:0/3026453939 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c010070 con 0x7f3e2406daa0 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa2780aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 0x7fa2780a8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 0x7fa2780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a7e90 con 0x7fa2780a3e10 2024-03-18T14:47:27.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a8150 con 0x7fa2780680f0 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa27de12700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780a6c00 con 0x7fa2780b21e0 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa277fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 0x7fa2780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa2777fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa2780aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa2777fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa2780aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43180/0 (socket says 172.21.15.57:43180) 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa277fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 0x7fa2780a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49420/0 (socket says 172.21.15.57:49420) 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa2777fe700 1 -- 172.21.15.57:0/2585610240 learned_addr learned my addr 172.21.15.57:0/2585610240 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7f3e21ffb700 1 -- 172.21.15.57:0/3026453939 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00b0d0 con 0x7f3e2406daa0 2024-03-18T14:47:27.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7f3e21ffb700 1 -- 172.21.15.57:0/3026453939 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00b490 con 0x7f3e2406daa0 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 0x7fa2780a8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 -- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 msgr2=0x7fa2780a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 0x7fa2780a5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 -- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 msgr2=0x7fa2780aa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa2780aa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.461+0000 7fa276ffd700 1 -- 172.21.15.57:0/2585610240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c009420 con 0x7fa2780a3e10 2024-03-18T14:47:27.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa276ffd700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 0x7fa2780a8bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa26c016000 tx=0x7fa26c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7f3e29562700 1 -- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 msgr2=0x7f3e2406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7f3e29562700 1 --2- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d1a0 tx=0x7f3e1c00ba50 comp rx=0 tx=0).stop 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00b950 con 0x7fa2780a3e10 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2780a7a70 con 0x7fa2780a3e10 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c00bab0 con 0x7fa2780a3e10 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c01a660 con 0x7fa2780a3e10 2024-03-18T14:47:27.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.462+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa278145510 con 0x7fa2780a3e10 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa26c01aa50 con 0x7fa2780a3e10 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa278065180 con 0x7fa2780a3e10 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 -- 172.21.15.57:0/3026453939 shutdown_connections 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 --2- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e2406daa0 0x7f3e2406df00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 --2- 172.21.15.57:0/3026453939 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240b22a0 0x7f3e240a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 --2- 172.21.15.57:0/3026453939 >> v2:172.21.15.57:3300/0 conn(0x7f3e240a4910 0x7f3e2413b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 -- 172.21.15.57:0/3026453939 >> 172.21.15.57:0/3026453939 conn(0x7f3e2406d1f0 msgr2=0x7f3e2406af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 -- 172.21.15.57:0/3026453939 shutdown_connections 2024-03-18T14:47:27.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7f3e29562700 1 -- 172.21.15.57:0/3026453939 wait complete. 2024-03-18T14:47:27.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.463+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa26c05ce70 con 0x7fa2780a3e10 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.464+0000 7f3e29562700 1 Processor -- start 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 -- start start 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e2406daa0 0x7f3e240a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240ae9b0 con 0x7f3e2406daa0 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240af6e0 con 0x7f3e240b22a0 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e29562700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240ae710 con 0x7f3e240a4910 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e227fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e227fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49434/0 (socket says 172.21.15.57:49434) 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43192/0 (socket says 172.21.15.57:43192) 2024-03-18T14:47:27.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.465+0000 7f3e227fc700 1 -- 172.21.15.57:0/756864742 learned_addr learned my addr 172.21.15.57:0/756864742 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 -- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 msgr2=0x7f3e240aa0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 -- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e2406daa0 msgr2=0x7f3e240a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e2406daa0 0x7f3e240a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 -- 172.21.15.57:0/756864742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c00bcf0 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e227fc700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e237fe700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c017000 tx=0x7f3e1c01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00adc0 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c01e440 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c01e800 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e240aba90 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.466+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240aede0 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.467+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e240af0c0 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.468+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3e1c003040 con 0x7f3e240b22a0 2024-03-18T14:47:27.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.468+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3e1c05d320 con 0x7f3e240b22a0 2024-03-18T14:47:27.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.471+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fa26c005bd0 con 0x7fa2780a3e10 2024-03-18T14:47:27.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.475+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f3e1c006680 con 0x7f3e240b22a0 2024-03-18T14:47:27.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.585+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbea011eb90 con 0x7fbea01416e0 2024-03-18T14:47:27.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.585+0000 7fbe95ffb700 1 -- 172.21.15.57:0/168214781 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbea011eb90 con 0x7fbea01416e0 2024-03-18T14:47:27.587 INFO:teuthology.orchestra.run.smithi057.stdout:128849018883 2024-03-18T14:47:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.587+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 >> v1:172.21.15.57:6816/47480 conn(0x7fbe84046040 legacy=0x7fbe840484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 msgr2=0x7fbea011a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbe980099f0 tx=0x7fbe98019000 comp rx=0 tx=0).stop 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 shutdown_connections 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbea01416e0 0x7fbea011a470 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbea00aa1c0 0x7fbea011cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 --2- 172.21.15.57:0/168214781 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbea00ad690 0x7fbea0119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 >> 172.21.15.57:0/168214781 conn(0x7fbea006a4d0 msgr2=0x7fbea0068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 shutdown_connections 2024-03-18T14:47:27.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.588+0000 7fbea8074700 1 -- 172.21.15.57:0/168214781 wait complete. 2024-03-18T14:47:27.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.2 2024-03-18T14:47:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.623+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0d1c0aaa70 con 0x7f0d1c146780 2024-03-18T14:47:27.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.624+0000 7f0d127fc700 1 -- 172.21.15.57:0/2909810121 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d1403e760 con 0x7f0d1c146780 2024-03-18T14:47:27.625 INFO:teuthology.orchestra.run.smithi057.stdout:124554051587 2024-03-18T14:47:27.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.625+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 >> v1:172.21.15.57:6816/47480 conn(0x7f0d00046010 legacy=0x7f0d000484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.625+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 msgr2=0x7f0d1c131620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.625+0000 7f0d246ab700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400b610 tx=0x7f0d14018000 comp rx=0 tx=0).stop 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 shutdown_connections 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0d1c146780 0x7f0d1c131620 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0d1c063ab0 0x7f0d1c0a8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 --2- 172.21.15.57:0/2909810121 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0d1c145ca0 0x7f0d1c1310e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 >> 172.21.15.57:0/2909810121 conn(0x7f0d1c06a4d0 msgr2=0x7f0d1c068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 shutdown_connections 2024-03-18T14:47:27.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.626+0000 7f0d246ab700 1 -- 172.21.15.57:0/2909810121 wait complete. 2024-03-18T14:47:27.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.1 2024-03-18T14:47:27.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.637+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa27809ff10 con 0x7fa2780a3e10 2024-03-18T14:47:27.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.638+0000 7fa25f7fe700 1 -- 172.21.15.57:0/2585610240 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa26c005a00 con 0x7fa2780a3e10 2024-03-18T14:47:27.640 INFO:teuthology.orchestra.run.smithi057.stdout:137438953475 2024-03-18T14:47:27.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 >> v1:172.21.15.57:6816/47480 conn(0x7fa264046040 legacy=0x7fa2640484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 msgr2=0x7fa2780a8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 0x7fa2780a8bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa26c016000 tx=0x7fa26c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 shutdown_connections 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa2780b21e0 0x7fa2780a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa2780680f0 0x7fa2780aa2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 --2- 172.21.15.57:0/2585610240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa2780a3e10 0x7fa2780a8bb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 >> 172.21.15.57:0/2585610240 conn(0x7fa27806ac00 msgr2=0x7fa2780691e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 shutdown_connections 2024-03-18T14:47:27.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.640+0000 7fa27de12700 1 -- 172.21.15.57:0/2585610240 wait complete. 2024-03-18T14:47:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.644+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e240abc20 con 0x7f3e240b22a0 2024-03-18T14:47:27.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.644+0000 7f3e0affd700 1 -- 172.21.15.57:0/756864742 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e1c006680 con 0x7f3e240b22a0 2024-03-18T14:47:27.645 INFO:teuthology.orchestra.run.smithi057.stdout:120259084292 2024-03-18T14:47:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 >> v1:172.21.15.57:6816/47480 conn(0x7f3e10046010 legacy=0x7f3e100484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 msgr2=0x7f3e240aa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:27.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c017000 tx=0x7f3e1c01a000 comp rx=0 tx=0).stop 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 shutdown_connections 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e240b22a0 0x7f3e240aa620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e2406daa0 0x7f3e240a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 --2- 172.21.15.57:0/756864742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e240a4910 0x7f3e240aa0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 >> 172.21.15.57:0/756864742 conn(0x7f3e2406d1f0 msgr2=0x7f3e2406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 shutdown_connections 2024-03-18T14:47:27.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:27.646+0000 7f3e29562700 1 -- 172.21.15.57:0/756864742 wait complete. 2024-03-18T14:47:27.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953475 for osd.3 2024-03-18T14:47:27.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084292 for osd.0 2024-03-18T14:47:28.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T14:47:28.636 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-18T14:47:28.635+0000 7f57bda47700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T14:47:28.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T14:47:28.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T14:47:28.661 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T14:47:28.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.754+0000 7f37c58ec700 1 Processor -- start 2024-03-18T14:47:28.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.754+0000 7f37c58ec700 1 -- start start 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37c58ec700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 0x7f37c013fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37c58ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 0x7f37c0140270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37c58ec700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00a57f0 con 0x7f37c00a4790 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37c58ec700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00a37c0 con 0x7f37c00a5420 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37c58ec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00a7470 con 0x7f37c00b0810 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37bf7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f37c00a4790 0x7f37c006eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58614/0 (socket says 172.21.15.57:58614) 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37bf7fe700 1 -- 172.21.15.57:0/2907485374 learned_addr learned my addr 172.21.15.57:0/2907485374 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37beffd700 1 --2- 172.21.15.57:0/2907485374 >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 0x7f37c013fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.755+0000 7f37be7fc700 1 --2- 172.21.15.57:0/2907485374 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 0x7f37c0140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37be7fc700 1 -- 172.21.15.57:0/2907485374 >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 msgr2=0x7f37c013fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37be7fc700 1 --2- 172.21.15.57:0/2907485374 >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 0x7f37c013fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37be7fc700 1 -- 172.21.15.57:0/2907485374 >> v1:172.21.15.57:6789/0 conn(0x7f37c00a4790 legacy=0x7f37c006eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37bdffb700 1 -- 172.21.15.57:0/2907485374 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3948109299 0 0) 0x7f37c00a57f0 con 0x7f37c00a4790 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37be7fc700 1 -- 172.21.15.57:0/2907485374 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00a42c0 con 0x7f37c00b0810 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37beffd700 1 --2- 172.21.15.57:0/2907485374 >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 0x7f37c013fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37be7fc700 1 --2- 172.21.15.57:0/2907485374 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 0x7f37c0140270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37b40098e0 tx=0x7f37b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df2db93ee919bbf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37bdffb700 1 -- 172.21.15.57:0/2907485374 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400b640 con 0x7f37c00b0810 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37bdffb700 1 -- 172.21.15.57:0/2907485374 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400b7a0 con 0x7f37c00b0810 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.756+0000 7f37bdffb700 1 -- 172.21.15.57:0/2907485374 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400bb40 con 0x7f37c00b0810 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 -- 172.21.15.57:0/2907485374 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 msgr2=0x7f37c0140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 --2- 172.21.15.57:0/2907485374 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 0x7f37c0140270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37b40098e0 tx=0x7f37b40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 -- 172.21.15.57:0/2907485374 shutdown_connections 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 --2- 172.21.15.57:0/2907485374 >> v2:172.21.15.57:3300/0 conn(0x7f37c00a5420 0x7f37c013fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 --2- 172.21.15.57:0/2907485374 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00b0810 0x7f37c0140270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 -- 172.21.15.57:0/2907485374 >> 172.21.15.57:0/2907485374 conn(0x7f37c006c150 msgr2=0x7f37c00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 -- 172.21.15.57:0/2907485374 shutdown_connections 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.757+0000 7f37c58ec700 1 -- 172.21.15.57:0/2907485374 wait complete. 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.759+0000 7f37c58ec700 1 Processor -- start 2024-03-18T14:47:28.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.759+0000 7f37c58ec700 1 -- start start 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 0x7f37c00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 0x7f37c014fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ada90 con 0x7f37c00b0810 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ac3a0 con 0x7f37c00a4790 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37c58ec700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00ac640 con 0x7f37c00a5420 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37be7fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37be7fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49448/0 (socket says 172.21.15.57:49448) 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37be7fc700 1 -- 172.21.15.57:0/3145068952 learned_addr learned my addr 172.21.15.57:0/3145068952 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37bf7fe700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 0x7f37c014fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.760+0000 7f37beffd700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 0x7f37c00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 -- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 msgr2=0x7f37c00aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 0x7f37c00aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 -- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 msgr2=0x7f37c014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 0x7f37c014fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 -- 172.21.15.57:0/3145068952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0009420 con 0x7f37c00a5420 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37bf7fe700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 0x7f37c014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37beffd700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 0x7f37c00aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37be7fc700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37c00a75b0 tx=0x7f37b4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400b910 con 0x7f37c00a5420 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400ba70 con 0x7f37c00a5420 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b4009420 con 0x7f37c00a5420 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011670 con 0x7f37c00a5420 2024-03-18T14:47:28.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.761+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00aae60 con 0x7f37c00a5420 2024-03-18T14:47:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.763+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f37b4011aa0 con 0x7f37c00a5420 2024-03-18T14:47:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.763+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0065180 con 0x7f37c00a5420 2024-03-18T14:47:28.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.763+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f37b405c920 con 0x7f37c00a5420 2024-03-18T14:47:28.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.767+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f37b4002ae0 con 0x7f37c00a5420 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.779+0000 7f0de1872700 1 Processor -- start 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.779+0000 7f0de1872700 1 -- start start 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.779+0000 7f0de1872700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ddc063ab0 0x7f0ddc06daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.779+0000 7f0de1872700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc146780 0x7f0ddc14d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0de1872700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc0ac600 con 0x7f0ddc145ca0 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0de1872700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ac8a0 con 0x7f0ddc063ab0 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0de1872700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0ad8c0 con 0x7f0ddc146780 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0ddc063ab0 0x7f0ddc06daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0dda7fc700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0ddc145ca0 0x7f0ddc146070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58622/0 (socket says 172.21.15.57:58622) 2024-03-18T14:47:28.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0dda7fc700 1 -- 172.21.15.57:0/845418239 learned_addr learned my addr 172.21.15.57:0/845418239 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 -- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc146780 msgr2=0x7f0ddc14d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 --2- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc146780 0x7f0ddc14d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 -- 172.21.15.57:0/845418239 >> v1:172.21.15.57:6789/0 conn(0x7f0ddc145ca0 legacy=0x7f0ddc146070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 -- 172.21.15.57:0/845418239 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc06e600 con 0x7f0ddc063ab0 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0ddaffd700 1 --2- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc063ab0 0x7f0ddc06daf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098e0 tx=0x7f0dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48df67e362bec39c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.780+0000 7f0dd9ffb700 1 -- 172.21.15.57:0/845418239 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc009e80 con 0x7f0ddc063ab0 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0dd9ffb700 1 -- 172.21.15.57:0/845418239 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc00b860 con 0x7f0ddc063ab0 2024-03-18T14:47:28.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0dd9ffb700 1 -- 172.21.15.57:0/845418239 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc00bbe0 con 0x7f0ddc063ab0 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 -- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc063ab0 msgr2=0x7f0ddc06daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 --2- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc063ab0 0x7f0ddc06daf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0098e0 tx=0x7f0dcc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 -- 172.21.15.57:0/845418239 shutdown_connections 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 --2- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc146780 0x7f0ddc14d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 --2- 172.21.15.57:0/845418239 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc063ab0 0x7f0ddc06daf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 -- 172.21.15.57:0/845418239 >> 172.21.15.57:0/845418239 conn(0x7f0ddc06a4d0 msgr2=0x7f0ddc06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 -- 172.21.15.57:0/845418239 shutdown_connections 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.781+0000 7f0de1872700 1 -- 172.21.15.57:0/845418239 wait complete. 2024-03-18T14:47:28.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 Processor -- start 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 -- start start 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 0x7f0ddc0a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 0x7f0ddc0aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 0x7f0ddc0a8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0a7740 con 0x7f0ddc145ca0 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0aaa60 con 0x7f0ddc063ab0 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0de1872700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc0aa020 con 0x7f0ddc146780 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0dda7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 0x7f0ddc0aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0dda7fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 0x7f0ddc0aa520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34362/0 (socket says 172.21.15.57:34362) 2024-03-18T14:47:28.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0dda7fc700 1 -- 172.21.15.57:0/2817958138 learned_addr learned my addr 172.21.15.57:0/2817958138 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0ddaffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 0x7f0ddc0a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.783+0000 7f0ddb7fe700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 0x7f0ddc0a8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 -- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 msgr2=0x7f0ddc0a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 0x7f0ddc0a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 -- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 msgr2=0x7f0ddc0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 0x7f0ddc0aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 -- 172.21.15.57:0/2817958138 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc009420 con 0x7f0ddc146780 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddaffd700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 0x7f0ddc0a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0ddb7fe700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 0x7f0ddc0a8d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400bb00 tx=0x7f0dd4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400c7d0 con 0x7f0ddc146780 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd400c950 con 0x7f0ddc146780 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc0a97a0 con 0x7f0ddc146780 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.784+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc0a8190 con 0x7f0ddc146780 2024-03-18T14:47:28.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.785+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd400cd10 con 0x7f0ddc146780 2024-03-18T14:47:28.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.786+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0dd4014620 con 0x7f0ddc146780 2024-03-18T14:47:28.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.786+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc0a9490 con 0x7f0ddc146780 2024-03-18T14:47:28.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.786+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0dd405b180 con 0x7f0ddc146780 2024-03-18T14:47:28.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.794+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0dd4039510 con 0x7f0ddc146780 2024-03-18T14:47:28.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.819+0000 7fa0bc5ee700 1 Processor -- start 2024-03-18T14:47:28.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.819+0000 7fa0bc5ee700 1 -- start start 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 0x7fa0b406ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b406fd10 con 0x7fa0b406ea90 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40b07e0 con 0x7fa0b40a4730 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bc5ee700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40697a0 con 0x7fa0b4068340 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0ba38a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0ba38a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49462/0 (socket says 172.21.15.57:49462) 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43230/0 (socket says 172.21.15.57:43230) 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0ba38a700 1 -- 172.21.15.57:0/237070737 learned_addr learned my addr 172.21.15.57:0/237070737 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bab8b700 1 --2- 172.21.15.57:0/237070737 >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 0x7fa0b406ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 -- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 msgr2=0x7fa0b40a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 -- 172.21.15.57:0/237070737 >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 msgr2=0x7fa0b406ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 --2- 172.21.15.57:0/237070737 >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 0x7fa0b406ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0b9b89700 1 -- 172.21.15.57:0/237070737 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b4069a40 con 0x7fa0b40a4730 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0ba38a700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.820+0000 7fa0bab8b700 1 --2- 172.21.15.57:0/237070737 >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 0x7fa0b406ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.821+0000 7fa0b9b89700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009910 tx=0x7fa0a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50647c6ea8b9dc80 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.821+0000 7fa0b9388700 1 -- 172.21.15.57:0/237070737 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4011630 con 0x7fa0b40a4730 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.821+0000 7fa0b9388700 1 -- 172.21.15.57:0/237070737 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4011790 con 0x7fa0b40a4730 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.821+0000 7fa0b9388700 1 -- 172.21.15.57:0/237070737 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a4011b30 con 0x7fa0b40a4730 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 msgr2=0x7fa0b406a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.824 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009910 tx=0x7fa0a40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/237070737 shutdown_connections 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/237070737 >> v2:172.21.15.57:3300/0 conn(0x7fa0b406ea90 0x7fa0b406ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b4068340 0x7fa0b40a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/237070737 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b40a4730 0x7fa0b406a0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/237070737 >> 172.21.15.57:0/237070737 conn(0x7fa0b406be90 msgr2=0x7fa0b40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/237070737 shutdown_connections 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/237070737 wait complete. 2024-03-18T14:47:28.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.822+0000 7efc87c5e700 1 Processor -- start 2024-03-18T14:47:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 -- start start 2024-03-18T14:47:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7fa0bc5ee700 1 Processor -- start 2024-03-18T14:47:28.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7fa0bc5ee700 1 -- start start 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc800a7590 0x7efc8013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a49d0 0x7efc8013e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800a4590 con 0x7efc800a7590 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800b5b50 con 0x7efc800b5780 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc87c5e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc800a1d50 con 0x7efc800a49d0 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc859fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc859fa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43244/0 (socket says 172.21.15.57:43244) 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.823+0000 7efc859fa700 1 -- 172.21.15.57:0/3494526624 learned_addr learned my addr 172.21.15.57:0/3494526624 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 -- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a49d0 msgr2=0x7efc8013e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 --2- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a49d0 0x7efc8013e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 -- 172.21.15.57:0/3494526624 >> v2:172.21.15.57:3300/0 conn(0x7efc800a7590 msgr2=0x7efc8013dc30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 --2- 172.21.15.57:0/3494526624 >> v2:172.21.15.57:3300/0 conn(0x7efc800a7590 0x7efc8013dc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 -- 172.21.15.57:0/3494526624 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800a2010 con 0x7efc800b5780 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc859fa700 1 --2- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc78009f50 tx=0x7efc78009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95d52ad4648b8429 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc849f8700 1 -- 172.21.15.57:0/3494526624 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800e070 con 0x7efc800b5780 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc849f8700 1 -- 172.21.15.57:0/3494526624 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800bb00 con 0x7efc800b5780 2024-03-18T14:47:28.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7efc849f8700 1 -- 172.21.15.57:0/3494526624 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc780092e0 con 0x7efc800b5780 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 0x7fa0b40a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 0x7fa0b4152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40a7cd0 con 0x7fa0b40a4730 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40a8590 con 0x7fa0b4068340 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0bc5ee700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b4152460 con 0x7fa0b406ea90 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0ba38a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0ba38a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43248/0 (socket says 172.21.15.57:43248) 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.824+0000 7fa0ba38a700 1 -- 172.21.15.57:0/2633395563 learned_addr learned my addr 172.21.15.57:0/2633395563 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0b9b89700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 0x7fa0b40a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 -- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 msgr2=0x7fa0b40a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0bab8b700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 0x7fa0b4152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 0x7fa0b40a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 -- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 msgr2=0x7fa0b4152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 0x7fa0b4152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 -- 172.21.15.57:0/2633395563 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b00094f0 con 0x7fa0b4068340 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 -- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 msgr2=0x7efc800a4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 --2- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efc78009f50 tx=0x7efc78009840 comp rx=0 tx=0).stop 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 -- 172.21.15.57:0/3494526624 shutdown_connections 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 --2- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a49d0 0x7efc8013e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 --2- 172.21.15.57:0/3494526624 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800a4050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 --2- 172.21.15.57:0/3494526624 >> v2:172.21.15.57:3300/0 conn(0x7efc800a7590 0x7efc8013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 -- 172.21.15.57:0/3494526624 >> 172.21.15.57:0/3494526624 conn(0x7efc8006fb90 msgr2=0x7efc800b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0b9b89700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 0x7fa0b40a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:47:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0bab8b700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 0x7fa0b4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T14:47:28.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 -- 172.21.15.57:0/3494526624 shutdown_connections 2024-03-18T14:47:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7fa0ba38a700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000ec50 tx=0x7fa0b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.825+0000 7efc87c5e700 1 -- 172.21.15.57:0/3494526624 wait complete. 2024-03-18T14:47:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.826+0000 7efc87c5e700 1 Processor -- start 2024-03-18T14:47:28.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.826+0000 7efc87c5e700 1 -- start start 2024-03-18T14:47:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b000c9d0 con 0x7fa0b4068340 2024-03-18T14:47:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b000cb30 con 0x7fa0b4068340 2024-03-18T14:47:28.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0013470 con 0x7fa0b4068340 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a7590 0x7efc8006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800a1820 con 0x7efc800a49d0 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8006cca0 con 0x7efc800b5780 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc87c5e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc800b24b0 con 0x7efc800a7590 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc859fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc859fa700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34390/0 (socket says 172.21.15.57:34390) 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc859fa700 1 -- 172.21.15.57:0/2963153285 learned_addr learned my addr 172.21.15.57:0/2963153285 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:28.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7efc861fb700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac009a20 con 0x7fa0b4068340 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.827+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4009420 con 0x7fa0b4068340 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 -- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a7590 msgr2=0x7efc8006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a7590 0x7efc8006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 -- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 msgr2=0x7efc800b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 -- 172.21.15.57:0/2963153285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78009ae0 con 0x7efc800a49d0 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc859fa700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc78009880 tx=0x7efc78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78007c50 con 0x7efc800a49d0 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78007dd0 con 0x7efc800a49d0 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7801e680 con 0x7efc800a49d0 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.829+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b4065180 con 0x7fa0b4068340 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.829+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa0b0013860 con 0x7fa0b4068340 2024-03-18T14:47:28.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.829+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa0b005b570 con 0x7fa0b4068340 2024-03-18T14:47:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc8006b4a0 con 0x7efc800a49d0 2024-03-18T14:47:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.828+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc8006e780 con 0x7efc800a49d0 2024-03-18T14:47:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.830+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80065180 con 0x7efc800a49d0 2024-03-18T14:47:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.830+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7efc78003040 con 0x7efc800a49d0 2024-03-18T14:47:28.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.834+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7efc7803c700 con 0x7efc800a49d0 2024-03-18T14:47:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.834+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7efc78062060 con 0x7efc800a49d0 2024-03-18T14:47:28.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.837+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fa0b0039810 con 0x7fa0b4068340 2024-03-18T14:47:28.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.942+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37c006d430 con 0x7f37c00a5420 2024-03-18T14:47:28.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.943+0000 7f37a6ffd700 1 -- 172.21.15.57:0/3145068952 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37b4015070 con 0x7f37c00a5420 2024-03-18T14:47:28.944 INFO:teuthology.orchestra.run.smithi057.stdout:128849018884 2024-03-18T14:47:28.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 >> v1:172.21.15.57:6816/47480 conn(0x7f37ac046010 legacy=0x7f37ac0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 msgr2=0x7f37c014f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37c00a75b0 tx=0x7f37b4017000 comp rx=0 tx=0).stop 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 shutdown_connections 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37c00b0810 0x7f37c014fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f37c00a4790 0x7f37c00aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 --2- 172.21.15.57:0/3145068952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f37c00a5420 0x7f37c014f5f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 >> 172.21.15.57:0/3145068952 conn(0x7f37c006c150 msgr2=0x7f37c013cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 shutdown_connections 2024-03-18T14:47:28.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.945+0000 7f37c58ec700 1 -- 172.21.15.57:0/3145068952 wait complete. 2024-03-18T14:47:28.959 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018884 for osd.2 2024-03-18T14:47:28.959 DEBUG:teuthology.parallel:result is None 2024-03-18T14:47:28.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.962+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0ddc0a7ef0 con 0x7f0ddc146780 2024-03-18T14:47:28.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.962+0000 7f0dc2ffd700 1 -- 172.21.15.57:0/2817958138 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0dd403e030 con 0x7f0ddc146780 2024-03-18T14:47:28.964 INFO:teuthology.orchestra.run.smithi057.stdout:124554051589 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 >> v1:172.21.15.57:6816/47480 conn(0x7f0dc8046010 legacy=0x7f0dc80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 msgr2=0x7f0ddc0a8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 0x7f0ddc0a8d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400bb00 tx=0x7f0dd4009780 comp rx=0 tx=0).stop 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 shutdown_connections 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ddc146780 0x7f0ddc0a8d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ddc063ab0 0x7f0ddc0a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 --2- 172.21.15.57:0/2817958138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ddc145ca0 0x7f0ddc0aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 >> 172.21.15.57:0/2817958138 conn(0x7f0ddc06a4d0 msgr2=0x7f0ddc068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:28.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 shutdown_connections 2024-03-18T14:47:28.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:28.964+0000 7f0de1872700 1 -- 172.21.15.57:0/2817958138 wait complete. 2024-03-18T14:47:28.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051589 for osd.1 2024-03-18T14:47:28.978 DEBUG:teuthology.parallel:result is None 2024-03-18T14:47:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.001+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efc800b4780 con 0x7efc800a49d0 2024-03-18T14:47:29.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.001+0000 7efc75ffb700 1 -- 172.21.15.57:0/2963153285 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc78062030 con 0x7efc800a49d0 2024-03-18T14:47:29.003 INFO:teuthology.orchestra.run.smithi057.stdout:120259084293 2024-03-18T14:47:29.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.002+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0b40afe90 con 0x7fa0b4068340 2024-03-18T14:47:29.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7fa0aa7fc700 1 -- 172.21.15.57:0/2633395563 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0b003d000 con 0x7fa0b4068340 2024-03-18T14:47:29.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 >> v1:172.21.15.57:6816/47480 conn(0x7efc64046010 legacy=0x7efc640484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 msgr2=0x7efc80142600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.005 INFO:teuthology.orchestra.run.smithi057.stdout:137438953476 2024-03-18T14:47:29.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efc78009880 tx=0x7efc78018000 comp rx=0 tx=0).stop 2024-03-18T14:47:29.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 shutdown_connections 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc800b5780 0x7efc800b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc800a49d0 0x7efc80142600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 --2- 172.21.15.57:0/2963153285 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc800a7590 0x7efc8006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 >> 172.21.15.57:0/2963153285 conn(0x7efc8006fb90 msgr2=0x7efc800a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 shutdown_connections 2024-03-18T14:47:29.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.003+0000 7efc87c5e700 1 -- 172.21.15.57:0/2963153285 wait complete. 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 >> v1:172.21.15.57:6816/47480 conn(0x7fa098046110 legacy=0x7fa0980485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 msgr2=0x7fa0b40a7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000ec50 tx=0x7fa0b0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 shutdown_connections 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0b40a4730 0x7fa0b4152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0b4068340 0x7fa0b40a7790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 --2- 172.21.15.57:0/2633395563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0b406ea90 0x7fa0b40a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 >> 172.21.15.57:0/2633395563 conn(0x7fa0b406be90 msgr2=0x7fa0b4069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 shutdown_connections 2024-03-18T14:47:29.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.005+0000 7fa0bc5ee700 1 -- 172.21.15.57:0/2633395563 wait complete. 2024-03-18T14:47:29.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084293 got 120259084293 for osd.0 2024-03-18T14:47:29.017 DEBUG:teuthology.parallel:result is None 2024-03-18T14:47:29.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 137438953476 got 137438953476 for osd.3 2024-03-18T14:47:29.019 DEBUG:teuthology.parallel:result is None 2024-03-18T14:47:29.019 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T14:47:29.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 Processor -- start 2024-03-18T14:47:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 -- start start 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c13e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c0a3bf0 con 0x7f046c069200 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c06ed90 con 0x7f046c06f9f0 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f0471173700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f046c06b7b0 con 0x7f046c06f620 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046b59e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046a59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c13e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046b59e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43272/0 (socket says 172.21.15.57:43272) 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046b59e700 1 -- 172.21.15.57:0/3704528568 learned_addr learned my addr 172.21.15.57:0/3704528568 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.179+0000 7f046ad9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34392/0 (socket says 172.21.15.57:34392) 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 -- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 msgr2=0x7f046c13e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c13e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 -- 172.21.15.57:0/3704528568 >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 msgr2=0x7f046c06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 --2- 172.21.15.57:0/3704528568 >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 -- 172.21.15.57:0/3704528568 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c13e5e0 con 0x7f046c06f9f0 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046ad9d700 1 --2- 172.21.15.57:0/3704528568 >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046a59c700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c13e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f046b59e700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0464009f20 tx=0x7f0464009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=714c03c525e8a267 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0469d9b700 1 -- 172.21.15.57:0/3704528568 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046400e070 con 0x7f046c06f9f0 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0469d9b700 1 -- 172.21.15.57:0/3704528568 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400b970 con 0x7f046c06f9f0 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0469d9b700 1 -- 172.21.15.57:0/3704528568 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04640092e0 con 0x7f046c06f9f0 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0471173700 1 -- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 msgr2=0x7f046c13edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0471173700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0464009f20 tx=0x7f0464009840 comp rx=0 tx=0).stop 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.180+0000 7f0471173700 1 -- 172.21.15.57:0/3704528568 shutdown_connections 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c06f9f0 0x7f046c13edc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 --2- 172.21.15.57:0/3704528568 >> v2:172.21.15.57:3300/0 conn(0x7f046c069200 0x7f046c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 --2- 172.21.15.57:0/3704528568 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c13e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 -- 172.21.15.57:0/3704528568 >> 172.21.15.57:0/3704528568 conn(0x7f046c06af90 msgr2=0x7f046c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 -- 172.21.15.57:0/3704528568 shutdown_connections 2024-03-18T14:47:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.181+0000 7f0471173700 1 -- 172.21.15.57:0/3704528568 wait complete. 2024-03-18T14:47:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 Processor -- start 2024-03-18T14:47:29.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 -- start start 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 0x7f046c0a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0a9010 con 0x7f046c06f9f0 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0a7af0 con 0x7f046c069200 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f0471173700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0a7db0 con 0x7f046c06f620 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f046ad9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f046b59e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 0x7f046c0a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f046a59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f046ad9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43280/0 (socket says 172.21.15.57:43280) 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.182+0000 7f046ad9d700 1 -- 172.21.15.57:0/4112662699 learned_addr learned my addr 172.21.15.57:0/4112662699 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:29.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 -- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 msgr2=0x7f046c0a57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c0a57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 -- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 msgr2=0x7f046c0a5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 0x7f046c0a5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 -- 172.21.15.57:0/4112662699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0460009420 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046a59c700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c0a57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046b59e700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 0x7f046c0a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f046ad9d700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f046000ec80 tx=0x7f04600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000c850 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046000c9b0 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045c009420 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000cd30 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.183+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0464009ae0 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.184+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c0a9e20 con 0x7f046c069200 2024-03-18T14:47:29.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.184+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0460013680 con 0x7f046c069200 2024-03-18T14:47:29.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.184+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f046005b3c0 con 0x7f046c069200 2024-03-18T14:47:29.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.188+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f04600395e0 con 0x7f046c069200 2024-03-18T14:47:29.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.346+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f046c13d950 con 0x7f0458046010 2024-03-18T14:47:29.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.354+0000 7f0452ffd700 1 -- 172.21.15.57:0/4112662699 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273494 (unknown 2965378022 0 3710658535) 0x7f046c13d950 con 0x7f0458046010 2024-03-18T14:47:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 >> v1:172.21.15.57:6816/47480 conn(0x7f0458046010 legacy=0x7f04580484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 msgr2=0x7f046c0a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f046000ec80 tx=0x7f04600091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 shutdown_connections 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f046c06f9f0 0x7f046c0a5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f046c069200 0x7f046c0a8ad0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 --2- 172.21.15.57:0/4112662699 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f046c06f620 0x7f046c0a57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 >> 172.21.15.57:0/4112662699 conn(0x7f046c06af90 msgr2=0x7f046c13eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 shutdown_connections 2024-03-18T14:47:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.357+0000 7f0471173700 1 -- 172.21.15.57:0/4112662699 wait complete. 2024-03-18T14:47:29.362 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:29.370 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-03-18T14:47:27.552665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137710119,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6275,"num_read_kb":3053126,"num_write":65047,"num_write_kb":8749011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71444,"ondisk_log_size":71444,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532784,"kb_used_data":270416,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954576,"statfs":{"total":386547056640,"available":384977485824,"internally_reserved":0,"allocated":276905984,"data_stored":276040996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":49343,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.899563"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":879,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712788+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:23.712788+0000","last_peered":"2024-03-18T14:47:23.712788+0000","last_clean":"2024-03-18T14:47:23.712788+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:23.712788+0000","last_undegraded":"2024-03-18T14:47:23.712788+0000","last_fullsized":"2024-03-18T14:47:23.712788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":924,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712253+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:23.712253+0000","last_peered":"2024-03-18T14:47:23.712253+0000","last_clean":"2024-03-18T14:47:23.712253+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:23.712253+0000","last_undegraded":"2024-03-18T14:47:23.712253+0000","last_fullsized":"2024-03-18T14:47:23.712253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":944,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712359+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:23.712359+0000","last_peered":"2024-03-18T14:47:23.712359+0000","last_clean":"2024-03-18T14:47:23.712359+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:23.712359+0000","last_undegraded":"2024-03-18T14:47:23.712359+0000","last_fullsized":"2024-03-18T14:47:23.712359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":924,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711844+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:23.711844+0000","last_peered":"2024-03-18T14:47:23.711844+0000","last_clean":"2024-03-18T14:47:23.711844+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:23.711844+0000","last_undegraded":"2024-03-18T14:47:23.711844+0000","last_fullsized":"2024-03-18T14:47:23.711844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":881,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711627+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:23.711627+0000","last_peered":"2024-03-18T14:47:23.711627+0000","last_clean":"2024-03-18T14:47:23.711627+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:23.711627+0000","last_undegraded":"2024-03-18T14:47:23.711627+0000","last_fullsized":"2024-03-18T14:47:23.711627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":903,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263772+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:24.263772+0000","last_peered":"2024-03-18T14:47:24.263772+0000","last_clean":"2024-03-18T14:47:24.263772+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:24.263772+0000","last_undegraded":"2024-03-18T14:47:24.263772+0000","last_fullsized":"2024-03-18T14:47:24.263772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":956,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264265+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:24.264265+0000","last_peered":"2024-03-18T14:47:24.264265+0000","last_clean":"2024-03-18T14:47:24.264265+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:24.264265+0000","last_undegraded":"2024-03-18T14:47:24.264265+0000","last_fullsized":"2024-03-18T14:47:24.264265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":803,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713401+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:23.713401+0000","last_peered":"2024-03-18T14:47:23.713401+0000","last_clean":"2024-03-18T14:47:23.713401+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:23.713401+0000","last_undegraded":"2024-03-18T14:47:23.713401+0000","last_fullsized":"2024-03-18T14:47:23.713401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":946,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712391+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:23.712391+0000","last_peered":"2024-03-18T14:47:23.712391+0000","last_clean":"2024-03-18T14:47:23.712391+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:23.712391+0000","last_undegraded":"2024-03-18T14:47:23.712391+0000","last_fullsized":"2024-03-18T14:47:23.712391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":829,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714076+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:23.714076+0000","last_peered":"2024-03-18T14:47:23.714076+0000","last_clean":"2024-03-18T14:47:23.714076+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:23.714076+0000","last_undegraded":"2024-03-18T14:47:23.714076+0000","last_fullsized":"2024-03-18T14:47:23.714076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":805,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713655+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:23.713655+0000","last_peered":"2024-03-18T14:47:23.713655+0000","last_clean":"2024-03-18T14:47:23.713655+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:23.713655+0000","last_undegraded":"2024-03-18T14:47:23.713655+0000","last_fullsized":"2024-03-18T14:47:23.713655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":832,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712305+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:23.712305+0000","last_peered":"2024-03-18T14:47:23.712305+0000","last_clean":"2024-03-18T14:47:23.712305+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:23.712305+0000","last_undegraded":"2024-03-18T14:47:23.712305+0000","last_fullsized":"2024-03-18T14:47:23.712305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":886,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711828+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:23.711828+0000","last_peered":"2024-03-18T14:47:23.711828+0000","last_clean":"2024-03-18T14:47:23.711828+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:23.711828+0000","last_undegraded":"2024-03-18T14:47:23.711828+0000","last_fullsized":"2024-03-18T14:47:23.711828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1007,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713495+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:23.713495+0000","last_peered":"2024-03-18T14:47:23.713495+0000","last_clean":"2024-03-18T14:47:23.713495+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:23.713495+0000","last_undegraded":"2024-03-18T14:47:23.713495+0000","last_fullsized":"2024-03-18T14:47:23.713495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1049,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711296+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:23.711296+0000","last_peered":"2024-03-18T14:47:23.711296+0000","last_clean":"2024-03-18T14:47:23.711296+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:23.711296+0000","last_undegraded":"2024-03-18T14:47:23.711296+0000","last_fullsized":"2024-03-18T14:47:23.711296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":882,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263474+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:24.263474+0000","last_peered":"2024-03-18T14:47:24.263474+0000","last_clean":"2024-03-18T14:47:24.263474+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:24.263474+0000","last_undegraded":"2024-03-18T14:47:24.263474+0000","last_fullsized":"2024-03-18T14:47:24.263474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1011,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712678+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:23.712678+0000","last_peered":"2024-03-18T14:47:23.712678+0000","last_clean":"2024-03-18T14:47:23.712678+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:23.712678+0000","last_undegraded":"2024-03-18T14:47:23.712678+0000","last_fullsized":"2024-03-18T14:47:23.712678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1010,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711942+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:23.711942+0000","last_peered":"2024-03-18T14:47:23.711942+0000","last_clean":"2024-03-18T14:47:23.711942+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:23.711942+0000","last_undegraded":"2024-03-18T14:47:23.711942+0000","last_fullsized":"2024-03-18T14:47:23.711942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":999,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712114+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:23.712114+0000","last_peered":"2024-03-18T14:47:23.712114+0000","last_clean":"2024-03-18T14:47:23.712114+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:23.712114+0000","last_undegraded":"2024-03-18T14:47:23.712114+0000","last_fullsized":"2024-03-18T14:47:23.712114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1046,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714376+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:23.714376+0000","last_peered":"2024-03-18T14:47:23.714376+0000","last_clean":"2024-03-18T14:47:23.714376+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:23.714376+0000","last_undegraded":"2024-03-18T14:47:23.714376+0000","last_fullsized":"2024-03-18T14:47:23.714376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1028,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714752+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:23.714752+0000","last_peered":"2024-03-18T14:47:23.714752+0000","last_clean":"2024-03-18T14:47:23.714752+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:23.714752+0000","last_undegraded":"2024-03-18T14:47:23.714752+0000","last_fullsized":"2024-03-18T14:47:23.714752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711177+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:23.711177+0000","last_peered":"2024-03-18T14:47:23.711177+0000","last_clean":"2024-03-18T14:47:23.711177+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:23.711177+0000","last_undegraded":"2024-03-18T14:47:23.711177+0000","last_fullsized":"2024-03-18T14:47:23.711177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1018,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263704+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:24.263704+0000","last_peered":"2024-03-18T14:47:24.263704+0000","last_clean":"2024-03-18T14:47:24.263704+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:24.263704+0000","last_undegraded":"2024-03-18T14:47:24.263704+0000","last_fullsized":"2024-03-18T14:47:24.263704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":935,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713305+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:23.713305+0000","last_peered":"2024-03-18T14:47:23.713305+0000","last_clean":"2024-03-18T14:47:23.713305+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:23.713305+0000","last_undegraded":"2024-03-18T14:47:23.713305+0000","last_fullsized":"2024-03-18T14:47:23.713305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":965,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714342+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:23.714342+0000","last_peered":"2024-03-18T14:47:23.714342+0000","last_clean":"2024-03-18T14:47:23.714342+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:23.714342+0000","last_undegraded":"2024-03-18T14:47:23.714342+0000","last_fullsized":"2024-03-18T14:47:23.714342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":918,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714342+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:23.714342+0000","last_peered":"2024-03-18T14:47:23.714342+0000","last_clean":"2024-03-18T14:47:23.714342+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:23.714342+0000","last_undegraded":"2024-03-18T14:47:23.714342+0000","last_fullsized":"2024-03-18T14:47:23.714342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":933,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264547+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:24.264547+0000","last_peered":"2024-03-18T14:47:24.264547+0000","last_clean":"2024-03-18T14:47:24.264547+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:24.264547+0000","last_undegraded":"2024-03-18T14:47:24.264547+0000","last_fullsized":"2024-03-18T14:47:24.264547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1528,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713664+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:23.713664+0000","last_peered":"2024-03-18T14:47:23.713664+0000","last_clean":"2024-03-18T14:47:23.713664+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:23.713664+0000","last_undegraded":"2024-03-18T14:47:23.713664+0000","last_fullsized":"2024-03-18T14:47:23.713664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265008+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:24.265008+0000","last_peered":"2024-03-18T14:47:24.265008+0000","last_clean":"2024-03-18T14:47:24.265008+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:24.265008+0000","last_undegraded":"2024-03-18T14:47:24.265008+0000","last_fullsized":"2024-03-18T14:47:24.265008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1399,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713334+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:23.713334+0000","last_peered":"2024-03-18T14:47:23.713334+0000","last_clean":"2024-03-18T14:47:23.713334+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:23.713334+0000","last_undegraded":"2024-03-18T14:47:23.713334+0000","last_fullsized":"2024-03-18T14:47:23.713334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":827,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712115+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:23.712115+0000","last_peered":"2024-03-18T14:47:23.712115+0000","last_clean":"2024-03-18T14:47:23.712115+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:23.712115+0000","last_undegraded":"2024-03-18T14:47:23.712115+0000","last_fullsized":"2024-03-18T14:47:23.712115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263765+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:24.263765+0000","last_peered":"2024-03-18T14:47:24.263765+0000","last_clean":"2024-03-18T14:47:24.263765+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:24.263765+0000","last_undegraded":"2024-03-18T14:47:24.263765+0000","last_fullsized":"2024-03-18T14:47:24.263765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265222+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:24.265222+0000","last_peered":"2024-03-18T14:47:24.265222+0000","last_clean":"2024-03-18T14:47:24.265222+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:24.265222+0000","last_undegraded":"2024-03-18T14:47:24.265222+0000","last_fullsized":"2024-03-18T14:47:24.265222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712586+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:23.712586+0000","last_peered":"2024-03-18T14:47:23.712586+0000","last_clean":"2024-03-18T14:47:23.712586+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:23.712586+0000","last_undegraded":"2024-03-18T14:47:23.712586+0000","last_fullsized":"2024-03-18T14:47:23.712586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":842,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263622+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:24.263622+0000","last_peered":"2024-03-18T14:47:24.263622+0000","last_clean":"2024-03-18T14:47:24.263622+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:24.263622+0000","last_undegraded":"2024-03-18T14:47:24.263622+0000","last_fullsized":"2024-03-18T14:47:24.263622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1686,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710620+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:23.710620+0000","last_peered":"2024-03-18T14:47:23.710620+0000","last_clean":"2024-03-18T14:47:23.710620+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:23.710620+0000","last_undegraded":"2024-03-18T14:47:23.710620+0000","last_fullsized":"2024-03-18T14:47:23.710620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1058,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264163+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:24.264163+0000","last_peered":"2024-03-18T14:47:24.264163+0000","last_clean":"2024-03-18T14:47:24.264163+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:24.264163+0000","last_undegraded":"2024-03-18T14:47:24.264163+0000","last_fullsized":"2024-03-18T14:47:24.264163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":268,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.474673+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:24.474673+0000","last_peered":"2024-03-18T14:47:24.474673+0000","last_clean":"2024-03-18T14:47:24.474673+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:24.474673+0000","last_undegraded":"2024-03-18T14:47:24.474673+0000","last_fullsized":"2024-03-18T14:47:24.474673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1035,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713914+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:23.713914+0000","last_peered":"2024-03-18T14:47:23.713914+0000","last_clean":"2024-03-18T14:47:23.713914+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:23.713914+0000","last_undegraded":"2024-03-18T14:47:23.713914+0000","last_fullsized":"2024-03-18T14:47:23.713914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'648","reported_seq":690,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264309+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:24.264309+0000","last_peered":"2024-03-18T14:47:24.264309+0000","last_clean":"2024-03-18T14:47:24.264309+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:24.264309+0000","last_undegraded":"2024-03-18T14:47:24.264309+0000","last_fullsized":"2024-03-18T14:47:24.264309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":6,"num_read_kb":12290,"num_write":549,"num_write_kb":12563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":980,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711742+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:23.711742+0000","last_peered":"2024-03-18T14:47:23.711742+0000","last_clean":"2024-03-18T14:47:23.711742+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:23.711742+0000","last_undegraded":"2024-03-18T14:47:23.711742+0000","last_fullsized":"2024-03-18T14:47:23.711742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":602,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264212+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:24.264212+0000","last_peered":"2024-03-18T14:47:24.264212+0000","last_clean":"2024-03-18T14:47:24.264212+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:24.264212+0000","last_undegraded":"2024-03-18T14:47:24.264212+0000","last_fullsized":"2024-03-18T14:47:24.264212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":8193,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264453+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:24.264453+0000","last_peered":"2024-03-18T14:47:24.264453+0000","last_clean":"2024-03-18T14:47:24.264453+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:24.264453+0000","last_undegraded":"2024-03-18T14:47:24.264453+0000","last_fullsized":"2024-03-18T14:47:24.264453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":215,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711303+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:23.711303+0000","last_peered":"2024-03-18T14:47:23.711303+0000","last_clean":"2024-03-18T14:47:23.711303+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:23.711303+0000","last_undegraded":"2024-03-18T14:47:23.711303+0000","last_fullsized":"2024-03-18T14:47:23.711303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":940,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265107+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:24.265107+0000","last_peered":"2024-03-18T14:47:24.265107+0000","last_clean":"2024-03-18T14:47:24.265107+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:24.265107+0000","last_undegraded":"2024-03-18T14:47:24.265107+0000","last_fullsized":"2024-03-18T14:47:24.265107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":412,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263431+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:24.263431+0000","last_peered":"2024-03-18T14:47:24.263431+0000","last_clean":"2024-03-18T14:47:24.263431+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:24.263431+0000","last_undegraded":"2024-03-18T14:47:24.263431+0000","last_fullsized":"2024-03-18T14:47:24.263431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":862,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713001+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:23.713001+0000","last_peered":"2024-03-18T14:47:23.713001+0000","last_clean":"2024-03-18T14:47:23.713001+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:23.713001+0000","last_undegraded":"2024-03-18T14:47:23.713001+0000","last_fullsized":"2024-03-18T14:47:23.713001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'154","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712030+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:24.712030+0000","last_peered":"2024-03-18T14:47:24.712030+0000","last_clean":"2024-03-18T14:47:24.712030+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:24.712030+0000","last_undegraded":"2024-03-18T14:47:24.712030+0000","last_fullsized":"2024-03-18T14:47:24.712030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194899,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":191,"num_write":40,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":840,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264992+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:24.264992+0000","last_peered":"2024-03-18T14:47:24.264992+0000","last_clean":"2024-03-18T14:47:24.264992+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:24.264992+0000","last_undegraded":"2024-03-18T14:47:24.264992+0000","last_fullsized":"2024-03-18T14:47:24.264992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":470,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712086+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:23.712086+0000","last_peered":"2024-03-18T14:47:23.712086+0000","last_clean":"2024-03-18T14:47:23.712086+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:23.712086+0000","last_undegraded":"2024-03-18T14:47:23.712086+0000","last_fullsized":"2024-03-18T14:47:23.712086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1020,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263474+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:24.263474+0000","last_peered":"2024-03-18T14:47:24.263474+0000","last_clean":"2024-03-18T14:47:24.263474+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:24.263474+0000","last_undegraded":"2024-03-18T14:47:24.263474+0000","last_fullsized":"2024-03-18T14:47:24.263474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":444,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712883+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:23.712883+0000","last_peered":"2024-03-18T14:47:23.712883+0000","last_clean":"2024-03-18T14:47:23.712883+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:23.712883+0000","last_undegraded":"2024-03-18T14:47:23.712883+0000","last_fullsized":"2024-03-18T14:47:23.712883+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713548+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:23.713548+0000","last_peered":"2024-03-18T14:47:23.713548+0000","last_clean":"2024-03-18T14:47:23.713548+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:23.713548+0000","last_undegraded":"2024-03-18T14:47:23.713548+0000","last_fullsized":"2024-03-18T14:47:23.713548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":892,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264312+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:24.264312+0000","last_peered":"2024-03-18T14:47:24.264312+0000","last_clean":"2024-03-18T14:47:24.264312+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:24.264312+0000","last_undegraded":"2024-03-18T14:47:24.264312+0000","last_fullsized":"2024-03-18T14:47:24.264312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":892,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711378+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:23.711378+0000","last_peered":"2024-03-18T14:47:23.711378+0000","last_clean":"2024-03-18T14:47:23.711378+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:23.711378+0000","last_undegraded":"2024-03-18T14:47:23.711378+0000","last_fullsized":"2024-03-18T14:47:23.711378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":183,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711658+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:23.711658+0000","last_peered":"2024-03-18T14:47:23.711658+0000","last_clean":"2024-03-18T14:47:23.711658+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:23.711658+0000","last_undegraded":"2024-03-18T14:47:23.711658+0000","last_fullsized":"2024-03-18T14:47:23.711658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":928,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711824+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:23.711824+0000","last_peered":"2024-03-18T14:47:23.711824+0000","last_clean":"2024-03-18T14:47:23.711824+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:23.711824+0000","last_undegraded":"2024-03-18T14:47:23.711824+0000","last_fullsized":"2024-03-18T14:47:23.711824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":629,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264201+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:24.264201+0000","last_peered":"2024-03-18T14:47:24.264201+0000","last_clean":"2024-03-18T14:47:24.264201+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:24.264201+0000","last_undegraded":"2024-03-18T14:47:24.264201+0000","last_fullsized":"2024-03-18T14:47:24.264201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1006,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711752+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:23.711752+0000","last_peered":"2024-03-18T14:47:23.711752+0000","last_clean":"2024-03-18T14:47:23.711752+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:23.711752+0000","last_undegraded":"2024-03-18T14:47:23.711752+0000","last_fullsized":"2024-03-18T14:47:23.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263499+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:24.263499+0000","last_peered":"2024-03-18T14:47:24.263499+0000","last_clean":"2024-03-18T14:47:24.263499+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:24.263499+0000","last_undegraded":"2024-03-18T14:47:24.263499+0000","last_fullsized":"2024-03-18T14:47:24.263499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":894,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264774+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:24.264774+0000","last_peered":"2024-03-18T14:47:24.264774+0000","last_clean":"2024-03-18T14:47:24.264774+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:24.264774+0000","last_undegraded":"2024-03-18T14:47:24.264774+0000","last_fullsized":"2024-03-18T14:47:24.264774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":329,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.473789+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:24.473789+0000","last_peered":"2024-03-18T14:47:24.473789+0000","last_clean":"2024-03-18T14:47:24.473789+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:24.473789+0000","last_undegraded":"2024-03-18T14:47:24.473789+0000","last_fullsized":"2024-03-18T14:47:24.473789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":896,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712981+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:23.712981+0000","last_peered":"2024-03-18T14:47:23.712981+0000","last_clean":"2024-03-18T14:47:23.712981+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:23.712981+0000","last_undegraded":"2024-03-18T14:47:23.712981+0000","last_fullsized":"2024-03-18T14:47:23.712981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1565,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263356+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:24.263356+0000","last_peered":"2024-03-18T14:47:24.263356+0000","last_clean":"2024-03-18T14:47:24.263356+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:24.263356+0000","last_undegraded":"2024-03-18T14:47:24.263356+0000","last_fullsized":"2024-03-18T14:47:24.263356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714634+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:23.714634+0000","last_peered":"2024-03-18T14:47:23.714634+0000","last_clean":"2024-03-18T14:47:23.714634+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:23.714634+0000","last_undegraded":"2024-03-18T14:47:23.714634+0000","last_fullsized":"2024-03-18T14:47:23.714634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714287+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:23.714287+0000","last_peered":"2024-03-18T14:47:23.714287+0000","last_clean":"2024-03-18T14:47:23.714287+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:23.714287+0000","last_undegraded":"2024-03-18T14:47:23.714287+0000","last_fullsized":"2024-03-18T14:47:23.714287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":544,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712022+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:23.712022+0000","last_peered":"2024-03-18T14:47:23.712022+0000","last_clean":"2024-03-18T14:47:23.712022+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:23.712022+0000","last_undegraded":"2024-03-18T14:47:23.712022+0000","last_fullsized":"2024-03-18T14:47:23.712022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713753+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:23.713753+0000","last_peered":"2024-03-18T14:47:23.713753+0000","last_clean":"2024-03-18T14:47:23.713753+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:23.713753+0000","last_undegraded":"2024-03-18T14:47:23.713753+0000","last_fullsized":"2024-03-18T14:47:23.713753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263615+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:24.263615+0000","last_peered":"2024-03-18T14:47:24.263615+0000","last_clean":"2024-03-18T14:47:24.263615+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:24.263615+0000","last_undegraded":"2024-03-18T14:47:24.263615+0000","last_fullsized":"2024-03-18T14:47:24.263615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":751,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711735+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:23.711735+0000","last_peered":"2024-03-18T14:47:23.711735+0000","last_clean":"2024-03-18T14:47:23.711735+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:23.711735+0000","last_undegraded":"2024-03-18T14:47:23.711735+0000","last_fullsized":"2024-03-18T14:47:23.711735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714211+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:23.714211+0000","last_peered":"2024-03-18T14:47:23.714211+0000","last_clean":"2024-03-18T14:47:23.714211+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:23.714211+0000","last_undegraded":"2024-03-18T14:47:23.714211+0000","last_fullsized":"2024-03-18T14:47:23.714211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710876+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:23.710876+0000","last_peered":"2024-03-18T14:47:23.710876+0000","last_clean":"2024-03-18T14:47:23.710876+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:23.710876+0000","last_undegraded":"2024-03-18T14:47:23.710876+0000","last_fullsized":"2024-03-18T14:47:23.710876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":866,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.474407+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.474407+0000","last_peered":"2024-03-18T14:47:24.474407+0000","last_clean":"2024-03-18T14:47:24.474407+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.474407+0000","last_undegraded":"2024-03-18T14:47:24.474407+0000","last_fullsized":"2024-03-18T14:47:24.474407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":859,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714485+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:23.714485+0000","last_peered":"2024-03-18T14:47:23.714485+0000","last_clean":"2024-03-18T14:47:23.714485+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:23.714485+0000","last_undegraded":"2024-03-18T14:47:23.714485+0000","last_fullsized":"2024-03-18T14:47:23.714485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263598+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:24.263598+0000","last_peered":"2024-03-18T14:47:24.263598+0000","last_clean":"2024-03-18T14:47:24.263598+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:24.263598+0000","last_undegraded":"2024-03-18T14:47:24.263598+0000","last_fullsized":"2024-03-18T14:47:24.263598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713196+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:23.713196+0000","last_peered":"2024-03-18T14:47:23.713196+0000","last_clean":"2024-03-18T14:47:23.713196+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:23.713196+0000","last_undegraded":"2024-03-18T14:47:23.713196+0000","last_fullsized":"2024-03-18T14:47:23.713196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1052,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263925+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:24.263925+0000","last_peered":"2024-03-18T14:47:24.263925+0000","last_clean":"2024-03-18T14:47:24.263925+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:24.263925+0000","last_undegraded":"2024-03-18T14:47:24.263925+0000","last_fullsized":"2024-03-18T14:47:24.263925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":898,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264781+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:24.264781+0000","last_peered":"2024-03-18T14:47:24.264781+0000","last_clean":"2024-03-18T14:47:24.264781+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:24.264781+0000","last_undegraded":"2024-03-18T14:47:24.264781+0000","last_fullsized":"2024-03-18T14:47:24.264781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263341+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:24.263341+0000","last_peered":"2024-03-18T14:47:24.263341+0000","last_clean":"2024-03-18T14:47:24.263341+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:24.263341+0000","last_undegraded":"2024-03-18T14:47:24.263341+0000","last_fullsized":"2024-03-18T14:47:24.263341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1006,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711129+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:23.711129+0000","last_peered":"2024-03-18T14:47:23.711129+0000","last_clean":"2024-03-18T14:47:23.711129+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:23.711129+0000","last_undegraded":"2024-03-18T14:47:23.711129+0000","last_fullsized":"2024-03-18T14:47:23.711129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1021,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712066+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:23.712066+0000","last_peered":"2024-03-18T14:47:23.712066+0000","last_clean":"2024-03-18T14:47:23.712066+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:23.712066+0000","last_undegraded":"2024-03-18T14:47:23.712066+0000","last_fullsized":"2024-03-18T14:47:23.712066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264859+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:24.264859+0000","last_peered":"2024-03-18T14:47:24.264859+0000","last_clean":"2024-03-18T14:47:24.264859+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:24.264859+0000","last_undegraded":"2024-03-18T14:47:24.264859+0000","last_fullsized":"2024-03-18T14:47:24.264859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":489,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714549+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:23.714549+0000","last_peered":"2024-03-18T14:47:23.714549+0000","last_clean":"2024-03-18T14:47:23.714549+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:23.714549+0000","last_undegraded":"2024-03-18T14:47:23.714549+0000","last_fullsized":"2024-03-18T14:47:23.714549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711917+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:23.711917+0000","last_peered":"2024-03-18T14:47:23.711917+0000","last_clean":"2024-03-18T14:47:23.711917+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:23.711917+0000","last_undegraded":"2024-03-18T14:47:23.711917+0000","last_fullsized":"2024-03-18T14:47:23.711917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":549,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.474946+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:24.474946+0000","last_peered":"2024-03-18T14:47:24.474946+0000","last_clean":"2024-03-18T14:47:24.474946+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:24.474946+0000","last_undegraded":"2024-03-18T14:47:24.474946+0000","last_fullsized":"2024-03-18T14:47:24.474946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714421+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:23.714421+0000","last_peered":"2024-03-18T14:47:23.714421+0000","last_clean":"2024-03-18T14:47:23.714421+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:23.714421+0000","last_undegraded":"2024-03-18T14:47:23.714421+0000","last_fullsized":"2024-03-18T14:47:23.714421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263619+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:24.263619+0000","last_peered":"2024-03-18T14:47:24.263619+0000","last_clean":"2024-03-18T14:47:24.263619+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:24.263619+0000","last_undegraded":"2024-03-18T14:47:24.263619+0000","last_fullsized":"2024-03-18T14:47:24.263619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264731+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:24.264731+0000","last_peered":"2024-03-18T14:47:24.264731+0000","last_clean":"2024-03-18T14:47:24.264731+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:24.264731+0000","last_undegraded":"2024-03-18T14:47:24.264731+0000","last_fullsized":"2024-03-18T14:47:24.264731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'665","reported_seq":702,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712918+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:23.712918+0000","last_peered":"2024-03-18T14:47:23.712918+0000","last_clean":"2024-03-18T14:47:23.712918+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:23.712918+0000","last_undegraded":"2024-03-18T14:47:23.712918+0000","last_fullsized":"2024-03-18T14:47:23.712918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":593,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710807+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:23.710807+0000","last_peered":"2024-03-18T14:47:23.710807+0000","last_clean":"2024-03-18T14:47:23.710807+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:23.710807+0000","last_undegraded":"2024-03-18T14:47:23.710807+0000","last_fullsized":"2024-03-18T14:47:23.710807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":169,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712033+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:23.712033+0000","last_peered":"2024-03-18T14:47:23.712033+0000","last_clean":"2024-03-18T14:47:23.712033+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:23.712033+0000","last_undegraded":"2024-03-18T14:47:23.712033+0000","last_fullsized":"2024-03-18T14:47:23.712033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712576+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:23.712576+0000","last_peered":"2024-03-18T14:47:23.712576+0000","last_clean":"2024-03-18T14:47:23.712576+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:23.712576+0000","last_undegraded":"2024-03-18T14:47:23.712576+0000","last_fullsized":"2024-03-18T14:47:23.712576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":425,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714066+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:23.714066+0000","last_peered":"2024-03-18T14:47:23.714066+0000","last_clean":"2024-03-18T14:47:23.714066+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:23.714066+0000","last_undegraded":"2024-03-18T14:47:23.714066+0000","last_fullsized":"2024-03-18T14:47:23.714066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":837,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711916+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:23.711916+0000","last_peered":"2024-03-18T14:47:23.711916+0000","last_clean":"2024-03-18T14:47:23.711916+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:23.711916+0000","last_undegraded":"2024-03-18T14:47:23.711916+0000","last_fullsized":"2024-03-18T14:47:23.711916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":678,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264656+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:24.264656+0000","last_peered":"2024-03-18T14:47:24.264656+0000","last_clean":"2024-03-18T14:47:24.264656+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:24.264656+0000","last_undegraded":"2024-03-18T14:47:24.264656+0000","last_fullsized":"2024-03-18T14:47:24.264656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":891,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711282+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:23.711282+0000","last_peered":"2024-03-18T14:47:23.711282+0000","last_clean":"2024-03-18T14:47:23.711282+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:23.711282+0000","last_undegraded":"2024-03-18T14:47:23.711282+0000","last_fullsized":"2024-03-18T14:47:23.711282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":522,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264871+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:24.264871+0000","last_peered":"2024-03-18T14:47:24.264871+0000","last_clean":"2024-03-18T14:47:24.264871+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:24.264871+0000","last_undegraded":"2024-03-18T14:47:24.264871+0000","last_fullsized":"2024-03-18T14:47:24.264871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":883,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263831+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:24.263831+0000","last_peered":"2024-03-18T14:47:24.263831+0000","last_clean":"2024-03-18T14:47:24.263831+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:24.263831+0000","last_undegraded":"2024-03-18T14:47:24.263831+0000","last_fullsized":"2024-03-18T14:47:24.263831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":253,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712771+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:23.712771+0000","last_peered":"2024-03-18T14:47:23.712771+0000","last_clean":"2024-03-18T14:47:23.712771+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:23.712771+0000","last_undegraded":"2024-03-18T14:47:23.712771+0000","last_fullsized":"2024-03-18T14:47:23.712771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":999,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710460+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:23.710460+0000","last_peered":"2024-03-18T14:47:23.710460+0000","last_clean":"2024-03-18T14:47:23.710460+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:23.710460+0000","last_undegraded":"2024-03-18T14:47:23.710460+0000","last_fullsized":"2024-03-18T14:47:23.710460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1091,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713765+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:23.713765+0000","last_peered":"2024-03-18T14:47:23.713765+0000","last_clean":"2024-03-18T14:47:23.713765+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:23.713765+0000","last_undegraded":"2024-03-18T14:47:23.713765+0000","last_fullsized":"2024-03-18T14:47:23.713765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1007,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264027+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:24.264027+0000","last_peered":"2024-03-18T14:47:24.264027+0000","last_clean":"2024-03-18T14:47:24.264027+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:24.264027+0000","last_undegraded":"2024-03-18T14:47:24.264027+0000","last_fullsized":"2024-03-18T14:47:24.264027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":920,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711398+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:23.711398+0000","last_peered":"2024-03-18T14:47:23.711398+0000","last_clean":"2024-03-18T14:47:23.711398+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:23.711398+0000","last_undegraded":"2024-03-18T14:47:23.711398+0000","last_fullsized":"2024-03-18T14:47:23.711398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":916,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264640+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:24.264640+0000","last_peered":"2024-03-18T14:47:24.264640+0000","last_clean":"2024-03-18T14:47:24.264640+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:24.264640+0000","last_undegraded":"2024-03-18T14:47:24.264640+0000","last_fullsized":"2024-03-18T14:47:24.264640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":881,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714455+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:23.714455+0000","last_peered":"2024-03-18T14:47:23.714455+0000","last_clean":"2024-03-18T14:47:23.714455+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:23.714455+0000","last_undegraded":"2024-03-18T14:47:23.714455+0000","last_fullsized":"2024-03-18T14:47:23.714455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137119751,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":596,"num_read_kb":130397,"num_write":16036,"num_write_kb":262678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274350080,"data_stored":274239230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19608,"ondisk_log_size":19608,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953476,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413508,"kb_used_data":95868,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958332,"statfs":{"total":96636764160,"available":96213331968,"internally_reserved":0,"allocated":98168832,"data_stored":97939474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.193}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018884,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379164,"kb_used_data":62932,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992676,"statfs":{"total":96636764160,"available":96248500224,"internally_reserved":0,"allocated":64442368,"data_stored":64235606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084293,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372420,"kb_used_data":59836,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999420,"statfs":{"total":96636764160,"available":96255406080,"internally_reserved":0,"allocated":61272064,"data_stored":61051128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051589,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367692,"kb_used_data":51780,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004148,"statfs":{"total":96636764160,"available":96260247552,"internally_reserved":0,"allocated":53022720,"data_stored":52814788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60334080,"data_stored":60304318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52084736,"data_stored":52068250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:29.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:29.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 Processor -- start 2024-03-18T14:47:29.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 -- start start 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d813e580 con 0x7f22d80a17f0 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80a3ea0 con 0x7f22d80a4580 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22dd738700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80a66c0 con 0x7f22d80b4fb0 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.530+0000 7f22d67fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d77fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f22d80a17f0 0x7f22d8141b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58624/0 (socket says 172.21.15.57:58624) 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d77fe700 1 -- 172.21.15.57:0/3900677081 learned_addr learned my addr 172.21.15.57:0/3900677081 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d5ffb700 1 -- 172.21.15.57:0/3900677081 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506088780 0 0) 0x7f22d813e580 con 0x7f22d80a17f0 2024-03-18T14:47:29.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d67fc700 1 -- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 msgr2=0x7f22d80a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d67fc700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d67fc700 1 -- 172.21.15.57:0/3900677081 >> v1:172.21.15.57:6789/0 conn(0x7f22d80a17f0 legacy=0x7f22d8141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d67fc700 1 -- 172.21.15.57:0/3900677081 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d813e7e0 con 0x7f22d80a4580 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d6ffd700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d67fc700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80a49d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009910 tx=0x7f22cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f66909a97a525663 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d5ffb700 1 -- 172.21.15.57:0/3900677081 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00b680 con 0x7f22d80a4580 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d5ffb700 1 -- 172.21.15.57:0/3900677081 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00b7e0 con 0x7f22d80a4580 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.531+0000 7f22d5ffb700 1 -- 172.21.15.57:0/3900677081 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00bba0 con 0x7f22d80a4580 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 -- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 msgr2=0x7f22d80a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80a49d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009910 tx=0x7f22cc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 -- 172.21.15.57:0/3900677081 shutdown_connections 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 --2- 172.21.15.57:0/3900677081 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80a49d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 -- 172.21.15.57:0/3900677081 >> 172.21.15.57:0/3900677081 conn(0x7f22d8063600 msgr2=0x7f22d8063a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 -- 172.21.15.57:0/3900677081 shutdown_connections 2024-03-18T14:47:29.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.532+0000 7f22dd738700 1 -- 172.21.15.57:0/3900677081 wait complete. 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 Processor -- start 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 -- start start 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d814ede0 con 0x7f22d80a17f0 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80ae1b0 con 0x7f22d80a4580 2024-03-18T14:47:29.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22dd738700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80ad500 con 0x7f22d80b4fb0 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d67fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d67fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43286/0 (socket says 172.21.15.57:43286) 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d67fc700 1 -- 172.21.15.57:0/2220830499 learned_addr learned my addr 172.21.15.57:0/2220830499 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d6ffd700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34412/0 (socket says 172.21.15.57:34412) 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.533+0000 7f22d77fe700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49514/0 (socket says 172.21.15.57:49514) 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 -- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 msgr2=0x7f22d80ac690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 -- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 msgr2=0x7f22d80abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 -- 172.21.15.57:0/2220830499 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009420 con 0x7f22d80a4580 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d77fe700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d6ffd700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22d67fc700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22cc013000 tx=0x7f22cc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00bb60 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc000c90 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc01a660 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc009420 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.534+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d814e3e0 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.535+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f22cc01a9d0 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.535+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d80648f0 con 0x7f22d80a4580 2024-03-18T14:47:29.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.535+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f22cc05ccc0 con 0x7f22d80a4580 2024-03-18T14:47:29.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.539+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f22cc0263f0 con 0x7f22d80a4580 2024-03-18T14:47:29.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.699+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22d80b5c50 con 0x7f22c4046010 2024-03-18T14:47:29.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.707+0000 7f22beffd700 1 -- 172.21.15.57:0/2220830499 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273489 (unknown 2965378022 0 2673801223) 0x7f22d80b5c50 con 0x7f22c4046010 2024-03-18T14:47:29.711 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:29.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 >> v1:172.21.15.57:6816/47480 conn(0x7f22c4046010 legacy=0x7f22c40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 msgr2=0x7f22d80adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f22cc013000 tx=0x7f22cc017000 comp rx=0 tx=0).stop 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 shutdown_connections 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f22d80b4fb0 0x7f22d80ac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f22d80a17f0 0x7f22d80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 --2- 172.21.15.57:0/2220830499 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f22d80a4580 0x7f22d80adc70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 >> 172.21.15.57:0/2220830499 conn(0x7f22d8063600 msgr2=0x7f22d80b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.709+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 shutdown_connections 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.710+0000 7f22dd738700 1 -- 172.21.15.57:0/2220830499 wait complete. 2024-03-18T14:47:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:29.723 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-03-18T14:47:29.553255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137710119,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6284,"num_read_kb":3053135,"num_write":65048,"num_write_kb":8749011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71445,"ondisk_log_size":71445,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532824,"kb_used_data":270456,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954536,"statfs":{"total":386547056640,"available":384977444864,"internally_reserved":0,"allocated":276946944,"data_stored":276080473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":37064,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.877187"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":879,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712788+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:23.712788+0000","last_peered":"2024-03-18T14:47:23.712788+0000","last_clean":"2024-03-18T14:47:23.712788+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:23.712788+0000","last_undegraded":"2024-03-18T14:47:23.712788+0000","last_fullsized":"2024-03-18T14:47:23.712788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":924,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712253+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:23.712253+0000","last_peered":"2024-03-18T14:47:23.712253+0000","last_clean":"2024-03-18T14:47:23.712253+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:23.712253+0000","last_undegraded":"2024-03-18T14:47:23.712253+0000","last_fullsized":"2024-03-18T14:47:23.712253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":944,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712359+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:23.712359+0000","last_peered":"2024-03-18T14:47:23.712359+0000","last_clean":"2024-03-18T14:47:23.712359+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:23.712359+0000","last_undegraded":"2024-03-18T14:47:23.712359+0000","last_fullsized":"2024-03-18T14:47:23.712359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":924,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711844+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:23.711844+0000","last_peered":"2024-03-18T14:47:23.711844+0000","last_clean":"2024-03-18T14:47:23.711844+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:23.711844+0000","last_undegraded":"2024-03-18T14:47:23.711844+0000","last_fullsized":"2024-03-18T14:47:23.711844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":881,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711627+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:23.711627+0000","last_peered":"2024-03-18T14:47:23.711627+0000","last_clean":"2024-03-18T14:47:23.711627+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:23.711627+0000","last_undegraded":"2024-03-18T14:47:23.711627+0000","last_fullsized":"2024-03-18T14:47:23.711627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":903,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263772+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:24.263772+0000","last_peered":"2024-03-18T14:47:24.263772+0000","last_clean":"2024-03-18T14:47:24.263772+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:24.263772+0000","last_undegraded":"2024-03-18T14:47:24.263772+0000","last_fullsized":"2024-03-18T14:47:24.263772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":956,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264265+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:24.264265+0000","last_peered":"2024-03-18T14:47:24.264265+0000","last_clean":"2024-03-18T14:47:24.264265+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:24.264265+0000","last_undegraded":"2024-03-18T14:47:24.264265+0000","last_fullsized":"2024-03-18T14:47:24.264265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":803,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713401+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:23.713401+0000","last_peered":"2024-03-18T14:47:23.713401+0000","last_clean":"2024-03-18T14:47:23.713401+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:23.713401+0000","last_undegraded":"2024-03-18T14:47:23.713401+0000","last_fullsized":"2024-03-18T14:47:23.713401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":946,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712391+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:23.712391+0000","last_peered":"2024-03-18T14:47:23.712391+0000","last_clean":"2024-03-18T14:47:23.712391+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:23.712391+0000","last_undegraded":"2024-03-18T14:47:23.712391+0000","last_fullsized":"2024-03-18T14:47:23.712391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":829,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714076+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:23.714076+0000","last_peered":"2024-03-18T14:47:23.714076+0000","last_clean":"2024-03-18T14:47:23.714076+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:23.714076+0000","last_undegraded":"2024-03-18T14:47:23.714076+0000","last_fullsized":"2024-03-18T14:47:23.714076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":805,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713655+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:23.713655+0000","last_peered":"2024-03-18T14:47:23.713655+0000","last_clean":"2024-03-18T14:47:23.713655+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:23.713655+0000","last_undegraded":"2024-03-18T14:47:23.713655+0000","last_fullsized":"2024-03-18T14:47:23.713655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":832,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712305+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:23.712305+0000","last_peered":"2024-03-18T14:47:23.712305+0000","last_clean":"2024-03-18T14:47:23.712305+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:23.712305+0000","last_undegraded":"2024-03-18T14:47:23.712305+0000","last_fullsized":"2024-03-18T14:47:23.712305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":886,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711828+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:23.711828+0000","last_peered":"2024-03-18T14:47:23.711828+0000","last_clean":"2024-03-18T14:47:23.711828+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:23.711828+0000","last_undegraded":"2024-03-18T14:47:23.711828+0000","last_fullsized":"2024-03-18T14:47:23.711828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1007,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713495+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:23.713495+0000","last_peered":"2024-03-18T14:47:23.713495+0000","last_clean":"2024-03-18T14:47:23.713495+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:23.713495+0000","last_undegraded":"2024-03-18T14:47:23.713495+0000","last_fullsized":"2024-03-18T14:47:23.713495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1049,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711296+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:23.711296+0000","last_peered":"2024-03-18T14:47:23.711296+0000","last_clean":"2024-03-18T14:47:23.711296+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:23.711296+0000","last_undegraded":"2024-03-18T14:47:23.711296+0000","last_fullsized":"2024-03-18T14:47:23.711296+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":882,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263474+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:24.263474+0000","last_peered":"2024-03-18T14:47:24.263474+0000","last_clean":"2024-03-18T14:47:24.263474+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:24.263474+0000","last_undegraded":"2024-03-18T14:47:24.263474+0000","last_fullsized":"2024-03-18T14:47:24.263474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1011,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712678+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:23.712678+0000","last_peered":"2024-03-18T14:47:23.712678+0000","last_clean":"2024-03-18T14:47:23.712678+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:23.712678+0000","last_undegraded":"2024-03-18T14:47:23.712678+0000","last_fullsized":"2024-03-18T14:47:23.712678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1010,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711942+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:23.711942+0000","last_peered":"2024-03-18T14:47:23.711942+0000","last_clean":"2024-03-18T14:47:23.711942+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:23.711942+0000","last_undegraded":"2024-03-18T14:47:23.711942+0000","last_fullsized":"2024-03-18T14:47:23.711942+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":999,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712114+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:23.712114+0000","last_peered":"2024-03-18T14:47:23.712114+0000","last_clean":"2024-03-18T14:47:23.712114+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:23.712114+0000","last_undegraded":"2024-03-18T14:47:23.712114+0000","last_fullsized":"2024-03-18T14:47:23.712114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1046,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714376+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:23.714376+0000","last_peered":"2024-03-18T14:47:23.714376+0000","last_clean":"2024-03-18T14:47:23.714376+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:23.714376+0000","last_undegraded":"2024-03-18T14:47:23.714376+0000","last_fullsized":"2024-03-18T14:47:23.714376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1028,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714752+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:23.714752+0000","last_peered":"2024-03-18T14:47:23.714752+0000","last_clean":"2024-03-18T14:47:23.714752+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:23.714752+0000","last_undegraded":"2024-03-18T14:47:23.714752+0000","last_fullsized":"2024-03-18T14:47:23.714752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":890,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711177+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:23.711177+0000","last_peered":"2024-03-18T14:47:23.711177+0000","last_clean":"2024-03-18T14:47:23.711177+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:23.711177+0000","last_undegraded":"2024-03-18T14:47:23.711177+0000","last_fullsized":"2024-03-18T14:47:23.711177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1018,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263704+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:24.263704+0000","last_peered":"2024-03-18T14:47:24.263704+0000","last_clean":"2024-03-18T14:47:24.263704+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:24.263704+0000","last_undegraded":"2024-03-18T14:47:24.263704+0000","last_fullsized":"2024-03-18T14:47:24.263704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":935,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713305+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:23.713305+0000","last_peered":"2024-03-18T14:47:23.713305+0000","last_clean":"2024-03-18T14:47:23.713305+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:23.713305+0000","last_undegraded":"2024-03-18T14:47:23.713305+0000","last_fullsized":"2024-03-18T14:47:23.713305+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":965,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714342+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:23.714342+0000","last_peered":"2024-03-18T14:47:23.714342+0000","last_clean":"2024-03-18T14:47:23.714342+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:23.714342+0000","last_undegraded":"2024-03-18T14:47:23.714342+0000","last_fullsized":"2024-03-18T14:47:23.714342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":918,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714342+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:23.714342+0000","last_peered":"2024-03-18T14:47:23.714342+0000","last_clean":"2024-03-18T14:47:23.714342+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:23.714342+0000","last_undegraded":"2024-03-18T14:47:23.714342+0000","last_fullsized":"2024-03-18T14:47:23.714342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":933,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264547+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:24.264547+0000","last_peered":"2024-03-18T14:47:24.264547+0000","last_clean":"2024-03-18T14:47:24.264547+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:24.264547+0000","last_undegraded":"2024-03-18T14:47:24.264547+0000","last_fullsized":"2024-03-18T14:47:24.264547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1528,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713664+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:23.713664+0000","last_peered":"2024-03-18T14:47:23.713664+0000","last_clean":"2024-03-18T14:47:23.713664+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:23.713664+0000","last_undegraded":"2024-03-18T14:47:23.713664+0000","last_fullsized":"2024-03-18T14:47:23.713664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":925,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265008+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:24.265008+0000","last_peered":"2024-03-18T14:47:24.265008+0000","last_clean":"2024-03-18T14:47:24.265008+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:24.265008+0000","last_undegraded":"2024-03-18T14:47:24.265008+0000","last_fullsized":"2024-03-18T14:47:24.265008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1399,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713334+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:23.713334+0000","last_peered":"2024-03-18T14:47:23.713334+0000","last_clean":"2024-03-18T14:47:23.713334+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:23.713334+0000","last_undegraded":"2024-03-18T14:47:23.713334+0000","last_fullsized":"2024-03-18T14:47:23.713334+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":827,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712115+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:23.712115+0000","last_peered":"2024-03-18T14:47:23.712115+0000","last_clean":"2024-03-18T14:47:23.712115+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:23.712115+0000","last_undegraded":"2024-03-18T14:47:23.712115+0000","last_fullsized":"2024-03-18T14:47:23.712115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1059,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263765+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:24.263765+0000","last_peered":"2024-03-18T14:47:24.263765+0000","last_clean":"2024-03-18T14:47:24.263765+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:24.263765+0000","last_undegraded":"2024-03-18T14:47:24.263765+0000","last_fullsized":"2024-03-18T14:47:24.263765+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":869,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265222+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:24.265222+0000","last_peered":"2024-03-18T14:47:24.265222+0000","last_clean":"2024-03-18T14:47:24.265222+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:24.265222+0000","last_undegraded":"2024-03-18T14:47:24.265222+0000","last_fullsized":"2024-03-18T14:47:24.265222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":167,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712586+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:23.712586+0000","last_peered":"2024-03-18T14:47:23.712586+0000","last_clean":"2024-03-18T14:47:23.712586+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:23.712586+0000","last_undegraded":"2024-03-18T14:47:23.712586+0000","last_fullsized":"2024-03-18T14:47:23.712586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":842,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263622+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:24.263622+0000","last_peered":"2024-03-18T14:47:24.263622+0000","last_clean":"2024-03-18T14:47:24.263622+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:24.263622+0000","last_undegraded":"2024-03-18T14:47:24.263622+0000","last_fullsized":"2024-03-18T14:47:24.263622+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1686,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710620+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:23.710620+0000","last_peered":"2024-03-18T14:47:23.710620+0000","last_clean":"2024-03-18T14:47:23.710620+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:23.710620+0000","last_undegraded":"2024-03-18T14:47:23.710620+0000","last_fullsized":"2024-03-18T14:47:23.710620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1058,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264163+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:24.264163+0000","last_peered":"2024-03-18T14:47:24.264163+0000","last_clean":"2024-03-18T14:47:24.264163+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:24.264163+0000","last_undegraded":"2024-03-18T14:47:24.264163+0000","last_fullsized":"2024-03-18T14:47:24.264163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":269,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711280+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:24.711280+0000","last_peered":"2024-03-18T14:47:24.711280+0000","last_clean":"2024-03-18T14:47:24.711280+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:24.711280+0000","last_undegraded":"2024-03-18T14:47:24.711280+0000","last_fullsized":"2024-03-18T14:47:24.711280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1035,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713914+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:23.713914+0000","last_peered":"2024-03-18T14:47:23.713914+0000","last_clean":"2024-03-18T14:47:23.713914+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:23.713914+0000","last_undegraded":"2024-03-18T14:47:23.713914+0000","last_fullsized":"2024-03-18T14:47:23.713914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'648","reported_seq":690,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264309+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:24.264309+0000","last_peered":"2024-03-18T14:47:24.264309+0000","last_clean":"2024-03-18T14:47:24.264309+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:24.264309+0000","last_undegraded":"2024-03-18T14:47:24.264309+0000","last_fullsized":"2024-03-18T14:47:24.264309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":6,"num_read_kb":12290,"num_write":549,"num_write_kb":12563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":980,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711742+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:23.711742+0000","last_peered":"2024-03-18T14:47:23.711742+0000","last_clean":"2024-03-18T14:47:23.711742+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:23.711742+0000","last_undegraded":"2024-03-18T14:47:23.711742+0000","last_fullsized":"2024-03-18T14:47:23.711742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":602,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264212+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:24.264212+0000","last_peered":"2024-03-18T14:47:24.264212+0000","last_clean":"2024-03-18T14:47:24.264212+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:24.264212+0000","last_undegraded":"2024-03-18T14:47:24.264212+0000","last_fullsized":"2024-03-18T14:47:24.264212+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":8193,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":961,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264453+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:24.264453+0000","last_peered":"2024-03-18T14:47:24.264453+0000","last_clean":"2024-03-18T14:47:24.264453+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:24.264453+0000","last_undegraded":"2024-03-18T14:47:24.264453+0000","last_fullsized":"2024-03-18T14:47:24.264453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":215,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711303+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:23.711303+0000","last_peered":"2024-03-18T14:47:23.711303+0000","last_clean":"2024-03-18T14:47:23.711303+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:23.711303+0000","last_undegraded":"2024-03-18T14:47:23.711303+0000","last_fullsized":"2024-03-18T14:47:23.711303+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":940,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.265107+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:24.265107+0000","last_peered":"2024-03-18T14:47:24.265107+0000","last_clean":"2024-03-18T14:47:24.265107+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:24.265107+0000","last_undegraded":"2024-03-18T14:47:24.265107+0000","last_fullsized":"2024-03-18T14:47:24.265107+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":412,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263431+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:24.263431+0000","last_peered":"2024-03-18T14:47:24.263431+0000","last_clean":"2024-03-18T14:47:24.263431+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:24.263431+0000","last_undegraded":"2024-03-18T14:47:24.263431+0000","last_fullsized":"2024-03-18T14:47:24.263431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":862,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713001+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:23.713001+0000","last_peered":"2024-03-18T14:47:23.713001+0000","last_clean":"2024-03-18T14:47:23.713001+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:23.713001+0000","last_undegraded":"2024-03-18T14:47:23.713001+0000","last_fullsized":"2024-03-18T14:47:23.713001+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"41'154","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712030+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:24.712030+0000","last_peered":"2024-03-18T14:47:24.712030+0000","last_clean":"2024-03-18T14:47:24.712030+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:24.712030+0000","last_undegraded":"2024-03-18T14:47:24.712030+0000","last_fullsized":"2024-03-18T14:47:24.712030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194899,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":191,"num_write":40,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":840,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264992+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:24.264992+0000","last_peered":"2024-03-18T14:47:24.264992+0000","last_clean":"2024-03-18T14:47:24.264992+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:24.264992+0000","last_undegraded":"2024-03-18T14:47:24.264992+0000","last_fullsized":"2024-03-18T14:47:24.264992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":470,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712086+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:23.712086+0000","last_peered":"2024-03-18T14:47:23.712086+0000","last_clean":"2024-03-18T14:47:23.712086+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:23.712086+0000","last_undegraded":"2024-03-18T14:47:23.712086+0000","last_fullsized":"2024-03-18T14:47:23.712086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1020,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263474+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:24.263474+0000","last_peered":"2024-03-18T14:47:24.263474+0000","last_clean":"2024-03-18T14:47:24.263474+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:24.263474+0000","last_undegraded":"2024-03-18T14:47:24.263474+0000","last_fullsized":"2024-03-18T14:47:24.263474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":445,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710599+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:24.710599+0000","last_peered":"2024-03-18T14:47:24.710599+0000","last_clean":"2024-03-18T14:47:24.710599+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:24.710599+0000","last_undegraded":"2024-03-18T14:47:24.710599+0000","last_fullsized":"2024-03-18T14:47:24.710599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":884,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713548+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:23.713548+0000","last_peered":"2024-03-18T14:47:23.713548+0000","last_clean":"2024-03-18T14:47:23.713548+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:23.713548+0000","last_undegraded":"2024-03-18T14:47:23.713548+0000","last_fullsized":"2024-03-18T14:47:23.713548+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":892,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264312+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:24.264312+0000","last_peered":"2024-03-18T14:47:24.264312+0000","last_clean":"2024-03-18T14:47:24.264312+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:24.264312+0000","last_undegraded":"2024-03-18T14:47:24.264312+0000","last_fullsized":"2024-03-18T14:47:24.264312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":892,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711378+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:23.711378+0000","last_peered":"2024-03-18T14:47:23.711378+0000","last_clean":"2024-03-18T14:47:23.711378+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:23.711378+0000","last_undegraded":"2024-03-18T14:47:23.711378+0000","last_fullsized":"2024-03-18T14:47:23.711378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":183,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711658+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:23.711658+0000","last_peered":"2024-03-18T14:47:23.711658+0000","last_clean":"2024-03-18T14:47:23.711658+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:23.711658+0000","last_undegraded":"2024-03-18T14:47:23.711658+0000","last_fullsized":"2024-03-18T14:47:23.711658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":928,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711824+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:23.711824+0000","last_peered":"2024-03-18T14:47:23.711824+0000","last_clean":"2024-03-18T14:47:23.711824+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:23.711824+0000","last_undegraded":"2024-03-18T14:47:23.711824+0000","last_fullsized":"2024-03-18T14:47:23.711824+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":629,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264201+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:24.264201+0000","last_peered":"2024-03-18T14:47:24.264201+0000","last_clean":"2024-03-18T14:47:24.264201+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:24.264201+0000","last_undegraded":"2024-03-18T14:47:24.264201+0000","last_fullsized":"2024-03-18T14:47:24.264201+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1006,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711752+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:23.711752+0000","last_peered":"2024-03-18T14:47:23.711752+0000","last_clean":"2024-03-18T14:47:23.711752+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:23.711752+0000","last_undegraded":"2024-03-18T14:47:23.711752+0000","last_fullsized":"2024-03-18T14:47:23.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":667,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263499+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:24.263499+0000","last_peered":"2024-03-18T14:47:24.263499+0000","last_clean":"2024-03-18T14:47:24.263499+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:24.263499+0000","last_undegraded":"2024-03-18T14:47:24.263499+0000","last_fullsized":"2024-03-18T14:47:24.263499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":894,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264774+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:24.264774+0000","last_peered":"2024-03-18T14:47:24.264774+0000","last_clean":"2024-03-18T14:47:24.264774+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:24.264774+0000","last_undegraded":"2024-03-18T14:47:24.264774+0000","last_fullsized":"2024-03-18T14:47:24.264774+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":329,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.473789+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:24.473789+0000","last_peered":"2024-03-18T14:47:24.473789+0000","last_clean":"2024-03-18T14:47:24.473789+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:24.473789+0000","last_undegraded":"2024-03-18T14:47:24.473789+0000","last_fullsized":"2024-03-18T14:47:24.473789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":896,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712981+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:23.712981+0000","last_peered":"2024-03-18T14:47:23.712981+0000","last_clean":"2024-03-18T14:47:23.712981+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:23.712981+0000","last_undegraded":"2024-03-18T14:47:23.712981+0000","last_fullsized":"2024-03-18T14:47:23.712981+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1565,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263356+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:24.263356+0000","last_peered":"2024-03-18T14:47:24.263356+0000","last_clean":"2024-03-18T14:47:24.263356+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:24.263356+0000","last_undegraded":"2024-03-18T14:47:24.263356+0000","last_fullsized":"2024-03-18T14:47:24.263356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":895,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714634+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:23.714634+0000","last_peered":"2024-03-18T14:47:23.714634+0000","last_clean":"2024-03-18T14:47:23.714634+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:23.714634+0000","last_undegraded":"2024-03-18T14:47:23.714634+0000","last_fullsized":"2024-03-18T14:47:23.714634+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714287+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:23.714287+0000","last_peered":"2024-03-18T14:47:23.714287+0000","last_clean":"2024-03-18T14:47:23.714287+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:23.714287+0000","last_undegraded":"2024-03-18T14:47:23.714287+0000","last_fullsized":"2024-03-18T14:47:23.714287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":544,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712022+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:23.712022+0000","last_peered":"2024-03-18T14:47:23.712022+0000","last_clean":"2024-03-18T14:47:23.712022+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:23.712022+0000","last_undegraded":"2024-03-18T14:47:23.712022+0000","last_fullsized":"2024-03-18T14:47:23.712022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713753+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:23.713753+0000","last_peered":"2024-03-18T14:47:23.713753+0000","last_clean":"2024-03-18T14:47:23.713753+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:23.713753+0000","last_undegraded":"2024-03-18T14:47:23.713753+0000","last_fullsized":"2024-03-18T14:47:23.713753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263615+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:24.263615+0000","last_peered":"2024-03-18T14:47:24.263615+0000","last_clean":"2024-03-18T14:47:24.263615+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:24.263615+0000","last_undegraded":"2024-03-18T14:47:24.263615+0000","last_fullsized":"2024-03-18T14:47:24.263615+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":751,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711735+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:23.711735+0000","last_peered":"2024-03-18T14:47:23.711735+0000","last_clean":"2024-03-18T14:47:23.711735+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:23.711735+0000","last_undegraded":"2024-03-18T14:47:23.711735+0000","last_fullsized":"2024-03-18T14:47:23.711735+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":937,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714211+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:23.714211+0000","last_peered":"2024-03-18T14:47:23.714211+0000","last_clean":"2024-03-18T14:47:23.714211+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:23.714211+0000","last_undegraded":"2024-03-18T14:47:23.714211+0000","last_fullsized":"2024-03-18T14:47:23.714211+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710876+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:23.710876+0000","last_peered":"2024-03-18T14:47:23.710876+0000","last_clean":"2024-03-18T14:47:23.710876+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:23.710876+0000","last_undegraded":"2024-03-18T14:47:23.710876+0000","last_fullsized":"2024-03-18T14:47:23.710876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":866,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.474407+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.474407+0000","last_peered":"2024-03-18T14:47:24.474407+0000","last_clean":"2024-03-18T14:47:24.474407+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.474407+0000","last_undegraded":"2024-03-18T14:47:24.474407+0000","last_fullsized":"2024-03-18T14:47:24.474407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":859,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714485+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:23.714485+0000","last_peered":"2024-03-18T14:47:23.714485+0000","last_clean":"2024-03-18T14:47:23.714485+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:23.714485+0000","last_undegraded":"2024-03-18T14:47:23.714485+0000","last_fullsized":"2024-03-18T14:47:23.714485+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263598+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:24.263598+0000","last_peered":"2024-03-18T14:47:24.263598+0000","last_clean":"2024-03-18T14:47:24.263598+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:24.263598+0000","last_undegraded":"2024-03-18T14:47:24.263598+0000","last_fullsized":"2024-03-18T14:47:24.263598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713196+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:23.713196+0000","last_peered":"2024-03-18T14:47:23.713196+0000","last_clean":"2024-03-18T14:47:23.713196+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:23.713196+0000","last_undegraded":"2024-03-18T14:47:23.713196+0000","last_fullsized":"2024-03-18T14:47:23.713196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1052,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263925+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:24.263925+0000","last_peered":"2024-03-18T14:47:24.263925+0000","last_clean":"2024-03-18T14:47:24.263925+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:24.263925+0000","last_undegraded":"2024-03-18T14:47:24.263925+0000","last_fullsized":"2024-03-18T14:47:24.263925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":898,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264781+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:24.264781+0000","last_peered":"2024-03-18T14:47:24.264781+0000","last_clean":"2024-03-18T14:47:24.264781+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:24.264781+0000","last_undegraded":"2024-03-18T14:47:24.264781+0000","last_fullsized":"2024-03-18T14:47:24.264781+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263341+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:24.263341+0000","last_peered":"2024-03-18T14:47:24.263341+0000","last_clean":"2024-03-18T14:47:24.263341+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:24.263341+0000","last_undegraded":"2024-03-18T14:47:24.263341+0000","last_fullsized":"2024-03-18T14:47:24.263341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1006,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711129+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:23.711129+0000","last_peered":"2024-03-18T14:47:23.711129+0000","last_clean":"2024-03-18T14:47:23.711129+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:23.711129+0000","last_undegraded":"2024-03-18T14:47:23.711129+0000","last_fullsized":"2024-03-18T14:47:23.711129+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1021,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712066+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:23.712066+0000","last_peered":"2024-03-18T14:47:23.712066+0000","last_clean":"2024-03-18T14:47:23.712066+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:23.712066+0000","last_undegraded":"2024-03-18T14:47:23.712066+0000","last_fullsized":"2024-03-18T14:47:23.712066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264859+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:24.264859+0000","last_peered":"2024-03-18T14:47:24.264859+0000","last_clean":"2024-03-18T14:47:24.264859+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:24.264859+0000","last_undegraded":"2024-03-18T14:47:24.264859+0000","last_fullsized":"2024-03-18T14:47:24.264859+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":489,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714549+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:23.714549+0000","last_peered":"2024-03-18T14:47:23.714549+0000","last_clean":"2024-03-18T14:47:23.714549+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:23.714549+0000","last_undegraded":"2024-03-18T14:47:23.714549+0000","last_fullsized":"2024-03-18T14:47:23.714549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":897,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711917+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:23.711917+0000","last_peered":"2024-03-18T14:47:23.711917+0000","last_clean":"2024-03-18T14:47:23.711917+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:23.711917+0000","last_undegraded":"2024-03-18T14:47:23.711917+0000","last_fullsized":"2024-03-18T14:47:23.711917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":549,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.474946+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:24.474946+0000","last_peered":"2024-03-18T14:47:24.474946+0000","last_clean":"2024-03-18T14:47:24.474946+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:24.474946+0000","last_undegraded":"2024-03-18T14:47:24.474946+0000","last_fullsized":"2024-03-18T14:47:24.474946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714421+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:23.714421+0000","last_peered":"2024-03-18T14:47:23.714421+0000","last_clean":"2024-03-18T14:47:23.714421+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:23.714421+0000","last_undegraded":"2024-03-18T14:47:23.714421+0000","last_fullsized":"2024-03-18T14:47:23.714421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1036,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263619+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:24.263619+0000","last_peered":"2024-03-18T14:47:24.263619+0000","last_clean":"2024-03-18T14:47:24.263619+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:24.263619+0000","last_undegraded":"2024-03-18T14:47:24.263619+0000","last_fullsized":"2024-03-18T14:47:24.263619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264731+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:24.264731+0000","last_peered":"2024-03-18T14:47:24.264731+0000","last_clean":"2024-03-18T14:47:24.264731+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:24.264731+0000","last_undegraded":"2024-03-18T14:47:24.264731+0000","last_fullsized":"2024-03-18T14:47:24.264731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":703,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711782+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:24.711782+0000","last_peered":"2024-03-18T14:47:24.711782+0000","last_clean":"2024-03-18T14:47:24.711782+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:24.711782+0000","last_undegraded":"2024-03-18T14:47:24.711782+0000","last_fullsized":"2024-03-18T14:47:24.711782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":919,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710807+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:23.710807+0000","last_peered":"2024-03-18T14:47:23.710807+0000","last_clean":"2024-03-18T14:47:23.710807+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:23.710807+0000","last_undegraded":"2024-03-18T14:47:23.710807+0000","last_fullsized":"2024-03-18T14:47:23.710807+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":169,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712033+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:23.712033+0000","last_peered":"2024-03-18T14:47:23.712033+0000","last_clean":"2024-03-18T14:47:23.712033+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:23.712033+0000","last_undegraded":"2024-03-18T14:47:23.712033+0000","last_fullsized":"2024-03-18T14:47:23.712033+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":950,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.712576+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:23.712576+0000","last_peered":"2024-03-18T14:47:23.712576+0000","last_clean":"2024-03-18T14:47:23.712576+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:23.712576+0000","last_undegraded":"2024-03-18T14:47:23.712576+0000","last_fullsized":"2024-03-18T14:47:23.712576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":425,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714066+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:23.714066+0000","last_peered":"2024-03-18T14:47:23.714066+0000","last_clean":"2024-03-18T14:47:23.714066+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:23.714066+0000","last_undegraded":"2024-03-18T14:47:23.714066+0000","last_fullsized":"2024-03-18T14:47:23.714066+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":837,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711916+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:23.711916+0000","last_peered":"2024-03-18T14:47:23.711916+0000","last_clean":"2024-03-18T14:47:23.711916+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:23.711916+0000","last_undegraded":"2024-03-18T14:47:23.711916+0000","last_fullsized":"2024-03-18T14:47:23.711916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":678,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264656+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:24.264656+0000","last_peered":"2024-03-18T14:47:24.264656+0000","last_clean":"2024-03-18T14:47:24.264656+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:24.264656+0000","last_undegraded":"2024-03-18T14:47:24.264656+0000","last_fullsized":"2024-03-18T14:47:24.264656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":891,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711282+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:23.711282+0000","last_peered":"2024-03-18T14:47:23.711282+0000","last_clean":"2024-03-18T14:47:23.711282+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:23.711282+0000","last_undegraded":"2024-03-18T14:47:23.711282+0000","last_fullsized":"2024-03-18T14:47:23.711282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":522,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264871+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:24.264871+0000","last_peered":"2024-03-18T14:47:24.264871+0000","last_clean":"2024-03-18T14:47:24.264871+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:24.264871+0000","last_undegraded":"2024-03-18T14:47:24.264871+0000","last_fullsized":"2024-03-18T14:47:24.264871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":883,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.263831+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:24.263831+0000","last_peered":"2024-03-18T14:47:24.263831+0000","last_clean":"2024-03-18T14:47:24.263831+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:24.263831+0000","last_undegraded":"2024-03-18T14:47:24.263831+0000","last_fullsized":"2024-03-18T14:47:24.263831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":254,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712151+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:24.712151+0000","last_peered":"2024-03-18T14:47:24.712151+0000","last_clean":"2024-03-18T14:47:24.712151+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:24.712151+0000","last_undegraded":"2024-03-18T14:47:24.712151+0000","last_fullsized":"2024-03-18T14:47:24.712151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":999,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.710460+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:23.710460+0000","last_peered":"2024-03-18T14:47:23.710460+0000","last_clean":"2024-03-18T14:47:23.710460+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:23.710460+0000","last_undegraded":"2024-03-18T14:47:23.710460+0000","last_fullsized":"2024-03-18T14:47:23.710460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1091,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.713765+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:23.713765+0000","last_peered":"2024-03-18T14:47:23.713765+0000","last_clean":"2024-03-18T14:47:23.713765+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:23.713765+0000","last_undegraded":"2024-03-18T14:47:23.713765+0000","last_fullsized":"2024-03-18T14:47:23.713765+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1007,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264027+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:24.264027+0000","last_peered":"2024-03-18T14:47:24.264027+0000","last_clean":"2024-03-18T14:47:24.264027+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:24.264027+0000","last_undegraded":"2024-03-18T14:47:24.264027+0000","last_fullsized":"2024-03-18T14:47:24.264027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":920,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.711398+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:23.711398+0000","last_peered":"2024-03-18T14:47:23.711398+0000","last_clean":"2024-03-18T14:47:23.711398+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:23.711398+0000","last_undegraded":"2024-03-18T14:47:23.711398+0000","last_fullsized":"2024-03-18T14:47:23.711398+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":916,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.264640+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:24.264640+0000","last_peered":"2024-03-18T14:47:24.264640+0000","last_clean":"2024-03-18T14:47:24.264640+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:24.264640+0000","last_undegraded":"2024-03-18T14:47:24.264640+0000","last_fullsized":"2024-03-18T14:47:24.264640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":881,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-18T14:47:23.714455+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:23.714455+0000","last_peered":"2024-03-18T14:47:23.714455+0000","last_clean":"2024-03-18T14:47:23.714455+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:23.714455+0000","last_undegraded":"2024-03-18T14:47:23.714455+0000","last_fullsized":"2024-03-18T14:47:23.714455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137119751,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":605,"num_read_kb":130406,"num_write":16037,"num_write_kb":262678,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274391040,"data_stored":274278707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19609,"ondisk_log_size":19609,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953476,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413508,"kb_used_data":95868,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958332,"statfs":{"total":96636764160,"available":96213331968,"internally_reserved":0,"allocated":98168832,"data_stored":97939474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.193}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379164,"kb_used_data":62932,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992676,"statfs":{"total":96636764160,"available":96248500224,"internally_reserved":0,"allocated":64442368,"data_stored":64235606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084294,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372460,"kb_used_data":59876,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999380,"statfs":{"total":96636764160,"available":96255365120,"internally_reserved":0,"allocated":61313024,"data_stored":61090605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,3],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]}]},{"osd":1,"up_from":29,"seq":124554051589,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367692,"kb_used_data":51780,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004148,"statfs":{"total":96636764160,"available":96260247552,"internally_reserved":0,"allocated":53022720,"data_stored":52814788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60343795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52084736,"data_stored":52068250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:29.727 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T14:47:29.727 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T14:47:29.727 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T14:47:29.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T14:47:29.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.881+0000 7f869b4c4700 1 Processor -- start 2024-03-18T14:47:29.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.881+0000 7f869b4c4700 1 -- start start 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f869b4c4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 0x7f86940a2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f869b4c4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 0x7f86940680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f869b4c4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869406dd90 con 0x7f869406f2a0 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f869b4c4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869406fe70 con 0x7f869406f690 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f869b4c4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f869406fbd0 con 0x7f8694069200 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 0x7f86940a2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699a61700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 0x7f86940680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8698a5f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f869406f2a0 0x7f86940679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58630/0 (socket says 172.21.15.57:58630) 2024-03-18T14:47:29.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8698a5f700 1 -- 172.21.15.57:0/2962209439 learned_addr learned my addr 172.21.15.57:0/2962209439 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 -- 172.21.15.57:0/2962209439 >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 msgr2=0x7f86940680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 --2- 172.21.15.57:0/2962209439 >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 0x7f86940680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 -- 172.21.15.57:0/2962209439 >> v1:172.21.15.57:6789/0 conn(0x7f869406f2a0 legacy=0x7f86940679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 -- 172.21.15.57:0/2962209439 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940a26f0 con 0x7f8694069200 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f868bfff700 1 -- 172.21.15.57:0/2962209439 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563944351 0 0) 0x7f869406dd90 con 0x7f869406f2a0 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699a61700 1 --2- 172.21.15.57:0/2962209439 >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 0x7f86940680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.882+0000 7f8699260700 1 --2- 172.21.15.57:0/2962209439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 0x7f86940a2ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86900098e0 tx=0x7f86900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48eb990ea36dfb16 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f868bfff700 1 -- 172.21.15.57:0/2962209439 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000b640 con 0x7f8694069200 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f868bfff700 1 -- 172.21.15.57:0/2962209439 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000b7a0 con 0x7f8694069200 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f868bfff700 1 -- 172.21.15.57:0/2962209439 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000bb40 con 0x7f8694069200 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 -- 172.21.15.57:0/2962209439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 msgr2=0x7f86940a2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2962209439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 0x7f86940a2ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f86900098e0 tx=0x7f86900091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 -- 172.21.15.57:0/2962209439 shutdown_connections 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2962209439 >> v2:172.21.15.57:3300/0 conn(0x7f869406f690 0x7f86940680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.886 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2962209439 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f8694069200 0x7f86940a2ed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 -- 172.21.15.57:0/2962209439 >> 172.21.15.57:0/2962209439 conn(0x7f869406af40 msgr2=0x7f8694068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 -- 172.21.15.57:0/2962209439 shutdown_connections 2024-03-18T14:47:29.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.883+0000 7f869b4c4700 1 -- 172.21.15.57:0/2962209439 wait complete. 2024-03-18T14:47:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.885+0000 7f869b4c4700 1 Processor -- start 2024-03-18T14:47:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.885+0000 7f869b4c4700 1 -- start start 2024-03-18T14:47:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.885+0000 7f869b4c4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 0x7f869414efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.889 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 0x7f8694151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869414e590 con 0x7f8694069200 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869414f4f0 con 0x7f869406f2a0 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8694097f40 con 0x7f869406f690 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34424/0 (socket says 172.21.15.57:34424) 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 -- 172.21.15.57:0/2642873323 learned_addr learned my addr 172.21.15.57:0/2642873323 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8698a5f700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 0x7f869414efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699a61700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 0x7f8694151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 -- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 msgr2=0x7f8694151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 0x7f8694151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 -- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 msgr2=0x7f869414efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 0x7f869414efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:29.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 -- 172.21.15.57:0/2642873323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c009a20 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699a61700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 0x7f8694151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8698a5f700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 0x7f869414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f8699260700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f869000b6c0 tx=0x7f8690017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690000d10 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000bb20 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8690009420 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690011670 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.886+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86940a1a30 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.887+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8694065180 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.887+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f8690011aa0 con 0x7f8694069200 2024-03-18T14:47:29.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.888+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f869005ca90 con 0x7f8694069200 2024-03-18T14:47:29.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:29.891+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f8690001d40 con 0x7f8694069200 2024-03-18T14:47:30.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.077+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f869406b310 con 0x7f8694069200 2024-03-18T14:47:30.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.078+0000 7f86897fa700 1 -- 172.21.15.57:0/2642873323 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8690015040 con 0x7f8694069200 2024-03-18T14:47:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:30.079 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 >> v1:172.21.15.57:6816/47480 conn(0x7f8678046010 legacy=0x7f86780484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 msgr2=0x7f869414ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f869000b6c0 tx=0x7f8690017000 comp rx=0 tx=0).stop 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 shutdown_connections 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f869406f690 0x7f8694151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8694069200 0x7f869414ea70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 --2- 172.21.15.57:0/2642873323 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f869406f2a0 0x7f869414efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 >> 172.21.15.57:0/2642873323 conn(0x7f869406af40 msgr2=0x7f8694068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 shutdown_connections 2024-03-18T14:47:30.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.079+0000 7f869b4c4700 1 -- 172.21.15.57:0/2642873323 wait complete. 2024-03-18T14:47:30.092 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T14:47:30.093 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:30.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 Processor -- start 2024-03-18T14:47:30.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 -- start start 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 0x7f201406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201406de60 con 0x7f201406f490 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201406dbf0 con 0x7f201406e890 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f201b5fc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140a3490 con 0x7f2014069450 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.212+0000 7f2019398700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43298/0 (socket says 172.21.15.57:43298) 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 -- 172.21.15.57:0/447352009 learned_addr learned my addr 172.21.15.57:0/447352009 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:30.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2018b97700 1 --2- 172.21.15.57:0/447352009 >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 0x7f201406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 -- 172.21.15.57:0/447352009 >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 msgr2=0x7f201406ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 --2- 172.21.15.57:0/447352009 >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 0x7f201406ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 -- 172.21.15.57:0/447352009 >> v1:172.21.15.57:6789/0 conn(0x7f201406f490 legacy=0x7f20140679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 -- 172.21.15.57:0/447352009 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20140a2a50 con 0x7f2014069450 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2018b97700 1 --2- 172.21.15.57:0/447352009 >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 0x7f201406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f2019398700 1 --2- 172.21.15.57:0/447352009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20100099b0 tx=0x7f2010009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97976f324fd7645 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f200bfff700 1 -- 172.21.15.57:0/447352009 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010009ea0 con 0x7f2014069450 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f200bfff700 1 -- 172.21.15.57:0/447352009 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201000b860 con 0x7f2014069450 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.213+0000 7f200bfff700 1 -- 172.21.15.57:0/447352009 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000bc00 con 0x7f2014069450 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 -- 172.21.15.57:0/447352009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 msgr2=0x7f20140a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 --2- 172.21.15.57:0/447352009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f20100099b0 tx=0x7f2010009250 comp rx=0 tx=0).stop 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 -- 172.21.15.57:0/447352009 shutdown_connections 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 --2- 172.21.15.57:0/447352009 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f20140a3df0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 --2- 172.21.15.57:0/447352009 >> v2:172.21.15.57:3300/0 conn(0x7f201406e890 0x7f201406ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 -- 172.21.15.57:0/447352009 >> 172.21.15.57:0/447352009 conn(0x7f201406af90 msgr2=0x7f2014068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 -- 172.21.15.57:0/447352009 shutdown_connections 2024-03-18T14:47:30.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.214+0000 7f201b5fc700 1 -- 172.21.15.57:0/447352009 wait complete. 2024-03-18T14:47:30.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 Processor -- start 2024-03-18T14:47:30.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 -- start start 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f2014151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f201406f490 0x7f201413fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2014098800 con 0x7f201406f490 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20140ac1f0 con 0x7f2014069450 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.215+0000 7f201b5fc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2014140390 con 0x7f201406e890 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2019b99700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f201406f490 0x7f201413fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49536/0 (socket says 172.21.15.57:49536) 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2019398700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f2014151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 -- 172.21.15.57:0/2971751790 learned_addr learned my addr 172.21.15.57:0/2971751790 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 -- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 msgr2=0x7f2014151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f2014151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 -- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f201406f490 msgr2=0x7f201413fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f201406f490 0x7f201413fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 -- 172.21.15.57:0/2971751790 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004009420 con 0x7f201406e890 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f2018b97700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f200400ec50 tx=0x7f20040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400c8e0 con 0x7f201406e890 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400ca40 con 0x7f201406e890 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400cde0 con 0x7f201406e890 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20100094f0 con 0x7f201406e890 2024-03-18T14:47:30.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.216+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2014151fe0 con 0x7f201406e890 2024-03-18T14:47:30.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.217+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2004013680 con 0x7f201406e890 2024-03-18T14:47:30.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.217+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2014152470 con 0x7f201406e890 2024-03-18T14:47:30.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.218+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f200405b8d0 con 0x7f201406e890 2024-03-18T14:47:30.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.221+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f2014152470 con 0x7f201406e890 2024-03-18T14:47:30.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.385+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2014152470 con 0x7f201406e890 2024-03-18T14:47:30.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.386+0000 7f20097fa700 1 -- 172.21.15.57:0/2971751790 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11631 (secure 0 0 0) 0x7f2014152470 con 0x7f201406e890 2024-03-18T14:47:30.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:30.388 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:24.703821+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 >> v1:172.21.15.57:6816/47480 conn(0x7f1ff8046040 legacy=0x7f1ff80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 msgr2=0x7f201413f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f200400ec50 tx=0x7f20040091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 shutdown_connections 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f201406f490 0x7f201413fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2014069450 0x7f2014151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 --2- 172.21.15.57:0/2971751790 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f201406e890 0x7f201413f910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 >> 172.21.15.57:0/2971751790 conn(0x7f201406af90 msgr2=0x7f2014140f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 shutdown_connections 2024-03-18T14:47:30.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.388+0000 7f201b5fc700 1 -- 172.21.15.57:0/2971751790 wait complete. 2024-03-18T14:47:30.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:47:30.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.527+0000 7f2ae0110700 1 Processor -- start 2024-03-18T14:47:30.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.527+0000 7f2ae0110700 1 -- start start 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ae0110700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad80b16c0 0x7f2ad806e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ae0110700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad80ae290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ae0110700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad813aae0 con 0x7f2ad813a650 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ae0110700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad8138380 con 0x7f2ad80b16c0 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ae0110700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad813ad80 con 0x7f2ad80aca50 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2addeac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad80b16c0 0x7f2ad806e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2add6ab700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2ad813a650 0x7f2ad806eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58644/0 (socket says 172.21.15.57:58644) 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ade6ad700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad80ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2add6ab700 1 -- 172.21.15.57:0/2233715865 learned_addr learned my addr 172.21.15.57:0/2233715865 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2addeac700 1 -- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 msgr2=0x7f2ad80ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:30.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2addeac700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad80ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2addeac700 1 -- 172.21.15.57:0/2233715865 >> v1:172.21.15.57:6789/0 conn(0x7f2ad813a650 legacy=0x7f2ad806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2addeac700 1 -- 172.21.15.57:0/2233715865 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80b1a90 con 0x7f2ad80b16c0 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2adceaa700 1 -- 172.21.15.57:0/2233715865 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933682591 0 0) 0x7f2ad813aae0 con 0x7f2ad813a650 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.528+0000 7f2ade6ad700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2addeac700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad806e650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bdcfb8b42c1ca5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2adceaa700 1 -- 172.21.15.57:0/2233715865 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400b640 con 0x7f2ad80b16c0 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2adceaa700 1 -- 172.21.15.57:0/2233715865 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400b7a0 con 0x7f2ad80b16c0 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2adceaa700 1 -- 172.21.15.57:0/2233715865 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400bb40 con 0x7f2ad80b16c0 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 -- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 msgr2=0x7f2ad806e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad806e650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40098e0 tx=0x7f2ad40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 -- 172.21.15.57:0/2233715865 shutdown_connections 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad80ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 --2- 172.21.15.57:0/2233715865 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad806e650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 -- 172.21.15.57:0/2233715865 >> 172.21.15.57:0/2233715865 conn(0x7f2ad806a4d0 msgr2=0x7f2ad806a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 -- 172.21.15.57:0/2233715865 shutdown_connections 2024-03-18T14:47:30.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.529+0000 7f2ae0110700 1 -- 172.21.15.57:0/2233715865 wait complete. 2024-03-18T14:47:30.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.530+0000 7f2ae0110700 1 Processor -- start 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.530+0000 7f2ae0110700 1 -- start start 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad80a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ad813a650 0x7f2ad80a54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80a6c70 con 0x7f2ad80b16c0 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80a7620 con 0x7f2ad813a650 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ae0110700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad80a94e0 con 0x7f2ad80aca50 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49546/0 (socket says 172.21.15.57:49546) 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2add6ab700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad80a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 -- 172.21.15.57:0/498455785 learned_addr learned my addr 172.21.15.57:0/498455785 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2ade6ad700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ad813a650 0x7f2ad80a54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 -- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ad813a650 msgr2=0x7f2ad80a54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ad813a650 0x7f2ad80a54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 -- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 msgr2=0x7f2ad80a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad80a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 -- 172.21.15.57:0/498455785 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0009a20 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2addeac700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40093f0 tx=0x7f2ad4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.531+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400bb20 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.532+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4011420 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.532+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4011800 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.532+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad4009420 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.532+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad80a9200 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.533+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2ad4011c30 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.533+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad8065180 con 0x7f2ad80aca50 2024-03-18T14:47:30.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.533+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f2ad405c220 con 0x7f2ad80aca50 2024-03-18T14:47:30.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.537+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f2ad401d160 con 0x7f2ad80aca50 2024-03-18T14:47:30.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.700+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ad806eca0 con 0x7f2ad80aca50 2024-03-18T14:47:30.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.700+0000 7f2acdffb700 1 -- 172.21.15.57:0/498455785 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ad401d160 con 0x7f2ad80aca50 2024-03-18T14:47:30.702 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 >> v1:172.21.15.57:6816/47480 conn(0x7f2abc046040 legacy=0x7f2abc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 msgr2=0x7f2ad8137a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40093f0 tx=0x7f2ad4017000 comp rx=0 tx=0).stop 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 shutdown_connections 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2ad813a650 0x7f2ad80a54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2ad80aca50 0x7f2ad8137a90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 --2- 172.21.15.57:0/498455785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad80b16c0 0x7f2ad80a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 >> 172.21.15.57:0/498455785 conn(0x7f2ad806a4d0 msgr2=0x7f2ad8063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 shutdown_connections 2024-03-18T14:47:30.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.702+0000 7f2ae0110700 1 -- 172.21.15.57:0/498455785 wait complete. 2024-03-18T14:47:30.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:30.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.837+0000 7f6dbc9ba700 1 Processor -- start 2024-03-18T14:47:30.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.837+0000 7f6dbc9ba700 1 -- start start 2024-03-18T14:47:30.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.837+0000 7f6dbc9ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 0x7f6db80a3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.837+0000 7f6dbc9ba700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 0x7f6db81495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6dbc9ba700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db806f060 con 0x7f6db806e590 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6dbc9ba700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db80af340 con 0x7f6db80680f0 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6dbc9ba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80a2590 con 0x7f6db8069200 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 0x7f6db80a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db5d9b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6db806e590 0x7f6db80679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58654/0 (socket says 172.21.15.57:58654) 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db5d9b700 1 -- 172.21.15.57:0/3882842460 learned_addr learned my addr 172.21.15.57:0/3882842460 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db6d9d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 0x7f6db81495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db559a700 1 -- 172.21.15.57:0/3882842460 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145105465 0 0) 0x7f6db806f060 con 0x7f6db806e590 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db559a700 1 -- 172.21.15.57:0/3882842460 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003570 con 0x7f6db806e590 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 -- 172.21.15.57:0/3882842460 >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 msgr2=0x7f6db81495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:30.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 --2- 172.21.15.57:0/3882842460 >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 0x7f6db81495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 -- 172.21.15.57:0/3882842460 >> v1:172.21.15.57:6789/0 conn(0x7f6db806e590 legacy=0x7f6db80679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 -- 172.21.15.57:0/3882842460 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80a40d0 con 0x7f6db8069200 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db6d9d700 1 --2- 172.21.15.57:0/3882842460 >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 0x7f6db81495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db659c700 1 --2- 172.21.15.57:0/3882842460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 0x7f6db80a3930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6da80098e0 tx=0x7f6da80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=586e75c21631b162 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db559a700 1 -- 172.21.15.57:0/3882842460 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011630 con 0x7f6db8069200 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db559a700 1 -- 172.21.15.57:0/3882842460 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8011790 con 0x7f6db8069200 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.838+0000 7f6db559a700 1 -- 172.21.15.57:0/3882842460 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011b10 con 0x7f6db8069200 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/3882842460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 msgr2=0x7f6db80a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/3882842460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 0x7f6db80a3930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6da80098e0 tx=0x7f6da80091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/3882842460 shutdown_connections 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/3882842460 >> v2:172.21.15.57:3300/0 conn(0x7f6db80680f0 0x7f6db81495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/3882842460 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db8069200 0x7f6db80a3930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/3882842460 >> 172.21.15.57:0/3882842460 conn(0x7f6db806ce30 msgr2=0x7f6db8068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/3882842460 shutdown_connections 2024-03-18T14:47:30.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.839+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/3882842460 wait complete. 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 Processor -- start 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 -- start start 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6db8069200 0x7f6db80aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db806e590 0x7f6db80aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80ae990 con 0x7f6db80680f0 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8096f80 con 0x7f6db8069200 2024-03-18T14:47:30.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.840+0000 7f6dbc9ba700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8097240 con 0x7f6db806e590 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34490/0 (socket says 172.21.15.57:34490) 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 -- 172.21.15.57:0/2410699561 learned_addr learned my addr 172.21.15.57:0/2410699561 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db6d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db806e590 0x7f6db80aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db5d9b700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6db8069200 0x7f6db80aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 -- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db806e590 msgr2=0x7f6db80aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db806e590 0x7f6db80aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 -- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6db8069200 msgr2=0x7f6db80aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6db8069200 0x7f6db80aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 -- 172.21.15.57:0/2410699561 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0009a20 con 0x7f6db80680f0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6db659c700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6db80a26d0 tx=0x7f6da8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011900 con 0x7f6db80680f0 2024-03-18T14:47:30.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8011a80 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da8009420 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da801a680 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.841+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db8096c50 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.842+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db806a8b0 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.842+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f6da801aa70 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.843+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f6da805ccb0 con 0x7f6db80680f0 2024-03-18T14:47:30.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:30.846+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f6da8007a80 con 0x7f6db80680f0 2024-03-18T14:47:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.008+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6db8065180 con 0x7f6db80680f0 2024-03-18T14:47:31.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.009+0000 7f6da67fc700 1 -- 172.21.15.57:0/2410699561 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6da80078b0 con 0x7f6db80680f0 2024-03-18T14:47:31.011 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:31.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 >> v1:172.21.15.57:6816/47480 conn(0x7f6d98046010 legacy=0x7f6d980484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 msgr2=0x7f6db80adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6db80a26d0 tx=0x7f6da8017000 comp rx=0 tx=0).stop 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 shutdown_connections 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6db806e590 0x7f6db80aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6db80680f0 0x7f6db80adc80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 --2- 172.21.15.57:0/2410699561 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6db8069200 0x7f6db80aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 >> 172.21.15.57:0/2410699561 conn(0x7f6db806ce30 msgr2=0x7f6db80b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 shutdown_connections 2024-03-18T14:47:31.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.011+0000 7f6dbc9ba700 1 -- 172.21.15.57:0/2410699561 wait complete. 2024-03-18T14:47:31.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:31.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.145+0000 7efc2ace7700 1 Processor -- start 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.145+0000 7efc2ace7700 1 -- start start 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc2ace7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 0x7efc240a3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc2ace7700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 0x7efc241495b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc2ace7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2406f060 con 0x7efc2406e590 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc2ace7700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc240af340 con 0x7efc240680f0 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc2ace7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc240a2590 con 0x7efc24069200 2024-03-18T14:47:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc29284700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 0x7efc241495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc28a83700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 0x7efc240a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc23fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efc2406e590 0x7efc240679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58658/0 (socket says 172.21.15.57:58658) 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc23fff700 1 -- 172.21.15.57:0/1372519373 learned_addr learned my addr 172.21.15.57:0/1372519373 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc28a83700 1 -- 172.21.15.57:0/1372519373 >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 msgr2=0x7efc241495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc28a83700 1 --2- 172.21.15.57:0/1372519373 >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 0x7efc241495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc28a83700 1 -- 172.21.15.57:0/1372519373 >> v1:172.21.15.57:6789/0 conn(0x7efc2406e590 legacy=0x7efc240679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc28a83700 1 -- 172.21.15.57:0/1372519373 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc240a40d0 con 0x7efc24069200 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.146+0000 7efc29284700 1 --2- 172.21.15.57:0/1372519373 >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 0x7efc241495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc28a83700 1 --2- 172.21.15.57:0/1372519373 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 0x7efc240a3930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc180098e0 tx=0x7efc180091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f016fba1297d167 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc237fe700 1 -- 172.21.15.57:0/1372519373 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800b640 con 0x7efc24069200 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc237fe700 1 -- 172.21.15.57:0/1372519373 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800b7a0 con 0x7efc24069200 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc237fe700 1 -- 172.21.15.57:0/1372519373 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800bb40 con 0x7efc24069200 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 -- 172.21.15.57:0/1372519373 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 msgr2=0x7efc240a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1372519373 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 0x7efc240a3930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efc180098e0 tx=0x7efc180091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 -- 172.21.15.57:0/1372519373 shutdown_connections 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1372519373 >> v2:172.21.15.57:3300/0 conn(0x7efc240680f0 0x7efc241495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1372519373 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc24069200 0x7efc240a3930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 -- 172.21.15.57:0/1372519373 >> 172.21.15.57:0/1372519373 conn(0x7efc2406ce30 msgr2=0x7efc24068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 -- 172.21.15.57:0/1372519373 shutdown_connections 2024-03-18T14:47:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.147+0000 7efc2ace7700 1 -- 172.21.15.57:0/1372519373 wait complete. 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.148+0000 7efc2ace7700 1 Processor -- start 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 -- start start 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc24069200 0x7efc2413e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc2406e590 0x7efc2413eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24097600 con 0x7efc2406e590 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2413f410 con 0x7efc24069200 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc2ace7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc24097b60 con 0x7efc240680f0 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49580/0 (socket says 172.21.15.57:49580) 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 -- 172.21.15.57:0/1643582482 learned_addr learned my addr 172.21.15.57:0/1643582482 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc29284700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc2406e590 0x7efc2413eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc23fff700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc24069200 0x7efc2413e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 -- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc24069200 msgr2=0x7efc2413e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc24069200 0x7efc2413e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 -- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc2406e590 msgr2=0x7efc2413eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc2406e590 0x7efc2413eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.149+0000 7efc28a83700 1 -- 172.21.15.57:0/1643582482 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c009a20 con 0x7efc240680f0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc28a83700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc18009f80 tx=0x7efc18017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1801bce0 con 0x7efc240680f0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1801be60 con 0x7efc240680f0 2024-03-18T14:47:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc18009420 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18011670 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.150+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc240ab010 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.151+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7efc18011a20 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.151+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2406a8b0 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.151+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7efc1805c610 con 0x7efc240680f0 2024-03-18T14:47:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.155+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7efc1803e4f0 con 0x7efc240680f0 2024-03-18T14:47:31.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.315+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc240a1ac0 con 0x7efc240680f0 2024-03-18T14:47:31.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.315+0000 7efc20ff9700 1 -- 172.21.15.57:0/1643582482 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc18011cd0 con 0x7efc240680f0 2024-03-18T14:47:31.317 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 >> v1:172.21.15.57:6816/47480 conn(0x7efc08046010 legacy=0x7efc080484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 msgr2=0x7efc240970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efc18009f80 tx=0x7efc18017000 comp rx=0 tx=0).stop 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 shutdown_connections 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc2406e590 0x7efc2413eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7efc240680f0 0x7efc240970c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 --2- 172.21.15.57:0/1643582482 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7efc24069200 0x7efc2413e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 >> 172.21.15.57:0/1643582482 conn(0x7efc2406ce30 msgr2=0x7efc240b2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 shutdown_connections 2024-03-18T14:47:31.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.317+0000 7efc2ace7700 1 -- 172.21.15.57:0/1643582482 wait complete. 2024-03-18T14:47:31.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:31.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.452+0000 7fc79cac9700 1 Processor -- start 2024-03-18T14:47:31.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.452+0000 7fc79cac9700 1 -- start start 2024-03-18T14:47:31.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79cac9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 0x7fc7980a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79cac9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 0x7fc798140200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79cac9700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980a3d30 con 0x7fc79806eb30 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79cac9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798068680 con 0x7fc79813fdb0 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79cac9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980a56f0 con 0x7fc7980682b0 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79659c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 0x7fc7980a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc796d9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc79806eb30 0x7fc79806efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58664/0 (socket says 172.21.15.57:58664) 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc795d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 0x7fc798140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc796d9d700 1 -- 172.21.15.57:0/1442361167 learned_addr learned my addr 172.21.15.57:0/1442361167 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79659c700 1 -- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 msgr2=0x7fc798140200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79659c700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 0x7fc798140200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79659c700 1 -- 172.21.15.57:0/1442361167 >> v1:172.21.15.57:6789/0 conn(0x7fc79806eb30 legacy=0x7fc79806efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc79659c700 1 -- 172.21.15.57:0/1442361167 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7980a74c0 con 0x7fc7980682b0 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.453+0000 7fc795d9b700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 0x7fc798140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.454+0000 7fc79659c700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 0x7fc7980a6de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc788009910 tx=0x7fc7880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f822b60982e47 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.457+0000 7fc79559a700 1 -- 172.21.15.57:0/1442361167 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800b710 con 0x7fc7980682b0 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.457+0000 7fc79559a700 1 -- 172.21.15.57:0/1442361167 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800b870 con 0x7fc7980682b0 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.457+0000 7fc79559a700 1 -- 172.21.15.57:0/1442361167 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800bc30 con 0x7fc7980682b0 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 -- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 msgr2=0x7fc7980a6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 0x7fc7980a6de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc788009910 tx=0x7fc7880091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 -- 172.21.15.57:0/1442361167 shutdown_connections 2024-03-18T14:47:31.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7980682b0 0x7fc7980a6de0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 --2- 172.21.15.57:0/1442361167 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79813fdb0 0x7fc798140200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 -- 172.21.15.57:0/1442361167 >> 172.21.15.57:0/1442361167 conn(0x7fc79806bf80 msgr2=0x7fc7980679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 -- 172.21.15.57:0/1442361167 shutdown_connections 2024-03-18T14:47:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.458+0000 7fc79cac9700 1 -- 172.21.15.57:0/1442361167 wait complete. 2024-03-18T14:47:31.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.459+0000 7fc79cac9700 1 Processor -- start 2024-03-18T14:47:31.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.459+0000 7fc79cac9700 1 -- start start 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 0x7fc79813d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 0x7fc79813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980af7c0 con 0x7fc7980682b0 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79813e470 con 0x7fc79806eb30 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79cac9700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980ad440 con 0x7fc79813fdb0 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 0x7fc79813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79659c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34506/0 (socket says 172.21.15.57:34506) 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79659c700 1 -- 172.21.15.57:0/929308189 learned_addr learned my addr 172.21.15.57:0/929308189 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc795d9b700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 0x7fc79813d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 -- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 msgr2=0x7fc79813d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 0x7fc79813d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 -- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 msgr2=0x7fc7980add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc796d9d700 1 -- 172.21.15.57:0/929308189 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c009420 con 0x7fc79813fdb0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc795d9b700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 0x7fc79813d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.460+0000 7fc79659c700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc796d9d700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 0x7fc79813df30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc79000cbc0 tx=0x7fc7900019a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000a830 con 0x7fc79813fdb0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000a990 con 0x7fc79813fdb0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc788009420 con 0x7fc79813fdb0 2024-03-18T14:47:31.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79000ad50 con 0x7fc79813fdb0 2024-03-18T14:47:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.461+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7980a2a10 con 0x7fc79813fdb0 2024-03-18T14:47:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.462+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc790007300 con 0x7fc79813fdb0 2024-03-18T14:47:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.462+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7980a2bd0 con 0x7fc79813fdb0 2024-03-18T14:47:31.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.462+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc79005b450 con 0x7fc79813fdb0 2024-03-18T14:47:31.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.466+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc7900396f0 con 0x7fc79813fdb0 2024-03-18T14:47:31.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.627+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc798065180 con 0x7fc79813fdb0 2024-03-18T14:47:31.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.627+0000 7fc7867fc700 1 -- 172.21.15.57:0/929308189 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc79003cee0 con 0x7fc79813fdb0 2024-03-18T14:47:31.629 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 >> v1:172.21.15.57:6816/47480 conn(0x7fc778046010 legacy=0x7fc7780484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 msgr2=0x7fc79813df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 0x7fc79813df30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc79000cbc0 tx=0x7fc7900019a0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 shutdown_connections 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc79813fdb0 0x7fc79813df30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7980682b0 0x7fc7980add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 --2- 172.21.15.57:0/929308189 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc79806eb30 0x7fc79813d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 >> 172.21.15.57:0/929308189 conn(0x7fc79806bf80 msgr2=0x7fc79806c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 shutdown_connections 2024-03-18T14:47:31.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.629+0000 7fc79cac9700 1 -- 172.21.15.57:0/929308189 wait complete. 2024-03-18T14:47:31.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.762+0000 7fddcbeac700 1 Processor -- start 2024-03-18T14:47:31.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.762+0000 7fddcbeac700 1 -- start start 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddcbeac700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 0x7fddc40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddcbeac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 0x7fddc40afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddcbeac700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc40a77d0 con 0x7fddc40b0050 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddcbeac700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc413fc50 con 0x7fddc40b3550 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddcbeac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc413fef0 con 0x7fddc40a4cb0 2024-03-18T14:47:31.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9c48700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 0x7fddc40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 0x7fddc40afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddca449700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fddc40b0050 0x7fddc406eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58676/0 (socket says 172.21.15.57:58676) 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddca449700 1 -- 172.21.15.57:0/2054935069 learned_addr learned my addr 172.21.15.57:0/2054935069 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 -- 172.21.15.57:0/2054935069 >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 msgr2=0x7fddc40a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 --2- 172.21.15.57:0/2054935069 >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 0x7fddc40a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 -- 172.21.15.57:0/2054935069 >> v1:172.21.15.57:6789/0 conn(0x7fddc40b0050 legacy=0x7fddc406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 -- 172.21.15.57:0/2054935069 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc40a5980 con 0x7fddc40a4cb0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9c48700 1 --2- 172.21.15.57:0/2054935069 >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 0x7fddc40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc9447700 1 --2- 172.21.15.57:0/2054935069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 0x7fddc40afb10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098e0 tx=0x7fddc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43009e35af24674a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc8c46700 1 -- 172.21.15.57:0/2054935069 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000b640 con 0x7fddc40a4cb0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc8c46700 1 -- 172.21.15.57:0/2054935069 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000b7a0 con 0x7fddc40a4cb0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.763+0000 7fddc8c46700 1 -- 172.21.15.57:0/2054935069 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000bb40 con 0x7fddc40a4cb0 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 -- 172.21.15.57:0/2054935069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 msgr2=0x7fddc40afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 --2- 172.21.15.57:0/2054935069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 0x7fddc40afb10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fddc00098e0 tx=0x7fddc00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 -- 172.21.15.57:0/2054935069 shutdown_connections 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 --2- 172.21.15.57:0/2054935069 >> v2:172.21.15.57:3300/0 conn(0x7fddc40b3550 0x7fddc40a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 --2- 172.21.15.57:0/2054935069 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40a4cb0 0x7fddc40afb10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 -- 172.21.15.57:0/2054935069 >> 172.21.15.57:0/2054935069 conn(0x7fddc406e2c0 msgr2=0x7fddc406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 -- 172.21.15.57:0/2054935069 shutdown_connections 2024-03-18T14:47:31.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.764+0000 7fddcbeac700 1 -- 172.21.15.57:0/2054935069 wait complete. 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.765+0000 7fddcbeac700 1 Processor -- start 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.765+0000 7fddcbeac700 1 -- start start 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 0x7fddc4097590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 0x7fddc40ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 0x7fddc414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:31.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40adb40 con 0x7fddc40b3550 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40aefc0 con 0x7fddc40a4cb0 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddc40ab810 con 0x7fddc40b0050 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9c48700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 0x7fddc4097590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddca449700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 0x7fddc414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 0x7fddc40ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9c48700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 0x7fddc4097590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43362/0 (socket says 172.21.15.57:43362) 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9c48700 1 -- 172.21.15.57:0/1363226641 learned_addr learned my addr 172.21.15.57:0/1363226641 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 -- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 msgr2=0x7fddc4097590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 0x7fddc4097590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 -- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 msgr2=0x7fddc414f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 0x7fddc414f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 -- 172.21.15.57:0/1363226641 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4009420 con 0x7fddc40b0050 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddca449700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 0x7fddc414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddc9447700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 0x7fddc40ae5f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fddc0016000 tx=0x7fddc0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc001bc40 con 0x7fddc40b0050 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc001bda0 con 0x7fddc40b0050 2024-03-18T14:47:31.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc0009420 con 0x7fddc40b0050 2024-03-18T14:47:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.766+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0011670 con 0x7fddc40b0050 2024-03-18T14:47:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.767+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc40afb80 con 0x7fddc40b0050 2024-03-18T14:47:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.767+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc40ae460 con 0x7fddc40b0050 2024-03-18T14:47:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.767+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fddc0011aa0 con 0x7fddc40b0050 2024-03-18T14:47:31.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.768+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fddc005c9f0 con 0x7fddc40b0050 2024-03-18T14:47:31.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.771+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fddc0001d40 con 0x7fddc40b0050 2024-03-18T14:47:31.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.960+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddc4065180 con 0x7fddc40b0050 2024-03-18T14:47:31.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.960+0000 7fddb9ffb700 1 -- 172.21.15.57:0/1363226641 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3668 (secure 0 0 0) 0x7fddc0015020 con 0x7fddc40b0050 2024-03-18T14:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/3316946905","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":3316946905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":14420,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6819/2165512544","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2165512544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:47:27.421839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14431},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14431":{"gid":14431,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6818/4018842639","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":4018842639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 >> v1:172.21.15.57:6816/47480 conn(0x7fdda8046010 legacy=0x7fdda80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 msgr2=0x7fddc40ae5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 0x7fddc40ae5f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fddc0016000 tx=0x7fddc0017000 comp rx=0 tx=0).stop 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 shutdown_connections 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddc40b3550 0x7fddc414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fddc40a4cb0 0x7fddc4097590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 --2- 172.21.15.57:0/1363226641 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fddc40b0050 0x7fddc40ae5f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 >> 172.21.15.57:0/1363226641 conn(0x7fddc406e2c0 msgr2=0x7fddc413ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 shutdown_connections 2024-03-18T14:47:31.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:31.962+0000 7fddcbeac700 1 -- 172.21.15.57:0/1363226641 wait complete. 2024-03-18T14:47:31.965 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2024-03-18T14:47:31.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 Processor -- start 2024-03-18T14:47:32.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 -- start start 2024-03-18T14:47:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0bc06ebf0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc06b7c0 con 0x7fa0bc069450 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0c208e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc06f520 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0baffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0bb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0bbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0bbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49624/0 (socket says 172.21.15.57:49624) 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0bb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0a3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43374/0 (socket says 172.21.15.57:43374) 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0bbfff700 1 -- 172.21.15.57:0/402217844 learned_addr learned my addr 172.21.15.57:0/402217844 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.095+0000 7fa0baffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34528/0 (socket says 172.21.15.57:34528) 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 -- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 msgr2=0x7fa0bc0a3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 --2- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0a3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 -- 172.21.15.57:0/402217844 >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 msgr2=0x7fa0bc06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 --2- 172.21.15.57:0/402217844 >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 -- 172.21.15.57:0/402217844 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0a44f0 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0baffd700 1 --2- 172.21.15.57:0/402217844 >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0bbfff700 1 --2- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009f20 tx=0x7fa0b4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1312ee2bb359704a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0ba7fc700 1 -- 172.21.15.57:0/402217844 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b400e070 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0ba7fc700 1 -- 172.21.15.57:0/402217844 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b400b970 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.096+0000 7fa0ba7fc700 1 -- 172.21.15.57:0/402217844 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b40092e0 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 -- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 msgr2=0x7fa0bc06e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 --2- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa0b4009f20 tx=0x7fa0b4009840 comp rx=0 tx=0).stop 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 -- 172.21.15.57:0/402217844 shutdown_connections 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 --2- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2c50 0x7fa0bc06e6b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 --2- 172.21.15.57:0/402217844 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 --2- 172.21.15.57:0/402217844 >> v2:172.21.15.57:3300/0 conn(0x7fa0bc0a2820 0x7fa0bc06e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 -- 172.21.15.57:0/402217844 >> 172.21.15.57:0/402217844 conn(0x7fa0bc06af40 msgr2=0x7fa0bc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 -- 172.21.15.57:0/402217844 shutdown_connections 2024-03-18T14:47:32.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.097+0000 7fa0c208e700 1 -- 172.21.15.57:0/402217844 wait complete. 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 Processor -- start 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 -- start start 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc0a2c50 0x7fa0bc14d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc096f50 con 0x7fa0bc0a2c50 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc0acb90 con 0x7fa0bc069450 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0c208e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0bc0adcb0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0baffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0bb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0baffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49634/0 (socket says 172.21.15.57:49634) 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0baffd700 1 -- 172.21.15.57:0/3930292376 learned_addr learned my addr 172.21.15.57:0/3930292376 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.098+0000 7fa0bbfff700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc0a2c50 0x7fa0bc14d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 -- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 msgr2=0x7fa0bc0abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 -- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc0a2c50 msgr2=0x7fa0bc14d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc0a2c50 0x7fa0bc14d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 -- 172.21.15.57:0/3930292376 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b000b6d0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0bb7fe700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0baffd700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000e3e0 tx=0x7fa0b000b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011450 con 0x7fa0bc0a2820 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b00115b0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0b4009ae0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b0011950 con 0x7fa0bc0a2820 2024-03-18T14:47:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.099+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0bc096a50 con 0x7fa0bc0a2820 2024-03-18T14:47:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.100+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0bc0a1eb0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.100+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fa0b0011cc0 con 0x7fa0bc0a2820 2024-03-18T14:47:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.101+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fa0b005e340 con 0x7fa0bc0a2820 2024-03-18T14:47:32.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.104+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fa0b003c560 con 0x7fa0bc0a2820 2024-03-18T14:47:32.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.268+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0bc0b2450 con 0x7fa0bc0a2820 2024-03-18T14:47:32.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.269+0000 7fa0a37fe700 1 -- 172.21.15.57:0/3930292376 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11631 (secure 0 0 0) 0x7fa0b001e030 con 0x7fa0bc0a2820 2024-03-18T14:47:32.271 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:32.271 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:24.703821+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 >> v1:172.21.15.57:6816/47480 conn(0x7fa0a8046010 legacy=0x7fa0a80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 msgr2=0x7fa0bc14d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa0b000e3e0 tx=0x7fa0b000b430 comp rx=0 tx=0).stop 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 shutdown_connections 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc0a2c50 0x7fa0bc14d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fa0bc069450 0x7fa0bc0abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 --2- 172.21.15.57:0/3930292376 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fa0bc0a2820 0x7fa0bc14d1b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 >> 172.21.15.57:0/3930292376 conn(0x7fa0bc06af40 msgr2=0x7fa0bc068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 shutdown_connections 2024-03-18T14:47:32.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.271+0000 7fa0c208e700 1 -- 172.21.15.57:0/3930292376 wait complete. 2024-03-18T14:47:32.284 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:47:32.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.407+0000 7fe6c5a5b700 1 Processor -- start 2024-03-18T14:47:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.407+0000 7fe6c5a5b700 1 -- start start 2024-03-18T14:47:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 0x7fe6c00a2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 0x7fe6c0141e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c00a7500 con 0x7fe6c00a42a0 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c013ebd0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6c5a5b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00a3290 con 0x7fe6c013f540 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43392/0 (socket says 172.21.15.57:43392) 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6bf7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 0x7fe6c0141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 -- 172.21.15.57:0/2374176087 learned_addr learned my addr 172.21.15.57:0/2374176087 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6beffd700 1 --2- 172.21.15.57:0/2374176087 >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 0x7fe6c00a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 -- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 msgr2=0x7fe6c0141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 0x7fe6c0141e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 -- 172.21.15.57:0/2374176087 >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 msgr2=0x7fe6c00a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 --2- 172.21.15.57:0/2374176087 >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 0x7fe6c00a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 -- 172.21.15.57:0/2374176087 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c00a3850 con 0x7fe6c00a27d0 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6bf7fe700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 0x7fe6c0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6beffd700 1 --2- 172.21.15.57:0/2374176087 >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 0x7fe6c00a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.408+0000 7fe6be7fc700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00099e0 tx=0x7fe6b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5262ea84ee9b348d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6bdffb700 1 -- 172.21.15.57:0/2374176087 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000b640 con 0x7fe6c00a27d0 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6bdffb700 1 -- 172.21.15.57:0/2374176087 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b000b7a0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6bdffb700 1 -- 172.21.15.57:0/2374176087 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b000bb40 con 0x7fe6c00a27d0 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 msgr2=0x7fe6c013f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe6b00099e0 tx=0x7fe6b0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/2374176087 shutdown_connections 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c013f540 0x7fe6c0141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/2374176087 >> v2:172.21.15.57:3300/0 conn(0x7fe6c00a42a0 0x7fe6c00a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/2374176087 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a27d0 0x7fe6c013f000 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/2374176087 >> 172.21.15.57:0/2374176087 conn(0x7fe6c00b4eb0 msgr2=0x7fe6c00b52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/2374176087 shutdown_connections 2024-03-18T14:47:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.409+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/2374176087 wait complete. 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.410+0000 7fe6c5a5b700 1 Processor -- start 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.410+0000 7fe6c5a5b700 1 -- start start 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 0x7fe6c00ab660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 0x7fe6c0151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00ae580 con 0x7fe6c013f540 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00abf20 con 0x7fe6c00a42a0 2024-03-18T14:47:32.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6c5a5b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00acde0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6be7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 0x7fe6c0151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6be7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 0x7fe6c0151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43406/0 (socket says 172.21.15.57:43406) 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 0x7fe6c00ab660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6be7fc700 1 -- 172.21.15.57:0/1356664869 learned_addr learned my addr 172.21.15.57:0/1356664869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6bf7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34548/0 (socket says 172.21.15.57:34548) 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 -- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 msgr2=0x7fe6c0151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 0x7fe6c0151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 -- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 msgr2=0x7fe6c0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 -- 172.21.15.57:0/1356664869 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b4009420 con 0x7fe6c00a27d0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6bf7fe700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.411+0000 7fe6beffd700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 0x7fe6c00ab660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ec80 tx=0x7fe6b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.412+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400c850 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.412+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400c9b0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.412+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b8009a20 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.412+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400cd50 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.412+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b00094f0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.413+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c00b25f0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.413+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe6b4013680 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.413+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe6b405b420 con 0x7fe6c00a27d0 2024-03-18T14:47:32.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.417+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fe6b4039700 con 0x7fe6c00a27d0 2024-03-18T14:47:32.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.579+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe6c00648f0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.580+0000 7fe6a6ffd700 1 -- 172.21.15.57:0/1356664869 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6b403cef0 con 0x7fe6c00a27d0 2024-03-18T14:47:32.581 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 >> v1:172.21.15.57:6816/47480 conn(0x7fe6ac046010 legacy=0x7fe6ac0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 msgr2=0x7fe6c00ab660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 0x7fe6c00ab660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe6b400ec80 tx=0x7fe6b40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 shutdown_connections 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe6c013f540 0x7fe6c0151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe6c00a27d0 0x7fe6c00ab660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 --2- 172.21.15.57:0/1356664869 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe6c00a42a0 0x7fe6c0151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 >> 172.21.15.57:0/1356664869 conn(0x7fe6c00b4eb0 msgr2=0x7fe6c013fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 shutdown_connections 2024-03-18T14:47:32.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.581+0000 7fe6c5a5b700 1 -- 172.21.15.57:0/1356664869 wait complete. 2024-03-18T14:47:32.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:32.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.717+0000 7f33b4979700 1 Processor -- start 2024-03-18T14:47:32.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.717+0000 7f33b4979700 1 -- start start 2024-03-18T14:47:32.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33b4979700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 0x7f33b0138150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33b4979700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 0x7f33b0138690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33b4979700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b013be70 con 0x7f33b0063a70 2024-03-18T14:47:32.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33b4979700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b006ead0 con 0x7f33b013ae40 2024-03-18T14:47:32.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33b4979700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013b340 con 0x7f33b006ef20 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33add9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 0x7f33b0138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 0x7f33b0138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33ae59c700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f33b0063a70 0x7f33b006d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58690/0 (socket says 172.21.15.57:58690) 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33ae59c700 1 -- 172.21.15.57:0/2119173516 learned_addr learned my addr 172.21.15.57:0/2119173516 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 -- 172.21.15.57:0/2119173516 >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 msgr2=0x7f33b0138150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 --2- 172.21.15.57:0/2119173516 >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 0x7f33b0138150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 -- 172.21.15.57:0/2119173516 >> v1:172.21.15.57:6789/0 conn(0x7f33b0063a70 legacy=0x7f33b006d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 -- 172.21.15.57:0/2119173516 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b013b5e0 con 0x7f33b006ef20 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33add9b700 1 --2- 172.21.15.57:0/2119173516 >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 0x7f33b0138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33aed9d700 1 --2- 172.21.15.57:0/2119173516 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 0x7f33b0138690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f33a80098e0 tx=0x7f33a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bb558e20ee817df server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33ad59a700 1 -- 172.21.15.57:0/2119173516 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800b640 con 0x7f33b006ef20 2024-03-18T14:47:32.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33ad59a700 1 -- 172.21.15.57:0/2119173516 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800b7a0 con 0x7f33b006ef20 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.718+0000 7f33ad59a700 1 -- 172.21.15.57:0/2119173516 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800bb40 con 0x7f33b006ef20 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 -- 172.21.15.57:0/2119173516 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 msgr2=0x7f33b0138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 --2- 172.21.15.57:0/2119173516 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 0x7f33b0138690 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f33a80098e0 tx=0x7f33a80091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 -- 172.21.15.57:0/2119173516 shutdown_connections 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 --2- 172.21.15.57:0/2119173516 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b006ef20 0x7f33b0138690 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 --2- 172.21.15.57:0/2119173516 >> v2:172.21.15.57:3300/0 conn(0x7f33b013ae40 0x7f33b0138150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 -- 172.21.15.57:0/2119173516 >> 172.21.15.57:0/2119173516 conn(0x7f33b006a4d0 msgr2=0x7f33b006a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 -- 172.21.15.57:0/2119173516 shutdown_connections 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.719+0000 7f33b4979700 1 -- 172.21.15.57:0/2119173516 wait complete. 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 Processor -- start 2024-03-18T14:47:32.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 -- start start 2024-03-18T14:47:32.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b006ef20 0x7f33b00a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b013ae40 0x7f33b00a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013cc70 con 0x7f33b013ae40 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00af3c0 con 0x7f33b006ef20 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.720+0000 7f33b4979700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00af660 con 0x7f33b0063a70 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49688/0 (socket says 172.21.15.57:49688) 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 -- 172.21.15.57:0/3840362587 learned_addr learned my addr 172.21.15.57:0/3840362587 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33add9b700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b006ef20 0x7f33b00a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33aed9d700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b013ae40 0x7f33b00a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 -- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b006ef20 msgr2=0x7f33b00a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b006ef20 0x7f33b00a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 -- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b013ae40 msgr2=0x7f33b00a9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b013ae40 0x7f33b00a9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 -- 172.21.15.57:0/3840362587 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398009420 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33ae59c700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cd30 tx=0x7f33a0001ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000ce30 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0004bb0 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8009420 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a000aac0 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.721+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b00af170 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.722+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b013c560 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.722+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f33a00070f0 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.723+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f33a005ad70 con 0x7f33b0063a70 2024-03-18T14:47:32.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.726+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f33a0038fb0 con 0x7f33b0063a70 2024-03-18T14:47:32.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.886+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33b013be70 con 0x7f33b0063a70 2024-03-18T14:47:32.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.886+0000 7f33a67fc700 1 -- 172.21.15.57:0/3840362587 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33b013be70 con 0x7f33b0063a70 2024-03-18T14:47:32.888 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 >> v1:172.21.15.57:6816/47480 conn(0x7f3390046040 legacy=0x7f33900484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 msgr2=0x7f33b013c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f33a000cd30 tx=0x7f33a0001ad0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 shutdown_connections 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f33b013ae40 0x7f33b00a9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f33b0063a70 0x7f33b013c730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 --2- 172.21.15.57:0/3840362587 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f33b006ef20 0x7f33b00a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 >> 172.21.15.57:0/3840362587 conn(0x7f33b006a4d0 msgr2=0x7f33b00ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 shutdown_connections 2024-03-18T14:47:32.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:32.888+0000 7f33b4979700 1 -- 172.21.15.57:0/3840362587 wait complete. 2024-03-18T14:47:32.901 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.023+0000 7f13e1e3c700 1 Processor -- start 2024-03-18T14:47:33.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.023+0000 7f13e1e3c700 1 -- start start 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13e1e3c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13e1e3c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13e1e3c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0a57f0 con 0x7f13dc0a5420 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13e1e3c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0a37c0 con 0x7f13dc0b0810 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13e1e3c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0a7470 con 0x7f13dc0a4790 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43434/0 (socket says 172.21.15.57:43434) 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49694/0 (socket says 172.21.15.57:49694) 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 -- 172.21.15.57:0/1894042795 learned_addr learned my addr 172.21.15.57:0/1894042795 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13db7fe700 1 --1- 172.21.15.57:0/1894042795 >> v1:172.21.15.57:6789/0 conn(0x7f13dc0a5420 0x7f13dc13fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58702/0 (socket says 172.21.15.57:58702) 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 -- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 msgr2=0x7f13dc146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13da7fc700 1 -- 172.21.15.57:0/1894042795 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267275716 0 0) 0x7f13dc0a57f0 con 0x7f13dc0a5420 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 -- 172.21.15.57:0/1894042795 >> v1:172.21.15.57:6789/0 conn(0x7f13dc0a5420 legacy=0x7f13dc13fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 -- 172.21.15.57:0/1894042795 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0a42c0 con 0x7f13dc0b0810 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13dbfff700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.024+0000 7f13daffd700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13d00099e0 tx=0x7f13d0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ff493c80466c4f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13da7fc700 1 -- 172.21.15.57:0/1894042795 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000b860 con 0x7f13dc0b0810 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13da7fc700 1 -- 172.21.15.57:0/1894042795 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d000b9c0 con 0x7f13dc0b0810 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13da7fc700 1 -- 172.21.15.57:0/1894042795 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d000bd60 con 0x7f13dc0b0810 2024-03-18T14:47:33.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 msgr2=0x7f13dc140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f13d00099e0 tx=0x7f13d0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1894042795 shutdown_connections 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0a4790 0x7f13dc146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1894042795 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0b0810 0x7f13dc140440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1894042795 >> 172.21.15.57:0/1894042795 conn(0x7f13dc06c150 msgr2=0x7f13dc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1894042795 shutdown_connections 2024-03-18T14:47:33.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.025+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1894042795 wait complete. 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.026+0000 7f13e1e3c700 1 Processor -- start 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.026+0000 7f13e1e3c700 1 -- start start 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 0x7f13dc0abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ac030 con 0x7f13dc0a5420 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ae930 con 0x7f13dc0a4790 2024-03-18T14:47:33.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13e1e3c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0ac290 con 0x7f13dc0b0810 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13daffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 0x7f13dc0abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:43438/0 (socket says 172.21.15.57:43438) 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 -- 172.21.15.57:0/1693681192 learned_addr learned my addr 172.21.15.57:0/1693681192 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13daffd700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34584/0 (socket says 172.21.15.57:34584) 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 -- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 msgr2=0x7f13dc0abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 0x7f13dc0abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 -- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 msgr2=0x7f13dc0ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13db7fe700 1 -- 172.21.15.57:0/1693681192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009a20 con 0x7f13dc0a4790 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13daffd700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.027+0000 7f13dbfff700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 0x7f13dc0abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13db7fe700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c810 tx=0x7f13cc007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc005b40 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc005cc0 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc007320 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00094f0 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.028+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc0ae230 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.029+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc065180 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.029+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f13cc01b3b0 con 0x7f13dc0a4790 2024-03-18T14:47:33.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.029+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f13cc05a670 con 0x7f13dc0a4790 2024-03-18T14:47:33.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.033+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f13cc0388f0 con 0x7f13dc0a4790 2024-03-18T14:47:33.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.192+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13dc06d430 con 0x7f13dc0a4790 2024-03-18T14:47:33.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.192+0000 7f13c37fe700 1 -- 172.21.15.57:0/1693681192 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13cc017020 con 0x7f13dc0a4790 2024-03-18T14:47:33.194 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 >> v1:172.21.15.57:6816/47480 conn(0x7f13c8046010 legacy=0x7f13c80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 msgr2=0x7f13dc0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c810 tx=0x7f13cc007d90 comp rx=0 tx=0).stop 2024-03-18T14:47:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 shutdown_connections 2024-03-18T14:47:33.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f13dc0b0810 0x7f13dc0abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f13dc0a4790 0x7f13dc0aee20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 --2- 172.21.15.57:0/1693681192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc0a5420 0x7f13dc0ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 >> 172.21.15.57:0/1693681192 conn(0x7f13dc06c150 msgr2=0x7f13dc067b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 shutdown_connections 2024-03-18T14:47:33.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.194+0000 7f13e1e3c700 1 -- 172.21.15.57:0/1693681192 wait complete. 2024-03-18T14:47:33.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:33.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.330+0000 7f0e6a296700 1 Processor -- start 2024-03-18T14:47:33.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.330+0000 7f0e6a296700 1 -- start start 2024-03-18T14:47:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e6a296700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e640a4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e6a296700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e6413e340 0x7f0e64148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e6a296700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e640b5b50 con 0x7f0e640a7590 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e6a296700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e640a4590 con 0x7f0e6413e340 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e6a296700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640a1d50 con 0x7f0e640b5780 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e68833700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e6413e340 0x7f0e64148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e640a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e637fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0e640a7590 0x7f0e6413dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58716/0 (socket says 172.21.15.57:58716) 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e637fe700 1 -- 172.21.15.57:0/1410401615 learned_addr learned my addr 172.21.15.57:0/1410401615 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e68833700 1 -- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 msgr2=0x7f0e640a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e68833700 1 --2- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e640a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e68833700 1 -- 172.21.15.57:0/1410401615 >> v1:172.21.15.57:6789/0 conn(0x7f0e640a7590 legacy=0x7f0e6413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.331+0000 7f0e68833700 1 -- 172.21.15.57:0/1410401615 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640a2010 con 0x7f0e6413e340 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e68833700 1 --2- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e6413e340 0x7f0e64148fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009e60 tx=0x7f0e5c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e027b1711bf8fc server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e62ffd700 1 -- 172.21.15.57:0/1410401615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c00e070 con 0x7f0e6413e340 2024-03-18T14:47:33.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e62ffd700 1 -- 172.21.15.57:0/1410401615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c00bb60 con 0x7f0e6413e340 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e62ffd700 1 -- 172.21.15.57:0/1410401615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c012430 con 0x7f0e6413e340 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 -- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e6413e340 msgr2=0x7f0e64148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 --2- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e6413e340 0x7f0e64148fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c009e60 tx=0x7f0e5c009780 comp rx=0 tx=0).stop 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 -- 172.21.15.57:0/1410401615 shutdown_connections 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 --2- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e6413e340 0x7f0e64148fb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 --2- 172.21.15.57:0/1410401615 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e640a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 -- 172.21.15.57:0/1410401615 >> 172.21.15.57:0/1410401615 conn(0x7f0e6406fb90 msgr2=0x7f0e640b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 -- 172.21.15.57:0/1410401615 shutdown_connections 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.332+0000 7f0e6a296700 1 -- 172.21.15.57:0/1410401615 wait complete. 2024-03-18T14:47:33.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.333+0000 7f0e6a296700 1 Processor -- start 2024-03-18T14:47:33.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.333+0000 7f0e6a296700 1 -- start start 2024-03-18T14:47:33.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e6413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 0x7f0e6413bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64099980 con 0x7f0e640a7590 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64142620 con 0x7f0e64141f80 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e6a296700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6413eee0 con 0x7f0e640b5780 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e6413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e63fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34606/0 (socket says 172.21.15.57:34606) 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e63fff700 1 -- 172.21.15.57:0/365967707 learned_addr learned my addr 172.21.15.57:0/365967707 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e68833700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 0x7f0e6413bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 -- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 msgr2=0x7f0e6413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 0x7f0e6413bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 -- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 msgr2=0x7f0e6409b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e637fe700 1 -- 172.21.15.57:0/365967707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c009a20 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e63fff700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.334+0000 7f0e68833700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 0x7f0e6413bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e637fe700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e6413b610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c470 tx=0x7f0e4c007f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c00ce10 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c005b30 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640a23f0 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0070d0 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.335+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6409bcc0 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.336+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e64065180 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.336+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0e4c0074c0 con 0x7f0e640b5780 2024-03-18T14:47:33.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.336+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0e4c05a500 con 0x7f0e640b5780 2024-03-18T14:47:33.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.340+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0e4c038720 con 0x7f0e640b5780 2024-03-18T14:47:33.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.504+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e640a47b0 con 0x7f0e640b5780 2024-03-18T14:47:33.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.504+0000 7f0e5bfff700 1 -- 172.21.15.57:0/365967707 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e4c017070 con 0x7f0e640b5780 2024-03-18T14:47:33.506 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 >> v1:172.21.15.57:6816/47480 conn(0x7f0e44046010 legacy=0x7f0e440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 msgr2=0x7f0e6413b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e6413b610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c00c470 tx=0x7f0e4c007f10 comp rx=0 tx=0).stop 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 shutdown_connections 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0e64141f80 0x7f0e6413bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e640a7590 0x7f0e6409b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 --2- 172.21.15.57:0/365967707 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0e640b5780 0x7f0e6413b610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 >> 172.21.15.57:0/365967707 conn(0x7f0e6406fb90 msgr2=0x7f0e6413e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 shutdown_connections 2024-03-18T14:47:33.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.506+0000 7f0e6a296700 1 -- 172.21.15.57:0/365967707 wait complete. 2024-03-18T14:47:33.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:33.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.639+0000 7f59e8db3700 1 Processor -- start 2024-03-18T14:47:33.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.639+0000 7f59e8db3700 1 -- start start 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e8db3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 0x7f59e40a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e8db3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e8db3700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59e413e710 con 0x7f59e40a3000 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e8db3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40a3ce0 con 0x7f59e40a2b90 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e8db3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e40a3ee0 con 0x7f59e4069450 2024-03-18T14:47:33.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e1d9b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56758/0 (socket says 172.21.15.57:56758) 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e259c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 0x7f59e40a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.640+0000 7f59e1d9b700 1 -- 172.21.15.57:0/228804299 learned_addr learned my addr 172.21.15.57:0/228804299 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e159a700 1 -- 172.21.15.57:0/228804299 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773729973 0 0) 0x7f59e413e710 con 0x7f59e40a3000 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e1d9b700 1 -- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 msgr2=0x7f59e40a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e1d9b700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 0x7f59e40a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e1d9b700 1 -- 172.21.15.57:0/228804299 >> v1:172.21.15.57:6789/0 conn(0x7f59e40a3000 legacy=0x7f59e406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e1d9b700 1 -- 172.21.15.57:0/228804299 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e40a3520 con 0x7f59e40a2b90 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e259c700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 0x7f59e40a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e1d9b700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59d80099e0 tx=0x7f59d8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c93a8ddb2197dac server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e159a700 1 -- 172.21.15.57:0/228804299 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800b860 con 0x7f59e40a2b90 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e159a700 1 -- 172.21.15.57:0/228804299 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d800b9c0 con 0x7f59e40a2b90 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e159a700 1 -- 172.21.15.57:0/228804299 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d800bd60 con 0x7f59e40a2b90 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e8db3700 1 -- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 msgr2=0x7f59e413eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.641+0000 7f59e8db3700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59d80099e0 tx=0x7f59d8009250 comp rx=0 tx=0).stop 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 -- 172.21.15.57:0/228804299 shutdown_connections 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e4069450 0x7f59e40a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 --2- 172.21.15.57:0/228804299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e40a2b90 0x7f59e413eec0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 -- 172.21.15.57:0/228804299 >> 172.21.15.57:0/228804299 conn(0x7f59e406af40 msgr2=0x7f59e4068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 -- 172.21.15.57:0/228804299 shutdown_connections 2024-03-18T14:47:33.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 -- 172.21.15.57:0/228804299 wait complete. 2024-03-18T14:47:33.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.642+0000 7f59e8db3700 1 Processor -- start 2024-03-18T14:47:33.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 -- start start 2024-03-18T14:47:33.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 0x7f59e4141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4141e50 con 0x7f59e40a3000 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59e4135900 con 0x7f59e4069450 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e8db3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59e413ded0 con 0x7f59e40a2b90 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e1d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e259c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56768/0 (socket says 172.21.15.57:56768) 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e259c700 1 -- 172.21.15.57:0/3241520268 learned_addr learned my addr 172.21.15.57:0/3241520268 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e1d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49540/0 (socket says 172.21.15.57:49540) 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.643+0000 7f59e2d9d700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 0x7f59e4141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 -- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 msgr2=0x7f59e4140d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 -- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 msgr2=0x7f59e4141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 0x7f59e4141250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 -- 172.21.15.57:0/3241520268 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009420 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e2d9d700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 0x7f59e4141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e1d9b700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e259c700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59d400ecb0 tx=0x7f59d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400c920 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d400ca80 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80094f0 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d400ce00 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.644+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e4139590 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.645+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e4065180 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.645+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f59d4013680 con 0x7f59e4069450 2024-03-18T14:47:33.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.645+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f59d405b890 con 0x7f59e4069450 2024-03-18T14:47:33.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.649+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f59d4039c60 con 0x7f59e4069450 2024-03-18T14:47:33.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.840+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59e4068fe0 con 0x7f59e4069450 2024-03-18T14:47:33.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.841+0000 7f59d27fc700 1 -- 172.21.15.57:0/3241520268 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3668 (secure 0 0 0) 0x7f59d403d240 con 0x7f59e4069450 2024-03-18T14:47:33.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:33.843 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/3316946905","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":3316946905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":14420,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6819/2165512544","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2165512544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:47:27.421839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14431},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14431":{"gid":14431,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6818/4018842639","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":4018842639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 >> v1:172.21.15.57:6816/47480 conn(0x7f59c4046010 legacy=0x7f59c40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 msgr2=0x7f59e413d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f59d400ecb0 tx=0x7f59d40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 shutdown_connections 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e40a3000 0x7f59e4141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f59e4069450 0x7f59e413d500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 --2- 172.21.15.57:0/3241520268 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f59e40a2b90 0x7f59e4140d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.842+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 >> 172.21.15.57:0/3241520268 conn(0x7f59e406af40 msgr2=0x7f59e41460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.843+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 shutdown_connections 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.843+0000 7f59e8db3700 1 -- 172.21.15.57:0/3241520268 wait complete. 2024-03-18T14:47:33.845 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2024-03-18T14:47:33.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.975+0000 7fe3cbd64700 1 Processor -- start 2024-03-18T14:47:33.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.975+0000 7fe3cbd64700 1 -- start start 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3cbd64700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 0x7fe3c4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3cbd64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c406eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3cbd64700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3c406a790 con 0x7fe3c406f040 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3cbd64700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40b0520 con 0x7fe3c4068340 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3cbd64700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40a35f0 con 0x7fe3c40a42d0 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c406eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3ca301700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe3c406f040 0x7fe3c41485a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36530/0 (socket says 172.21.15.57:36530) 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3ca301700 1 -- 172.21.15.57:0/898047584 learned_addr learned my addr 172.21.15.57:0/898047584 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:33.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c9b00700 1 --2- 172.21.15.57:0/898047584 >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 0x7fe3c4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 -- 172.21.15.57:0/898047584 >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 msgr2=0x7fe3c4069e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 --2- 172.21.15.57:0/898047584 >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 0x7fe3c4069e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c8afe700 1 -- 172.21.15.57:0/898047584 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138956987 0 0) 0x7fe3c406a790 con 0x7fe3c406f040 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 -- 172.21.15.57:0/898047584 >> v1:172.21.15.57:6789/0 conn(0x7fe3c406f040 legacy=0x7fe3c41485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 -- 172.21.15.57:0/898047584 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c406c6e0 con 0x7fe3c40a42d0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c9b00700 1 --2- 172.21.15.57:0/898047584 >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 0x7fe3c4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c92ff700 1 --2- 172.21.15.57:0/898047584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c406eb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40098e0 tx=0x7fe3b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62513d9a7e038b41 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c8afe700 1 -- 172.21.15.57:0/898047584 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400b640 con 0x7fe3c40a42d0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c8afe700 1 -- 172.21.15.57:0/898047584 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b400b7a0 con 0x7fe3c40a42d0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.976+0000 7fe3c8afe700 1 -- 172.21.15.57:0/898047584 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b400bb40 con 0x7fe3c40a42d0 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 -- 172.21.15.57:0/898047584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 msgr2=0x7fe3c406eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/898047584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c406eb00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe3b40098e0 tx=0x7fe3b40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 -- 172.21.15.57:0/898047584 shutdown_connections 2024-03-18T14:47:33.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/898047584 >> v2:172.21.15.57:3300/0 conn(0x7fe3c4068340 0x7fe3c4069e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/898047584 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c406eb00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 -- 172.21.15.57:0/898047584 >> 172.21.15.57:0/898047584 conn(0x7fe3c406bf20 msgr2=0x7fe3c40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:33.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 -- 172.21.15.57:0/898047584 shutdown_connections 2024-03-18T14:47:33.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.977+0000 7fe3cbd64700 1 -- 172.21.15.57:0/898047584 wait complete. 2024-03-18T14:47:33.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.978+0000 7fe3cbd64700 1 Processor -- start 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.978+0000 7fe3cbd64700 1 -- start start 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.978+0000 7fe3cbd64700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3c406f040 0x7fe3c4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c4097970 con 0x7fe3c406f040 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40ae290 con 0x7fe3c40a42d0 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c40abba0 con 0x7fe3c4068340 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49552/0 (socket says 172.21.15.57:49552) 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3ca301700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 -- 172.21.15.57:0/642496718 learned_addr learned my addr 172.21.15.57:0/642496718 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:33.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c92ff700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3c406f040 0x7fe3c4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 -- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 msgr2=0x7fe3c4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 -- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3c406f040 msgr2=0x7fe3c4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3c406f040 0x7fe3c4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 -- 172.21.15.57:0/642496718 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c0009420 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3ca301700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3c9b00700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000ec80 tx=0x7fe3c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000c9b0 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000cb10 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3b4009420 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.979+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000ce90 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.980+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c4097c00 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.980+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c4065180 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.981+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe3c0013680 con 0x7fe3c4068340 2024-03-18T14:47:33.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.981+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe3c005be00 con 0x7fe3c4068340 2024-03-18T14:47:33.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:33.984+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fe3c0039fa0 con 0x7fe3c4068340 2024-03-18T14:47:34.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.146+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3c4068fb0 con 0x7fe3c4068340 2024-03-18T14:47:34.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.147+0000 7fe3b9ffb700 1 -- 172.21.15.57:0/642496718 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11631 (secure 0 0 0) 0x7fe3c003d790 con 0x7fe3c4068340 2024-03-18T14:47:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:34.149 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":41,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:24.703821+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 >> v1:172.21.15.57:6816/47480 conn(0x7fe3a8046090 legacy=0x7fe3a8048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 msgr2=0x7fe3c40983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe3c000ec80 tx=0x7fe3c00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 shutdown_connections 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe3c40a42d0 0x7fe3c4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe3c4068340 0x7fe3c40983f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 --2- 172.21.15.57:0/642496718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3c406f040 0x7fe3c4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 >> 172.21.15.57:0/642496718 conn(0x7fe3c406bf20 msgr2=0x7fe3c4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 shutdown_connections 2024-03-18T14:47:34.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.149+0000 7fe3cbd64700 1 -- 172.21.15.57:0/642496718 wait complete. 2024-03-18T14:47:34.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.282+0000 7fbdcdbdc700 1 Processor -- start 2024-03-18T14:47:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.282+0000 7fbdcdbdc700 1 -- start start 2024-03-18T14:47:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdcdbdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 0x7fbdc80a3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdcdbdc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 0x7fbdc806e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdcdbdc700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80a3440 con 0x7fbdc80679e0 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdcdbdc700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc80a36e0 con 0x7fbdc806e370 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdcdbdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc80a2a00 con 0x7fbdc8069450 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 0x7fbdc80a3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc6ffd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 0x7fbdc806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbdc80679e0 0x7fbdc8067e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36532/0 (socket says 172.21.15.57:36532) 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc7fff700 1 -- 172.21.15.57:0/2066547851 learned_addr learned my addr 172.21.15.57:0/2066547851 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 -- 172.21.15.57:0/2066547851 >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 msgr2=0x7fbdc806e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 --2- 172.21.15.57:0/2066547851 >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 0x7fbdc806e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 -- 172.21.15.57:0/2066547851 >> v1:172.21.15.57:6789/0 conn(0x7fbdc80679e0 legacy=0x7fbdc8067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 -- 172.21.15.57:0/2066547851 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc806f3c0 con 0x7fbdc8069450 2024-03-18T14:47:34.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc6ffd700 1 --2- 172.21.15.57:0/2066547851 >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 0x7fbdc806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc67fc700 1 -- 172.21.15.57:0/2066547851 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398772688 0 0) 0x7fbdc80a3440 con 0x7fbdc80679e0 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.283+0000 7fbdc77fe700 1 --2- 172.21.15.57:0/2066547851 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 0x7fbdc80a3e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50db308b093482b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdc67fc700 1 -- 172.21.15.57:0/2066547851 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800b640 con 0x7fbdc8069450 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdc67fc700 1 -- 172.21.15.57:0/2066547851 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800b7a0 con 0x7fbdc8069450 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdc67fc700 1 -- 172.21.15.57:0/2066547851 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800bb40 con 0x7fbdc8069450 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/2066547851 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 msgr2=0x7fbdc80a3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/2066547851 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 0x7fbdc80a3e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/2066547851 shutdown_connections 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/2066547851 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc8069450 0x7fbdc80a3e60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/2066547851 >> v2:172.21.15.57:3300/0 conn(0x7fbdc806e370 0x7fbdc806e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/2066547851 >> 172.21.15.57:0/2066547851 conn(0x7fbdc806ce10 msgr2=0x7fbdc8068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/2066547851 shutdown_connections 2024-03-18T14:47:34.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.284+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/2066547851 wait complete. 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.285+0000 7fbdcdbdc700 1 Processor -- start 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.285+0000 7fbdcdbdc700 1 -- start start 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdc80679e0 0x7fbdc809dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc806e370 0x7fbdc809c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc809d3a0 con 0x7fbdc8069450 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc809fb80 con 0x7fbdc80679e0 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdcdbdc700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc809ba90 con 0x7fbdc806e370 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc7fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc806e370 0x7fbdc809c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34168/0 (socket says 172.21.15.57:34168) 2024-03-18T14:47:34.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 -- 172.21.15.57:0/211707062 learned_addr learned my addr 172.21.15.57:0/211707062 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc77fe700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdc80679e0 0x7fbdc809dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 -- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc806e370 msgr2=0x7fbdc809c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc806e370 0x7fbdc809c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 -- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdc80679e0 msgr2=0x7fbdc809dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdc80679e0 0x7fbdc809dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 -- 172.21.15.57:0/211707062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb0009420 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.286+0000 7fbdc6ffd700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000ec50 tx=0x7fbdb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.287+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000c850 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.287+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb000c9b0 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.287+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb8009420 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.287+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000cd50 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.287+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc809cf10 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.288+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc809c6f0 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.288+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbdb0013680 con 0x7fbdc8069450 2024-03-18T14:47:34.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.288+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fbdb005b3f0 con 0x7fbdc8069450 2024-03-18T14:47:34.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.292+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fbdc809c6f0 con 0x7fbdc8069450 2024-03-18T14:47:34.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.486+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdc809c6f0 con 0x7fbdc8069450 2024-03-18T14:47:34.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.486+0000 7fbdbf7fe700 1 -- 172.21.15.57:0/211707062 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+3668 (secure 0 0 0) 0x7fbdc809c6f0 con 0x7fbdc8069450 2024-03-18T14:47:34.488 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:34.488 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/3316946905","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":3316946905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":14420,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6819/2165512544","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2165512544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:47:27.421839+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14431},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14431":{"gid":14431,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6818/4018842639","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":4018842639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 >> v1:172.21.15.57:6816/47480 conn(0x7fbda8046010 legacy=0x7fbda80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 msgr2=0x7fbdc809ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000ec50 tx=0x7fbdb00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 shutdown_connections 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbdc806e370 0x7fbdc809c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbdc80679e0 0x7fbdc809dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 --2- 172.21.15.57:0/211707062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbdc8069450 0x7fbdc809ee30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 >> 172.21.15.57:0/211707062 conn(0x7fbdc806ce10 msgr2=0x7fbdc80648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.488+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 shutdown_connections 2024-03-18T14:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.489+0000 7fbdcdbdc700 1 -- 172.21.15.57:0/211707062 wait complete. 2024-03-18T14:47:34.491 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2024-03-18T14:47:34.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T14:41:13.448406+0000', 'modified': '2024-03-18T14:47:27.421839+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 35, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14431}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_14431': {'gid': 14431, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.57:6818/4018842639', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.57:6818', 'nonce': 4018842639}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-03-18T14:47:34.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T14:47:34.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-18T14:47:34.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.928+0000 7faf0f5d3700 1 Processor -- start 2024-03-18T14:47:34.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 -- start start 2024-03-18T14:47:34.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf08063d10 0x7faf08069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf080a35f0 con 0x7faf08063d10 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0806a900 con 0x7faf0806a470 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0f5d3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf08068a70 con 0x7faf080a42b0 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0cb6e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0d36f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf08063d10 0x7faf08069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0db70700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0db70700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49590/0 (socket says 172.21.15.57:49590) 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0d36f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf08063d10 0x7faf08069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34172/0 (socket says 172.21.15.57:34172) 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0cb6e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56796/0 (socket says 172.21.15.57:56796) 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.929+0000 7faf0db70700 1 -- 172.21.15.57:0/3175186785 learned_addr learned my addr 172.21.15.57:0/3175186785 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 -- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 msgr2=0x7faf0806efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 -- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 msgr2=0x7faf0806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 -- 172.21.15.57:0/3175186785 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf080640e0 con 0x7faf08063d10 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0db70700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faf0d36f700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf08069f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faefc0098e0 tx=0x7faefc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d76d8121504ca3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faefbfff700 1 -- 172.21.15.57:0/3175186785 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011630 con 0x7faf08063d10 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faefbfff700 1 -- 172.21.15.57:0/3175186785 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc011790 con 0x7faf08063d10 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.930+0000 7faefbfff700 1 -- 172.21.15.57:0/3175186785 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011b30 con 0x7faf08063d10 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 -- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 msgr2=0x7faf08069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf08069f30 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faefc0098e0 tx=0x7faefc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 -- 172.21.15.57:0/3175186785 shutdown_connections 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf080a42b0 0x7faf0806efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf08069f30 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/3175186785 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf0806a470 0x7faf0806ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 -- 172.21.15.57:0/3175186785 >> 172.21.15.57:0/3175186785 conn(0x7faf0806de00 msgr2=0x7faf08063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 -- 172.21.15.57:0/3175186785 shutdown_connections 2024-03-18T14:47:34.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.931+0000 7faf0f5d3700 1 -- 172.21.15.57:0/3175186785 wait complete. 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 Processor -- start 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 -- start start 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 0x7faf081418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0809b700 con 0x7faf08063d10 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf08096e90 con 0x7faf080a42b0 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0f5d3700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf0809b900 con 0x7faf0806a470 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0cb6e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0db70700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 0x7faf081418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0cb6e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49600/0 (socket says 172.21.15.57:49600) 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0cb6e700 1 -- 172.21.15.57:0/1330691563 learned_addr learned my addr 172.21.15.57:0/1330691563 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34186/0 (socket says 172.21.15.57:34186) 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.932+0000 7faf0db70700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 0x7faf081418b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56798/0 (socket says 172.21.15.57:56798) 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 -- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 msgr2=0x7faf080997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 -- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 msgr2=0x7faf081418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 0x7faf081418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 -- 172.21.15.57:0/1330691563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009420 con 0x7faf08063d10 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0d36f700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faefc016000 tx=0x7faefc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faef97fa700 1 -- 172.21.15.57:0/1330691563 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc000d10 con 0x7faf08063d10 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faef97fa700 1 -- 172.21.15.57:0/1330691563 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc011b10 con 0x7faf08063d10 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf00009ae0 con 0x7faf08063d10 2024-03-18T14:47:34.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faef97fa700 1 -- 172.21.15.57:0/1330691563 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc025660 con 0x7faf08063d10 2024-03-18T14:47:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.933+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc009420 con 0x7faf08063d10 2024-03-18T14:47:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.934+0000 7faef97fa700 1 -- 172.21.15.57:0/1330691563 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7faefc025a10 con 0x7faf08063d10 2024-03-18T14:47:34.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.934+0000 7faef97fa700 1 -- 172.21.15.57:0/1330691563 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7faefc05c8d0 con 0x7faf08063d10 2024-03-18T14:47:34.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.937+0000 7faf188e8b80 1 Processor -- start 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.937+0000 7faf188e8b80 1 -- start start 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed000a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e4ec227b0 con 0x561e4eccca80 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e4ec20170 con 0x561e4eccd150 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x561e4ec1bf60 con 0x561e4eceac10 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34192/0 (socket says 172.21.15.57:34192) 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 -- 172.21.15.57:0/468494635 learned_addr learned my addr 172.21.15.57:0/468494635 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0db70700 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 -- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 msgr2=0x561e4ecffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 -- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 msgr2=0x561e4ed000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 -- 172.21.15.57:0/468494635 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e4ea98040 con 0x561e4eccca80 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faf0d36f700 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faefc009f50 tx=0x7faefc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6faeee32cc9ef16 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faef27fc700 1 -- 172.21.15.57:0/468494635 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc048070 con 0x561e4eccca80 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faef27fc700 1 -- 172.21.15.57:0/468494635 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc01deb0 con 0x561e4eccca80 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.938+0000 7faef27fc700 1 -- 172.21.15.57:0/468494635 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc005a00 con 0x561e4eccca80 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 msgr2=0x561e4eccb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faefc009f50 tx=0x7faefc012000 comp rx=0 tx=0).stop 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- 172.21.15.57:0/468494635 shutdown_connections 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eccb8c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 --2- 172.21.15.57:0/468494635 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- 172.21.15.57:0/468494635 >> 172.21.15.57:0/468494635 conn(0x561e4ecca3a0 msgr2=0x561e4eccd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- 172.21.15.57:0/468494635 shutdown_connections 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- 172.21.15.57:0/468494635 wait complete. 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.939+0000 7faf188e8b80 1 -- start start 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 Processor -- start 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ed06b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e4ebc6d70 con 0x561e4eceac10 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e4ebc6a10 con 0x561e4eccd150 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x561e4eb14290 con 0x561e4eccca80 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf188e8b80 10 client.0 _ll_register_callbacks cb 0x561e4ebc8e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49626/0 (socket says 172.21.15.57:49626) 2024-03-18T14:47:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf0d36f700 1 -- 172.21.15.57:0/4236573880 learned_addr learned my addr 172.21.15.57:0/4236573880 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.940+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0db70700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ed06b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 -- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 msgr2=0x561e4ed065f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed065f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 -- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 msgr2=0x561e4ed06b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ed06b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 -- 172.21.15.57:0/4236573880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc009420 con 0x561e4eccca80 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0db70700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ed06b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf0d36f700 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faefc02ff90 tx=0x7faefc013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5752fe14b62b0f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3302/0 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc02f3d0 con 0x561e4eccca80 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mon.2 v2:172.21.15.57:3302/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7faefc04a2d0 con 0x561e4eccca80 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e4ec45690 con 0x561e4eccca80 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faefc0413b0 con 0x561e4eccca80 2024-03-18T14:47:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf188e8b80 10 client.14672 fetch_fsmap learned FSMap version 22 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,fsmap=22,monmap=3+}) v3 -- 0x561e4ea5a230 con 0x561e4eccca80 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.941+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mon.2 v2:172.21.15.57:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561e4ec45690 con 0x561e4eccca80 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mon.2 v2:172.21.15.57:3302/0 5 ==== fsmap(e 22) v1 ==== 2454+0+0 (secure 0 0 0) 0x7faefc04a6c0 con 0x561e4eccca80 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faf188e8b80 10 client.14672 fetch_fsmap finished waiting for FSMap version 22 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faf188e8b80 10 client.14672 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faf188e8b80 20 client.14672 populate_metadata read hostname 'smithi057' 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faf188e8b80 4 client.14672 mds_command: new command op to 14431 tid=0[{"prefix": "get_command_descriptions"}] 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 --> v1:172.21.15.57:6818/4018842639 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e4ebbe0e0 con 0x561e4ed09bf0 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.942+0000 7faee77fe700 10 client.14672 ms_handle_connect on v1:172.21.15.57:6818/4018842639 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faee77fe700 1 -- 172.21.15.57:0/4236573880 <== mds.0 v1:172.21.15.57:6818/4018842639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17146 (unknown 0 0 428609513) 0x561e4ebbe0e0 con 0x561e4ed09bf0 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faee77fe700 10 client.14672 handle_command_reply: tid=0 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 client.14672 shutdown 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 msgr2=0x561e4ecf5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faefc02ff90 tx=0x7faefc013000 comp rx=0 tx=0).stop 2024-03-18T14:47:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 shutdown_connections 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ed06b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccca80 0x561e4ecf5dc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 --2- 172.21.15.57:0/4236573880 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ed065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faee77fe700 0 client.14672 ms_handle_reset on v1:172.21.15.57:6818/4018842639 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 >> 172.21.15.57:0/4236573880 conn(0x561e4ecca3a0 msgr2=0x561e4ecc9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 shutdown_connections 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 1 -- 172.21.15.57:0/4236573880 wait complete. 2024-03-18T14:47:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.943+0000 7faf188e8b80 20 client.14672 trim_cache size 0 max 16384 2024-03-18T14:47:34.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 Processor -- start 2024-03-18T14:47:34.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 -- start start 2024-03-18T14:47:34.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ecc8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecc9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e4ed06210 con 0x561e4eccca80 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e4ec45690 con 0x561e4eccd150 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x561e4ecf26f0 con 0x561e4eceac10 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.960+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34206/0 (socket says 172.21.15.57:34206) 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ecc8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0d36f700 1 -- 172.21.15.57:0/130433725 learned_addr learned my addr 172.21.15.57:0/130433725 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0db70700 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecc9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 -- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 msgr2=0x561e4ecc9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecc9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 -- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 msgr2=0x561e4eceb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 -- 172.21.15.57:0/130433725 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e4ed03bb0 con 0x561e4eccd150 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0d36f700 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ecc8210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x561e4ecca840 tx=0x7faf04008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20c180f5fced8c5c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faef2ffd700 1 -- 172.21.15.57:0/130433725 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0401c070 con 0x561e4eccd150 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faef2ffd700 1 -- 172.21.15.57:0/130433725 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf04017e00 con 0x561e4eccd150 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.961+0000 7faef2ffd700 1 -- 172.21.15.57:0/130433725 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040172e0 con 0x561e4eccd150 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 msgr2=0x561e4ecc8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ecc8210 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x561e4ecca840 tx=0x7faf04008040 comp rx=0 tx=0).stop 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- 172.21.15.57:0/130433725 shutdown_connections 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eceac10 0x561e4ecc9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eccca80 0x561e4eceb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 --2- 172.21.15.57:0/130433725 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccd150 0x561e4ecc8210 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- 172.21.15.57:0/130433725 >> 172.21.15.57:0/130433725 conn(0x561e4ecca3a0 msgr2=0x561e4eced210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- 172.21.15.57:0/130433725 shutdown_connections 2024-03-18T14:47:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- 172.21.15.57:0/130433725 wait complete. 2024-03-18T14:47:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 -- start start 2024-03-18T14:47:34.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.962+0000 7faf188e8b80 1 Processor -- start 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccd150 0x561e4eceb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ecebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e4ed329e0 con 0x561e4eceac10 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x561e4ecf06a0 con 0x561e4eccca80 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x561e4ecf1090 con 0x561e4eccd150 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf188e8b80 10 client.0 _ll_register_callbacks cb 0x7faf080a3440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56854/0 (socket says 172.21.15.57:56854) 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 -- 172.21.15.57:0/2202667006 learned_addr learned my addr 172.21.15.57:0/2202667006 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0db70700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ecebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0cb6e700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccd150 0x561e4eceb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:34.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 -- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccd150 msgr2=0x561e4eceb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccd150 0x561e4eceb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 -- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 msgr2=0x561e4ecebe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ecebe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0d36f700 1 -- 172.21.15.57:0/2202667006 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc009420 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.963+0000 7faf0db70700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ecebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf0d36f700 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faefc023fe0 tx=0x7faefc037000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442679afe36547bb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.57:3301/0 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0413b0 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mon.1 v2:172.21.15.57:3301/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7faefc005a00 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faefc01deb0 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7faefc04a2d0 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 10 client.14671 fetch_fsmap learned FSMap version 22 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,fsmap=22,monmap=3+}) v3 -- 0x7faf04017440 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mon.1 v2:172.21.15.57:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc01deb0 con 0x561e4eccca80 2024-03-18T14:47:34.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mon.1 v2:172.21.15.57:3301/0 5 ==== fsmap(e 22) v1 ==== 2454+0+0 (secure 0 0 0) 0x7faefc04a6c0 con 0x561e4eccca80 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 10 client.14671 fetch_fsmap finished waiting for FSMap version 22 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 10 client.14671 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 20 client.14671 populate_metadata read hostname 'smithi057' 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 4 client.14671 mds_command: new command op to 14431 tid=0[{"prefix": "status"}] 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 --> v1:172.21.15.57:6818/4018842639 -- command(tid 0: {"prefix": "status"}) v1 -- 0x561e4ea7d100 con 0x561e4ed57a30 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.964+0000 7faee77fe700 10 client.14671 ms_handle_connect on v1:172.21.15.57:6818/4018842639 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faee77fe700 1 -- 172.21.15.57:0/2202667006 <== mds.0 v1:172.21.15.57:6818/4018842639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (unknown 0 0 3837164850) 0x561e4ea7d100 con 0x561e4ed57a30 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faee77fe700 10 client.14671 handle_command_reply: tid=0 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 client.14671 shutdown 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 msgr2=0x561e4ed324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7faefc023fe0 tx=0x7faefc037000 comp rx=0 tx=0).stop 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 shutdown_connections 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x561e4eceac10 0x561e4ecebe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x561e4eccca80 0x561e4ed324a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faee77fe700 0 client.14671 ms_handle_reset on v1:172.21.15.57:6818/4018842639 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 --2- 172.21.15.57:0/2202667006 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x561e4eccd150 0x561e4eceb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 >> 172.21.15.57:0/2202667006 conn(0x561e4ecca3a0 msgr2=0x561e4eccd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 shutdown_connections 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 1 -- 172.21.15.57:0/2202667006 wait complete. 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.965+0000 7faf188e8b80 20 client.14671 trim_cache size 0 max 16384 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "347a5fae-6424-47b3-8c67-8d3421f1b0dd", 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 14431, 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:47:34.972 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 16.321118303999999, 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 22, 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 41, 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 41, 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 16.488458494 2024-03-18T14:47:34.973 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 >> v1:172.21.15.57:6816/47480 conn(0x7faeec046010 legacy=0x7faeec0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 msgr2=0x7faf0809ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faefc016000 tx=0x7faefc017000 comp rx=0 tx=0).stop 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 shutdown_connections 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7faf080a42b0 0x7faf081418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf08063d10 0x7faf0809ab80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 --2- 172.21.15.57:0/1330691563 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7faf0806a470 0x7faf080997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 >> 172.21.15.57:0/1330691563 conn(0x7faf0806de00 msgr2=0x7faf0806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 shutdown_connections 2024-03-18T14:47:34.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:34.966+0000 7faf0f5d3700 1 -- 172.21.15.57:0/1330691563 wait complete. 2024-03-18T14:47:34.979 INFO:teuthology.run_tasks:Running task print... 2024-03-18T14:47:34.990 INFO:teuthology.task.print:**** done ceph.restart 2024-03-18T14:47:34.990 INFO:teuthology.run_tasks:Running task exec... 2024-03-18T14:47:35.015 INFO:teuthology.task.exec:Executing custom commands... 2024-03-18T14:47:35.015 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:47:35.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump --format=json-pretty' 2024-03-18T14:47:35.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.131+0000 7feaa331e700 1 Processor -- start 2024-03-18T14:47:35.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 -- start start 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c0635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea9c06f430 con 0x7fea9c142300 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c1417c0 con 0x7fea9c141ed0 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa331e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c06f630 con 0x7fea9c06eac0 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa18bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa10ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa08b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c0635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa18bb700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34222/0 (socket says 172.21.15.57:34222) 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.132+0000 7feaa18bb700 1 -- 172.21.15.57:0/1694608833 learned_addr learned my addr 172.21.15.57:0/1694608833 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 -- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 msgr2=0x7fea9c0635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 --2- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c0635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 -- 172.21.15.57:0/1694608833 >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 msgr2=0x7fea9c063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 --2- 172.21.15.57:0/1694608833 >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 -- 172.21.15.57:0/1694608833 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c0b1d30 con 0x7fea9c06eac0 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa18bb700 1 --2- 172.21.15.57:0/1694608833 >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7feaa10ba700 1 --2- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098e0 tx=0x7fea8c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6854c8c00b3dfac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:35.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7fea93fff700 1 -- 172.21.15.57:0/1694608833 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c011630 con 0x7fea9c06eac0 2024-03-18T14:47:35.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7fea93fff700 1 -- 172.21.15.57:0/1694608833 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c011790 con 0x7fea9c06eac0 2024-03-18T14:47:35.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.133+0000 7fea93fff700 1 -- 172.21.15.57:0/1694608833 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c011b30 con 0x7fea9c06eac0 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 -- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 msgr2=0x7fea9c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 --2- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c06d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea8c0098e0 tx=0x7fea8c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 -- 172.21.15.57:0/1694608833 shutdown_connections 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 --2- 172.21.15.57:0/1694608833 >> v2:172.21.15.57:3300/0 conn(0x7fea9c142300 0x7fea9c063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 --2- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c06d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 --2- 172.21.15.57:0/1694608833 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c0635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 -- 172.21.15.57:0/1694608833 >> 172.21.15.57:0/1694608833 conn(0x7fea9c069910 msgr2=0x7fea9c069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 -- 172.21.15.57:0/1694608833 shutdown_connections 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.134+0000 7feaa331e700 1 -- 172.21.15.57:0/1694608833 wait complete. 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 Processor -- start 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 -- start start 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea9c142300 0x7fea9c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0994f0 con 0x7fea9c142300 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c099230 con 0x7fea9c141ed0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa331e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea9c0a3360 con 0x7fea9c06eac0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa10ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa10ba700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49660/0 (socket says 172.21.15.57:49660) 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa10ba700 1 -- 172.21.15.57:0/3741568521 learned_addr learned my addr 172.21.15.57:0/3741568521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.135+0000 7feaa08b9700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa18bb700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea9c142300 0x7fea9c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 -- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 msgr2=0x7fea9c151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 -- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea9c142300 msgr2=0x7fea9c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea9c142300 0x7fea9c151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 -- 172.21.15.57:0/3741568521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea94009ae0 con 0x7fea9c06eac0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa10ba700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06f7c0 tx=0x7fea8c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c000d10 con 0x7fea9c06eac0 2024-03-18T14:47:35.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c011b10 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c009420 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c025660 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.136+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9c06db90 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.137+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9c04c710 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.137+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fea8c025a10 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.137+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fea8c05c950 con 0x7fea9c06eac0 2024-03-18T14:47:35.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.141+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fea8c007e50 con 0x7fea9c06eac0 2024-03-18T14:47:35.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.333+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "fs dump", "format": "json-pretty"} v 0) v1 -- 0x7fea9c06d560 con 0x7fea9c06eac0 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.333+0000 7fea917fa700 1 -- 172.21.15.57:0/3741568521 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json-pretty"}]=0 dumped fsmap epoch 22 v22) v1 ==== 101+0+7631 (secure 0 0 0) 0x7fea8c02f910 con 0x7fea9c06eac0 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 22, 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "default_fscid": 1, 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": { 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": {}, 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "ro_compat": {}, 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "incompat": { 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_1": "base v0.20", 2024-03-18T14:47:35.335 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_2": "client writeable ranges", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_3": "default file layouts on dirs", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_4": "dir inode in separate object", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_5": "mds uses versioned encoding", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_6": "dirfrag is stored in omap", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_8": "no anchor table", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_9": "file layout v2", 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_10": "snaprealm v2" 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_flags": { 2024-03-18T14:47:35.336 INFO:teuthology.orchestra.run.smithi057.stdout: "enable_multiple": false, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "ever_enabled_multiple": true 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "standbys": [ 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "gid": 14414, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "b", 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "rank": -1, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "incarnation": 0, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:standby", 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "state_seq": 1, 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817/3316946905", 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "addrs": { 2024-03-18T14:47:35.337 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6817", 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 3316946905 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "join_fscid": -1, 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "export_targets": [], 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 0, 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": { 2024-03-18T14:47:35.338 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": {}, 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "ro_compat": {}, 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "incompat": { 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_1": "base v0.20", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_2": "client writeable ranges", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_3": "default file layouts on dirs", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_4": "dir inode in separate object", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_5": "mds uses versioned encoding", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_6": "dirfrag is stored in omap", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_7": "mds uses inline data", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_8": "no anchor table", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_9": "file layout v2", 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_10": "snaprealm v2" 2024-03-18T14:47:35.339 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 19 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "gid": 14420, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "a", 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "rank": -1, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "incarnation": 0, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:standby", 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "state_seq": 1, 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819/2165512544", 2024-03-18T14:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout: "addrs": { 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6819", 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2165512544 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "join_fscid": -1, 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "export_targets": [], 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 0, 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": { 2024-03-18T14:47:35.341 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": {}, 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "ro_compat": {}, 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "incompat": { 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_1": "base v0.20", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_2": "client writeable ranges", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_3": "default file layouts on dirs", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_4": "dir inode in separate object", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_5": "mds uses versioned encoding", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_6": "dirfrag is stored in omap", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_7": "mds uses inline data", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_8": "no anchor table", 2024-03-18T14:47:35.342 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_9": "file layout v2", 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_10": "snaprealm v2" 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 18 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "filesystems": [ 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap": { 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "epoch": 22, 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 18, 2024-03-18T14:47:35.343 INFO:teuthology.orchestra.run.smithi057.stdout: "flags_state": { 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "joinable": true, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_snaps": true, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_multimds_snaps": true, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "allow_standby_replay": false 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "ever_allowed_features": 0, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "explicitly_allowed_features": 0, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "created": "2024-03-18T14:41:13.448406+0000", 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "modified": "2024-03-18T14:47:27.421839+0000", 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "tableserver": 0, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "root": 0, 2024-03-18T14:47:35.344 INFO:teuthology.orchestra.run.smithi057.stdout: "session_timeout": 60, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "session_autoclose": 300, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "required_client_features": {}, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "max_file_size": 1099511627776, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "last_failure": 0, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "last_failure_osd_epoch": 35, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": { 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": {}, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "ro_compat": {}, 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "incompat": { 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_1": "base v0.20", 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_2": "client writeable ranges", 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_3": "default file layouts on dirs", 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_4": "dir inode in separate object", 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_5": "mds uses versioned encoding", 2024-03-18T14:47:35.345 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_6": "dirfrag is stored in omap", 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_7": "mds uses inline data", 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_8": "no anchor table", 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_9": "file layout v2", 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_10": "snaprealm v2" 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "max_mds": 1, 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "in": [ 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: 0 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "up": { 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_0": 14431 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.346 INFO:teuthology.orchestra.run.smithi057.stdout: "failed": [], 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "damaged": [], 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "stopped": [ 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: 1 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "info": { 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "gid_14431": { 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "gid": 14431, 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "name": "c", 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "rank": 0, 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "incarnation": 19, 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "state_seq": 5, 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818/4018842639", 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "addrs": { 2024-03-18T14:47:35.347 INFO:teuthology.orchestra.run.smithi057.stdout: "addrvec": [ 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:6818", 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 4018842639 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "join_fscid": -1, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "export_targets": [], 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "features": 4540138320759226367, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "flags": 0, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": { 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "compat": {}, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "ro_compat": {}, 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "incompat": { 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_1": "base v0.20", 2024-03-18T14:47:35.348 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_2": "client writeable ranges", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_3": "default file layouts on dirs", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_4": "dir inode in separate object", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_5": "mds uses versioned encoding", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_6": "dirfrag is stored in omap", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_7": "mds uses inline data", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_8": "no anchor table", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_9": "file layout v2", 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "feature_10": "snaprealm v2" 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "data_pools": [ 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: 4 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: ], 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata_pool": 3, 2024-03-18T14:47:35.349 INFO:teuthology.orchestra.run.smithi057.stdout: "enabled": true, 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: "balancer": "", 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: "standby_count_wanted": 0 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 1 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-18T14:47:35.350 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 >> v1:172.21.15.57:6816/47480 conn(0x7fea80046010 legacy=0x7fea800484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 msgr2=0x7fea9c0ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fea9c06f7c0 tx=0x7fea8c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 shutdown_connections 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fea9c142300 0x7fea9c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fea9c06eac0 0x7fea9c0ae010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 --2- 172.21.15.57:0/3741568521 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fea9c141ed0 0x7fea9c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 >> 172.21.15.57:0/3741568521 conn(0x7fea9c069910 msgr2=0x7fea9c140590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 shutdown_connections 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.335+0000 7feaa331e700 1 -- 172.21.15.57:0/3741568521 wait complete. 2024-03-18T14:47:35.352 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 22 2024-03-18T14:47:35.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs required_client_features cephfs add metric_collect' 2024-03-18T14:47:35.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.471+0000 7fef1366d700 1 Processor -- start 2024-03-18T14:47:35.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.471+0000 7fef1366d700 1 -- start start 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef1366d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef0c068340 0x7fef0c06e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef1366d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 0x7fef0c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef1366d700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0c06da50 con 0x7fef0c0a4810 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef1366d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef0c06dc80 con 0x7fef0c068340 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef1366d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c06c9f0 con 0x7fef0c143810 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11409700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fef0c068340 0x7fef0c06e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11c0a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 0x7fef0c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef10c08700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fef0c0a4810 0x7fef0c13da80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36542/0 (socket says 172.21.15.57:36542) 2024-03-18T14:47:35.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef10c08700 1 -- 172.21.15.57:0/3730094940 learned_addr learned my addr 172.21.15.57:0/3730094940 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11409700 1 -- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 msgr2=0x7fef0c145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11409700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 0x7fef0c145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11409700 1 -- 172.21.15.57:0/3730094940 >> v1:172.21.15.57:6789/0 conn(0x7fef0c0a4810 legacy=0x7fef0c13da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11409700 1 -- 172.21.15.57:0/3730094940 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c06cc90 con 0x7fef0c068340 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef03fff700 1 -- 172.21.15.57:0/3730094940 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388712343 0 0) 0x7fef0c06da50 con 0x7fef0c0a4810 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.472+0000 7fef11c0a700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 0x7fef0c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef11409700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c068340 0x7fef0c06e210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feefc0098e0 tx=0x7feefc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de86d35f5138a1f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef03fff700 1 -- 172.21.15.57:0/3730094940 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00b640 con 0x7fef0c068340 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef03fff700 1 -- 172.21.15.57:0/3730094940 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc00b7a0 con 0x7fef0c068340 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef03fff700 1 -- 172.21.15.57:0/3730094940 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00bb40 con 0x7fef0c068340 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 -- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c068340 msgr2=0x7fef0c06e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c068340 0x7fef0c06e210 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feefc0098e0 tx=0x7feefc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 -- 172.21.15.57:0/3730094940 shutdown_connections 2024-03-18T14:47:35.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c143810 0x7fef0c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 --2- 172.21.15.57:0/3730094940 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c068340 0x7fef0c06e210 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 -- 172.21.15.57:0/3730094940 >> 172.21.15.57:0/3730094940 conn(0x7fef0c06bc50 msgr2=0x7fef0c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 -- 172.21.15.57:0/3730094940 shutdown_connections 2024-03-18T14:47:35.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.473+0000 7fef1366d700 1 -- 172.21.15.57:0/3730094940 wait complete. 2024-03-18T14:47:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.474+0000 7fef1366d700 1 Processor -- start 2024-03-18T14:47:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.474+0000 7fef1366d700 1 -- start start 2024-03-18T14:47:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 0x7fef0c0635c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 0x7fef0c064040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0aa6a0 con 0x7fef0c143810 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0a8e40 con 0x7fef0c0a4810 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef1366d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef0c0a9100 con 0x7fef0c068340 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef10c08700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11409700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 0x7fef0c0635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 0x7fef0c064040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef10c08700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56880/0 (socket says 172.21.15.57:56880) 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11409700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 0x7fef0c0635c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49674/0 (socket says 172.21.15.57:49674) 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef10c08700 1 -- 172.21.15.57:0/3580984570 learned_addr learned my addr 172.21.15.57:0/3580984570 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 -- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 msgr2=0x7fef0c0635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 0x7fef0c0635c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 -- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 msgr2=0x7fef0c063b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:35.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef11c0a700 1 -- 172.21.15.57:0/3580984570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef04009a20 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.475+0000 7fef10c08700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef11c0a700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 0x7fef0c064040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef04009e70 tx=0x7fef0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0400cb30 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0400f040 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04014480 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feefc009420 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.476+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c142320 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.477+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef0c0aa810 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.477+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fef04003020 con 0x7fef0c143810 2024-03-18T14:47:35.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.477+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fef0405bab0 con 0x7fef0c143810 2024-03-18T14:47:35.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.481+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fef04039bc0 con 0x7fef0c143810 2024-03-18T14:47:35.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:35.673+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"} v 0) v1 -- 0x7fef0c04c710 con 0x7fef0c143810 2024-03-18T14:47:36.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.502+0000 7fef017fa700 1 -- 172.21.15.57:0/3580984570 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"}]=0 added feature 'metric_collect' to required_client_features v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7fef04018070 con 0x7fef0c143810 2024-03-18T14:47:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 >> v1:172.21.15.57:6816/47480 conn(0x7feef0046010 legacy=0x7feef00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 msgr2=0x7fef0c064040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 0x7fef0c064040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef04009e70 tx=0x7fef0400b040 comp rx=0 tx=0).stop 2024-03-18T14:47:36.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 shutdown_connections 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fef0c143810 0x7fef0c064040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fef0c068340 0x7fef0c0635c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 --2- 172.21.15.57:0/3580984570 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fef0c0a4810 0x7fef0c063b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.505+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 >> 172.21.15.57:0/3580984570 conn(0x7fef0c06bc50 msgr2=0x7fef0c0a2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.506+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 shutdown_connections 2024-03-18T14:47:36.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:36.506+0000 7fef1366d700 1 -- 172.21.15.57:0/3580984570 wait complete. 2024-03-18T14:47:36.508 INFO:teuthology.orchestra.run.smithi057.stderr:added feature 'metric_collect' to required_client_features 2024-03-18T14:47:36.522 INFO:teuthology.run_tasks:Running task sleep... 2024-03-18T14:47:36.540 INFO:teuthology.task.sleep:Sleeping for 5 seconds 2024-03-18T14:47:37.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:2024-03-18T14:47:37.527+0000 7f5e827fc700 -1 client.4514 I was blacklisted at osd epoch 42 2024-03-18T14:47:37.529 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi129.stderr:2024-03-18T14:47:37.527+0000 7f6808ff9700 -1 client.4555 I was blacklisted at osd epoch 42 2024-03-18T14:47:41.540 INFO:teuthology.run_tasks:Running task fs.clients_evicted... 2024-03-18T14:47:41.554 INFO:tasks.fs:clients is {'client.0': True, 'client.1': True} 2024-03-18T14:47:41.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.686+0000 7f5af820d700 1 Processor -- start 2024-03-18T14:47:41.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 -- start start 2024-03-18T14:47:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5af00b3250 0x7f5af006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 0x7f5af006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af00a3a80 con 0x7f5af00b3250 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00b0350 con 0x7f5af006f5f0 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af820d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00a4990 con 0x7f5af00a4e70 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af57a8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 0x7f5af006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af67aa700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af5fa9700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5af00b3250 0x7f5af006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af57a8700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 0x7f5af006f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49680/0 (socket says 172.21.15.57:49680) 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af57a8700 1 -- 172.21.15.57:0/2020459391 learned_addr learned my addr 172.21.15.57:0/2020459391 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.687+0000 7f5af67aa700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56884/0 (socket says 172.21.15.57:56884) 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 -- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 msgr2=0x7f5af006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 0x7f5af006f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 -- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 msgr2=0x7f5af0148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 -- 172.21.15.57:0/2020459391 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af006a3f0 con 0x7f5af00b3250 2024-03-18T14:47:41.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af67aa700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af5fa9700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af00b3250 0x7f5af006eb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00098e0 tx=0x7f5ae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e4880adbb00cfc server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af4fa7700 1 -- 172.21.15.57:0/2020459391 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000b640 con 0x7f5af00b3250 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af4fa7700 1 -- 172.21.15.57:0/2020459391 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae000b7a0 con 0x7f5af00b3250 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.688+0000 7f5af4fa7700 1 -- 172.21.15.57:0/2020459391 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae000bb40 con 0x7f5af00b3250 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 -- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af00b3250 msgr2=0x7f5af006eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af00b3250 0x7f5af006eb70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5ae00098e0 tx=0x7f5ae00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 -- 172.21.15.57:0/2020459391 shutdown_connections 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af006f5f0 0x7f5af0148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af00b3250 0x7f5af006eb70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 --2- 172.21.15.57:0/2020459391 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00a4e70 0x7f5af006f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 -- 172.21.15.57:0/2020459391 >> 172.21.15.57:0/2020459391 conn(0x7f5af006e2c0 msgr2=0x7f5af006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 -- 172.21.15.57:0/2020459391 shutdown_connections 2024-03-18T14:47:41.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.689+0000 7f5af820d700 1 -- 172.21.15.57:0/2020459391 wait complete. 2024-03-18T14:47:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 Processor -- start 2024-03-18T14:47:41.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 -- start start 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 0x7f5af0098360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0097950 con 0x7f5af006f5f0 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00ab7b0 con 0x7f5af00a4e70 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af820d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0097e60 con 0x7f5af00b3250 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af57a8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af67aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af57a8700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56890/0 (socket says 172.21.15.57:56890) 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af57a8700 1 -- 172.21.15.57:0/1825233148 learned_addr learned my addr 172.21.15.57:0/1825233148 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af67aa700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49692/0 (socket says 172.21.15.57:49692) 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.690+0000 7f5af5fa9700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 0x7f5af0098360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 -- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 msgr2=0x7f5af0151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:41.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 -- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 msgr2=0x7f5af0098360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 0x7f5af0098360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 -- 172.21.15.57:0/1825233148 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae8009a20 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af5fa9700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 0x7f5af0098360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af67aa700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af57a8700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e850 tx=0x7f5aec008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec013410 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec013570 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae0009420 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0138f0 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.691+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af00ab9e0 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.692+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5aec013ca0 con 0x7f5af00a4e70 2024-03-18T14:47:41.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.692+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af00ad290 con 0x7f5af00a4e70 2024-03-18T14:47:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.692+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f5aec05b0c0 con 0x7f5af00a4e70 2024-03-18T14:47:41.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.696+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f5aec039230 con 0x7f5af00a4e70 2024-03-18T14:47:41.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.859+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af00a4c50 con 0x7f5af00a4e70 2024-03-18T14:47:41.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.860+0000 7f5ae5ffb700 1 -- 172.21.15.57:0/1825233148 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f5aec03ca20 con 0x7f5af00a4e70 2024-03-18T14:47:41.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:41.862 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 >> v1:172.21.15.57:6816/47480 conn(0x7f5ad4046010 legacy=0x7f5ad40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 msgr2=0x7f5af01518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00e850 tx=0x7f5aec008040 comp rx=0 tx=0).stop 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 shutdown_connections 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5af00b3250 0x7f5af0151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5af006f5f0 0x7f5af0098360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 --2- 172.21.15.57:0/1825233148 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5af00a4e70 0x7f5af01518e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 >> 172.21.15.57:0/1825233148 conn(0x7f5af006e2c0 msgr2=0x7f5af00648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 shutdown_connections 2024-03-18T14:47:41.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.862+0000 7f5af820d700 1 -- 172.21.15.57:0/1825233148 wait complete. 2024-03-18T14:47:41.876 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:47:41.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:41.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.998+0000 7feef3c09700 1 Processor -- start 2024-03-18T14:47:41.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.998+0000 7feef3c09700 1 -- start start 2024-03-18T14:47:42.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef3c09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 0x7feeec0a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef3c09700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 0x7feeec1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef3c09700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec069e80 con 0x7feeec0a4ee0 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef3c09700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0a3dd0 con 0x7feeec146600 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef3c09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeec0a4910 con 0x7feeec06a860 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 0x7feeec0a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef21a6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 0x7feeec1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef11a4700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7feeec0a4ee0 0x7feeec0b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36558/0 (socket says 172.21.15.57:36558) 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef11a4700 1 -- 172.21.15.57:0/775071874 learned_addr learned my addr 172.21.15.57:0/775071874 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 -- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 msgr2=0x7feeec1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef09a3700 1 -- 172.21.15.57:0/775071874 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182740881 0 0) 0x7feeec069e80 con 0x7feeec0a4ee0 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 0x7feeec1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 -- 172.21.15.57:0/775071874 >> v1:172.21.15.57:6789/0 conn(0x7feeec0a4ee0 legacy=0x7feeec0b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 -- 172.21.15.57:0/775071874 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec0694c0 con 0x7feeec06a860 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef21a6700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 0x7feeec1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef19a5700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 0x7feeec0a42d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feedc009910 tx=0x7feedc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f7d3403abd1844c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:41.999+0000 7feef09a3700 1 -- 172.21.15.57:0/775071874 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc00b680 con 0x7feeec06a860 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef09a3700 1 -- 172.21.15.57:0/775071874 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc00b7e0 con 0x7feeec06a860 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef09a3700 1 -- 172.21.15.57:0/775071874 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc00bba0 con 0x7feeec06a860 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 -- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 msgr2=0x7feeec0a42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 0x7feeec0a42d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feedc009910 tx=0x7feedc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 -- 172.21.15.57:0/775071874 shutdown_connections 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec146600 0x7feeec1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 --2- 172.21.15.57:0/775071874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec06a860 0x7feeec0a42d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 -- 172.21.15.57:0/775071874 >> 172.21.15.57:0/775071874 conn(0x7feeec06e250 msgr2=0x7feeec06bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 -- 172.21.15.57:0/775071874 shutdown_connections 2024-03-18T14:47:42.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.000+0000 7feef3c09700 1 -- 172.21.15.57:0/775071874 wait complete. 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.001+0000 7feef3c09700 1 Processor -- start 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.001+0000 7feef3c09700 1 -- start start 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeec0a4ee0 0x7feeec09a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 0x7feeec151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec09d010 con 0x7feeec0a4ee0 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec09ae30 con 0x7feeec06a860 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feeec1511f0 con 0x7feeec146600 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef19a5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef19a5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56908/0 (socket says 172.21.15.57:56908) 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 0x7feeec151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef19a5700 1 -- 172.21.15.57:0/1217338809 learned_addr learned my addr 172.21.15.57:0/1217338809 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef11a4700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeec0a4ee0 0x7feeec09a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 -- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 msgr2=0x7feeec09c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 -- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeec0a4ee0 msgr2=0x7feeec09a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeec0a4ee0 0x7feeec09a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 -- 172.21.15.57:0/1217338809 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee4009a20 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef19a5700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef21a6700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 0x7feeec151620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feeec069c40 tx=0x7feee400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400caa0 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400f040 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.002+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc009420 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.003+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400ce50 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.003+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec09b790 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.003+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7feee4003020 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.004+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec065180 con 0x7feeec146600 2024-03-18T14:47:42.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.004+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7feee405ba50 con 0x7feeec146600 2024-03-18T14:47:42.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.007+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7feee4039aa0 con 0x7feeec146600 2024-03-18T14:47:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.168+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feeec069750 con 0x7feeec146600 2024-03-18T14:47:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.168+0000 7feee1ffb700 1 -- 172.21.15.57:0/1217338809 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7feee4018030 con 0x7feeec146600 2024-03-18T14:47:42.170 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 >> v1:172.21.15.57:6816/47480 conn(0x7feed0046010 legacy=0x7feed00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 msgr2=0x7feeec151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 0x7feeec151620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7feeec069c40 tx=0x7feee400b040 comp rx=0 tx=0).stop 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 shutdown_connections 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7feeec146600 0x7feeec151620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7feeec06a860 0x7feeec09c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 --2- 172.21.15.57:0/1217338809 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7feeec0a4ee0 0x7feeec09a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 >> 172.21.15.57:0/1217338809 conn(0x7feeec06e250 msgr2=0x7feeec0b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 shutdown_connections 2024-03-18T14:47:42.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.170+0000 7feef3c09700 1 -- 172.21.15.57:0/1217338809 wait complete. 2024-03-18T14:47:42.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:42.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.305+0000 7f2c41e2b700 1 Processor -- start 2024-03-18T14:47:42.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.305+0000 7f2c41e2b700 1 -- start start 2024-03-18T14:47:42.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c41e2b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c3c0a3cb0 0x7f2c3c069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c41e2b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 0x7f2c3c148a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c41e2b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c06a210 con 0x7f2c3c0b0230 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c41e2b700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c06a020 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c41e2b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c06a4b0 con 0x7f2c3c146690 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2c3c0a3cb0 0x7f2c3c069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3b7fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2c3c0b0230 0x7f2c3c0680f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36570/0 (socket says 172.21.15.57:36570) 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3b7fe700 1 -- 172.21.15.57:0/458393923 learned_addr learned my addr 172.21.15.57:0/458393923 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3bfff700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 0x7f2c3c148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 -- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 msgr2=0x7f2c3c148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 0x7f2c3c148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 -- 172.21.15.57:0/458393923 >> v1:172.21.15.57:6789/0 conn(0x7f2c3c0b0230 legacy=0x7f2c3c0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 -- 172.21.15.57:0/458393923 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0a3540 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3a7fc700 1 -- 172.21.15.57:0/458393923 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356101681 0 0) 0x7f2c3c06a210 con 0x7f2c3c0b0230 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3bfff700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 0x7f2c3c148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3affd700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0a3cb0 0x7f2c3c069ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0098e0 tx=0x7f2c2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa516b2207e8d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.306+0000 7f2c3a7fc700 1 -- 172.21.15.57:0/458393923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00b640 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c3a7fc700 1 -- 172.21.15.57:0/458393923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00b7a0 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c3a7fc700 1 -- 172.21.15.57:0/458393923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00bb40 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 -- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0a3cb0 msgr2=0x7f2c3c069ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0a3cb0 0x7f2c3c069ae0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c0098e0 tx=0x7f2c2c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 -- 172.21.15.57:0/458393923 shutdown_connections 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c146690 0x7f2c3c148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/458393923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0a3cb0 0x7f2c3c069ae0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 -- 172.21.15.57:0/458393923 >> 172.21.15.57:0/458393923 conn(0x7f2c3c06bf80 msgr2=0x7f2c3c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 -- 172.21.15.57:0/458393923 shutdown_connections 2024-03-18T14:47:42.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.307+0000 7f2c41e2b700 1 -- 172.21.15.57:0/458393923 wait complete. 2024-03-18T14:47:42.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.308+0000 7f2c41e2b700 1 Processor -- start 2024-03-18T14:47:42.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.308+0000 7f2c41e2b700 1 -- start start 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 0x7f2c3c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3c146690 0x7f2c3c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0a2940 con 0x7f2c3c0b0230 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c098570 con 0x7f2c3c146690 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c0ae560 con 0x7f2c3c0a3cb0 2024-03-18T14:47:42.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 0x7f2c3c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49720/0 (socket says 172.21.15.57:49720) 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3b7fe700 1 -- 172.21.15.57:0/1450763175 learned_addr learned my addr 172.21.15.57:0/1450763175 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3bfff700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3c146690 0x7f2c3c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 -- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 msgr2=0x7f2c3c14ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 -- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3c146690 msgr2=0x7f2c3c14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3c146690 0x7f2c3c14e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 -- 172.21.15.57:0/1450763175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c34009a20 con 0x7f2c3c0b0230 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3b7fe700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c3affd700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 0x7f2c3c14e300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c016000 tx=0x7f2c2c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c000d10 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c00bb20 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2c009420 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.309+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c011670 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.310+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0aee90 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.310+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2c2c011aa0 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.310+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c0af080 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.311+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f2c2c05caf0 con 0x7f2c3c0b0230 2024-03-18T14:47:42.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.314+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f2c2c01dac0 con 0x7f2c3c0b0230 2024-03-18T14:47:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.473+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2c3c065180 con 0x7f2c3c0b0230 2024-03-18T14:47:42.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.473+0000 7f2c337fe700 1 -- 172.21.15.57:0/1450763175 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2c2c015030 con 0x7f2c3c0b0230 2024-03-18T14:47:42.475 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 >> v1:172.21.15.57:6816/47480 conn(0x7f2c1c046010 legacy=0x7f2c1c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 msgr2=0x7f2c3c14e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 0x7f2c3c14e300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c016000 tx=0x7f2c2c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 shutdown_connections 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2c3c146690 0x7f2c3c14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2c3c0a3cb0 0x7f2c3c14ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 --2- 172.21.15.57:0/1450763175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2c3c0b0230 0x7f2c3c14e300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 >> 172.21.15.57:0/1450763175 conn(0x7f2c3c06bf80 msgr2=0x7f2c3c068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 shutdown_connections 2024-03-18T14:47:42.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.475+0000 7f2c41e2b700 1 -- 172.21.15.57:0/1450763175 wait complete. 2024-03-18T14:47:42.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.610+0000 7f74c2745700 1 Processor -- start 2024-03-18T14:47:42.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 -- start start 2024-03-18T14:47:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 0x7f74bc06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 0x7f74bc148a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc06fd10 con 0x7f74bc068340 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0b07e0 con 0x7f74bc0a4730 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c2745700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc0697a0 con 0x7f74bc146690 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74c0ce2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 0x7f74bc148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 0x7f74bc06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74bbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f74bc068340 0x7f74bc0a3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36576/0 (socket says 172.21.15.57:36576) 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.611+0000 7f74bbfff700 1 -- 172.21.15.57:0/1686927094 learned_addr learned my addr 172.21.15.57:0/1686927094 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74baffd700 1 -- 172.21.15.57:0/1686927094 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273414515 0 0) 0x7f74bc06fd10 con 0x7f74bc068340 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 msgr2=0x7f74bc06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 0x7f74bc06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1686927094 >> v1:172.21.15.57:6789/0 conn(0x7f74bc068340 legacy=0x7f74bc0a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1686927094 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc069a40 con 0x7f74bc146690 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74bb7fe700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 0x7f74bc06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 0x7f74bc148a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009e90 tx=0x7f74b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72e1d6b24627252f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74baffd700 1 -- 172.21.15.57:0/1686927094 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b400e070 con 0x7f74bc146690 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74baffd700 1 -- 172.21.15.57:0/1686927094 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b400bc30 con 0x7f74bc146690 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74baffd700 1 -- 172.21.15.57:0/1686927094 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4012430 con 0x7f74bc146690 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 -- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 msgr2=0x7f74bc148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 0x7f74bc148a70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009e90 tx=0x7f74b4009780 comp rx=0 tx=0).stop 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 -- 172.21.15.57:0/1686927094 shutdown_connections 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc146690 0x7f74bc148a70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 --2- 172.21.15.57:0/1686927094 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc0a4730 0x7f74bc06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.612+0000 7f74c2745700 1 -- 172.21.15.57:0/1686927094 >> 172.21.15.57:0/1686927094 conn(0x7f74bc06be90 msgr2=0x7f74bc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.613+0000 7f74c2745700 1 -- 172.21.15.57:0/1686927094 shutdown_connections 2024-03-18T14:47:42.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.613+0000 7f74c2745700 1 -- 172.21.15.57:0/1686927094 wait complete. 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.614+0000 7f74c2745700 1 Processor -- start 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.614+0000 7f74c2745700 1 -- start start 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 0x7f74bc143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 0x7f74bc143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc09bcb0 con 0x7f74bc146690 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc09b470 con 0x7f74bc068340 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c2745700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1444f0 con 0x7f74bc0a4730 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bb7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 0x7f74bc143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bbfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56940/0 (socket says 172.21.15.57:56940) 2024-03-18T14:47:42.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bbfff700 1 -- 172.21.15.57:0/1199438159 learned_addr learned my addr 172.21.15.57:0/1199438159 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 0x7f74bc143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 msgr2=0x7f74bc143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 0x7f74bc143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 msgr2=0x7f74bc099cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 -- 172.21.15.57:0/1199438159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009420 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bb7fe700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 0x7f74bc143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74bbfff700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.615+0000 7f74c0ce2700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 0x7f74bc143fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f74b4016000 tx=0x7f74b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.616+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4027470 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.616+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4027630 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.616+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b4009a20 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.616+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40279f0 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.616+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc09a670 con 0x7f74bc146690 2024-03-18T14:47:42.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.617+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc065180 con 0x7f74bc146690 2024-03-18T14:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.617+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f74b4024070 con 0x7f74bc146690 2024-03-18T14:47:42.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.617+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f74b405d8a0 con 0x7f74bc146690 2024-03-18T14:47:42.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.621+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f74b401f940 con 0x7f74bc146690 2024-03-18T14:47:42.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.781+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74bc0a4510 con 0x7f74bc146690 2024-03-18T14:47:42.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.781+0000 7f74a3fff700 1 -- 172.21.15.57:0/1199438159 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74b401f940 con 0x7f74bc146690 2024-03-18T14:47:42.783 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 >> v1:172.21.15.57:6816/47480 conn(0x7f74a80460e0 legacy=0x7f74a8048590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 msgr2=0x7f74bc143fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 0x7f74bc143fb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f74b4016000 tx=0x7f74b4019000 comp rx=0 tx=0).stop 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 shutdown_connections 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f74bc146690 0x7f74bc143fb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f74bc068340 0x7f74bc099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 --2- 172.21.15.57:0/1199438159 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f74bc0a4730 0x7f74bc143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 >> 172.21.15.57:0/1199438159 conn(0x7f74bc06be90 msgr2=0x7f74bc0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 shutdown_connections 2024-03-18T14:47:42.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.783+0000 7f74c2745700 1 -- 172.21.15.57:0/1199438159 wait complete. 2024-03-18T14:47:42.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:42.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 Processor -- start 2024-03-18T14:47:42.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 -- start start 2024-03-18T14:47:42.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 0x7f3a640a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a640a4ee0 0x7f3a640b3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a64069e80 con 0x7f3a6406eb00 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640a3dd0 con 0x7f3a640a4ee0 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a6a8ed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640a4910 con 0x7f3a6406a860 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a637fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a640a4ee0 0x7f3a640b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a63fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 0x7f3a640a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a68e8a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3a6406eb00 0x7f3a6406ef40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36592/0 (socket says 172.21.15.57:36592) 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.919+0000 7f3a68e8a700 1 -- 172.21.15.57:0/1922361496 learned_addr learned my addr 172.21.15.57:0/1922361496 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a637fe700 1 -- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 msgr2=0x7f3a640a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a637fe700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 0x7f3a640a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a637fe700 1 -- 172.21.15.57:0/1922361496 >> v1:172.21.15.57:6789/0 conn(0x7f3a6406eb00 legacy=0x7f3a6406ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a637fe700 1 -- 172.21.15.57:0/1922361496 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640b3790 con 0x7f3a640a4ee0 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a63fff700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 0x7f3a640a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a62ffd700 1 -- 172.21.15.57:0/1922361496 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777073750 0 0) 0x7f3a64069e80 con 0x7f3a6406eb00 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a637fe700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a640a4ee0 0x7f3a640b3250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a580098e0 tx=0x7f3a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5d687b1f78dbf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a62ffd700 1 -- 172.21.15.57:0/1922361496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800b640 con 0x7f3a640a4ee0 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a62ffd700 1 -- 172.21.15.57:0/1922361496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800b7a0 con 0x7f3a640a4ee0 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a62ffd700 1 -- 172.21.15.57:0/1922361496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5800bb40 con 0x7f3a640a4ee0 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a640a4ee0 msgr2=0x7f3a640b3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.920+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a640a4ee0 0x7f3a640b3250 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a580098e0 tx=0x7f3a580091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/1922361496 shutdown_connections 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a6406a860 0x7f3a640a42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/1922361496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a640a4ee0 0x7f3a640b3250 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/1922361496 >> 172.21.15.57:0/1922361496 conn(0x7f3a6406e250 msgr2=0x7f3a6406bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/1922361496 shutdown_connections 2024-03-18T14:47:42.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/1922361496 wait complete. 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.921+0000 7f3a6a8ed700 1 Processor -- start 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 -- start start 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 0x7f3a6414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:42.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64098d70 con 0x7f3a6406eb00 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64099860 con 0x7f3a640a4ee0 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a6a8ed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6414da20 con 0x7f3a6406a860 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a63fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a68e8a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 0x7f3a6414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a637fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34318/0 (socket says 172.21.15.57:34318) 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a63fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:49738/0 (socket says 172.21.15.57:49738) 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.922+0000 7f3a637fe700 1 -- 172.21.15.57:0/2108681991 learned_addr learned my addr 172.21.15.57:0/2108681991 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 -- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 msgr2=0x7f3a64097620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 -- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 msgr2=0x7f3a64099d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 -- 172.21.15.57:0/2108681991 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a54009420 con 0x7f3a640a4ee0 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a637fe700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a63fff700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:42.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a68e8a700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 0x7f3a6414dca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00cc10 tx=0x7f3a5c0019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00a870 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00a9f0 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00adb0 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a58009420 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.923+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a64097bc0 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.924+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3a5c007300 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.924+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a64098f20 con 0x7f3a640a4ee0 2024-03-18T14:47:42.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.924+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f3a5c05b470 con 0x7f3a640a4ee0 2024-03-18T14:47:42.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:42.928+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f3a64098f20 con 0x7f3a640a4ee0 2024-03-18T14:47:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.086+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a64096b00 con 0x7f3a640a4ee0 2024-03-18T14:47:43.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.087+0000 7f3a4bfff700 1 -- 172.21.15.57:0/2108681991 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a5c039630 con 0x7f3a640a4ee0 2024-03-18T14:47:43.088 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 >> v1:172.21.15.57:6816/47480 conn(0x7f3a50046010 legacy=0x7f3a500484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 msgr2=0x7f3a6414dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 0x7f3a6414dca0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00cc10 tx=0x7f3a5c0019a0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 shutdown_connections 2024-03-18T14:47:43.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3a640a4ee0 0x7f3a6414dca0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3a6406a860 0x7f3a64097620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 --2- 172.21.15.57:0/2108681991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a6406eb00 0x7f3a64099d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 >> 172.21.15.57:0/2108681991 conn(0x7f3a6406e250 msgr2=0x7f3a64144200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 shutdown_connections 2024-03-18T14:47:43.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.088+0000 7f3a6a8ed700 1 -- 172.21.15.57:0/2108681991 wait complete. 2024-03-18T14:47:43.102 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T14:47:43.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.220+0000 7f0ee96e2700 1 Processor -- start 2024-03-18T14:47:43.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 -- start start 2024-03-18T14:47:43.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 0x7f0ee406f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:43.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 0x7f0ee41499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:43.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee40a3a80 con 0x7f0ee40b3250 2024-03-18T14:47:43.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40b0350 con 0x7f0ee40a4e70 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee96e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40a4990 con 0x7f0ee4147610 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 0x7f0ee406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee2ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0ee40b3250 0x7f0ee406eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:36608/0 (socket says 172.21.15.57:36608) 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee2ffd700 1 -- 172.21.15.57:0/3836878990 learned_addr learned my addr 172.21.15.57:0/3836878990 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.221+0000 7f0ee37fe700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 0x7f0ee41499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee1ffb700 1 -- 172.21.15.57:0/3836878990 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221570038 0 0) 0x7f0ee40a3a80 con 0x7f0ee40b3250 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee27fc700 1 -- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 msgr2=0x7f0ee41499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee27fc700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 0x7f0ee41499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee27fc700 1 -- 172.21.15.57:0/3836878990 >> v1:172.21.15.57:6789/0 conn(0x7f0ee40b3250 legacy=0x7f0ee406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee27fc700 1 -- 172.21.15.57:0/3836878990 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee406a3f0 con 0x7f0ee40a4e70 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee37fe700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 0x7f0ee41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee27fc700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 0x7f0ee406f280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009910 tx=0x7f0ed40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6954f802edb8bb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee1ffb700 1 -- 172.21.15.57:0/3836878990 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400b680 con 0x7f0ee40a4e70 2024-03-18T14:47:43.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee1ffb700 1 -- 172.21.15.57:0/3836878990 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400b7e0 con 0x7f0ee40a4e70 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee1ffb700 1 -- 172.21.15.57:0/3836878990 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400bba0 con 0x7f0ee40a4e70 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 -- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 msgr2=0x7f0ee406f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 0x7f0ee406f280 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009910 tx=0x7f0ed40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 -- 172.21.15.57:0/3836878990 shutdown_connections 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee4147610 0x7f0ee41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/3836878990 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40a4e70 0x7f0ee406f280 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.222+0000 7f0ee96e2700 1 -- 172.21.15.57:0/3836878990 >> 172.21.15.57:0/3836878990 conn(0x7f0ee406e2c0 msgr2=0x7f0ee406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.223+0000 7f0ee96e2700 1 -- 172.21.15.57:0/3836878990 shutdown_connections 2024-03-18T14:47:43.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.223+0000 7f0ee96e2700 1 -- 172.21.15.57:0/3836878990 wait complete. 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 Processor -- start 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 -- start start 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 0x7f0ee4096a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 0x7f0ee40ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4098380 con 0x7f0ee4147610 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40ae180 con 0x7f0ee40b3250 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee96e2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee40ae420 con 0x7f0ee40a4e70 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee2ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 0x7f0ee4096a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:43.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee27fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56984/0 (socket says 172.21.15.57:56984) 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee27fc700 1 -- 172.21.15.57:0/896490874 learned_addr learned my addr 172.21.15.57:0/896490874 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee37fe700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 0x7f0ee40ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.224+0000 7f0ee27fc700 1 -- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 msgr2=0x7f0ee4096a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee27fc700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 0x7f0ee4096a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee27fc700 1 -- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 msgr2=0x7f0ee40ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee27fc700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 0x7f0ee40ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee27fc700 1 -- 172.21.15.57:0/896490874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009a20 con 0x7f0ee40b3250 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee2ffd700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 0x7f0ee4096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee37fe700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 0x7f0ee40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee27fc700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40b2dc0 tx=0x7f0ed4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400bb60 con 0x7f0ee40b3250 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed4000c90 con 0x7f0ee40b3250 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4009420 con 0x7f0ee40b3250 2024-03-18T14:47:43.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed401a660 con 0x7f0ee40b3250 2024-03-18T14:47:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.225+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40974c0 con 0x7f0ee40b3250 2024-03-18T14:47:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.226+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4097c40 con 0x7f0ee40b3250 2024-03-18T14:47:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.226+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f0ed401a9d0 con 0x7f0ee40b3250 2024-03-18T14:47:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.226+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f0ed405ccc0 con 0x7f0ee40b3250 2024-03-18T14:47:43.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.230+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f0ed40263f0 con 0x7f0ee40b3250 2024-03-18T14:47:43.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.419+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ee40a4c50 con 0x7f0ee40b3250 2024-03-18T14:47:43.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.420+0000 7f0edaffd700 1 -- 172.21.15.57:0/896490874 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+3697 (secure 0 0 0) 0x7f0ed4002d70 con 0x7f0ee40b3250 2024-03-18T14:47:43.421 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:43.421 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14414,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6817/3316946905","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6817","nonce":3316946905}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":14420,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6819/2165512544","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6819","nonce":2165512544}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T14:41:13.448406+0000","modified":"2024-03-18T14:47:36.495930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":35,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14431},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14431":{"gid":14431,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.57:6818/4018842639","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6818","nonce":4018842639}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 >> v1:172.21.15.57:6816/47480 conn(0x7f0ec4046010 legacy=0x7f0ec40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 msgr2=0x7f0ee4097e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40b2dc0 tx=0x7f0ed4017000 comp rx=0 tx=0).stop 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 shutdown_connections 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0ee4147610 0x7f0ee40ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f0ee40a4e70 0x7f0ee4096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 --2- 172.21.15.57:0/896490874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f0ee40b3250 0x7f0ee4097e40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:43.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.421+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 >> 172.21.15.57:0/896490874 conn(0x7f0ee406e2c0 msgr2=0x7f0ee40b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:43.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.422+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 shutdown_connections 2024-03-18T14:47:43.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:43.422+0000 7f0ee96e2700 1 -- 172.21.15.57:0/896490874 wait complete. 2024-03-18T14:47:43.424 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 23 2024-03-18T14:47:43.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-03-18T14:47:43.575 INFO:teuthology.orchestra.run.smithi057.stdout:[{"id":14220,"entity":{"name":{"type":"client","num":14220},"addr":{"type":"v1","addr":"172.21.15.57:0","nonce":3718804678}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":19.093730684000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.95891899517182289,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.14220 v1:172.21.15.57:0/3718804678","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6716c9f3976cf9fc2fd546e9f1182c2d4421b451","ceph_version":"ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)","entity_id":"y","hostname":"smithi057","pid":"47480","root":"/"}},{"id":14183,"entity":{"name":{"type":"client","num":14183},"addr":{"type":"v1","addr":"172.21.15.57:0","nonce":606709445}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":19.093730684000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.95891899517182289,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":0,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.14183 v1:172.21.15.57:0/606709445","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000017ffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"6716c9f3976cf9fc2fd546e9f1182c2d4421b451","ceph_version":"ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)","entity_id":"y","hostname":"smithi057","pid":"47480","root":"/"}}] 2024-03-18T14:47:43.576 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6716c9f3976cf9fc2fd546e9f1182c2d4421b451", "ceph_version": "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "y", "hostname": "smithi057", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "47480", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.57:0", "nonce": 3718804678, "type": "v1" }, "name": { "num": 14220, "type": "client" } }, "id": 14220, "inst": "client.14220 v1:172.21.15.57:0/3718804678", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9589189951718229 }, "state": "open", "uptime": 19.093730684 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "6716c9f3976cf9fc2fd546e9f1182c2d4421b451", "ceph_version": "ceph version 17.2.7-684-g6716c9f3 (6716c9f3976cf9fc2fd546e9f1182c2d4421b451) quincy (stable)", "client_features": { "feature_bits": "0x000000000017ffff" }, "entity_id": "y", "hostname": "smithi057", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "47480", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.57:0", "nonce": 606709445, "type": "v1" }, "name": { "num": 14183, "type": "client" } }, "id": 14183, "inst": "client.14183 v1:172.21.15.57:0/606709445", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 0, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9589189951718229 }, "state": "open", "uptime": 19.093730684 } ] 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-03-18T14:47:43.577 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-03-18T14:47:43.578 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-03-18T14:47:43.674 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:47:43.677 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:47:43.683 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:47:43.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:43.684 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37291.asok mds_sessions 2024-03-18T14:47:43.822 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4514, 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4514 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2493486388 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:47:43.823 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4514 v1:172.21.15.87:0/2493486388", 2024-03-18T14:47:43.824 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "v1:172.21.15.87:0/2493486388", 2024-03-18T14:47:43.824 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions": [], 2024-03-18T14:47:43.824 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23 2024-03-18T14:47:43.824 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> import glob 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> import re 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> import os 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> import subprocess 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:43.831 DEBUG:teuthology.orchestra.run.smithi129:> def _find_admin_socket(client_name): 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> files = glob.glob(asok_path) 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> # Given a non-glob path, it better be there 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> if "*" not in asok_path: 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> assert(len(files) == 1) 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> return files[0] 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> for f in files: 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> contents = proc_f.read() 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> if mountpoint in contents: 2024-03-18T14:47:43.832 DEBUG:teuthology.orchestra.run.smithi129:> return f 2024-03-18T14:47:43.833 DEBUG:teuthology.orchestra.run.smithi129:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:47:43.833 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:43.833 DEBUG:teuthology.orchestra.run.smithi129:> print(_find_admin_socket("client.1")) 2024-03-18T14:47:43.833 DEBUG:teuthology.orchestra.run.smithi129:> ' 2024-03-18T14:47:43.929 INFO:teuthology.orchestra.run.smithi129.stdout:/var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:47:43.933 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:47:43.940 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:47:43.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:43.940 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37344.asok mds_sessions 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4555, 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "inst": { 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "name": { 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "client", 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "num": 4555 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": { 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:0", 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 1814197221 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:47:44.079 INFO:teuthology.orchestra.run.smithi129.stdout: "inst_str": "client.4555 v1:172.21.15.129:0/1814197221", 2024-03-18T14:47:44.080 INFO:teuthology.orchestra.run.smithi129.stdout: "addr_str": "v1:172.21.15.129:0/1814197221", 2024-03-18T14:47:44.080 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions": [], 2024-03-18T14:47:44.080 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 23 2024-03-18T14:47:44.080 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-03-18T14:47:44.087 DEBUG:teuthology.orchestra.run.smithi087:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:47:44.087 DEBUG:teuthology.orchestra.run.smithi087:> import glob 2024-03-18T14:47:44.087 DEBUG:teuthology.orchestra.run.smithi087:> import re 2024-03-18T14:47:44.087 DEBUG:teuthology.orchestra.run.smithi087:> import os 2024-03-18T14:47:44.087 DEBUG:teuthology.orchestra.run.smithi087:> import subprocess 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> def _find_admin_socket(client_name): 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> files = glob.glob(asok_path) 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> # Given a non-glob path, it better be there 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> if "*" not in asok_path: 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> assert(len(files) == 1) 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> return files[0] 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> for f in files: 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> contents = proc_f.read() 2024-03-18T14:47:44.088 DEBUG:teuthology.orchestra.run.smithi087:> if mountpoint in contents: 2024-03-18T14:47:44.089 DEBUG:teuthology.orchestra.run.smithi087:> return f 2024-03-18T14:47:44.089 DEBUG:teuthology.orchestra.run.smithi087:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:47:44.089 DEBUG:teuthology.orchestra.run.smithi087:> 2024-03-18T14:47:44.089 DEBUG:teuthology.orchestra.run.smithi087:> print(_find_admin_socket("client.0")) 2024-03-18T14:47:44.089 DEBUG:teuthology.orchestra.run.smithi087:> ' 2024-03-18T14:47:44.170 INFO:teuthology.orchestra.run.smithi087.stdout:/var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:47:44.173 INFO:teuthology.orchestra.run.smithi087.stderr:2024-03-18T14:47:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:47:44.179 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37291.asok 2024-03-18T14:47:44.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:44.179 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37291.asok mds_sessions 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout:{ 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: "id": 4514, 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: "inst": { 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: "name": { 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "client", 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: "num": 4514 2024-03-18T14:47:44.316 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": { 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "type": "v1", 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addr": "172.21.15.87:0", 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "nonce": 2493486388 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: } 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: }, 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "inst_str": "client.4514 v1:172.21.15.87:0/2493486388", 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "addr_str": "v1:172.21.15.87:0/2493486388", 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "sessions": [], 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout: "mdsmap_epoch": 23 2024-03-18T14:47:44.317 INFO:teuthology.orchestra.run.smithi087.stdout:} 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> sudo stdin-killer -- python3 -c ' 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> import glob 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> import re 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> import os 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> import subprocess 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> def _find_admin_socket(client_name): 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> files = glob.glob(asok_path) 2024-03-18T14:47:44.325 DEBUG:teuthology.orchestra.run.smithi129:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> # Given a non-glob path, it better be there 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> if "*" not in asok_path: 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> assert(len(files) == 1) 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> return files[0] 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> for f in files: 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-18T14:47:44.326 DEBUG:teuthology.orchestra.run.smithi129:> contents = proc_f.read() 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> if mountpoint in contents: 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> return f 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> print(_find_admin_socket("client.1")) 2024-03-18T14:47:44.327 DEBUG:teuthology.orchestra.run.smithi129:> ' 2024-03-18T14:47:44.409 INFO:teuthology.orchestra.run.smithi129.stdout:/var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:47:44.412 INFO:teuthology.orchestra.run.smithi129.stderr:2024-03-18T14:47:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T14:47:44.419 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37344.asok 2024-03-18T14:47:44.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:44.419 DEBUG:teuthology.orchestra.run.smithi129:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37344.asok mds_sessions 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout:{ 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout: "id": 4555, 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout: "inst": { 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout: "name": { 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "client", 2024-03-18T14:47:44.556 INFO:teuthology.orchestra.run.smithi129.stdout: "num": 4555 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": { 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "type": "v1", 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "addr": "172.21.15.129:0", 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "nonce": 1814197221 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: } 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: }, 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "inst_str": "client.4555 v1:172.21.15.129:0/1814197221", 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "addr_str": "v1:172.21.15.129:0/1814197221", 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "sessions": [], 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout: "mdsmap_epoch": 23 2024-03-18T14:47:44.557 INFO:teuthology.orchestra.run.smithi129.stdout:} 2024-03-18T14:47:44.565 INFO:tasks.fs:confirming client client.0 is blocklisted 2024-03-18T14:47:44.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:44.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.700+0000 7f4837e49700 1 Processor -- start 2024-03-18T14:47:44.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.700+0000 7f4837e49700 1 -- start start 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4837e49700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4837e49700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f483006f9f0 0x7f483013ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4837e49700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48300a3bf0 con 0x7f483006f620 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4837e49700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f483006ed90 con 0x7f483006f9f0 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4837e49700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483006b7b0 con 0x7f4830069200 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57484/0 (socket says 172.21.15.57:57484) 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 -- 172.21.15.57:0/1124043874 learned_addr learned my addr 172.21.15.57:0/1124043874 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:44.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f48363e6700 1 --2- 172.21.15.57:0/1124043874 >> v2:172.21.15.57:3300/0 conn(0x7f483006f9f0 0x7f483013ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 -- 172.21.15.57:0/1124043874 >> v2:172.21.15.57:3300/0 conn(0x7f483006f9f0 msgr2=0x7f483013ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 --2- 172.21.15.57:0/1124043874 >> v2:172.21.15.57:3300/0 conn(0x7f483006f9f0 0x7f483013ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 -- 172.21.15.57:0/1124043874 >> v1:172.21.15.57:6789/0 conn(0x7f483006f620 legacy=0x7f483013e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.701+0000 7f4835be5700 1 -- 172.21.15.57:0/1124043874 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483013e5e0 con 0x7f4830069200 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4835be5700 1 --2- 172.21.15.57:0/1124043874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48200099b0 tx=0x7f4820009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81dbe8581178822f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4834be3700 1 -- 172.21.15.57:0/1124043874 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820009ea0 con 0x7f4830069200 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4834be3700 1 -- 172.21.15.57:0/1124043874 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482000b860 con 0x7f4830069200 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4834be3700 1 -- 172.21.15.57:0/1124043874 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482000bc00 con 0x7f4830069200 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 -- 172.21.15.57:0/1124043874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 msgr2=0x7f483006e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 --2- 172.21.15.57:0/1124043874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48200099b0 tx=0x7f4820009250 comp rx=0 tx=0).stop 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 -- 172.21.15.57:0/1124043874 shutdown_connections 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 --2- 172.21.15.57:0/1124043874 >> v2:172.21.15.57:3300/0 conn(0x7f483006f9f0 0x7f483013ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 --2- 172.21.15.57:0/1124043874 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4830069200 0x7f483006e1b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 -- 172.21.15.57:0/1124043874 >> 172.21.15.57:0/1124043874 conn(0x7f483006af90 msgr2=0x7f4830068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:44.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 -- 172.21.15.57:0/1124043874 shutdown_connections 2024-03-18T14:47:44.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.702+0000 7f4837e49700 1 -- 172.21.15.57:0/1124043874 wait complete. 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.704+0000 7f4837e49700 1 Processor -- start 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.704+0000 7f4837e49700 1 -- start start 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 0x7f4830143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f483006f620 0x7f4830137520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 0x7f4830137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830144120 con 0x7f4830069200 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830139900 con 0x7f483006f9f0 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4830139bc0 con 0x7f483006f620 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4835be5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 0x7f4830143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4835be5700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 0x7f4830143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43656/0 (socket says 172.21.15.57:43656) 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4835be5700 1 -- 172.21.15.57:0/2665120622 learned_addr learned my addr 172.21.15.57:0/2665120622 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 0x7f4830137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:44.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48353e4700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f483006f620 0x7f4830137520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 -- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f483006f620 msgr2=0x7f4830137520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f483006f620 0x7f4830137520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 -- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 msgr2=0x7f4830143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 0x7f4830143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 -- 172.21.15.57:0/2665120622 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48200094f0 con 0x7f483006f9f0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f48363e6700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 0x7f4830137a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4828009e20 tx=0x7f482800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482800caa0 con 0x7f483006f9f0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482800f040 con 0x7f483006f9f0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483013a6d0 con 0x7f483006f9f0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.705+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482800ce70 con 0x7f483006f9f0 2024-03-18T14:47:44.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.706+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483013b390 con 0x7f483006f9f0 2024-03-18T14:47:44.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.707+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483013b0b0 con 0x7f483006f9f0 2024-03-18T14:47:44.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.707+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f4828014690 con 0x7f483006f9f0 2024-03-18T14:47:44.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.707+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f482805bdd0 con 0x7f483006f9f0 2024-03-18T14:47:44.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.711+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f483013b0b0 con 0x7f483006f9f0 2024-03-18T14:47:44.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.873+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f483013b0b0 con 0x7f483006f9f0 2024-03-18T14:47:44.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.873+0000 7f4825ffb700 1 -- 172.21.15.57:0/2665120622 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f483013b0b0 con 0x7f483006f9f0 2024-03-18T14:47:44.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:44.875 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 >> v1:172.21.15.57:6816/47480 conn(0x7f4814046010 legacy=0x7f48140484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 msgr2=0x7f4830137a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 0x7f4830137a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4828009e20 tx=0x7f482800b040 comp rx=0 tx=0).stop 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 shutdown_connections 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f483006f9f0 0x7f4830137a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4830069200 0x7f4830143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 --2- 172.21.15.57:0/2665120622 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f483006f620 0x7f4830137520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 >> 172.21.15.57:0/2665120622 conn(0x7f483006af90 msgr2=0x7f48300b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 shutdown_connections 2024-03-18T14:47:44.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:44.875+0000 7f4837e49700 1 -- 172.21.15.57:0/2665120622 wait complete. 2024-03-18T14:47:44.889 INFO:tasks.fs:confirming client client.1 is blocklisted 2024-03-18T14:47:44.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:45.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.008+0000 7f880099e700 1 Processor -- start 2024-03-18T14:47:45.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.008+0000 7f880099e700 1 -- start start 2024-03-18T14:47:45.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 0x7f87fc13e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc13aba0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc13ae00 con 0x7f87fc13dbb0 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f880099e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc13b0a0 con 0x7f87fc0adef0 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87f9d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 0x7f87fc13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fa59c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43668/0 (socket says 172.21.15.57:43668) 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fa59c700 1 -- 172.21.15.57:0/160484299 learned_addr learned my addr 172.21.15.57:0/160484299 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:45.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87f9d9b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45180/0 (socket says 172.21.15.57:45180) 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 -- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 msgr2=0x7f87fc0ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 -- 172.21.15.57:0/160484299 >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 msgr2=0x7f87fc13a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 --2- 172.21.15.57:0/160484299 >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 -- 172.21.15.57:0/160484299 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0a3bb0 con 0x7f87fc13dbb0 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fa59c700 1 --2- 172.21.15.57:0/160484299 >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87f9d9b700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87fad9d700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 0x7f87fc13e000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009e60 tx=0x7f87f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b1ae1e997627649 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.009+0000 7f87f959a700 1 -- 172.21.15.57:0/160484299 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400e070 con 0x7f87fc13dbb0 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f87f959a700 1 -- 172.21.15.57:0/160484299 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400bab0 con 0x7f87fc13dbb0 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f87f959a700 1 -- 172.21.15.57:0/160484299 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400be70 con 0x7f87fc13dbb0 2024-03-18T14:47:45.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 -- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 msgr2=0x7f87fc13e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 0x7f87fc13e000 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009e60 tx=0x7f87f4009780 comp rx=0 tx=0).stop 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 -- 172.21.15.57:0/160484299 shutdown_connections 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc13dbb0 0x7f87fc13e000 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 --2- 172.21.15.57:0/160484299 >> v2:172.21.15.57:3300/0 conn(0x7f87fc0a4e60 0x7f87fc13a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 --2- 172.21.15.57:0/160484299 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc0adef0 0x7f87fc0ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 -- 172.21.15.57:0/160484299 >> 172.21.15.57:0/160484299 conn(0x7f87fc0679e0 msgr2=0x7f87fc067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 -- 172.21.15.57:0/160484299 shutdown_connections 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.010+0000 7f880099e700 1 -- 172.21.15.57:0/160484299 wait complete. 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.011+0000 7f880099e700 1 Processor -- start 2024-03-18T14:47:45.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.011+0000 7f880099e700 1 -- start start 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 0x7f87fc0a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 0x7f87fc149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0a70c0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc13a670 con 0x7f87fc0adef0 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc149b00 con 0x7f87fc13dbb0 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43670/0 (socket says 172.21.15.57:43670) 2024-03-18T14:47:45.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 -- 172.21.15.57:0/1449792927 learned_addr learned my addr 172.21.15.57:0/1449792927 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fad9d700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 0x7f87fc149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87f9d9b700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 0x7f87fc0a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 -- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 msgr2=0x7f87fc149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 0x7f87fc149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 -- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 msgr2=0x7f87fc0a9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 0x7f87fc0a9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 -- 172.21.15.57:0/1449792927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f000b780 con 0x7f87fc0a4e60 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87f9d9b700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 0x7f87fc0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fad9d700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 0x7f87fc149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87fa59c700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87f0010170 tx=0x7f87f000f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0012040 con 0x7f87fc0a4e60 2024-03-18T14:47:45.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f0010cb0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec009420 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f0018410 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.012+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4009a20 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.013+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc0a73c0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.013+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f87f0018840 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.014+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f87f005d7b0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.017+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f87fc0a73c0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.181+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87fc0a73c0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.181+0000 7f87ea7fc700 1 -- 172.21.15.57:0/1449792927 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f87fc0a73c0 con 0x7f87fc0a4e60 2024-03-18T14:47:45.183 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:45.183 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 >> v1:172.21.15.57:6816/47480 conn(0x7f87dc046010 legacy=0x7f87dc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 msgr2=0x7f87fc0a8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f87f0010170 tx=0x7f87f000f040 comp rx=0 tx=0).stop 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 shutdown_connections 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f87fc13dbb0 0x7f87fc149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87fc0a4e60 0x7f87fc0a8cc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 --2- 172.21.15.57:0/1449792927 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f87fc0adef0 0x7f87fc0a9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 >> 172.21.15.57:0/1449792927 conn(0x7f87fc0679e0 msgr2=0x7f87fc0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 shutdown_connections 2024-03-18T14:47:45.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.183+0000 7f880099e700 1 -- 172.21.15.57:0/1449792927 wait complete. 2024-03-18T14:47:45.197 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-03-18T14:47:45.209 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2024-03-18T14:47:45.224 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-03-18T14:47:45.239 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-03-18T14:47:45.255 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-03-18T14:47:45.282 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-18T14:47:45.298 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-18T14:47:45.298 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:47:45.298 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T14:47:45.321 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2024-03-18T14:47:45.321 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T14:47:45.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.504+0000 7fde1e8bf700 1 Processor -- start 2024-03-18T14:47:45.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.504+0000 7fde1e8bf700 1 -- start start 2024-03-18T14:47:45.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1e8bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 0x7fde180ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1e8bf700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde180a5f00 0x7fde181468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1e8bf700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde180ae840 con 0x7fde180a5af0 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1e8bf700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde180ad670 con 0x7fde180a5f00 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1e8bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde1813c240 con 0x7fde18063840 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1ce5c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde180a5f00 0x7fde181468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde177fe700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fde180a5af0 0x7fde18139160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33716/0 (socket says 172.21.15.57:33716) 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde17fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 0x7fde180ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde177fe700 1 -- 172.21.15.57:0/4204889203 learned_addr learned my addr 172.21.15.57:0/4204889203 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde16ffd700 1 -- 172.21.15.57:0/4204889203 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310354066 0 0) 0x7fde180ae840 con 0x7fde180a5af0 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1ce5c700 1 -- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 msgr2=0x7fde180ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1ce5c700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 0x7fde180ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1ce5c700 1 -- 172.21.15.57:0/4204889203 >> v1:172.21.15.57:6789/0 conn(0x7fde180a5af0 legacy=0x7fde18139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde1ce5c700 1 -- 172.21.15.57:0/4204889203 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1813c500 con 0x7fde180a5f00 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.505+0000 7fde17fff700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 0x7fde180ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1ce5c700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde181468d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde10009e60 tx=0x7fde10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34777c444f21b26b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde16ffd700 1 -- 172.21.15.57:0/4204889203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000e070 con 0x7fde180a5f00 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde16ffd700 1 -- 172.21.15.57:0/4204889203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000bbf0 con 0x7fde180a5f00 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde16ffd700 1 -- 172.21.15.57:0/4204889203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde10012430 con 0x7fde180a5f00 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 -- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 msgr2=0x7fde181468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde181468d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fde10009e60 tx=0x7fde10009780 comp rx=0 tx=0).stop 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 -- 172.21.15.57:0/4204889203 shutdown_connections 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde181468d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/4204889203 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde18063840 0x7fde180ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 -- 172.21.15.57:0/4204889203 >> 172.21.15.57:0/4204889203 conn(0x7fde1806f500 msgr2=0x7fde1806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 -- 172.21.15.57:0/4204889203 shutdown_connections 2024-03-18T14:47:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.506+0000 7fde1e8bf700 1 -- 172.21.15.57:0/4204889203 wait complete. 2024-03-18T14:47:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.507+0000 7fde1e8bf700 1 Processor -- start 2024-03-18T14:47:45.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.507+0000 7fde1e8bf700 1 -- start start 2024-03-18T14:47:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde18063840 0x7fde180a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde180a7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde18138bb0 con 0x7fde180a5f00 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde180aac10 con 0x7fde18063840 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1e8bf700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde180aa430 con 0x7fde180a5af0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde17fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde18063840 0x7fde180a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45202/0 (socket says 172.21.15.57:45202) 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 -- 172.21.15.57:0/3636015484 learned_addr learned my addr 172.21.15.57:0/3636015484 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde1ce5c700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde180a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 -- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde18063840 msgr2=0x7fde180a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde18063840 0x7fde180a67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 -- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 msgr2=0x7fde180a7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde180a7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.508+0000 7fde177fe700 1 -- 172.21.15.57:0/3636015484 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08009420 con 0x7fde180a5af0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde177fe700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c7e0 tx=0x7fde00007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00005b30 con 0x7fde180a5af0 2024-03-18T14:47:45.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00005cb0 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00007320 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde10009a20 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.509+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde180a7e50 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.510+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde18065180 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.510+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fde0001b3b0 con 0x7fde180a5af0 2024-03-18T14:47:45.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.510+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fde0005a610 con 0x7fde180a5af0 2024-03-18T14:47:45.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.514+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fde00038770 con 0x7fde180a5af0 2024-03-18T14:47:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.679+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde180aad80 con 0x7fde180a5af0 2024-03-18T14:47:45.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.680+0000 7fde0ffff700 1 -- 172.21.15.57:0/3636015484 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7fde00017070 con 0x7fde180a5af0 2024-03-18T14:47:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:45.682 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 >> v1:172.21.15.57:6816/47480 conn(0x7fddf8046010 legacy=0x7fddf80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 msgr2=0x7fde180a6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c7e0 tx=0x7fde00007d70 comp rx=0 tx=0).stop 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 shutdown_connections 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde180a5f00 0x7fde180a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fde18063840 0x7fde180a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 --2- 172.21.15.57:0/3636015484 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fde180a5af0 0x7fde180a6ce0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 >> 172.21.15.57:0/3636015484 conn(0x7fde1806f500 msgr2=0x7fde18068130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 shutdown_connections 2024-03-18T14:47:45.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.682+0000 7fde1e8bf700 1 -- 172.21.15.57:0/3636015484 wait complete. 2024-03-18T14:47:45.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:47:45.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.818+0000 7f69e787a700 1 Processor -- start 2024-03-18T14:47:45.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.818+0000 7f69e787a700 1 -- start start 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e787a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 0x7f69e00a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e787a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 0x7f69e0148a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e787a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e006fd10 con 0x7f69e00a4730 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e787a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e006a7d0 con 0x7f69e0068340 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e787a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00b07e0 con 0x7f69e0146690 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5616700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 0x7f69e00a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5e17700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 0x7f69e0148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e4e15700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f69e00a4730 0x7f69e006a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33728/0 (socket says 172.21.15.57:33728) 2024-03-18T14:47:45.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e4e15700 1 -- 172.21.15.57:0/3017540743 learned_addr learned my addr 172.21.15.57:0/3017540743 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:45.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5e17700 1 -- 172.21.15.57:0/3017540743 >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 msgr2=0x7f69e00a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:45.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5e17700 1 --2- 172.21.15.57:0/3017540743 >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 0x7f69e00a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5e17700 1 -- 172.21.15.57:0/3017540743 >> v1:172.21.15.57:6789/0 conn(0x7f69e00a4730 legacy=0x7f69e006a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5e17700 1 -- 172.21.15.57:0/3017540743 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00697a0 con 0x7f69e0146690 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.819+0000 7f69e5616700 1 --2- 172.21.15.57:0/3017540743 >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 0x7f69e00a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e5e17700 1 --2- 172.21.15.57:0/3017540743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 0x7f69e0148a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009e90 tx=0x7f69d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dda7070a8af1669 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69d7fff700 1 -- 172.21.15.57:0/3017540743 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800e070 con 0x7f69e0146690 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69d7fff700 1 -- 172.21.15.57:0/3017540743 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800bbf0 con 0x7f69e0146690 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69d7fff700 1 -- 172.21.15.57:0/3017540743 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d8012430 con 0x7f69e0146690 2024-03-18T14:47:45.825 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 -- 172.21.15.57:0/3017540743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 msgr2=0x7f69e0148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 --2- 172.21.15.57:0/3017540743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 0x7f69e0148a70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009e90 tx=0x7f69d8009780 comp rx=0 tx=0).stop 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 -- 172.21.15.57:0/3017540743 shutdown_connections 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 --2- 172.21.15.57:0/3017540743 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0146690 0x7f69e0148a70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 --2- 172.21.15.57:0/3017540743 >> v2:172.21.15.57:3300/0 conn(0x7f69e0068340 0x7f69e00a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 -- 172.21.15.57:0/3017540743 >> 172.21.15.57:0/3017540743 conn(0x7f69e006be90 msgr2=0x7f69e00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 -- 172.21.15.57:0/3017540743 shutdown_connections 2024-03-18T14:47:45.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.820+0000 7f69e787a700 1 -- 172.21.15.57:0/3017540743 wait complete. 2024-03-18T14:47:45.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.821+0000 7f69e787a700 1 Processor -- start 2024-03-18T14:47:45.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.821+0000 7f69e787a700 1 -- start start 2024-03-18T14:47:45.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 0x7f69e00974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f69e0146690 0x7f69e00aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0096d80 con 0x7f69e00a4730 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0152330 con 0x7f69e0146690 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e787a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00ae710 con 0x7f69e0068340 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e5616700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e4e15700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 0x7f69e00974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e5616700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45210/0 (socket says 172.21.15.57:45210) 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e5616700 1 -- 172.21.15.57:0/84817907 learned_addr learned my addr 172.21.15.57:0/84817907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.822+0000 7f69e5e17700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f69e0146690 0x7f69e00aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 -- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f69e0146690 msgr2=0x7f69e00aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f69e0146690 0x7f69e00aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 -- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 msgr2=0x7f69e00974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 0x7f69e00974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 -- 172.21.15.57:0/84817907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0009420 con 0x7f69e0068340 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e4e15700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 0x7f69e00974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:45.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e5616700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69d000ec80 tx=0x7f69d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000c920 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d000ca80 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d000ce00 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d8009a20 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.823+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e0097a30 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.824+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e00ae2c0 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.824+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f69d0013680 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.825+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f69d005bcf0 con 0x7f69e0068340 2024-03-18T14:47:45.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.828+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f69d0039ed0 con 0x7f69e0068340 2024-03-18T14:47:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.987+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69e00651b0 con 0x7f69e0068340 2024-03-18T14:47:45.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.987+0000 7f69d57fa700 1 -- 172.21.15.57:0/84817907 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69d003d6c0 con 0x7f69e0068340 2024-03-18T14:47:45.989 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 >> v1:172.21.15.57:6816/47480 conn(0x7f69c4046010 legacy=0x7f69c40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 msgr2=0x7f69e0151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f69d000ec80 tx=0x7f69d00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 shutdown_connections 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f69e0146690 0x7f69e00aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f69e0068340 0x7f69e0151df0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 --2- 172.21.15.57:0/84817907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69e00a4730 0x7f69e00974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 >> 172.21.15.57:0/84817907 conn(0x7f69e006be90 msgr2=0x7f69e0143ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:45.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 shutdown_connections 2024-03-18T14:47:45.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:45.989+0000 7f69e787a700 1 -- 172.21.15.57:0/84817907 wait complete. 2024-03-18T14:47:46.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.124+0000 7fdb475d4700 1 Processor -- start 2024-03-18T14:47:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.124+0000 7fdb475d4700 1 -- start start 2024-03-18T14:47:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 0x7fdb400ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400abfd0 con 0x7fdb40063a70 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400ad900 con 0x7fdb400ac3e0 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb475d4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400ac990 con 0x7fdb400aa710 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb45b71700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb45370700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 0x7fdb400ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45222/0 (socket says 172.21.15.57:45222) 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb45b71700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57528/0 (socket says 172.21.15.57:57528) 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 -- 172.21.15.57:0/3659485360 learned_addr learned my addr 172.21.15.57:0/3659485360 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 -- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 msgr2=0x7fdb4013db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 -- 172.21.15.57:0/3659485360 >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 msgr2=0x7fdb400ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:46.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/3659485360 >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 0x7fdb400ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 -- 172.21.15.57:0/3659485360 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400acc30 con 0x7fdb400aa710 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb45b71700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb45370700 1 --2- 172.21.15.57:0/3659485360 >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 0x7fdb400ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.125+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0099e0 tx=0x7fdb3c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6703244de27dd8cf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb37fff700 1 -- 172.21.15.57:0/3659485360 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00b6d0 con 0x7fdb400aa710 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb37fff700 1 -- 172.21.15.57:0/3659485360 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c00b830 con 0x7fdb400aa710 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb37fff700 1 -- 172.21.15.57:0/3659485360 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00bbd0 con 0x7fdb400aa710 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 -- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 msgr2=0x7fdb4013d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c0099e0 tx=0x7fdb3c009250 comp rx=0 tx=0).stop 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 -- 172.21.15.57:0/3659485360 shutdown_connections 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb400ac3e0 0x7fdb4013db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 --2- 172.21.15.57:0/3659485360 >> v2:172.21.15.57:3300/0 conn(0x7fdb40063a70 0x7fdb400ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 --2- 172.21.15.57:0/3659485360 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb4013d600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 -- 172.21.15.57:0/3659485360 >> 172.21.15.57:0/3659485360 conn(0x7fdb4006f580 msgr2=0x7fdb4006f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 -- 172.21.15.57:0/3659485360 shutdown_connections 2024-03-18T14:47:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.126+0000 7fdb475d4700 1 -- 172.21.15.57:0/3659485360 wait complete. 2024-03-18T14:47:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.127+0000 7fdb475d4700 1 Processor -- start 2024-03-18T14:47:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.127+0000 7fdb475d4700 1 -- start start 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 0x7fdb4011b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb400ac3e0 0x7fdb40151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb401195b0 con 0x7fdb400ac3e0 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40118ff0 con 0x7fdb40063a70 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb475d4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4011b5f0 con 0x7fdb400aa710 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb45370700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 0x7fdb4011b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb45370700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 0x7fdb4011b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57536/0 (socket says 172.21.15.57:57536) 2024-03-18T14:47:46.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45238/0 (socket says 172.21.15.57:45238) 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb45370700 1 -- 172.21.15.57:0/1048800681 learned_addr learned my addr 172.21.15.57:0/1048800681 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb45b71700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb400ac3e0 0x7fdb40151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 -- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 msgr2=0x7fdb4011b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 0x7fdb4011b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 -- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb400ac3e0 msgr2=0x7fdb40151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb400ac3e0 0x7fdb40151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.128+0000 7fdb44b6f700 1 -- 172.21.15.57:0/1048800681 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30009420 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb44b6f700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb400b23a0 tx=0x7fdb3c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00bbb0 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c011420 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb38009a20 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c011820 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.129+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c0094f0 con 0x7fdb400aa710 2024-03-18T14:47:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.130+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb40065180 con 0x7fdb400aa710 2024-03-18T14:47:46.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.130+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fdb3c011c10 con 0x7fdb400aa710 2024-03-18T14:47:46.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.130+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fdb3c05ca40 con 0x7fdb400aa710 2024-03-18T14:47:46.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.134+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fdb3c05ee60 con 0x7fdb400aa710 2024-03-18T14:47:46.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.293+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb400b1760 con 0x7fdb400aa710 2024-03-18T14:47:46.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.293+0000 7fdb357fa700 1 -- 172.21.15.57:0/1048800681 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb3c015020 con 0x7fdb400aa710 2024-03-18T14:47:46.295 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 >> v1:172.21.15.57:6816/47480 conn(0x7fdb24046010 legacy=0x7fdb240484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 msgr2=0x7fdb401512f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb400b23a0 tx=0x7fdb3c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 shutdown_connections 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb400ac3e0 0x7fdb40151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fdb40063a70 0x7fdb4011b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 --2- 172.21.15.57:0/1048800681 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fdb400aa710 0x7fdb401512f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 >> 172.21.15.57:0/1048800681 conn(0x7fdb4006f580 msgr2=0x7fdb400679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 shutdown_connections 2024-03-18T14:47:46.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.295+0000 7fdb475d4700 1 -- 172.21.15.57:0/1048800681 wait complete. 2024-03-18T14:47:46.309 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 Processor -- start 2024-03-18T14:47:46.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 -- start start 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bc00a70f0 0x7f6bc013fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 0x7f6bc0146930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc00a5590 con 0x7f6bc00680f0 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc013f710 con 0x7f6bc00a70f0 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc8784700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc013f9d0 con 0x7f6bc01401c0 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc5d1f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bc00a70f0 0x7f6bc013fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc6d21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 0x7f6bc0146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc5d1f700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bc00a70f0 0x7f6bc013fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43752/0 (socket says 172.21.15.57:43752) 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc6d21700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 0x7f6bc0146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57550/0 (socket says 172.21.15.57:57550) 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 -- 172.21.15.57:0/3764962062 learned_addr learned my addr 172.21.15.57:0/3764962062 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.431+0000 7f6bc6520700 1 --1- 172.21.15.57:0/3764962062 >> v1:172.21.15.57:6789/0 conn(0x7f6bc00680f0 0x7f6bc00a4a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33742/0 (socket says 172.21.15.57:33742) 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 -- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 msgr2=0x7f6bc0146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 --2- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 0x7f6bc0146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 -- 172.21.15.57:0/3764962062 >> v1:172.21.15.57:6789/0 conn(0x7f6bc00680f0 legacy=0x7f6bc00a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 -- 172.21.15.57:0/3764962062 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00a44c0 con 0x7f6bc00a70f0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc551e700 1 -- 172.21.15.57:0/3764962062 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260174275 0 0) 0x7f6bc00a5590 con 0x7f6bc00680f0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc5d1f700 1 --2- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00a70f0 0x7f6bc013fc80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00099b0 tx=0x7f6bb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8563562e640e87c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc551e700 1 -- 172.21.15.57:0/3764962062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0009ea0 con 0x7f6bc00a70f0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc551e700 1 -- 172.21.15.57:0/3764962062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000b860 con 0x7f6bc00a70f0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.432+0000 7f6bc551e700 1 -- 172.21.15.57:0/3764962062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000bc00 con 0x7f6bc00a70f0 2024-03-18T14:47:46.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 -- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00a70f0 msgr2=0x7f6bc013fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00a70f0 0x7f6bc013fc80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00099b0 tx=0x7f6bb0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 -- 172.21.15.57:0/3764962062 shutdown_connections 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc01401c0 0x7f6bc0146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3764962062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00a70f0 0x7f6bc013fc80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 -- 172.21.15.57:0/3764962062 >> 172.21.15.57:0/3764962062 conn(0x7f6bc006be90 msgr2=0x7f6bc00679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 -- 172.21.15.57:0/3764962062 shutdown_connections 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.433+0000 7f6bc8784700 1 -- 172.21.15.57:0/3764962062 wait complete. 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 Processor -- start 2024-03-18T14:47:46.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 -- start start 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bc01401c0 0x7f6bc0151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00af7f0 con 0x7f6bc00680f0 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00aead0 con 0x7f6bc00a70f0 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc8784700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00afd10 con 0x7f6bc01401c0 2024-03-18T14:47:46.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc6520700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc5d1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc6520700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43760/0 (socket says 172.21.15.57:43760) 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc6520700 1 -- 172.21.15.57:0/3383375168 learned_addr learned my addr 172.21.15.57:0/3383375168 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc5d1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57562/0 (socket says 172.21.15.57:57562) 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.434+0000 7f6bc6d21700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bc01401c0 0x7f6bc0151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 -- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bc01401c0 msgr2=0x7f6bc0151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bc01401c0 0x7f6bc0151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 -- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 msgr2=0x7f6bc00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 -- 172.21.15.57:0/3383375168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00094f0 con 0x7f6bc00680f0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc5d1f700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc6520700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c560 tx=0x7f6bbc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc005a70 con 0x7f6bc00680f0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc005bd0 con 0x7f6bc00680f0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc00ad7d0 con 0x7f6bc00680f0 2024-03-18T14:47:46.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc0070d0 con 0x7f6bc00680f0 2024-03-18T14:47:46.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.435+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc006a590 con 0x7f6bc00680f0 2024-03-18T14:47:46.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.436+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0065180 con 0x7f6bc00680f0 2024-03-18T14:47:46.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.436+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f6bbc0074c0 con 0x7f6bc00680f0 2024-03-18T14:47:46.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.436+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f6bbc05a660 con 0x7f6bc00680f0 2024-03-18T14:47:46.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.440+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f6bbc038820 con 0x7f6bc00680f0 2024-03-18T14:47:46.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.599+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bc00a75f0 con 0x7f6bc00680f0 2024-03-18T14:47:46.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.600+0000 7f6bb67fc700 1 -- 172.21.15.57:0/3383375168 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bbc017020 con 0x7f6bc00680f0 2024-03-18T14:47:46.601 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.601+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 >> v1:172.21.15.57:6816/47480 conn(0x7f6ba4046010 legacy=0x7f6ba40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.601+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 msgr2=0x7f6bc00af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.601+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00c560 tx=0x7f6bbc007f60 comp rx=0 tx=0).stop 2024-03-18T14:47:46.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 shutdown_connections 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bc01401c0 0x7f6bc0151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bc00680f0 0x7f6bc00af2b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 --2- 172.21.15.57:0/3383375168 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bc00a70f0 0x7f6bc00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 >> 172.21.15.57:0/3383375168 conn(0x7f6bc006be90 msgr2=0x7f6bc013d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 shutdown_connections 2024-03-18T14:47:46.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.602+0000 7f6bc8784700 1 -- 172.21.15.57:0/3383375168 wait complete. 2024-03-18T14:47:46.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:46.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.738+0000 7f9a10465700 1 Processor -- start 2024-03-18T14:47:46.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.738+0000 7f9a10465700 1 -- start start 2024-03-18T14:47:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a10465700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a080aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a10465700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 0x7f9a08149e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a10465700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a080a9fe0 con 0x7f9a080a8700 2024-03-18T14:47:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a10465700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080a4da0 con 0x7f9a0813ec50 2024-03-18T14:47:46.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a10465700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08141dd0 con 0x7f9a08142770 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0da00700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9a080a8700 0x7f9a0813e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33758/0 (socket says 172.21.15.57:33758) 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0da00700 1 -- 172.21.15.57:0/3881443871 learned_addr learned my addr 172.21.15.57:0/3881443871 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0ea02700 1 --2- 172.21.15.57:0/3881443871 >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 0x7f9a08149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0e201700 1 --2- 172.21.15.57:0/3881443871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a080aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0d1ff700 1 -- 172.21.15.57:0/3881443871 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746461323 0 0) 0x7f9a080a9fe0 con 0x7f9a080a8700 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0d1ff700 1 -- 172.21.15.57:0/3881443871 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f4003570 con 0x7f9a080a8700 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0e201700 1 -- 172.21.15.57:0/3881443871 >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 msgr2=0x7f9a08149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0e201700 1 --2- 172.21.15.57:0/3881443871 >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 0x7f9a08149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0e201700 1 -- 172.21.15.57:0/3881443871 >> v1:172.21.15.57:6789/0 conn(0x7f9a080a8700 legacy=0x7f9a0813e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0e201700 1 -- 172.21.15.57:0/3881443871 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a08142070 con 0x7f9a08142770 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.739+0000 7f9a0ea02700 1 --2- 172.21.15.57:0/3881443871 >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 0x7f9a08149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a0e201700 1 --2- 172.21.15.57:0/3881443871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a080aa4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a040098e0 tx=0x7f9a040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd1b014b7b9be7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a0d1ff700 1 -- 172.21.15.57:0/3881443871 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011630 con 0x7f9a08142770 2024-03-18T14:47:46.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a0d1ff700 1 -- 172.21.15.57:0/3881443871 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04011790 con 0x7f9a08142770 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a0d1ff700 1 -- 172.21.15.57:0/3881443871 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011b30 con 0x7f9a08142770 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a10465700 1 -- 172.21.15.57:0/3881443871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 msgr2=0x7f9a080aa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.740+0000 7f9a10465700 1 --2- 172.21.15.57:0/3881443871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a080aa4e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9a040098e0 tx=0x7f9a040091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 -- 172.21.15.57:0/3881443871 shutdown_connections 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 --2- 172.21.15.57:0/3881443871 >> v2:172.21.15.57:3300/0 conn(0x7f9a0813ec50 0x7f9a08149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 --2- 172.21.15.57:0/3881443871 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a080aa4e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 -- 172.21.15.57:0/3881443871 >> 172.21.15.57:0/3881443871 conn(0x7f9a08063880 msgr2=0x7f9a0806f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 -- 172.21.15.57:0/3881443871 shutdown_connections 2024-03-18T14:47:46.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.741+0000 7f9a10465700 1 -- 172.21.15.57:0/3881443871 wait complete. 2024-03-18T14:47:46.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 Processor -- start 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 -- start start 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 0x7f9a080ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080ae110 con 0x7f9a0813ec50 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080b0910 con 0x7f9a080a8700 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a10465700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a080aef00 con 0x7f9a08142770 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0ea02700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0e201700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 0x7f9a080ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0da00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0ea02700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45266/0 (socket says 172.21.15.57:45266) 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0e201700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 0x7f9a080ae9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57578/0 (socket says 172.21.15.57:57578) 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0da00700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43770/0 (socket says 172.21.15.57:43770) 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.742+0000 7f9a0ea02700 1 -- 172.21.15.57:0/3664617925 learned_addr learned my addr 172.21.15.57:0/3664617925 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 -- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 msgr2=0x7f9a080ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 0x7f9a080ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 -- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 msgr2=0x7f9a081519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 -- 172.21.15.57:0/3664617925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009a20 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0da00700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a0ea02700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009f50 tx=0x7f9a0000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000cbe0 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000f040 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00014480 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a04009420 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.743+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a080b15a0 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.744+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9a00003020 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.744+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a08065180 con 0x7f9a08142770 2024-03-18T14:47:46.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.744+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f9a0005bbc0 con 0x7f9a08142770 2024-03-18T14:47:46.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.748+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f9a00039e40 con 0x7f9a08142770 2024-03-18T14:47:46.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.906+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a08141b10 con 0x7f9a08142770 2024-03-18T14:47:46.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.907+0000 7f99fe7fc700 1 -- 172.21.15.57:0/3664617925 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a00018030 con 0x7f9a08142770 2024-03-18T14:47:46.909 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:46.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.908+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 >> v1:172.21.15.57:6816/47480 conn(0x7f99ec046010 legacy=0x7f99ec0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.908+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 msgr2=0x7f9a08151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:46.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.908+0000 7f9a10465700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009f50 tx=0x7f9a0000b040 comp rx=0 tx=0).stop 2024-03-18T14:47:46.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 shutdown_connections 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9a08142770 0x7f9a08151f20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9a080a8700 0x7f9a080ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 --2- 172.21.15.57:0/3664617925 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9a0813ec50 0x7f9a081519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 >> 172.21.15.57:0/3664617925 conn(0x7f9a08063880 msgr2=0x7f9a080b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 shutdown_connections 2024-03-18T14:47:46.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:46.909+0000 7f9a10465700 1 -- 172.21.15.57:0/3664617925 wait complete. 2024-03-18T14:47:46.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.042+0000 7f9622891700 1 Processor -- start 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.042+0000 7f9622891700 1 -- start start 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.042+0000 7f9622891700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f961c0a4910 0x7f961c13b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9622891700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 0x7f961c145c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9622891700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f961c0a3c40 con 0x7f961c0b22a0 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9622891700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961c0a3740 con 0x7f961c0a4910 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9622891700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c13af20 con 0x7f961c143850 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f961c0a4910 0x7f961c13b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9620e2e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 0x7f961c145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f961c0b22a0 0x7f961c0a3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33772/0 (socket says 172.21.15.57:33772) 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961bfff700 1 -- 172.21.15.57:0/34624949 learned_addr learned my addr 172.21.15.57:0/34624949 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 -- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 msgr2=0x7f961c145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 0x7f961c145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 -- 172.21.15.57:0/34624949 >> v1:172.21.15.57:6789/0 conn(0x7f961c0b22a0 legacy=0x7f961c0a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 -- 172.21.15.57:0/34624949 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c13b110 con 0x7f961c0a4910 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961affd700 1 -- 172.21.15.57:0/34624949 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772590458 0 0) 0x7f961c0a3c40 con 0x7f961c0b22a0 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f9620e2e700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 0x7f961c145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961b7fe700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c0a4910 0x7f961c13b760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098e0 tx=0x7f960c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8400967e756b06e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961affd700 1 -- 172.21.15.57:0/34624949 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00b640 con 0x7f961c0a4910 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961affd700 1 -- 172.21.15.57:0/34624949 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00b7a0 con 0x7f961c0a4910 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.043+0000 7f961affd700 1 -- 172.21.15.57:0/34624949 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c00bb40 con 0x7f961c0a4910 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 -- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c0a4910 msgr2=0x7f961c13b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c0a4910 0x7f961c13b760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098e0 tx=0x7f960c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 -- 172.21.15.57:0/34624949 shutdown_connections 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c143850 0x7f961c145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 --2- 172.21.15.57:0/34624949 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c0a4910 0x7f961c13b760 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 -- 172.21.15.57:0/34624949 >> 172.21.15.57:0/34624949 conn(0x7f961c06d1f0 msgr2=0x7f961c06af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 -- 172.21.15.57:0/34624949 shutdown_connections 2024-03-18T14:47:47.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.044+0000 7f9622891700 1 -- 172.21.15.57:0/34624949 wait complete. 2024-03-18T14:47:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.045+0000 7f9622891700 1 Processor -- start 2024-03-18T14:47:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.045+0000 7f9622891700 1 -- start start 2024-03-18T14:47:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 0x7f961c0a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 0x7f961c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0a7a60 con 0x7f961c143850 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0a7220 con 0x7f961c0b22a0 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f961c0a67d0 con 0x7f961c0a4910 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 0x7f961c0a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9620e2e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 0x7f961c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57582/0 (socket says 172.21.15.57:57582) 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 -- 172.21.15.57:0/4224325786 learned_addr learned my addr 172.21.15.57:0/4224325786 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:47.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 -- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 msgr2=0x7f961c0a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 0x7f961c0a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 -- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 msgr2=0x7f961c14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 0x7f961c14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 -- 172.21.15.57:0/4224325786 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9614009a20 con 0x7f961c0b22a0 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9620e2e700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 0x7f961c14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961bfff700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 0x7f961c0a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f961b7fe700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f960c013000 tx=0x7f960c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c000d10 con 0x7f961c0b22a0 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c00bb20 con 0x7f961c0b22a0 2024-03-18T14:47:47.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c009420 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c011650 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.046+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c13e7a0 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.048+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c065180 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.048+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f960c011a00 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.048+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f960c05c6a0 con 0x7f961c0b22a0 2024-03-18T14:47:47.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.052+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f960c005f10 con 0x7f961c0b22a0 2024-03-18T14:47:47.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.226+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f961c13a270 con 0x7f961c0b22a0 2024-03-18T14:47:47.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.227+0000 7f9613fff700 1 -- 172.21.15.57:0/4224325786 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 7 entries v42) v1 ==== 80+0+408 (secure 0 0 0) 0x7f960c015020 con 0x7f961c0b22a0 2024-03-18T14:47:47.228 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2355346234 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2550387238 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1711862619 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.129:0/1814197221 2024-03-18T15:47:36.508336+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6816/39496 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6819/2329339569 2024-03-19T14:47:18.613680+0000 2024-03-18T14:47:47.229 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/2493486388 2024-03-18T15:47:36.508029+0000 2024-03-18T14:47:47.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 >> v1:172.21.15.57:6816/47480 conn(0x7f95fc046010 legacy=0x7f95fc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 msgr2=0x7f961c14e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f960c013000 tx=0x7f960c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:47.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 shutdown_connections 2024-03-18T14:47:47.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f961c143850 0x7f961c14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f961c0a4910 0x7f961c0a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 --2- 172.21.15.57:0/4224325786 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f961c0b22a0 0x7f961c14e200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.228+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 >> 172.21.15.57:0/4224325786 conn(0x7f961c06d1f0 msgr2=0x7f961c13b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.229+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 shutdown_connections 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.229+0000 7f9622891700 1 -- 172.21.15.57:0/4224325786 wait complete. 2024-03-18T14:47:47.231 INFO:teuthology.orchestra.run.smithi057.stderr:listed 7 entries 2024-03-18T14:47:47.242 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.0 2024-03-18T14:47:47.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:47.242 DEBUG:teuthology.orchestra.run.smithi087:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.0 2024-03-18T14:47:47.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi087.stderr:ceph-fuse[37291]: fuse finished with error 0 and tester_r 0 2024-03-18T14:47:47.283 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi087.front.sepia.ceph.com 2024-03-18T14:47:47.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:47.283 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-18T14:47:47.356 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:47:47.356 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T14:47:47.378 DEBUG:teuthology.orchestra.run.smithi129:> set -ex 2024-03-18T14:47:47.378 DEBUG:teuthology.orchestra.run.smithi129:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T14:47:47.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.560+0000 7f7c32a44700 1 Processor -- start 2024-03-18T14:47:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.560+0000 7f7c32a44700 1 -- start start 2024-03-18T14:47:47.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c2c06f620 0x7f7c2c13e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0a3bf0 con 0x7f7c2c06f620 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06ed90 con 0x7f7c2c06f9f0 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c32a44700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06b7b0 con 0x7f7c2c069200 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c2c06f620 0x7f7c2c13e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c30fe1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2bfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45292/0 (socket says 172.21.15.57:45292) 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7c2c06f620 0x7f7c2c13e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43796/0 (socket says 172.21.15.57:43796) 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2bfff700 1 -- 172.21.15.57:0/1558434287 learned_addr learned my addr 172.21.15.57:0/1558434287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 msgr2=0x7f7c2c06e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:47.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 msgr2=0x7f7c2c13edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c13edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/1558434287 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c13e5e0 con 0x7f7c2c06f620 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2bfff700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c30fe1700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.561+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c06f620 0x7f7c2c13e880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c140098e0 tx=0x7f7c140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35180e98a8a8bb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c2affd700 1 -- 172.21.15.57:0/1558434287 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14011630 con 0x7f7c2c06f620 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c2affd700 1 -- 172.21.15.57:0/1558434287 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14011790 con 0x7f7c2c06f620 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c2affd700 1 -- 172.21.15.57:0/1558434287 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14011b30 con 0x7f7c2c06f620 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 -- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c06f620 msgr2=0x7f7c2c13e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c06f620 0x7f7c2c13e880 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c140098e0 tx=0x7f7c140091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 -- 172.21.15.57:0/1558434287 shutdown_connections 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c069200 0x7f7c2c06e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 --2- 172.21.15.57:0/1558434287 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c06f620 0x7f7c2c13e880 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 -- 172.21.15.57:0/1558434287 >> 172.21.15.57:0/1558434287 conn(0x7f7c2c06af90 msgr2=0x7f7c2c068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 -- 172.21.15.57:0/1558434287 shutdown_connections 2024-03-18T14:47:47.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.562+0000 7f7c32a44700 1 -- 172.21.15.57:0/1558434287 wait complete. 2024-03-18T14:47:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.563+0000 7f7c32a44700 1 Processor -- start 2024-03-18T14:47:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.563+0000 7f7c32a44700 1 -- start start 2024-03-18T14:47:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c069200 0x7f7c2c14b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0a8bc0 con 0x7f7c2c069200 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14be30 con 0x7f7c2c06f9f0 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c32a44700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14c0f0 con 0x7f7c2c06f620 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45304/0 (socket says 172.21.15.57:45304) 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/2752227760 learned_addr learned my addr 172.21.15.57:0/2752227760 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c30fe1700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2bfff700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c069200 0x7f7c2c14b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 msgr2=0x7f7c2c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c069200 msgr2=0x7f7c2c14b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c069200 0x7f7c2c14b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.564+0000 7f7c2b7fe700 1 -- 172.21.15.57:0/2752227760 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0094f0 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c2b7fe700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0a3d30 tx=0x7f7c14017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14020070 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14011b10 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c24009a20 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14024680 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.565+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c14009420 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.566+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c06e1b0 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.566+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f7c1402d3b0 con 0x7f7c2c06f620 2024-03-18T14:47:47.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.567+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f7c1405e800 con 0x7f7c2c06f620 2024-03-18T14:47:47.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.570+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f7c14006300 con 0x7f7c2c06f620 2024-03-18T14:47:47.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.736+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c2c065180 con 0x7f7c2c06f620 2024-03-18T14:47:47.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.736+0000 7f7c23fff700 1 -- 172.21.15.57:0/2752227760 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f7c14015020 con 0x7f7c2c06f620 2024-03-18T14:47:47.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:47.738 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 >> v1:172.21.15.57:6816/47480 conn(0x7f7c0c046010 legacy=0x7f7c0c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 msgr2=0x7f7c2c14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0a3d30 tx=0x7f7c14017000 comp rx=0 tx=0).stop 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 shutdown_connections 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7c2c06f9f0 0x7f7c2c14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7c2c069200 0x7f7c2c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 --2- 172.21.15.57:0/2752227760 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7c2c06f620 0x7f7c2c14e870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 >> 172.21.15.57:0/2752227760 conn(0x7f7c2c06af90 msgr2=0x7f7c2c13c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:47.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 shutdown_connections 2024-03-18T14:47:47.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.738+0000 7f7c32a44700 1 -- 172.21.15.57:0/2752227760 wait complete. 2024-03-18T14:47:47.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T14:40:56.461069+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-03-18T14:41:03.450055+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T14:41:11.444063+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T14:41:12.438862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-18T14:47:47.752 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T14:47:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.874+0000 7fc6dbe1f700 1 Processor -- start 2024-03-18T14:47:47.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.874+0000 7fc6dbe1f700 1 -- start start 2024-03-18T14:47:47.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6dbe1f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 0x7fc6d40a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6dbe1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 0x7fc6d4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6dbe1f700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6d40a3c00 con 0x7fc6d40a48b0 2024-03-18T14:47:47.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6dbe1f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40a36d0 con 0x7fc6d4143940 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6dbe1f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d413e920 con 0x7fc6d40b2310 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6d9bbb700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 0x7fc6d40a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6da3bc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 0x7fc6d4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6d93ba700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc6d40a48b0 0x7fc6d40ae860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33786/0 (socket says 172.21.15.57:33786) 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6d93ba700 1 -- 172.21.15.57:0/2290253872 learned_addr learned my addr 172.21.15.57:0/2290253872 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6d8bb9700 1 -- 172.21.15.57:0/2290253872 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282041512 0 0) 0x7fc6d40a3c00 con 0x7fc6d40a48b0 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6d8bb9700 1 -- 172.21.15.57:0/2290253872 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6c0003570 con 0x7fc6d40a48b0 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6da3bc700 1 -- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 msgr2=0x7fc6d40a3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6da3bc700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 0x7fc6d40a3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6da3bc700 1 -- 172.21.15.57:0/2290253872 >> v1:172.21.15.57:6789/0 conn(0x7fc6d40a48b0 legacy=0x7fc6d40ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.875+0000 7fc6da3bc700 1 -- 172.21.15.57:0/2290253872 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d413ebc0 con 0x7fc6d4143940 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6d9bbb700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 0x7fc6d40a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6da3bc700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 0x7fc6d4145d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009e90 tx=0x7fc6cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d31438935ccf3e24 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6d8bb9700 1 -- 172.21.15.57:0/2290253872 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc00e070 con 0x7fc6d4143940 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6d8bb9700 1 -- 172.21.15.57:0/2290253872 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6cc00bc10 con 0x7fc6d4143940 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6d8bb9700 1 -- 172.21.15.57:0/2290253872 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc012430 con 0x7fc6d4143940 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 msgr2=0x7fc6d4145d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 0x7fc6d4145d20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009e90 tx=0x7fc6cc009780 comp rx=0 tx=0).stop 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/2290253872 shutdown_connections 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d4143940 0x7fc6d4145d20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/2290253872 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d40b2310 0x7fc6d40a3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.876+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/2290253872 >> 172.21.15.57:0/2290253872 conn(0x7fc6d406b180 msgr2=0x7fc6d406ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.877+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/2290253872 shutdown_connections 2024-03-18T14:47:47.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.877+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/2290253872 wait complete. 2024-03-18T14:47:47.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.877+0000 7fc6dbe1f700 1 Processor -- start 2024-03-18T14:47:47.882 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.877+0000 7fc6dbe1f700 1 -- start start 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d4143940 0x7fc6d413ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40ad770 con 0x7fc6d40b2310 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40a1880 con 0x7fc6d40a48b0 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6dbe1f700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d414fcd0 con 0x7fc6d4143940 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d9bbb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6da3bc700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d4143940 0x7fc6d413ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d9bbb700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57614/0 (socket says 172.21.15.57:57614) 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d9bbb700 1 -- 172.21.15.57:0/1131514623 learned_addr learned my addr 172.21.15.57:0/1131514623 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43822/0 (socket says 172.21.15.57:43822) 2024-03-18T14:47:47.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 -- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d4143940 msgr2=0x7fc6d413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d4143940 0x7fc6d413ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 -- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 msgr2=0x7fc6d414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d93ba700 1 -- 172.21.15.57:0/1131514623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4009420 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.878+0000 7fc6d9bbb700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6d93ba700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c560 tx=0x7fc6d0007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0005b30 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d0005cb0 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0007320 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc009a20 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.879+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d414f950 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.880+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d4065180 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.880+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc6d001b3b0 con 0x7fc6d40b2310 2024-03-18T14:47:47.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.881+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fc6d005a9f0 con 0x7fc6d40b2310 2024-03-18T14:47:47.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:47.884+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc6d0038bd0 con 0x7fc6d40b2310 2024-03-18T14:47:48.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.043+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc6d4143030 con 0x7fc6d40b2310 2024-03-18T14:47:48.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.043+0000 7fc6c9ffb700 1 -- 172.21.15.57:0/1131514623 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6d0017020 con 0x7fc6d40b2310 2024-03-18T14:47:48.045 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-18T14:47:48.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.044+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 >> v1:172.21.15.57:6816/47480 conn(0x7fc6b8046010 legacy=0x7fc6b80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.044+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 msgr2=0x7fc6d413c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.044+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000c560 tx=0x7fc6d0007d50 comp rx=0 tx=0).stop 2024-03-18T14:47:48.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 shutdown_connections 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc6d4143940 0x7fc6d413ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc6d40a48b0 0x7fc6d414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 --2- 172.21.15.57:0/1131514623 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6d40b2310 0x7fc6d413c510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 >> 172.21.15.57:0/1131514623 conn(0x7fc6d406b180 msgr2=0x7fc6d4069240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 shutdown_connections 2024-03-18T14:47:48.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.045+0000 7fc6dbe1f700 1 -- 172.21.15.57:0/1131514623 wait complete. 2024-03-18T14:47:48.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-03-18T14:47:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.179+0000 7fe4f9e10700 1 Processor -- start 2024-03-18T14:47:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.179+0000 7fe4f9e10700 1 -- start start 2024-03-18T14:47:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f9e10700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f9e10700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4f4144920 0x7fe4f4146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f9e10700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f40a5590 con 0x7fe4f40a70f0 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f9e10700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f413f710 con 0x7fe4f4144920 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f9e10700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f413f9d0 con 0x7fe4f40680f0 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f37fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45336/0 (socket says 172.21.15.57:45336) 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f3fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe4f4144920 0x7fe4f4146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f37fe700 1 -- 172.21.15.57:0/1427207367 learned_addr learned my addr 172.21.15.57:0/1427207367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f2ffd700 1 --1- 172.21.15.57:0/1427207367 >> v1:172.21.15.57:6789/0 conn(0x7fe4f40a70f0 0x7fe4f413fc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33802/0 (socket says 172.21.15.57:33802) 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 msgr2=0x7fe4f40a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f3fff700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1427207367 >> v1:172.21.15.57:6789/0 conn(0x7fe4f40a70f0 legacy=0x7fe4f413fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1427207367 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f40a4f50 con 0x7fe4f4144920 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f27fc700 1 -- 172.21.15.57:0/1427207367 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737061096 0 0) 0x7fe4f40a5590 con 0x7fe4f40a70f0 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.180+0000 7fe4f37fe700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f3fff700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f4144920 0x7fe4f4146d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009e60 tx=0x7fe4ec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e951aed8448b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f27fc700 1 -- 172.21.15.57:0/1427207367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00e070 con 0x7fe4f4144920 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f27fc700 1 -- 172.21.15.57:0/1427207367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00bb60 con 0x7fe4f4144920 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f27fc700 1 -- 172.21.15.57:0/1427207367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec012430 con 0x7fe4f4144920 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f4144920 msgr2=0x7fe4f4146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f4144920 0x7fe4f4146d00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009e60 tx=0x7fe4ec009780 comp rx=0 tx=0).stop 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1427207367 shutdown_connections 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f4144920 0x7fe4f4146d00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1427207367 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f40680f0 0x7fe4f40a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1427207367 >> 172.21.15.57:0/1427207367 conn(0x7fe4f406be90 msgr2=0x7fe4f40679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1427207367 shutdown_connections 2024-03-18T14:47:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.181+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1427207367 wait complete. 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.182+0000 7fe4f9e10700 1 Processor -- start 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.182+0000 7fe4f9e10700 1 -- start start 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41430a0 con 0x7fe4f40a70f0 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4142850 con 0x7fe4f40680f0 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f9e10700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4144050 con 0x7fe4f4144920 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f37fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f37fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57630/0 (socket says 172.21.15.57:57630) 2024-03-18T14:47:48.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f37fe700 1 -- 172.21.15.57:0/1820052749 learned_addr learned my addr 172.21.15.57:0/1820052749 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f2ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43836/0 (socket says 172.21.15.57:43836) 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45340/0 (socket says 172.21.15.57:45340) 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 msgr2=0x7fe4f4143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 msgr2=0x7fe4f4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f3fff700 1 -- 172.21.15.57:0/1820052749 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40094f0 con 0x7fe4f4144920 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f37fe700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.183+0000 7fe4f2ffd700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4f3fff700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec016000 tx=0x7fe4ec019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec027470 con 0x7fe4f4144920 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0275d0 con 0x7fe4f4144920 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec009a20 con 0x7fe4f4144920 2024-03-18T14:47:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec027990 con 0x7fe4f4144920 2024-03-18T14:47:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.184+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f40abe60 con 0x7fe4f4144920 2024-03-18T14:47:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.185+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4065180 con 0x7fe4f4144920 2024-03-18T14:47:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.185+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe4ec024070 con 0x7fe4f4144920 2024-03-18T14:47:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.185+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fe4ec05d7f0 con 0x7fe4f4144920 2024-03-18T14:47:48.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.189+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fe4ec01f940 con 0x7fe4f4144920 2024-03-18T14:47:48.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.348+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4f413d5a0 con 0x7fe4f4144920 2024-03-18T14:47:48.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.348+0000 7fe4eb7fe700 1 -- 172.21.15.57:0/1820052749 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4ec02c020 con 0x7fe4f4144920 2024-03-18T14:47:48.350 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 8 2024-03-18T14:47:48.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 >> v1:172.21.15.57:6816/47480 conn(0x7fe4d4046010 legacy=0x7fe4d40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 msgr2=0x7fe4f4151940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec016000 tx=0x7fe4ec019000 comp rx=0 tx=0).stop 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 shutdown_connections 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe4f4144920 0x7fe4f4151940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe4f40680f0 0x7fe4f4143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 --2- 172.21.15.57:0/1820052749 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe4f40a70f0 0x7fe4f4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 >> 172.21.15.57:0/1820052749 conn(0x7fe4f406be90 msgr2=0x7fe4f40b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 shutdown_connections 2024-03-18T14:47:48.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.350+0000 7fe4f9e10700 1 -- 172.21.15.57:0/1820052749 wait complete. 2024-03-18T14:47:48.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T14:47:48.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.485+0000 7f27f44d2700 1 Processor -- start 2024-03-18T14:47:48.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.485+0000 7f27f44d2700 1 -- start start 2024-03-18T14:47:48.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f44d2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec13e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f44d2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec06d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f44d2700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec06ddd0 con 0x7f27ec06d960 2024-03-18T14:47:48.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f44d2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec06cbb0 con 0x7f27ec06eb10 2024-03-18T14:47:48.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f44d2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec06ce50 con 0x7f27ec13dce0 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f226e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f1a6d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f2a6f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f27ec06d960 0x7f27ec13a760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33806/0 (socket says 172.21.15.57:33806) 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f2a6f700 1 -- 172.21.15.57:0/3958075093 learned_addr learned my addr 172.21.15.57:0/3958075093 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f126c700 1 -- 172.21.15.57:0/3958075093 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 720547887 0 0) 0x7f27ec06ddd0 con 0x7f27ec06d960 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f226e700 1 -- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 msgr2=0x7f27ec06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f226e700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec06d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f226e700 1 -- 172.21.15.57:0/3958075093 >> v1:172.21.15.57:6789/0 conn(0x7f27ec06d960 legacy=0x7f27ec13a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f226e700 1 -- 172.21.15.57:0/3958075093 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec06e0c0 con 0x7f27ec06eb10 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.486+0000 7f27f1a6d700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f226e700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec13e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a9c0 tx=0x7f27dc0080e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bde7c726800fc06 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f126c700 1 -- 172.21.15.57:0/3958075093 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00b750 con 0x7f27ec06eb10 2024-03-18T14:47:48.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f126c700 1 -- 172.21.15.57:0/3958075093 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00b8b0 con 0x7f27ec06eb10 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f126c700 1 -- 172.21.15.57:0/3958075093 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc00bc50 con 0x7f27ec06eb10 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 -- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 msgr2=0x7f27ec13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec13e460 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a9c0 tx=0x7f27dc0080e0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 -- 172.21.15.57:0/3958075093 shutdown_connections 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec13e460 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 --2- 172.21.15.57:0/3958075093 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 -- 172.21.15.57:0/3958075093 >> 172.21.15.57:0/3958075093 conn(0x7f27ec0679e0 msgr2=0x7f27ec067de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 -- 172.21.15.57:0/3958075093 shutdown_connections 2024-03-18T14:47:48.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.487+0000 7f27f44d2700 1 -- 172.21.15.57:0/3958075093 wait complete. 2024-03-18T14:47:48.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.488+0000 7f27f44d2700 1 Processor -- start 2024-03-18T14:47:48.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.488+0000 7f27f44d2700 1 -- start start 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec098080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0aaa50 con 0x7f27ec06d960 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0970b0 con 0x7f27ec06eb10 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f44d2700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0976f0 con 0x7f27ec13dce0 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43840/0 (socket says 172.21.15.57:43840) 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 -- 172.21.15.57:0/1779653952 learned_addr learned my addr 172.21.15.57:0/1779653952 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f2a6f700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f1a6d700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec098080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 -- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 msgr2=0x7f27ec151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 -- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 msgr2=0x7f27ec098080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec098080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f226e700 1 -- 172.21.15.57:0/1779653952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e800b6d0 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f2a6f700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.489+0000 7f27f1a6d700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27f226e700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a4a0 tx=0x7f27dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc01f070 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc00bc30 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27dc00a4d0 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc019660 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.490+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0aacd0 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.491+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f27dc0199d0 con 0x7f27ec06d960 2024-03-18T14:47:48.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.491+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec098620 con 0x7f27ec06d960 2024-03-18T14:47:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.491+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f27dc05c530 con 0x7f27ec06d960 2024-03-18T14:47:48.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.494+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f27dc025c50 con 0x7f27ec06d960 2024-03-18T14:47:48.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.655+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27ec0648f0 con 0x7f27ec06d960 2024-03-18T14:47:48.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.655+0000 7f27e27fc700 1 -- 172.21.15.57:0/1779653952 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27dc00b040 con 0x7f27ec06d960 2024-03-18T14:47:48.657 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-18T14:47:48.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 >> v1:172.21.15.57:6816/47480 conn(0x7f27d0046010 legacy=0x7f27d00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 msgr2=0x7f27ec096b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00a4a0 tx=0x7f27dc019000 comp rx=0 tx=0).stop 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 shutdown_connections 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f27ec13dce0 0x7f27ec151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27ec06d960 0x7f27ec096b70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 --2- 172.21.15.57:0/1779653952 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f27ec06eb10 0x7f27ec098080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 >> 172.21.15.57:0/1779653952 conn(0x7f27ec0679e0 msgr2=0x7f27ec0710b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 shutdown_connections 2024-03-18T14:47:48.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.657+0000 7f27f44d2700 1 -- 172.21.15.57:0/1779653952 wait complete. 2024-03-18T14:47:48.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T14:47:48.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.792+0000 7f9c124ed700 1 Processor -- start 2024-03-18T14:47:48.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.792+0000 7f9c124ed700 1 -- start start 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c124ed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 0x7f9c0c0aa1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c124ed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 0x7f9c0c13b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c124ed700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0ac680 con 0x7f9c0c13bb20 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c124ed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c13bfc0 con 0x7f9c0c063a10 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c124ed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0b2030 con 0x7f9c0c06f160 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 0x7f9c0c0aa1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 0x7f9c0c13b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c10a8a700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9c0c13bb20 0x7f9c0c1417e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33820/0 (socket says 172.21.15.57:33820) 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c10a8a700 1 -- 172.21.15.57:0/3126339440 learned_addr learned my addr 172.21.15.57:0/3126339440 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 msgr2=0x7f9c0c0aa1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 0x7f9c0c0aa1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0affd700 1 -- 172.21.15.57:0/3126339440 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049737352 0 0) 0x7f9c0c0ac680 con 0x7f9c0c13bb20 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/3126339440 >> v1:172.21.15.57:6789/0 conn(0x7f9c0c13bb20 legacy=0x7f9c0c1417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/3126339440 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0ac8b0 con 0x7f9c0c06f160 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0bfff700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 0x7f9c0c0aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0b7fe700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 0x7f9c0c13b5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009940 tx=0x7f9bf40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3e244b2a8ca531 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0affd700 1 -- 172.21.15.57:0/3126339440 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400b670 con 0x7f9c0c06f160 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.793+0000 7f9c0affd700 1 -- 172.21.15.57:0/3126339440 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400b7d0 con 0x7f9c0c06f160 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c0affd700 1 -- 172.21.15.57:0/3126339440 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400bb90 con 0x7f9c0c06f160 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 -- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 msgr2=0x7f9c0c13b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 0x7f9c0c13b5e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009940 tx=0x7f9bf40091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 -- 172.21.15.57:0/3126339440 shutdown_connections 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c063a10 0x7f9c0c0aa1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 --2- 172.21.15.57:0/3126339440 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c06f160 0x7f9c0c13b5e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 -- 172.21.15.57:0/3126339440 >> 172.21.15.57:0/3126339440 conn(0x7f9c0c06f580 msgr2=0x7f9c0c06f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 -- 172.21.15.57:0/3126339440 shutdown_connections 2024-03-18T14:47:48.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.794+0000 7f9c124ed700 1 -- 172.21.15.57:0/3126339440 wait complete. 2024-03-18T14:47:48.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.795+0000 7f9c124ed700 1 Processor -- start 2024-03-18T14:47:48.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.795+0000 7f9c124ed700 1 -- start start 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 0x7f9c0c119240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c13bb20 0x7f9c0c13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c141ae0 con 0x7f9c0c063a10 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c11aa30 con 0x7f9c0c06f160 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c119ae0 con 0x7f9c0c13bb20 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 0x7f9c0c119240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c10a8a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c13bb20 0x7f9c0c13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0bfff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 0x7f9c0c119240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43852/0 (socket says 172.21.15.57:43852) 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57658/0 (socket says 172.21.15.57:57658) 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0bfff700 1 -- 172.21.15.57:0/1160889315 learned_addr learned my addr 172.21.15.57:0/1160889315 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:48.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c13bb20 msgr2=0x7f9c0c13f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c13bb20 0x7f9c0c13f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 msgr2=0x7f9c0c119240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 0x7f9c0c119240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 -- 172.21.15.57:0/1160889315 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009420 con 0x7f9c0c06f160 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c0b7fe700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4016000 tx=0x7f9bf4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401f070 con 0x7f9c0c06f160 2024-03-18T14:47:48.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4000c90 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.796+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf4009420 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.797+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400bb90 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.797+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c11a2c0 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.798+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c118f60 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.798+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f9bf4023070 con 0x7f9c0c06f160 2024-03-18T14:47:48.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.798+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f9bf405c5b0 con 0x7f9c0c06f160 2024-03-18T14:47:48.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.802+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f9c0c118f60 con 0x7f9c0c06f160 2024-03-18T14:47:48.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.961+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c0c118f60 con 0x7f9c0c06f160 2024-03-18T14:47:48.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.961+0000 7f9c03fff700 1 -- 172.21.15.57:0/1160889315 <== mon.1 v2:172.21.15.57:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9bf402b020 con 0x7f9c0c06f160 2024-03-18T14:47:48.963 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 >> v1:172.21.15.57:6816/47480 conn(0x7f9bec046040 legacy=0x7f9bec0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 msgr2=0x7f9c0c1415a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4016000 tx=0x7f9bf4017000 comp rx=0 tx=0).stop 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 shutdown_connections 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f9c0c13bb20 0x7f9c0c13f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9c0c063a10 0x7f9c0c119240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 --2- 172.21.15.57:0/1160889315 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f9c0c06f160 0x7f9c0c1415a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 >> 172.21.15.57:0/1160889315 conn(0x7f9c0c06f580 msgr2=0x7f9c0c0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:48.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 shutdown_connections 2024-03-18T14:47:48.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:48.963+0000 7f9c124ed700 1 -- 172.21.15.57:0/1160889315 wait complete. 2024-03-18T14:47:48.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T14:47:49.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.096+0000 7fb86c56b700 1 Processor -- start 2024-03-18T14:47:49.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.096+0000 7fb86c56b700 1 -- start start 2024-03-18T14:47:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86c56b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 0x7fb864141e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86c56b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8641423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86c56b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640b3a50 con 0x7fb864069270 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86c56b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb864068ba0 con 0x7fb8640a3b50 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86c56b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640a40b0 con 0x7fb8640b3250 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb869b06700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 0x7fb864141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8641423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86a307700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb864069270 0x7fb864069f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33836/0 (socket says 172.21.15.57:33836) 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86a307700 1 -- 172.21.15.57:0/916378393 learned_addr learned my addr 172.21.15.57:0/916378393 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb869305700 1 -- 172.21.15.57:0/916378393 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708870583 0 0) 0x7fb8640b3a50 con 0x7fb864069270 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb869305700 1 -- 172.21.15.57:0/916378393 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb850003570 con 0x7fb864069270 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 -- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 msgr2=0x7fb864141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 0x7fb864141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 -- 172.21.15.57:0/916378393 >> v1:172.21.15.57:6789/0 conn(0x7fb864069270 legacy=0x7fb864069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 -- 172.21.15.57:0/916378393 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb864149c10 con 0x7fb8640a3b50 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb869b06700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 0x7fb864141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:49.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.097+0000 7fb86ab08700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8641423b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e90 tx=0x7fb85c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783811a4f13e4c41 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb869305700 1 -- 172.21.15.57:0/916378393 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c00e070 con 0x7fb8640a3b50 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb869305700 1 -- 172.21.15.57:0/916378393 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00bb80 con 0x7fb8640a3b50 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb869305700 1 -- 172.21.15.57:0/916378393 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c012430 con 0x7fb8640a3b50 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 -- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 msgr2=0x7fb8641423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8641423b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e90 tx=0x7fb85c009780 comp rx=0 tx=0).stop 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 -- 172.21.15.57:0/916378393 shutdown_connections 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8641423b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 --2- 172.21.15.57:0/916378393 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb8640b3250 0x7fb864141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 -- 172.21.15.57:0/916378393 >> 172.21.15.57:0/916378393 conn(0x7fb86406bf70 msgr2=0x7fb86406c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 -- 172.21.15.57:0/916378393 shutdown_connections 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.098+0000 7fb86c56b700 1 -- 172.21.15.57:0/916378393 wait complete. 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.099+0000 7fb86c56b700 1 Processor -- start 2024-03-18T14:47:49.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.099+0000 7fb86c56b700 1 -- start start 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 0x7fb86413bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640ad5c0 con 0x7fb8640b3250 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640af660 con 0x7fb8640a3b50 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640ac560 con 0x7fb864069270 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb869b06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45402/0 (socket says 172.21.15.57:45402) 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb869b06700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57678/0 (socket says 172.21.15.57:57678) 2024-03-18T14:47:49.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 -- 172.21.15.57:0/2972377513 learned_addr learned my addr 172.21.15.57:0/2972377513 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86ab08700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 0x7fb86413bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 -- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 msgr2=0x7fb8640af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 -- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 msgr2=0x7fb86413bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 0x7fb86413bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 -- 172.21.15.57:0/2972377513 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860009420 con 0x7fb864069270 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb869b06700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86ab08700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 0x7fb86413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86a307700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7c0 tx=0x7fb854007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854005b30 con 0x7fb864069270 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb854005c90 con 0x7fb864069270 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c009a20 con 0x7fb864069270 2024-03-18T14:47:49.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.100+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854007300 con 0x7fb864069270 2024-03-18T14:47:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.101+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640acf90 con 0x7fb864069270 2024-03-18T14:47:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.101+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864065180 con 0x7fb864069270 2024-03-18T14:47:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.101+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fb85401b3b0 con 0x7fb864069270 2024-03-18T14:47:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.102+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fb85405a7d0 con 0x7fb864069270 2024-03-18T14:47:49.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.105+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fb854038930 con 0x7fb864069270 2024-03-18T14:47:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.279+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb864068e00 con 0x7fb864069270 2024-03-18T14:47:49.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.280+0000 7fb85a7fc700 1 -- 172.21.15.57:0/2972377513 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 7 entries v42) v1 ==== 80+0+408 (secure 0 0 0) 0x7fb854017030 con 0x7fb864069270 2024-03-18T14:47:49.281 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2355346234 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/2550387238 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:0/1711862619 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.129:0/1814197221 2024-03-18T15:47:36.508336+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6816/39496 2024-03-19T14:46:53.512574+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57:6819/2329339569 2024-03-19T14:47:18.613680+0000 2024-03-18T14:47:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.87:0/2493486388 2024-03-18T15:47:36.508029+0000 2024-03-18T14:47:49.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 >> v1:172.21.15.57:6816/47480 conn(0x7fb848046010 legacy=0x7fb8480484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 msgr2=0x7fb8641432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c7c0 tx=0x7fb854007e00 comp rx=0 tx=0).stop 2024-03-18T14:47:49.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 shutdown_connections 2024-03-18T14:47:49.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb8640b3250 0x7fb86413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fb864069270 0x7fb8641432e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.281+0000 7fb86c56b700 1 --2- 172.21.15.57:0/2972377513 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fb8640a3b50 0x7fb8640af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.282+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 >> 172.21.15.57:0/2972377513 conn(0x7fb86406bf70 msgr2=0x7fb864141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.282+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 shutdown_connections 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.282+0000 7fb86c56b700 1 -- 172.21.15.57:0/2972377513 wait complete. 2024-03-18T14:47:49.284 INFO:teuthology.orchestra.run.smithi057.stderr:listed 7 entries 2024-03-18T14:47:49.295 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.1 2024-03-18T14:47:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.295 DEBUG:teuthology.orchestra.run.smithi129:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.1 2024-03-18T14:47:49.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi129.stderr:ceph-fuse[37344]: fuse finished with error 0 and tester_r 0 2024-03-18T14:47:49.335 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi129.front.sepia.ceph.com 2024-03-18T14:47:49.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.335 DEBUG:teuthology.orchestra.run.smithi129:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-18T14:47:49.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.407 DEBUG:teuthology.orchestra.run.smithi087:> ip netns list 2024-03-18T14:47:49.429 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T14:47:49.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T14:47:49.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.517 DEBUG:teuthology.orchestra.run.smithi087:> sudo ip link delete ceph-brx 2024-03-18T14:47:49.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.596 DEBUG:teuthology.orchestra.run.smithi129:> ip netns list 2024-03-18T14:47:49.617 INFO:teuthology.orchestra.run.smithi129.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-18T14:47:49.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.617 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T14:47:49.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T14:47:49.697 DEBUG:teuthology.orchestra.run.smithi129:> sudo ip link delete ceph-brx 2024-03-18T14:47:49.794 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-18T14:47:49.808 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T14:47:49.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.931+0000 7f1debd38700 1 Processor -- start 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.931+0000 7f1debd38700 1 -- start start 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1debd38700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1de40b3250 0x7f1de406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1debd38700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1debd38700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de40a3a80 con 0x7f1de40a4e70 2024-03-18T14:47:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1debd38700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de40b0350 con 0x7f1de40b3250 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1debd38700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40a4990 con 0x7f1de4147610 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1dea2d5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de9ad4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1de40b3250 0x7f1de406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de92d3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1de40a4e70 0x7f1de406f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33846/0 (socket says 172.21.15.57:33846) 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1dea2d5700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45404/0 (socket says 172.21.15.57:45404) 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de92d3700 1 -- 172.21.15.57:0/1528649745 learned_addr learned my addr 172.21.15.57:0/1528649745 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 msgr2=0x7f1de41499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de9ad4700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1528649745 >> v1:172.21.15.57:6789/0 conn(0x7f1de40a4e70 legacy=0x7f1de406f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1528649745 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de406a3f0 con 0x7f1de40b3250 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1de8ad2700 1 -- 172.21.15.57:0/1528649745 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603773145 0 0) 0x7f1de40a3a80 con 0x7f1de40a4e70 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.932+0000 7f1dea2d5700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1de9ad4700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40b3250 0x7f1de406eb70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1de00098e0 tx=0x7f1de00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66211cb57744ddf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:49.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1de8ad2700 1 -- 172.21.15.57:0/1528649745 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000b640 con 0x7f1de40b3250 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1de8ad2700 1 -- 172.21.15.57:0/1528649745 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000b7a0 con 0x7f1de40b3250 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1de8ad2700 1 -- 172.21.15.57:0/1528649745 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000bb40 con 0x7f1de40b3250 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 -- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40b3250 msgr2=0x7f1de406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40b3250 0x7f1de406eb70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1de00098e0 tx=0x7f1de00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 -- 172.21.15.57:0/1528649745 shutdown_connections 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de41499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 --2- 172.21.15.57:0/1528649745 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40b3250 0x7f1de406eb70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 -- 172.21.15.57:0/1528649745 >> 172.21.15.57:0/1528649745 conn(0x7f1de406e2c0 msgr2=0x7f1de406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 -- 172.21.15.57:0/1528649745 shutdown_connections 2024-03-18T14:47:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.933+0000 7f1debd38700 1 -- 172.21.15.57:0/1528649745 wait complete. 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 Processor -- start 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 -- start start 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1de40b3250 0x7f1de414e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4146db0 con 0x7f1de40a4e70 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40ae190 con 0x7f1de40b3250 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.935+0000 7f1debd38700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de40ae470 con 0x7f1de4147610 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43882/0 (socket says 172.21.15.57:43882) 2024-03-18T14:47:49.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1203553896 learned_addr learned my addr 172.21.15.57:0/1203553896 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1dea2d5700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de92d3700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1de40b3250 0x7f1de414e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 msgr2=0x7f1de414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de414eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1de40b3250 msgr2=0x7f1de414e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1de40b3250 0x7f1de414e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 -- 172.21.15.57:0/1203553896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc009a20 con 0x7f1de40a4e70 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1dea2d5700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1de9ad4700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1de40a3c10 tx=0x7f1de0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0000d10 con 0x7f1de40a4e70 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000bb20 con 0x7f1de40a4e70 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de0009420 con 0x7f1de40a4e70 2024-03-18T14:47:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0011650 con 0x7f1de40a4e70 2024-03-18T14:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.936+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de40ab640 con 0x7f1de40a4e70 2024-03-18T14:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.937+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de40ad1b0 con 0x7f1de40a4e70 2024-03-18T14:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.938+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1de00119c0 con 0x7f1de40a4e70 2024-03-18T14:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.938+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f1de005ce00 con 0x7f1de40a4e70 2024-03-18T14:47:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:49.941+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1de0002eb0 con 0x7f1de40a4e70 2024-03-18T14:47:50.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.096+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1de40ab280 con 0x7f1dc8046090 2024-03-18T14:47:50.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.103+0000 7f1dd5ffb700 1 -- 172.21.15.57:0/1203553896 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273444 (unknown 2965378022 0 2282131912) 0x7f1de40ab280 con 0x7f1dc8046090 2024-03-18T14:47:50.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 >> v1:172.21.15.57:6816/47480 conn(0x7f1dc8046090 legacy=0x7f1dc8048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 msgr2=0x7f1de40ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1de40a3c10 tx=0x7f1de0017000 comp rx=0 tx=0).stop 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 shutdown_connections 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1de4147610 0x7f1de414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1de40a4e70 0x7f1de40ad3b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 --2- 172.21.15.57:0/1203553896 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1de40b3250 0x7f1de414e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 >> 172.21.15.57:0/1203553896 conn(0x7f1de406e2c0 msgr2=0x7f1de40648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 shutdown_connections 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.106+0000 7f1debd38700 1 -- 172.21.15.57:0/1203553896 wait complete. 2024-03-18T14:47:50.111 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:50.120 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-18T14:47:49.557231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749686,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65074,"num_write_kb":8749062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71471,"ondisk_log_size":71471,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532904,"kb_used_data":270536,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954456,"statfs":{"total":386547056640,"available":384977362944,"internally_reserved":0,"allocated":277028864,"data_stored":276142128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002422"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":880,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710440+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:24.710440+0000","last_peered":"2024-03-18T14:47:24.710440+0000","last_clean":"2024-03-18T14:47:24.710440+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:24.710440+0000","last_undegraded":"2024-03-18T14:47:24.710440+0000","last_fullsized":"2024-03-18T14:47:24.710440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710484+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:24.710484+0000","last_peered":"2024-03-18T14:47:24.710484+0000","last_clean":"2024-03-18T14:47:24.710484+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:24.710484+0000","last_undegraded":"2024-03-18T14:47:24.710484+0000","last_fullsized":"2024-03-18T14:47:24.710484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":945,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711185+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:24.711185+0000","last_peered":"2024-03-18T14:47:24.711185+0000","last_clean":"2024-03-18T14:47:24.711185+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:24.711185+0000","last_undegraded":"2024-03-18T14:47:24.711185+0000","last_fullsized":"2024-03-18T14:47:24.711185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711313+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:24.711313+0000","last_peered":"2024-03-18T14:47:24.711313+0000","last_clean":"2024-03-18T14:47:24.711313+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:24.711313+0000","last_undegraded":"2024-03-18T14:47:24.711313+0000","last_fullsized":"2024-03-18T14:47:24.711313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710214+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:24.710214+0000","last_peered":"2024-03-18T14:47:24.710214+0000","last_clean":"2024-03-18T14:47:24.710214+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:24.710214+0000","last_undegraded":"2024-03-18T14:47:24.710214+0000","last_fullsized":"2024-03-18T14:47:24.710214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":904,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600392+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:25.600392+0000","last_peered":"2024-03-18T14:47:25.600392+0000","last_clean":"2024-03-18T14:47:25.600392+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:25.600392+0000","last_undegraded":"2024-03-18T14:47:25.600392+0000","last_fullsized":"2024-03-18T14:47:25.600392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":957,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599543+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:25.599543+0000","last_peered":"2024-03-18T14:47:25.599543+0000","last_clean":"2024-03-18T14:47:25.599543+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:25.599543+0000","last_undegraded":"2024-03-18T14:47:25.599543+0000","last_fullsized":"2024-03-18T14:47:25.599543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":804,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711870+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:24.711870+0000","last_peered":"2024-03-18T14:47:24.711870+0000","last_clean":"2024-03-18T14:47:24.711870+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:24.711870+0000","last_undegraded":"2024-03-18T14:47:24.711870+0000","last_fullsized":"2024-03-18T14:47:24.711870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":947,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712243+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:24.712243+0000","last_peered":"2024-03-18T14:47:24.712243+0000","last_clean":"2024-03-18T14:47:24.712243+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:24.712243+0000","last_undegraded":"2024-03-18T14:47:24.712243+0000","last_fullsized":"2024-03-18T14:47:24.712243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":830,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712437+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:24.712437+0000","last_peered":"2024-03-18T14:47:24.712437+0000","last_clean":"2024-03-18T14:47:24.712437+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:24.712437+0000","last_undegraded":"2024-03-18T14:47:24.712437+0000","last_fullsized":"2024-03-18T14:47:24.712437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":806,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712653+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:24.712653+0000","last_peered":"2024-03-18T14:47:24.712653+0000","last_clean":"2024-03-18T14:47:24.712653+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:24.712653+0000","last_undegraded":"2024-03-18T14:47:24.712653+0000","last_fullsized":"2024-03-18T14:47:24.712653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":833,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710663+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:24.710663+0000","last_peered":"2024-03-18T14:47:24.710663+0000","last_clean":"2024-03-18T14:47:24.710663+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:24.710663+0000","last_undegraded":"2024-03-18T14:47:24.710663+0000","last_fullsized":"2024-03-18T14:47:24.710663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":887,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710327+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:24.710327+0000","last_peered":"2024-03-18T14:47:24.710327+0000","last_clean":"2024-03-18T14:47:24.710327+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:24.710327+0000","last_undegraded":"2024-03-18T14:47:24.710327+0000","last_fullsized":"2024-03-18T14:47:24.710327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712352+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:24.712352+0000","last_peered":"2024-03-18T14:47:24.712352+0000","last_clean":"2024-03-18T14:47:24.712352+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:24.712352+0000","last_undegraded":"2024-03-18T14:47:24.712352+0000","last_fullsized":"2024-03-18T14:47:24.712352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1050,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710336+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:24.710336+0000","last_peered":"2024-03-18T14:47:24.710336+0000","last_clean":"2024-03-18T14:47:24.710336+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:24.710336+0000","last_undegraded":"2024-03-18T14:47:24.710336+0000","last_fullsized":"2024-03-18T14:47:24.710336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":883,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599889+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:25.599889+0000","last_peered":"2024-03-18T14:47:25.599889+0000","last_clean":"2024-03-18T14:47:25.599889+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:25.599889+0000","last_undegraded":"2024-03-18T14:47:25.599889+0000","last_fullsized":"2024-03-18T14:47:25.599889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1012,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712495+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:24.712495+0000","last_peered":"2024-03-18T14:47:24.712495+0000","last_clean":"2024-03-18T14:47:24.712495+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:24.712495+0000","last_undegraded":"2024-03-18T14:47:24.712495+0000","last_fullsized":"2024-03-18T14:47:24.712495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1011,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711421+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:24.711421+0000","last_peered":"2024-03-18T14:47:24.711421+0000","last_clean":"2024-03-18T14:47:24.711421+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:24.711421+0000","last_undegraded":"2024-03-18T14:47:24.711421+0000","last_fullsized":"2024-03-18T14:47:24.711421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710683+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:24.710683+0000","last_peered":"2024-03-18T14:47:24.710683+0000","last_clean":"2024-03-18T14:47:24.710683+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:24.710683+0000","last_undegraded":"2024-03-18T14:47:24.710683+0000","last_fullsized":"2024-03-18T14:47:24.710683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713231+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:24.713231+0000","last_peered":"2024-03-18T14:47:24.713231+0000","last_clean":"2024-03-18T14:47:24.713231+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:24.713231+0000","last_undegraded":"2024-03-18T14:47:24.713231+0000","last_fullsized":"2024-03-18T14:47:24.713231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1029,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712578+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:24.712578+0000","last_peered":"2024-03-18T14:47:24.712578+0000","last_clean":"2024-03-18T14:47:24.712578+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:24.712578+0000","last_undegraded":"2024-03-18T14:47:24.712578+0000","last_fullsized":"2024-03-18T14:47:24.712578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":891,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710482+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:24.710482+0000","last_peered":"2024-03-18T14:47:24.710482+0000","last_clean":"2024-03-18T14:47:24.710482+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:24.710482+0000","last_undegraded":"2024-03-18T14:47:24.710482+0000","last_fullsized":"2024-03-18T14:47:24.710482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1019,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600855+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:25.600855+0000","last_peered":"2024-03-18T14:47:25.600855+0000","last_clean":"2024-03-18T14:47:25.600855+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:25.600855+0000","last_undegraded":"2024-03-18T14:47:25.600855+0000","last_fullsized":"2024-03-18T14:47:25.600855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":936,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711752+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:24.711752+0000","last_peered":"2024-03-18T14:47:24.711752+0000","last_clean":"2024-03-18T14:47:24.711752+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:24.711752+0000","last_undegraded":"2024-03-18T14:47:24.711752+0000","last_fullsized":"2024-03-18T14:47:24.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":966,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712973+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:24.712973+0000","last_peered":"2024-03-18T14:47:24.712973+0000","last_clean":"2024-03-18T14:47:24.712973+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:24.712973+0000","last_undegraded":"2024-03-18T14:47:24.712973+0000","last_fullsized":"2024-03-18T14:47:24.712973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712776+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:24.712776+0000","last_peered":"2024-03-18T14:47:24.712776+0000","last_clean":"2024-03-18T14:47:24.712776+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:24.712776+0000","last_undegraded":"2024-03-18T14:47:24.712776+0000","last_fullsized":"2024-03-18T14:47:24.712776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":934,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600488+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:25.600488+0000","last_peered":"2024-03-18T14:47:25.600488+0000","last_clean":"2024-03-18T14:47:25.600488+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:25.600488+0000","last_undegraded":"2024-03-18T14:47:25.600488+0000","last_fullsized":"2024-03-18T14:47:25.600488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712447+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:24.712447+0000","last_peered":"2024-03-18T14:47:24.712447+0000","last_clean":"2024-03-18T14:47:24.712447+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:24.712447+0000","last_undegraded":"2024-03-18T14:47:24.712447+0000","last_fullsized":"2024-03-18T14:47:24.712447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":926,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599866+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:25.599866+0000","last_peered":"2024-03-18T14:47:25.599866+0000","last_clean":"2024-03-18T14:47:25.599866+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:25.599866+0000","last_undegraded":"2024-03-18T14:47:25.599866+0000","last_fullsized":"2024-03-18T14:47:25.599866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1400,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711973+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:24.711973+0000","last_peered":"2024-03-18T14:47:24.711973+0000","last_clean":"2024-03-18T14:47:24.711973+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:24.711973+0000","last_undegraded":"2024-03-18T14:47:24.711973+0000","last_fullsized":"2024-03-18T14:47:24.711973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":828,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711702+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:24.711702+0000","last_peered":"2024-03-18T14:47:24.711702+0000","last_clean":"2024-03-18T14:47:24.711702+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:24.711702+0000","last_undegraded":"2024-03-18T14:47:24.711702+0000","last_fullsized":"2024-03-18T14:47:24.711702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599482+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:25.599482+0000","last_peered":"2024-03-18T14:47:25.599482+0000","last_clean":"2024-03-18T14:47:25.599482+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:25.599482+0000","last_undegraded":"2024-03-18T14:47:25.599482+0000","last_fullsized":"2024-03-18T14:47:25.599482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":870,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601271+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:25.601271+0000","last_peered":"2024-03-18T14:47:25.601271+0000","last_clean":"2024-03-18T14:47:25.601271+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:25.601271+0000","last_undegraded":"2024-03-18T14:47:25.601271+0000","last_fullsized":"2024-03-18T14:47:25.601271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712400+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:24.712400+0000","last_peered":"2024-03-18T14:47:24.712400+0000","last_clean":"2024-03-18T14:47:24.712400+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:24.712400+0000","last_undegraded":"2024-03-18T14:47:24.712400+0000","last_fullsized":"2024-03-18T14:47:24.712400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":843,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600141+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:25.600141+0000","last_peered":"2024-03-18T14:47:25.600141+0000","last_clean":"2024-03-18T14:47:25.600141+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:25.600141+0000","last_undegraded":"2024-03-18T14:47:25.600141+0000","last_fullsized":"2024-03-18T14:47:25.600141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710369+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:24.710369+0000","last_peered":"2024-03-18T14:47:24.710369+0000","last_clean":"2024-03-18T14:47:24.710369+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:24.710369+0000","last_undegraded":"2024-03-18T14:47:24.710369+0000","last_fullsized":"2024-03-18T14:47:24.710369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1059,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599644+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:25.599644+0000","last_peered":"2024-03-18T14:47:25.599644+0000","last_clean":"2024-03-18T14:47:25.599644+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:25.599644+0000","last_undegraded":"2024-03-18T14:47:25.599644+0000","last_fullsized":"2024-03-18T14:47:25.599644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":270,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.442911+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:27.442911+0000","last_peered":"2024-03-18T14:47:27.442911+0000","last_clean":"2024-03-18T14:47:27.442911+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:27.442911+0000","last_undegraded":"2024-03-18T14:47:27.442911+0000","last_fullsized":"2024-03-18T14:47:27.442911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1036,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712994+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:24.712994+0000","last_peered":"2024-03-18T14:47:24.712994+0000","last_clean":"2024-03-18T14:47:24.712994+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:24.712994+0000","last_undegraded":"2024-03-18T14:47:24.712994+0000","last_fullsized":"2024-03-18T14:47:24.712994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'649","reported_seq":693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.444711+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:27.444711+0000","last_peered":"2024-03-18T14:47:27.444711+0000","last_clean":"2024-03-18T14:47:27.444711+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:27.444711+0000","last_undegraded":"2024-03-18T14:47:27.444711+0000","last_fullsized":"2024-03-18T14:47:27.444711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":550,"num_write_kb":12564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":981,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710262+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:24.710262+0000","last_peered":"2024-03-18T14:47:24.710262+0000","last_clean":"2024-03-18T14:47:24.710262+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:24.710262+0000","last_undegraded":"2024-03-18T14:47:24.710262+0000","last_fullsized":"2024-03-18T14:47:24.710262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":604,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438163+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:27.438163+0000","last_peered":"2024-03-18T14:47:27.438163+0000","last_clean":"2024-03-18T14:47:27.438163+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:27.438163+0000","last_undegraded":"2024-03-18T14:47:27.438163+0000","last_fullsized":"2024-03-18T14:47:27.438163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":962,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600270+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:25.600270+0000","last_peered":"2024-03-18T14:47:25.600270+0000","last_clean":"2024-03-18T14:47:25.600270+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:25.600270+0000","last_undegraded":"2024-03-18T14:47:25.600270+0000","last_fullsized":"2024-03-18T14:47:25.600270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":216,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710584+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:24.710584+0000","last_peered":"2024-03-18T14:47:24.710584+0000","last_clean":"2024-03-18T14:47:24.710584+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:24.710584+0000","last_undegraded":"2024-03-18T14:47:24.710584+0000","last_fullsized":"2024-03-18T14:47:24.710584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599738+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:25.599738+0000","last_peered":"2024-03-18T14:47:25.599738+0000","last_clean":"2024-03-18T14:47:25.599738+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:25.599738+0000","last_undegraded":"2024-03-18T14:47:25.599738+0000","last_fullsized":"2024-03-18T14:47:25.599738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":413,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601164+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:25.601164+0000","last_peered":"2024-03-18T14:47:25.601164+0000","last_clean":"2024-03-18T14:47:25.601164+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:25.601164+0000","last_undegraded":"2024-03-18T14:47:25.601164+0000","last_fullsized":"2024-03-18T14:47:25.601164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":863,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711877+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:24.711877+0000","last_peered":"2024-03-18T14:47:24.711877+0000","last_clean":"2024-03-18T14:47:24.711877+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:24.711877+0000","last_undegraded":"2024-03-18T14:47:24.711877+0000","last_fullsized":"2024-03-18T14:47:24.711877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'179","reported_seq":224,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-03-18T14:47:37.523076+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:37.523076+0000","last_peered":"2024-03-18T14:47:37.523076+0000","last_clean":"2024-03-18T14:47:37.523076+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:37.523076+0000","last_undegraded":"2024-03-18T14:47:37.523076+0000","last_fullsized":"2024-03-18T14:47:37.523076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234466,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":65,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601638+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:25.601638+0000","last_peered":"2024-03-18T14:47:25.601638+0000","last_clean":"2024-03-18T14:47:25.601638+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:25.601638+0000","last_undegraded":"2024-03-18T14:47:25.601638+0000","last_fullsized":"2024-03-18T14:47:25.601638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712073+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:24.712073+0000","last_peered":"2024-03-18T14:47:24.712073+0000","last_clean":"2024-03-18T14:47:24.712073+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:24.712073+0000","last_undegraded":"2024-03-18T14:47:24.712073+0000","last_fullsized":"2024-03-18T14:47:24.712073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1021,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599768+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:25.599768+0000","last_peered":"2024-03-18T14:47:25.599768+0000","last_clean":"2024-03-18T14:47:25.599768+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:25.599768+0000","last_undegraded":"2024-03-18T14:47:25.599768+0000","last_fullsized":"2024-03-18T14:47:25.599768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":446,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.446361+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:27.446361+0000","last_peered":"2024-03-18T14:47:27.446361+0000","last_clean":"2024-03-18T14:47:27.446361+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:27.446361+0000","last_undegraded":"2024-03-18T14:47:27.446361+0000","last_fullsized":"2024-03-18T14:47:27.446361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":885,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712207+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:24.712207+0000","last_peered":"2024-03-18T14:47:24.712207+0000","last_clean":"2024-03-18T14:47:24.712207+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:24.712207+0000","last_undegraded":"2024-03-18T14:47:24.712207+0000","last_fullsized":"2024-03-18T14:47:24.712207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600602+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:25.600602+0000","last_peered":"2024-03-18T14:47:25.600602+0000","last_clean":"2024-03-18T14:47:25.600602+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:25.600602+0000","last_undegraded":"2024-03-18T14:47:25.600602+0000","last_fullsized":"2024-03-18T14:47:25.600602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710377+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:24.710377+0000","last_peered":"2024-03-18T14:47:24.710377+0000","last_clean":"2024-03-18T14:47:24.710377+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:24.710377+0000","last_undegraded":"2024-03-18T14:47:24.710377+0000","last_fullsized":"2024-03-18T14:47:24.710377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711104+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:24.711104+0000","last_peered":"2024-03-18T14:47:24.711104+0000","last_clean":"2024-03-18T14:47:24.711104+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:24.711104+0000","last_undegraded":"2024-03-18T14:47:24.711104+0000","last_fullsized":"2024-03-18T14:47:24.711104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":929,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711303+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:24.711303+0000","last_peered":"2024-03-18T14:47:24.711303+0000","last_clean":"2024-03-18T14:47:24.711303+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:24.711303+0000","last_undegraded":"2024-03-18T14:47:24.711303+0000","last_fullsized":"2024-03-18T14:47:24.711303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":630,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600452+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:25.600452+0000","last_peered":"2024-03-18T14:47:25.600452+0000","last_clean":"2024-03-18T14:47:25.600452+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:25.600452+0000","last_undegraded":"2024-03-18T14:47:25.600452+0000","last_fullsized":"2024-03-18T14:47:25.600452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711207+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:24.711207+0000","last_peered":"2024-03-18T14:47:24.711207+0000","last_clean":"2024-03-18T14:47:24.711207+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:24.711207+0000","last_undegraded":"2024-03-18T14:47:24.711207+0000","last_fullsized":"2024-03-18T14:47:24.711207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600738+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:25.600738+0000","last_peered":"2024-03-18T14:47:25.600738+0000","last_clean":"2024-03-18T14:47:25.600738+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:25.600738+0000","last_undegraded":"2024-03-18T14:47:25.600738+0000","last_fullsized":"2024-03-18T14:47:25.600738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":895,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600209+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:25.600209+0000","last_peered":"2024-03-18T14:47:25.600209+0000","last_clean":"2024-03-18T14:47:25.600209+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:25.600209+0000","last_undegraded":"2024-03-18T14:47:25.600209+0000","last_fullsized":"2024-03-18T14:47:25.600209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":330,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599505+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:25.599505+0000","last_peered":"2024-03-18T14:47:25.599505+0000","last_clean":"2024-03-18T14:47:25.599505+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:25.599505+0000","last_undegraded":"2024-03-18T14:47:25.599505+0000","last_fullsized":"2024-03-18T14:47:25.599505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":897,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710680+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:24.710680+0000","last_peered":"2024-03-18T14:47:24.710680+0000","last_clean":"2024-03-18T14:47:24.710680+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:24.710680+0000","last_undegraded":"2024-03-18T14:47:24.710680+0000","last_fullsized":"2024-03-18T14:47:24.710680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600008+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:25.600008+0000","last_peered":"2024-03-18T14:47:25.600008+0000","last_clean":"2024-03-18T14:47:25.600008+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:25.600008+0000","last_undegraded":"2024-03-18T14:47:25.600008+0000","last_fullsized":"2024-03-18T14:47:25.600008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713247+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:24.713247+0000","last_peered":"2024-03-18T14:47:24.713247+0000","last_clean":"2024-03-18T14:47:24.713247+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:24.713247+0000","last_undegraded":"2024-03-18T14:47:24.713247+0000","last_fullsized":"2024-03-18T14:47:24.713247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713126+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:24.713126+0000","last_peered":"2024-03-18T14:47:24.713126+0000","last_clean":"2024-03-18T14:47:24.713126+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:24.713126+0000","last_undegraded":"2024-03-18T14:47:24.713126+0000","last_fullsized":"2024-03-18T14:47:24.713126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710611+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:24.710611+0000","last_peered":"2024-03-18T14:47:24.710611+0000","last_clean":"2024-03-18T14:47:24.710611+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:24.710611+0000","last_undegraded":"2024-03-18T14:47:24.710611+0000","last_fullsized":"2024-03-18T14:47:24.710611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712464+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:24.712464+0000","last_peered":"2024-03-18T14:47:24.712464+0000","last_clean":"2024-03-18T14:47:24.712464+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:24.712464+0000","last_undegraded":"2024-03-18T14:47:24.712464+0000","last_fullsized":"2024-03-18T14:47:24.712464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600668+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:25.600668+0000","last_peered":"2024-03-18T14:47:25.600668+0000","last_clean":"2024-03-18T14:47:25.600668+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:25.600668+0000","last_undegraded":"2024-03-18T14:47:25.600668+0000","last_fullsized":"2024-03-18T14:47:25.600668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710936+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:24.710936+0000","last_peered":"2024-03-18T14:47:24.710936+0000","last_clean":"2024-03-18T14:47:24.710936+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:24.710936+0000","last_undegraded":"2024-03-18T14:47:24.710936+0000","last_fullsized":"2024-03-18T14:47:24.710936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713044+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:24.713044+0000","last_peered":"2024-03-18T14:47:24.713044+0000","last_clean":"2024-03-18T14:47:24.713044+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:24.713044+0000","last_undegraded":"2024-03-18T14:47:24.713044+0000","last_fullsized":"2024-03-18T14:47:24.713044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710256+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:24.710256+0000","last_peered":"2024-03-18T14:47:24.710256+0000","last_clean":"2024-03-18T14:47:24.710256+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:24.710256+0000","last_undegraded":"2024-03-18T14:47:24.710256+0000","last_fullsized":"2024-03-18T14:47:24.710256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":867,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712128+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.712128+0000","last_peered":"2024-03-18T14:47:24.712128+0000","last_clean":"2024-03-18T14:47:24.712128+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.712128+0000","last_undegraded":"2024-03-18T14:47:24.712128+0000","last_fullsized":"2024-03-18T14:47:24.712128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713074+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:24.713074+0000","last_peered":"2024-03-18T14:47:24.713074+0000","last_clean":"2024-03-18T14:47:24.713074+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:24.713074+0000","last_undegraded":"2024-03-18T14:47:24.713074+0000","last_fullsized":"2024-03-18T14:47:24.713074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600551+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:25.600551+0000","last_peered":"2024-03-18T14:47:25.600551+0000","last_clean":"2024-03-18T14:47:25.600551+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:25.600551+0000","last_undegraded":"2024-03-18T14:47:25.600551+0000","last_fullsized":"2024-03-18T14:47:25.600551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711686+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:24.711686+0000","last_peered":"2024-03-18T14:47:24.711686+0000","last_clean":"2024-03-18T14:47:24.711686+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:24.711686+0000","last_undegraded":"2024-03-18T14:47:24.711686+0000","last_fullsized":"2024-03-18T14:47:24.711686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1053,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599935+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:25.599935+0000","last_peered":"2024-03-18T14:47:25.599935+0000","last_clean":"2024-03-18T14:47:25.599935+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:25.599935+0000","last_undegraded":"2024-03-18T14:47:25.599935+0000","last_fullsized":"2024-03-18T14:47:25.599935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":899,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600336+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:25.600336+0000","last_peered":"2024-03-18T14:47:25.600336+0000","last_clean":"2024-03-18T14:47:25.600336+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:25.600336+0000","last_undegraded":"2024-03-18T14:47:25.600336+0000","last_fullsized":"2024-03-18T14:47:25.600336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600216+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:25.600216+0000","last_peered":"2024-03-18T14:47:25.600216+0000","last_clean":"2024-03-18T14:47:25.600216+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:25.600216+0000","last_undegraded":"2024-03-18T14:47:25.600216+0000","last_fullsized":"2024-03-18T14:47:25.600216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710133+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:24.710133+0000","last_peered":"2024-03-18T14:47:24.710133+0000","last_clean":"2024-03-18T14:47:24.710133+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:24.710133+0000","last_undegraded":"2024-03-18T14:47:24.710133+0000","last_fullsized":"2024-03-18T14:47:24.710133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1022,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711613+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:24.711613+0000","last_peered":"2024-03-18T14:47:24.711613+0000","last_clean":"2024-03-18T14:47:24.711613+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:24.711613+0000","last_undegraded":"2024-03-18T14:47:24.711613+0000","last_fullsized":"2024-03-18T14:47:24.711613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600090+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:25.600090+0000","last_peered":"2024-03-18T14:47:25.600090+0000","last_clean":"2024-03-18T14:47:25.600090+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:25.600090+0000","last_undegraded":"2024-03-18T14:47:25.600090+0000","last_fullsized":"2024-03-18T14:47:25.600090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":490,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713357+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:24.713357+0000","last_peered":"2024-03-18T14:47:24.713357+0000","last_clean":"2024-03-18T14:47:24.713357+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:24.713357+0000","last_undegraded":"2024-03-18T14:47:24.713357+0000","last_fullsized":"2024-03-18T14:47:24.713357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":898,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711061+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:24.711061+0000","last_peered":"2024-03-18T14:47:24.711061+0000","last_clean":"2024-03-18T14:47:24.711061+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:24.711061+0000","last_undegraded":"2024-03-18T14:47:24.711061+0000","last_fullsized":"2024-03-18T14:47:24.711061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.447037+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:27.447037+0000","last_peered":"2024-03-18T14:47:27.447037+0000","last_clean":"2024-03-18T14:47:27.447037+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:27.447037+0000","last_undegraded":"2024-03-18T14:47:27.447037+0000","last_fullsized":"2024-03-18T14:47:27.447037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712854+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:24.712854+0000","last_peered":"2024-03-18T14:47:24.712854+0000","last_clean":"2024-03-18T14:47:24.712854+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:24.712854+0000","last_undegraded":"2024-03-18T14:47:24.712854+0000","last_fullsized":"2024-03-18T14:47:24.712854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1037,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599643+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:25.599643+0000","last_peered":"2024-03-18T14:47:25.599643+0000","last_clean":"2024-03-18T14:47:25.599643+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:25.599643+0000","last_undegraded":"2024-03-18T14:47:25.599643+0000","last_fullsized":"2024-03-18T14:47:25.599643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601639+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:25.601639+0000","last_peered":"2024-03-18T14:47:25.601639+0000","last_clean":"2024-03-18T14:47:25.601639+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:25.601639+0000","last_undegraded":"2024-03-18T14:47:25.601639+0000","last_fullsized":"2024-03-18T14:47:25.601639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":704,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:28.486202+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:28.486202+0000","last_peered":"2024-03-18T14:47:28.486202+0000","last_clean":"2024-03-18T14:47:28.486202+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:28.486202+0000","last_undegraded":"2024-03-18T14:47:28.486202+0000","last_fullsized":"2024-03-18T14:47:28.486202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":920,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710173+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:24.710173+0000","last_peered":"2024-03-18T14:47:24.710173+0000","last_clean":"2024-03-18T14:47:24.710173+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:24.710173+0000","last_undegraded":"2024-03-18T14:47:24.710173+0000","last_fullsized":"2024-03-18T14:47:24.710173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":170,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711152+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:24.711152+0000","last_peered":"2024-03-18T14:47:24.711152+0000","last_clean":"2024-03-18T14:47:24.711152+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:24.711152+0000","last_undegraded":"2024-03-18T14:47:24.711152+0000","last_fullsized":"2024-03-18T14:47:24.711152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":951,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710607+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:24.710607+0000","last_peered":"2024-03-18T14:47:24.710607+0000","last_clean":"2024-03-18T14:47:24.710607+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:24.710607+0000","last_undegraded":"2024-03-18T14:47:24.710607+0000","last_fullsized":"2024-03-18T14:47:24.710607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":427,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.445460+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:27.445460+0000","last_peered":"2024-03-18T14:47:27.445460+0000","last_clean":"2024-03-18T14:47:27.445460+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:27.445460+0000","last_undegraded":"2024-03-18T14:47:27.445460+0000","last_fullsized":"2024-03-18T14:47:27.445460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":838,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710407+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:24.710407+0000","last_peered":"2024-03-18T14:47:24.710407+0000","last_clean":"2024-03-18T14:47:24.710407+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:24.710407+0000","last_undegraded":"2024-03-18T14:47:24.710407+0000","last_fullsized":"2024-03-18T14:47:24.710407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.443865+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:27.443865+0000","last_peered":"2024-03-18T14:47:27.443865+0000","last_clean":"2024-03-18T14:47:27.443865+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:27.443865+0000","last_undegraded":"2024-03-18T14:47:27.443865+0000","last_fullsized":"2024-03-18T14:47:27.443865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":892,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710187+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:24.710187+0000","last_peered":"2024-03-18T14:47:24.710187+0000","last_clean":"2024-03-18T14:47:24.710187+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:24.710187+0000","last_undegraded":"2024-03-18T14:47:24.710187+0000","last_fullsized":"2024-03-18T14:47:24.710187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":523,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601185+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:25.601185+0000","last_peered":"2024-03-18T14:47:25.601185+0000","last_clean":"2024-03-18T14:47:25.601185+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:25.601185+0000","last_undegraded":"2024-03-18T14:47:25.601185+0000","last_fullsized":"2024-03-18T14:47:25.601185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600747+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:25.600747+0000","last_peered":"2024-03-18T14:47:25.600747+0000","last_clean":"2024-03-18T14:47:25.600747+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:25.600747+0000","last_undegraded":"2024-03-18T14:47:25.600747+0000","last_fullsized":"2024-03-18T14:47:25.600747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":255,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438993+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:27.438993+0000","last_peered":"2024-03-18T14:47:27.438993+0000","last_clean":"2024-03-18T14:47:27.438993+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:27.438993+0000","last_undegraded":"2024-03-18T14:47:27.438993+0000","last_fullsized":"2024-03-18T14:47:27.438993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710130+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:24.710130+0000","last_peered":"2024-03-18T14:47:24.710130+0000","last_clean":"2024-03-18T14:47:24.710130+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:24.710130+0000","last_undegraded":"2024-03-18T14:47:24.710130+0000","last_fullsized":"2024-03-18T14:47:24.710130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1092,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712058+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:24.712058+0000","last_peered":"2024-03-18T14:47:24.712058+0000","last_clean":"2024-03-18T14:47:24.712058+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:24.712058+0000","last_undegraded":"2024-03-18T14:47:24.712058+0000","last_fullsized":"2024-03-18T14:47:24.712058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600538+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:25.600538+0000","last_peered":"2024-03-18T14:47:25.600538+0000","last_clean":"2024-03-18T14:47:25.600538+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:25.600538+0000","last_undegraded":"2024-03-18T14:47:25.600538+0000","last_fullsized":"2024-03-18T14:47:25.600538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":921,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710638+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:24.710638+0000","last_peered":"2024-03-18T14:47:24.710638+0000","last_clean":"2024-03-18T14:47:24.710638+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:24.710638+0000","last_undegraded":"2024-03-18T14:47:24.710638+0000","last_fullsized":"2024-03-18T14:47:24.710638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":917,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599923+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:25.599923+0000","last_peered":"2024-03-18T14:47:25.599923+0000","last_clean":"2024-03-18T14:47:25.599923+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:25.599923+0000","last_undegraded":"2024-03-18T14:47:25.599923+0000","last_fullsized":"2024-03-18T14:47:25.599923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713347+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:24.713347+0000","last_peered":"2024-03-18T14:47:24.713347+0000","last_clean":"2024-03-18T14:47:24.713347+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:24.713347+0000","last_undegraded":"2024-03-18T14:47:24.713347+0000","last_fullsized":"2024-03-18T14:47:24.713347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159318,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16063,"num_write_kb":262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274318636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19635,"ondisk_log_size":19635,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413524,"kb_used_data":95884,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958316,"statfs":{"total":96636764160,"available":96213315584,"internally_reserved":0,"allocated":98185216,"data_stored":97948187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379172,"kb_used_data":62940,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992668,"statfs":{"total":96636764160,"available":96248492032,"internally_reserved":0,"allocated":64450560,"data_stored":64239853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372468,"kb_used_data":59884,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999372,"statfs":{"total":96636764160,"available":96255356928,"internally_reserved":0,"allocated":61321216,"data_stored":61095214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051593,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367740,"kb_used_data":51828,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004100,"statfs":{"total":96636764160,"available":96260198400,"internally_reserved":0,"allocated":53071872,"data_stored":52858874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52107817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:50.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:50.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.280+0000 7fcb99590700 1 Processor -- start 2024-03-18T14:47:50.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.280+0000 7fcb99590700 1 -- start start 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb940a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb940a4580 0x7fcb940a49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940a3ea0 con 0x7fcb940a4580 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940a66c0 con 0x7fcb940a17f0 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb99590700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940a21d0 con 0x7fcb940b4fb0 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb92ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb940a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb940a4580 0x7fcb940a49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb937fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb940a4580 0x7fcb940a49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43886/0 (socket says 172.21.15.57:43886) 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb92ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb940a3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45412/0 (socket says 172.21.15.57:45412) 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb937fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57692/0 (socket says 172.21.15.57:57692) 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 -- 172.21.15.57:0/4176029807 learned_addr learned my addr 172.21.15.57:0/4176029807 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 -- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 msgr2=0x7fcb940a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb940a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 -- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 msgr2=0x7fcb940a1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 -- 172.21.15.57:0/4176029807 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9413e580 con 0x7fcb940a4580 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb937fe700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.281+0000 7fcb927fc700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb940a49d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099e0 tx=0x7fcb88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30c51590f32d393 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb91ffb700 1 -- 172.21.15.57:0/4176029807 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800b640 con 0x7fcb940a4580 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb91ffb700 1 -- 172.21.15.57:0/4176029807 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8800b7a0 con 0x7fcb940a4580 2024-03-18T14:47:50.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb91ffb700 1 -- 172.21.15.57:0/4176029807 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8800bb40 con 0x7fcb940a4580 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 -- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 msgr2=0x7fcb940a49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb940a49d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcb880099e0 tx=0x7fcb88009250 comp rx=0 tx=0).stop 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 -- 172.21.15.57:0/4176029807 shutdown_connections 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb940a1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb940a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 --2- 172.21.15.57:0/4176029807 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb940a49d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 -- 172.21.15.57:0/4176029807 >> 172.21.15.57:0/4176029807 conn(0x7fcb94063600 msgr2=0x7fcb94063a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 -- 172.21.15.57:0/4176029807 shutdown_connections 2024-03-18T14:47:50.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.282+0000 7fcb99590700 1 -- 172.21.15.57:0/4176029807 wait complete. 2024-03-18T14:47:50.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.283+0000 7fcb99590700 1 Processor -- start 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.283+0000 7fcb99590700 1 -- start start 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb9409a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb94151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9409c160 con 0x7fcb940a4580 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9409adc0 con 0x7fcb940a17f0 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb99590700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940a1160 con 0x7fcb940b4fb0 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57694/0 (socket says 172.21.15.57:57694) 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb937fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb94151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 -- 172.21.15.57:0/500486873 learned_addr learned my addr 172.21.15.57:0/500486873 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb927fc700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb9409a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 -- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 msgr2=0x7fcb94151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb94151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 -- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 msgr2=0x7fcb9409a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb9409a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 -- 172.21.15.57:0/500486873 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009a20 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb937fe700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb94151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb927fc700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb9409a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.284+0000 7fcb92ffd700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ec80 tx=0x7fcb840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.285+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400c850 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.285+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400c9b0 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.285+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400cd50 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.285+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb880094f0 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.285+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9409ce00 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.286+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fcb84013680 con 0x7fcb940a17f0 2024-03-18T14:47:50.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.286+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb940648f0 con 0x7fcb940a17f0 2024-03-18T14:47:50.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.286+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fcb8405b490 con 0x7fcb940a17f0 2024-03-18T14:47:50.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.290+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fcb840396b0 con 0x7fcb940a17f0 2024-03-18T14:47:50.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.448+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb940a13d0 con 0x7fcb80046010 2024-03-18T14:47:50.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.456+0000 7fcb7affd700 1 -- 172.21.15.57:0/500486873 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273444 (unknown 2965378022 0 2282131912) 0x7fcb8800beb0 con 0x7fcb80046010 2024-03-18T14:47:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 >> v1:172.21.15.57:6816/47480 conn(0x7fcb80046010 legacy=0x7fcb800484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 msgr2=0x7fcb9409b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcb8400ec80 tx=0x7fcb840091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 shutdown_connections 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcb940b4fb0 0x7fcb94151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcb940a17f0 0x7fcb9409b880 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 --2- 172.21.15.57:0/500486873 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb940a4580 0x7fcb9409a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 >> 172.21.15.57:0/500486873 conn(0x7fcb94063600 msgr2=0x7fcb94142250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 shutdown_connections 2024-03-18T14:47:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.459+0000 7fcb99590700 1 -- 172.21.15.57:0/500486873 wait complete. 2024-03-18T14:47:50.464 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:50.472 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-18T14:47:49.557231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749686,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65074,"num_write_kb":8749062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71471,"ondisk_log_size":71471,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532904,"kb_used_data":270536,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954456,"statfs":{"total":386547056640,"available":384977362944,"internally_reserved":0,"allocated":277028864,"data_stored":276142128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002422"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":880,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710440+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:24.710440+0000","last_peered":"2024-03-18T14:47:24.710440+0000","last_clean":"2024-03-18T14:47:24.710440+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:24.710440+0000","last_undegraded":"2024-03-18T14:47:24.710440+0000","last_fullsized":"2024-03-18T14:47:24.710440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710484+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:24.710484+0000","last_peered":"2024-03-18T14:47:24.710484+0000","last_clean":"2024-03-18T14:47:24.710484+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:24.710484+0000","last_undegraded":"2024-03-18T14:47:24.710484+0000","last_fullsized":"2024-03-18T14:47:24.710484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":945,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711185+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:24.711185+0000","last_peered":"2024-03-18T14:47:24.711185+0000","last_clean":"2024-03-18T14:47:24.711185+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:24.711185+0000","last_undegraded":"2024-03-18T14:47:24.711185+0000","last_fullsized":"2024-03-18T14:47:24.711185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711313+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:24.711313+0000","last_peered":"2024-03-18T14:47:24.711313+0000","last_clean":"2024-03-18T14:47:24.711313+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:24.711313+0000","last_undegraded":"2024-03-18T14:47:24.711313+0000","last_fullsized":"2024-03-18T14:47:24.711313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710214+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:24.710214+0000","last_peered":"2024-03-18T14:47:24.710214+0000","last_clean":"2024-03-18T14:47:24.710214+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:24.710214+0000","last_undegraded":"2024-03-18T14:47:24.710214+0000","last_fullsized":"2024-03-18T14:47:24.710214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":904,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600392+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:25.600392+0000","last_peered":"2024-03-18T14:47:25.600392+0000","last_clean":"2024-03-18T14:47:25.600392+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:25.600392+0000","last_undegraded":"2024-03-18T14:47:25.600392+0000","last_fullsized":"2024-03-18T14:47:25.600392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":957,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599543+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:25.599543+0000","last_peered":"2024-03-18T14:47:25.599543+0000","last_clean":"2024-03-18T14:47:25.599543+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:25.599543+0000","last_undegraded":"2024-03-18T14:47:25.599543+0000","last_fullsized":"2024-03-18T14:47:25.599543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":804,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711870+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:24.711870+0000","last_peered":"2024-03-18T14:47:24.711870+0000","last_clean":"2024-03-18T14:47:24.711870+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:24.711870+0000","last_undegraded":"2024-03-18T14:47:24.711870+0000","last_fullsized":"2024-03-18T14:47:24.711870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":947,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712243+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:24.712243+0000","last_peered":"2024-03-18T14:47:24.712243+0000","last_clean":"2024-03-18T14:47:24.712243+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:24.712243+0000","last_undegraded":"2024-03-18T14:47:24.712243+0000","last_fullsized":"2024-03-18T14:47:24.712243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":830,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712437+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:24.712437+0000","last_peered":"2024-03-18T14:47:24.712437+0000","last_clean":"2024-03-18T14:47:24.712437+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:24.712437+0000","last_undegraded":"2024-03-18T14:47:24.712437+0000","last_fullsized":"2024-03-18T14:47:24.712437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":806,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712653+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:24.712653+0000","last_peered":"2024-03-18T14:47:24.712653+0000","last_clean":"2024-03-18T14:47:24.712653+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:24.712653+0000","last_undegraded":"2024-03-18T14:47:24.712653+0000","last_fullsized":"2024-03-18T14:47:24.712653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":833,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710663+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:24.710663+0000","last_peered":"2024-03-18T14:47:24.710663+0000","last_clean":"2024-03-18T14:47:24.710663+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:24.710663+0000","last_undegraded":"2024-03-18T14:47:24.710663+0000","last_fullsized":"2024-03-18T14:47:24.710663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":887,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710327+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:24.710327+0000","last_peered":"2024-03-18T14:47:24.710327+0000","last_clean":"2024-03-18T14:47:24.710327+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:24.710327+0000","last_undegraded":"2024-03-18T14:47:24.710327+0000","last_fullsized":"2024-03-18T14:47:24.710327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712352+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:24.712352+0000","last_peered":"2024-03-18T14:47:24.712352+0000","last_clean":"2024-03-18T14:47:24.712352+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:24.712352+0000","last_undegraded":"2024-03-18T14:47:24.712352+0000","last_fullsized":"2024-03-18T14:47:24.712352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1050,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710336+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:24.710336+0000","last_peered":"2024-03-18T14:47:24.710336+0000","last_clean":"2024-03-18T14:47:24.710336+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:24.710336+0000","last_undegraded":"2024-03-18T14:47:24.710336+0000","last_fullsized":"2024-03-18T14:47:24.710336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":883,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599889+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:25.599889+0000","last_peered":"2024-03-18T14:47:25.599889+0000","last_clean":"2024-03-18T14:47:25.599889+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:25.599889+0000","last_undegraded":"2024-03-18T14:47:25.599889+0000","last_fullsized":"2024-03-18T14:47:25.599889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1012,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712495+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:24.712495+0000","last_peered":"2024-03-18T14:47:24.712495+0000","last_clean":"2024-03-18T14:47:24.712495+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:24.712495+0000","last_undegraded":"2024-03-18T14:47:24.712495+0000","last_fullsized":"2024-03-18T14:47:24.712495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1011,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711421+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:24.711421+0000","last_peered":"2024-03-18T14:47:24.711421+0000","last_clean":"2024-03-18T14:47:24.711421+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:24.711421+0000","last_undegraded":"2024-03-18T14:47:24.711421+0000","last_fullsized":"2024-03-18T14:47:24.711421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710683+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:24.710683+0000","last_peered":"2024-03-18T14:47:24.710683+0000","last_clean":"2024-03-18T14:47:24.710683+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:24.710683+0000","last_undegraded":"2024-03-18T14:47:24.710683+0000","last_fullsized":"2024-03-18T14:47:24.710683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713231+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:24.713231+0000","last_peered":"2024-03-18T14:47:24.713231+0000","last_clean":"2024-03-18T14:47:24.713231+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:24.713231+0000","last_undegraded":"2024-03-18T14:47:24.713231+0000","last_fullsized":"2024-03-18T14:47:24.713231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1029,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712578+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:24.712578+0000","last_peered":"2024-03-18T14:47:24.712578+0000","last_clean":"2024-03-18T14:47:24.712578+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:24.712578+0000","last_undegraded":"2024-03-18T14:47:24.712578+0000","last_fullsized":"2024-03-18T14:47:24.712578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":891,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710482+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:24.710482+0000","last_peered":"2024-03-18T14:47:24.710482+0000","last_clean":"2024-03-18T14:47:24.710482+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:24.710482+0000","last_undegraded":"2024-03-18T14:47:24.710482+0000","last_fullsized":"2024-03-18T14:47:24.710482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1019,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600855+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:25.600855+0000","last_peered":"2024-03-18T14:47:25.600855+0000","last_clean":"2024-03-18T14:47:25.600855+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:25.600855+0000","last_undegraded":"2024-03-18T14:47:25.600855+0000","last_fullsized":"2024-03-18T14:47:25.600855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":936,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711752+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:24.711752+0000","last_peered":"2024-03-18T14:47:24.711752+0000","last_clean":"2024-03-18T14:47:24.711752+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:24.711752+0000","last_undegraded":"2024-03-18T14:47:24.711752+0000","last_fullsized":"2024-03-18T14:47:24.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":966,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712973+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:24.712973+0000","last_peered":"2024-03-18T14:47:24.712973+0000","last_clean":"2024-03-18T14:47:24.712973+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:24.712973+0000","last_undegraded":"2024-03-18T14:47:24.712973+0000","last_fullsized":"2024-03-18T14:47:24.712973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712776+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:24.712776+0000","last_peered":"2024-03-18T14:47:24.712776+0000","last_clean":"2024-03-18T14:47:24.712776+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:24.712776+0000","last_undegraded":"2024-03-18T14:47:24.712776+0000","last_fullsized":"2024-03-18T14:47:24.712776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":934,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600488+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:25.600488+0000","last_peered":"2024-03-18T14:47:25.600488+0000","last_clean":"2024-03-18T14:47:25.600488+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:25.600488+0000","last_undegraded":"2024-03-18T14:47:25.600488+0000","last_fullsized":"2024-03-18T14:47:25.600488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712447+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:24.712447+0000","last_peered":"2024-03-18T14:47:24.712447+0000","last_clean":"2024-03-18T14:47:24.712447+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:24.712447+0000","last_undegraded":"2024-03-18T14:47:24.712447+0000","last_fullsized":"2024-03-18T14:47:24.712447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":926,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599866+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:25.599866+0000","last_peered":"2024-03-18T14:47:25.599866+0000","last_clean":"2024-03-18T14:47:25.599866+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:25.599866+0000","last_undegraded":"2024-03-18T14:47:25.599866+0000","last_fullsized":"2024-03-18T14:47:25.599866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1400,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711973+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:24.711973+0000","last_peered":"2024-03-18T14:47:24.711973+0000","last_clean":"2024-03-18T14:47:24.711973+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:24.711973+0000","last_undegraded":"2024-03-18T14:47:24.711973+0000","last_fullsized":"2024-03-18T14:47:24.711973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":828,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711702+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:24.711702+0000","last_peered":"2024-03-18T14:47:24.711702+0000","last_clean":"2024-03-18T14:47:24.711702+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:24.711702+0000","last_undegraded":"2024-03-18T14:47:24.711702+0000","last_fullsized":"2024-03-18T14:47:24.711702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599482+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:25.599482+0000","last_peered":"2024-03-18T14:47:25.599482+0000","last_clean":"2024-03-18T14:47:25.599482+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:25.599482+0000","last_undegraded":"2024-03-18T14:47:25.599482+0000","last_fullsized":"2024-03-18T14:47:25.599482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":870,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601271+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:25.601271+0000","last_peered":"2024-03-18T14:47:25.601271+0000","last_clean":"2024-03-18T14:47:25.601271+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:25.601271+0000","last_undegraded":"2024-03-18T14:47:25.601271+0000","last_fullsized":"2024-03-18T14:47:25.601271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712400+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:24.712400+0000","last_peered":"2024-03-18T14:47:24.712400+0000","last_clean":"2024-03-18T14:47:24.712400+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:24.712400+0000","last_undegraded":"2024-03-18T14:47:24.712400+0000","last_fullsized":"2024-03-18T14:47:24.712400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":843,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600141+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:25.600141+0000","last_peered":"2024-03-18T14:47:25.600141+0000","last_clean":"2024-03-18T14:47:25.600141+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:25.600141+0000","last_undegraded":"2024-03-18T14:47:25.600141+0000","last_fullsized":"2024-03-18T14:47:25.600141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710369+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:24.710369+0000","last_peered":"2024-03-18T14:47:24.710369+0000","last_clean":"2024-03-18T14:47:24.710369+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:24.710369+0000","last_undegraded":"2024-03-18T14:47:24.710369+0000","last_fullsized":"2024-03-18T14:47:24.710369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1059,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599644+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:25.599644+0000","last_peered":"2024-03-18T14:47:25.599644+0000","last_clean":"2024-03-18T14:47:25.599644+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:25.599644+0000","last_undegraded":"2024-03-18T14:47:25.599644+0000","last_fullsized":"2024-03-18T14:47:25.599644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":270,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.442911+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:27.442911+0000","last_peered":"2024-03-18T14:47:27.442911+0000","last_clean":"2024-03-18T14:47:27.442911+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:27.442911+0000","last_undegraded":"2024-03-18T14:47:27.442911+0000","last_fullsized":"2024-03-18T14:47:27.442911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1036,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712994+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:24.712994+0000","last_peered":"2024-03-18T14:47:24.712994+0000","last_clean":"2024-03-18T14:47:24.712994+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:24.712994+0000","last_undegraded":"2024-03-18T14:47:24.712994+0000","last_fullsized":"2024-03-18T14:47:24.712994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'649","reported_seq":693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.444711+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:27.444711+0000","last_peered":"2024-03-18T14:47:27.444711+0000","last_clean":"2024-03-18T14:47:27.444711+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:27.444711+0000","last_undegraded":"2024-03-18T14:47:27.444711+0000","last_fullsized":"2024-03-18T14:47:27.444711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":550,"num_write_kb":12564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":981,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710262+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:24.710262+0000","last_peered":"2024-03-18T14:47:24.710262+0000","last_clean":"2024-03-18T14:47:24.710262+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:24.710262+0000","last_undegraded":"2024-03-18T14:47:24.710262+0000","last_fullsized":"2024-03-18T14:47:24.710262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":604,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438163+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:27.438163+0000","last_peered":"2024-03-18T14:47:27.438163+0000","last_clean":"2024-03-18T14:47:27.438163+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:27.438163+0000","last_undegraded":"2024-03-18T14:47:27.438163+0000","last_fullsized":"2024-03-18T14:47:27.438163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":962,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600270+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:25.600270+0000","last_peered":"2024-03-18T14:47:25.600270+0000","last_clean":"2024-03-18T14:47:25.600270+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:25.600270+0000","last_undegraded":"2024-03-18T14:47:25.600270+0000","last_fullsized":"2024-03-18T14:47:25.600270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":216,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710584+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:24.710584+0000","last_peered":"2024-03-18T14:47:24.710584+0000","last_clean":"2024-03-18T14:47:24.710584+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:24.710584+0000","last_undegraded":"2024-03-18T14:47:24.710584+0000","last_fullsized":"2024-03-18T14:47:24.710584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599738+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:25.599738+0000","last_peered":"2024-03-18T14:47:25.599738+0000","last_clean":"2024-03-18T14:47:25.599738+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:25.599738+0000","last_undegraded":"2024-03-18T14:47:25.599738+0000","last_fullsized":"2024-03-18T14:47:25.599738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":413,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601164+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:25.601164+0000","last_peered":"2024-03-18T14:47:25.601164+0000","last_clean":"2024-03-18T14:47:25.601164+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:25.601164+0000","last_undegraded":"2024-03-18T14:47:25.601164+0000","last_fullsized":"2024-03-18T14:47:25.601164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":863,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711877+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:24.711877+0000","last_peered":"2024-03-18T14:47:24.711877+0000","last_clean":"2024-03-18T14:47:24.711877+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:24.711877+0000","last_undegraded":"2024-03-18T14:47:24.711877+0000","last_fullsized":"2024-03-18T14:47:24.711877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'179","reported_seq":224,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-03-18T14:47:37.523076+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:37.523076+0000","last_peered":"2024-03-18T14:47:37.523076+0000","last_clean":"2024-03-18T14:47:37.523076+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:37.523076+0000","last_undegraded":"2024-03-18T14:47:37.523076+0000","last_fullsized":"2024-03-18T14:47:37.523076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234466,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":65,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601638+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:25.601638+0000","last_peered":"2024-03-18T14:47:25.601638+0000","last_clean":"2024-03-18T14:47:25.601638+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:25.601638+0000","last_undegraded":"2024-03-18T14:47:25.601638+0000","last_fullsized":"2024-03-18T14:47:25.601638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712073+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:24.712073+0000","last_peered":"2024-03-18T14:47:24.712073+0000","last_clean":"2024-03-18T14:47:24.712073+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:24.712073+0000","last_undegraded":"2024-03-18T14:47:24.712073+0000","last_fullsized":"2024-03-18T14:47:24.712073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1021,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599768+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:25.599768+0000","last_peered":"2024-03-18T14:47:25.599768+0000","last_clean":"2024-03-18T14:47:25.599768+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:25.599768+0000","last_undegraded":"2024-03-18T14:47:25.599768+0000","last_fullsized":"2024-03-18T14:47:25.599768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":446,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.446361+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:27.446361+0000","last_peered":"2024-03-18T14:47:27.446361+0000","last_clean":"2024-03-18T14:47:27.446361+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:27.446361+0000","last_undegraded":"2024-03-18T14:47:27.446361+0000","last_fullsized":"2024-03-18T14:47:27.446361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":885,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712207+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:24.712207+0000","last_peered":"2024-03-18T14:47:24.712207+0000","last_clean":"2024-03-18T14:47:24.712207+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:24.712207+0000","last_undegraded":"2024-03-18T14:47:24.712207+0000","last_fullsized":"2024-03-18T14:47:24.712207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600602+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:25.600602+0000","last_peered":"2024-03-18T14:47:25.600602+0000","last_clean":"2024-03-18T14:47:25.600602+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:25.600602+0000","last_undegraded":"2024-03-18T14:47:25.600602+0000","last_fullsized":"2024-03-18T14:47:25.600602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710377+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:24.710377+0000","last_peered":"2024-03-18T14:47:24.710377+0000","last_clean":"2024-03-18T14:47:24.710377+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:24.710377+0000","last_undegraded":"2024-03-18T14:47:24.710377+0000","last_fullsized":"2024-03-18T14:47:24.710377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711104+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:24.711104+0000","last_peered":"2024-03-18T14:47:24.711104+0000","last_clean":"2024-03-18T14:47:24.711104+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:24.711104+0000","last_undegraded":"2024-03-18T14:47:24.711104+0000","last_fullsized":"2024-03-18T14:47:24.711104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":929,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711303+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:24.711303+0000","last_peered":"2024-03-18T14:47:24.711303+0000","last_clean":"2024-03-18T14:47:24.711303+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:24.711303+0000","last_undegraded":"2024-03-18T14:47:24.711303+0000","last_fullsized":"2024-03-18T14:47:24.711303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":630,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600452+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:25.600452+0000","last_peered":"2024-03-18T14:47:25.600452+0000","last_clean":"2024-03-18T14:47:25.600452+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:25.600452+0000","last_undegraded":"2024-03-18T14:47:25.600452+0000","last_fullsized":"2024-03-18T14:47:25.600452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711207+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:24.711207+0000","last_peered":"2024-03-18T14:47:24.711207+0000","last_clean":"2024-03-18T14:47:24.711207+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:24.711207+0000","last_undegraded":"2024-03-18T14:47:24.711207+0000","last_fullsized":"2024-03-18T14:47:24.711207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600738+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:25.600738+0000","last_peered":"2024-03-18T14:47:25.600738+0000","last_clean":"2024-03-18T14:47:25.600738+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:25.600738+0000","last_undegraded":"2024-03-18T14:47:25.600738+0000","last_fullsized":"2024-03-18T14:47:25.600738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":895,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600209+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:25.600209+0000","last_peered":"2024-03-18T14:47:25.600209+0000","last_clean":"2024-03-18T14:47:25.600209+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:25.600209+0000","last_undegraded":"2024-03-18T14:47:25.600209+0000","last_fullsized":"2024-03-18T14:47:25.600209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":330,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599505+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:25.599505+0000","last_peered":"2024-03-18T14:47:25.599505+0000","last_clean":"2024-03-18T14:47:25.599505+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:25.599505+0000","last_undegraded":"2024-03-18T14:47:25.599505+0000","last_fullsized":"2024-03-18T14:47:25.599505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":897,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710680+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:24.710680+0000","last_peered":"2024-03-18T14:47:24.710680+0000","last_clean":"2024-03-18T14:47:24.710680+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:24.710680+0000","last_undegraded":"2024-03-18T14:47:24.710680+0000","last_fullsized":"2024-03-18T14:47:24.710680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600008+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:25.600008+0000","last_peered":"2024-03-18T14:47:25.600008+0000","last_clean":"2024-03-18T14:47:25.600008+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:25.600008+0000","last_undegraded":"2024-03-18T14:47:25.600008+0000","last_fullsized":"2024-03-18T14:47:25.600008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713247+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:24.713247+0000","last_peered":"2024-03-18T14:47:24.713247+0000","last_clean":"2024-03-18T14:47:24.713247+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:24.713247+0000","last_undegraded":"2024-03-18T14:47:24.713247+0000","last_fullsized":"2024-03-18T14:47:24.713247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713126+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:24.713126+0000","last_peered":"2024-03-18T14:47:24.713126+0000","last_clean":"2024-03-18T14:47:24.713126+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:24.713126+0000","last_undegraded":"2024-03-18T14:47:24.713126+0000","last_fullsized":"2024-03-18T14:47:24.713126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710611+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:24.710611+0000","last_peered":"2024-03-18T14:47:24.710611+0000","last_clean":"2024-03-18T14:47:24.710611+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:24.710611+0000","last_undegraded":"2024-03-18T14:47:24.710611+0000","last_fullsized":"2024-03-18T14:47:24.710611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712464+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:24.712464+0000","last_peered":"2024-03-18T14:47:24.712464+0000","last_clean":"2024-03-18T14:47:24.712464+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:24.712464+0000","last_undegraded":"2024-03-18T14:47:24.712464+0000","last_fullsized":"2024-03-18T14:47:24.712464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600668+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:25.600668+0000","last_peered":"2024-03-18T14:47:25.600668+0000","last_clean":"2024-03-18T14:47:25.600668+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:25.600668+0000","last_undegraded":"2024-03-18T14:47:25.600668+0000","last_fullsized":"2024-03-18T14:47:25.600668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710936+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:24.710936+0000","last_peered":"2024-03-18T14:47:24.710936+0000","last_clean":"2024-03-18T14:47:24.710936+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:24.710936+0000","last_undegraded":"2024-03-18T14:47:24.710936+0000","last_fullsized":"2024-03-18T14:47:24.710936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713044+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:24.713044+0000","last_peered":"2024-03-18T14:47:24.713044+0000","last_clean":"2024-03-18T14:47:24.713044+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:24.713044+0000","last_undegraded":"2024-03-18T14:47:24.713044+0000","last_fullsized":"2024-03-18T14:47:24.713044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710256+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:24.710256+0000","last_peered":"2024-03-18T14:47:24.710256+0000","last_clean":"2024-03-18T14:47:24.710256+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:24.710256+0000","last_undegraded":"2024-03-18T14:47:24.710256+0000","last_fullsized":"2024-03-18T14:47:24.710256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":867,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712128+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.712128+0000","last_peered":"2024-03-18T14:47:24.712128+0000","last_clean":"2024-03-18T14:47:24.712128+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.712128+0000","last_undegraded":"2024-03-18T14:47:24.712128+0000","last_fullsized":"2024-03-18T14:47:24.712128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713074+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:24.713074+0000","last_peered":"2024-03-18T14:47:24.713074+0000","last_clean":"2024-03-18T14:47:24.713074+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:24.713074+0000","last_undegraded":"2024-03-18T14:47:24.713074+0000","last_fullsized":"2024-03-18T14:47:24.713074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600551+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:25.600551+0000","last_peered":"2024-03-18T14:47:25.600551+0000","last_clean":"2024-03-18T14:47:25.600551+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:25.600551+0000","last_undegraded":"2024-03-18T14:47:25.600551+0000","last_fullsized":"2024-03-18T14:47:25.600551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711686+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:24.711686+0000","last_peered":"2024-03-18T14:47:24.711686+0000","last_clean":"2024-03-18T14:47:24.711686+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:24.711686+0000","last_undegraded":"2024-03-18T14:47:24.711686+0000","last_fullsized":"2024-03-18T14:47:24.711686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1053,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599935+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:25.599935+0000","last_peered":"2024-03-18T14:47:25.599935+0000","last_clean":"2024-03-18T14:47:25.599935+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:25.599935+0000","last_undegraded":"2024-03-18T14:47:25.599935+0000","last_fullsized":"2024-03-18T14:47:25.599935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":899,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600336+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:25.600336+0000","last_peered":"2024-03-18T14:47:25.600336+0000","last_clean":"2024-03-18T14:47:25.600336+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:25.600336+0000","last_undegraded":"2024-03-18T14:47:25.600336+0000","last_fullsized":"2024-03-18T14:47:25.600336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600216+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:25.600216+0000","last_peered":"2024-03-18T14:47:25.600216+0000","last_clean":"2024-03-18T14:47:25.600216+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:25.600216+0000","last_undegraded":"2024-03-18T14:47:25.600216+0000","last_fullsized":"2024-03-18T14:47:25.600216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710133+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:24.710133+0000","last_peered":"2024-03-18T14:47:24.710133+0000","last_clean":"2024-03-18T14:47:24.710133+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:24.710133+0000","last_undegraded":"2024-03-18T14:47:24.710133+0000","last_fullsized":"2024-03-18T14:47:24.710133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1022,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711613+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:24.711613+0000","last_peered":"2024-03-18T14:47:24.711613+0000","last_clean":"2024-03-18T14:47:24.711613+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:24.711613+0000","last_undegraded":"2024-03-18T14:47:24.711613+0000","last_fullsized":"2024-03-18T14:47:24.711613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600090+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:25.600090+0000","last_peered":"2024-03-18T14:47:25.600090+0000","last_clean":"2024-03-18T14:47:25.600090+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:25.600090+0000","last_undegraded":"2024-03-18T14:47:25.600090+0000","last_fullsized":"2024-03-18T14:47:25.600090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":490,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713357+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:24.713357+0000","last_peered":"2024-03-18T14:47:24.713357+0000","last_clean":"2024-03-18T14:47:24.713357+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:24.713357+0000","last_undegraded":"2024-03-18T14:47:24.713357+0000","last_fullsized":"2024-03-18T14:47:24.713357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":898,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711061+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:24.711061+0000","last_peered":"2024-03-18T14:47:24.711061+0000","last_clean":"2024-03-18T14:47:24.711061+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:24.711061+0000","last_undegraded":"2024-03-18T14:47:24.711061+0000","last_fullsized":"2024-03-18T14:47:24.711061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.447037+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:27.447037+0000","last_peered":"2024-03-18T14:47:27.447037+0000","last_clean":"2024-03-18T14:47:27.447037+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:27.447037+0000","last_undegraded":"2024-03-18T14:47:27.447037+0000","last_fullsized":"2024-03-18T14:47:27.447037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712854+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:24.712854+0000","last_peered":"2024-03-18T14:47:24.712854+0000","last_clean":"2024-03-18T14:47:24.712854+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:24.712854+0000","last_undegraded":"2024-03-18T14:47:24.712854+0000","last_fullsized":"2024-03-18T14:47:24.712854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1037,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599643+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:25.599643+0000","last_peered":"2024-03-18T14:47:25.599643+0000","last_clean":"2024-03-18T14:47:25.599643+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:25.599643+0000","last_undegraded":"2024-03-18T14:47:25.599643+0000","last_fullsized":"2024-03-18T14:47:25.599643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601639+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:25.601639+0000","last_peered":"2024-03-18T14:47:25.601639+0000","last_clean":"2024-03-18T14:47:25.601639+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:25.601639+0000","last_undegraded":"2024-03-18T14:47:25.601639+0000","last_fullsized":"2024-03-18T14:47:25.601639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":704,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:28.486202+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:28.486202+0000","last_peered":"2024-03-18T14:47:28.486202+0000","last_clean":"2024-03-18T14:47:28.486202+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:28.486202+0000","last_undegraded":"2024-03-18T14:47:28.486202+0000","last_fullsized":"2024-03-18T14:47:28.486202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":920,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710173+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:24.710173+0000","last_peered":"2024-03-18T14:47:24.710173+0000","last_clean":"2024-03-18T14:47:24.710173+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:24.710173+0000","last_undegraded":"2024-03-18T14:47:24.710173+0000","last_fullsized":"2024-03-18T14:47:24.710173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":170,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711152+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:24.711152+0000","last_peered":"2024-03-18T14:47:24.711152+0000","last_clean":"2024-03-18T14:47:24.711152+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:24.711152+0000","last_undegraded":"2024-03-18T14:47:24.711152+0000","last_fullsized":"2024-03-18T14:47:24.711152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":951,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710607+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:24.710607+0000","last_peered":"2024-03-18T14:47:24.710607+0000","last_clean":"2024-03-18T14:47:24.710607+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:24.710607+0000","last_undegraded":"2024-03-18T14:47:24.710607+0000","last_fullsized":"2024-03-18T14:47:24.710607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":427,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.445460+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:27.445460+0000","last_peered":"2024-03-18T14:47:27.445460+0000","last_clean":"2024-03-18T14:47:27.445460+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:27.445460+0000","last_undegraded":"2024-03-18T14:47:27.445460+0000","last_fullsized":"2024-03-18T14:47:27.445460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":838,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710407+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:24.710407+0000","last_peered":"2024-03-18T14:47:24.710407+0000","last_clean":"2024-03-18T14:47:24.710407+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:24.710407+0000","last_undegraded":"2024-03-18T14:47:24.710407+0000","last_fullsized":"2024-03-18T14:47:24.710407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.443865+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:27.443865+0000","last_peered":"2024-03-18T14:47:27.443865+0000","last_clean":"2024-03-18T14:47:27.443865+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:27.443865+0000","last_undegraded":"2024-03-18T14:47:27.443865+0000","last_fullsized":"2024-03-18T14:47:27.443865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":892,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710187+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:24.710187+0000","last_peered":"2024-03-18T14:47:24.710187+0000","last_clean":"2024-03-18T14:47:24.710187+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:24.710187+0000","last_undegraded":"2024-03-18T14:47:24.710187+0000","last_fullsized":"2024-03-18T14:47:24.710187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":523,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601185+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:25.601185+0000","last_peered":"2024-03-18T14:47:25.601185+0000","last_clean":"2024-03-18T14:47:25.601185+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:25.601185+0000","last_undegraded":"2024-03-18T14:47:25.601185+0000","last_fullsized":"2024-03-18T14:47:25.601185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600747+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:25.600747+0000","last_peered":"2024-03-18T14:47:25.600747+0000","last_clean":"2024-03-18T14:47:25.600747+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:25.600747+0000","last_undegraded":"2024-03-18T14:47:25.600747+0000","last_fullsized":"2024-03-18T14:47:25.600747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":255,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438993+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:27.438993+0000","last_peered":"2024-03-18T14:47:27.438993+0000","last_clean":"2024-03-18T14:47:27.438993+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:27.438993+0000","last_undegraded":"2024-03-18T14:47:27.438993+0000","last_fullsized":"2024-03-18T14:47:27.438993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710130+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:24.710130+0000","last_peered":"2024-03-18T14:47:24.710130+0000","last_clean":"2024-03-18T14:47:24.710130+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:24.710130+0000","last_undegraded":"2024-03-18T14:47:24.710130+0000","last_fullsized":"2024-03-18T14:47:24.710130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1092,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712058+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:24.712058+0000","last_peered":"2024-03-18T14:47:24.712058+0000","last_clean":"2024-03-18T14:47:24.712058+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:24.712058+0000","last_undegraded":"2024-03-18T14:47:24.712058+0000","last_fullsized":"2024-03-18T14:47:24.712058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600538+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:25.600538+0000","last_peered":"2024-03-18T14:47:25.600538+0000","last_clean":"2024-03-18T14:47:25.600538+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:25.600538+0000","last_undegraded":"2024-03-18T14:47:25.600538+0000","last_fullsized":"2024-03-18T14:47:25.600538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":921,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710638+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:24.710638+0000","last_peered":"2024-03-18T14:47:24.710638+0000","last_clean":"2024-03-18T14:47:24.710638+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:24.710638+0000","last_undegraded":"2024-03-18T14:47:24.710638+0000","last_fullsized":"2024-03-18T14:47:24.710638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":917,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599923+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:25.599923+0000","last_peered":"2024-03-18T14:47:25.599923+0000","last_clean":"2024-03-18T14:47:25.599923+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:25.599923+0000","last_undegraded":"2024-03-18T14:47:25.599923+0000","last_fullsized":"2024-03-18T14:47:25.599923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713347+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:24.713347+0000","last_peered":"2024-03-18T14:47:24.713347+0000","last_clean":"2024-03-18T14:47:24.713347+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:24.713347+0000","last_undegraded":"2024-03-18T14:47:24.713347+0000","last_fullsized":"2024-03-18T14:47:24.713347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159318,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16063,"num_write_kb":262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274318636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19635,"ondisk_log_size":19635,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413524,"kb_used_data":95884,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958316,"statfs":{"total":96636764160,"available":96213315584,"internally_reserved":0,"allocated":98185216,"data_stored":97948187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379172,"kb_used_data":62940,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992668,"statfs":{"total":96636764160,"available":96248492032,"internally_reserved":0,"allocated":64450560,"data_stored":64239853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372468,"kb_used_data":59884,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999372,"statfs":{"total":96636764160,"available":96255356928,"internally_reserved":0,"allocated":61321216,"data_stored":61095214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051593,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367740,"kb_used_data":51828,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004100,"statfs":{"total":96636764160,"available":96260198400,"internally_reserved":0,"allocated":53071872,"data_stored":52858874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52107817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:50.476 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T14:47:50.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 Processor -- start 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 -- start start 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd80a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 0x7f1fd813f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd80a73c0 con 0x7f1fd80a6c70 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd80a53f0 con 0x7f1fd80a3e00 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fde225700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80a50a0 con 0x7f1fd8068340 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fd6ffd700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1fd80a6c70 0x7f1fd813ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33858/0 (socket says 172.21.15.57:33858) 2024-03-18T14:47:50.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fd6ffd700 1 -- 172.21.15.57:0/3186080857 learned_addr learned my addr 172.21.15.57:0/3186080857 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/3186080857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd80a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.632+0000 7f1fd7fff700 1 --2- 172.21.15.57:0/3186080857 >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 0x7f1fd813f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd67fc700 1 -- 172.21.15.57:0/3186080857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002078188 0 0) 0x7f1fd80a73c0 con 0x7f1fd80a6c70 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd67fc700 1 -- 172.21.15.57:0/3186080857 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc0003570 con 0x7f1fd80a6c70 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd77fe700 1 -- 172.21.15.57:0/3186080857 >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 msgr2=0x7f1fd813f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/3186080857 >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 0x7f1fd813f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd77fe700 1 -- 172.21.15.57:0/3186080857 >> v1:172.21.15.57:6789/0 conn(0x7f1fd80a6c70 legacy=0x7f1fd813ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd77fe700 1 -- 172.21.15.57:0/3186080857 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd806c520 con 0x7f1fd8068340 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd7fff700 1 --2- 172.21.15.57:0/3186080857 >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 0x7f1fd813f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/3186080857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd80a4b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80098e0 tx=0x7f1fc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b192b322661532cf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd67fc700 1 -- 172.21.15.57:0/3186080857 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011630 con 0x7f1fd8068340 2024-03-18T14:47:50.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd67fc700 1 -- 172.21.15.57:0/3186080857 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8011790 con 0x7f1fd8068340 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.633+0000 7f1fd67fc700 1 -- 172.21.15.57:0/3186080857 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011b30 con 0x7f1fd8068340 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 -- 172.21.15.57:0/3186080857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 msgr2=0x7f1fd80a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 --2- 172.21.15.57:0/3186080857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd80a4b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1fc80098e0 tx=0x7f1fc80091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 -- 172.21.15.57:0/3186080857 shutdown_connections 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 --2- 172.21.15.57:0/3186080857 >> v2:172.21.15.57:3300/0 conn(0x7f1fd80a3e00 0x7f1fd813f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 --2- 172.21.15.57:0/3186080857 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd80a4b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 -- 172.21.15.57:0/3186080857 >> 172.21.15.57:0/3186080857 conn(0x7f1fd806c0a0 msgr2=0x7f1fd80679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 -- 172.21.15.57:0/3186080857 shutdown_connections 2024-03-18T14:47:50.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.634+0000 7f1fde225700 1 -- 172.21.15.57:0/3186080857 wait complete. 2024-03-18T14:47:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 Processor -- start 2024-03-18T14:47:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 -- start start 2024-03-18T14:47:50.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd8151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1fd80a3e00 0x7f1fd814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81443a0 con 0x7f1fd80a6c70 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80ac290 con 0x7f1fd8068340 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fde225700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd806a7f0 con 0x7f1fd80a3e00 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fd7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd8151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fd6ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1fd80a3e00 0x7f1fd814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.635+0000 7f1fd7fff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43912/0 (socket says 172.21.15.57:43912) 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd7fff700 1 -- 172.21.15.57:0/1963740818 learned_addr learned my addr 172.21.15.57:0/1963740818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 -- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1fd80a3e00 msgr2=0x7f1fd814dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1fd80a3e00 0x7f1fd814dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 -- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 msgr2=0x7f1fd814e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 -- 172.21.15.57:0/1963740818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd0009a20 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd7fff700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fd77fe700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd8151800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8016000 tx=0x7f1fc8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011b10 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8000c90 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8025620 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8009420 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.636+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd8151190 con 0x7f1fd8068340 2024-03-18T14:47:50.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.637+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8065180 con 0x7f1fd8068340 2024-03-18T14:47:50.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.637+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f1fc8025a10 con 0x7f1fd8068340 2024-03-18T14:47:50.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.637+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f1fc805c940 con 0x7f1fd8068340 2024-03-18T14:47:50.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.641+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1fc801deb0 con 0x7f1fd8068340 2024-03-18T14:47:50.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.797+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fd80b0920 con 0x7f1fc4046010 2024-03-18T14:47:50.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.805+0000 7f1fbf7fe700 1 -- 172.21.15.57:0/1963740818 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273444 (unknown 2965378022 0 2282131912) 0x7f1fd80b0920 con 0x7f1fc4046010 2024-03-18T14:47:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 >> v1:172.21.15.57:6816/47480 conn(0x7f1fc4046010 legacy=0x7f1fc40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 msgr2=0x7f1fd8151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd8151800 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8016000 tx=0x7f1fc8017000 comp rx=0 tx=0).stop 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 shutdown_connections 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1fd80a6c70 0x7f1fd814e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f1fd8068340 0x7f1fd8151800 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 --2- 172.21.15.57:0/1963740818 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f1fd80a3e00 0x7f1fd814dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 >> 172.21.15.57:0/1963740818 conn(0x7f1fd806c0a0 msgr2=0x7f1fd806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 shutdown_connections 2024-03-18T14:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.808+0000 7f1fde225700 1 -- 172.21.15.57:0/1963740818 wait complete. 2024-03-18T14:47:50.813 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:50.821 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-03-18T14:47:49.557231+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749686,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65074,"num_write_kb":8749062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71471,"ondisk_log_size":71471,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532904,"kb_used_data":270536,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954456,"statfs":{"total":386547056640,"available":384977362944,"internally_reserved":0,"allocated":277028864,"data_stored":276142128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002422"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":880,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710440+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:24.710440+0000","last_peered":"2024-03-18T14:47:24.710440+0000","last_clean":"2024-03-18T14:47:24.710440+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:24.710440+0000","last_undegraded":"2024-03-18T14:47:24.710440+0000","last_fullsized":"2024-03-18T14:47:24.710440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710484+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:24.710484+0000","last_peered":"2024-03-18T14:47:24.710484+0000","last_clean":"2024-03-18T14:47:24.710484+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:24.710484+0000","last_undegraded":"2024-03-18T14:47:24.710484+0000","last_fullsized":"2024-03-18T14:47:24.710484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":945,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711185+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:24.711185+0000","last_peered":"2024-03-18T14:47:24.711185+0000","last_clean":"2024-03-18T14:47:24.711185+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:24.711185+0000","last_undegraded":"2024-03-18T14:47:24.711185+0000","last_fullsized":"2024-03-18T14:47:24.711185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711313+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:24.711313+0000","last_peered":"2024-03-18T14:47:24.711313+0000","last_clean":"2024-03-18T14:47:24.711313+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:24.711313+0000","last_undegraded":"2024-03-18T14:47:24.711313+0000","last_fullsized":"2024-03-18T14:47:24.711313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710214+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:24.710214+0000","last_peered":"2024-03-18T14:47:24.710214+0000","last_clean":"2024-03-18T14:47:24.710214+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:24.710214+0000","last_undegraded":"2024-03-18T14:47:24.710214+0000","last_fullsized":"2024-03-18T14:47:24.710214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":904,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600392+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:25.600392+0000","last_peered":"2024-03-18T14:47:25.600392+0000","last_clean":"2024-03-18T14:47:25.600392+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:25.600392+0000","last_undegraded":"2024-03-18T14:47:25.600392+0000","last_fullsized":"2024-03-18T14:47:25.600392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":957,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599543+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:25.599543+0000","last_peered":"2024-03-18T14:47:25.599543+0000","last_clean":"2024-03-18T14:47:25.599543+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:25.599543+0000","last_undegraded":"2024-03-18T14:47:25.599543+0000","last_fullsized":"2024-03-18T14:47:25.599543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":804,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711870+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:24.711870+0000","last_peered":"2024-03-18T14:47:24.711870+0000","last_clean":"2024-03-18T14:47:24.711870+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:24.711870+0000","last_undegraded":"2024-03-18T14:47:24.711870+0000","last_fullsized":"2024-03-18T14:47:24.711870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":947,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712243+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:24.712243+0000","last_peered":"2024-03-18T14:47:24.712243+0000","last_clean":"2024-03-18T14:47:24.712243+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:24.712243+0000","last_undegraded":"2024-03-18T14:47:24.712243+0000","last_fullsized":"2024-03-18T14:47:24.712243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":830,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712437+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:24.712437+0000","last_peered":"2024-03-18T14:47:24.712437+0000","last_clean":"2024-03-18T14:47:24.712437+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:24.712437+0000","last_undegraded":"2024-03-18T14:47:24.712437+0000","last_fullsized":"2024-03-18T14:47:24.712437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":806,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712653+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:24.712653+0000","last_peered":"2024-03-18T14:47:24.712653+0000","last_clean":"2024-03-18T14:47:24.712653+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:24.712653+0000","last_undegraded":"2024-03-18T14:47:24.712653+0000","last_fullsized":"2024-03-18T14:47:24.712653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":833,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710663+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:24.710663+0000","last_peered":"2024-03-18T14:47:24.710663+0000","last_clean":"2024-03-18T14:47:24.710663+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:24.710663+0000","last_undegraded":"2024-03-18T14:47:24.710663+0000","last_fullsized":"2024-03-18T14:47:24.710663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":887,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710327+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:24.710327+0000","last_peered":"2024-03-18T14:47:24.710327+0000","last_clean":"2024-03-18T14:47:24.710327+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:24.710327+0000","last_undegraded":"2024-03-18T14:47:24.710327+0000","last_fullsized":"2024-03-18T14:47:24.710327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712352+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:24.712352+0000","last_peered":"2024-03-18T14:47:24.712352+0000","last_clean":"2024-03-18T14:47:24.712352+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:24.712352+0000","last_undegraded":"2024-03-18T14:47:24.712352+0000","last_fullsized":"2024-03-18T14:47:24.712352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1050,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710336+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:24.710336+0000","last_peered":"2024-03-18T14:47:24.710336+0000","last_clean":"2024-03-18T14:47:24.710336+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:24.710336+0000","last_undegraded":"2024-03-18T14:47:24.710336+0000","last_fullsized":"2024-03-18T14:47:24.710336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":883,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599889+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:25.599889+0000","last_peered":"2024-03-18T14:47:25.599889+0000","last_clean":"2024-03-18T14:47:25.599889+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:25.599889+0000","last_undegraded":"2024-03-18T14:47:25.599889+0000","last_fullsized":"2024-03-18T14:47:25.599889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1012,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712495+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:24.712495+0000","last_peered":"2024-03-18T14:47:24.712495+0000","last_clean":"2024-03-18T14:47:24.712495+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:24.712495+0000","last_undegraded":"2024-03-18T14:47:24.712495+0000","last_fullsized":"2024-03-18T14:47:24.712495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1011,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711421+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:24.711421+0000","last_peered":"2024-03-18T14:47:24.711421+0000","last_clean":"2024-03-18T14:47:24.711421+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:24.711421+0000","last_undegraded":"2024-03-18T14:47:24.711421+0000","last_fullsized":"2024-03-18T14:47:24.711421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710683+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:24.710683+0000","last_peered":"2024-03-18T14:47:24.710683+0000","last_clean":"2024-03-18T14:47:24.710683+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:24.710683+0000","last_undegraded":"2024-03-18T14:47:24.710683+0000","last_fullsized":"2024-03-18T14:47:24.710683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713231+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:24.713231+0000","last_peered":"2024-03-18T14:47:24.713231+0000","last_clean":"2024-03-18T14:47:24.713231+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:24.713231+0000","last_undegraded":"2024-03-18T14:47:24.713231+0000","last_fullsized":"2024-03-18T14:47:24.713231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1029,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712578+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:24.712578+0000","last_peered":"2024-03-18T14:47:24.712578+0000","last_clean":"2024-03-18T14:47:24.712578+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:24.712578+0000","last_undegraded":"2024-03-18T14:47:24.712578+0000","last_fullsized":"2024-03-18T14:47:24.712578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":891,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710482+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:24.710482+0000","last_peered":"2024-03-18T14:47:24.710482+0000","last_clean":"2024-03-18T14:47:24.710482+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:24.710482+0000","last_undegraded":"2024-03-18T14:47:24.710482+0000","last_fullsized":"2024-03-18T14:47:24.710482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1019,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600855+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:25.600855+0000","last_peered":"2024-03-18T14:47:25.600855+0000","last_clean":"2024-03-18T14:47:25.600855+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:25.600855+0000","last_undegraded":"2024-03-18T14:47:25.600855+0000","last_fullsized":"2024-03-18T14:47:25.600855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":936,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711752+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:24.711752+0000","last_peered":"2024-03-18T14:47:24.711752+0000","last_clean":"2024-03-18T14:47:24.711752+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:24.711752+0000","last_undegraded":"2024-03-18T14:47:24.711752+0000","last_fullsized":"2024-03-18T14:47:24.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":966,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712973+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:24.712973+0000","last_peered":"2024-03-18T14:47:24.712973+0000","last_clean":"2024-03-18T14:47:24.712973+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:24.712973+0000","last_undegraded":"2024-03-18T14:47:24.712973+0000","last_fullsized":"2024-03-18T14:47:24.712973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712776+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:24.712776+0000","last_peered":"2024-03-18T14:47:24.712776+0000","last_clean":"2024-03-18T14:47:24.712776+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:24.712776+0000","last_undegraded":"2024-03-18T14:47:24.712776+0000","last_fullsized":"2024-03-18T14:47:24.712776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":934,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600488+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:25.600488+0000","last_peered":"2024-03-18T14:47:25.600488+0000","last_clean":"2024-03-18T14:47:25.600488+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:25.600488+0000","last_undegraded":"2024-03-18T14:47:25.600488+0000","last_fullsized":"2024-03-18T14:47:25.600488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712447+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:24.712447+0000","last_peered":"2024-03-18T14:47:24.712447+0000","last_clean":"2024-03-18T14:47:24.712447+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:24.712447+0000","last_undegraded":"2024-03-18T14:47:24.712447+0000","last_fullsized":"2024-03-18T14:47:24.712447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":926,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599866+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:25.599866+0000","last_peered":"2024-03-18T14:47:25.599866+0000","last_clean":"2024-03-18T14:47:25.599866+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:25.599866+0000","last_undegraded":"2024-03-18T14:47:25.599866+0000","last_fullsized":"2024-03-18T14:47:25.599866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1400,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711973+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:24.711973+0000","last_peered":"2024-03-18T14:47:24.711973+0000","last_clean":"2024-03-18T14:47:24.711973+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:24.711973+0000","last_undegraded":"2024-03-18T14:47:24.711973+0000","last_fullsized":"2024-03-18T14:47:24.711973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":828,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711702+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:24.711702+0000","last_peered":"2024-03-18T14:47:24.711702+0000","last_clean":"2024-03-18T14:47:24.711702+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:24.711702+0000","last_undegraded":"2024-03-18T14:47:24.711702+0000","last_fullsized":"2024-03-18T14:47:24.711702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599482+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:25.599482+0000","last_peered":"2024-03-18T14:47:25.599482+0000","last_clean":"2024-03-18T14:47:25.599482+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:25.599482+0000","last_undegraded":"2024-03-18T14:47:25.599482+0000","last_fullsized":"2024-03-18T14:47:25.599482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":870,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601271+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:25.601271+0000","last_peered":"2024-03-18T14:47:25.601271+0000","last_clean":"2024-03-18T14:47:25.601271+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:25.601271+0000","last_undegraded":"2024-03-18T14:47:25.601271+0000","last_fullsized":"2024-03-18T14:47:25.601271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712400+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:24.712400+0000","last_peered":"2024-03-18T14:47:24.712400+0000","last_clean":"2024-03-18T14:47:24.712400+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:24.712400+0000","last_undegraded":"2024-03-18T14:47:24.712400+0000","last_fullsized":"2024-03-18T14:47:24.712400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":843,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600141+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:25.600141+0000","last_peered":"2024-03-18T14:47:25.600141+0000","last_clean":"2024-03-18T14:47:25.600141+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:25.600141+0000","last_undegraded":"2024-03-18T14:47:25.600141+0000","last_fullsized":"2024-03-18T14:47:25.600141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710369+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:24.710369+0000","last_peered":"2024-03-18T14:47:24.710369+0000","last_clean":"2024-03-18T14:47:24.710369+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:24.710369+0000","last_undegraded":"2024-03-18T14:47:24.710369+0000","last_fullsized":"2024-03-18T14:47:24.710369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1059,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599644+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:25.599644+0000","last_peered":"2024-03-18T14:47:25.599644+0000","last_clean":"2024-03-18T14:47:25.599644+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:25.599644+0000","last_undegraded":"2024-03-18T14:47:25.599644+0000","last_fullsized":"2024-03-18T14:47:25.599644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":270,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.442911+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:27.442911+0000","last_peered":"2024-03-18T14:47:27.442911+0000","last_clean":"2024-03-18T14:47:27.442911+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:27.442911+0000","last_undegraded":"2024-03-18T14:47:27.442911+0000","last_fullsized":"2024-03-18T14:47:27.442911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1036,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712994+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:24.712994+0000","last_peered":"2024-03-18T14:47:24.712994+0000","last_clean":"2024-03-18T14:47:24.712994+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:24.712994+0000","last_undegraded":"2024-03-18T14:47:24.712994+0000","last_fullsized":"2024-03-18T14:47:24.712994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'649","reported_seq":693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.444711+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:27.444711+0000","last_peered":"2024-03-18T14:47:27.444711+0000","last_clean":"2024-03-18T14:47:27.444711+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:27.444711+0000","last_undegraded":"2024-03-18T14:47:27.444711+0000","last_fullsized":"2024-03-18T14:47:27.444711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":550,"num_write_kb":12564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":981,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710262+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:24.710262+0000","last_peered":"2024-03-18T14:47:24.710262+0000","last_clean":"2024-03-18T14:47:24.710262+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:24.710262+0000","last_undegraded":"2024-03-18T14:47:24.710262+0000","last_fullsized":"2024-03-18T14:47:24.710262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":604,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438163+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:27.438163+0000","last_peered":"2024-03-18T14:47:27.438163+0000","last_clean":"2024-03-18T14:47:27.438163+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:27.438163+0000","last_undegraded":"2024-03-18T14:47:27.438163+0000","last_fullsized":"2024-03-18T14:47:27.438163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":962,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600270+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:25.600270+0000","last_peered":"2024-03-18T14:47:25.600270+0000","last_clean":"2024-03-18T14:47:25.600270+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:25.600270+0000","last_undegraded":"2024-03-18T14:47:25.600270+0000","last_fullsized":"2024-03-18T14:47:25.600270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":216,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710584+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:24.710584+0000","last_peered":"2024-03-18T14:47:24.710584+0000","last_clean":"2024-03-18T14:47:24.710584+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:24.710584+0000","last_undegraded":"2024-03-18T14:47:24.710584+0000","last_fullsized":"2024-03-18T14:47:24.710584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599738+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:25.599738+0000","last_peered":"2024-03-18T14:47:25.599738+0000","last_clean":"2024-03-18T14:47:25.599738+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:25.599738+0000","last_undegraded":"2024-03-18T14:47:25.599738+0000","last_fullsized":"2024-03-18T14:47:25.599738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":413,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601164+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:25.601164+0000","last_peered":"2024-03-18T14:47:25.601164+0000","last_clean":"2024-03-18T14:47:25.601164+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:25.601164+0000","last_undegraded":"2024-03-18T14:47:25.601164+0000","last_fullsized":"2024-03-18T14:47:25.601164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":863,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711877+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:24.711877+0000","last_peered":"2024-03-18T14:47:24.711877+0000","last_clean":"2024-03-18T14:47:24.711877+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:24.711877+0000","last_undegraded":"2024-03-18T14:47:24.711877+0000","last_fullsized":"2024-03-18T14:47:24.711877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'179","reported_seq":224,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-03-18T14:47:37.523076+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:37.523076+0000","last_peered":"2024-03-18T14:47:37.523076+0000","last_clean":"2024-03-18T14:47:37.523076+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:37.523076+0000","last_undegraded":"2024-03-18T14:47:37.523076+0000","last_fullsized":"2024-03-18T14:47:37.523076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234466,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":65,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601638+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:25.601638+0000","last_peered":"2024-03-18T14:47:25.601638+0000","last_clean":"2024-03-18T14:47:25.601638+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:25.601638+0000","last_undegraded":"2024-03-18T14:47:25.601638+0000","last_fullsized":"2024-03-18T14:47:25.601638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712073+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:24.712073+0000","last_peered":"2024-03-18T14:47:24.712073+0000","last_clean":"2024-03-18T14:47:24.712073+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:24.712073+0000","last_undegraded":"2024-03-18T14:47:24.712073+0000","last_fullsized":"2024-03-18T14:47:24.712073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1021,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599768+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:25.599768+0000","last_peered":"2024-03-18T14:47:25.599768+0000","last_clean":"2024-03-18T14:47:25.599768+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:25.599768+0000","last_undegraded":"2024-03-18T14:47:25.599768+0000","last_fullsized":"2024-03-18T14:47:25.599768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":446,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.446361+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:27.446361+0000","last_peered":"2024-03-18T14:47:27.446361+0000","last_clean":"2024-03-18T14:47:27.446361+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:27.446361+0000","last_undegraded":"2024-03-18T14:47:27.446361+0000","last_fullsized":"2024-03-18T14:47:27.446361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":885,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712207+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:24.712207+0000","last_peered":"2024-03-18T14:47:24.712207+0000","last_clean":"2024-03-18T14:47:24.712207+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:24.712207+0000","last_undegraded":"2024-03-18T14:47:24.712207+0000","last_fullsized":"2024-03-18T14:47:24.712207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600602+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:25.600602+0000","last_peered":"2024-03-18T14:47:25.600602+0000","last_clean":"2024-03-18T14:47:25.600602+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:25.600602+0000","last_undegraded":"2024-03-18T14:47:25.600602+0000","last_fullsized":"2024-03-18T14:47:25.600602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710377+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:24.710377+0000","last_peered":"2024-03-18T14:47:24.710377+0000","last_clean":"2024-03-18T14:47:24.710377+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:24.710377+0000","last_undegraded":"2024-03-18T14:47:24.710377+0000","last_fullsized":"2024-03-18T14:47:24.710377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711104+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:24.711104+0000","last_peered":"2024-03-18T14:47:24.711104+0000","last_clean":"2024-03-18T14:47:24.711104+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:24.711104+0000","last_undegraded":"2024-03-18T14:47:24.711104+0000","last_fullsized":"2024-03-18T14:47:24.711104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":929,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711303+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:24.711303+0000","last_peered":"2024-03-18T14:47:24.711303+0000","last_clean":"2024-03-18T14:47:24.711303+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:24.711303+0000","last_undegraded":"2024-03-18T14:47:24.711303+0000","last_fullsized":"2024-03-18T14:47:24.711303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":630,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600452+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:25.600452+0000","last_peered":"2024-03-18T14:47:25.600452+0000","last_clean":"2024-03-18T14:47:25.600452+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:25.600452+0000","last_undegraded":"2024-03-18T14:47:25.600452+0000","last_fullsized":"2024-03-18T14:47:25.600452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711207+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:24.711207+0000","last_peered":"2024-03-18T14:47:24.711207+0000","last_clean":"2024-03-18T14:47:24.711207+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:24.711207+0000","last_undegraded":"2024-03-18T14:47:24.711207+0000","last_fullsized":"2024-03-18T14:47:24.711207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600738+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:25.600738+0000","last_peered":"2024-03-18T14:47:25.600738+0000","last_clean":"2024-03-18T14:47:25.600738+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:25.600738+0000","last_undegraded":"2024-03-18T14:47:25.600738+0000","last_fullsized":"2024-03-18T14:47:25.600738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":895,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600209+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:25.600209+0000","last_peered":"2024-03-18T14:47:25.600209+0000","last_clean":"2024-03-18T14:47:25.600209+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:25.600209+0000","last_undegraded":"2024-03-18T14:47:25.600209+0000","last_fullsized":"2024-03-18T14:47:25.600209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":330,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599505+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:25.599505+0000","last_peered":"2024-03-18T14:47:25.599505+0000","last_clean":"2024-03-18T14:47:25.599505+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:25.599505+0000","last_undegraded":"2024-03-18T14:47:25.599505+0000","last_fullsized":"2024-03-18T14:47:25.599505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":897,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710680+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:24.710680+0000","last_peered":"2024-03-18T14:47:24.710680+0000","last_clean":"2024-03-18T14:47:24.710680+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:24.710680+0000","last_undegraded":"2024-03-18T14:47:24.710680+0000","last_fullsized":"2024-03-18T14:47:24.710680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600008+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:25.600008+0000","last_peered":"2024-03-18T14:47:25.600008+0000","last_clean":"2024-03-18T14:47:25.600008+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:25.600008+0000","last_undegraded":"2024-03-18T14:47:25.600008+0000","last_fullsized":"2024-03-18T14:47:25.600008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713247+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:24.713247+0000","last_peered":"2024-03-18T14:47:24.713247+0000","last_clean":"2024-03-18T14:47:24.713247+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:24.713247+0000","last_undegraded":"2024-03-18T14:47:24.713247+0000","last_fullsized":"2024-03-18T14:47:24.713247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713126+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:24.713126+0000","last_peered":"2024-03-18T14:47:24.713126+0000","last_clean":"2024-03-18T14:47:24.713126+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:24.713126+0000","last_undegraded":"2024-03-18T14:47:24.713126+0000","last_fullsized":"2024-03-18T14:47:24.713126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710611+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:24.710611+0000","last_peered":"2024-03-18T14:47:24.710611+0000","last_clean":"2024-03-18T14:47:24.710611+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:24.710611+0000","last_undegraded":"2024-03-18T14:47:24.710611+0000","last_fullsized":"2024-03-18T14:47:24.710611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712464+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:24.712464+0000","last_peered":"2024-03-18T14:47:24.712464+0000","last_clean":"2024-03-18T14:47:24.712464+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:24.712464+0000","last_undegraded":"2024-03-18T14:47:24.712464+0000","last_fullsized":"2024-03-18T14:47:24.712464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600668+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:25.600668+0000","last_peered":"2024-03-18T14:47:25.600668+0000","last_clean":"2024-03-18T14:47:25.600668+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:25.600668+0000","last_undegraded":"2024-03-18T14:47:25.600668+0000","last_fullsized":"2024-03-18T14:47:25.600668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710936+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:24.710936+0000","last_peered":"2024-03-18T14:47:24.710936+0000","last_clean":"2024-03-18T14:47:24.710936+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:24.710936+0000","last_undegraded":"2024-03-18T14:47:24.710936+0000","last_fullsized":"2024-03-18T14:47:24.710936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713044+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:24.713044+0000","last_peered":"2024-03-18T14:47:24.713044+0000","last_clean":"2024-03-18T14:47:24.713044+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:24.713044+0000","last_undegraded":"2024-03-18T14:47:24.713044+0000","last_fullsized":"2024-03-18T14:47:24.713044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710256+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:24.710256+0000","last_peered":"2024-03-18T14:47:24.710256+0000","last_clean":"2024-03-18T14:47:24.710256+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:24.710256+0000","last_undegraded":"2024-03-18T14:47:24.710256+0000","last_fullsized":"2024-03-18T14:47:24.710256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":867,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712128+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.712128+0000","last_peered":"2024-03-18T14:47:24.712128+0000","last_clean":"2024-03-18T14:47:24.712128+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.712128+0000","last_undegraded":"2024-03-18T14:47:24.712128+0000","last_fullsized":"2024-03-18T14:47:24.712128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713074+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:24.713074+0000","last_peered":"2024-03-18T14:47:24.713074+0000","last_clean":"2024-03-18T14:47:24.713074+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:24.713074+0000","last_undegraded":"2024-03-18T14:47:24.713074+0000","last_fullsized":"2024-03-18T14:47:24.713074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600551+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:25.600551+0000","last_peered":"2024-03-18T14:47:25.600551+0000","last_clean":"2024-03-18T14:47:25.600551+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:25.600551+0000","last_undegraded":"2024-03-18T14:47:25.600551+0000","last_fullsized":"2024-03-18T14:47:25.600551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711686+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:24.711686+0000","last_peered":"2024-03-18T14:47:24.711686+0000","last_clean":"2024-03-18T14:47:24.711686+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:24.711686+0000","last_undegraded":"2024-03-18T14:47:24.711686+0000","last_fullsized":"2024-03-18T14:47:24.711686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1053,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599935+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:25.599935+0000","last_peered":"2024-03-18T14:47:25.599935+0000","last_clean":"2024-03-18T14:47:25.599935+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:25.599935+0000","last_undegraded":"2024-03-18T14:47:25.599935+0000","last_fullsized":"2024-03-18T14:47:25.599935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":899,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600336+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:25.600336+0000","last_peered":"2024-03-18T14:47:25.600336+0000","last_clean":"2024-03-18T14:47:25.600336+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:25.600336+0000","last_undegraded":"2024-03-18T14:47:25.600336+0000","last_fullsized":"2024-03-18T14:47:25.600336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600216+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:25.600216+0000","last_peered":"2024-03-18T14:47:25.600216+0000","last_clean":"2024-03-18T14:47:25.600216+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:25.600216+0000","last_undegraded":"2024-03-18T14:47:25.600216+0000","last_fullsized":"2024-03-18T14:47:25.600216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710133+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:24.710133+0000","last_peered":"2024-03-18T14:47:24.710133+0000","last_clean":"2024-03-18T14:47:24.710133+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:24.710133+0000","last_undegraded":"2024-03-18T14:47:24.710133+0000","last_fullsized":"2024-03-18T14:47:24.710133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1022,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711613+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:24.711613+0000","last_peered":"2024-03-18T14:47:24.711613+0000","last_clean":"2024-03-18T14:47:24.711613+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:24.711613+0000","last_undegraded":"2024-03-18T14:47:24.711613+0000","last_fullsized":"2024-03-18T14:47:24.711613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600090+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:25.600090+0000","last_peered":"2024-03-18T14:47:25.600090+0000","last_clean":"2024-03-18T14:47:25.600090+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:25.600090+0000","last_undegraded":"2024-03-18T14:47:25.600090+0000","last_fullsized":"2024-03-18T14:47:25.600090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":490,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713357+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:24.713357+0000","last_peered":"2024-03-18T14:47:24.713357+0000","last_clean":"2024-03-18T14:47:24.713357+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:24.713357+0000","last_undegraded":"2024-03-18T14:47:24.713357+0000","last_fullsized":"2024-03-18T14:47:24.713357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":898,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711061+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:24.711061+0000","last_peered":"2024-03-18T14:47:24.711061+0000","last_clean":"2024-03-18T14:47:24.711061+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:24.711061+0000","last_undegraded":"2024-03-18T14:47:24.711061+0000","last_fullsized":"2024-03-18T14:47:24.711061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.447037+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:27.447037+0000","last_peered":"2024-03-18T14:47:27.447037+0000","last_clean":"2024-03-18T14:47:27.447037+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:27.447037+0000","last_undegraded":"2024-03-18T14:47:27.447037+0000","last_fullsized":"2024-03-18T14:47:27.447037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712854+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:24.712854+0000","last_peered":"2024-03-18T14:47:24.712854+0000","last_clean":"2024-03-18T14:47:24.712854+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:24.712854+0000","last_undegraded":"2024-03-18T14:47:24.712854+0000","last_fullsized":"2024-03-18T14:47:24.712854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1037,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599643+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:25.599643+0000","last_peered":"2024-03-18T14:47:25.599643+0000","last_clean":"2024-03-18T14:47:25.599643+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:25.599643+0000","last_undegraded":"2024-03-18T14:47:25.599643+0000","last_fullsized":"2024-03-18T14:47:25.599643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601639+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:25.601639+0000","last_peered":"2024-03-18T14:47:25.601639+0000","last_clean":"2024-03-18T14:47:25.601639+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:25.601639+0000","last_undegraded":"2024-03-18T14:47:25.601639+0000","last_fullsized":"2024-03-18T14:47:25.601639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":704,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:28.486202+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:28.486202+0000","last_peered":"2024-03-18T14:47:28.486202+0000","last_clean":"2024-03-18T14:47:28.486202+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:28.486202+0000","last_undegraded":"2024-03-18T14:47:28.486202+0000","last_fullsized":"2024-03-18T14:47:28.486202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":920,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710173+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:24.710173+0000","last_peered":"2024-03-18T14:47:24.710173+0000","last_clean":"2024-03-18T14:47:24.710173+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:24.710173+0000","last_undegraded":"2024-03-18T14:47:24.710173+0000","last_fullsized":"2024-03-18T14:47:24.710173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":170,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711152+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:24.711152+0000","last_peered":"2024-03-18T14:47:24.711152+0000","last_clean":"2024-03-18T14:47:24.711152+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:24.711152+0000","last_undegraded":"2024-03-18T14:47:24.711152+0000","last_fullsized":"2024-03-18T14:47:24.711152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":951,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710607+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:24.710607+0000","last_peered":"2024-03-18T14:47:24.710607+0000","last_clean":"2024-03-18T14:47:24.710607+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:24.710607+0000","last_undegraded":"2024-03-18T14:47:24.710607+0000","last_fullsized":"2024-03-18T14:47:24.710607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":427,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.445460+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:27.445460+0000","last_peered":"2024-03-18T14:47:27.445460+0000","last_clean":"2024-03-18T14:47:27.445460+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:27.445460+0000","last_undegraded":"2024-03-18T14:47:27.445460+0000","last_fullsized":"2024-03-18T14:47:27.445460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":838,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710407+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:24.710407+0000","last_peered":"2024-03-18T14:47:24.710407+0000","last_clean":"2024-03-18T14:47:24.710407+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:24.710407+0000","last_undegraded":"2024-03-18T14:47:24.710407+0000","last_fullsized":"2024-03-18T14:47:24.710407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.443865+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:27.443865+0000","last_peered":"2024-03-18T14:47:27.443865+0000","last_clean":"2024-03-18T14:47:27.443865+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:27.443865+0000","last_undegraded":"2024-03-18T14:47:27.443865+0000","last_fullsized":"2024-03-18T14:47:27.443865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":892,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710187+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:24.710187+0000","last_peered":"2024-03-18T14:47:24.710187+0000","last_clean":"2024-03-18T14:47:24.710187+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:24.710187+0000","last_undegraded":"2024-03-18T14:47:24.710187+0000","last_fullsized":"2024-03-18T14:47:24.710187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":523,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601185+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:25.601185+0000","last_peered":"2024-03-18T14:47:25.601185+0000","last_clean":"2024-03-18T14:47:25.601185+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:25.601185+0000","last_undegraded":"2024-03-18T14:47:25.601185+0000","last_fullsized":"2024-03-18T14:47:25.601185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600747+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:25.600747+0000","last_peered":"2024-03-18T14:47:25.600747+0000","last_clean":"2024-03-18T14:47:25.600747+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:25.600747+0000","last_undegraded":"2024-03-18T14:47:25.600747+0000","last_fullsized":"2024-03-18T14:47:25.600747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":255,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438993+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:27.438993+0000","last_peered":"2024-03-18T14:47:27.438993+0000","last_clean":"2024-03-18T14:47:27.438993+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:27.438993+0000","last_undegraded":"2024-03-18T14:47:27.438993+0000","last_fullsized":"2024-03-18T14:47:27.438993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710130+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:24.710130+0000","last_peered":"2024-03-18T14:47:24.710130+0000","last_clean":"2024-03-18T14:47:24.710130+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:24.710130+0000","last_undegraded":"2024-03-18T14:47:24.710130+0000","last_fullsized":"2024-03-18T14:47:24.710130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1092,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712058+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:24.712058+0000","last_peered":"2024-03-18T14:47:24.712058+0000","last_clean":"2024-03-18T14:47:24.712058+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:24.712058+0000","last_undegraded":"2024-03-18T14:47:24.712058+0000","last_fullsized":"2024-03-18T14:47:24.712058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600538+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:25.600538+0000","last_peered":"2024-03-18T14:47:25.600538+0000","last_clean":"2024-03-18T14:47:25.600538+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:25.600538+0000","last_undegraded":"2024-03-18T14:47:25.600538+0000","last_fullsized":"2024-03-18T14:47:25.600538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":921,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710638+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:24.710638+0000","last_peered":"2024-03-18T14:47:24.710638+0000","last_clean":"2024-03-18T14:47:24.710638+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:24.710638+0000","last_undegraded":"2024-03-18T14:47:24.710638+0000","last_fullsized":"2024-03-18T14:47:24.710638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":917,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599923+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:25.599923+0000","last_peered":"2024-03-18T14:47:25.599923+0000","last_clean":"2024-03-18T14:47:25.599923+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:25.599923+0000","last_undegraded":"2024-03-18T14:47:25.599923+0000","last_fullsized":"2024-03-18T14:47:25.599923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713347+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:24.713347+0000","last_peered":"2024-03-18T14:47:24.713347+0000","last_clean":"2024-03-18T14:47:24.713347+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:24.713347+0000","last_undegraded":"2024-03-18T14:47:24.713347+0000","last_fullsized":"2024-03-18T14:47:24.713347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159318,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16063,"num_write_kb":262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274318636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19635,"ondisk_log_size":19635,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413524,"kb_used_data":95884,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958316,"statfs":{"total":96636764160,"available":96213315584,"internally_reserved":0,"allocated":98185216,"data_stored":97948187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379172,"kb_used_data":62940,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992668,"statfs":{"total":96636764160,"available":96248492032,"internally_reserved":0,"allocated":64450560,"data_stored":64239853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372468,"kb_used_data":59884,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999372,"statfs":{"total":96636764160,"available":96255356928,"internally_reserved":0,"allocated":61321216,"data_stored":61095214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051593,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367740,"kb_used_data":51828,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004100,"statfs":{"total":96636764160,"available":96260198400,"internally_reserved":0,"allocated":53071872,"data_stored":52858874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52107817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:50.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T14:47:50.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 Processor -- start 2024-03-18T14:47:50.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 -- start start 2024-03-18T14:47:50.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 0x7f30c80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 0x7f30c8146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80a77d0 con 0x7f30c80a4cb0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c813fc50 con 0x7f30c80b3550 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cf115700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c813fef0 con 0x7f30c80a72d0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cd6b2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 0x7f30c8146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30cceb1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 0x7f30c80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30c7fff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f30c80a4cb0 0x7f30c80afb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33864/0 (socket says 172.21.15.57:33864) 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.981+0000 7f30c7fff700 1 -- 172.21.15.57:0/3956625626 learned_addr learned my addr 172.21.15.57:0/3956625626 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cd6b2700 1 -- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 msgr2=0x7f30c80a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30c77fe700 1 -- 172.21.15.57:0/3956625626 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360431964 0 0) 0x7f30c80a77d0 con 0x7f30c80a4cb0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cd6b2700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 0x7f30c80a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cd6b2700 1 -- 172.21.15.57:0/3956625626 >> v1:172.21.15.57:6789/0 conn(0x7f30c80a4cb0 legacy=0x7f30c80afb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cd6b2700 1 -- 172.21.15.57:0/3956625626 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c80b0220 con 0x7f30c80a72d0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cceb1700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 0x7f30c80a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30cd6b2700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 0x7f30c8146be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e90 tx=0x7f30c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4265a6843598f8dc server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30c77fe700 1 -- 172.21.15.57:0/3956625626 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c000e070 con 0x7f30c80a72d0 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30c77fe700 1 -- 172.21.15.57:0/3956625626 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c000bc30 con 0x7f30c80a72d0 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.982+0000 7f30c77fe700 1 -- 172.21.15.57:0/3956625626 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0012430 con 0x7f30c80a72d0 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 -- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 msgr2=0x7f30c8146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 0x7f30c8146be0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009e90 tx=0x7f30c0009780 comp rx=0 tx=0).stop 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 -- 172.21.15.57:0/3956625626 shutdown_connections 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a72d0 0x7f30c8146be0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 --2- 172.21.15.57:0/3956625626 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80b3550 0x7f30c80a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 -- 172.21.15.57:0/3956625626 >> 172.21.15.57:0/3956625626 conn(0x7f30c806e2c0 msgr2=0x7f30c806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 -- 172.21.15.57:0/3956625626 shutdown_connections 2024-03-18T14:47:50.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.983+0000 7f30cf115700 1 -- 172.21.15.57:0/3956625626 wait complete. 2024-03-18T14:47:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 Processor -- start 2024-03-18T14:47:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 -- start start 2024-03-18T14:47:50.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80a72d0 0x7f30c80a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30c80b3550 0x7f30c80a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8151900 con 0x7f30c80b3550 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c813db90 con 0x7f30c80a72d0 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cf115700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8151af0 con 0x7f30c80a4cb0 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cceb1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30c7fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80a72d0 0x7f30c80a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cceb1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45424/0 (socket says 172.21.15.57:45424) 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cceb1700 1 -- 172.21.15.57:0/1968026498 learned_addr learned my addr 172.21.15.57:0/1968026498 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.984+0000 7f30cd6b2700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30c80b3550 0x7f30c80a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 -- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80a72d0 msgr2=0x7f30c80a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80a72d0 0x7f30c80a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 -- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30c80b3550 msgr2=0x7f30c80a27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:50.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30c80b3550 0x7f30c80a27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 -- 172.21.15.57:0/1968026498 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009420 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cceb1700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ec80 tx=0x7f30bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00c850 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00c9b0 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00cd30 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c0009a20 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.985+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c806a420 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.986+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c8065180 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.986+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f30bc013680 con 0x7f30c80a4cb0 2024-03-18T14:47:50.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.986+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f30bc05b7c0 con 0x7f30c80a4cb0 2024-03-18T14:47:50.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:50.990+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f30bc039920 con 0x7f30c80a4cb0 2024-03-18T14:47:51.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.153+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30c806a200 con 0x7f30c80a4cb0 2024-03-18T14:47:51.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.153+0000 7f30c4ff9700 1 -- 172.21.15.57:0/1968026498 <== mon.2 v2:172.21.15.57:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+11756 (secure 0 0 0) 0x7f30bc03d110 con 0x7f30c80a4cb0 2024-03-18T14:47:51.155 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:51.155 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"347a5fae-6424-47b3-8c67-8d3421f1b0dd","created":"2024-03-18T14:40:54.335193+0000","modified":"2024-03-18T14:47:37.504964+0000","last_up_change":"2024-03-18T14:47:16.428036+0000","last_in_change":"2024-03-18T14:40:59.413584+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T14:40:56.461069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-18T14:41:03.450055+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-03-18T14:41:11.444063+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-03-18T14:41:12.438862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"674b74ac-d72f-4d09-bacf-b63061fe0927","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":32,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6800","nonce":50045}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6801","nonce":50045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6803","nonce":50045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6802","nonce":50045}]},"public_addr":"172.21.15.57:6800/50045","cluster_addr":"172.21.15.57:6801/50045","heartbeat_back_addr":"172.21.15.57:6803/50045","heartbeat_front_addr":"172.21.15.57:6802/50045","state":["exists","up"]},{"osd":1,"uuid":"eb13ed10-144d-4d6f-9b89-7b855befb612","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":32,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6804","nonce":50128}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6805","nonce":50128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6807","nonce":50128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6806","nonce":50128}]},"public_addr":"172.21.15.57:6804/50128","cluster_addr":"172.21.15.57:6805/50128","heartbeat_back_addr":"172.21.15.57:6807/50128","heartbeat_front_addr":"172.21.15.57:6806/50128","state":["exists","up"]},{"osd":2,"uuid":"11575c4d-a2f0-4cf2-92f7-a4ecc1a759ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":32,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6808","nonce":50245}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6809","nonce":50245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6811","nonce":50245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6810","nonce":50245}]},"public_addr":"172.21.15.57:6808/50245","cluster_addr":"172.21.15.57:6809/50245","heartbeat_back_addr":"172.21.15.57:6811/50245","heartbeat_front_addr":"172.21.15.57:6810/50245","state":["exists","up"]},{"osd":3,"uuid":"208ece67-3817-45fa-9e1c-415cf5fd1e00","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":32,"up_thru":32,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6812","nonce":50393}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6813","nonce":50393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6815","nonce":50393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.57:6814","nonce":50393}]},"public_addr":"172.21.15.57:6812/50393","cluster_addr":"172.21.15.57:6813/50393","heartbeat_back_addr":"172.21.15.57:6815/50393","heartbeat_front_addr":"172.21.15.57:6814/50393","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.334545+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.363433+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.321596+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-03-18T14:47:06.627764+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T14:40:58.351592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:0/2355346234":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/2550387238":"2024-03-19T14:46:53.512574+0000","172.21.15.57:0/1711862619":"2024-03-19T14:46:53.512574+0000","172.21.15.129:0/1814197221":"2024-03-18T15:47:36.508336+0000","172.21.15.57:6816/39496":"2024-03-19T14:46:53.512574+0000","172.21.15.57:6819/2329339569":"2024-03-19T14:47:18.613680+0000","172.21.15.87:0/2493486388":"2024-03-18T15:47:36.508029+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 >> v1:172.21.15.57:6816/47480 conn(0x7f30ac046040 legacy=0x7f30ac0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 msgr2=0x7f30c81513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ec80 tx=0x7f30bc0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 shutdown_connections 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30c80b3550 0x7f30c80a27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f30c80a4cb0 0x7f30c81513c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:51.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 --2- 172.21.15.57:0/1968026498 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f30c80a72d0 0x7f30c80a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:51.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 >> 172.21.15.57:0/1968026498 conn(0x7f30c806e2c0 msgr2=0x7f30c806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:51.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 shutdown_connections 2024-03-18T14:47:51.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:51.155+0000 7f30cf115700 1 -- 172.21.15.57:0/1968026498 wait complete. 2024-03-18T14:47:52.170 INFO:tasks.ceph:Scrubbing osd.0 2024-03-18T14:47:52.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-18T14:47:52.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.308+0000 7f5750b0e700 1 Processor -- start 2024-03-18T14:47:52.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.308+0000 7f5750b0e700 1 -- start start 2024-03-18T14:47:52.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.308+0000 7f5750b0e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5750b0e700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f574c0b0640 0x7f574c0a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5750b0e700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0697c0 con 0x7f574c06ea50 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5750b0e700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0b35c0 con 0x7f574c0b0640 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5750b0e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c069a60 con 0x7f574c06a4d0 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574a59c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f574c0b0640 0x7f574c0a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574ad9d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f574c06ea50 0x7f574c06eef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33872/0 (socket says 172.21.15.57:33872) 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574ad9d700 1 -- 172.21.15.57:0/1877924059 learned_addr learned my addr 172.21.15.57:0/1877924059 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574a59c700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57748/0 (socket says 172.21.15.57:57748) 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 -- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 msgr2=0x7f574c0b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 -- 172.21.15.57:0/1877924059 >> v1:172.21.15.57:6789/0 conn(0x7f574c06ea50 legacy=0x7f574c06eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574959a700 1 -- 172.21.15.57:0/1877924059 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2148295695 0 0) 0x7f574c0697c0 con 0x7f574c06ea50 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 -- 172.21.15.57:0/1877924059 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c068c80 con 0x7f574c0b0640 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574a59c700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f5749d9b700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c0b0640 0x7f574c0a3ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098e0 tx=0x7f573c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88979f6b926a6f3a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574959a700 1 -- 172.21.15.57:0/1877924059 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c00b640 con 0x7f574c0b0640 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574959a700 1 -- 172.21.15.57:0/1877924059 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c00b7a0 con 0x7f574c0b0640 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.309+0000 7f574959a700 1 -- 172.21.15.57:0/1877924059 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c00bb40 con 0x7f574c0b0640 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 -- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c0b0640 msgr2=0x7f574c0a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c0b0640 0x7f574c0a3ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f573c0098e0 tx=0x7f573c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 -- 172.21.15.57:0/1877924059 shutdown_connections 2024-03-18T14:47:52.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06a4d0 0x7f574c0b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 --2- 172.21.15.57:0/1877924059 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c0b0640 0x7f574c0a3ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 -- 172.21.15.57:0/1877924059 >> 172.21.15.57:0/1877924059 conn(0x7f574c06df80 msgr2=0x7f574c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 -- 172.21.15.57:0/1877924059 shutdown_connections 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.310+0000 7f5750b0e700 1 -- 172.21.15.57:0/1877924059 wait complete. 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.311+0000 7f5750b0e700 1 Processor -- start 2024-03-18T14:47:52.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.311+0000 7f5750b0e700 1 -- start start 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 0x7f574c097960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06ea50 0x7f574c1512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f574c0b0640 0x7f574c151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c0985d0 con 0x7f574c06a4d0 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c098330 con 0x7f574c06ea50 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574c071680 con 0x7f574c0b0640 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 0x7f574c097960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 0x7f574c097960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43934/0 (socket says 172.21.15.57:43934) 2024-03-18T14:47:52.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 -- 172.21.15.57:0/268151247 learned_addr learned my addr 172.21.15.57:0/268151247 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5749d9b700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06ea50 0x7f574c1512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574ad9d700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f574c0b0640 0x7f574c151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 -- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f574c0b0640 msgr2=0x7f574c151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f574c0b0640 0x7f574c151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 -- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06ea50 msgr2=0x7f574c1512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06ea50 0x7f574c1512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 -- 172.21.15.57:0/268151247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009420 con 0x7f574c06a4d0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5749d9b700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f574c06ea50 0x7f574c1512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f574a59c700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 0x7f574c097960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f574000ec80 tx=0x7f57400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000c9b0 con 0x7f574c06a4d0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000cb10 con 0x7f574c06a4d0 2024-03-18T14:47:52.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c009420 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000ce90 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.312+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c09a3b0 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.313+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f574c065180 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.314+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5740013680 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.314+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f574005bda0 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.314+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 --> v1:172.21.15.57:6800/50045 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f572c052b00 con 0x7f572c04ee40 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.314+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f574005c170 con 0x7f574c06a4d0 2024-03-18T14:47:52.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.315+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== osd.0 v1:172.21.15.57:6800/50045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f572c052b00 con 0x7f572c04ee40 2024-03-18T14:47:52.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.329+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 --> v1:172.21.15.57:6800/50045 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f574c068ee0 con 0x7f572c04ee40 2024-03-18T14:47:52.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.329+0000 7f573a7fc700 1 -- 172.21.15.57:0/268151247 <== osd.0 v1:172.21.15.57:6800/50045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f574c068ee0 con 0x7f572c04ee40 2024-03-18T14:47:52.331 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:52.331 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T14:47:52.331 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 >> v1:172.21.15.57:6800/50045 conn(0x7f572c04ee40 legacy=0x7f572c051290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 >> v1:172.21.15.57:6816/47480 conn(0x7f572c046010 legacy=0x7f572c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 msgr2=0x7f574c097960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 --2- 172.21.15.57:0/268151247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f574c06a4d0 0x7f574c097960 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f574000ec80 tx=0x7f57400091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f574ad9d700 1 -- 172.21.15.57:0/268151247 reap_dead start 2024-03-18T14:47:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 shutdown_connections 2024-03-18T14:47:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 >> 172.21.15.57:0/268151247 conn(0x7f574c06df80 msgr2=0x7f574c06f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 shutdown_connections 2024-03-18T14:47:52.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.330+0000 7f5750b0e700 1 -- 172.21.15.57:0/268151247 wait complete. 2024-03-18T14:47:52.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-18T14:47:52.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.464+0000 7fc647904700 1 Processor -- start 2024-03-18T14:47:52.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.464+0000 7fc647904700 1 -- start start 2024-03-18T14:47:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc640069450 0x7fc64006f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64006e750 con 0x7fc640069450 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400a36c0 con 0x7fc64013f070 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc647904700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc64006eed0 con 0x7fc64006df00 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc640069450 0x7fc64006f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc644e9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc645ea1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc640069450 0x7fc64006f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43936/0 (socket says 172.21.15.57:43936) 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc644e9f700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45446/0 (socket says 172.21.15.57:45446) 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc645ea1700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57770/0 (socket says 172.21.15.57:57770) 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 -- 172.21.15.57:0/1088838597 learned_addr learned my addr 172.21.15.57:0/1088838597 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 -- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 msgr2=0x7fc64013eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 -- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 msgr2=0x7fc6400a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 -- 172.21.15.57:0/1088838597 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64006eb70 con 0x7fc640069450 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc644e9f700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc645ea1700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc6456a0700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640069450 0x7fc64006f640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc6300099b0 tx=0x7fc630009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a3233df2334dee server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.465+0000 7fc637fff700 1 -- 172.21.15.57:0/1088838597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000b680 con 0x7fc640069450 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc637fff700 1 -- 172.21.15.57:0/1088838597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b7e0 con 0x7fc640069450 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc637fff700 1 -- 172.21.15.57:0/1088838597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000bb80 con 0x7fc640069450 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 -- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640069450 msgr2=0x7fc64006f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640069450 0x7fc64006f640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc6300099b0 tx=0x7fc630009250 comp rx=0 tx=0).stop 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 -- 172.21.15.57:0/1088838597 shutdown_connections 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc64013f070 0x7fc6400a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc640069450 0x7fc64006f640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 --2- 172.21.15.57:0/1088838597 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 -- 172.21.15.57:0/1088838597 >> 172.21.15.57:0/1088838597 conn(0x7fc64006ce30 msgr2=0x7fc640068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 -- 172.21.15.57:0/1088838597 shutdown_connections 2024-03-18T14:47:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.466+0000 7fc647904700 1 -- 172.21.15.57:0/1088838597 wait complete. 2024-03-18T14:47:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.467+0000 7fc647904700 1 Processor -- start 2024-03-18T14:47:52.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.467+0000 7fc647904700 1 -- start start 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 0x7fc64013de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400a9fd0 con 0x7fc64013f070 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64013e370 con 0x7fc640069450 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc647904700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6400ae690 con 0x7fc64006df00 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57780/0 (socket says 172.21.15.57:57780) 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 -- 172.21.15.57:0/3911201863 learned_addr learned my addr 172.21.15.57:0/3911201863 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc645ea1700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 0x7fc64013de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc644e9f700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 -- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 msgr2=0x7fc64013d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 -- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 msgr2=0x7fc64013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 0x7fc64013de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 -- 172.21.15.57:0/3911201863 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009420 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc645ea1700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 0x7fc64013de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.468+0000 7fc6456a0700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6400a3ab0 tx=0x7fc630017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.469+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc630002f90 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.469+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000b950 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.469+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63800bc30 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.469+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63001a430 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.469+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300094f0 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.470+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6400aea70 con 0x7fc640069450 2024-03-18T14:47:52.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.470+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc63001a7e0 con 0x7fc640069450 2024-03-18T14:47:52.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.470+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fc63005cdd0 con 0x7fc640069450 2024-03-18T14:47:52.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.474+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fc63002fff0 con 0x7fc640069450 2024-03-18T14:47:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.634+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6400b03f0 con 0x7fc624046010 2024-03-18T14:47:52.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.635+0000 7fc6357fa700 1 -- 172.21.15.57:0/3911201863 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7fc6400b03f0 con 0x7fc624046010 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 >> v1:172.21.15.57:6816/47480 conn(0x7fc624046010 legacy=0x7fc6240484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 msgr2=0x7fc6400aca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc6400a3ab0 tx=0x7fc630017000 comp rx=0 tx=0).stop 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 shutdown_connections 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc64013f070 0x7fc64013de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc640069450 0x7fc6400aca40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 --2- 172.21.15.57:0/3911201863 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc64006df00 0x7fc64013d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 >> 172.21.15.57:0/3911201863 conn(0x7fc64006ce30 msgr2=0x7fc6400a2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 shutdown_connections 2024-03-18T14:47:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.636+0000 7fc647904700 1 -- 172.21.15.57:0/3911201863 wait complete. 2024-03-18T14:47:52.639 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-03-18T14:47:52.650 INFO:tasks.ceph:Scrubbing osd.1 2024-03-18T14:47:52.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-18T14:47:52.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.773+0000 7fc7a6ea7700 1 Processor -- start 2024-03-18T14:47:52.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.773+0000 7fc7a6ea7700 1 -- start start 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a6ea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 0x7fc7a006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a6ea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 0x7fc7a0148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a6ea7700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a006deb0 con 0x7fc7a00a4310 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a6ea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00a37a0 con 0x7fc7a0146520 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a6ea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00a3a40 con 0x7fc7a006efc0 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc79ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 0x7fc7a006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a4c43700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7a00a4310 0x7fc7a0068d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33880/0 (socket says 172.21.15.57:33880) 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 0x7fc7a0148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a4c43700 1 -- 172.21.15.57:0/1858425764 learned_addr learned my addr 172.21.15.57:0/1858425764 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc79f7fe700 1 -- 172.21.15.57:0/1858425764 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649534142 0 0) 0x7fc7a006deb0 con 0x7fc7a00a4310 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 -- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 msgr2=0x7fc7a006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 0x7fc7a006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 -- 172.21.15.57:0/1858425764 >> v1:172.21.15.57:6789/0 conn(0x7fc7a00a4310 legacy=0x7fc7a0068d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 -- 172.21.15.57:0/1858425764 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a00a2b50 con 0x7fc7a0146520 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc79ffff700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 0x7fc7a006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.774+0000 7fc7a5444700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 0x7fc7a0148900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc798009e90 tx=0x7fc798009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad3152b04dbec41 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc79f7fe700 1 -- 172.21.15.57:0/1858425764 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79800e070 con 0x7fc7a0146520 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc79f7fe700 1 -- 172.21.15.57:0/1858425764 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79800bc30 con 0x7fc7a0146520 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc79f7fe700 1 -- 172.21.15.57:0/1858425764 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc798012430 con 0x7fc7a0146520 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 msgr2=0x7fc7a0148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 0x7fc7a0148900 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc798009e90 tx=0x7fc798009780 comp rx=0 tx=0).stop 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/1858425764 shutdown_connections 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a0146520 0x7fc7a0148900 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 --2- 172.21.15.57:0/1858425764 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a006efc0 0x7fc7a006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/1858425764 >> 172.21.15.57:0/1858425764 conn(0x7fc7a006aa00 msgr2=0x7fc7a006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/1858425764 shutdown_connections 2024-03-18T14:47:52.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.775+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/1858425764 wait complete. 2024-03-18T14:47:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.776+0000 7fc7a6ea7700 1 Processor -- start 2024-03-18T14:47:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.776+0000 7fc7a6ea7700 1 -- start start 2024-03-18T14:47:52.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a006efc0 0x7fc7a009a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 0x7fc7a01414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a0146520 0x7fc7a0141a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a00980b0 con 0x7fc7a0146520 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0098820 con 0x7fc7a006efc0 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a6ea7700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a0098ae0 con 0x7fc7a00a4310 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a006efc0 0x7fc7a009a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc79ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 0x7fc7a01414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a5444700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a0146520 0x7fc7a0141a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc79ffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 0x7fc7a01414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45470/0 (socket says 172.21.15.57:45470) 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc79ffff700 1 -- 172.21.15.57:0/4018182935 learned_addr learned my addr 172.21.15.57:0/4018182935 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 -- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 msgr2=0x7fc7a01414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 0x7fc7a01414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 -- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a0146520 msgr2=0x7fc7a0141a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a0146520 0x7fc7a0141a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 -- 172.21.15.57:0/4018182935 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c009420 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc79ffff700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fc7a00a4310 0x7fc7a01414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a5444700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc7a0146520 0x7fc7a0141a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.777+0000 7fc7a4c43700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a006efc0 0x7fc7a009a720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7940011e0 tx=0x7fc794007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794005b30 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794005cb0 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc798009a20 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794007320 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a00ad910 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.778+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7a0065180 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.779+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fc794012400 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.779+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fc79405a5b0 con 0x7fc7a006efc0 2024-03-18T14:47:52.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.779+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 --> v1:172.21.15.57:6804/50128 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc784052b00 con 0x7fc78404ee40 2024-03-18T14:47:52.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.779+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc79405cbf0 con 0x7fc7a006efc0 2024-03-18T14:47:52.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.780+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== osd.1 v1:172.21.15.57:6804/50128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fc784052b00 con 0x7fc78404ee40 2024-03-18T14:47:52.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 --> v1:172.21.15.57:6804/50128 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc7a006eda0 con 0x7fc78404ee40 2024-03-18T14:47:52.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc79cff9700 1 -- 172.21.15.57:0/4018182935 <== osd.1 v1:172.21.15.57:6804/50128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fc7a006eda0 con 0x7fc78404ee40 2024-03-18T14:47:52.796 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:52.796 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T14:47:52.796 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:52.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 >> v1:172.21.15.57:6804/50128 conn(0x7fc78404ee40 legacy=0x7fc784051290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 >> v1:172.21.15.57:6816/47480 conn(0x7fc784046010 legacy=0x7fc7840484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a006efc0 msgr2=0x7fc7a009a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 --2- 172.21.15.57:0/4018182935 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fc7a006efc0 0x7fc7a009a720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7940011e0 tx=0x7fc794007d10 comp rx=0 tx=0).stop 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a5444700 1 -- 172.21.15.57:0/4018182935 reap_dead start 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 shutdown_connections 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 >> 172.21.15.57:0/4018182935 conn(0x7fc7a006aa00 msgr2=0x7fc7a00648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 shutdown_connections 2024-03-18T14:47:52.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.794+0000 7fc7a6ea7700 1 -- 172.21.15.57:0/4018182935 wait complete. 2024-03-18T14:47:52.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-18T14:47:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.927+0000 7fbf53756700 1 Processor -- start 2024-03-18T14:47:52.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 -- start start 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf4c06ea90 0x7fbf4c06ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c06fd10 con 0x7fbf4c06ea90 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0b07e0 con 0x7fbf4c068340 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf53756700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0697a0 con 0x7fbf4c0a4730 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf514f2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf51cf3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf4c06ea90 0x7fbf4c06ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf50cf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf51cf3700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbf4c06ea90 0x7fbf4c06ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43958/0 (socket says 172.21.15.57:43958) 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf514f2700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:57798/0 (socket says 172.21.15.57:57798) 2024-03-18T14:47:52.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf51cf3700 1 -- 172.21.15.57:0/4135714389 learned_addr learned my addr 172.21.15.57:0/4135714389 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.928+0000 7fbf50cf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45476/0 (socket says 172.21.15.57:45476) 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 -- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 msgr2=0x7fbf4c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 -- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 msgr2=0x7fbf4c0a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 -- 172.21.15.57:0/4135714389 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c069a40 con 0x7fbf4c06ea90 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf514f2700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf50cf1700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf51cf3700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c06ea90 0x7fbf4c06ef30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009f20 tx=0x7fbf44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10002efcb8191c8d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf3ffff700 1 -- 172.21.15.57:0/4135714389 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400e070 con 0x7fbf4c06ea90 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf3ffff700 1 -- 172.21.15.57:0/4135714389 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4400b970 con 0x7fbf4c06ea90 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf3ffff700 1 -- 172.21.15.57:0/4135714389 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440092e0 con 0x7fbf4c06ea90 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf53756700 1 -- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c06ea90 msgr2=0x7fbf4c06ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.929+0000 7fbf53756700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c06ea90 0x7fbf4c06ef30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009f20 tx=0x7fbf44009840 comp rx=0 tx=0).stop 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 -- 172.21.15.57:0/4135714389 shutdown_connections 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c06ea90 0x7fbf4c06ef30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c068340 0x7fbf4c0a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 --2- 172.21.15.57:0/4135714389 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c0a4730 0x7fbf4c06a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 -- 172.21.15.57:0/4135714389 >> 172.21.15.57:0/4135714389 conn(0x7fbf4c06be90 msgr2=0x7fbf4c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 -- 172.21.15.57:0/4135714389 shutdown_connections 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.930+0000 7fbf53756700 1 -- 172.21.15.57:0/4135714389 wait complete. 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 Processor -- start 2024-03-18T14:47:52.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 -- start start 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 0x7fbf4c13f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c0a4730 0x7fbf4c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c099530 con 0x7fbf4c068340 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c097b20 con 0x7fbf4c0a4730 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf53756700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0976b0 con 0x7fbf4c06ea90 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf514f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf50cf1700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 0x7fbf4c13f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf514f2700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43970/0 (socket says 172.21.15.57:43970) 2024-03-18T14:47:52.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf51cf3700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c0a4730 0x7fbf4c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.931+0000 7fbf514f2700 1 -- 172.21.15.57:0/2304035528 learned_addr learned my addr 172.21.15.57:0/2304035528 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 -- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 msgr2=0x7fbf4c13f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 0x7fbf4c13f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 -- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c0a4730 msgr2=0x7fbf4c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c0a4730 0x7fbf4c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 -- 172.21.15.57:0/2304035528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40009420 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf50cf1700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 0x7fbf4c13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf514f2700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000ec80 tx=0x7fbf400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000c850 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000c9b0 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf48009420 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4000cd30 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.932+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf44009ae0 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.933+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c099930 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.933+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fbf40013680 con 0x7fbf4c068340 2024-03-18T14:47:52.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.933+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7fbf4005b810 con 0x7fbf4c068340 2024-03-18T14:47:52.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:52.937+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fbf40039970 con 0x7fbf4c068340 2024-03-18T14:47:53.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.098+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf4c099670 con 0x7fbf30046010 2024-03-18T14:47:53.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.098+0000 7fbf3d7fa700 1 -- 172.21.15.57:0/2304035528 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7fbf4c099670 con 0x7fbf30046010 2024-03-18T14:47:53.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 >> v1:172.21.15.57:6816/47480 conn(0x7fbf30046010 legacy=0x7fbf300484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 msgr2=0x7fbf4c099f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbf4000ec80 tx=0x7fbf400091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 shutdown_connections 2024-03-18T14:47:53.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fbf4c0a4730 0x7fbf4c13fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbf4c068340 0x7fbf4c099f80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 --2- 172.21.15.57:0/2304035528 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fbf4c06ea90 0x7fbf4c13f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.100+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 >> 172.21.15.57:0/2304035528 conn(0x7fbf4c06be90 msgr2=0x7fbf4c069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.101+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 shutdown_connections 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.101+0000 7fbf53756700 1 -- 172.21.15.57:0/2304035528 wait complete. 2024-03-18T14:47:53.103 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-03-18T14:47:53.114 INFO:tasks.ceph:Scrubbing osd.2 2024-03-18T14:47:53.114 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.237+0000 7f4bf6916700 1 Processor -- start 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.237+0000 7f4bf6916700 1 -- start start 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf6916700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf6916700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bf013ea10 0x7f4bf013ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf6916700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf00a2420 con 0x7f4bf00a5460 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf6916700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf00a2c40 con 0x7f4bf013ea10 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf6916700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00a39b0 con 0x7f4bf0069170 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4beffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bef7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4bf013ea10 0x7f4bf013ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf4eb3700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4bf00a5460 0x7f4bf00a5900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33890/0 (socket says 172.21.15.57:33890) 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4beffff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:45482/0 (socket says 172.21.15.57:45482) 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bf4eb3700 1 -- 172.21.15.57:0/2485306007 learned_addr learned my addr 172.21.15.57:0/2485306007 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4beeffd700 1 -- 172.21.15.57:0/2485306007 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875298221 0 0) 0x7f4bf00a2420 con 0x7f4bf00a5460 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4beeffd700 1 -- 172.21.15.57:0/2485306007 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd8003570 con 0x7f4bf00a5460 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bef7fe700 1 -- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 msgr2=0x7f4bf00a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bef7fe700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bef7fe700 1 -- 172.21.15.57:0/2485306007 >> v1:172.21.15.57:6789/0 conn(0x7f4bf00a5460 legacy=0x7f4bf00a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4bef7fe700 1 -- 172.21.15.57:0/2485306007 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00a6600 con 0x7f4bf013ea10 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.238+0000 7f4beffff700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bef7fe700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf013ea10 0x7f4bf013ee20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4be00098e0 tx=0x7f4be00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd54b593b396342 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4beeffd700 1 -- 172.21.15.57:0/2485306007 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0011630 con 0x7f4bf013ea10 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4beeffd700 1 -- 172.21.15.57:0/2485306007 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0011790 con 0x7f4bf013ea10 2024-03-18T14:47:53.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4beeffd700 1 -- 172.21.15.57:0/2485306007 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0011b30 con 0x7f4bf013ea10 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 -- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf013ea10 msgr2=0x7f4bf013ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf013ea10 0x7f4bf013ee20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4be00098e0 tx=0x7f4be00091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 -- 172.21.15.57:0/2485306007 shutdown_connections 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf0069170 0x7f4bf00a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 --2- 172.21.15.57:0/2485306007 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf013ea10 0x7f4bf013ee20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 -- 172.21.15.57:0/2485306007 >> 172.21.15.57:0/2485306007 conn(0x7f4bf0063600 msgr2=0x7f4bf0063a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 -- 172.21.15.57:0/2485306007 shutdown_connections 2024-03-18T14:47:53.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.239+0000 7f4bf6916700 1 -- 172.21.15.57:0/2485306007 wait complete. 2024-03-18T14:47:53.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.241+0000 7f4bf6916700 1 Processor -- start 2024-03-18T14:47:53.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.241+0000 7f4bf6916700 1 -- start start 2024-03-18T14:47:53.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf0069170 0x7f4bf0151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 0x7f4bf0140020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf013ea10 0x7f4bf0140560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0151a20 con 0x7f4bf00a5460 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0152820 con 0x7f4bf0069170 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf013a810 con 0x7f4bf013ea10 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 0x7f4bf0140020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4beffff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf0069170 0x7f4bf0151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 0x7f4bf0140020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:43996/0 (socket says 172.21.15.57:43996) 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 -- 172.21.15.57:0/1800464625 learned_addr learned my addr 172.21.15.57:0/1800464625 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf4eb3700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf013ea10 0x7f4bf0140560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 -- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf013ea10 msgr2=0x7f4bf0140560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf013ea10 0x7f4bf0140560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 -- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf0069170 msgr2=0x7f4bf0151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf0069170 0x7f4bf0151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 -- 172.21.15.57:0/1800464625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be4009420 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf4eb3700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f4bf013ea10 0x7f4bf0140560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4beffff700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f4bf0069170 0x7f4bf0151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bef7fe700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 0x7f4bf0140020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4be0013000 tx=0x7f4be0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0000d10 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be0011900 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0025420 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.242+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0009420 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.243+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf0152390 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.243+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bf00a2a80 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.243+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f4be0023070 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.244+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f4be005c560 con 0x7f4bf00a5460 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.244+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 --> v1:172.21.15.57:6808/50245 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bdc0529c0 con 0x7f4bdc04ed00 2024-03-18T14:47:53.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.244+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4be005eba0 con 0x7f4bf00a5460 2024-03-18T14:47:53.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.245+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== osd.2 v1:172.21.15.57:6808/50245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f4bdc0529c0 con 0x7f4bdc04ed00 2024-03-18T14:47:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 --> v1:172.21.15.57:6808/50245 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4bf00a62a0 con 0x7f4bdc04ed00 2024-03-18T14:47:53.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bd7fff700 1 -- 172.21.15.57:0/1800464625 <== osd.2 v1:172.21.15.57:6808/50245 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f4bf00a62a0 con 0x7f4bdc04ed00 2024-03-18T14:47:53.260 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:53.261 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T14:47:53.261 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 >> v1:172.21.15.57:6808/50245 conn(0x7f4bdc04ed00 legacy=0x7f4bdc051150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 >> v1:172.21.15.57:6816/47480 conn(0x7f4bdc046040 legacy=0x7f4bdc0484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 msgr2=0x7f4bf0140020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 --2- 172.21.15.57:0/1800464625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4bf00a5460 0x7f4bf0140020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4be0013000 tx=0x7f4be0017000 comp rx=0 tx=0).stop 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf4eb3700 1 -- 172.21.15.57:0/1800464625 reap_dead start 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 shutdown_connections 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 >> 172.21.15.57:0/1800464625 conn(0x7f4bf0063600 msgr2=0x7f4bf013ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 shutdown_connections 2024-03-18T14:47:53.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.259+0000 7f4bf6916700 1 -- 172.21.15.57:0/1800464625 wait complete. 2024-03-18T14:47:53.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-18T14:47:53.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.391+0000 7f2a77ba0700 1 Processor -- start 2024-03-18T14:47:53.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.391+0000 7f2a77ba0700 1 -- start start 2024-03-18T14:47:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a77ba0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 0x7f2a700a3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a77ba0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 0x7f2a7013b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a77ba0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a700a3c40 con 0x7f2a7006daa0 2024-03-18T14:47:53.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a77ba0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7013af20 con 0x7f2a700b22a0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a77ba0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7013b110 con 0x7f2a700a4910 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7593c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 0x7f2a700a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7513b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 0x7f2a7013b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7613d700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2a7006daa0 0x7f2a7006df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:33896/0 (socket says 172.21.15.57:33896) 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7613d700 1 -- 172.21.15.57:0/1272203541 learned_addr learned my addr 172.21.15.57:0/1272203541 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7593c700 1 -- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 msgr2=0x7f2a7013b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7593c700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 0x7f2a7013b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7593c700 1 -- 172.21.15.57:0/1272203541 >> v1:172.21.15.57:6789/0 conn(0x7f2a7006daa0 legacy=0x7f2a7006df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7493a700 1 -- 172.21.15.57:0/1272203541 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418062059 0 0) 0x7f2a700a3c40 con 0x7f2a7006daa0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7593c700 1 -- 172.21.15.57:0/1272203541 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7013b3b0 con 0x7f2a700b22a0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.392+0000 7f2a7513b700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 0x7f2a7013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a7593c700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 0x7f2a700a3030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009910 tx=0x7f2a600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d22a70987820b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a7493a700 1 -- 172.21.15.57:0/1272203541 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000b680 con 0x7f2a700b22a0 2024-03-18T14:47:53.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a7493a700 1 -- 172.21.15.57:0/1272203541 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000b7e0 con 0x7f2a700b22a0 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a7493a700 1 -- 172.21.15.57:0/1272203541 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000bba0 con 0x7f2a700b22a0 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 msgr2=0x7f2a700a3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 0x7f2a700a3030 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009910 tx=0x7f2a600091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1272203541 shutdown_connections 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700b22a0 0x7f2a700a3030 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1272203541 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700a4910 0x7f2a7013b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1272203541 >> 172.21.15.57:0/1272203541 conn(0x7f2a7006d1f0 msgr2=0x7f2a7006af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1272203541 shutdown_connections 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.393+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1272203541 wait complete. 2024-03-18T14:47:53.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.394+0000 7f2a77ba0700 1 Processor -- start 2024-03-18T14:47:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.394+0000 7f2a77ba0700 1 -- start start 2024-03-18T14:47:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700a4910 0x7f2a700afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 0x7f2a700b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7014ffa0 con 0x7f2a7006daa0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a70150260 con 0x7f2a700a4910 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a77ba0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a700a9bc0 con 0x7f2a700b22a0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7593c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7593c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44008/0 (socket says 172.21.15.57:44008) 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7593c700 1 -- 172.21.15.57:0/1587767471 learned_addr learned my addr 172.21.15.57:0/1587767471 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 0x7f2a700b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7513b700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700a4910 0x7f2a700afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 -- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700a4910 msgr2=0x7f2a700afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700a4910 0x7f2a700afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 -- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 msgr2=0x7f2a7014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 -- 172.21.15.57:0/1587767471 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009420 con 0x7f2a700b22a0 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7593c700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.395+0000 7f2a7613d700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 0x7f2a700b0160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cbe0 tx=0x7f2a680019a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.396+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800a8b0 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.396+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6800aa30 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.396+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a60009420 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.396+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800adf0 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.396+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a70067ea0 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.397+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f2a68007300 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.397+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f2a6805b4c0 con 0x7f2a700b22a0 2024-03-18T14:47:53.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.397+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a700a9d00 con 0x7f2a700b22a0 2024-03-18T14:47:53.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.401+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f2a700a9d00 con 0x7f2a700b22a0 2024-03-18T14:47:53.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.564+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a700a9d00 con 0x7f2a54046010 2024-03-18T14:47:53.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.564+0000 7f2a65ffb700 1 -- 172.21.15.57:0/1587767471 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f2a700a9d00 con 0x7f2a54046010 2024-03-18T14:47:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 >> v1:172.21.15.57:6816/47480 conn(0x7f2a54046010 legacy=0x7f2a540484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 msgr2=0x7f2a700b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 0x7f2a700b0160 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cbe0 tx=0x7f2a680019a0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 shutdown_connections 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f2a700b22a0 0x7f2a700b0160 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a7006daa0 0x7f2a7014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 --2- 172.21.15.57:0/1587767471 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f2a700a4910 0x7f2a700afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 >> 172.21.15.57:0/1587767471 conn(0x7f2a7006d1f0 msgr2=0x7f2a7013f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 shutdown_connections 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.566+0000 7f2a77ba0700 1 -- 172.21.15.57:0/1587767471 wait complete. 2024-03-18T14:47:53.569 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-03-18T14:47:53.580 INFO:tasks.ceph:Scrubbing osd.3 2024-03-18T14:47:53.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.704+0000 7f5bc160c700 1 Processor -- start 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.704+0000 7f5bc160c700 1 -- start start 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0a5d70 con 0x7f5bbc0a5690 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc13f6c0 con 0x7f5bbc0a7130 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bc160c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc13f960 con 0x7f5bbc068340 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bba7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59570/0 (socket says 172.21.15.57:59570) 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bba7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60400/0 (socket says 172.21.15.57:60400) 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 -- 172.21.15.57:0/275047829 learned_addr learned my addr 172.21.15.57:0/275047829 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59842/0 (socket says 172.21.15.57:59842) 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 -- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 msgr2=0x7f5bbc0a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 -- 172.21.15.57:0/275047829 >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 msgr2=0x7f5bbc06ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 --2- 172.21.15.57:0/275047829 >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbaffd700 1 -- 172.21.15.57:0/275047829 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc06c6e0 con 0x7f5bbc068340 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bba7fc700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.705+0000 7f5bbb7fe700 1 --2- 172.21.15.57:0/275047829 >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bbaffd700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00099b0 tx=0x7f5bb0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e379625e5e7044a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/275047829 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000b680 con 0x7f5bbc068340 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/275047829 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000b7e0 con 0x7f5bbc068340 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bb9ffb700 1 -- 172.21.15.57:0/275047829 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000bb80 con 0x7f5bbc068340 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 -- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 msgr2=0x7f5bbc13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00099b0 tx=0x7f5bb0009250 comp rx=0 tx=0).stop 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 -- 172.21.15.57:0/275047829 shutdown_connections 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 --2- 172.21.15.57:0/275047829 >> v2:172.21.15.57:3300/0 conn(0x7f5bbc0a5690 0x7f5bbc06ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc13fd90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 --2- 172.21.15.57:0/275047829 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a7130 0x7f5bbc0a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 -- 172.21.15.57:0/275047829 >> 172.21.15.57:0/275047829 conn(0x7f5bbc06bdd0 msgr2=0x7f5bbc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 -- 172.21.15.57:0/275047829 shutdown_connections 2024-03-18T14:47:53.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.706+0000 7f5bc160c700 1 -- 172.21.15.57:0/275047829 wait complete. 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.707+0000 7f5bc160c700 1 Processor -- start 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.707+0000 7f5bc160c700 1 -- start start 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc0ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 0x7f5bbc0970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 0x7f5bbc14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc096cd0 con 0x7f5bbc0a7130 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc097730 con 0x7f5bbc0a5690 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bc160c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0aa9d0 con 0x7f5bbc068340 2024-03-18T14:47:53.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bba7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 0x7f5bbc0970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 0x7f5bbc14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbaffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc0ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbaffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc0ad4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59574/0 (socket says 172.21.15.57:59574) 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bba7fc700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 0x7f5bbc0970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60414/0 (socket says 172.21.15.57:60414) 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbaffd700 1 -- 172.21.15.57:0/4164784183 learned_addr learned my addr 172.21.15.57:0/4164784183 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 0x7f5bbc14f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59846/0 (socket says 172.21.15.57:59846) 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 -- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 msgr2=0x7f5bbc0ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 --2- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f5bbc068340 0x7f5bbc0ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 -- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 msgr2=0x7f5bbc0970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 --2- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 0x7f5bbc0970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bbb7fe700 1 -- 172.21.15.57:0/4164784183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009a20 con 0x7f5bbc0a7130 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.708+0000 7f5bba7fc700 1 --2- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f5bbc0a5690 0x7f5bbc0970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5bbb7fe700 1 --2- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 0x7f5bbc14f270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0a5a80 tx=0x7f5bb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400cc00 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400f040 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4014480 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bac009420 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.709+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00094f0 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.710+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bbc065180 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.710+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f5bb4003020 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.710+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f5bb405bb10 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.710+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 --> v1:172.21.15.57:6812/50393 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ba8052b00 con 0x7f5ba804ee40 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.710+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5bb4060240 con 0x7f5bbc0a7130 2024-03-18T14:47:53.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.711+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== osd.3 v1:172.21.15.57:6812/50393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f5ba8052b00 con 0x7f5ba804ee40 2024-03-18T14:47:53.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.725+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 --> v1:172.21.15.57:6812/50393 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5bbc0a40a0 con 0x7f5ba804ee40 2024-03-18T14:47:53.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.725+0000 7f5ba2ffd700 1 -- 172.21.15.57:0/4164784183 <== osd.3 v1:172.21.15.57:6812/50393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f5bbc0a40a0 con 0x7f5ba804ee40 2024-03-18T14:47:53.727 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-18T14:47:53.727 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T14:47:53.727 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 >> v1:172.21.15.57:6812/50393 conn(0x7f5ba804ee40 legacy=0x7f5ba8051290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 >> v1:172.21.15.57:6816/47480 conn(0x7f5ba8046010 legacy=0x7f5ba80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 msgr2=0x7f5bbc14f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 --2- 172.21.15.57:0/4164784183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5bbc0a7130 0x7f5bbc14f270 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0a5a80 tx=0x7f5bb400b040 comp rx=0 tx=0).stop 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bbb7fe700 1 -- 172.21.15.57:0/4164784183 reap_dead start 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 shutdown_connections 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 >> 172.21.15.57:0/4164784183 conn(0x7f5bbc06bdd0 msgr2=0x7f5bbc0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 shutdown_connections 2024-03-18T14:47:53.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.726+0000 7f5bc160c700 1 -- 172.21.15.57:0/4164784183 wait complete. 2024-03-18T14:47:53.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-18T14:47:53.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.860+0000 7f6f340ca700 1 Processor -- start 2024-03-18T14:47:53.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.860+0000 7f6f340ca700 1 -- start start 2024-03-18T14:47:53.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f2c0b2310 0x7f6f2c0a3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c0a48b0 0x7f6f2c0ae860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a36d0 con 0x7f6f2c0b2310 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a3c00 con 0x7f6f2c0aeda0 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f340ca700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c13e920 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f2c0b2310 0x7f6f2c0a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f32667700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31665700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c0a48b0 0x7f6f2c0ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f32667700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60416/0 (socket says 172.21.15.57:60416) 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f32667700 1 -- 172.21.15.57:0/1177540415 learned_addr learned my addr 172.21.15.57:0/1177540415 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f2c0b2310 0x7f6f2c0a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59850/0 (socket says 172.21.15.57:59850) 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 -- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c0a48b0 msgr2=0x7f6f2c0ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c0a48b0 0x7f6f2c0ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 -- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 msgr2=0x7f6f2c06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f31e66700 1 -- 172.21.15.57:0/1177540415 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c13ebc0 con 0x7f6f2c0b2310 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.861+0000 7f6f32667700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f31e66700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0b2310 0x7f6f2c0a3190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098e0 tx=0x7f6f1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cf68acc48792be server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f30e64700 1 -- 172.21.15.57:0/1177540415 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011630 con 0x7f6f2c0b2310 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f30e64700 1 -- 172.21.15.57:0/1177540415 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c011790 con 0x7f6f2c0b2310 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f30e64700 1 -- 172.21.15.57:0/1177540415 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c011b30 con 0x7f6f2c0b2310 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 -- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0b2310 msgr2=0x7f6f2c0a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0b2310 0x7f6f2c0a3190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0098e0 tx=0x7f6f1c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 -- 172.21.15.57:0/1177540415 shutdown_connections 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0aeda0 0x7f6f2c06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0b2310 0x7f6f2c0a3190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 --2- 172.21.15.57:0/1177540415 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c0a48b0 0x7f6f2c0ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 -- 172.21.15.57:0/1177540415 >> 172.21.15.57:0/1177540415 conn(0x7f6f2c06b180 msgr2=0x7f6f2c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:53.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 -- 172.21.15.57:0/1177540415 shutdown_connections 2024-03-18T14:47:53.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.862+0000 7f6f340ca700 1 -- 172.21.15.57:0/1177540415 wait complete. 2024-03-18T14:47:53.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.863+0000 7f6f340ca700 1 Processor -- start 2024-03-18T14:47:53.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.863+0000 7f6f340ca700 1 -- start start 2024-03-18T14:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a8eb0 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c0a8250 con 0x7f6f2c0b2310 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f340ca700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2c152080 con 0x7f6f2c151bf0 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f32667700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31665700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59864/0 (socket says 172.21.15.57:59864) 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 -- 172.21.15.57:0/2400231559 learned_addr learned my addr 172.21.15.57:0/2400231559 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f32667700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59598/0 (socket says 172.21.15.57:59598) 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31665700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:60420/0 (socket says 172.21.15.57:60420) 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 -- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 msgr2=0x7f6f2c0a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 -- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 msgr2=0x7f6f2c0a57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 -- 172.21.15.57:0/2400231559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f24009ae0 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f32667700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31665700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.864+0000 7f6f31e66700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0b28b0 tx=0x7f6f1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.865+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c000d10 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.865+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c011b10 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.865+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c009420 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.865+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c025660 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.865+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2c13e0b0 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.866+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f6f1c025a10 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.866+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2c065180 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.866+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f6f1c05ca60 con 0x7f6f2c0a48b0 2024-03-18T14:47:53.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:53.870+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f6f1c005a00 con 0x7f6f2c0a48b0 2024-03-18T14:47:54.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.029+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f2c06d560 con 0x7f6f10046010 2024-03-18T14:47:54.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.030+0000 7f6f21ffb700 1 -- 172.21.15.57:0/2400231559 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f6f2c06d560 con 0x7f6f10046010 2024-03-18T14:47:54.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.031+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 >> v1:172.21.15.57:6816/47480 conn(0x7f6f10046010 legacy=0x7f6f100484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.031+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 msgr2=0x7f6f2c1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.031+0000 7f6f340ca700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c0b28b0 tx=0x7f6f1c017000 comp rx=0 tx=0).stop 2024-03-18T14:47:54.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 shutdown_connections 2024-03-18T14:47:54.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6f2c151bf0 0x7f6f2c0a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f2c0a48b0 0x7f6f2c1516b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 --2- 172.21.15.57:0/2400231559 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6f2c0b2310 0x7f6f2c0a57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 >> 172.21.15.57:0/2400231559 conn(0x7f6f2c06b180 msgr2=0x7f6f2c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 shutdown_connections 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.032+0000 7f6f340ca700 1 -- 172.21.15.57:0/2400231559 wait complete. 2024-03-18T14:47:54.034 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-03-18T14:47:54.045 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:47:54.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.164+0000 7f3e93bc6700 1 Processor -- start 2024-03-18T14:47:54.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.164+0000 7f3e93bc6700 1 -- start start 2024-03-18T14:47:54.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e93bc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:54.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e93bc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:54.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e93bc6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c0a4ce0 con 0x7f3e8c0b56e0 2024-03-18T14:47:54.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e93bc6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c13e440 con 0x7f3e8c13e070 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e93bc6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0a3ad0 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91962700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3e8c0b56e0 0x7f3e8c13d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46522/0 (socket says 172.21.15.57:46522) 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91962700 1 -- 172.21.15.57:0/2814599569 learned_addr learned my addr 172.21.15.57:0/2814599569 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e92163700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91161700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e90960700 1 -- 172.21.15.57:0/2814599569 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381934128 0 0) 0x7f3e8c0a4ce0 con 0x7f3e8c0b56e0 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e90960700 1 -- 172.21.15.57:0/2814599569 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e78003570 con 0x7f3e8c0b56e0 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91161700 1 -- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 msgr2=0x7f3e8c148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91161700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91161700 1 -- 172.21.15.57:0/2814599569 >> v1:172.21.15.57:6789/0 conn(0x7f3e8c0b56e0 legacy=0x7f3e8c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e91161700 1 -- 172.21.15.57:0/2814599569 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0a7230 con 0x7f3e8c13e070 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.165+0000 7f3e92163700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e91161700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0a4600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009910 tx=0x7f3e7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d896855da3e22d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:54.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e90960700 1 -- 172.21.15.57:0/2814599569 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c011630 con 0x7f3e8c13e070 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e90960700 1 -- 172.21.15.57:0/2814599569 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c011790 con 0x7f3e8c13e070 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e90960700 1 -- 172.21.15.57:0/2814599569 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c011b30 con 0x7f3e8c13e070 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 -- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 msgr2=0x7f3e8c0a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0a4600 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009910 tx=0x7f3e7c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 -- 172.21.15.57:0/2814599569 shutdown_connections 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/2814599569 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0a4600 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 -- 172.21.15.57:0/2814599569 >> 172.21.15.57:0/2814599569 conn(0x7f3e8c06fb90 msgr2=0x7f3e8c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 -- 172.21.15.57:0/2814599569 shutdown_connections 2024-03-18T14:47:54.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.166+0000 7f3e93bc6700 1 -- 172.21.15.57:0/2814599569 wait complete. 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.167+0000 7f3e93bc6700 1 Processor -- start 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.167+0000 7f3e93bc6700 1 -- start start 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c09b610 con 0x7f3e8c0b56e0 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c14e360 con 0x7f3e8c13e070 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e93bc6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c09b050 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:54.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:59610/0 (socket says 172.21.15.57:59610) 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91161700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:59868/0 (socket says 172.21.15.57:59868) 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 -- 172.21.15.57:0/1970167404 learned_addr learned my addr 172.21.15.57:0/1970167404 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e92163700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 -- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 msgr2=0x7f3e8c0984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 -- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 msgr2=0x7f3e8c099fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91962700 1 -- 172.21.15.57:0/1970167404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009a20 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e91161700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.168+0000 7f3e92163700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e91962700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800c7c0 tx=0x7f3e88007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88005b30 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e88005c90 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c009420 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88007320 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.169+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c0996b0 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.170+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c099db0 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.170+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7f3e8801b3b0 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.171+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 3969+0+0 (secure 0 0 0) 0x7f3e8805a670 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.174+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f3e88038890 con 0x7f3e8c0a1d30 2024-03-18T14:47:54.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.332+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e8c065180 con 0x7f3e70046010 2024-03-18T14:47:54.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.340+0000 7f3e81ffb700 1 -- 172.21.15.57:0/1970167404 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273445 (unknown 2965378022 0 3165537839) 0x7f3e8c065180 con 0x7f3e70046010 2024-03-18T14:47:54.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 >> v1:172.21.15.57:6816/47480 conn(0x7f3e70046010 legacy=0x7f3e700484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 msgr2=0x7f3e8c09ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3e8800c7c0 tx=0x7f3e88007e00 comp rx=0 tx=0).stop 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 shutdown_connections 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f3e8c13e070 0x7f3e8c0984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f3e8c0a1d30 0x7f3e8c09ab10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 --2- 172.21.15.57:0/1970167404 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e8c0b56e0 0x7f3e8c099fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.342+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 >> 172.21.15.57:0/1970167404 conn(0x7f3e8c06fb90 msgr2=0x7f3e8c0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.343+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 shutdown_connections 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:47:54.343+0000 7f3e93bc6700 1 -- 172.21.15.57:0/1970167404 wait complete. 2024-03-18T14:47:54.347 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:47:54.356 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-03-18T14:47:53.558144+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749686,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65074,"num_write_kb":8749062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71471,"ondisk_log_size":71471,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1532904,"kb_used_data":270536,"kb_used_omap":816,"kb_used_meta":1261519,"kb_avail":375954456,"statfs":{"total":386547056640,"available":384977362944,"internally_reserved":0,"allocated":277028864,"data_stored":276142128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1291795739},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":362,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002483"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":880,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710440+0000","last_change":"2024-03-18T14:47:17.505592+0000","last_active":"2024-03-18T14:47:24.710440+0000","last_peered":"2024-03-18T14:47:24.710440+0000","last_clean":"2024-03-18T14:47:24.710440+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:47:24.710440+0000","last_undegraded":"2024-03-18T14:47:24.710440+0000","last_fullsized":"2024-03-18T14:47:24.710440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:27.538991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710484+0000","last_change":"2024-03-18T14:47:14.611983+0000","last_active":"2024-03-18T14:47:24.710484+0000","last_peered":"2024-03-18T14:47:24.710484+0000","last_clean":"2024-03-18T14:47:24.710484+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:24.710484+0000","last_undegraded":"2024-03-18T14:47:24.710484+0000","last_fullsized":"2024-03-18T14:47:24.710484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:05.371817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":945,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711185+0000","last_change":"2024-03-18T14:47:13.585927+0000","last_active":"2024-03-18T14:47:24.711185+0000","last_peered":"2024-03-18T14:47:24.711185+0000","last_clean":"2024-03-18T14:47:24.711185+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:47:24.711185+0000","last_undegraded":"2024-03-18T14:47:24.711185+0000","last_fullsized":"2024-03-18T14:47:24.711185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:01:54.667078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":925,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711313+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:24.711313+0000","last_peered":"2024-03-18T14:47:24.711313+0000","last_clean":"2024-03-18T14:47:24.711313+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:24.711313+0000","last_undegraded":"2024-03-18T14:47:24.711313+0000","last_fullsized":"2024-03-18T14:47:24.711313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:09:12.040777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710214+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:24.710214+0000","last_peered":"2024-03-18T14:47:24.710214+0000","last_clean":"2024-03-18T14:47:24.710214+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:24.710214+0000","last_undegraded":"2024-03-18T14:47:24.710214+0000","last_fullsized":"2024-03-18T14:47:24.710214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:13:51.685313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":904,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600392+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:25.600392+0000","last_peered":"2024-03-18T14:47:25.600392+0000","last_clean":"2024-03-18T14:47:25.600392+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:25.600392+0000","last_undegraded":"2024-03-18T14:47:25.600392+0000","last_fullsized":"2024-03-18T14:47:25.600392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:26:59.184560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":957,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599543+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:25.599543+0000","last_peered":"2024-03-18T14:47:25.599543+0000","last_clean":"2024-03-18T14:47:25.599543+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:25.599543+0000","last_undegraded":"2024-03-18T14:47:25.599543+0000","last_fullsized":"2024-03-18T14:47:25.599543+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:43.747057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":804,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711870+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:24.711870+0000","last_peered":"2024-03-18T14:47:24.711870+0000","last_clean":"2024-03-18T14:47:24.711870+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:24.711870+0000","last_undegraded":"2024-03-18T14:47:24.711870+0000","last_fullsized":"2024-03-18T14:47:24.711870+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:40:03.135242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":947,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712243+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:24.712243+0000","last_peered":"2024-03-18T14:47:24.712243+0000","last_clean":"2024-03-18T14:47:24.712243+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:24.712243+0000","last_undegraded":"2024-03-18T14:47:24.712243+0000","last_fullsized":"2024-03-18T14:47:24.712243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:05:32.457061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":830,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712437+0000","last_change":"2024-03-18T14:47:13.603240+0000","last_active":"2024-03-18T14:47:24.712437+0000","last_peered":"2024-03-18T14:47:24.712437+0000","last_clean":"2024-03-18T14:47:24.712437+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:24.712437+0000","last_undegraded":"2024-03-18T14:47:24.712437+0000","last_fullsized":"2024-03-18T14:47:24.712437+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:18:19.403241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":806,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712653+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:24.712653+0000","last_peered":"2024-03-18T14:47:24.712653+0000","last_clean":"2024-03-18T14:47:24.712653+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:24.712653+0000","last_undegraded":"2024-03-18T14:47:24.712653+0000","last_fullsized":"2024-03-18T14:47:24.712653+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:26:56.421716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":833,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710663+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:24.710663+0000","last_peered":"2024-03-18T14:47:24.710663+0000","last_clean":"2024-03-18T14:47:24.710663+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:24.710663+0000","last_undegraded":"2024-03-18T14:47:24.710663+0000","last_fullsized":"2024-03-18T14:47:24.710663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:29.329614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":887,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710327+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:24.710327+0000","last_peered":"2024-03-18T14:47:24.710327+0000","last_clean":"2024-03-18T14:47:24.710327+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:24.710327+0000","last_undegraded":"2024-03-18T14:47:24.710327+0000","last_fullsized":"2024-03-18T14:47:24.710327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:51:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712352+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:24.712352+0000","last_peered":"2024-03-18T14:47:24.712352+0000","last_clean":"2024-03-18T14:47:24.712352+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:24.712352+0000","last_undegraded":"2024-03-18T14:47:24.712352+0000","last_fullsized":"2024-03-18T14:47:24.712352+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:09:57.018454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1050,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710336+0000","last_change":"2024-03-18T14:47:13.605624+0000","last_active":"2024-03-18T14:47:24.710336+0000","last_peered":"2024-03-18T14:47:24.710336+0000","last_clean":"2024-03-18T14:47:24.710336+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:47:24.710336+0000","last_undegraded":"2024-03-18T14:47:24.710336+0000","last_fullsized":"2024-03-18T14:47:24.710336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:26:54.096651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":883,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599889+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:25.599889+0000","last_peered":"2024-03-18T14:47:25.599889+0000","last_clean":"2024-03-18T14:47:25.599889+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:25.599889+0000","last_undegraded":"2024-03-18T14:47:25.599889+0000","last_fullsized":"2024-03-18T14:47:25.599889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:41:25.185632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1012,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712495+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:24.712495+0000","last_peered":"2024-03-18T14:47:24.712495+0000","last_clean":"2024-03-18T14:47:24.712495+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:24.712495+0000","last_undegraded":"2024-03-18T14:47:24.712495+0000","last_fullsized":"2024-03-18T14:47:24.712495+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:23:57.481690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1011,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711421+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:24.711421+0000","last_peered":"2024-03-18T14:47:24.711421+0000","last_clean":"2024-03-18T14:47:24.711421+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:24.711421+0000","last_undegraded":"2024-03-18T14:47:24.711421+0000","last_fullsized":"2024-03-18T14:47:24.711421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:38:07.599857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710683+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:24.710683+0000","last_peered":"2024-03-18T14:47:24.710683+0000","last_clean":"2024-03-18T14:47:24.710683+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:24.710683+0000","last_undegraded":"2024-03-18T14:47:24.710683+0000","last_fullsized":"2024-03-18T14:47:24.710683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:15.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1047,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713231+0000","last_change":"2024-03-18T14:47:17.488774+0000","last_active":"2024-03-18T14:47:24.713231+0000","last_peered":"2024-03-18T14:47:24.713231+0000","last_clean":"2024-03-18T14:47:24.713231+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:47:24.713231+0000","last_undegraded":"2024-03-18T14:47:24.713231+0000","last_fullsized":"2024-03-18T14:47:24.713231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:48:50.093468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1029,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712578+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:24.712578+0000","last_peered":"2024-03-18T14:47:24.712578+0000","last_clean":"2024-03-18T14:47:24.712578+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:24.712578+0000","last_undegraded":"2024-03-18T14:47:24.712578+0000","last_fullsized":"2024-03-18T14:47:24.712578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:24:33.256934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":891,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710482+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:24.710482+0000","last_peered":"2024-03-18T14:47:24.710482+0000","last_clean":"2024-03-18T14:47:24.710482+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:24.710482+0000","last_undegraded":"2024-03-18T14:47:24.710482+0000","last_fullsized":"2024-03-18T14:47:24.710482+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:03.203580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1019,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600855+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:25.600855+0000","last_peered":"2024-03-18T14:47:25.600855+0000","last_clean":"2024-03-18T14:47:25.600855+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:25.600855+0000","last_undegraded":"2024-03-18T14:47:25.600855+0000","last_fullsized":"2024-03-18T14:47:25.600855+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:15:31.675141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":936,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711752+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:24.711752+0000","last_peered":"2024-03-18T14:47:24.711752+0000","last_clean":"2024-03-18T14:47:24.711752+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:24.711752+0000","last_undegraded":"2024-03-18T14:47:24.711752+0000","last_fullsized":"2024-03-18T14:47:24.711752+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:20.194258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":966,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712973+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:24.712973+0000","last_peered":"2024-03-18T14:47:24.712973+0000","last_clean":"2024-03-18T14:47:24.712973+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:24.712973+0000","last_undegraded":"2024-03-18T14:47:24.712973+0000","last_fullsized":"2024-03-18T14:47:24.712973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:28.526908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":919,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712776+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:24.712776+0000","last_peered":"2024-03-18T14:47:24.712776+0000","last_clean":"2024-03-18T14:47:24.712776+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:24.712776+0000","last_undegraded":"2024-03-18T14:47:24.712776+0000","last_fullsized":"2024-03-18T14:47:24.712776+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:01.342108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":934,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600488+0000","last_change":"2024-03-18T14:47:17.523223+0000","last_active":"2024-03-18T14:47:25.600488+0000","last_peered":"2024-03-18T14:47:25.600488+0000","last_clean":"2024-03-18T14:47:25.600488+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:47:25.600488+0000","last_undegraded":"2024-03-18T14:47:25.600488+0000","last_fullsized":"2024-03-18T14:47:25.600488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:06:58.502026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1529,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712447+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:24.712447+0000","last_peered":"2024-03-18T14:47:24.712447+0000","last_clean":"2024-03-18T14:47:24.712447+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:24.712447+0000","last_undegraded":"2024-03-18T14:47:24.712447+0000","last_fullsized":"2024-03-18T14:47:24.712447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:24:09.924727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":926,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599866+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:25.599866+0000","last_peered":"2024-03-18T14:47:25.599866+0000","last_clean":"2024-03-18T14:47:25.599866+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:25.599866+0000","last_undegraded":"2024-03-18T14:47:25.599866+0000","last_fullsized":"2024-03-18T14:47:25.599866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:26.519994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"19'1065","reported_seq":1400,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711973+0000","last_change":"2024-03-18T14:47:17.525863+0000","last_active":"2024-03-18T14:47:24.711973+0000","last_peered":"2024-03-18T14:47:24.711973+0000","last_clean":"2024-03-18T14:47:24.711973+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:47:24.711973+0000","last_undegraded":"2024-03-18T14:47:24.711973+0000","last_fullsized":"2024-03-18T14:47:24.711973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1065,"log_dups_size":0,"ondisk_log_size":1065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:56.072166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":828,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711702+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:24.711702+0000","last_peered":"2024-03-18T14:47:24.711702+0000","last_clean":"2024-03-18T14:47:24.711702+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:24.711702+0000","last_undegraded":"2024-03-18T14:47:24.711702+0000","last_fullsized":"2024-03-18T14:47:24.711702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:39:48.937183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1060,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599482+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:25.599482+0000","last_peered":"2024-03-18T14:47:25.599482+0000","last_clean":"2024-03-18T14:47:25.599482+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:25.599482+0000","last_undegraded":"2024-03-18T14:47:25.599482+0000","last_fullsized":"2024-03-18T14:47:25.599482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:29.812802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":870,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601271+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:25.601271+0000","last_peered":"2024-03-18T14:47:25.601271+0000","last_clean":"2024-03-18T14:47:25.601271+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:25.601271+0000","last_undegraded":"2024-03-18T14:47:25.601271+0000","last_fullsized":"2024-03-18T14:47:25.601271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:39.311898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":168,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712400+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:24.712400+0000","last_peered":"2024-03-18T14:47:24.712400+0000","last_clean":"2024-03-18T14:47:24.712400+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:24.712400+0000","last_undegraded":"2024-03-18T14:47:24.712400+0000","last_fullsized":"2024-03-18T14:47:24.712400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:35.522315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":843,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600141+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:25.600141+0000","last_peered":"2024-03-18T14:47:25.600141+0000","last_clean":"2024-03-18T14:47:25.600141+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:25.600141+0000","last_undegraded":"2024-03-18T14:47:25.600141+0000","last_fullsized":"2024-03-18T14:47:25.600141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:49.603366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1687,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710369+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:24.710369+0000","last_peered":"2024-03-18T14:47:24.710369+0000","last_clean":"2024-03-18T14:47:24.710369+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:24.710369+0000","last_undegraded":"2024-03-18T14:47:24.710369+0000","last_fullsized":"2024-03-18T14:47:24.710369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:17.925829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1059,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599644+0000","last_change":"2024-03-18T14:47:17.520240+0000","last_active":"2024-03-18T14:47:25.599644+0000","last_peered":"2024-03-18T14:47:25.599644+0000","last_clean":"2024-03-18T14:47:25.599644+0000","last_became_active":"2024-03-18T14:47:17.500453+0000","last_became_peered":"2024-03-18T14:47:17.500453+0000","last_unstale":"2024-03-18T14:47:25.599644+0000","last_undegraded":"2024-03-18T14:47:25.599644+0000","last_fullsized":"2024-03-18T14:47:25.599644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:46:58.152840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":270,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.442911+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:27.442911+0000","last_peered":"2024-03-18T14:47:27.442911+0000","last_clean":"2024-03-18T14:47:27.442911+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:27.442911+0000","last_undegraded":"2024-03-18T14:47:27.442911+0000","last_fullsized":"2024-03-18T14:47:27.442911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:41:43.866840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1036,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712994+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:24.712994+0000","last_peered":"2024-03-18T14:47:24.712994+0000","last_clean":"2024-03-18T14:47:24.712994+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:24.712994+0000","last_undegraded":"2024-03-18T14:47:24.712994+0000","last_fullsized":"2024-03-18T14:47:24.712994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:35:56.481053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"41'649","reported_seq":693,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.444711+0000","last_change":"2024-03-18T14:47:17.462646+0000","last_active":"2024-03-18T14:47:27.444711+0000","last_peered":"2024-03-18T14:47:27.444711+0000","last_clean":"2024-03-18T14:47:27.444711+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:27.444711+0000","last_undegraded":"2024-03-18T14:47:27.444711+0000","last_fullsized":"2024-03-18T14:47:27.444711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:50:45.006365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":550,"num_write_kb":12564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":981,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710262+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:24.710262+0000","last_peered":"2024-03-18T14:47:24.710262+0000","last_clean":"2024-03-18T14:47:24.710262+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:24.710262+0000","last_undegraded":"2024-03-18T14:47:24.710262+0000","last_fullsized":"2024-03-18T14:47:24.710262+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:52.708252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":604,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438163+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:27.438163+0000","last_peered":"2024-03-18T14:47:27.438163+0000","last_clean":"2024-03-18T14:47:27.438163+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:27.438163+0000","last_undegraded":"2024-03-18T14:47:27.438163+0000","last_fullsized":"2024-03-18T14:47:27.438163+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:43.798941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":962,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600270+0000","last_change":"2024-03-18T14:47:17.501260+0000","last_active":"2024-03-18T14:47:25.600270+0000","last_peered":"2024-03-18T14:47:25.600270+0000","last_clean":"2024-03-18T14:47:25.600270+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:25.600270+0000","last_undegraded":"2024-03-18T14:47:25.600270+0000","last_fullsized":"2024-03-18T14:47:25.600270+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:36:10.259757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":216,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710584+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:24.710584+0000","last_peered":"2024-03-18T14:47:24.710584+0000","last_clean":"2024-03-18T14:47:24.710584+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:24.710584+0000","last_undegraded":"2024-03-18T14:47:24.710584+0000","last_fullsized":"2024-03-18T14:47:24.710584+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:39.571748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":941,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599738+0000","last_change":"2024-03-18T14:47:17.517604+0000","last_active":"2024-03-18T14:47:25.599738+0000","last_peered":"2024-03-18T14:47:25.599738+0000","last_clean":"2024-03-18T14:47:25.599738+0000","last_became_active":"2024-03-18T14:47:17.499159+0000","last_became_peered":"2024-03-18T14:47:17.499159+0000","last_unstale":"2024-03-18T14:47:25.599738+0000","last_undegraded":"2024-03-18T14:47:25.599738+0000","last_fullsized":"2024-03-18T14:47:25.599738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:46.541244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":413,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601164+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:25.601164+0000","last_peered":"2024-03-18T14:47:25.601164+0000","last_clean":"2024-03-18T14:47:25.601164+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:25.601164+0000","last_undegraded":"2024-03-18T14:47:25.601164+0000","last_fullsized":"2024-03-18T14:47:25.601164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:42:56.996927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":863,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711877+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:24.711877+0000","last_peered":"2024-03-18T14:47:24.711877+0000","last_clean":"2024-03-18T14:47:24.711877+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:24.711877+0000","last_undegraded":"2024-03-18T14:47:24.711877+0000","last_fullsized":"2024-03-18T14:47:24.711877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:25.242315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'179","reported_seq":224,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-03-18T14:47:37.523076+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:37.523076+0000","last_peered":"2024-03-18T14:47:37.523076+0000","last_clean":"2024-03-18T14:47:37.523076+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:37.523076+0000","last_undegraded":"2024-03-18T14:47:37.523076+0000","last_fullsized":"2024-03-18T14:47:37.523076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:07:56.947437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234466,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":65,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":841,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601638+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:25.601638+0000","last_peered":"2024-03-18T14:47:25.601638+0000","last_clean":"2024-03-18T14:47:25.601638+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:25.601638+0000","last_undegraded":"2024-03-18T14:47:25.601638+0000","last_fullsized":"2024-03-18T14:47:25.601638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:34.539270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":471,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712073+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:24.712073+0000","last_peered":"2024-03-18T14:47:24.712073+0000","last_clean":"2024-03-18T14:47:24.712073+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:24.712073+0000","last_undegraded":"2024-03-18T14:47:24.712073+0000","last_fullsized":"2024-03-18T14:47:24.712073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:04:36.022720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1021,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599768+0000","last_change":"2024-03-18T14:47:17.526444+0000","last_active":"2024-03-18T14:47:25.599768+0000","last_peered":"2024-03-18T14:47:25.599768+0000","last_clean":"2024-03-18T14:47:25.599768+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:25.599768+0000","last_undegraded":"2024-03-18T14:47:25.599768+0000","last_fullsized":"2024-03-18T14:47:25.599768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:00:50.279865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"19'403","reported_seq":446,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.446361+0000","last_change":"2024-03-18T14:47:14.577705+0000","last_active":"2024-03-18T14:47:27.446361+0000","last_peered":"2024-03-18T14:47:27.446361+0000","last_clean":"2024-03-18T14:47:27.446361+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:47:27.446361+0000","last_undegraded":"2024-03-18T14:47:27.446361+0000","last_fullsized":"2024-03-18T14:47:27.446361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:51.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":885,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712207+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:24.712207+0000","last_peered":"2024-03-18T14:47:24.712207+0000","last_clean":"2024-03-18T14:47:24.712207+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:24.712207+0000","last_undegraded":"2024-03-18T14:47:24.712207+0000","last_fullsized":"2024-03-18T14:47:24.712207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:30:31.608157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600602+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:25.600602+0000","last_peered":"2024-03-18T14:47:25.600602+0000","last_clean":"2024-03-18T14:47:25.600602+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:25.600602+0000","last_undegraded":"2024-03-18T14:47:25.600602+0000","last_fullsized":"2024-03-18T14:47:25.600602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:14.253020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":893,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710377+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:24.710377+0000","last_peered":"2024-03-18T14:47:24.710377+0000","last_clean":"2024-03-18T14:47:24.710377+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:24.710377+0000","last_undegraded":"2024-03-18T14:47:24.710377+0000","last_fullsized":"2024-03-18T14:47:24.710377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:47.789396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":184,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711104+0000","last_change":"2024-03-18T14:47:17.466422+0000","last_active":"2024-03-18T14:47:24.711104+0000","last_peered":"2024-03-18T14:47:24.711104+0000","last_clean":"2024-03-18T14:47:24.711104+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:47:24.711104+0000","last_undegraded":"2024-03-18T14:47:24.711104+0000","last_fullsized":"2024-03-18T14:47:24.711104+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:10:19.182704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":929,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711303+0000","last_change":"2024-03-18T14:47:13.619204+0000","last_active":"2024-03-18T14:47:24.711303+0000","last_peered":"2024-03-18T14:47:24.711303+0000","last_clean":"2024-03-18T14:47:24.711303+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:47:24.711303+0000","last_undegraded":"2024-03-18T14:47:24.711303+0000","last_fullsized":"2024-03-18T14:47:24.711303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:39:21.527951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":630,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600452+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:25.600452+0000","last_peered":"2024-03-18T14:47:25.600452+0000","last_clean":"2024-03-18T14:47:25.600452+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:25.600452+0000","last_undegraded":"2024-03-18T14:47:25.600452+0000","last_fullsized":"2024-03-18T14:47:25.600452+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:37:25.183875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711207+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:24.711207+0000","last_peered":"2024-03-18T14:47:24.711207+0000","last_clean":"2024-03-18T14:47:24.711207+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:24.711207+0000","last_undegraded":"2024-03-18T14:47:24.711207+0000","last_fullsized":"2024-03-18T14:47:24.711207+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:38.469515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":668,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600738+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:25.600738+0000","last_peered":"2024-03-18T14:47:25.600738+0000","last_clean":"2024-03-18T14:47:25.600738+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:25.600738+0000","last_undegraded":"2024-03-18T14:47:25.600738+0000","last_fullsized":"2024-03-18T14:47:25.600738+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:00.006597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":895,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600209+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:25.600209+0000","last_peered":"2024-03-18T14:47:25.600209+0000","last_clean":"2024-03-18T14:47:25.600209+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:25.600209+0000","last_undegraded":"2024-03-18T14:47:25.600209+0000","last_fullsized":"2024-03-18T14:47:25.600209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:16:52.413394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":330,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599505+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:25.599505+0000","last_peered":"2024-03-18T14:47:25.599505+0000","last_clean":"2024-03-18T14:47:25.599505+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:25.599505+0000","last_undegraded":"2024-03-18T14:47:25.599505+0000","last_fullsized":"2024-03-18T14:47:25.599505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:53:27.822024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":897,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710680+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:24.710680+0000","last_peered":"2024-03-18T14:47:24.710680+0000","last_clean":"2024-03-18T14:47:24.710680+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:24.710680+0000","last_undegraded":"2024-03-18T14:47:24.710680+0000","last_fullsized":"2024-03-18T14:47:24.710680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:10.087200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1566,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600008+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:25.600008+0000","last_peered":"2024-03-18T14:47:25.600008+0000","last_clean":"2024-03-18T14:47:25.600008+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:25.600008+0000","last_undegraded":"2024-03-18T14:47:25.600008+0000","last_fullsized":"2024-03-18T14:47:25.600008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:52.411814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":896,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713247+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:24.713247+0000","last_peered":"2024-03-18T14:47:24.713247+0000","last_clean":"2024-03-18T14:47:24.713247+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:24.713247+0000","last_undegraded":"2024-03-18T14:47:24.713247+0000","last_fullsized":"2024-03-18T14:47:24.713247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:17:38.760387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713126+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:24.713126+0000","last_peered":"2024-03-18T14:47:24.713126+0000","last_clean":"2024-03-18T14:47:24.713126+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:24.713126+0000","last_undegraded":"2024-03-18T14:47:24.713126+0000","last_fullsized":"2024-03-18T14:47:24.713126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:08:24.091327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"19'506","reported_seq":545,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710611+0000","last_change":"2024-03-18T14:47:17.486438+0000","last_active":"2024-03-18T14:47:24.710611+0000","last_peered":"2024-03-18T14:47:24.710611+0000","last_clean":"2024-03-18T14:47:24.710611+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:24.710611+0000","last_undegraded":"2024-03-18T14:47:24.710611+0000","last_fullsized":"2024-03-18T14:47:24.710611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:28.136764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712464+0000","last_change":"2024-03-18T14:47:17.515646+0000","last_active":"2024-03-18T14:47:24.712464+0000","last_peered":"2024-03-18T14:47:24.712464+0000","last_clean":"2024-03-18T14:47:24.712464+0000","last_became_active":"2024-03-18T14:47:17.510469+0000","last_became_peered":"2024-03-18T14:47:17.510469+0000","last_unstale":"2024-03-18T14:47:24.712464+0000","last_undegraded":"2024-03-18T14:47:24.712464+0000","last_fullsized":"2024-03-18T14:47:24.712464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:49:19.557030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600668+0000","last_change":"2024-03-18T14:47:17.467350+0000","last_active":"2024-03-18T14:47:25.600668+0000","last_peered":"2024-03-18T14:47:25.600668+0000","last_clean":"2024-03-18T14:47:25.600668+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:25.600668+0000","last_undegraded":"2024-03-18T14:47:25.600668+0000","last_fullsized":"2024-03-18T14:47:25.600668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:07.207360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":752,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710936+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:24.710936+0000","last_peered":"2024-03-18T14:47:24.710936+0000","last_clean":"2024-03-18T14:47:24.710936+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:24.710936+0000","last_undegraded":"2024-03-18T14:47:24.710936+0000","last_fullsized":"2024-03-18T14:47:24.710936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:37:31.708535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":938,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713044+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:24.713044+0000","last_peered":"2024-03-18T14:47:24.713044+0000","last_clean":"2024-03-18T14:47:24.713044+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:24.713044+0000","last_undegraded":"2024-03-18T14:47:24.713044+0000","last_fullsized":"2024-03-18T14:47:24.713044+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:37:37.504357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710256+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:24.710256+0000","last_peered":"2024-03-18T14:47:24.710256+0000","last_clean":"2024-03-18T14:47:24.710256+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:24.710256+0000","last_undegraded":"2024-03-18T14:47:24.710256+0000","last_fullsized":"2024-03-18T14:47:24.710256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:25.897430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":867,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712128+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:24.712128+0000","last_peered":"2024-03-18T14:47:24.712128+0000","last_clean":"2024-03-18T14:47:24.712128+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:24.712128+0000","last_undegraded":"2024-03-18T14:47:24.712128+0000","last_fullsized":"2024-03-18T14:47:24.712128+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:16:18.894217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":860,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713074+0000","last_change":"2024-03-18T14:47:13.602500+0000","last_active":"2024-03-18T14:47:24.713074+0000","last_peered":"2024-03-18T14:47:24.713074+0000","last_clean":"2024-03-18T14:47:24.713074+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:47:24.713074+0000","last_undegraded":"2024-03-18T14:47:24.713074+0000","last_fullsized":"2024-03-18T14:47:24.713074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:31.407968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600551+0000","last_change":"2024-03-18T14:47:17.464559+0000","last_active":"2024-03-18T14:47:25.600551+0000","last_peered":"2024-03-18T14:47:25.600551+0000","last_clean":"2024-03-18T14:47:25.600551+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:47:25.600551+0000","last_undegraded":"2024-03-18T14:47:25.600551+0000","last_fullsized":"2024-03-18T14:47:25.600551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:11:49.605341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":194,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711686+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:24.711686+0000","last_peered":"2024-03-18T14:47:24.711686+0000","last_clean":"2024-03-18T14:47:24.711686+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:24.711686+0000","last_undegraded":"2024-03-18T14:47:24.711686+0000","last_fullsized":"2024-03-18T14:47:24.711686+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:11.661520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"19'1013","reported_seq":1053,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599935+0000","last_change":"2024-03-18T14:47:17.466106+0000","last_active":"2024-03-18T14:47:25.599935+0000","last_peered":"2024-03-18T14:47:25.599935+0000","last_clean":"2024-03-18T14:47:25.599935+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:47:25.599935+0000","last_undegraded":"2024-03-18T14:47:25.599935+0000","last_fullsized":"2024-03-18T14:47:25.599935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1013,"log_dups_size":0,"ondisk_log_size":1013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:39:35.877210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":899,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600336+0000","last_change":"2024-03-18T14:47:17.516844+0000","last_active":"2024-03-18T14:47:25.600336+0000","last_peered":"2024-03-18T14:47:25.600336+0000","last_clean":"2024-03-18T14:47:25.600336+0000","last_became_active":"2024-03-18T14:47:17.474440+0000","last_became_peered":"2024-03-18T14:47:17.474440+0000","last_unstale":"2024-03-18T14:47:25.600336+0000","last_undegraded":"2024-03-18T14:47:25.600336+0000","last_fullsized":"2024-03-18T14:47:25.600336+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:50.042382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600216+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:25.600216+0000","last_peered":"2024-03-18T14:47:25.600216+0000","last_clean":"2024-03-18T14:47:25.600216+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:25.600216+0000","last_undegraded":"2024-03-18T14:47:25.600216+0000","last_fullsized":"2024-03-18T14:47:25.600216+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:22.621261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1007,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710133+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:24.710133+0000","last_peered":"2024-03-18T14:47:24.710133+0000","last_clean":"2024-03-18T14:47:24.710133+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:24.710133+0000","last_undegraded":"2024-03-18T14:47:24.710133+0000","last_fullsized":"2024-03-18T14:47:24.710133+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:17:25.052268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1022,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711613+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:24.711613+0000","last_peered":"2024-03-18T14:47:24.711613+0000","last_clean":"2024-03-18T14:47:24.711613+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:24.711613+0000","last_undegraded":"2024-03-18T14:47:24.711613+0000","last_fullsized":"2024-03-18T14:47:24.711613+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:15.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600090+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:25.600090+0000","last_peered":"2024-03-18T14:47:25.600090+0000","last_clean":"2024-03-18T14:47:25.600090+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:25.600090+0000","last_undegraded":"2024-03-18T14:47:25.600090+0000","last_fullsized":"2024-03-18T14:47:25.600090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:20:29.466916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":490,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713357+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:24.713357+0000","last_peered":"2024-03-18T14:47:24.713357+0000","last_clean":"2024-03-18T14:47:24.713357+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:24.713357+0000","last_undegraded":"2024-03-18T14:47:24.713357+0000","last_fullsized":"2024-03-18T14:47:24.713357+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:10.587043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":898,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711061+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:24.711061+0000","last_peered":"2024-03-18T14:47:24.711061+0000","last_clean":"2024-03-18T14:47:24.711061+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:24.711061+0000","last_undegraded":"2024-03-18T14:47:24.711061+0000","last_fullsized":"2024-03-18T14:47:24.711061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:34:28.347158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":551,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.447037+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:27.447037+0000","last_peered":"2024-03-18T14:47:27.447037+0000","last_clean":"2024-03-18T14:47:27.447037+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:27.447037+0000","last_undegraded":"2024-03-18T14:47:27.447037+0000","last_fullsized":"2024-03-18T14:47:27.447037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:44:43.602706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712854+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:24.712854+0000","last_peered":"2024-03-18T14:47:24.712854+0000","last_clean":"2024-03-18T14:47:24.712854+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:24.712854+0000","last_undegraded":"2024-03-18T14:47:24.712854+0000","last_fullsized":"2024-03-18T14:47:24.712854+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:34:09.282290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1037,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599643+0000","last_change":"2024-03-18T14:47:17.527392+0000","last_active":"2024-03-18T14:47:25.599643+0000","last_peered":"2024-03-18T14:47:25.599643+0000","last_clean":"2024-03-18T14:47:25.599643+0000","last_became_active":"2024-03-18T14:47:17.506738+0000","last_became_peered":"2024-03-18T14:47:17.506738+0000","last_unstale":"2024-03-18T14:47:25.599643+0000","last_undegraded":"2024-03-18T14:47:25.599643+0000","last_fullsized":"2024-03-18T14:47:25.599643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:31.804307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601639+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:25.601639+0000","last_peered":"2024-03-18T14:47:25.601639+0000","last_clean":"2024-03-18T14:47:25.601639+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:25.601639+0000","last_undegraded":"2024-03-18T14:47:25.601639+0000","last_fullsized":"2024-03-18T14:47:25.601639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:09.003093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":704,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:28.486202+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:28.486202+0000","last_peered":"2024-03-18T14:47:28.486202+0000","last_clean":"2024-03-18T14:47:28.486202+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:28.486202+0000","last_undegraded":"2024-03-18T14:47:28.486202+0000","last_fullsized":"2024-03-18T14:47:28.486202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:13.104302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":920,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710173+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:24.710173+0000","last_peered":"2024-03-18T14:47:24.710173+0000","last_clean":"2024-03-18T14:47:24.710173+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:24.710173+0000","last_undegraded":"2024-03-18T14:47:24.710173+0000","last_fullsized":"2024-03-18T14:47:24.710173+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:07:41.697938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":170,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.711152+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:24.711152+0000","last_peered":"2024-03-18T14:47:24.711152+0000","last_clean":"2024-03-18T14:47:24.711152+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:24.711152+0000","last_undegraded":"2024-03-18T14:47:24.711152+0000","last_fullsized":"2024-03-18T14:47:24.711152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:27:07.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":951,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710607+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:24.710607+0000","last_peered":"2024-03-18T14:47:24.710607+0000","last_clean":"2024-03-18T14:47:24.710607+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:24.710607+0000","last_undegraded":"2024-03-18T14:47:24.710607+0000","last_fullsized":"2024-03-18T14:47:24.710607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:23:44.982477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":427,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.445460+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:27.445460+0000","last_peered":"2024-03-18T14:47:27.445460+0000","last_clean":"2024-03-18T14:47:27.445460+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:27.445460+0000","last_undegraded":"2024-03-18T14:47:27.445460+0000","last_fullsized":"2024-03-18T14:47:27.445460+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:19:30.025913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":838,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710407+0000","last_change":"2024-03-18T14:47:17.506009+0000","last_active":"2024-03-18T14:47:24.710407+0000","last_peered":"2024-03-18T14:47:24.710407+0000","last_clean":"2024-03-18T14:47:24.710407+0000","last_became_active":"2024-03-18T14:47:17.495832+0000","last_became_peered":"2024-03-18T14:47:17.495832+0000","last_unstale":"2024-03-18T14:47:24.710407+0000","last_undegraded":"2024-03-18T14:47:24.710407+0000","last_fullsized":"2024-03-18T14:47:24.710407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:56:05.823238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":680,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.443865+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:27.443865+0000","last_peered":"2024-03-18T14:47:27.443865+0000","last_clean":"2024-03-18T14:47:27.443865+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:27.443865+0000","last_undegraded":"2024-03-18T14:47:27.443865+0000","last_fullsized":"2024-03-18T14:47:27.443865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:39.494925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":892,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710187+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:24.710187+0000","last_peered":"2024-03-18T14:47:24.710187+0000","last_clean":"2024-03-18T14:47:24.710187+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:24.710187+0000","last_undegraded":"2024-03-18T14:47:24.710187+0000","last_fullsized":"2024-03-18T14:47:24.710187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:26:07.113196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":523,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.601185+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:25.601185+0000","last_peered":"2024-03-18T14:47:25.601185+0000","last_clean":"2024-03-18T14:47:25.601185+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:25.601185+0000","last_undegraded":"2024-03-18T14:47:25.601185+0000","last_fullsized":"2024-03-18T14:47:25.601185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:00:02.049791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":884,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600747+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:25.600747+0000","last_peered":"2024-03-18T14:47:25.600747+0000","last_clean":"2024-03-18T14:47:25.600747+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:25.600747+0000","last_undegraded":"2024-03-18T14:47:25.600747+0000","last_fullsized":"2024-03-18T14:47:25.600747+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:01:53.435354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":255,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:27.438993+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:27.438993+0000","last_peered":"2024-03-18T14:47:27.438993+0000","last_clean":"2024-03-18T14:47:27.438993+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:27.438993+0000","last_undegraded":"2024-03-18T14:47:27.438993+0000","last_fullsized":"2024-03-18T14:47:27.438993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:01.845375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1000,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710130+0000","last_change":"2024-03-18T14:47:14.623750+0000","last_active":"2024-03-18T14:47:24.710130+0000","last_peered":"2024-03-18T14:47:24.710130+0000","last_clean":"2024-03-18T14:47:24.710130+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:47:24.710130+0000","last_undegraded":"2024-03-18T14:47:24.710130+0000","last_fullsized":"2024-03-18T14:47:24.710130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:15:31.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1092,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.712058+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:24.712058+0000","last_peered":"2024-03-18T14:47:24.712058+0000","last_clean":"2024-03-18T14:47:24.712058+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:24.712058+0000","last_undegraded":"2024-03-18T14:47:24.712058+0000","last_fullsized":"2024-03-18T14:47:24.712058+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:53:48.500177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1008,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.600538+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:25.600538+0000","last_peered":"2024-03-18T14:47:25.600538+0000","last_clean":"2024-03-18T14:47:25.600538+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:25.600538+0000","last_undegraded":"2024-03-18T14:47:25.600538+0000","last_fullsized":"2024-03-18T14:47:25.600538+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:05:40.271326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":921,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.710638+0000","last_change":"2024-03-18T14:47:17.489843+0000","last_active":"2024-03-18T14:47:24.710638+0000","last_peered":"2024-03-18T14:47:24.710638+0000","last_clean":"2024-03-18T14:47:24.710638+0000","last_became_active":"2024-03-18T14:47:17.466778+0000","last_became_peered":"2024-03-18T14:47:17.466778+0000","last_unstale":"2024-03-18T14:47:24.710638+0000","last_undegraded":"2024-03-18T14:47:24.710638+0000","last_fullsized":"2024-03-18T14:47:24.710638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:16:45.800854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":917,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:25.599923+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:25.599923+0000","last_peered":"2024-03-18T14:47:25.599923+0000","last_clean":"2024-03-18T14:47:25.599923+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:25.599923+0000","last_undegraded":"2024-03-18T14:47:25.599923+0000","last_fullsized":"2024-03-18T14:47:25.599923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:05:04.326061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":882,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-03-18T14:47:24.713347+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:24.713347+0000","last_peered":"2024-03-18T14:47:24.713347+0000","last_clean":"2024-03-18T14:47:24.713347+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:24.713347+0000","last_undegraded":"2024-03-18T14:47:24.713347+0000","last_fullsized":"2024-03-18T14:47:24.713347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:49:20.283288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159318,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16063,"num_write_kb":262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274318636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19635,"ondisk_log_size":19635,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953481,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413524,"kb_used_data":95884,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958316,"statfs":{"total":96636764160,"available":96213315584,"internally_reserved":0,"allocated":98185216,"data_stored":97948187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]},{"osd":2,"up_from":30,"seq":128849018890,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379172,"kb_used_data":62940,"kb_used_omap":7,"kb_used_meta":316216,"kb_avail":93992668,"statfs":{"total":96636764160,"available":96248492032,"internally_reserved":0,"allocated":64450560,"data_stored":64239853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323805723},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084298,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":372468,"kb_used_data":59884,"kb_used_omap":241,"kb_used_meta":312334,"kb_avail":93999372,"statfs":{"total":96636764160,"available":96255356928,"internally_reserved":0,"allocated":61321216,"data_stored":61095214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":319830688},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051594,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367740,"kb_used_data":51828,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004100,"statfs":{"total":96636764160,"available":96260198400,"internally_reserved":0,"allocated":53071872,"data_stored":52858874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52107817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.363 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.364 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.365 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.366 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.367 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.368 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.369 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.370 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T14:40:57.398555+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.371 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.372 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.373 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.374 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.374 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.374 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:47:54.374 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:48:14.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:48:14.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.511+0000 7fe17222a700 1 Processor -- start 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.511+0000 7fe17222a700 1 -- start start 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.511+0000 7fe17222a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 0x7fe16c0aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.511+0000 7fe17222a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 0x7fe16c141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe17222a700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16c1419d0 con 0x7fe16c142500 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe17222a700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c0aaa80 con 0x7fe16c0a8a80 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe17222a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0a7400 con 0x7fe16c063f60 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 0x7fe16c0aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16affd700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 0x7fe16c141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe16c142500 0x7fe16c0a53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54998/0 (socket says 172.21.15.57:54998) 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16bfff700 1 -- 172.21.15.57:0/3700821860 learned_addr learned my addr 172.21.15.57:0/3700821860 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3700821860 >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 msgr2=0x7fe16c141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:48:14.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 --2- 172.21.15.57:0/3700821860 >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 0x7fe16c141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3700821860 >> v1:172.21.15.57:6789/0 conn(0x7fe16c142500 legacy=0x7fe16c0a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3700821860 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c0a8e70 con 0x7fe16c063f60 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16a7fc700 1 -- 172.21.15.57:0/3700821860 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463386547 0 0) 0x7fe16c1419d0 con 0x7fe16c142500 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16affd700 1 --2- 172.21.15.57:0/3700821860 >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 0x7fe16c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16b7fe700 1 --2- 172.21.15.57:0/3700821860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 0x7fe16c0aa440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0098e0 tx=0x7fe15c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=976fa4a9678abc60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16a7fc700 1 -- 172.21.15.57:0/3700821860 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00b640 con 0x7fe16c063f60 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16a7fc700 1 -- 172.21.15.57:0/3700821860 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c00b7a0 con 0x7fe16c063f60 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.512+0000 7fe16a7fc700 1 -- 172.21.15.57:0/3700821860 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00bb40 con 0x7fe16c063f60 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 -- 172.21.15.57:0/3700821860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 msgr2=0x7fe16c0aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 --2- 172.21.15.57:0/3700821860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 0x7fe16c0aa440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0098e0 tx=0x7fe15c0091a0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 -- 172.21.15.57:0/3700821860 shutdown_connections 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 --2- 172.21.15.57:0/3700821860 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c063f60 0x7fe16c0aa440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 --2- 172.21.15.57:0/3700821860 >> v2:172.21.15.57:3300/0 conn(0x7fe16c0a8a80 0x7fe16c141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 -- 172.21.15.57:0/3700821860 >> 172.21.15.57:0/3700821860 conn(0x7fe16c087fe0 msgr2=0x7fe16c063600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 -- 172.21.15.57:0/3700821860 shutdown_connections 2024-03-18T14:48:14.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.513+0000 7fe17222a700 1 -- 172.21.15.57:0/3700821860 wait complete. 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.514+0000 7fe17222a700 1 Processor -- start 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.514+0000 7fe17222a700 1 -- start start 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 0x7fe16c151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c097b60 con 0x7fe16c0a8a80 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0add70 con 0x7fe16c142500 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c0b13f0 con 0x7fe16c063f60 2024-03-18T14:48:14.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 0x7fe16c151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16affd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44714/0 (socket says 172.21.15.57:44714) 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16affd700 1 -- 172.21.15.57:0/3960944011 learned_addr learned my addr 172.21.15.57:0/3960944011 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:60864/0 (socket says 172.21.15.57:60864) 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 msgr2=0x7fe16c151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 0x7fe16c151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 msgr2=0x7fe16c151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 -- 172.21.15.57:0/3960944011 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160009420 con 0x7fe16c063f60 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16affd700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16bfff700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 0x7fe16c151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe16b7fe700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0685a0 tx=0x7fe15c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00bb20 con 0x7fe16c063f60 2024-03-18T14:48:14.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c000c90 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.515+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c009420 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.516+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c011630 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.516+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c0afa80 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.516+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 10) v1 ==== 53592+0+0 (secure 0 0 0) 0x7fe15c0119e0 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.516+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c098750 con 0x7fe16c063f60 2024-03-18T14:48:14.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.517+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7fe15c05c6a0 con 0x7fe16c063f60 2024-03-18T14:48:14.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.520+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fe15c03e3a0 con 0x7fe16c063f60 2024-03-18T14:48:14.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.680+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe16c0648f0 con 0x7fe158046010 2024-03-18T14:48:14.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.687+0000 7fe1537fe700 1 -- 172.21.15.57:0/3960944011 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270941 (unknown 2965378022 0 1037868973) 0x7fe16c0648f0 con 0x7fe158046010 2024-03-18T14:48:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 >> v1:172.21.15.57:6816/47480 conn(0x7fe158046010 legacy=0x7fe1580484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 msgr2=0x7fe16c0b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0685a0 tx=0x7fe15c017000 comp rx=0 tx=0).stop 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 shutdown_connections 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe16c142500 0x7fe16c151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe16c063f60 0x7fe16c0b0a60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 --2- 172.21.15.57:0/3960944011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe16c0a8a80 0x7fe16c151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 >> 172.21.15.57:0/3960944011 conn(0x7fe16c087fe0 msgr2=0x7fe16c140520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 shutdown_connections 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:14.690+0000 7fe17222a700 1 -- 172.21.15.57:0/3960944011 wait complete. 2024-03-18T14:48:14.693 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:48:14.702 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-03-18T14:48:13.562476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749686,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65074,"num_write_kb":8749062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71485,"ondisk_log_size":71485,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-366,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1271,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002710"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":933,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416571+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:59.416571+0000","last_peered":"2024-03-18T14:47:59.416571+0000","last_clean":"2024-03-18T14:47:59.416571+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:59.416571+0000","last_undegraded":"2024-03-18T14:47:59.416571+0000","last_fullsized":"2024-03-18T14:47:59.416571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416446+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:59.416446+0000","last_peered":"2024-03-18T14:47:59.416446+0000","last_clean":"2024-03-18T14:47:59.416446+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:59.416446+0000","last_undegraded":"2024-03-18T14:47:59.416446+0000","last_fullsized":"2024-03-18T14:47:59.416446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":912,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434040+0000","last_change":"2024-03-18T14:47:17.507358+0000","last_active":"2024-03-18T14:47:59.434040+0000","last_peered":"2024-03-18T14:47:59.434040+0000","last_clean":"2024-03-18T14:47:59.434040+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:47:59.434040+0000","last_undegraded":"2024-03-18T14:47:59.434040+0000","last_fullsized":"2024-03-18T14:47:59.434040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":965,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434812+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:59.434812+0000","last_peered":"2024-03-18T14:47:59.434812+0000","last_clean":"2024-03-18T14:47:59.434812+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:59.434812+0000","last_undegraded":"2024-03-18T14:47:59.434812+0000","last_fullsized":"2024-03-18T14:47:59.434812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":812,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417324+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:59.417324+0000","last_peered":"2024-03-18T14:47:59.417324+0000","last_clean":"2024-03-18T14:47:59.417324+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:59.417324+0000","last_undegraded":"2024-03-18T14:47:59.417324+0000","last_fullsized":"2024-03-18T14:47:59.417324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":955,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416653+0000","last_change":"2024-03-18T14:47:17.490338+0000","last_active":"2024-03-18T14:47:59.416653+0000","last_peered":"2024-03-18T14:47:59.416653+0000","last_clean":"2024-03-18T14:47:59.416653+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:47:59.416653+0000","last_undegraded":"2024-03-18T14:47:59.416653+0000","last_fullsized":"2024-03-18T14:47:59.416653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":814,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418705+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:59.418705+0000","last_peered":"2024-03-18T14:47:59.418705+0000","last_clean":"2024-03-18T14:47:59.418705+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:59.418705+0000","last_undegraded":"2024-03-18T14:47:59.418705+0000","last_fullsized":"2024-03-18T14:47:59.418705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":841,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419370+0000","last_change":"2024-03-18T14:47:17.496999+0000","last_active":"2024-03-18T14:47:59.419370+0000","last_peered":"2024-03-18T14:47:59.419370+0000","last_clean":"2024-03-18T14:47:59.419370+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:47:59.419370+0000","last_undegraded":"2024-03-18T14:47:59.419370+0000","last_fullsized":"2024-03-18T14:47:59.419370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":895,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419108+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:59.419108+0000","last_peered":"2024-03-18T14:47:59.419108+0000","last_clean":"2024-03-18T14:47:59.419108+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:59.419108+0000","last_undegraded":"2024-03-18T14:47:59.419108+0000","last_fullsized":"2024-03-18T14:47:59.419108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1016,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417272+0000","last_change":"2024-03-18T14:47:14.614014+0000","last_active":"2024-03-18T14:47:59.417272+0000","last_peered":"2024-03-18T14:47:59.417272+0000","last_clean":"2024-03-18T14:47:59.417272+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:47:59.417272+0000","last_undegraded":"2024-03-18T14:47:59.417272+0000","last_fullsized":"2024-03-18T14:47:59.417272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":891,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433431+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:59.433431+0000","last_peered":"2024-03-18T14:47:59.433431+0000","last_clean":"2024-03-18T14:47:59.433431+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:59.433431+0000","last_undegraded":"2024-03-18T14:47:59.433431+0000","last_fullsized":"2024-03-18T14:47:59.433431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1020,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416896+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:59.416896+0000","last_peered":"2024-03-18T14:47:59.416896+0000","last_clean":"2024-03-18T14:47:59.416896+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:59.416896+0000","last_undegraded":"2024-03-18T14:47:59.416896+0000","last_fullsized":"2024-03-18T14:47:59.416896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1019,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416922+0000","last_change":"2024-03-18T14:47:14.612368+0000","last_active":"2024-03-18T14:47:59.416922+0000","last_peered":"2024-03-18T14:47:59.416922+0000","last_clean":"2024-03-18T14:47:59.416922+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:47:59.416922+0000","last_undegraded":"2024-03-18T14:47:59.416922+0000","last_fullsized":"2024-03-18T14:47:59.416922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1008,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419567+0000","last_change":"2024-03-18T14:47:17.509587+0000","last_active":"2024-03-18T14:47:59.419567+0000","last_peered":"2024-03-18T14:47:59.419567+0000","last_clean":"2024-03-18T14:47:59.419567+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:47:59.419567+0000","last_undegraded":"2024-03-18T14:47:59.419567+0000","last_fullsized":"2024-03-18T14:47:59.419567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1037,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417454+0000","last_change":"2024-03-18T14:47:17.498088+0000","last_active":"2024-03-18T14:47:59.417454+0000","last_peered":"2024-03-18T14:47:59.417454+0000","last_clean":"2024-03-18T14:47:59.417454+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:47:59.417454+0000","last_undegraded":"2024-03-18T14:47:59.417454+0000","last_fullsized":"2024-03-18T14:47:59.417454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":899,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418421+0000","last_change":"2024-03-18T14:47:13.597320+0000","last_active":"2024-03-18T14:47:59.418421+0000","last_peered":"2024-03-18T14:47:59.418421+0000","last_clean":"2024-03-18T14:47:59.418421+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:47:59.418421+0000","last_undegraded":"2024-03-18T14:47:59.418421+0000","last_fullsized":"2024-03-18T14:47:59.418421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1027,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434085+0000","last_change":"2024-03-18T14:47:17.526975+0000","last_active":"2024-03-18T14:47:59.434085+0000","last_peered":"2024-03-18T14:47:59.434085+0000","last_clean":"2024-03-18T14:47:59.434085+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:47:59.434085+0000","last_undegraded":"2024-03-18T14:47:59.434085+0000","last_fullsized":"2024-03-18T14:47:59.434085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":944,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417218+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:59.417218+0000","last_peered":"2024-03-18T14:47:59.417218+0000","last_clean":"2024-03-18T14:47:59.417218+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:59.417218+0000","last_undegraded":"2024-03-18T14:47:59.417218+0000","last_fullsized":"2024-03-18T14:47:59.417218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":974,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418177+0000","last_change":"2024-03-18T14:47:17.483443+0000","last_active":"2024-03-18T14:47:59.418177+0000","last_peered":"2024-03-18T14:47:59.418177+0000","last_clean":"2024-03-18T14:47:59.418177+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:47:59.418177+0000","last_undegraded":"2024-03-18T14:47:59.418177+0000","last_fullsized":"2024-03-18T14:47:59.418177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419559+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:59.419559+0000","last_peered":"2024-03-18T14:47:59.419559+0000","last_clean":"2024-03-18T14:47:59.419559+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:59.419559+0000","last_undegraded":"2024-03-18T14:47:59.419559+0000","last_fullsized":"2024-03-18T14:47:59.419559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1490","reported_seq":1537,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417455+0000","last_change":"2024-03-18T14:47:14.606929+0000","last_active":"2024-03-18T14:47:59.417455+0000","last_peered":"2024-03-18T14:47:59.417455+0000","last_clean":"2024-03-18T14:47:59.417455+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:47:59.417455+0000","last_undegraded":"2024-03-18T14:47:59.417455+0000","last_fullsized":"2024-03-18T14:47:59.417455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1490,"log_dups_size":0,"ondisk_log_size":1490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.435209+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:59.435209+0000","last_peered":"2024-03-18T14:47:59.435209+0000","last_clean":"2024-03-18T14:47:59.435209+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:59.435209+0000","last_undegraded":"2024-03-18T14:47:59.435209+0000","last_fullsized":"2024-03-18T14:47:59.435209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":836,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417234+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:59.417234+0000","last_peered":"2024-03-18T14:47:59.417234+0000","last_clean":"2024-03-18T14:47:59.417234+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:59.417234+0000","last_undegraded":"2024-03-18T14:47:59.417234+0000","last_fullsized":"2024-03-18T14:47:59.417234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"19'1015","reported_seq":1068,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433656+0000","last_change":"2024-03-18T14:47:17.463768+0000","last_active":"2024-03-18T14:47:59.433656+0000","last_peered":"2024-03-18T14:47:59.433656+0000","last_clean":"2024-03-18T14:47:59.433656+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:47:59.433656+0000","last_undegraded":"2024-03-18T14:47:59.433656+0000","last_fullsized":"2024-03-18T14:47:59.433656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":878,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434381+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:59.434381+0000","last_peered":"2024-03-18T14:47:59.434381+0000","last_clean":"2024-03-18T14:47:59.434381+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:59.434381+0000","last_undegraded":"2024-03-18T14:47:59.434381+0000","last_fullsized":"2024-03-18T14:47:59.434381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":176,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416833+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:59.416833+0000","last_peered":"2024-03-18T14:47:59.416833+0000","last_clean":"2024-03-18T14:47:59.416833+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:59.416833+0000","last_undegraded":"2024-03-18T14:47:59.416833+0000","last_fullsized":"2024-03-18T14:47:59.416833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":851,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433617+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:59.433617+0000","last_peered":"2024-03-18T14:47:59.433617+0000","last_clean":"2024-03-18T14:47:59.433617+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:59.433617+0000","last_undegraded":"2024-03-18T14:47:59.433617+0000","last_fullsized":"2024-03-18T14:47:59.433617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419697+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:59.419697+0000","last_peered":"2024-03-18T14:47:59.419697+0000","last_clean":"2024-03-18T14:47:59.419697+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:59.419697+0000","last_undegraded":"2024-03-18T14:47:59.419697+0000","last_fullsized":"2024-03-18T14:47:59.419697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":278,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416786+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:59.416786+0000","last_peered":"2024-03-18T14:47:59.416786+0000","last_clean":"2024-03-18T14:47:59.416786+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:59.416786+0000","last_undegraded":"2024-03-18T14:47:59.416786+0000","last_fullsized":"2024-03-18T14:47:59.416786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417633+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:59.417633+0000","last_peered":"2024-03-18T14:47:59.417633+0000","last_clean":"2024-03-18T14:47:59.417633+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:59.417633+0000","last_undegraded":"2024-03-18T14:47:59.417633+0000","last_fullsized":"2024-03-18T14:47:59.417633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"44'655","reported_seq":717,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434065+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:47:59.434065+0000","last_peered":"2024-03-18T14:47:59.434065+0000","last_clean":"2024-03-18T14:47:59.434065+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:47:59.434065+0000","last_undegraded":"2024-03-18T14:47:59.434065+0000","last_fullsized":"2024-03-18T14:47:59.434065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":655,"log_dups_size":0,"ondisk_log_size":655,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":550,"num_write_kb":12564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":989,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419017+0000","last_change":"2024-03-18T14:47:17.512580+0000","last_active":"2024-03-18T14:47:59.419017+0000","last_peered":"2024-03-18T14:47:59.419017+0000","last_clean":"2024-03-18T14:47:59.419017+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:47:59.419017+0000","last_undegraded":"2024-03-18T14:47:59.419017+0000","last_fullsized":"2024-03-18T14:47:59.419017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":612,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434309+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:59.434309+0000","last_peered":"2024-03-18T14:47:59.434309+0000","last_clean":"2024-03-18T14:47:59.434309+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:59.434309+0000","last_undegraded":"2024-03-18T14:47:59.434309+0000","last_fullsized":"2024-03-18T14:47:59.434309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"19'176","reported_seq":224,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416228+0000","last_change":"2024-03-18T14:47:17.468338+0000","last_active":"2024-03-18T14:47:59.416228+0000","last_peered":"2024-03-18T14:47:59.416228+0000","last_clean":"2024-03-18T14:47:59.416228+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:47:59.416228+0000","last_undegraded":"2024-03-18T14:47:59.416228+0000","last_fullsized":"2024-03-18T14:47:59.416228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":176,"log_dups_size":0,"ondisk_log_size":176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":421,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433925+0000","last_change":"2024-03-18T14:47:17.463823+0000","last_active":"2024-03-18T14:47:59.433925+0000","last_peered":"2024-03-18T14:47:59.433925+0000","last_clean":"2024-03-18T14:47:59.433925+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:47:59.433925+0000","last_undegraded":"2024-03-18T14:47:59.433925+0000","last_fullsized":"2024-03-18T14:47:59.433925+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":871,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417341+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:59.417341+0000","last_peered":"2024-03-18T14:47:59.417341+0000","last_clean":"2024-03-18T14:47:59.417341+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:59.417341+0000","last_undegraded":"2024-03-18T14:47:59.417341+0000","last_fullsized":"2024-03-18T14:47:59.417341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"42'179","reported_seq":232,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417569+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:47:59.417569+0000","last_peered":"2024-03-18T14:47:59.417569+0000","last_clean":"2024-03-18T14:47:59.417569+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:47:59.417569+0000","last_undegraded":"2024-03-18T14:47:59.417569+0000","last_fullsized":"2024-03-18T14:47:59.417569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234466,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":65,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":849,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433799+0000","last_change":"2024-03-18T14:47:17.505773+0000","last_active":"2024-03-18T14:47:59.433799+0000","last_peered":"2024-03-18T14:47:59.433799+0000","last_clean":"2024-03-18T14:47:59.433799+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:47:59.433799+0000","last_undegraded":"2024-03-18T14:47:59.433799+0000","last_fullsized":"2024-03-18T14:47:59.433799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'432","reported_seq":479,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416446+0000","last_change":"2024-03-18T14:47:13.588882+0000","last_active":"2024-03-18T14:47:59.416446+0000","last_peered":"2024-03-18T14:47:59.416446+0000","last_clean":"2024-03-18T14:47:59.416446+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:47:59.416446+0000","last_undegraded":"2024-03-18T14:47:59.416446+0000","last_fullsized":"2024-03-18T14:47:59.416446+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418110+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:59.418110+0000","last_peered":"2024-03-18T14:47:59.418110+0000","last_clean":"2024-03-18T14:47:59.418110+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:59.418110+0000","last_undegraded":"2024-03-18T14:47:59.418110+0000","last_fullsized":"2024-03-18T14:47:59.418110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"19'852","reported_seq":901,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434554+0000","last_change":"2024-03-18T14:47:17.515966+0000","last_active":"2024-03-18T14:47:59.434554+0000","last_peered":"2024-03-18T14:47:59.434554+0000","last_clean":"2024-03-18T14:47:59.434554+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:47:59.434554+0000","last_undegraded":"2024-03-18T14:47:59.434554+0000","last_fullsized":"2024-03-18T14:47:59.434554+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":852,"log_dups_size":0,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":901,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419732+0000","last_change":"2024-03-18T14:47:17.502650+0000","last_active":"2024-03-18T14:47:59.419732+0000","last_peered":"2024-03-18T14:47:59.419732+0000","last_clean":"2024-03-18T14:47:59.419732+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:47:59.419732+0000","last_undegraded":"2024-03-18T14:47:59.419732+0000","last_fullsized":"2024-03-18T14:47:59.419732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":638,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434424+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:59.434424+0000","last_peered":"2024-03-18T14:47:59.434424+0000","last_clean":"2024-03-18T14:47:59.434424+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:59.434424+0000","last_undegraded":"2024-03-18T14:47:59.434424+0000","last_fullsized":"2024-03-18T14:47:59.434424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1015,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416477+0000","last_change":"2024-03-18T14:47:17.491899+0000","last_active":"2024-03-18T14:47:59.416477+0000","last_peered":"2024-03-18T14:47:59.416477+0000","last_clean":"2024-03-18T14:47:59.416477+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:47:59.416477+0000","last_undegraded":"2024-03-18T14:47:59.416477+0000","last_fullsized":"2024-03-18T14:47:59.416477+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":676,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433642+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:59.433642+0000","last_peered":"2024-03-18T14:47:59.433642+0000","last_clean":"2024-03-18T14:47:59.433642+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:59.433642+0000","last_undegraded":"2024-03-18T14:47:59.433642+0000","last_fullsized":"2024-03-18T14:47:59.433642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":903,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434958+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:59.434958+0000","last_peered":"2024-03-18T14:47:59.434958+0000","last_clean":"2024-03-18T14:47:59.434958+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:59.434958+0000","last_undegraded":"2024-03-18T14:47:59.434958+0000","last_fullsized":"2024-03-18T14:47:59.434958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":338,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434883+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:59.434883+0000","last_peered":"2024-03-18T14:47:59.434883+0000","last_clean":"2024-03-18T14:47:59.434883+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:59.434883+0000","last_undegraded":"2024-03-18T14:47:59.434883+0000","last_fullsized":"2024-03-18T14:47:59.434883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":905,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.420032+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:59.420032+0000","last_peered":"2024-03-18T14:47:59.420032+0000","last_clean":"2024-03-18T14:47:59.420032+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:59.420032+0000","last_undegraded":"2024-03-18T14:47:59.420032+0000","last_fullsized":"2024-03-18T14:47:59.420032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"19'1526","reported_seq":1574,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433372+0000","last_change":"2024-03-18T14:47:17.526183+0000","last_active":"2024-03-18T14:47:59.433372+0000","last_peered":"2024-03-18T14:47:59.433372+0000","last_clean":"2024-03-18T14:47:59.433372+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:47:59.433372+0000","last_undegraded":"2024-03-18T14:47:59.433372+0000","last_fullsized":"2024-03-18T14:47:59.433372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1526,"log_dups_size":0,"ondisk_log_size":1526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418494+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:59.418494+0000","last_peered":"2024-03-18T14:47:59.418494+0000","last_clean":"2024-03-18T14:47:59.418494+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:59.418494+0000","last_undegraded":"2024-03-18T14:47:59.418494+0000","last_fullsized":"2024-03-18T14:47:59.418494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417375+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:59.417375+0000","last_peered":"2024-03-18T14:47:59.417375+0000","last_clean":"2024-03-18T14:47:59.417375+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:59.417375+0000","last_undegraded":"2024-03-18T14:47:59.417375+0000","last_fullsized":"2024-03-18T14:47:59.417375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1652,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417672+0000","last_change":"2024-03-18T14:47:58.524766+0000","last_active":"2024-03-18T14:47:59.417672+0000","last_peered":"2024-03-18T14:47:59.417672+0000","last_clean":"2024-03-18T14:47:59.417672+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:47:59.417672+0000","last_undegraded":"2024-03-18T14:47:59.417672+0000","last_fullsized":"2024-03-18T14:47:59.417672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'712","reported_seq":760,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416663+0000","last_change":"2024-03-18T14:47:14.619361+0000","last_active":"2024-03-18T14:47:59.416663+0000","last_peered":"2024-03-18T14:47:59.416663+0000","last_clean":"2024-03-18T14:47:59.416663+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:47:59.416663+0000","last_undegraded":"2024-03-18T14:47:59.416663+0000","last_fullsized":"2024-03-18T14:47:59.416663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":946,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417282+0000","last_change":"2024-03-18T14:47:14.637172+0000","last_active":"2024-03-18T14:47:59.417282+0000","last_peered":"2024-03-18T14:47:59.417282+0000","last_clean":"2024-03-18T14:47:59.417282+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:47:59.417282+0000","last_undegraded":"2024-03-18T14:47:59.417282+0000","last_fullsized":"2024-03-18T14:47:59.417282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418726+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:59.418726+0000","last_peered":"2024-03-18T14:47:59.418726+0000","last_clean":"2024-03-18T14:47:59.418726+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:59.418726+0000","last_undegraded":"2024-03-18T14:47:59.418726+0000","last_fullsized":"2024-03-18T14:47:59.418726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417770+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:59.417770+0000","last_peered":"2024-03-18T14:47:59.417770+0000","last_clean":"2024-03-18T14:47:59.417770+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:59.417770+0000","last_undegraded":"2024-03-18T14:47:59.417770+0000","last_fullsized":"2024-03-18T14:47:59.417770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417106+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:59.417106+0000","last_peered":"2024-03-18T14:47:59.417106+0000","last_clean":"2024-03-18T14:47:59.417106+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:59.417106+0000","last_undegraded":"2024-03-18T14:47:59.417106+0000","last_fullsized":"2024-03-18T14:47:59.417106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433319+0000","last_change":"2024-03-18T14:47:17.525018+0000","last_active":"2024-03-18T14:47:59.433319+0000","last_peered":"2024-03-18T14:47:59.433319+0000","last_clean":"2024-03-18T14:47:59.433319+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:47:59.433319+0000","last_undegraded":"2024-03-18T14:47:59.433319+0000","last_fullsized":"2024-03-18T14:47:59.433319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"19'721","reported_seq":1015,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.415751+0000","last_change":"2024-03-18T14:47:14.619103+0000","last_active":"2024-03-18T14:47:59.415751+0000","last_peered":"2024-03-18T14:47:59.415751+0000","last_clean":"2024-03-18T14:47:59.415751+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:47:59.415751+0000","last_undegraded":"2024-03-18T14:47:59.415751+0000","last_fullsized":"2024-03-18T14:47:59.415751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1030,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417140+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:59.417140+0000","last_peered":"2024-03-18T14:47:59.417140+0000","last_clean":"2024-03-18T14:47:59.417140+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:59.417140+0000","last_undegraded":"2024-03-18T14:47:59.417140+0000","last_fullsized":"2024-03-18T14:47:59.417140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.435298+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:59.435298+0000","last_peered":"2024-03-18T14:47:59.435298+0000","last_clean":"2024-03-18T14:47:59.435298+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:59.435298+0000","last_undegraded":"2024-03-18T14:47:59.435298+0000","last_fullsized":"2024-03-18T14:47:59.435298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":498,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417698+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:59.417698+0000","last_peered":"2024-03-18T14:47:59.417698+0000","last_clean":"2024-03-18T14:47:59.417698+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:59.417698+0000","last_undegraded":"2024-03-18T14:47:59.417698+0000","last_fullsized":"2024-03-18T14:47:59.417698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":906,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416901+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:59.416901+0000","last_peered":"2024-03-18T14:47:59.416901+0000","last_clean":"2024-03-18T14:47:59.416901+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:59.416901+0000","last_undegraded":"2024-03-18T14:47:59.416901+0000","last_fullsized":"2024-03-18T14:47:59.416901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":559,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434476+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:59.434476+0000","last_peered":"2024-03-18T14:47:59.434476+0000","last_clean":"2024-03-18T14:47:59.434476+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:59.434476+0000","last_undegraded":"2024-03-18T14:47:59.434476+0000","last_fullsized":"2024-03-18T14:47:59.434476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419600+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:59.419600+0000","last_peered":"2024-03-18T14:47:59.419600+0000","last_clean":"2024-03-18T14:47:59.419600+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:59.419600+0000","last_undegraded":"2024-03-18T14:47:59.419600+0000","last_fullsized":"2024-03-18T14:47:59.419600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1803,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433546+0000","last_change":"2024-03-18T14:47:58.527354+0000","last_active":"2024-03-18T14:47:59.433546+0000","last_peered":"2024-03-18T14:47:59.433546+0000","last_clean":"2024-03-18T14:47:59.433546+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:47:59.433546+0000","last_undegraded":"2024-03-18T14:47:59.433546+0000","last_fullsized":"2024-03-18T14:47:59.433546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433743+0000","last_change":"2024-03-18T14:47:17.506094+0000","last_active":"2024-03-18T14:47:59.433743+0000","last_peered":"2024-03-18T14:47:59.433743+0000","last_clean":"2024-03-18T14:47:59.433743+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:47:59.433743+0000","last_undegraded":"2024-03-18T14:47:59.433743+0000","last_fullsized":"2024-03-18T14:47:59.433743+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":712,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417305+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:59.417305+0000","last_peered":"2024-03-18T14:47:59.417305+0000","last_clean":"2024-03-18T14:47:59.417305+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:59.417305+0000","last_undegraded":"2024-03-18T14:47:59.417305+0000","last_fullsized":"2024-03-18T14:47:59.417305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":928,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418837+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:59.418837+0000","last_peered":"2024-03-18T14:47:59.418837+0000","last_clean":"2024-03-18T14:47:59.418837+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:59.418837+0000","last_undegraded":"2024-03-18T14:47:59.418837+0000","last_fullsized":"2024-03-18T14:47:59.418837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'130","reported_seq":178,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417002+0000","last_change":"2024-03-18T14:47:17.467211+0000","last_active":"2024-03-18T14:47:59.417002+0000","last_peered":"2024-03-18T14:47:59.417002+0000","last_clean":"2024-03-18T14:47:59.417002+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:47:59.417002+0000","last_undegraded":"2024-03-18T14:47:59.417002+0000","last_fullsized":"2024-03-18T14:47:59.417002+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":959,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419664+0000","last_change":"2024-03-18T14:47:14.623961+0000","last_active":"2024-03-18T14:47:59.419664+0000","last_peered":"2024-03-18T14:47:59.419664+0000","last_clean":"2024-03-18T14:47:59.419664+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:47:59.419664+0000","last_undegraded":"2024-03-18T14:47:59.419664+0000","last_fullsized":"2024-03-18T14:47:59.419664+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":435,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417104+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:59.417104+0000","last_peered":"2024-03-18T14:47:59.417104+0000","last_clean":"2024-03-18T14:47:59.417104+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:59.417104+0000","last_undegraded":"2024-03-18T14:47:59.417104+0000","last_fullsized":"2024-03-18T14:47:59.417104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1534,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437770+0000","last_change":"2024-03-18T14:47:59.429895+0000","last_active":"2024-03-18T14:47:59.437770+0000","last_peered":"2024-03-18T14:47:59.437770+0000","last_clean":"2024-03-18T14:47:59.437770+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:47:59.437770+0000","last_undegraded":"2024-03-18T14:47:59.437770+0000","last_fullsized":"2024-03-18T14:47:59.437770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":688,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434848+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:59.434848+0000","last_peered":"2024-03-18T14:47:59.434848+0000","last_clean":"2024-03-18T14:47:59.434848+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:59.434848+0000","last_undegraded":"2024-03-18T14:47:59.434848+0000","last_fullsized":"2024-03-18T14:47:59.434848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":900,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419759+0000","last_change":"2024-03-18T14:47:17.505610+0000","last_active":"2024-03-18T14:47:59.419759+0000","last_peered":"2024-03-18T14:47:59.419759+0000","last_clean":"2024-03-18T14:47:59.419759+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:47:59.419759+0000","last_undegraded":"2024-03-18T14:47:59.419759+0000","last_fullsized":"2024-03-18T14:47:59.419759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":531,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433812+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:59.433812+0000","last_peered":"2024-03-18T14:47:59.433812+0000","last_clean":"2024-03-18T14:47:59.433812+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:59.433812+0000","last_undegraded":"2024-03-18T14:47:59.433812+0000","last_fullsized":"2024-03-18T14:47:59.433812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":892,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434610+0000","last_change":"2024-03-18T14:47:17.519858+0000","last_active":"2024-03-18T14:47:59.434610+0000","last_peered":"2024-03-18T14:47:59.434610+0000","last_clean":"2024-03-18T14:47:59.434610+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:47:59.434610+0000","last_undegraded":"2024-03-18T14:47:59.434610+0000","last_fullsized":"2024-03-18T14:47:59.434610+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":263,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416554+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:59.416554+0000","last_peered":"2024-03-18T14:47:59.416554+0000","last_clean":"2024-03-18T14:47:59.416554+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:59.416554+0000","last_undegraded":"2024-03-18T14:47:59.416554+0000","last_fullsized":"2024-03-18T14:47:59.416554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1100,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417671+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:59.417671+0000","last_peered":"2024-03-18T14:47:59.417671+0000","last_clean":"2024-03-18T14:47:59.417671+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:59.417671+0000","last_undegraded":"2024-03-18T14:47:59.417671+0000","last_fullsized":"2024-03-18T14:47:59.417671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1016,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434715+0000","last_change":"2024-03-18T14:47:17.521156+0000","last_active":"2024-03-18T14:47:59.434715+0000","last_peered":"2024-03-18T14:47:59.434715+0000","last_clean":"2024-03-18T14:47:59.434715+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:47:59.434715+0000","last_undegraded":"2024-03-18T14:47:59.434715+0000","last_fullsized":"2024-03-18T14:47:59.434715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":925,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434671+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:59.434671+0000","last_peered":"2024-03-18T14:47:59.434671+0000","last_clean":"2024-03-18T14:47:59.434671+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:59.434671+0000","last_undegraded":"2024-03-18T14:47:59.434671+0000","last_fullsized":"2024-03-18T14:47:59.434671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417586+0000","last_change":"2024-03-18T14:47:14.637125+0000","last_active":"2024-03-18T14:47:59.417586+0000","last_peered":"2024-03-18T14:47:59.417586+0000","last_clean":"2024-03-18T14:47:59.417586+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:47:59.417586+0000","last_undegraded":"2024-03-18T14:47:59.417586+0000","last_fullsized":"2024-03-18T14:47:59.417586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159318,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16063,"num_write_kb":262729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274318636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19649,"ondisk_log_size":19649,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953485,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":2,"up_from":30,"seq":128849018894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":0,"up_from":28,"seq":120259084302,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61126956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051598,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52107817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.707 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.708 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.709 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.710 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.711 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.712 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T14:40:57.398555+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.713 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.714 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.715 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:14.716 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:48:34.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:48:34.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.852+0000 7f145db65700 1 Processor -- start 2024-03-18T14:48:34.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.852+0000 7f145db65700 1 -- start start 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14580b56e0 0x7f14580a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580a5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580a4ce0 con 0x7f14580b56e0 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580a3ad0 con 0x7f145813dea0 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f145db65700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14580a7230 con 0x7f14580a1d30 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f1456ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f14577fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14580b56e0 0x7f14580a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f1457fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f1456ffd700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:32910/0 (socket says 172.21.15.57:32910) 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.853+0000 7f1456ffd700 1 -- 172.21.15.57:0/3938461143 learned_addr learned my addr 172.21.15.57:0/3938461143 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 -- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 msgr2=0x7f14580a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 -- 172.21.15.57:0/3938461143 >> v2:172.21.15.57:3300/0 conn(0x7f14580b56e0 msgr2=0x7f14580a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 --2- 172.21.15.57:0/3938461143 >> v2:172.21.15.57:3300/0 conn(0x7f14580b56e0 0x7f14580a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 -- 172.21.15.57:0/3938461143 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580a3230 con 0x7f14580a1d30 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1457fff700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f1456ffd700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14480099b0 tx=0x7f1448009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd0480e331451f76 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f14567fc700 1 -- 172.21.15.57:0/3938461143 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800b680 con 0x7f14580a1d30 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f14567fc700 1 -- 172.21.15.57:0/3938461143 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144800b7e0 con 0x7f14580a1d30 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f14567fc700 1 -- 172.21.15.57:0/3938461143 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144800bb80 con 0x7f14580a1d30 2024-03-18T14:48:34.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 -- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 msgr2=0x7f145813d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14480099b0 tx=0x7f1448009250 comp rx=0 tx=0).stop 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 -- 172.21.15.57:0/3938461143 shutdown_connections 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 --2- 172.21.15.57:0/3938461143 >> v2:172.21.15.57:3300/0 conn(0x7f14580b56e0 0x7f14580a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 --2- 172.21.15.57:0/3938461143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145813d960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.854+0000 7f145db65700 1 -- 172.21.15.57:0/3938461143 >> 172.21.15.57:0/3938461143 conn(0x7f145806fb90 msgr2=0x7f14580b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.855+0000 7f145db65700 1 -- 172.21.15.57:0/3938461143 shutdown_connections 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.855+0000 7f145db65700 1 -- 172.21.15.57:0/3938461143 wait complete. 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 Processor -- start 2024-03-18T14:48:34.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 -- start start 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 0x7f1458098480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145809d0e0 con 0x7f14580b56e0 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145809beb0 con 0x7f145813dea0 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f145db65700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145809a760 con 0x7f14580a1d30 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f14577fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f1456ffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 0x7f1458098480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f14577fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:32920/0 (socket says 172.21.15.57:32920) 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f14577fe700 1 -- 172.21.15.57:0/1234919075 learned_addr learned my addr 172.21.15.57:0/1234919075 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.856+0000 7f1457fff700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:34.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 -- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 msgr2=0x7f14580989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 -- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 msgr2=0x7f1458098480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 0x7f1458098480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 -- 172.21.15.57:0/1234919075 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450009a20 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f1456ffd700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 0x7f1458098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f14577fe700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f144000ec80 tx=0x7f14400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000c850 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f144000c9b0 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480094f0 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000cd50 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.857+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145809a4a0 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.858+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1458099680 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.858+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f1440013680 con 0x7f14580a1d30 2024-03-18T14:48:34.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.858+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f144005b350 con 0x7f14580a1d30 2024-03-18T14:48:34.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:34.862+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f1440039630 con 0x7f14580a1d30 2024-03-18T14:48:35.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.024+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f145809aa50 con 0x7f1438045ef0 2024-03-18T14:48:35.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.031+0000 7f144f7fe700 1 -- 172.21.15.57:0/1234919075 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277919 (unknown 2965378022 0 1659581078) 0x7f145809aa50 con 0x7f1438045ef0 2024-03-18T14:48:35.037 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 >> v1:172.21.15.57:6816/47480 conn(0x7f1438045ef0 legacy=0x7f14380483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 msgr2=0x7f145809cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f144000ec80 tx=0x7f14400091a0 comp rx=0 tx=0).stop 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 shutdown_connections 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f145813dea0 0x7f14580989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f14580a1d30 0x7f145809cba0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 --2- 172.21.15.57:0/1234919075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14580b56e0 0x7f1458098480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 >> 172.21.15.57:0/1234919075 conn(0x7f145806fb90 msgr2=0x7f14580a4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 shutdown_connections 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:35.034+0000 7f145db65700 1 -- 172.21.15.57:0/1234919075 wait complete. 2024-03-18T14:48:35.039 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:48:35.047 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-03-18T14:48:33.567370+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71505,"ondisk_log_size":71505,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":282,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002944"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":933,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416571+0000","last_change":"2024-03-18T14:47:13.616498+0000","last_active":"2024-03-18T14:47:59.416571+0000","last_peered":"2024-03-18T14:47:59.416571+0000","last_clean":"2024-03-18T14:47:59.416571+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:47:59.416571+0000","last_undegraded":"2024-03-18T14:47:59.416571+0000","last_fullsized":"2024-03-18T14:47:59.416571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":890,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416446+0000","last_change":"2024-03-18T14:47:17.480647+0000","last_active":"2024-03-18T14:47:59.416446+0000","last_peered":"2024-03-18T14:47:59.416446+0000","last_clean":"2024-03-18T14:47:59.416446+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:47:59.416446+0000","last_undegraded":"2024-03-18T14:47:59.416446+0000","last_fullsized":"2024-03-18T14:47:59.416446+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":965,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434812+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:59.434812+0000","last_peered":"2024-03-18T14:47:59.434812+0000","last_clean":"2024-03-18T14:47:59.434812+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:59.434812+0000","last_undegraded":"2024-03-18T14:47:59.434812+0000","last_fullsized":"2024-03-18T14:47:59.434812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":812,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417324+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:59.417324+0000","last_peered":"2024-03-18T14:47:59.417324+0000","last_clean":"2024-03-18T14:47:59.417324+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:59.417324+0000","last_undegraded":"2024-03-18T14:47:59.417324+0000","last_fullsized":"2024-03-18T14:47:59.417324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":814,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418705+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:59.418705+0000","last_peered":"2024-03-18T14:47:59.418705+0000","last_clean":"2024-03-18T14:47:59.418705+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:59.418705+0000","last_undegraded":"2024-03-18T14:47:59.418705+0000","last_fullsized":"2024-03-18T14:47:59.418705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":895,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419108+0000","last_change":"2024-03-18T14:47:17.512615+0000","last_active":"2024-03-18T14:47:59.419108+0000","last_peered":"2024-03-18T14:47:59.419108+0000","last_clean":"2024-03-18T14:47:59.419108+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:47:59.419108+0000","last_undegraded":"2024-03-18T14:47:59.419108+0000","last_fullsized":"2024-03-18T14:47:59.419108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":891,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433431+0000","last_change":"2024-03-18T14:47:17.524810+0000","last_active":"2024-03-18T14:47:59.433431+0000","last_peered":"2024-03-18T14:47:59.433431+0000","last_clean":"2024-03-18T14:47:59.433431+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:47:59.433431+0000","last_undegraded":"2024-03-18T14:47:59.433431+0000","last_fullsized":"2024-03-18T14:47:59.433431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1020,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416896+0000","last_change":"2024-03-18T14:47:17.488895+0000","last_active":"2024-03-18T14:47:59.416896+0000","last_peered":"2024-03-18T14:47:59.416896+0000","last_clean":"2024-03-18T14:47:59.416896+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:47:59.416896+0000","last_undegraded":"2024-03-18T14:47:59.416896+0000","last_fullsized":"2024-03-18T14:47:59.416896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":944,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417218+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:59.417218+0000","last_peered":"2024-03-18T14:47:59.417218+0000","last_clean":"2024-03-18T14:47:59.417218+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:59.417218+0000","last_undegraded":"2024-03-18T14:47:59.417218+0000","last_fullsized":"2024-03-18T14:47:59.417218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419559+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:59.419559+0000","last_peered":"2024-03-18T14:47:59.419559+0000","last_clean":"2024-03-18T14:47:59.419559+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:59.419559+0000","last_undegraded":"2024-03-18T14:47:59.419559+0000","last_fullsized":"2024-03-18T14:47:59.419559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.435209+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:59.435209+0000","last_peered":"2024-03-18T14:47:59.435209+0000","last_clean":"2024-03-18T14:47:59.435209+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:59.435209+0000","last_undegraded":"2024-03-18T14:47:59.435209+0000","last_fullsized":"2024-03-18T14:47:59.435209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":836,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417234+0000","last_change":"2024-03-18T14:47:13.618788+0000","last_active":"2024-03-18T14:47:59.417234+0000","last_peered":"2024-03-18T14:47:59.417234+0000","last_clean":"2024-03-18T14:47:59.417234+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:47:59.417234+0000","last_undegraded":"2024-03-18T14:47:59.417234+0000","last_fullsized":"2024-03-18T14:47:59.417234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":878,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434381+0000","last_change":"2024-03-18T14:47:17.506195+0000","last_active":"2024-03-18T14:47:59.434381+0000","last_peered":"2024-03-18T14:47:59.434381+0000","last_clean":"2024-03-18T14:47:59.434381+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:47:59.434381+0000","last_undegraded":"2024-03-18T14:47:59.434381+0000","last_fullsized":"2024-03-18T14:47:59.434381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'130","reported_seq":176,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416833+0000","last_change":"2024-03-18T14:47:17.483754+0000","last_active":"2024-03-18T14:47:59.416833+0000","last_peered":"2024-03-18T14:47:59.416833+0000","last_clean":"2024-03-18T14:47:59.416833+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:47:59.416833+0000","last_undegraded":"2024-03-18T14:47:59.416833+0000","last_fullsized":"2024-03-18T14:47:59.416833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":851,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433617+0000","last_change":"2024-03-18T14:47:17.528143+0000","last_active":"2024-03-18T14:47:59.433617+0000","last_peered":"2024-03-18T14:47:59.433617+0000","last_clean":"2024-03-18T14:47:59.433617+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:47:59.433617+0000","last_undegraded":"2024-03-18T14:47:59.433617+0000","last_fullsized":"2024-03-18T14:47:59.433617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"19'1648","reported_seq":1695,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419697+0000","last_change":"2024-03-18T14:47:17.469303+0000","last_active":"2024-03-18T14:47:59.419697+0000","last_peered":"2024-03-18T14:47:59.419697+0000","last_clean":"2024-03-18T14:47:59.419697+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:47:59.419697+0000","last_undegraded":"2024-03-18T14:47:59.419697+0000","last_fullsized":"2024-03-18T14:47:59.419697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":1648,"log_dups_size":0,"ondisk_log_size":1648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"40'228","reported_seq":278,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416786+0000","last_change":"2024-03-18T14:47:17.476664+0000","last_active":"2024-03-18T14:47:59.416786+0000","last_peered":"2024-03-18T14:47:59.416786+0000","last_clean":"2024-03-18T14:47:59.416786+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:47:59.416786+0000","last_undegraded":"2024-03-18T14:47:59.416786+0000","last_fullsized":"2024-03-18T14:47:59.416786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417633+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:59.417633+0000","last_peered":"2024-03-18T14:47:59.417633+0000","last_clean":"2024-03-18T14:47:59.417633+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:59.417633+0000","last_undegraded":"2024-03-18T14:47:59.417633+0000","last_fullsized":"2024-03-18T14:47:59.417633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"19'557","reported_seq":612,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434309+0000","last_change":"2024-03-18T14:47:17.487318+0000","last_active":"2024-03-18T14:47:59.434309+0000","last_peered":"2024-03-18T14:47:59.434309+0000","last_clean":"2024-03-18T14:47:59.434309+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:47:59.434309+0000","last_undegraded":"2024-03-18T14:47:59.434309+0000","last_fullsized":"2024-03-18T14:47:59.434309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":557,"log_dups_size":0,"ondisk_log_size":557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":871,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417341+0000","last_change":"2024-03-18T14:47:17.488883+0000","last_active":"2024-03-18T14:47:59.417341+0000","last_peered":"2024-03-18T14:47:59.417341+0000","last_clean":"2024-03-18T14:47:59.417341+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:47:59.417341+0000","last_undegraded":"2024-03-18T14:47:59.417341+0000","last_fullsized":"2024-03-18T14:47:59.417341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'181","reported_seq":234,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.605829+0000","last_change":"2024-03-18T14:47:13.604573+0000","last_active":"2024-03-18T14:48:23.605829+0000","last_peered":"2024-03-18T14:48:23.605829+0000","last_clean":"2024-03-18T14:48:23.605829+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:23.605829+0000","last_undegraded":"2024-03-18T14:48:23.605829+0000","last_fullsized":"2024-03-18T14:48:23.605829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418110+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:59.418110+0000","last_peered":"2024-03-18T14:47:59.418110+0000","last_clean":"2024-03-18T14:47:59.418110+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:59.418110+0000","last_undegraded":"2024-03-18T14:47:59.418110+0000","last_fullsized":"2024-03-18T14:47:59.418110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'584","reported_seq":638,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434424+0000","last_change":"2024-03-18T14:47:17.487556+0000","last_active":"2024-03-18T14:47:59.434424+0000","last_peered":"2024-03-18T14:47:59.434424+0000","last_clean":"2024-03-18T14:47:59.434424+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:47:59.434424+0000","last_undegraded":"2024-03-18T14:47:59.434424+0000","last_fullsized":"2024-03-18T14:47:59.434424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'628","reported_seq":676,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433642+0000","last_change":"2024-03-18T14:47:17.477707+0000","last_active":"2024-03-18T14:47:59.433642+0000","last_peered":"2024-03-18T14:47:59.433642+0000","last_clean":"2024-03-18T14:47:59.433642+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:47:59.433642+0000","last_undegraded":"2024-03-18T14:47:59.433642+0000","last_fullsized":"2024-03-18T14:47:59.433642+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":903,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434958+0000","last_change":"2024-03-18T14:47:17.517037+0000","last_active":"2024-03-18T14:47:59.434958+0000","last_peered":"2024-03-18T14:47:59.434958+0000","last_clean":"2024-03-18T14:47:59.434958+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:47:59.434958+0000","last_undegraded":"2024-03-18T14:47:59.434958+0000","last_fullsized":"2024-03-18T14:47:59.434958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":338,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434883+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:59.434883+0000","last_peered":"2024-03-18T14:47:59.434883+0000","last_clean":"2024-03-18T14:47:59.434883+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:59.434883+0000","last_undegraded":"2024-03-18T14:47:59.434883+0000","last_fullsized":"2024-03-18T14:47:59.434883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":905,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.420032+0000","last_change":"2024-03-18T14:47:17.501907+0000","last_active":"2024-03-18T14:47:59.420032+0000","last_peered":"2024-03-18T14:47:59.420032+0000","last_clean":"2024-03-18T14:47:59.420032+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:47:59.420032+0000","last_undegraded":"2024-03-18T14:47:59.420032+0000","last_fullsized":"2024-03-18T14:47:59.420032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418494+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:59.418494+0000","last_peered":"2024-03-18T14:47:59.418494+0000","last_clean":"2024-03-18T14:47:59.418494+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:59.418494+0000","last_undegraded":"2024-03-18T14:47:59.418494+0000","last_fullsized":"2024-03-18T14:47:59.418494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417375+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:59.417375+0000","last_peered":"2024-03-18T14:47:59.417375+0000","last_clean":"2024-03-18T14:47:59.417375+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:59.417375+0000","last_undegraded":"2024-03-18T14:47:59.417375+0000","last_fullsized":"2024-03-18T14:47:59.417375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1652,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417672+0000","last_change":"2024-03-18T14:47:58.524766+0000","last_active":"2024-03-18T14:47:59.417672+0000","last_peered":"2024-03-18T14:47:59.417672+0000","last_clean":"2024-03-18T14:47:59.417672+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:47:59.417672+0000","last_undegraded":"2024-03-18T14:47:59.417672+0000","last_fullsized":"2024-03-18T14:47:59.417672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418726+0000","last_change":"2024-03-18T14:47:17.525772+0000","last_active":"2024-03-18T14:47:59.418726+0000","last_peered":"2024-03-18T14:47:59.418726+0000","last_clean":"2024-03-18T14:47:59.418726+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:47:59.418726+0000","last_undegraded":"2024-03-18T14:47:59.418726+0000","last_fullsized":"2024-03-18T14:47:59.418726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417770+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:59.417770+0000","last_peered":"2024-03-18T14:47:59.417770+0000","last_clean":"2024-03-18T14:47:59.417770+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:59.417770+0000","last_undegraded":"2024-03-18T14:47:59.417770+0000","last_fullsized":"2024-03-18T14:47:59.417770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417106+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:59.417106+0000","last_peered":"2024-03-18T14:47:59.417106+0000","last_clean":"2024-03-18T14:47:59.417106+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:59.417106+0000","last_undegraded":"2024-03-18T14:47:59.417106+0000","last_fullsized":"2024-03-18T14:47:59.417106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1030,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417140+0000","last_change":"2024-03-18T14:47:13.618583+0000","last_active":"2024-03-18T14:47:59.417140+0000","last_peered":"2024-03-18T14:47:59.417140+0000","last_clean":"2024-03-18T14:47:59.417140+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:47:59.417140+0000","last_undegraded":"2024-03-18T14:47:59.417140+0000","last_fullsized":"2024-03-18T14:47:59.417140+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.435298+0000","last_change":"2024-03-18T14:47:17.517775+0000","last_active":"2024-03-18T14:47:59.435298+0000","last_peered":"2024-03-18T14:47:59.435298+0000","last_clean":"2024-03-18T14:47:59.435298+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:47:59.435298+0000","last_undegraded":"2024-03-18T14:47:59.435298+0000","last_fullsized":"2024-03-18T14:47:59.435298+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":498,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417698+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:59.417698+0000","last_peered":"2024-03-18T14:47:59.417698+0000","last_clean":"2024-03-18T14:47:59.417698+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:59.417698+0000","last_undegraded":"2024-03-18T14:47:59.417698+0000","last_fullsized":"2024-03-18T14:47:59.417698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":906,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416901+0000","last_change":"2024-03-18T14:47:14.623418+0000","last_active":"2024-03-18T14:47:59.416901+0000","last_peered":"2024-03-18T14:47:59.416901+0000","last_clean":"2024-03-18T14:47:59.416901+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:47:59.416901+0000","last_undegraded":"2024-03-18T14:47:59.416901+0000","last_fullsized":"2024-03-18T14:47:59.416901+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"40'511","reported_seq":559,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434476+0000","last_change":"2024-03-18T14:47:17.505567+0000","last_active":"2024-03-18T14:47:59.434476+0000","last_peered":"2024-03-18T14:47:59.434476+0000","last_clean":"2024-03-18T14:47:59.434476+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:47:59.434476+0000","last_undegraded":"2024-03-18T14:47:59.434476+0000","last_fullsized":"2024-03-18T14:47:59.434476+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419600+0000","last_change":"2024-03-18T14:47:13.603811+0000","last_active":"2024-03-18T14:47:59.419600+0000","last_peered":"2024-03-18T14:47:59.419600+0000","last_clean":"2024-03-18T14:47:59.419600+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:47:59.419600+0000","last_undegraded":"2024-03-18T14:47:59.419600+0000","last_fullsized":"2024-03-18T14:47:59.419600+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"41'666","reported_seq":712,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417305+0000","last_change":"2024-03-18T14:47:13.617382+0000","last_active":"2024-03-18T14:47:59.417305+0000","last_peered":"2024-03-18T14:47:59.417305+0000","last_clean":"2024-03-18T14:47:59.417305+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:47:59.417305+0000","last_undegraded":"2024-03-18T14:47:59.417305+0000","last_fullsized":"2024-03-18T14:47:59.417305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":666,"log_dups_size":0,"ondisk_log_size":666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":928,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418837+0000","last_change":"2024-03-18T14:47:17.527583+0000","last_active":"2024-03-18T14:47:59.418837+0000","last_peered":"2024-03-18T14:47:59.418837+0000","last_clean":"2024-03-18T14:47:59.418837+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:47:59.418837+0000","last_undegraded":"2024-03-18T14:47:59.418837+0000","last_fullsized":"2024-03-18T14:47:59.418837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":435,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417104+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:59.417104+0000","last_peered":"2024-03-18T14:47:59.417104+0000","last_clean":"2024-03-18T14:47:59.417104+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:59.417104+0000","last_undegraded":"2024-03-18T14:47:59.417104+0000","last_fullsized":"2024-03-18T14:47:59.417104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1534,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437770+0000","last_change":"2024-03-18T14:47:59.429895+0000","last_active":"2024-03-18T14:47:59.437770+0000","last_peered":"2024-03-18T14:47:59.437770+0000","last_clean":"2024-03-18T14:47:59.437770+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:47:59.437770+0000","last_undegraded":"2024-03-18T14:47:59.437770+0000","last_fullsized":"2024-03-18T14:47:59.437770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"19'633","reported_seq":688,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434848+0000","last_change":"2024-03-18T14:47:17.518550+0000","last_active":"2024-03-18T14:47:59.434848+0000","last_peered":"2024-03-18T14:47:59.434848+0000","last_clean":"2024-03-18T14:47:59.434848+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:47:59.434848+0000","last_undegraded":"2024-03-18T14:47:59.434848+0000","last_fullsized":"2024-03-18T14:47:59.434848+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"19'484","reported_seq":531,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433812+0000","last_change":"2024-03-18T14:47:17.462373+0000","last_active":"2024-03-18T14:47:59.433812+0000","last_peered":"2024-03-18T14:47:59.433812+0000","last_clean":"2024-03-18T14:47:59.433812+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:47:59.433812+0000","last_undegraded":"2024-03-18T14:47:59.433812+0000","last_fullsized":"2024-03-18T14:47:59.433812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'215","reported_seq":263,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.416554+0000","last_change":"2024-03-18T14:47:13.608613+0000","last_active":"2024-03-18T14:47:59.416554+0000","last_peered":"2024-03-18T14:47:59.416554+0000","last_clean":"2024-03-18T14:47:59.416554+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:47:59.416554+0000","last_undegraded":"2024-03-18T14:47:59.416554+0000","last_fullsized":"2024-03-18T14:47:59.416554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1100,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417671+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:59.417671+0000","last_peered":"2024-03-18T14:47:59.417671+0000","last_clean":"2024-03-18T14:47:59.417671+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:59.417671+0000","last_undegraded":"2024-03-18T14:47:59.417671+0000","last_fullsized":"2024-03-18T14:47:59.417671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":925,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434671+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:59.434671+0000","last_peered":"2024-03-18T14:47:59.434671+0000","last_clean":"2024-03-18T14:47:59.434671+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:59.434671+0000","last_undegraded":"2024-03-18T14:47:59.434671+0000","last_fullsized":"2024-03-18T14:47:59.434671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19669,"ondisk_log_size":19669,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953489,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.34999999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":16.358000000000001,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.39600000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018898,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.222},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.32100000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.40400000000000003}]}]},{"osd":0,"up_from":28,"seq":120259084306,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.33700000000000002}]},{"osd":2,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.375},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.30199999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051602,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Mon Mar 18 14:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:48:35.052 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.052 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.053 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.054 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.055 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T14:40:57.398555+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.056 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.057 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.058 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.058 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.058 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.058 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:35.058 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:48:55.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:48:55.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.192+0000 7f760b4f4700 1 Processor -- start 2024-03-18T14:48:55.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.192+0000 7f760b4f4700 1 -- start start 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f760b4f4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 0x7f76040a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f760b4f4700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 0x7f7604148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f760b4f4700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76040a4ce0 con 0x7f76040a1d30 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f760b4f4700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76040a3ad0 con 0x7f760413e070 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f760b4f4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76040a7230 con 0x7f76040b56e0 2024-03-18T14:48:55.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f7609a91700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 0x7f7604148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f7608a8f700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f76040a1d30 0x7f760413d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57186/0 (socket says 172.21.15.57:57186) 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f7608a8f700 1 -- 172.21.15.57:0/2337344736 learned_addr learned my addr 172.21.15.57:0/2337344736 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f7609290700 1 --2- 172.21.15.57:0/2337344736 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 0x7f76040a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.193+0000 7f75fbfff700 1 -- 172.21.15.57:0/2337344736 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454758253 0 0) 0x7f76040a4ce0 con 0x7f76040a1d30 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f75fbfff700 1 -- 172.21.15.57:0/2337344736 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f0003570 con 0x7f76040a1d30 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609290700 1 -- 172.21.15.57:0/2337344736 >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 msgr2=0x7f7604148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609290700 1 --2- 172.21.15.57:0/2337344736 >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 0x7f7604148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609290700 1 -- 172.21.15.57:0/2337344736 >> v1:172.21.15.57:6789/0 conn(0x7f76040a1d30 legacy=0x7f760413d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609290700 1 -- 172.21.15.57:0/2337344736 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76040a3230 con 0x7f76040b56e0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609a91700 1 --2- 172.21.15.57:0/2337344736 >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 0x7f7604148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f7609290700 1 --2- 172.21.15.57:0/2337344736 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 0x7f76040a4600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098e0 tx=0x7f75f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=948149c61622091b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f75fbfff700 1 -- 172.21.15.57:0/2337344736 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4011630 con 0x7f76040b56e0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f75fbfff700 1 -- 172.21.15.57:0/2337344736 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f4011790 con 0x7f76040b56e0 2024-03-18T14:48:55.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f75fbfff700 1 -- 172.21.15.57:0/2337344736 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4011b30 con 0x7f76040b56e0 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f760b4f4700 1 -- 172.21.15.57:0/2337344736 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 msgr2=0x7f76040a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f760b4f4700 1 --2- 172.21.15.57:0/2337344736 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 0x7f76040a4600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098e0 tx=0x7f75f40091a0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f760b4f4700 1 -- 172.21.15.57:0/2337344736 shutdown_connections 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f760b4f4700 1 --2- 172.21.15.57:0/2337344736 >> v2:172.21.15.57:3300/0 conn(0x7f760413e070 0x7f7604148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.194+0000 7f760b4f4700 1 --2- 172.21.15.57:0/2337344736 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f76040b56e0 0x7f76040a4600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.195+0000 7f760b4f4700 1 -- 172.21.15.57:0/2337344736 >> 172.21.15.57:0/2337344736 conn(0x7f760406fb90 msgr2=0x7f76040b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.195+0000 7f760b4f4700 1 -- 172.21.15.57:0/2337344736 shutdown_connections 2024-03-18T14:48:55.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.195+0000 7f760b4f4700 1 -- 172.21.15.57:0/2337344736 wait complete. 2024-03-18T14:48:55.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 Processor -- start 2024-03-18T14:48:55.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 -- start start 2024-03-18T14:48:55.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76040b56e0 0x7f7604151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760409d810 con 0x7f76040a1d30 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760409b420 con 0x7f760413e070 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f760b4f4700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7604097c40 con 0x7f76040b56e0 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7609290700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7609a91700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7609a91700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:34092/0 (socket says 172.21.15.57:34092) 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7609a91700 1 -- 172.21.15.57:0/3849392250 learned_addr learned my addr 172.21.15.57:0/3849392250 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7609290700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45420/0 (socket says 172.21.15.57:45420) 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.196+0000 7f7608a8f700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76040b56e0 0x7f7604151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 -- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76040b56e0 msgr2=0x7f7604151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76040b56e0 0x7f7604151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 -- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 msgr2=0x7f760409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 -- 172.21.15.57:0/3849392250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc009a20 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609290700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f7609a91700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009f20 tx=0x7f75fc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00cb70 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc00f040 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc014480 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f4009420 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.197+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760409af70 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.198+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760409b1f0 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.198+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f75fc003020 con 0x7f760413e070 2024-03-18T14:48:55.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.198+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f75fc05b8c0 con 0x7f760413e070 2024-03-18T14:48:55.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.202+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f75fc039b40 con 0x7f760413e070 2024-03-18T14:48:55.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.358+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f760409a720 con 0x7f75e8045ef0 2024-03-18T14:48:55.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.366+0000 7f75f97fa700 1 -- 172.21.15.57:0/3849392250 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279703 (unknown 2965378022 0 2137391062) 0x7f760409a720 con 0x7f75e8045ef0 2024-03-18T14:48:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 >> v1:172.21.15.57:6816/47480 conn(0x7f75e8045ef0 legacy=0x7f75e80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 msgr2=0x7f7604151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009f20 tx=0x7f75fc00b040 comp rx=0 tx=0).stop 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 shutdown_connections 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f760413e070 0x7f7604151c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76040a1d30 0x7f760409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 --2- 172.21.15.57:0/3849392250 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f76040b56e0 0x7f7604151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 >> 172.21.15.57:0/3849392250 conn(0x7f760406fb90 msgr2=0x7f76040b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 shutdown_connections 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:48:55.369+0000 7f760b4f4700 1 -- 172.21.15.57:0/3849392250 wait complete. 2024-03-18T14:48:55.373 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:48:55.381 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-03-18T14:48:53.572449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71540,"ondisk_log_size":71540,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003090"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":965,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434812+0000","last_change":"2024-03-18T14:47:17.527910+0000","last_active":"2024-03-18T14:47:59.434812+0000","last_peered":"2024-03-18T14:47:59.434812+0000","last_clean":"2024-03-18T14:47:59.434812+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:47:59.434812+0000","last_undegraded":"2024-03-18T14:47:59.434812+0000","last_fullsized":"2024-03-18T14:47:59.434812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":812,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417324+0000","last_change":"2024-03-18T14:47:13.600178+0000","last_active":"2024-03-18T14:47:59.417324+0000","last_peered":"2024-03-18T14:47:59.417324+0000","last_clean":"2024-03-18T14:47:59.417324+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:47:59.417324+0000","last_undegraded":"2024-03-18T14:47:59.417324+0000","last_fullsized":"2024-03-18T14:47:59.417324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":814,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418705+0000","last_change":"2024-03-18T14:47:13.591752+0000","last_active":"2024-03-18T14:47:59.418705+0000","last_peered":"2024-03-18T14:47:59.418705+0000","last_clean":"2024-03-18T14:47:59.418705+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:47:59.418705+0000","last_undegraded":"2024-03-18T14:47:59.418705+0000","last_fullsized":"2024-03-18T14:47:59.418705+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":944,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417218+0000","last_change":"2024-03-18T14:47:17.495877+0000","last_active":"2024-03-18T14:47:59.417218+0000","last_peered":"2024-03-18T14:47:59.417218+0000","last_clean":"2024-03-18T14:47:59.417218+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:47:59.417218+0000","last_undegraded":"2024-03-18T14:47:59.417218+0000","last_fullsized":"2024-03-18T14:47:59.417218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419559+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:59.419559+0000","last_peered":"2024-03-18T14:47:59.419559+0000","last_clean":"2024-03-18T14:47:59.419559+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:59.419559+0000","last_undegraded":"2024-03-18T14:47:59.419559+0000","last_fullsized":"2024-03-18T14:47:59.419559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":934,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.435209+0000","last_change":"2024-03-18T14:47:17.517968+0000","last_active":"2024-03-18T14:47:59.435209+0000","last_peered":"2024-03-18T14:47:59.435209+0000","last_clean":"2024-03-18T14:47:59.435209+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:47:59.435209+0000","last_undegraded":"2024-03-18T14:47:59.435209+0000","last_fullsized":"2024-03-18T14:47:59.435209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417633+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:59.417633+0000","last_peered":"2024-03-18T14:47:59.417633+0000","last_clean":"2024-03-18T14:47:59.417633+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:59.417633+0000","last_undegraded":"2024-03-18T14:47:59.417633+0000","last_fullsized":"2024-03-18T14:47:59.417633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418110+0000","last_change":"2024-03-18T14:47:17.529855+0000","last_active":"2024-03-18T14:47:59.418110+0000","last_peered":"2024-03-18T14:47:59.418110+0000","last_clean":"2024-03-18T14:47:59.418110+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:47:59.418110+0000","last_undegraded":"2024-03-18T14:47:59.418110+0000","last_fullsized":"2024-03-18T14:47:59.418110+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"40'292","reported_seq":338,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434883+0000","last_change":"2024-03-18T14:47:17.527024+0000","last_active":"2024-03-18T14:47:59.434883+0000","last_peered":"2024-03-18T14:47:59.434883+0000","last_clean":"2024-03-18T14:47:59.434883+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:47:59.434883+0000","last_undegraded":"2024-03-18T14:47:59.434883+0000","last_fullsized":"2024-03-18T14:47:59.434883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418494+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:59.418494+0000","last_peered":"2024-03-18T14:47:59.418494+0000","last_clean":"2024-03-18T14:47:59.418494+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:59.418494+0000","last_undegraded":"2024-03-18T14:47:59.418494+0000","last_fullsized":"2024-03-18T14:47:59.418494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":50,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417375+0000","last_change":"2024-03-18T14:47:13.587017+0000","last_active":"2024-03-18T14:47:59.417375+0000","last_peered":"2024-03-18T14:47:59.417375+0000","last_clean":"2024-03-18T14:47:59.417375+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:47:59.417375+0000","last_undegraded":"2024-03-18T14:47:59.417375+0000","last_fullsized":"2024-03-18T14:47:59.417375+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:03.501719+0000","last_clean_scrub_stamp":"2024-03-18T14:41:03.501719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1652,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417672+0000","last_change":"2024-03-18T14:47:58.524766+0000","last_active":"2024-03-18T14:47:59.417672+0000","last_peered":"2024-03-18T14:47:59.417672+0000","last_clean":"2024-03-18T14:47:59.417672+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:47:59.417672+0000","last_undegraded":"2024-03-18T14:47:59.417672+0000","last_fullsized":"2024-03-18T14:47:59.417672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417770+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:59.417770+0000","last_peered":"2024-03-18T14:47:59.417770+0000","last_clean":"2024-03-18T14:47:59.417770+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:59.417770+0000","last_undegraded":"2024-03-18T14:47:59.417770+0000","last_fullsized":"2024-03-18T14:47:59.417770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417106+0000","last_change":"2024-03-18T14:47:13.604372+0000","last_active":"2024-03-18T14:47:59.417106+0000","last_peered":"2024-03-18T14:47:59.417106+0000","last_clean":"2024-03-18T14:47:59.417106+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:47:59.417106+0000","last_undegraded":"2024-03-18T14:47:59.417106+0000","last_fullsized":"2024-03-18T14:47:59.417106+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:40:57.398555+0000","last_clean_scrub_stamp":"2024-03-18T14:40:57.398555+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":498,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417698+0000","last_change":"2024-03-18T14:47:14.635076+0000","last_active":"2024-03-18T14:47:59.417698+0000","last_peered":"2024-03-18T14:47:59.417698+0000","last_clean":"2024-03-18T14:47:59.417698+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:47:59.417698+0000","last_undegraded":"2024-03-18T14:47:59.417698+0000","last_fullsized":"2024-03-18T14:47:59.417698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'386","reported_seq":435,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417104+0000","last_change":"2024-03-18T14:47:13.587221+0000","last_active":"2024-03-18T14:47:59.417104+0000","last_peered":"2024-03-18T14:47:59.417104+0000","last_clean":"2024-03-18T14:47:59.417104+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:47:59.417104+0000","last_undegraded":"2024-03-18T14:47:59.417104+0000","last_fullsized":"2024-03-18T14:47:59.417104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1100,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417671+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:59.417671+0000","last_peered":"2024-03-18T14:47:59.417671+0000","last_clean":"2024-03-18T14:47:59.417671+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:59.417671+0000","last_undegraded":"2024-03-18T14:47:59.417671+0000","last_fullsized":"2024-03-18T14:47:59.417671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":925,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434671+0000","last_change":"2024-03-18T14:47:17.488640+0000","last_active":"2024-03-18T14:47:59.434671+0000","last_peered":"2024-03-18T14:47:59.434671+0000","last_clean":"2024-03-18T14:47:59.434671+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:47:59.434671+0000","last_undegraded":"2024-03-18T14:47:59.434671+0000","last_fullsized":"2024-03-18T14:47:59.434671+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19704,"ondisk_log_size":19704,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953493,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.41899999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":16.358000000000001,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.44}]}]},{"osd":2,"up_from":30,"seq":128849018902,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.26200000000000001}]},{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33800000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.313},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.39900000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084310,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.318}]},{"osd":2,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.35499999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051606,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.26700000000000002}]},{"osd":2,"last update":"Mon Mar 18 14:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Mar 18 14:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.40400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:48:55.386 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.386 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.386 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.387 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-18T14:41:03.501719+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=3, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T14:40:57.398555+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=40, tm_sec=57, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.388 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.389 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.389 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.389 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:48:55.389 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:49:15.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:49:15.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.524+0000 7f6bb2aff700 1 Processor -- start 2024-03-18T14:49:15.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.524+0000 7f6bb2aff700 1 -- start start 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bac0b3250 0x7f6bac06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac0a3a80 con 0x7f6bac0b3250 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0b0350 con 0x7f6bac06f5f0 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb2aff700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0a4990 con 0x7f6bac0a4e70 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6babfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb109c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bac0b3250 0x7f6bac06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6babfff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:32848/0 (socket says 172.21.15.57:32848) 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb109c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39568/0 (socket says 172.21.15.57:39568) 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bac0b3250 0x7f6bac06eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34924/0 (socket says 172.21.15.57:34924) 2024-03-18T14:49:15.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6babfff700 1 -- 172.21.15.57:0/332682005 learned_addr learned my addr 172.21.15.57:0/332682005 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 -- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 msgr2=0x7f6bac06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 -- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 msgr2=0x7f6bac148610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 -- 172.21.15.57:0/332682005 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac06a3f0 con 0x7f6bac0b3250 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb109c700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6babfff700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.525+0000 7f6bb089b700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac06eb70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098e0 tx=0x7f6ba00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2042ea1f9161acd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bab7fe700 1 -- 172.21.15.57:0/332682005 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0011630 con 0x7f6bac0b3250 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bab7fe700 1 -- 172.21.15.57:0/332682005 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba0011790 con 0x7f6bac0b3250 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bab7fe700 1 -- 172.21.15.57:0/332682005 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0011b30 con 0x7f6bac0b3250 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 -- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 msgr2=0x7f6bac06eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:15.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac06eb70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098e0 tx=0x7f6ba00091a0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 -- 172.21.15.57:0/332682005 shutdown_connections 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac06f5f0 0x7f6bac148610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac06eb70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/332682005 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac0a4e70 0x7f6bac06f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 -- 172.21.15.57:0/332682005 >> 172.21.15.57:0/332682005 conn(0x7f6bac06e2c0 msgr2=0x7f6bac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 -- 172.21.15.57:0/332682005 shutdown_connections 2024-03-18T14:49:15.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.526+0000 7f6bb2aff700 1 -- 172.21.15.57:0/332682005 wait complete. 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.527+0000 7f6bb2aff700 1 Processor -- start 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.527+0000 7f6bb2aff700 1 -- start start 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 0x7f6bac097090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac0abe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0af490 con 0x7f6bac0b3250 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0ad950 con 0x7f6bac0a4e70 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb2aff700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0adbf0 con 0x7f6bac06f5f0 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb109c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac0abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:39572/0 (socket says 172.21.15.57:39572) 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 -- 172.21.15.57:0/3597157511 learned_addr learned my addr 172.21.15.57:0/3597157511 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:49:15.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb089b700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 0x7f6bac097090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 -- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 msgr2=0x7f6bac097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 0x7f6bac097090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 -- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 msgr2=0x7f6bac0abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac0abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6babfff700 1 -- 172.21.15.57:0/3597157511 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009a20 con 0x7f6bac0a4e70 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb089b700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 0x7f6bac097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.528+0000 7f6bb109c700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6babfff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800ec50 tx=0x7f6b98009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800c920 con 0x7f6bac0a4e70 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9800ca80 con 0x7f6bac0a4e70 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b980094f0 con 0x7f6bac0a4e70 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9800ce00 con 0x7f6bac0a4e70 2024-03-18T14:49:15.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.529+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba0009420 con 0x7f6bac0a4e70 2024-03-18T14:49:15.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.530+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f6b98013680 con 0x7f6bac0a4e70 2024-03-18T14:49:15.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.530+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac065180 con 0x7f6bac0a4e70 2024-03-18T14:49:15.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.530+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f6b9805b460 con 0x7f6bac0a4e70 2024-03-18T14:49:15.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.534+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f6b98039740 con 0x7f6bac0a4e70 2024-03-18T14:49:15.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.694+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bac0a2870 con 0x7f6b90045ef0 2024-03-18T14:49:15.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.702+0000 7f6ba8ff9700 1 -- 172.21.15.57:0/3597157511 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280335 (unknown 2965378022 0 1308238492) 0x7f6bac0a2870 con 0x7f6b90045ef0 2024-03-18T14:49:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.704+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 >> v1:172.21.15.57:6816/47480 conn(0x7f6b90045ef0 legacy=0x7f6b900483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.704+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 msgr2=0x7f6bac0ab8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.704+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800ec50 tx=0x7f6b98009250 comp rx=0 tx=0).stop 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.704+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 shutdown_connections 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bac0b3250 0x7f6bac0abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f6bac06f5f0 0x7f6bac097090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 --2- 172.21.15.57:0/3597157511 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f6bac0a4e70 0x7f6bac0ab8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 >> 172.21.15.57:0/3597157511 conn(0x7f6bac06e2c0 msgr2=0x7f6bac0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 shutdown_connections 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:15.705+0000 7f6bb2aff700 1 -- 172.21.15.57:0/3597157511 wait complete. 2024-03-18T14:49:15.709 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:49:15.718 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-03-18T14:49:15.578384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71546,"ondisk_log_size":71546,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003208"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":927,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419559+0000","last_change":"2024-03-18T14:47:14.621244+0000","last_active":"2024-03-18T14:47:59.419559+0000","last_peered":"2024-03-18T14:47:59.419559+0000","last_clean":"2024-03-18T14:47:59.419559+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:47:59.419559+0000","last_undegraded":"2024-03-18T14:47:59.419559+0000","last_fullsized":"2024-03-18T14:47:59.419559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1044,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417633+0000","last_change":"2024-03-18T14:47:17.520166+0000","last_active":"2024-03-18T14:47:59.417633+0000","last_peered":"2024-03-18T14:47:59.417633+0000","last_clean":"2024-03-18T14:47:59.417633+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:47:59.417633+0000","last_undegraded":"2024-03-18T14:47:59.417633+0000","last_fullsized":"2024-03-18T14:47:59.417633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":904,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.418494+0000","last_change":"2024-03-18T14:47:17.484024+0000","last_active":"2024-03-18T14:47:59.418494+0000","last_peered":"2024-03-18T14:47:59.418494+0000","last_clean":"2024-03-18T14:47:59.418494+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:47:59.418494+0000","last_undegraded":"2024-03-18T14:47:59.418494+0000","last_fullsized":"2024-03-18T14:47:59.418494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1652,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417672+0000","last_change":"2024-03-18T14:47:58.524766+0000","last_active":"2024-03-18T14:47:59.417672+0000","last_peered":"2024-03-18T14:47:59.417672+0000","last_clean":"2024-03-18T14:47:59.417672+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:47:59.417672+0000","last_undegraded":"2024-03-18T14:47:59.417672+0000","last_fullsized":"2024-03-18T14:47:59.417672+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417770+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:59.417770+0000","last_peered":"2024-03-18T14:47:59.417770+0000","last_clean":"2024-03-18T14:47:59.417770+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:59.417770+0000","last_undegraded":"2024-03-18T14:47:59.417770+0000","last_fullsized":"2024-03-18T14:47:59.417770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1100,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417671+0000","last_change":"2024-03-18T14:47:14.637435+0000","last_active":"2024-03-18T14:47:59.417671+0000","last_peered":"2024-03-18T14:47:59.417671+0000","last_clean":"2024-03-18T14:47:59.417671+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:47:59.417671+0000","last_undegraded":"2024-03-18T14:47:59.417671+0000","last_fullsized":"2024-03-18T14:47:59.417671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19708,"ondisk_log_size":19708,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953498,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":4.165,"5min":4.165,"15min":4.165},"last":0.249},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.28599999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.27000000000000002}]},{"osd":2,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":16.358000000000001,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.33600000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018906,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.28599999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.311},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:48:18 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.378}]}]},{"osd":0,"up_from":28,"seq":120259084315,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"last":0.313}]},{"osd":2,"last update":"Mon Mar 18 14:48:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.371},{"interface":"front","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"last":0.29499999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:48:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.38600000000000001}]}]},{"osd":1,"up_from":29,"seq":124554051610,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:48:12 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.375},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29799999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:48:14 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:48:16 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.433}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:49:15.723 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.723 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.724 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.724 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.724 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.724 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.724 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.725 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.725 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:15.725 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:49:35.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 Processor -- start 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 -- start start 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 0x7f00740a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00740a77d0 con 0x7f00740b0050 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007413fc50 con 0x7f00740b3550 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f007a445700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007413fef0 con 0x7f00740a4cb0 2024-03-18T14:49:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.861+0000 7f00737fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56472/0 (socket says 172.21.15.57:56472) 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0073fff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 0x7f00740a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 -- 172.21.15.57:0/103336201 learned_addr learned my addr 172.21.15.57:0/103336201 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0072ffd700 1 -- 172.21.15.57:0/103336201 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878936603 0 0) 0x7f00740a77d0 con 0x7f00740b0050 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0072ffd700 1 -- 172.21.15.57:0/103336201 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c003570 con 0x7f00740b0050 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 -- 172.21.15.57:0/103336201 >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 msgr2=0x7f00740a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 --2- 172.21.15.57:0/103336201 >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 0x7f00740a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 -- 172.21.15.57:0/103336201 >> v1:172.21.15.57:6789/0 conn(0x7f00740b0050 legacy=0x7f007406eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 -- 172.21.15.57:0/103336201 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740a5980 con 0x7f00740a4cb0 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0073fff700 1 --2- 172.21.15.57:0/103336201 >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 0x7f00740a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f00737fe700 1 --2- 172.21.15.57:0/103336201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00680099b0 tx=0x7f0068009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e152e7a38e835906 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0072ffd700 1 -- 172.21.15.57:0/103336201 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800b680 con 0x7f00740a4cb0 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0072ffd700 1 -- 172.21.15.57:0/103336201 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006800b7e0 con 0x7f00740a4cb0 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.862+0000 7f0072ffd700 1 -- 172.21.15.57:0/103336201 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800bb60 con 0x7f00740a4cb0 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 -- 172.21.15.57:0/103336201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 msgr2=0x7f00740afb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 --2- 172.21.15.57:0/103336201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f00680099b0 tx=0x7f0068009250 comp rx=0 tx=0).stop 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 -- 172.21.15.57:0/103336201 shutdown_connections 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 --2- 172.21.15.57:0/103336201 >> v2:172.21.15.57:3300/0 conn(0x7f00740b3550 0x7f00740a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 --2- 172.21.15.57:0/103336201 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740afb10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 -- 172.21.15.57:0/103336201 >> 172.21.15.57:0/103336201 conn(0x7f007406e2c0 msgr2=0x7f007406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 -- 172.21.15.57:0/103336201 shutdown_connections 2024-03-18T14:49:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.863+0000 7f007a445700 1 -- 172.21.15.57:0/103336201 wait complete. 2024-03-18T14:49:35.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.864+0000 7f007a445700 1 Processor -- start 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.864+0000 7f007a445700 1 -- start start 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 0x7f00740af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f00740b3550 0x7f007414f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00740af9a0 con 0x7f00740b0050 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00740a2a30 con 0x7f00740a4cb0 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f007a445700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00740ad600 con 0x7f00740b3550 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f0073fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 0x7f00740af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00789e2700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f00740b3550 0x7f007414f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f0073fff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:56474/0 (socket says 172.21.15.57:56474) 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f0073fff700 1 -- 172.21.15.57:0/1873767978 learned_addr learned my addr 172.21.15.57:0/1873767978 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 -- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f00740b3550 msgr2=0x7f007414f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f00740b3550 0x7f007414f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 -- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 msgr2=0x7f00740ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 -- 172.21.15.57:0/1873767978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009420 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f0073fff700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f00737fe700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 0x7f00740af090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00740b0960 tx=0x7f0068017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.865+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006800bb60 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.866+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006801e160 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.866+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680094f0 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.866+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006801e540 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.866+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00740addb0 con 0x7f00740b0050 2024-03-18T14:49:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.866+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f006801a660 con 0x7f00740b0050 2024-03-18T14:49:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.867+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0074065180 con 0x7f00740b0050 2024-03-18T14:49:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.867+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f006805ca80 con 0x7f00740b0050 2024-03-18T14:49:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:35.871+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f00680064d0 con 0x7f00740b0050 2024-03-18T14:49:36.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.028+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00740ae7a0 con 0x7f0060045ef0 2024-03-18T14:49:36.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.036+0000 7f005bfff700 1 -- 172.21.15.57:0/1873767978 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280804 (unknown 2965378022 0 2380700320) 0x7f00740ae7a0 con 0x7f0060045ef0 2024-03-18T14:49:36.040 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:49:36.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 >> v1:172.21.15.57:6816/47480 conn(0x7f0060045ef0 legacy=0x7f00600483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 msgr2=0x7f00740af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 0x7f00740af090 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00740b0960 tx=0x7f0068017000 comp rx=0 tx=0).stop 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 shutdown_connections 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f00740b3550 0x7f007414f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f00740a4cb0 0x7f00740ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 --2- 172.21.15.57:0/1873767978 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f00740b0050 0x7f00740af090 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 >> 172.21.15.57:0/1873767978 conn(0x7f007406e2c0 msgr2=0x7f00740b0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 shutdown_connections 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:36.039+0000 7f007a445700 1 -- 172.21.15.57:0/1873767978 wait complete. 2024-03-18T14:49:36.043 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:49:36.051 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-03-18T14:49:35.583484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71546,"ondisk_log_size":71546,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003368"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"40'830","reported_seq":875,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.417770+0000","last_change":"2024-03-18T14:47:14.627769+0000","last_active":"2024-03-18T14:47:59.417770+0000","last_peered":"2024-03-18T14:47:59.417770+0000","last_clean":"2024-03-18T14:47:59.417770+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:47:59.417770+0000","last_undegraded":"2024-03-18T14:47:59.417770+0000","last_fullsized":"2024-03-18T14:47:59.417770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:12.119490+0000","last_clean_scrub_stamp":"2024-03-18T14:41:12.119490+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19708,"ondisk_log_size":19708,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953502,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.46100000000000002,"5min":4.165,"15min":4.165},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":1.419,"15min":1.419},"last":0.373}]},{"osd":1,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.439},{"interface":"front","average":{"1min":0.372,"5min":0.371,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.083,"15min":1.1950000000000001},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.39900000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018910,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.34200000000000003,"15min":0.34699999999999998},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42899999999999999,"5min":0.501,"15min":0.501},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.35999999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.629,"15min":0.629},"last":0.378}]},{"osd":3,"last update":"Mon Mar 18 14:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40300000000000002,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.51100000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56699999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.44600000000000001}]}]},{"osd":0,"up_from":28,"seq":120259084319,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.33200000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47099999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.28899999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28100000000000003}]},{"osd":2,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53100000000000003,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.307},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.312},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.32400000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:49:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38700000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":1.034,"15min":1.034},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.36799999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051614,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44800000000000001,"5min":0.498,"15min":0.498},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.54600000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:49:36.056 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:36.056 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:36.057 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-18T14:41:12.119490+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=12, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:36.057 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:36.057 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:49:56.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:49:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 Processor -- start 2024-03-18T14:49:56.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 -- start start 2024-03-18T14:49:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57bc069450 0x7f57bc0a3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 0x7f57bc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:56.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57bc06de60 con 0x7f57bc06f490 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57bc06dbf0 con 0x7f57bc069450 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57c1c9c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0a3490 con 0x7f57bc06e890 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57bb7fe700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57bc069450 0x7f57bc0a3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57baffd700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 0x7f57bc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57bbfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f57bc06f490 0x7f57bc0679e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53210/0 (socket says 172.21.15.57:53210) 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.194+0000 7f57bbfff700 1 -- 172.21.15.57:0/2065555069 learned_addr learned my addr 172.21.15.57:0/2065555069 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57bb7fe700 1 -- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 msgr2=0x7f57bc06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57bb7fe700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 0x7f57bc06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57bb7fe700 1 -- 172.21.15.57:0/2065555069 >> v1:172.21.15.57:6789/0 conn(0x7f57bc06f490 legacy=0x7f57bc0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57ba7fc700 1 -- 172.21.15.57:0/2065555069 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334830731 0 0) 0x7f57bc06de60 con 0x7f57bc06f490 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57bb7fe700 1 -- 172.21.15.57:0/2065555069 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57bc0a2a50 con 0x7f57bc069450 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57baffd700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 0x7f57bc06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:56.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57bb7fe700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc069450 0x7f57bc0a3df0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098e0 tx=0x7f57ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea6d2faba42c8b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57ba7fc700 1 -- 172.21.15.57:0/2065555069 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00b640 con 0x7f57bc069450 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57ba7fc700 1 -- 172.21.15.57:0/2065555069 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00b7a0 con 0x7f57bc069450 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.195+0000 7f57ba7fc700 1 -- 172.21.15.57:0/2065555069 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bb40 con 0x7f57bc069450 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 -- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc069450 msgr2=0x7f57bc0a3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc069450 0x7f57bc0a3df0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0098e0 tx=0x7f57ac0091a0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 -- 172.21.15.57:0/2065555069 shutdown_connections 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc069450 0x7f57bc0a3df0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/2065555069 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06e890 0x7f57bc06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 -- 172.21.15.57:0/2065555069 >> 172.21.15.57:0/2065555069 conn(0x7f57bc06af90 msgr2=0x7f57bc068af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 -- 172.21.15.57:0/2065555069 shutdown_connections 2024-03-18T14:49:56.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.196+0000 7f57c1c9c700 1 -- 172.21.15.57:0/2065555069 wait complete. 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 Processor -- start 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 -- start start 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 0x7f57bc097b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06f490 0x7f57bc151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0ae580 con 0x7f57bc06e890 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc097270 con 0x7f57bc06f490 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57c1c9c700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57bc0986f0 con 0x7f57bc069450 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57bb7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 0x7f57bc097b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57baffd700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51502/0 (socket says 172.21.15.57:51502) 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57baffd700 1 -- 172.21.15.57:0/1958759450 learned_addr learned my addr 172.21.15.57:0/1958759450 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:49:56.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.197+0000 7f57bbfff700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06f490 0x7f57bc151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 -- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 msgr2=0x7f57bc097b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 0x7f57bc097b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 -- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06f490 msgr2=0x7f57bc151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06f490 0x7f57bc151780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 -- 172.21.15.57:0/1958759450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4009420 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57bb7fe700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 0x7f57bc097b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57baffd700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f57a400ecb0 tx=0x7f57a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400c920 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400ca80 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac009420 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400ce20 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.198+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57bc096c40 con 0x7f57bc06e890 2024-03-18T14:49:56.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.199+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57bc065180 con 0x7f57bc06e890 2024-03-18T14:49:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.199+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f57a4013680 con 0x7f57bc06e890 2024-03-18T14:49:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.200+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f57a405b2d0 con 0x7f57bc06e890 2024-03-18T14:49:56.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.203+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f57a4039550 con 0x7f57bc06e890 2024-03-18T14:49:56.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.360+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57bc0a1970 con 0x7f579c045f20 2024-03-18T14:49:56.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.368+0000 7f57b37fe700 1 -- 172.21.15.57:0/1958759450 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280866 (unknown 2965378022 0 2511631759) 0x7f57bc0a1970 con 0x7f579c045f20 2024-03-18T14:49:56.373 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:49:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 >> v1:172.21.15.57:6816/47480 conn(0x7f579c045f20 legacy=0x7f579c0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 msgr2=0x7f57bc151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:49:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f57a400ecb0 tx=0x7f57a40091a0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 shutdown_connections 2024-03-18T14:49:56.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f57bc06f490 0x7f57bc151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f57bc069450 0x7f57bc097b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 --2- 172.21.15.57:0/1958759450 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57bc06e890 0x7f57bc151240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 >> 172.21.15.57:0/1958759450 conn(0x7f57bc06af90 msgr2=0x7f57bc068210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 shutdown_connections 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:49:56.371+0000 7f57c1c9c700 1 -- 172.21.15.57:0/1958759450 wait complete. 2024-03-18T14:49:56.376 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:49:56.384 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-03-18T14:49:55.588738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003177"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953506,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.46100000000000002,"5min":4.165,"15min":4.165},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":1.419,"15min":1.419},"last":0.47399999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.372,"5min":0.371,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.435}]},{"osd":2,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.498},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.083,"15min":1.1950000000000001},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.45500000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018914,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.34200000000000003,"15min":0.34699999999999998},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42899999999999999,"5min":0.501,"15min":0.501},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.629,"15min":0.629},"last":0.45300000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40300000000000002,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.51100000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56699999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.52800000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084323,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.33200000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47099999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.28899999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.245}]},{"osd":2,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53100000000000003,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.312},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.27100000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:49:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38700000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":1.034,"15min":1.034},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.33900000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051618,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44800000000000001,"5min":0.498,"15min":0.498},"last":0.318},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.34300000000000003}]},{"osd":3,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.54600000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.35699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:49:56.389 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:56.389 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:56.390 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:49:56.390 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:50:16.392 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:50:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.528+0000 7f9803888700 1 Processor -- start 2024-03-18T14:50:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 -- start start 2024-03-18T14:50:16.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 0x7f97fc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc1499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97fc0a3a80 con 0x7f97fc0a4e70 2024-03-18T14:50:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0b0350 con 0x7f97fc147610 2024-03-18T14:50:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9803888700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0a4990 con 0x7f97fc0b3250 2024-03-18T14:50:16.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9801e25700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc1499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9800e23700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97fc0a4e70 0x7f97fc06f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49700/0 (socket says 172.21.15.57:49700) 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9800e23700 1 -- 172.21.15.57:0/3509476143 learned_addr learned my addr 172.21.15.57:0/3509476143 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.529+0000 7f9801624700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 0x7f97fc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f97effff700 1 -- 172.21.15.57:0/3509476143 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676239004 0 0) 0x7f97fc0a3a80 con 0x7f97fc0a4e70 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801e25700 1 -- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 msgr2=0x7f97fc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:50:16.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801e25700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 0x7f97fc06eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801e25700 1 -- 172.21.15.57:0/3509476143 >> v1:172.21.15.57:6789/0 conn(0x7f97fc0a4e70 legacy=0x7f97fc06f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801e25700 1 -- 172.21.15.57:0/3509476143 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97fc06a3f0 con 0x7f97fc147610 2024-03-18T14:50:16.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801624700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 0x7f97fc06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:16.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f9801e25700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc1499f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009e90 tx=0x7f97f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c753c6d0fcf7c85d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:16.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f97effff700 1 -- 172.21.15.57:0/3509476143 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f400e070 con 0x7f97fc147610 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f97effff700 1 -- 172.21.15.57:0/3509476143 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f400bc30 con 0x7f97fc147610 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.530+0000 7f97effff700 1 -- 172.21.15.57:0/3509476143 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4012430 con 0x7f97fc147610 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 -- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 msgr2=0x7f97fc1499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc1499f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f97f4009e90 tx=0x7f97f4009780 comp rx=0 tx=0).stop 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 -- 172.21.15.57:0/3509476143 shutdown_connections 2024-03-18T14:50:16.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc1499f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 --2- 172.21.15.57:0/3509476143 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0b3250 0x7f97fc06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 -- 172.21.15.57:0/3509476143 >> 172.21.15.57:0/3509476143 conn(0x7f97fc06e2c0 msgr2=0x7f97fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 -- 172.21.15.57:0/3509476143 shutdown_connections 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.531+0000 7f9803888700 1 -- 172.21.15.57:0/3509476143 wait complete. 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 Processor -- start 2024-03-18T14:50:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 -- start start 2024-03-18T14:50:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 0x7f97fc14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc151560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc0981b0 con 0x7f97fc0b3250 2024-03-18T14:50:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc096af0 con 0x7f97fc147610 2024-03-18T14:50:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.532+0000 7f9803888700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97fc098bf0 con 0x7f97fc0a4e70 2024-03-18T14:50:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:36962/0 (socket says 172.21.15.57:36962) 2024-03-18T14:50:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801e25700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 -- 172.21.15.57:0/3222259578 learned_addr learned my addr 172.21.15.57:0/3222259578 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9800e23700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 0x7f97fc14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 -- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 msgr2=0x7f97fc151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 -- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 msgr2=0x7f97fc14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 0x7f97fc14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 -- 172.21.15.57:0/3222259578 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f8009420 con 0x7f97fc0a4e70 2024-03-18T14:50:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9800e23700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 0x7f97fc14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801e25700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9801624700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97f800ec80 tx=0x7f97f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800c920 con 0x7f97fc0a4e70 2024-03-18T14:50:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f800ca80 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f4009a20 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f800ce00 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.533+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97fc0aeda0 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.534+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f97f8013680 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.534+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97fc097fe0 con 0x7f97fc0a4e70 2024-03-18T14:50:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.535+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f97f805b840 con 0x7f97fc0a4e70 2024-03-18T14:50:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.538+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f97f8039a60 con 0x7f97fc0a4e70 2024-03-18T14:50:16.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.699+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97fc098320 con 0x7f97e0045ef0 2024-03-18T14:50:16.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.707+0000 7f97ed7fa700 1 -- 172.21.15.57:0/3222259578 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280880 (unknown 2965378022 0 984728817) 0x7f97fc098320 con 0x7f97e0045ef0 2024-03-18T14:50:16.715 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:50:16.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 >> v1:172.21.15.57:6816/47480 conn(0x7f97e0045ef0 legacy=0x7f97e00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 msgr2=0x7f97fc0986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:16.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97f800ec80 tx=0x7f97f80091a0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 shutdown_connections 2024-03-18T14:50:16.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f97fc147610 0x7f97fc151560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f97fc0a4e70 0x7f97fc0986b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 --2- 172.21.15.57:0/3222259578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97fc0b3250 0x7f97fc14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:16.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 >> 172.21.15.57:0/3222259578 conn(0x7f97fc06e2c0 msgr2=0x7f97fc0648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:16.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 shutdown_connections 2024-03-18T14:50:16.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:16.710+0000 7f9803888700 1 -- 172.21.15.57:0/3222259578 wait complete. 2024-03-18T14:50:16.721 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:50:16.723 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":133,"stamp":"2024-03-18T14:50:15.593898+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003204"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953510,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.23899999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.46100000000000002,"5min":4.165,"15min":4.165},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.39100000000000001,"15min":0.39700000000000002},"min":{"1min":0.22700000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.56699999999999995,"5min":1.419,"15min":1.419},"last":0.41299999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35499999999999998},"min":{"1min":0.28000000000000003,"5min":0.251,"15min":0.251},"max":{"1min":0.498,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.371,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51600000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.53500000000000003}]},{"osd":2,"last update":"Mon Mar 18 14:49:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41099999999999998,"5min":1.083,"15min":1.1950000000000001},"min":{"1min":0.33600000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54200000000000004,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.438}]}]},{"osd":2,"up_from":30,"seq":128849018918,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.34200000000000003,"15min":0.34699999999999998},"min":{"1min":0.17999999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.42899999999999999,"5min":0.501,"15min":0.501},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.46999999999999997,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.32800000000000001}]},{"osd":1,"last update":"Mon Mar 18 14:49:16 2024","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.249,"5min":0.216,"15min":0.216},"max":{"1min":0.52200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.378,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48199999999999998,"5min":0.629,"15min":0.629},"last":0.41299999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:49:20 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.40300000000000002,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.51100000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.42699999999999999,"15min":0.42599999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.56699999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.379}]}]},{"osd":0,"up_from":28,"seq":120259084327,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.33200000000000002},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":0.47099999999999997,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.29599999999999999,"15min":0.28899999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.33500000000000002}]},{"osd":2,"last update":"Mon Mar 18 14:49:15 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.53100000000000003,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.378},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.32000000000000001,"15min":0.312},"min":{"1min":0.26000000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:49:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38700000000000001,"15min":0.38200000000000001},"min":{"1min":0.28100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":1.034,"15min":1.034},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.375,"15min":0.36899999999999999},"min":{"1min":0.29699999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"last":0.41299999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051622,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.23599999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.44800000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.46100000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.26800000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.44800000000000001,"5min":0.498,"15min":0.498},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.379},"min":{"1min":0.29499999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.502,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:49:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53000000000000003,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.46400000000000002,"15min":0.46600000000000003},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.54600000000000004,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.38300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:50:16.733 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:16.734 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:16.735 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:16.736 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:50:36.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:50:36.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.871+0000 7f8922a09700 1 Processor -- start 2024-03-18T14:50:36.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.871+0000 7f8922a09700 1 -- start start 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8922a09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 0x7f891c0a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8922a09700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8922a09700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0a4ce0 con 0x7f891c0b56e0 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8922a09700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c13e440 con 0x7f891c0a1d30 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8922a09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0a3ad0 con 0x7f891c13e070 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f891bfff700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f891c0b56e0 0x7f891c13d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53026/0 (socket says 172.21.15.57:53026) 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f891bfff700 1 -- 172.21.15.57:0/219309742 learned_addr learned my addr 172.21.15.57:0/219309742 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f891b7fe700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 0x7f891c0a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.872+0000 7f8920fa6700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f891affd700 1 -- 172.21.15.57:0/219309742 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682276099 0 0) 0x7f891c0a4ce0 con 0x7f891c0b56e0 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8920fa6700 1 -- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 msgr2=0x7f891c0a4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:50:36.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8920fa6700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 0x7f891c0a4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8920fa6700 1 -- 172.21.15.57:0/219309742 >> v1:172.21.15.57:6789/0 conn(0x7f891c0b56e0 legacy=0x7f891c13d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8920fa6700 1 -- 172.21.15.57:0/219309742 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0a7230 con 0x7f891c0a1d30 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f891b7fe700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 0x7f891c0a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8920fa6700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c148dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e90 tx=0x7f8914009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8605ff594f68afbe server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f891affd700 1 -- 172.21.15.57:0/219309742 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891400e070 con 0x7f891c0a1d30 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f891affd700 1 -- 172.21.15.57:0/219309742 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891400bc30 con 0x7f891c0a1d30 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f891affd700 1 -- 172.21.15.57:0/219309742 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914012430 con 0x7f891c0a1d30 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 -- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 msgr2=0x7f891c148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c148dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8914009e90 tx=0x7f8914009780 comp rx=0 tx=0).stop 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 -- 172.21.15.57:0/219309742 shutdown_connections 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c148dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 --2- 172.21.15.57:0/219309742 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c13e070 0x7f891c0a4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.873+0000 7f8922a09700 1 -- 172.21.15.57:0/219309742 >> 172.21.15.57:0/219309742 conn(0x7f891c06fb90 msgr2=0x7f891c0b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:36.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.874+0000 7f8922a09700 1 -- 172.21.15.57:0/219309742 shutdown_connections 2024-03-18T14:50:36.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.874+0000 7f8922a09700 1 -- 172.21.15.57:0/219309742 wait complete. 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.874+0000 7f8922a09700 1 Processor -- start 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 -- start start 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c0b56e0 0x7f891c13f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891c13e070 0x7f891c13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c098090 con 0x7f891c13e070 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c1412b0 con 0x7f891c0a1d30 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8922a09700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0982a0 con 0x7f891c0b56e0 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f891bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:36.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f891b7fe700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c0b56e0 0x7f891c13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f891bfff700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:45278/0 (socket says 172.21.15.57:45278) 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f891bfff700 1 -- 172.21.15.57:0/3764987596 learned_addr learned my addr 172.21.15.57:0/3764987596 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.875+0000 7f8920fa6700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891c13e070 0x7f891c13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 -- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c0b56e0 msgr2=0x7f891c13f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c0b56e0 0x7f891c13f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 -- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891c13e070 msgr2=0x7f891c13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891c13e070 0x7f891c13fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 -- 172.21.15.57:0/3764987596 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904009420 con 0x7f891c0a1d30 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f891bfff700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c810 tx=0x7f890c007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c005c00 con 0x7f891c0a1d30 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c005d60 con 0x7f891c0a1d30 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8914009a20 con 0x7f891c0a1d30 2024-03-18T14:50:36.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c007320 con 0x7f891c0a1d30 2024-03-18T14:50:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.876+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c0b5170 con 0x7f891c0a1d30 2024-03-18T14:50:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.877+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c065180 con 0x7f891c0a1d30 2024-03-18T14:50:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.877+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f890c01b3b0 con 0x7f891c0a1d30 2024-03-18T14:50:36.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.877+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f890c05a5a0 con 0x7f891c0a1d30 2024-03-18T14:50:36.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:36.881+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f890c0387c0 con 0x7f891c0a1d30 2024-03-18T14:50:37.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.039+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f891c0a7490 con 0x7f88fc045ef0 2024-03-18T14:50:37.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.046+0000 7f8913fff700 1 -- 172.21.15.57:0/3764987596 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280965 (unknown 2965378022 0 1384263088) 0x7f891c0a7490 con 0x7f88fc045ef0 2024-03-18T14:50:37.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:50:37.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 >> v1:172.21.15.57:6816/47480 conn(0x7f88fc045ef0 legacy=0x7f88fc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:37.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 msgr2=0x7f891c097b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:37.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f890c00c810 tx=0x7f890c007d90 comp rx=0 tx=0).stop 2024-03-18T14:50:37.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 shutdown_connections 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f891c13e070 0x7f891c13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f891c0a1d30 0x7f891c097b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 --2- 172.21.15.57:0/3764987596 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f891c0b56e0 0x7f891c13f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 >> 172.21.15.57:0/3764987596 conn(0x7f891c06fb90 msgr2=0x7f891c13d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 shutdown_connections 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:37.049+0000 7f8922a09700 1 -- 172.21.15.57:0/3764987596 wait complete. 2024-03-18T14:50:37.053 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:50:37.061 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-03-18T14:50:35.598886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003066"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953514,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.44600000000000001,"15min":0.49199999999999999},"min":{"1min":0.27200000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.49099999999999999,"5min":4.165,"15min":4.165},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38700000000000001,"15min":0.39500000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":1.419,"15min":1.419},"last":0.29999999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.377,"15min":0.373},"min":{"1min":0.29299999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38500000000000001},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.501,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.91400000000000003,"15min":1.139},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53100000000000003,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.35599999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018922,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.25900000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.501,"15min":0.501},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.30599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48999999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.28699999999999998}]},{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.48799999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.309},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.312,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.629,"15min":0.629},"last":0.40799999999999997}]},{"osd":3,"last update":"Mon Mar 18 14:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.372,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.59399999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.39200000000000002}]}]},{"osd":0,"up_from":28,"seq":120259084331,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33100000000000002},"min":{"1min":0.23100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.42099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.29199999999999998},"min":{"1min":0.245,"5min":0.217,"15min":0.217},"max":{"1min":0.45400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47499999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.315},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.497,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28499999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61899999999999999,"5min":1.034,"15min":1.034},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.372},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.39900000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051626,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.28699999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.29799999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.42899999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54000000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.379},{"interface":"front","average":{"1min":0.439,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.61399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.39300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:50:37.066 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:37.066 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:37.067 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:37.067 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:50:57.068 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.203+0000 7fd3671e0700 1 Processor -- start 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.203+0000 7fd3671e0700 1 -- start start 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd3671e0700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 0x7fd36006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd3671e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd3671e0700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3600a3a80 con 0x7fd3600b3250 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd3671e0700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3600b0350 con 0x7fd3600a4e70 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd3671e0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3600a4990 con 0x7fd360147610 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd35ffff700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 0x7fd36006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:57.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:52772/0 (socket says 172.21.15.57:52772) 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 -- 172.21.15.57:0/44495213 learned_addr learned my addr 172.21.15.57:0/44495213 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 -- 172.21.15.57:0/44495213 >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 msgr2=0x7fd36006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 --2- 172.21.15.57:0/44495213 >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 0x7fd36006f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 -- 172.21.15.57:0/44495213 >> v1:172.21.15.57:6789/0 conn(0x7fd3600b3250 legacy=0x7fd36006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd36577d700 1 -- 172.21.15.57:0/44495213 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36006a3f0 con 0x7fd360147610 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd35ffff700 1 --2- 172.21.15.57:0/44495213 >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 0x7fd36006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.204+0000 7fd35f7fe700 1 -- 172.21.15.57:0/44495213 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142885649 0 0) 0x7fd3600a3a80 con 0x7fd3600b3250 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd36577d700 1 --2- 172.21.15.57:0/44495213 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd358009f20 tx=0x7fd358009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b7e4e8f34b798d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd35f7fe700 1 -- 172.21.15.57:0/44495213 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800e070 con 0x7fd360147610 2024-03-18T14:50:57.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd35f7fe700 1 -- 172.21.15.57:0/44495213 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800b9d0 con 0x7fd360147610 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd35f7fe700 1 -- 172.21.15.57:0/44495213 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580092e0 con 0x7fd360147610 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 -- 172.21.15.57:0/44495213 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 msgr2=0x7fd3601499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 --2- 172.21.15.57:0/44495213 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd358009f20 tx=0x7fd358009840 comp rx=0 tx=0).stop 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 -- 172.21.15.57:0/44495213 shutdown_connections 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 --2- 172.21.15.57:0/44495213 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd3601499f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 --2- 172.21.15.57:0/44495213 >> v2:172.21.15.57:3300/0 conn(0x7fd3600a4e70 0x7fd36006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 -- 172.21.15.57:0/44495213 >> 172.21.15.57:0/44495213 conn(0x7fd36006e2c0 msgr2=0x7fd36006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 -- 172.21.15.57:0/44495213 shutdown_connections 2024-03-18T14:50:57.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.205+0000 7fd3671e0700 1 -- 172.21.15.57:0/44495213 wait complete. 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.206+0000 7fd3671e0700 1 Processor -- start 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.206+0000 7fd3671e0700 1 -- start start 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 0x7fd360098800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36014e4f0 con 0x7fd3600a4e70 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd360098d40 con 0x7fd3600b3250 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd3671e0700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd360098020 con 0x7fd360147610 2024-03-18T14:50:57.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd364f7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd36577d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd364f7c700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38998/0 (socket says 172.21.15.57:38998) 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd364f7c700 1 -- 172.21.15.57:0/2526572758 learned_addr learned my addr 172.21.15.57:0/2526572758 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd36577d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:52774/0 (socket says 172.21.15.57:52774) 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.207+0000 7fd35ffff700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 0x7fd360098800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 -- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 msgr2=0x7fd36014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 -- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 msgr2=0x7fd360098800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 0x7fd360098800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 -- 172.21.15.57:0/2526572758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009420 con 0x7fd3600a4e70 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd36577d700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd35ffff700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 0x7fd360098800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd364f7c700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c7e0 tx=0x7fd354007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011590 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd354011710 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358009ae0 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354011ad0 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.208+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36014e1f0 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.209+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd360065180 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.209+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fd35401b3b0 con 0x7fd3600a4e70 2024-03-18T14:50:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.209+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7fd35405a5e0 con 0x7fd3600a4e70 2024-03-18T14:50:57.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.213+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fd354038800 con 0x7fd3600a4e70 2024-03-18T14:50:57.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.370+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3600b2180 con 0x7fd344045ef0 2024-03-18T14:50:57.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.378+0000 7fd35cff9700 1 -- 172.21.15.57:0/2526572758 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280963 (unknown 2965378022 0 3058257415) 0x7fd3600b2180 con 0x7fd344045ef0 2024-03-18T14:50:57.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:50:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 >> v1:172.21.15.57:6816/47480 conn(0x7fd344045ef0 legacy=0x7fd3440483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 msgr2=0x7fd360152200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd35400c7e0 tx=0x7fd354007da0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 shutdown_connections 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fd360147610 0x7fd36014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3600a4e70 0x7fd360152200 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 --2- 172.21.15.57:0/2526572758 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fd3600b3250 0x7fd360098800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 >> 172.21.15.57:0/2526572758 conn(0x7fd36006e2c0 msgr2=0x7fd36006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 shutdown_connections 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:50:57.381+0000 7fd3671e0700 1 -- 172.21.15.57:0/2526572758 wait complete. 2024-03-18T14:50:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:50:57.394 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-03-18T14:50:55.603986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003043"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953518,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.44600000000000001,"15min":0.49199999999999999},"min":{"1min":0.27200000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.49099999999999999,"5min":4.165,"15min":4.165},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38700000000000001,"15min":0.39500000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":1.419,"15min":1.419},"last":0.30499999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.377,"15min":0.373},"min":{"1min":0.29299999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38500000000000001},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.501,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.373},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.91400000000000003,"15min":1.139},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53100000000000003,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.38300000000000001}]}]},{"osd":2,"up_from":30,"seq":128849018926,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.25900000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.501,"15min":0.501},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.30599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48999999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.48799999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.312,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.629,"15min":0.629},"last":0.35999999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.372,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.59399999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.42199999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084335,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33100000000000002},"min":{"1min":0.23100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.42099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.29199999999999998},"min":{"1min":0.245,"5min":0.217,"15min":0.217},"max":{"1min":0.45400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.47599999999999998}]},{"osd":2,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47499999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.315},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.497,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.5}]},{"osd":3,"last update":"Mon Mar 18 14:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61899999999999999,"5min":1.034,"15min":1.034},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.372},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.54300000000000004}]}]},{"osd":1,"up_from":29,"seq":124554051630,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.28699999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54000000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.61399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:50:57.445 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:57.445 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:57.446 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:50:57.446 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:51:17.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:51:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.584+0000 7f7d643af700 1 Processor -- start 2024-03-18T14:51:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.584+0000 7f7d643af700 1 -- start start 2024-03-18T14:51:17.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d643af700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 0x7f7d5c13fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d643af700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d643af700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5c06c550 con 0x7f7d5c0680f0 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d643af700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a44f0 con 0x7f7d5c0a70f0 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d643af700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c13f710 con 0x7f7d5c144920 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d6194a700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 0x7f7d5c13fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:17.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d6294c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d6214b700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7d5c0680f0 0x7f7d5c0a4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37648/0 (socket says 172.21.15.57:37648) 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.585+0000 7f7d6214b700 1 -- 172.21.15.57:0/541571789 learned_addr learned my addr 172.21.15.57:0/541571789 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6294c700 1 -- 172.21.15.57:0/541571789 >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 msgr2=0x7f7d5c13fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6294c700 1 --2- 172.21.15.57:0/541571789 >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 0x7f7d5c13fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6294c700 1 -- 172.21.15.57:0/541571789 >> v1:172.21.15.57:6789/0 conn(0x7f7d5c0680f0 legacy=0x7f7d5c0a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6294c700 1 -- 172.21.15.57:0/541571789 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c13f9d0 con 0x7f7d5c144920 2024-03-18T14:51:17.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6194a700 1 --2- 172.21.15.57:0/541571789 >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 0x7f7d5c13fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d6294c700 1 --2- 172.21.15.57:0/541571789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c146d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009e60 tx=0x7f7d54009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8331cc4be7f20270 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d61149700 1 -- 172.21.15.57:0/541571789 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5400e070 con 0x7f7d5c144920 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d61149700 1 -- 172.21.15.57:0/541571789 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5400bb60 con 0x7f7d5c144920 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.586+0000 7f7d61149700 1 -- 172.21.15.57:0/541571789 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54012430 con 0x7f7d5c144920 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 -- 172.21.15.57:0/541571789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 msgr2=0x7f7d5c146d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 --2- 172.21.15.57:0/541571789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c146d00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009e60 tx=0x7f7d54009780 comp rx=0 tx=0).stop 2024-03-18T14:51:17.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 -- 172.21.15.57:0/541571789 shutdown_connections 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 --2- 172.21.15.57:0/541571789 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c146d00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 --2- 172.21.15.57:0/541571789 >> v2:172.21.15.57:3300/0 conn(0x7f7d5c0a70f0 0x7f7d5c13fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 -- 172.21.15.57:0/541571789 >> 172.21.15.57:0/541571789 conn(0x7f7d5c06bfc0 msgr2=0x7f7d5c0679e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 -- 172.21.15.57:0/541571789 shutdown_connections 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.587+0000 7f7d643af700 1 -- 172.21.15.57:0/541571789 wait complete. 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 Processor -- start 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 -- start start 2024-03-18T14:51:17.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0a70f0 0x7f7d5c0a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a95e0 con 0x7f7d5c0680f0 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0aa930 con 0x7f7d5c0a70f0 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d643af700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0a9210 con 0x7f7d5c144920 2024-03-18T14:51:17.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6214b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6294c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6194a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0a70f0 0x7f7d5c0a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6214b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:42804/0 (socket says 172.21.15.57:42804) 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6214b700 1 -- 172.21.15.57:0/636119806 learned_addr learned my addr 172.21.15.57:0/636119806 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.588+0000 7f7d6294c700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:50124/0 (socket says 172.21.15.57:50124) 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 -- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0a70f0 msgr2=0x7f7d5c0a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0a70f0 0x7f7d5c0a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 -- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 msgr2=0x7f7d5c0ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 -- 172.21.15.57:0/636119806 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c009420 con 0x7f7d5c144920 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6214b700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d6294c700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d54016000 tx=0x7f7d54019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54007000 con 0x7f7d5c144920 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54012e60 con 0x7f7d5c144920 2024-03-18T14:51:17.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54009a20 con 0x7f7d5c144920 2024-03-18T14:51:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54025670 con 0x7f7d5c144920 2024-03-18T14:51:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.589+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c0aa080 con 0x7f7d5c144920 2024-03-18T14:51:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.590+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f7d54003050 con 0x7f7d5c144920 2024-03-18T14:51:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.590+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c065180 con 0x7f7d5c144920 2024-03-18T14:51:17.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.590+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f7d5405cda0 con 0x7f7d5c144920 2024-03-18T14:51:17.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.594+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f7d5402e5c0 con 0x7f7d5c144920 2024-03-18T14:51:17.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.757+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d5c0a3890 con 0x7f7d40045ef0 2024-03-18T14:51:17.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.764+0000 7f7d527fc700 1 -- 172.21.15.57:0/636119806 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280923 (unknown 2965378022 0 1961256403) 0x7f7d5c0a3890 con 0x7f7d40045ef0 2024-03-18T14:51:17.769 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 >> v1:172.21.15.57:6816/47480 conn(0x7f7d40045ef0 legacy=0x7f7d400483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 msgr2=0x7f7d5c138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d54016000 tx=0x7f7d54019000 comp rx=0 tx=0).stop 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 shutdown_connections 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f7d5c144920 0x7f7d5c138930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7d5c0680f0 0x7f7d5c0ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 --2- 172.21.15.57:0/636119806 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f7d5c0a70f0 0x7f7d5c0a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 >> 172.21.15.57:0/636119806 conn(0x7f7d5c06bfc0 msgr2=0x7f7d5c13fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 shutdown_connections 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:17.767+0000 7f7d643af700 1 -- 172.21.15.57:0/636119806 wait complete. 2024-03-18T14:51:17.772 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:51:17.780 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2024-03-18T14:51:17.610009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003323"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953522,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.44600000000000001,"15min":0.49199999999999999},"min":{"1min":0.27200000000000002,"5min":0.193,"15min":0.193},"max":{"1min":0.49099999999999999,"5min":4.165,"15min":4.165},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38700000000000001,"15min":0.39500000000000002},"min":{"1min":0.24099999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52900000000000003,"5min":1.419,"15min":1.419},"last":0.42599999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.29199999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.377,"15min":0.373},"min":{"1min":0.29299999999999998,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53500000000000003,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.496}]},{"osd":2,"last update":"Mon Mar 18 14:50:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39100000000000001,"15min":0.38500000000000001},"min":{"1min":0.32000000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.501,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.91400000000000003,"15min":1.139},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53100000000000003,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.46200000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018931,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.25900000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.435,"5min":0.501,"15min":0.501},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.30599999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.48999999999999999,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.39400000000000002}]},{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.48799999999999999,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.372},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.312,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.629,"15min":0.629},"last":0.34599999999999997}]},{"osd":3,"last update":"Mon Mar 18 14:50:23 2024","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.40000000000000002,"15min":0.40500000000000003},"min":{"1min":0.27600000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.61099999999999999,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.42899999999999999,"15min":0.42699999999999999},"min":{"1min":0.372,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.59399999999999997,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.41399999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084339,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.32800000000000001,"15min":0.33100000000000002},"min":{"1min":0.23100000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.42099999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.29199999999999998},"min":{"1min":0.245,"5min":0.217,"15min":0.217},"max":{"1min":0.45400000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:50:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.35999999999999999,"15min":0.35499999999999998},"min":{"1min":0.29099999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.47499999999999998,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.315},"min":{"1min":0.27100000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.497,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Mar 18 14:50:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39400000000000002,"15min":0.38400000000000001},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.61899999999999999,"5min":1.034,"15min":1.034},"last":0.503},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.372},"min":{"1min":0.33900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.52700000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051635,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34000000000000002,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.222,"15min":0.222},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.28699999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.375}]},{"osd":2,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.28899999999999998,"5min":0.214,"15min":0.214},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.439}]},{"osd":3,"last update":"Mon Mar 18 14:50:19 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.41199999999999998,"15min":0.41599999999999998},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54000000000000004,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.45800000000000002,"15min":0.46400000000000002},"min":{"1min":0.34200000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.61399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:51:17.785 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:17.786 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:17.786 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:17.787 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:51:37.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:51:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.920+0000 7fcf3866d700 1 Processor -- start 2024-03-18T14:51:37.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.920+0000 7fcf3866d700 1 -- start start 2024-03-18T14:51:37.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.920+0000 7fcf3866d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf3006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf3866d700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf3866d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf30148610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf3866d700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf300a3a80 con 0x7fcf300a4e70 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf3866d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b0350 con 0x7fcf300b3250 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf3866d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300a4990 con 0x7fcf3006f5f0 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35c08700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf30148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35c08700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57240/0 (socket says 172.21.15.57:57240) 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35c08700 1 -- 172.21.15.57:0/4046970976 learned_addr learned my addr 172.21.15.57:0/4046970976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36409700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf3006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 -- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 msgr2=0x7fcf3006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf3006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 -- 172.21.15.57:0/4046970976 >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 msgr2=0x7fcf3006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:51:37.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 --2- 172.21.15.57:0/4046970976 >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 -- 172.21.15.57:0/4046970976 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3006a3f0 con 0x7fcf3006f5f0 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35c08700 1 --2- 172.21.15.57:0/4046970976 >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36409700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf3006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf36c0a700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf30148610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009e60 tx=0x7fcf28009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=809416867257642a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35407700 1 -- 172.21.15.57:0/4046970976 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800e070 con 0x7fcf3006f5f0 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35407700 1 -- 172.21.15.57:0/4046970976 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800bab0 con 0x7fcf3006f5f0 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.921+0000 7fcf35407700 1 -- 172.21.15.57:0/4046970976 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800be70 con 0x7fcf3006f5f0 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 -- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 msgr2=0x7fcf30148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf30148610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcf28009e60 tx=0x7fcf28009780 comp rx=0 tx=0).stop 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 -- 172.21.15.57:0/4046970976 shutdown_connections 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf30148610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 --2- 172.21.15.57:0/4046970976 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf3006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 --2- 172.21.15.57:0/4046970976 >> v2:172.21.15.57:3300/0 conn(0x7fcf300a4e70 0x7fcf3006f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 -- 172.21.15.57:0/4046970976 >> 172.21.15.57:0/4046970976 conn(0x7fcf3006e2c0 msgr2=0x7fcf3006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 -- 172.21.15.57:0/4046970976 shutdown_connections 2024-03-18T14:51:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.922+0000 7fcf3866d700 1 -- 172.21.15.57:0/4046970976 wait complete. 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.923+0000 7fcf3866d700 1 Processor -- start 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.923+0000 7fcf3866d700 1 -- start start 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf300ab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300aea40 con 0x7fcf300a4e70 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300af7e0 con 0x7fcf300b3250 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf3866d700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300aec30 con 0x7fcf3006f5f0 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf36409700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:57250/0 (socket says 172.21.15.57:57250) 2024-03-18T14:51:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf36409700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:34652/0 (socket says 172.21.15.57:34652) 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf36c0a700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf300ab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 -- 172.21.15.57:0/310833070 learned_addr learned my addr 172.21.15.57:0/310833070 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 -- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 msgr2=0x7fcf300ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 -- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 msgr2=0x7fcf300ab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf300ab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 -- 172.21.15.57:0/310833070 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200094f0 con 0x7fcf300a4e70 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf36c0a700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf300ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf36409700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf35c08700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000ec50 tx=0x7fcf20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.924+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2000c8e0 con 0x7fcf300a4e70 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.925+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2000ca40 con 0x7fcf300a4e70 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.925+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2000cde0 con 0x7fcf300a4e70 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.925+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c009420 con 0x7fcf300a4e70 2024-03-18T14:51:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.925+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28009a20 con 0x7fcf300a4e70 2024-03-18T14:51:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.925+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fcf20013680 con 0x7fcf300a4e70 2024-03-18T14:51:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.926+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30065180 con 0x7fcf300a4e70 2024-03-18T14:51:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.926+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7fcf2005b470 con 0x7fcf300a4e70 2024-03-18T14:51:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:37.930+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7fcf200396f0 con 0x7fcf300a4e70 2024-03-18T14:51:38.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.086+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf300a4c50 con 0x7fcf14045ef0 2024-03-18T14:51:38.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.094+0000 7fcf267fc700 1 -- 172.21.15.57:0/310833070 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280906 (unknown 2965378022 0 2985304296) 0x7fcf300a4c50 con 0x7fcf14045ef0 2024-03-18T14:51:38.099 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 >> v1:172.21.15.57:6816/47480 conn(0x7fcf14045ef0 legacy=0x7fcf140483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 msgr2=0x7fcf300ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000ec50 tx=0x7fcf20009250 comp rx=0 tx=0).stop 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 shutdown_connections 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fcf300b3250 0x7fcf300ab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fcf3006f5f0 0x7fcf300ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 --2- 172.21.15.57:0/310833070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcf300a4e70 0x7fcf300ab4a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 >> 172.21.15.57:0/310833070 conn(0x7fcf3006e2c0 msgr2=0x7fcf300648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:38.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 shutdown_connections 2024-03-18T14:51:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:38.097+0000 7fcf3866d700 1 -- 172.21.15.57:0/310833070 wait complete. 2024-03-18T14:51:38.102 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:51:38.109 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2024-03-18T14:51:37.614473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002764"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953526,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.41599999999999998,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.53900000000000003,"5min":4.165,"15min":4.165},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27800000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51600000000000001,"5min":1.419,"15min":1.419},"last":0.40000000000000002}]},{"osd":1,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.376}]},{"osd":2,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.746,"15min":1.083},"min":{"1min":0.29299999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.35299999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018935,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.54900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.30499999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52400000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.27600000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.629,"15min":0.629},"last":0.26900000000000002}]},{"osd":3,"last update":"Mon Mar 18 14:51:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.55700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57099999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38}]}]},{"osd":0,"up_from":28,"seq":120259084343,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.254,"5min":0.182,"15min":0.182},"max":{"1min":0.52700000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.32300000000000001,"15min":0.29799999999999999},"min":{"1min":0.27200000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58599999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.32100000000000001},"min":{"1min":0.28499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.28899999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40600000000000003,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52900000000000003,"5min":1.034,"15min":1.034},"last":0.374},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.377},"min":{"1min":0.33200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.39900000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051639,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.223},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.253}]},{"osd":2,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.48299999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51100000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.314},{"interface":"front","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.59099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.34599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:51:38.114 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:38.114 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:38.115 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:38.115 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T14:51:58.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T14:51:58.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 Processor -- start 2024-03-18T14:51:58.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 -- start start 2024-03-18T14:51:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 0x7f38500a4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 0x7f3850148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38500a4ce0 con 0x7f38500b56e0 2024-03-18T14:51:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385013e440 con 0x7f38500a1d30 2024-03-18T14:51:58.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.250+0000 7f38578f6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38500a3ad0 con 0x7f385013e070 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3855e93700 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 0x7f3850148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 0x7f38500a4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3855692700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f38500b56e0 0x7f385013d960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53290/0 (socket says 172.21.15.57:53290) 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3855692700 1 -- 172.21.15.57:0/4138285455 learned_addr learned my addr 172.21.15.57:0/4138285455 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 -- 172.21.15.57:0/4138285455 >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 msgr2=0x7f3850148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 --2- 172.21.15.57:0/4138285455 >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 0x7f3850148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 -- 172.21.15.57:0/4138285455 >> v1:172.21.15.57:6789/0 conn(0x7f38500b56e0 legacy=0x7f385013d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 -- 172.21.15.57:0/4138285455 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38500a7230 con 0x7f385013e070 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3855e93700 1 --2- 172.21.15.57:0/4138285455 >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 0x7f3850148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3847fff700 1 -- 172.21.15.57:0/4138285455 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738845789 0 0) 0x7f38500a4ce0 con 0x7f38500b56e0 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3854e91700 1 --2- 172.21.15.57:0/4138285455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 0x7f38500a4600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38400098e0 tx=0x7f38400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24995f131026ebb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3847fff700 1 -- 172.21.15.57:0/4138285455 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384000b640 con 0x7f385013e070 2024-03-18T14:51:58.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3847fff700 1 -- 172.21.15.57:0/4138285455 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384000b7a0 con 0x7f385013e070 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.251+0000 7f3847fff700 1 -- 172.21.15.57:0/4138285455 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384000bb40 con 0x7f385013e070 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 -- 172.21.15.57:0/4138285455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 msgr2=0x7f38500a4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 --2- 172.21.15.57:0/4138285455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 0x7f38500a4600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f38400098e0 tx=0x7f38400091a0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 -- 172.21.15.57:0/4138285455 shutdown_connections 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 --2- 172.21.15.57:0/4138285455 >> v2:172.21.15.57:3300/0 conn(0x7f38500a1d30 0x7f3850148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 --2- 172.21.15.57:0/4138285455 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f385013e070 0x7f38500a4600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 -- 172.21.15.57:0/4138285455 >> 172.21.15.57:0/4138285455 conn(0x7f385006fb90 msgr2=0x7f38500b4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 -- 172.21.15.57:0/4138285455 shutdown_connections 2024-03-18T14:51:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.252+0000 7f38578f6700 1 -- 172.21.15.57:0/4138285455 wait complete. 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.253+0000 7f38578f6700 1 Processor -- start 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.253+0000 7f38578f6700 1 -- start start 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 0x7f3850151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 0x7f3850151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850140b60 con 0x7f385013e070 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3850138da0 con 0x7f38500a1d30 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3850139060 con 0x7f38500b56e0 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855e93700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 0x7f3850151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3301/0 says I am v2:172.21.15.57:47784/0 (socket says 172.21.15.57:47784) 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 -- 172.21.15.57:0/630240733 learned_addr learned my addr 172.21.15.57:0/630240733 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3854e91700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 0x7f3850151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 -- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 msgr2=0x7f3850151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 0x7f3850151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 -- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 msgr2=0x7f3850151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 0x7f3850151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 -- 172.21.15.57:0/630240733 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848009a20 con 0x7f38500a1d30 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855e93700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 0x7f3850151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3854e91700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 0x7f3850151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f3855692700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c810 tx=0x7f384c007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c005c00 con 0x7f38500a1d30 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c005d60 con 0x7f38500a1d30 2024-03-18T14:51:58.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c007320 con 0x7f38500a1d30 2024-03-18T14:51:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.254+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3840009420 con 0x7f38500a1d30 2024-03-18T14:51:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.255+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38501394d0 con 0x7f38500a1d30 2024-03-18T14:51:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.255+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7f384c01b3b0 con 0x7f38500a1d30 2024-03-18T14:51:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.256+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38500b4320 con 0x7f38500a1d30 2024-03-18T14:51:58.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.256+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7f384c05a5c0 con 0x7f38500a1d30 2024-03-18T14:51:58.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.260+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mon.1 v2:172.21.15.57:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+138670 (secure 0 0 0) 0x7f384c0388a0 con 0x7f38500a1d30 2024-03-18T14:51:58.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.415+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 --> v1:172.21.15.57:6816/47480 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38500a7490 con 0x7f3834045ef0 2024-03-18T14:51:58.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.422+0000 7f38457fa700 1 -- 172.21.15.57:0/630240733 <== mgr.14102 v1:172.21.15.57:6816/47480 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280977 (unknown 2965378022 0 3244903978) 0x7f38500a7490 con 0x7f3834045ef0 2024-03-18T14:51:58.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-18T14:51:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 >> v1:172.21.15.57:6816/47480 conn(0x7f3834045ef0 legacy=0x7f38340483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 msgr2=0x7f3850140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c810 tx=0x7f384c007d90 comp rx=0 tx=0).stop 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 shutdown_connections 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f385013e070 0x7f3850151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7f38500a1d30 0x7f3850140280 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 --2- 172.21.15.57:0/630240733 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7f38500b56e0 0x7f3850151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 >> 172.21.15.57:0/630240733 conn(0x7f385006fb90 msgr2=0x7f38500a5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 shutdown_connections 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.425+0000 7f38578f6700 1 -- 172.21.15.57:0/630240733 wait complete. 2024-03-18T14:51:58.429 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-18T14:51:58.437 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-03-18T14:51:57.619485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":137749968,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":6311,"num_read_kb":3053165,"num_write":65077,"num_write_kb":8749065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71548,"ondisk_log_size":71548,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1537400,"kb_used_data":270872,"kb_used_omap":816,"kb_used_meta":1265679,"kb_avail":375949960,"statfs":{"total":386547056640,"available":384972759040,"internally_reserved":0,"allocated":277372928,"data_stored":276269660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":1296055579},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003153"},"pg_stats":[{"pgid":"4.3f","version":"19'800","reported_seq":898,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.890750+0000","last_change":"2024-03-18T14:48:00.890694+0000","last_active":"2024-03-18T14:48:00.890750+0000","last_peered":"2024-03-18T14:48:00.890750+0000","last_clean":"2024-03-18T14:48:00.890750+0000","last_became_active":"2024-03-18T14:47:17.482446+0000","last_became_peered":"2024-03-18T14:47:17.482446+0000","last_unstale":"2024-03-18T14:48:00.890750+0000","last_undegraded":"2024-03-18T14:48:00.890750+0000","last_fullsized":"2024-03-18T14:48:00.890750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:00.890570+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.890570+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:36:18.488889+0000","scrub_duration":0.0018543019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":27639,"num_write":756,"num_write_kb":86639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"19'812","reported_seq":943,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419867+0000","last_change":"2024-03-18T14:47:54.902406+0000","last_active":"2024-03-18T14:47:59.419867+0000","last_peered":"2024-03-18T14:47:59.419867+0000","last_clean":"2024-03-18T14:47:59.419867+0000","last_became_active":"2024-03-18T14:47:14.581766+0000","last_became_peered":"2024-03-18T14:47:14.581766+0000","last_unstale":"2024-03-18T14:47:59.419867+0000","last_undegraded":"2024-03-18T14:47:59.419867+0000","last_fullsized":"2024-03-18T14:47:59.419867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:47:54.902287+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.902287+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:19:37.161102+0000","scrub_duration":0.0018852230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":32976,"num_write":762,"num_write_kb":89841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"19'814","reported_seq":963,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:07.220006+0000","last_change":"2024-03-18T14:48:07.219972+0000","last_active":"2024-03-18T14:48:07.220006+0000","last_peered":"2024-03-18T14:48:07.220006+0000","last_clean":"2024-03-18T14:48:07.220006+0000","last_became_active":"2024-03-18T14:47:13.578352+0000","last_became_peered":"2024-03-18T14:47:13.578352+0000","last_unstale":"2024-03-18T14:48:07.220006+0000","last_undegraded":"2024-03-18T14:48:07.220006+0000","last_fullsized":"2024-03-18T14:48:07.220006+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'814","last_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_deep_scrub":"19'814","last_deep_scrub_stamp":"2024-03-18T14:48:07.219861+0000","last_clean_scrub_stamp":"2024-03-18T14:48:07.219861+0000","objects_scrubbed":0,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:21:18.055387+0000","scrub_duration":0.0020762950000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":50921,"num_write":765,"num_write_kb":152120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"19'772","reported_seq":943,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.256745+0000","last_change":"2024-03-18T14:48:40.256714+0000","last_active":"2024-03-18T14:48:40.256745+0000","last_peered":"2024-03-18T14:48:40.256745+0000","last_clean":"2024-03-18T14:48:40.256745+0000","last_became_active":"2024-03-18T14:47:13.599896+0000","last_became_peered":"2024-03-18T14:47:13.599896+0000","last_unstale":"2024-03-18T14:48:40.256745+0000","last_undegraded":"2024-03-18T14:48:40.256745+0000","last_fullsized":"2024-03-18T14:48:40.256745+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:40.256611+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.256611+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:36:14.229565+0000","scrub_duration":0.0019834219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":63279,"num_write":729,"num_write_kb":188601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"19'772","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.253685+0000","last_change":"2024-03-18T14:48:30.253656+0000","last_active":"2024-03-18T14:48:30.253685+0000","last_peered":"2024-03-18T14:48:30.253685+0000","last_clean":"2024-03-18T14:48:30.253685+0000","last_became_active":"2024-03-18T14:47:17.465144+0000","last_became_peered":"2024-03-18T14:47:17.465144+0000","last_unstale":"2024-03-18T14:48:30.253685+0000","last_undegraded":"2024-03-18T14:48:30.253685+0000","last_fullsized":"2024-03-18T14:48:30.253685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'772","last_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_deep_scrub":"19'772","last_deep_scrub_stamp":"2024-03-18T14:48:30.253537+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.253537+0000","objects_scrubbed":0,"log_size":772,"log_dups_size":0,"ondisk_log_size":772,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:32:28.426868+0000","scrub_duration":0.0018720399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32975,"num_write":726,"num_write_kb":105307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"19'792","reported_seq":922,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.341608+0000","last_change":"2024-03-18T14:48:13.341577+0000","last_active":"2024-03-18T14:48:13.341608+0000","last_peered":"2024-03-18T14:48:13.341608+0000","last_clean":"2024-03-18T14:48:13.341608+0000","last_became_active":"2024-03-18T14:47:17.463126+0000","last_became_peered":"2024-03-18T14:47:17.463126+0000","last_unstale":"2024-03-18T14:48:13.341608+0000","last_undegraded":"2024-03-18T14:48:13.341608+0000","last_fullsized":"2024-03-18T14:48:13.341608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:13.341454+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.341454+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:38:06.042949+0000","scrub_duration":0.0020170190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":41144,"num_write":751,"num_write_kb":126874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"19'816","reported_seq":975,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:50.034526+0000","last_change":"2024-03-18T14:48:50.034483+0000","last_active":"2024-03-18T14:48:50.034526+0000","last_peered":"2024-03-18T14:48:50.034526+0000","last_clean":"2024-03-18T14:48:50.034526+0000","last_became_active":"2024-03-18T14:47:17.509219+0000","last_became_peered":"2024-03-18T14:47:17.509219+0000","last_unstale":"2024-03-18T14:48:50.034526+0000","last_undegraded":"2024-03-18T14:48:50.034526+0000","last_fullsized":"2024-03-18T14:48:50.034526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'816","last_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_deep_scrub":"19'816","last_deep_scrub_stamp":"2024-03-18T14:48:50.034375+0000","last_clean_scrub_stamp":"2024-03-18T14:48:50.034375+0000","objects_scrubbed":0,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:20:16.029123+0000","scrub_duration":0.0021240230000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":49535,"num_write":778,"num_write_kb":130401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"19'702","reported_seq":822,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:55.884974+0000","last_change":"2024-03-18T14:48:55.884927+0000","last_active":"2024-03-18T14:48:55.884974+0000","last_peered":"2024-03-18T14:48:55.884974+0000","last_clean":"2024-03-18T14:48:55.884974+0000","last_became_active":"2024-03-18T14:47:13.585115+0000","last_became_peered":"2024-03-18T14:47:13.585115+0000","last_unstale":"2024-03-18T14:48:55.884974+0000","last_undegraded":"2024-03-18T14:48:55.884974+0000","last_fullsized":"2024-03-18T14:48:55.884974+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'702","last_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_deep_scrub":"19'702","last_deep_scrub_stamp":"2024-03-18T14:48:55.884794+0000","last_clean_scrub_stamp":"2024-03-18T14:48:55.884794+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:34.739512+0000","scrub_duration":0.0019213559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":33747,"num_write":660,"num_write_kb":68715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"19'792","reported_seq":965,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.174147+0000","last_change":"2024-03-18T14:48:19.174116+0000","last_active":"2024-03-18T14:48:19.174147+0000","last_peered":"2024-03-18T14:48:19.174147+0000","last_clean":"2024-03-18T14:48:19.174147+0000","last_became_active":"2024-03-18T14:47:17.465339+0000","last_became_peered":"2024-03-18T14:47:17.465339+0000","last_unstale":"2024-03-18T14:48:19.174147+0000","last_undegraded":"2024-03-18T14:48:19.174147+0000","last_fullsized":"2024-03-18T14:48:19.174147+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'792","last_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_deep_scrub":"19'792","last_deep_scrub_stamp":"2024-03-18T14:48:19.174004+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.174004+0000","objects_scrubbed":0,"log_size":792,"log_dups_size":0,"ondisk_log_size":792,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:04:44.260470+0000","scrub_duration":0.0021836329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":70991,"num_write":741,"num_write_kb":147547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"19'754","reported_seq":848,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.419311+0000","last_change":"2024-03-18T14:47:54.792529+0000","last_active":"2024-03-18T14:47:59.419311+0000","last_peered":"2024-03-18T14:47:59.419311+0000","last_clean":"2024-03-18T14:47:59.419311+0000","last_became_active":"2024-03-18T14:47:13.587846+0000","last_became_peered":"2024-03-18T14:47:13.587846+0000","last_unstale":"2024-03-18T14:47:59.419311+0000","last_undegraded":"2024-03-18T14:47:59.419311+0000","last_fullsized":"2024-03-18T14:47:59.419311+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'754","last_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_deep_scrub":"19'754","last_deep_scrub_stamp":"2024-03-18T14:47:54.792434+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.792434+0000","objects_scrubbed":0,"log_size":754,"log_dups_size":0,"ondisk_log_size":754,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:12.821176+0000","scrub_duration":0.0017641320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":22348,"num_write":722,"num_write_kb":97153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"19'717","reported_seq":824,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:53.862391+0000","last_change":"2024-03-18T14:48:53.862359+0000","last_active":"2024-03-18T14:48:53.862391+0000","last_peered":"2024-03-18T14:48:53.862391+0000","last_clean":"2024-03-18T14:48:53.862391+0000","last_became_active":"2024-03-18T14:47:13.572873+0000","last_became_peered":"2024-03-18T14:47:13.572873+0000","last_unstale":"2024-03-18T14:48:53.862391+0000","last_undegraded":"2024-03-18T14:48:53.862391+0000","last_fullsized":"2024-03-18T14:48:53.862391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'717","last_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_deep_scrub":"19'717","last_deep_scrub_stamp":"2024-03-18T14:48:53.862228+0000","last_clean_scrub_stamp":"2024-03-18T14:48:53.862228+0000","objects_scrubbed":0,"log_size":717,"log_dups_size":0,"ondisk_log_size":717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.170416+0000","scrub_duration":0.001929296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":27516,"num_write":683,"num_write_kb":65198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"19'726","reported_seq":851,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.902153+0000","last_change":"2024-03-18T14:48:15.902117+0000","last_active":"2024-03-18T14:48:15.902153+0000","last_peered":"2024-03-18T14:48:15.902153+0000","last_clean":"2024-03-18T14:48:15.902153+0000","last_became_active":"2024-03-18T14:47:17.477579+0000","last_became_peered":"2024-03-18T14:47:17.477579+0000","last_unstale":"2024-03-18T14:48:15.902153+0000","last_undegraded":"2024-03-18T14:48:15.902153+0000","last_fullsized":"2024-03-18T14:48:15.902153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'726","last_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_deep_scrub":"19'726","last_deep_scrub_stamp":"2024-03-18T14:48:15.901913+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.901913+0000","objects_scrubbed":0,"log_size":726,"log_dups_size":0,"ondisk_log_size":726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:45:45.382914+0000","scrub_duration":0.0024291199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":34429,"num_write":676,"num_write_kb":93997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"19'810","reported_seq":905,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.167590+0000","last_change":"2024-03-18T14:48:42.167562+0000","last_active":"2024-03-18T14:48:42.167590+0000","last_peered":"2024-03-18T14:48:42.167590+0000","last_clean":"2024-03-18T14:48:42.167590+0000","last_became_active":"2024-03-18T14:47:17.504067+0000","last_became_peered":"2024-03-18T14:47:17.504067+0000","last_unstale":"2024-03-18T14:48:42.167590+0000","last_undegraded":"2024-03-18T14:48:42.167590+0000","last_fullsized":"2024-03-18T14:48:42.167590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'810","last_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_deep_scrub":"19'810","last_deep_scrub_stamp":"2024-03-18T14:48:42.167438+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.167438+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:22:34.614581+0000","scrub_duration":0.0021076710000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":24917,"num_write":766,"num_write_kb":80548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"19'829","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.903573+0000","last_change":"2024-03-18T14:48:14.903548+0000","last_active":"2024-03-18T14:48:14.903573+0000","last_peered":"2024-03-18T14:48:14.903573+0000","last_clean":"2024-03-18T14:48:14.903573+0000","last_became_active":"2024-03-18T14:47:14.607028+0000","last_became_peered":"2024-03-18T14:47:14.607028+0000","last_unstale":"2024-03-18T14:48:14.903573+0000","last_undegraded":"2024-03-18T14:48:14.903573+0000","last_fullsized":"2024-03-18T14:48:14.903573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'829","last_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_deep_scrub":"19'829","last_deep_scrub_stamp":"2024-03-18T14:48:14.903453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.903453+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:22:04.091653+0000","scrub_duration":0.0019250059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":75148,"num_write":778,"num_write_kb":184369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"19'882","reported_seq":1068,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.236389+0000","last_change":"2024-03-18T14:48:03.236349+0000","last_active":"2024-03-18T14:48:03.236389+0000","last_peered":"2024-03-18T14:48:03.236389+0000","last_clean":"2024-03-18T14:48:03.236389+0000","last_became_active":"2024-03-18T14:47:13.596148+0000","last_became_peered":"2024-03-18T14:47:13.596148+0000","last_unstale":"2024-03-18T14:48:03.236389+0000","last_undegraded":"2024-03-18T14:48:03.236389+0000","last_fullsized":"2024-03-18T14:48:03.236389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'882","last_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_deep_scrub":"19'882","last_deep_scrub_stamp":"2024-03-18T14:48:03.236226+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.236226+0000","objects_scrubbed":0,"log_size":882,"log_dups_size":0,"ondisk_log_size":882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:36.882623+0000","scrub_duration":0.0020777320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":68899,"num_write":831,"num_write_kb":217916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"19'773","reported_seq":901,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.212896+0000","last_change":"2024-03-18T14:48:30.212866+0000","last_active":"2024-03-18T14:48:30.212896+0000","last_peered":"2024-03-18T14:48:30.212896+0000","last_clean":"2024-03-18T14:48:30.212896+0000","last_became_active":"2024-03-18T14:47:17.476880+0000","last_became_peered":"2024-03-18T14:47:17.476880+0000","last_unstale":"2024-03-18T14:48:30.212896+0000","last_undegraded":"2024-03-18T14:48:30.212896+0000","last_fullsized":"2024-03-18T14:48:30.212896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'773","last_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_deep_scrub":"19'773","last_deep_scrub_stamp":"2024-03-18T14:48:30.212765+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.212765+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:04.434159+0000","scrub_duration":0.0019467340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":40223,"num_write":737,"num_write_kb":91934,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"19'893","reported_seq":1030,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.271275+0000","last_change":"2024-03-18T14:48:45.271246+0000","last_active":"2024-03-18T14:48:45.271275+0000","last_peered":"2024-03-18T14:48:45.271275+0000","last_clean":"2024-03-18T14:48:45.271275+0000","last_became_active":"2024-03-18T14:47:17.467410+0000","last_became_peered":"2024-03-18T14:47:17.467410+0000","last_unstale":"2024-03-18T14:48:45.271275+0000","last_undegraded":"2024-03-18T14:48:45.271275+0000","last_fullsized":"2024-03-18T14:48:45.271275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:48:45.271124+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.271124+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:53:28.548708+0000","scrub_duration":0.0018058620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":47390,"num_write":837,"num_write_kb":168300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"19'818","reported_seq":1029,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.116281+0000","last_change":"2024-03-18T14:48:24.116248+0000","last_active":"2024-03-18T14:48:24.116281+0000","last_peered":"2024-03-18T14:48:24.116281+0000","last_clean":"2024-03-18T14:48:24.116281+0000","last_became_active":"2024-03-18T14:47:14.604978+0000","last_became_peered":"2024-03-18T14:47:14.604978+0000","last_unstale":"2024-03-18T14:48:24.116281+0000","last_undegraded":"2024-03-18T14:48:24.116281+0000","last_fullsized":"2024-03-18T14:48:24.116281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'818","last_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_deep_scrub":"19'818","last_deep_scrub_stamp":"2024-03-18T14:48:24.116136+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.116136+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:02:50.563805+0000","scrub_duration":0.0020014410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":83519,"num_write":782,"num_write_kb":200346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"19'801","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.862454+0000","last_change":"2024-03-18T14:48:13.862418+0000","last_active":"2024-03-18T14:48:13.862454+0000","last_peered":"2024-03-18T14:48:13.862454+0000","last_clean":"2024-03-18T14:48:13.862454+0000","last_became_active":"2024-03-18T14:47:17.500457+0000","last_became_peered":"2024-03-18T14:47:17.500457+0000","last_unstale":"2024-03-18T14:48:13.862454+0000","last_undegraded":"2024-03-18T14:48:13.862454+0000","last_fullsized":"2024-03-18T14:48:13.862454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'801","last_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_deep_scrub":"19'801","last_deep_scrub_stamp":"2024-03-18T14:48:13.862301+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.862301+0000","objects_scrubbed":0,"log_size":801,"log_dups_size":0,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:33.887445+0000","scrub_duration":0.002148208,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":162,"num_read_kb":96726,"num_write":760,"num_write_kb":172078,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"19'862","reported_seq":1065,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:01.757837+0000","last_change":"2024-03-18T14:48:01.757805+0000","last_active":"2024-03-18T14:48:01.757837+0000","last_peered":"2024-03-18T14:48:01.757837+0000","last_clean":"2024-03-18T14:48:01.757837+0000","last_became_active":"2024-03-18T14:47:17.471044+0000","last_became_peered":"2024-03-18T14:47:17.471044+0000","last_unstale":"2024-03-18T14:48:01.757837+0000","last_undegraded":"2024-03-18T14:48:01.757837+0000","last_fullsized":"2024-03-18T14:48:01.757837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:01.757689+0000","last_clean_scrub_stamp":"2024-03-18T14:48:01.757689+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:42.379898+0000","scrub_duration":0.0025291559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":65791,"num_write":820,"num_write_kb":165660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"19'880","reported_seq":1047,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:19.951633+0000","last_change":"2024-03-18T14:48:19.951591+0000","last_active":"2024-03-18T14:48:19.951633+0000","last_peered":"2024-03-18T14:48:19.951633+0000","last_clean":"2024-03-18T14:48:19.951633+0000","last_became_active":"2024-03-18T14:47:17.490152+0000","last_became_peered":"2024-03-18T14:47:17.490152+0000","last_unstale":"2024-03-18T14:48:19.951633+0000","last_undegraded":"2024-03-18T14:48:19.951633+0000","last_fullsized":"2024-03-18T14:48:19.951633+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'880","last_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_deep_scrub":"19'880","last_deep_scrub_stamp":"2024-03-18T14:48:19.951472+0000","last_clean_scrub_stamp":"2024-03-18T14:48:19.951472+0000","objects_scrubbed":0,"log_size":880,"log_dups_size":0,"ondisk_log_size":880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:26:11.575789+0000","scrub_duration":0.0022975579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":45385,"num_write":834,"num_write_kb":160449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"19'812","reported_seq":909,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:23.106357+0000","last_change":"2024-03-18T14:48:23.106325+0000","last_active":"2024-03-18T14:48:23.106357+0000","last_peered":"2024-03-18T14:48:23.106357+0000","last_clean":"2024-03-18T14:48:23.106357+0000","last_became_active":"2024-03-18T14:47:13.590079+0000","last_became_peered":"2024-03-18T14:47:13.590079+0000","last_unstale":"2024-03-18T14:48:23.106357+0000","last_undegraded":"2024-03-18T14:48:23.106357+0000","last_fullsized":"2024-03-18T14:48:23.106357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'812","last_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_deep_scrub":"19'812","last_deep_scrub_stamp":"2024-03-18T14:48:23.106193+0000","last_clean_scrub_stamp":"2024-03-18T14:48:23.106193+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:44:07.642560+0000","scrub_duration":0.0021492669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":26510,"num_write":765,"num_write_kb":81123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"19'845","reported_seq":1037,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.316131+0000","last_change":"2024-03-18T14:48:15.316086+0000","last_active":"2024-03-18T14:48:15.316131+0000","last_peered":"2024-03-18T14:48:15.316131+0000","last_clean":"2024-03-18T14:48:15.316131+0000","last_became_active":"2024-03-18T14:47:17.510785+0000","last_became_peered":"2024-03-18T14:47:17.510785+0000","last_unstale":"2024-03-18T14:48:15.316131+0000","last_undegraded":"2024-03-18T14:48:15.316131+0000","last_fullsized":"2024-03-18T14:48:15.316131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'845","last_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_deep_scrub":"19'845","last_deep_scrub_stamp":"2024-03-18T14:48:15.315972+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.315972+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:49:56.248007+0000","scrub_duration":0.0021600410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":74416,"num_write":792,"num_write_kb":188899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"19'830","reported_seq":954,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:05.876278+0000","last_change":"2024-03-18T14:49:05.876244+0000","last_active":"2024-03-18T14:49:05.876278+0000","last_peered":"2024-03-18T14:49:05.876278+0000","last_clean":"2024-03-18T14:49:05.876278+0000","last_became_active":"2024-03-18T14:47:17.463753+0000","last_became_peered":"2024-03-18T14:47:17.463753+0000","last_unstale":"2024-03-18T14:49:05.876278+0000","last_undegraded":"2024-03-18T14:49:05.876278+0000","last_fullsized":"2024-03-18T14:49:05.876278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'830","last_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_deep_scrub":"19'830","last_deep_scrub_stamp":"2024-03-18T14:49:05.876134+0000","last_clean_scrub_stamp":"2024-03-18T14:49:05.876134+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:32:40.921471+0000","scrub_duration":0.0020662810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":31333,"num_write":785,"num_write_kb":123087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"19'822","reported_seq":984,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:30.884497+0000","last_change":"2024-03-18T14:48:30.884465+0000","last_active":"2024-03-18T14:48:30.884497+0000","last_peered":"2024-03-18T14:48:30.884497+0000","last_clean":"2024-03-18T14:48:30.884497+0000","last_became_active":"2024-03-18T14:47:17.471046+0000","last_became_peered":"2024-03-18T14:47:17.471046+0000","last_unstale":"2024-03-18T14:48:30.884497+0000","last_undegraded":"2024-03-18T14:48:30.884497+0000","last_fullsized":"2024-03-18T14:48:30.884497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'822","last_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_deep_scrub":"19'822","last_deep_scrub_stamp":"2024-03-18T14:48:30.884325+0000","last_clean_scrub_stamp":"2024-03-18T14:48:30.884325+0000","objects_scrubbed":0,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:25:36.262735+0000","scrub_duration":0.0021932079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63832,"num_write":776,"num_write_kb":133992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"19'835","reported_seq":937,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:22.911889+0000","last_change":"2024-03-18T14:49:22.911858+0000","last_active":"2024-03-18T14:49:22.911889+0000","last_peered":"2024-03-18T14:49:22.911889+0000","last_clean":"2024-03-18T14:49:22.911889+0000","last_became_active":"2024-03-18T14:47:14.610080+0000","last_became_peered":"2024-03-18T14:47:14.610080+0000","last_unstale":"2024-03-18T14:49:22.911889+0000","last_undegraded":"2024-03-18T14:49:22.911889+0000","last_fullsized":"2024-03-18T14:49:22.911889+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'835","last_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_deep_scrub":"19'835","last_deep_scrub_stamp":"2024-03-18T14:49:22.911733+0000","last_clean_scrub_stamp":"2024-03-18T14:49:22.911733+0000","objects_scrubbed":0,"log_size":835,"log_dups_size":0,"ondisk_log_size":835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:06:13.098093+0000","scrub_duration":0.0020081600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":22128,"num_write":789,"num_write_kb":143227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"19'798","reported_seq":952,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:03.195978+0000","last_change":"2024-03-18T14:48:03.195948+0000","last_active":"2024-03-18T14:48:03.195978+0000","last_peered":"2024-03-18T14:48:03.195978+0000","last_clean":"2024-03-18T14:48:03.195978+0000","last_became_active":"2024-03-18T14:47:17.515599+0000","last_became_peered":"2024-03-18T14:47:17.515599+0000","last_unstale":"2024-03-18T14:48:03.195978+0000","last_undegraded":"2024-03-18T14:48:03.195978+0000","last_fullsized":"2024-03-18T14:48:03.195978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'798","last_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_deep_scrub":"19'798","last_deep_scrub_stamp":"2024-03-18T14:48:03.195840+0000","last_clean_scrub_stamp":"2024-03-18T14:48:03.195840+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:21:19.631299+0000","scrub_duration":0.0024146290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":35975,"num_write":750,"num_write_kb":98160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"49'1493","reported_seq":1550,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.924327+0000","last_change":"2024-03-18T14:48:15.924269+0000","last_active":"2024-03-18T14:48:15.924327+0000","last_peered":"2024-03-18T14:48:15.924327+0000","last_clean":"2024-03-18T14:48:15.924327+0000","last_became_active":"2024-03-18T14:47:14.606145+0000","last_became_peered":"2024-03-18T14:47:14.606145+0000","last_unstale":"2024-03-18T14:48:15.924327+0000","last_undegraded":"2024-03-18T14:48:15.924327+0000","last_fullsized":"2024-03-18T14:48:15.924327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1493","last_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_deep_scrub":"49'1493","last_deep_scrub_stamp":"2024-03-18T14:48:15.924103+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.924103+0000","objects_scrubbed":3,"log_size":1493,"log_dups_size":0,"ondisk_log_size":1493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:55.510706+0000","scrub_duration":0.037211025000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":1363,"num_write_kb":21195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"19'789","reported_seq":944,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:52.992673+0000","last_change":"2024-03-18T14:48:52.992643+0000","last_active":"2024-03-18T14:48:52.992673+0000","last_peered":"2024-03-18T14:48:52.992673+0000","last_clean":"2024-03-18T14:48:52.992673+0000","last_became_active":"2024-03-18T14:47:17.498654+0000","last_became_peered":"2024-03-18T14:47:17.498654+0000","last_unstale":"2024-03-18T14:48:52.992673+0000","last_undegraded":"2024-03-18T14:48:52.992673+0000","last_fullsized":"2024-03-18T14:48:52.992673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'789","last_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_deep_scrub":"19'789","last_deep_scrub_stamp":"2024-03-18T14:48:52.992528+0000","last_clean_scrub_stamp":"2024-03-18T14:48:52.992528+0000","objects_scrubbed":0,"log_size":789,"log_dups_size":0,"ondisk_log_size":789,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:56:51.377266+0000","scrub_duration":0.0020841319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":46232,"num_write":742,"num_write_kb":98272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"49'1067","reported_seq":1420,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.805139+0000","last_change":"2024-03-18T14:48:00.805108+0000","last_active":"2024-03-18T14:48:00.805139+0000","last_peered":"2024-03-18T14:48:00.805139+0000","last_clean":"2024-03-18T14:48:00.805139+0000","last_became_active":"2024-03-18T14:47:17.521470+0000","last_became_peered":"2024-03-18T14:47:17.521470+0000","last_unstale":"2024-03-18T14:48:00.805139+0000","last_undegraded":"2024-03-18T14:48:00.805139+0000","last_fullsized":"2024-03-18T14:48:00.805139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1067","last_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_deep_scrub":"49'1067","last_deep_scrub_stamp":"2024-03-18T14:48:00.805006+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.805006+0000","objects_scrubbed":2,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:39:45.775275+0000","scrub_duration":0.019330119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5735362,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":296,"num_read_kb":5793,"num_write":950,"num_write_kb":10210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"19'765","reported_seq":846,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.310269+0000","last_change":"2024-03-18T14:48:42.310230+0000","last_active":"2024-03-18T14:48:42.310269+0000","last_peered":"2024-03-18T14:48:42.310269+0000","last_clean":"2024-03-18T14:48:42.310269+0000","last_became_active":"2024-03-18T14:47:13.606188+0000","last_became_peered":"2024-03-18T14:47:13.606188+0000","last_unstale":"2024-03-18T14:48:42.310269+0000","last_undegraded":"2024-03-18T14:48:42.310269+0000","last_fullsized":"2024-03-18T14:48:42.310269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'765","last_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_deep_scrub":"19'765","last_deep_scrub_stamp":"2024-03-18T14:48:42.310112+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.310112+0000","objects_scrubbed":0,"log_size":765,"log_dups_size":0,"ondisk_log_size":765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:14.338657+0000","scrub_duration":0.0020889239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":9702,"num_write":719,"num_write_kb":63904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"49'1017","reported_seq":1080,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.266467+0000","last_change":"2024-03-18T14:48:29.266439+0000","last_active":"2024-03-18T14:48:29.266467+0000","last_peered":"2024-03-18T14:48:29.266467+0000","last_clean":"2024-03-18T14:48:29.266467+0000","last_became_active":"2024-03-18T14:47:17.463063+0000","last_became_peered":"2024-03-18T14:47:17.463063+0000","last_unstale":"2024-03-18T14:48:29.266467+0000","last_undegraded":"2024-03-18T14:48:29.266467+0000","last_fullsized":"2024-03-18T14:48:29.266467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1017","last_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_deep_scrub":"49'1017","last_deep_scrub_stamp":"2024-03-18T14:48:29.266334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.266334+0000","objects_scrubbed":2,"log_size":1017,"log_dups_size":0,"ondisk_log_size":1017,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:51:28.596244+0000","scrub_duration":0.024710393000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":886,"num_write_kb":12713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"19'744","reported_seq":888,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.072338+0000","last_change":"2024-03-18T14:48:46.072285+0000","last_active":"2024-03-18T14:48:46.072338+0000","last_peered":"2024-03-18T14:48:46.072338+0000","last_clean":"2024-03-18T14:48:46.072338+0000","last_became_active":"2024-03-18T14:47:17.474050+0000","last_became_peered":"2024-03-18T14:47:17.474050+0000","last_unstale":"2024-03-18T14:48:46.072338+0000","last_undegraded":"2024-03-18T14:48:46.072338+0000","last_fullsized":"2024-03-18T14:48:46.072338+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'744","last_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_deep_scrub":"19'744","last_deep_scrub_stamp":"2024-03-18T14:48:46.072121+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.072121+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:27:25.218959+0000","scrub_duration":0.0021974389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":42918,"num_write":703,"num_write_kb":110203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"49'132","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:41.276442+0000","last_change":"2024-03-18T14:48:41.276414+0000","last_active":"2024-03-18T14:48:41.276442+0000","last_peered":"2024-03-18T14:48:41.276442+0000","last_clean":"2024-03-18T14:48:41.276442+0000","last_became_active":"2024-03-18T14:47:17.466969+0000","last_became_peered":"2024-03-18T14:47:17.466969+0000","last_unstale":"2024-03-18T14:48:41.276442+0000","last_undegraded":"2024-03-18T14:48:41.276442+0000","last_fullsized":"2024-03-18T14:48:41.276442+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:41.276299+0000","last_clean_scrub_stamp":"2024-03-18T14:48:41.276299+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:07.386720+0000","scrub_duration":0.0048032509999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":23,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"19'771","reported_seq":861,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:42.182487+0000","last_change":"2024-03-18T14:48:42.182442+0000","last_active":"2024-03-18T14:48:42.182487+0000","last_peered":"2024-03-18T14:48:42.182487+0000","last_clean":"2024-03-18T14:48:42.182487+0000","last_became_active":"2024-03-18T14:47:17.517401+0000","last_became_peered":"2024-03-18T14:47:17.517401+0000","last_unstale":"2024-03-18T14:48:42.182487+0000","last_undegraded":"2024-03-18T14:48:42.182487+0000","last_fullsized":"2024-03-18T14:48:42.182487+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:48:42.182334+0000","last_clean_scrub_stamp":"2024-03-18T14:48:42.182334+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:42.518691+0000","scrub_duration":0.0019365420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18379,"num_write":731,"num_write_kb":73409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"49'1650","reported_seq":1707,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.051449+0000","last_change":"2024-03-18T14:48:36.051421+0000","last_active":"2024-03-18T14:48:36.051449+0000","last_peered":"2024-03-18T14:48:36.051449+0000","last_clean":"2024-03-18T14:48:36.051449+0000","last_became_active":"2024-03-18T14:47:17.468004+0000","last_became_peered":"2024-03-18T14:47:17.468004+0000","last_unstale":"2024-03-18T14:48:36.051449+0000","last_undegraded":"2024-03-18T14:48:36.051449+0000","last_fullsized":"2024-03-18T14:48:36.051449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1650","last_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_deep_scrub":"49'1650","last_deep_scrub_stamp":"2024-03-18T14:48:36.051326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.051326+0000","objects_scrubbed":2,"log_size":1650,"log_dups_size":0,"ondisk_log_size":1650,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:09:25.108508+0000","scrub_duration":0.014384467999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1527,"num_write_kb":13029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"19'884","reported_seq":1050,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437723+0000","last_change":"2024-03-18T14:47:59.425820+0000","last_active":"2024-03-18T14:47:59.437723+0000","last_peered":"2024-03-18T14:47:59.437723+0000","last_clean":"2024-03-18T14:47:59.437723+0000","last_became_active":"2024-03-18T14:47:59.420814+0000","last_became_peered":"2024-03-18T14:47:59.420814+0000","last_unstale":"2024-03-18T14:47:59.437723+0000","last_undegraded":"2024-03-18T14:47:59.437723+0000","last_fullsized":"2024-03-18T14:47:59.437723+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":884,"log_dups_size":0,"ondisk_log_size":884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:58:31.147341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":59056,"num_write":834,"num_write_kb":160416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":380,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"49'231","reported_seq":291,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.269359+0000","last_change":"2024-03-18T14:48:37.269315+0000","last_active":"2024-03-18T14:48:37.269359+0000","last_peered":"2024-03-18T14:48:37.269359+0000","last_clean":"2024-03-18T14:48:37.269359+0000","last_became_active":"2024-03-18T14:47:17.476229+0000","last_became_peered":"2024-03-18T14:47:17.476229+0000","last_unstale":"2024-03-18T14:48:37.269359+0000","last_undegraded":"2024-03-18T14:48:37.269359+0000","last_fullsized":"2024-03-18T14:48:37.269359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'231","last_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_deep_scrub":"49'231","last_deep_scrub_stamp":"2024-03-18T14:48:37.269170+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.269170+0000","objects_scrubbed":3,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:39:49.754184+0000","scrub_duration":0.005823071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":106,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"19'875","reported_seq":1054,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:15.973206+0000","last_change":"2024-03-18T14:49:15.973181+0000","last_active":"2024-03-18T14:49:15.973206+0000","last_peered":"2024-03-18T14:49:15.973206+0000","last_clean":"2024-03-18T14:49:15.973206+0000","last_became_active":"2024-03-18T14:47:17.512874+0000","last_became_peered":"2024-03-18T14:47:17.512874+0000","last_unstale":"2024-03-18T14:49:15.973206+0000","last_undegraded":"2024-03-18T14:49:15.973206+0000","last_fullsized":"2024-03-18T14:49:15.973206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'875","last_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_deep_scrub":"19'875","last_deep_scrub_stamp":"2024-03-18T14:49:15.973093+0000","last_clean_scrub_stamp":"2024-03-18T14:49:15.973093+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:04:22.599146+0000","scrub_duration":0.001758653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":48615,"num_write":836,"num_write_kb":177037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"49'656","reported_seq":718,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.768326+0000","last_change":"2024-03-18T14:47:56.203180+0000","last_active":"2024-03-18T14:48:00.768326+0000","last_peered":"2024-03-18T14:48:00.768326+0000","last_clean":"2024-03-18T14:48:00.768326+0000","last_became_active":"2024-03-18T14:47:17.461407+0000","last_became_peered":"2024-03-18T14:47:17.461407+0000","last_unstale":"2024-03-18T14:48:00.768326+0000","last_undegraded":"2024-03-18T14:48:00.768326+0000","last_fullsized":"2024-03-18T14:48:00.768326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'655","last_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_deep_scrub":"44'655","last_deep_scrub_stamp":"2024-03-18T14:47:56.203087+0000","last_clean_scrub_stamp":"2024-03-18T14:47:56.203087+0000","objects_scrubbed":7,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:12:32.429412+0000","scrub_duration":0.035016302999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583555,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":9,"num_read_kb":12293,"num_write":551,"num_write_kb":12565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"19'817","reported_seq":999,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:29.929458+0000","last_change":"2024-03-18T14:48:29.929427+0000","last_active":"2024-03-18T14:48:29.929458+0000","last_peered":"2024-03-18T14:48:29.929458+0000","last_clean":"2024-03-18T14:48:29.929458+0000","last_became_active":"2024-03-18T14:47:17.468774+0000","last_became_peered":"2024-03-18T14:47:17.468774+0000","last_unstale":"2024-03-18T14:48:29.929458+0000","last_undegraded":"2024-03-18T14:48:29.929458+0000","last_fullsized":"2024-03-18T14:48:29.929458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'817","last_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_deep_scrub":"19'817","last_deep_scrub_stamp":"2024-03-18T14:48:29.929287+0000","last_clean_scrub_stamp":"2024-03-18T14:48:29.929287+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:04.308572+0000","scrub_duration":0.002027442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":127,"num_read_kb":76729,"num_write":769,"num_write_kb":154020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"49'562","reported_seq":627,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.162867+0000","last_change":"2024-03-18T14:48:33.162819+0000","last_active":"2024-03-18T14:48:33.162867+0000","last_peered":"2024-03-18T14:48:33.162867+0000","last_clean":"2024-03-18T14:48:33.162867+0000","last_became_active":"2024-03-18T14:47:17.480891+0000","last_became_peered":"2024-03-18T14:47:17.480891+0000","last_unstale":"2024-03-18T14:48:33.162867+0000","last_undegraded":"2024-03-18T14:48:33.162867+0000","last_fullsized":"2024-03-18T14:48:33.162867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'562","last_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_deep_scrub":"49'562","last_deep_scrub_stamp":"2024-03-18T14:48:33.162705+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.162705+0000","objects_scrubbed":5,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:05:27.947811+0000","scrub_duration":0.024586422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":8199,"num_write":444,"num_write_kb":8394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"19'820","reported_seq":980,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.434131+0000","last_change":"2024-03-18T14:47:54.117014+0000","last_active":"2024-03-18T14:47:59.434131+0000","last_peered":"2024-03-18T14:47:59.434131+0000","last_clean":"2024-03-18T14:47:59.434131+0000","last_became_active":"2024-03-18T14:47:17.477729+0000","last_became_peered":"2024-03-18T14:47:17.477729+0000","last_unstale":"2024-03-18T14:47:59.434131+0000","last_undegraded":"2024-03-18T14:47:59.434131+0000","last_fullsized":"2024-03-18T14:47:59.434131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'820","last_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_deep_scrub":"19'820","last_deep_scrub_stamp":"2024-03-18T14:47:54.116922+0000","last_clean_scrub_stamp":"2024-03-18T14:47:54.116922+0000","objects_scrubbed":0,"log_size":820,"log_dups_size":0,"ondisk_log_size":820,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:28:42.118731+0000","scrub_duration":0.0017738330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":54374,"num_write":787,"num_write_kb":180806,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"49'177","reported_seq":235,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.156603+0000","last_change":"2024-03-18T14:48:26.156574+0000","last_active":"2024-03-18T14:48:26.156603+0000","last_peered":"2024-03-18T14:48:26.156603+0000","last_clean":"2024-03-18T14:48:26.156603+0000","last_became_active":"2024-03-18T14:47:17.467892+0000","last_became_peered":"2024-03-18T14:47:17.467892+0000","last_unstale":"2024-03-18T14:48:26.156603+0000","last_undegraded":"2024-03-18T14:48:26.156603+0000","last_fullsized":"2024-03-18T14:48:26.156603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'177","last_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_deep_scrub":"49'177","last_deep_scrub_stamp":"2024-03-18T14:48:26.156453+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.156453+0000","objects_scrubbed":1,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:11.953704+0000","scrub_duration":0.0034013509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":69,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"19'824","reported_seq":931,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430224+0000","last_change":"2024-03-18T14:48:00.430224+0000","last_active":"2024-03-18T14:48:00.430224+0000","last_peered":"2024-03-18T14:48:00.430224+0000","last_clean":"2024-03-18T14:48:00.430224+0000","last_became_active":"2024-03-18T14:48:00.422433+0000","last_became_peered":"2024-03-18T14:48:00.422433+0000","last_unstale":"2024-03-18T14:48:00.430224+0000","last_undegraded":"2024-03-18T14:48:00.430224+0000","last_fullsized":"2024-03-18T14:48:00.430224+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:08:12.202654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35851,"num_write":777,"num_write_kb":151170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":367,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"19'375","reported_seq":431,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:17.352388+0000","last_change":"2024-03-18T14:48:17.352359+0000","last_active":"2024-03-18T14:48:17.352388+0000","last_peered":"2024-03-18T14:48:17.352388+0000","last_clean":"2024-03-18T14:48:17.352388+0000","last_became_active":"2024-03-18T14:47:17.463332+0000","last_became_peered":"2024-03-18T14:47:17.463332+0000","last_unstale":"2024-03-18T14:48:17.352388+0000","last_undegraded":"2024-03-18T14:48:17.352388+0000","last_fullsized":"2024-03-18T14:48:17.352388+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'375","last_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_deep_scrub":"19'375","last_deep_scrub_stamp":"2024-03-18T14:48:17.352254+0000","last_clean_scrub_stamp":"2024-03-18T14:48:17.352254+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:40:52.891806+0000","scrub_duration":0.0015990869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":248,"num_write_kb":8299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"19'779","reported_seq":881,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:46.247636+0000","last_change":"2024-03-18T14:48:46.247604+0000","last_active":"2024-03-18T14:48:46.247636+0000","last_peered":"2024-03-18T14:48:46.247636+0000","last_clean":"2024-03-18T14:48:46.247636+0000","last_became_active":"2024-03-18T14:47:17.467324+0000","last_became_peered":"2024-03-18T14:47:17.467324+0000","last_unstale":"2024-03-18T14:48:46.247636+0000","last_undegraded":"2024-03-18T14:48:46.247636+0000","last_fullsized":"2024-03-18T14:48:46.247636+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'779","last_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_deep_scrub":"19'779","last_deep_scrub_stamp":"2024-03-18T14:48:46.247483+0000","last_clean_scrub_stamp":"2024-03-18T14:48:46.247483+0000","objects_scrubbed":0,"log_size":779,"log_dups_size":0,"ondisk_log_size":779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:56:10.847167+0000","scrub_duration":0.0019632389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":20137,"num_write":730,"num_write_kb":121669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"49'186","reported_seq":249,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:48.795103+0000","last_change":"2024-03-18T14:48:48.795041+0000","last_active":"2024-03-18T14:48:48.795103+0000","last_peered":"2024-03-18T14:48:48.795103+0000","last_clean":"2024-03-18T14:48:48.795103+0000","last_became_active":"2024-03-18T14:47:13.603978+0000","last_became_peered":"2024-03-18T14:47:13.603978+0000","last_unstale":"2024-03-18T14:48:48.795103+0000","last_undegraded":"2024-03-18T14:48:48.795103+0000","last_fullsized":"2024-03-18T14:48:48.795103+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'186","last_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_deep_scrub":"49'186","last_deep_scrub_stamp":"2024-03-18T14:48:48.794928+0000","last_clean_scrub_stamp":"2024-03-18T14:48:48.794928+0000","objects_scrubbed":6,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:07:21.788197+0000","scrub_duration":0.0067452579999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234748,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":203,"num_write":67,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"19'758","reported_seq":859,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.294798+0000","last_change":"2024-03-18T14:48:27.294757+0000","last_active":"2024-03-18T14:48:27.294798+0000","last_peered":"2024-03-18T14:48:27.294798+0000","last_clean":"2024-03-18T14:48:27.294798+0000","last_became_active":"2024-03-18T14:47:17.470133+0000","last_became_peered":"2024-03-18T14:47:17.470133+0000","last_unstale":"2024-03-18T14:48:27.294798+0000","last_undegraded":"2024-03-18T14:48:27.294798+0000","last_fullsized":"2024-03-18T14:48:27.294798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'758","last_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_deep_scrub":"19'758","last_deep_scrub_stamp":"2024-03-18T14:48:27.294592+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.294592+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:01.178540+0000","scrub_duration":0.002043558,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":21826,"num_write":718,"num_write_kb":105588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"49'434","reported_seq":491,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:27.204459+0000","last_change":"2024-03-18T14:48:27.204425+0000","last_active":"2024-03-18T14:48:27.204459+0000","last_peered":"2024-03-18T14:48:27.204459+0000","last_clean":"2024-03-18T14:48:27.204459+0000","last_became_active":"2024-03-18T14:47:13.588563+0000","last_became_peered":"2024-03-18T14:47:13.588563+0000","last_unstale":"2024-03-18T14:48:27.204459+0000","last_undegraded":"2024-03-18T14:48:27.204459+0000","last_fullsized":"2024-03-18T14:48:27.204459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'434","last_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_deep_scrub":"49'434","last_deep_scrub_stamp":"2024-03-18T14:48:27.204321+0000","last_clean_scrub_stamp":"2024-03-18T14:48:27.204321+0000","objects_scrubbed":2,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:36.321079+0000","scrub_duration":0.019103287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":323,"num_write_kb":4253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"19'850","reported_seq":1039,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433492+0000","last_change":"2024-03-18T14:47:59.201505+0000","last_active":"2024-03-18T14:47:59.433492+0000","last_peered":"2024-03-18T14:47:59.433492+0000","last_clean":"2024-03-18T14:47:59.433492+0000","last_became_active":"2024-03-18T14:47:17.505782+0000","last_became_peered":"2024-03-18T14:47:17.505782+0000","last_unstale":"2024-03-18T14:47:59.433492+0000","last_undegraded":"2024-03-18T14:47:59.433492+0000","last_fullsized":"2024-03-18T14:47:59.433492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'850","last_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_deep_scrub":"19'850","last_deep_scrub_stamp":"2024-03-18T14:47:59.201416+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.201416+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:12:50.594706+0000","scrub_duration":0.0016080420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":67584,"num_write":799,"num_write_kb":193347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"49'405","reported_seq":466,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:11.871068+0000","last_change":"2024-03-18T14:48:11.871039+0000","last_active":"2024-03-18T14:48:11.871068+0000","last_peered":"2024-03-18T14:48:11.871068+0000","last_clean":"2024-03-18T14:48:11.871068+0000","last_became_active":"2024-03-18T14:47:14.577181+0000","last_became_peered":"2024-03-18T14:47:14.577181+0000","last_unstale":"2024-03-18T14:48:11.871068+0000","last_undegraded":"2024-03-18T14:48:11.871068+0000","last_fullsized":"2024-03-18T14:48:11.871068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'405","last_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_deep_scrub":"49'405","last_deep_scrub_stamp":"2024-03-18T14:48:11.870940+0000","last_clean_scrub_stamp":"2024-03-18T14:48:11.870940+0000","objects_scrubbed":2,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:38.220335+0000","scrub_duration":0.014207008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":299,"num_write_kb":4271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"19'791","reported_seq":903,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:07.924745+0000","last_change":"2024-03-18T14:49:07.924712+0000","last_active":"2024-03-18T14:49:07.924745+0000","last_peered":"2024-03-18T14:49:07.924745+0000","last_clean":"2024-03-18T14:49:07.924745+0000","last_became_active":"2024-03-18T14:47:17.522102+0000","last_became_peered":"2024-03-18T14:47:17.522102+0000","last_unstale":"2024-03-18T14:49:07.924745+0000","last_undegraded":"2024-03-18T14:49:07.924745+0000","last_fullsized":"2024-03-18T14:49:07.924745+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:49:07.924594+0000","last_clean_scrub_stamp":"2024-03-18T14:49:07.924594+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:57:49.474002+0000","scrub_duration":0.002122175,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31932,"num_write":738,"num_write_kb":101012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"49'854","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.371449+0000","last_change":"2024-03-18T14:48:25.371418+0000","last_active":"2024-03-18T14:48:25.371449+0000","last_peered":"2024-03-18T14:48:25.371449+0000","last_clean":"2024-03-18T14:48:25.371449+0000","last_became_active":"2024-03-18T14:47:17.474414+0000","last_became_peered":"2024-03-18T14:47:17.474414+0000","last_unstale":"2024-03-18T14:48:25.371449+0000","last_undegraded":"2024-03-18T14:48:25.371449+0000","last_fullsized":"2024-03-18T14:48:25.371449+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'854","last_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_deep_scrub":"49'854","last_deep_scrub_stamp":"2024-03-18T14:48:25.371302+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.371302+0000","objects_scrubbed":2,"log_size":854,"log_dups_size":0,"ondisk_log_size":854,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:28:29.023950+0000","scrub_duration":0.017311925999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":745,"num_write_kb":8558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"19'800","reported_seq":911,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.884434+0000","last_change":"2024-03-18T14:48:16.884386+0000","last_active":"2024-03-18T14:48:16.884434+0000","last_peered":"2024-03-18T14:48:16.884434+0000","last_clean":"2024-03-18T14:48:16.884434+0000","last_became_active":"2024-03-18T14:47:17.469755+0000","last_became_peered":"2024-03-18T14:47:17.469755+0000","last_unstale":"2024-03-18T14:48:16.884434+0000","last_undegraded":"2024-03-18T14:48:16.884434+0000","last_fullsized":"2024-03-18T14:48:16.884434+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'800","last_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_deep_scrub":"19'800","last_deep_scrub_stamp":"2024-03-18T14:48:16.884267+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.884267+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:04.933294+0000","scrub_duration":0.001977478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":34042,"num_write":753,"num_write_kb":105366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"19'144","reported_seq":202,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.218736+0000","last_change":"2024-03-18T14:48:00.218671+0000","last_active":"2024-03-18T14:48:00.218736+0000","last_peered":"2024-03-18T14:48:00.218736+0000","last_clean":"2024-03-18T14:48:00.218736+0000","last_became_active":"2024-03-18T14:47:17.466006+0000","last_became_peered":"2024-03-18T14:47:17.466006+0000","last_unstale":"2024-03-18T14:48:00.218736+0000","last_undegraded":"2024-03-18T14:48:00.218736+0000","last_fullsized":"2024-03-18T14:48:00.218736+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'144","last_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_deep_scrub":"19'144","last_deep_scrub_stamp":"2024-03-18T14:48:00.218500+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.218500+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:37:55.500165+0000","scrub_duration":0.001753098,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"19'806","reported_seq":947,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:09.182918+0000","last_change":"2024-03-18T14:48:09.182886+0000","last_active":"2024-03-18T14:48:09.182918+0000","last_peered":"2024-03-18T14:48:09.182918+0000","last_clean":"2024-03-18T14:48:09.182918+0000","last_became_active":"2024-03-18T14:47:13.600358+0000","last_became_peered":"2024-03-18T14:47:13.600358+0000","last_unstale":"2024-03-18T14:48:09.182918+0000","last_undegraded":"2024-03-18T14:48:09.182918+0000","last_fullsized":"2024-03-18T14:48:09.182918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'806","last_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_deep_scrub":"19'806","last_deep_scrub_stamp":"2024-03-18T14:48:09.182755+0000","last_clean_scrub_stamp":"2024-03-18T14:48:09.182755+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:07:01.292319+0000","scrub_duration":0.0019969419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":32262,"num_write":750,"num_write_kb":94040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"49'588","reported_seq":652,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.184707+0000","last_change":"2024-03-18T14:48:34.184679+0000","last_active":"2024-03-18T14:48:34.184707+0000","last_peered":"2024-03-18T14:48:34.184707+0000","last_clean":"2024-03-18T14:48:34.184707+0000","last_became_active":"2024-03-18T14:47:17.481588+0000","last_became_peered":"2024-03-18T14:47:17.481588+0000","last_unstale":"2024-03-18T14:48:34.184707+0000","last_undegraded":"2024-03-18T14:48:34.184707+0000","last_fullsized":"2024-03-18T14:48:34.184707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'588","last_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_deep_scrub":"49'588","last_deep_scrub_stamp":"2024-03-18T14:48:34.184584+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.184584+0000","objects_scrubbed":4,"log_size":588,"log_dups_size":0,"ondisk_log_size":588,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.539007+0000","scrub_duration":0.025118390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5,"num_read_kb":8194,"num_write":475,"num_write_kb":12534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"19'899","reported_seq":1025,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.153598+0000","last_change":"2024-03-18T14:48:14.153566+0000","last_active":"2024-03-18T14:48:14.153598+0000","last_peered":"2024-03-18T14:48:14.153598+0000","last_clean":"2024-03-18T14:48:14.153598+0000","last_became_active":"2024-03-18T14:47:17.465425+0000","last_became_peered":"2024-03-18T14:47:17.465425+0000","last_unstale":"2024-03-18T14:48:14.153598+0000","last_undegraded":"2024-03-18T14:48:14.153598+0000","last_fullsized":"2024-03-18T14:48:14.153598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'899","last_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_deep_scrub":"19'899","last_deep_scrub_stamp":"2024-03-18T14:48:14.153440+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.153440+0000","objects_scrubbed":0,"log_size":899,"log_dups_size":0,"ondisk_log_size":899,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:18:23.301363+0000","scrub_duration":0.0022463980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":37338,"num_write":856,"num_write_kb":119533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"49'630","reported_seq":688,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:38.224430+0000","last_change":"2024-03-18T14:48:38.224403+0000","last_active":"2024-03-18T14:48:38.224430+0000","last_peered":"2024-03-18T14:48:38.224430+0000","last_clean":"2024-03-18T14:48:38.224430+0000","last_became_active":"2024-03-18T14:47:17.470113+0000","last_became_peered":"2024-03-18T14:47:17.470113+0000","last_unstale":"2024-03-18T14:48:38.224430+0000","last_undegraded":"2024-03-18T14:48:38.224430+0000","last_fullsized":"2024-03-18T14:48:38.224430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'630","last_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_deep_scrub":"49'630","last_deep_scrub_stamp":"2024-03-18T14:48:38.224286+0000","last_clean_scrub_stamp":"2024-03-18T14:48:38.224286+0000","objects_scrubbed":2,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T14:57:53.056300+0000","scrub_duration":0.016074892,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":554,"num_write_kb":9253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"19'799","reported_seq":913,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:49.045282+0000","last_change":"2024-03-18T14:48:49.045255+0000","last_active":"2024-03-18T14:48:49.045282+0000","last_peered":"2024-03-18T14:48:49.045282+0000","last_clean":"2024-03-18T14:48:49.045282+0000","last_became_active":"2024-03-18T14:47:17.474957+0000","last_became_peered":"2024-03-18T14:47:17.474957+0000","last_unstale":"2024-03-18T14:48:49.045282+0000","last_undegraded":"2024-03-18T14:48:49.045282+0000","last_fullsized":"2024-03-18T14:48:49.045282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'799","last_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_deep_scrub":"19'799","last_deep_scrub_stamp":"2024-03-18T14:48:49.045151+0000","last_clean_scrub_stamp":"2024-03-18T14:48:49.045151+0000","objects_scrubbed":0,"log_size":799,"log_dups_size":0,"ondisk_log_size":799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:23:36.620183+0000","scrub_duration":0.001823124,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":31305,"num_write":749,"num_write_kb":143186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"49'294","reported_seq":350,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.060321+0000","last_change":"2024-03-18T14:48:58.060278+0000","last_active":"2024-03-18T14:48:58.060321+0000","last_peered":"2024-03-18T14:48:58.060321+0000","last_clean":"2024-03-18T14:48:58.060321+0000","last_became_active":"2024-03-18T14:47:17.520487+0000","last_became_peered":"2024-03-18T14:47:17.520487+0000","last_unstale":"2024-03-18T14:48:58.060321+0000","last_undegraded":"2024-03-18T14:48:58.060321+0000","last_fullsized":"2024-03-18T14:48:58.060321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'294","last_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_deep_scrub":"49'294","last_deep_scrub_stamp":"2024-03-18T14:48:58.060179+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.060179+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:35:31.101959+0000","scrub_duration":0.0045077479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":183,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"19'791","reported_seq":915,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:45.186872+0000","last_change":"2024-03-18T14:48:45.186840+0000","last_active":"2024-03-18T14:48:45.186872+0000","last_peered":"2024-03-18T14:48:45.186872+0000","last_clean":"2024-03-18T14:48:45.186872+0000","last_became_active":"2024-03-18T14:47:17.468812+0000","last_became_peered":"2024-03-18T14:47:17.468812+0000","last_unstale":"2024-03-18T14:48:45.186872+0000","last_undegraded":"2024-03-18T14:48:45.186872+0000","last_fullsized":"2024-03-18T14:48:45.186872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'791","last_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_deep_scrub":"19'791","last_deep_scrub_stamp":"2024-03-18T14:48:45.186724+0000","last_clean_scrub_stamp":"2024-03-18T14:48:45.186724+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:31:22.594831+0000","scrub_duration":0.0019781920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":35258,"num_write":743,"num_write_kb":122563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"49'1528","reported_seq":1586,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.360428+0000","last_change":"2024-03-18T14:48:24.360398+0000","last_active":"2024-03-18T14:48:24.360428+0000","last_peered":"2024-03-18T14:48:24.360428+0000","last_clean":"2024-03-18T14:48:24.360428+0000","last_became_active":"2024-03-18T14:47:17.504854+0000","last_became_peered":"2024-03-18T14:47:17.504854+0000","last_unstale":"2024-03-18T14:48:24.360428+0000","last_undegraded":"2024-03-18T14:48:24.360428+0000","last_fullsized":"2024-03-18T14:48:24.360428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'1528","last_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_deep_scrub":"49'1528","last_deep_scrub_stamp":"2024-03-18T14:48:24.360290+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.360290+0000","objects_scrubbed":2,"log_size":1528,"log_dups_size":0,"ondisk_log_size":1528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:36:53.733586+0000","scrub_duration":0.016489377,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":1413,"num_write_kb":12970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"19'771","reported_seq":914,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:26.864249+0000","last_change":"2024-03-18T14:49:26.864201+0000","last_active":"2024-03-18T14:49:26.864249+0000","last_peered":"2024-03-18T14:49:26.864249+0000","last_clean":"2024-03-18T14:49:26.864249+0000","last_became_active":"2024-03-18T14:47:17.472814+0000","last_became_peered":"2024-03-18T14:47:17.472814+0000","last_unstale":"2024-03-18T14:49:26.864249+0000","last_undegraded":"2024-03-18T14:49:26.864249+0000","last_fullsized":"2024-03-18T14:49:26.864249+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'771","last_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_deep_scrub":"19'771","last_deep_scrub_stamp":"2024-03-18T14:49:26.864083+0000","last_clean_scrub_stamp":"2024-03-18T14:49:26.864083+0000","objects_scrubbed":0,"log_size":771,"log_dups_size":0,"ondisk_log_size":771,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:36:49.322385+0000","scrub_duration":0.002288478,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":58129,"num_write":730,"num_write_kb":118291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:54.893212+0000","last_change":"2024-03-18T14:48:54.893182+0000","last_active":"2024-03-18T14:48:54.893212+0000","last_peered":"2024-03-18T14:48:54.893212+0000","last_clean":"2024-03-18T14:48:54.893212+0000","last_became_active":"2024-03-18T14:47:13.586217+0000","last_became_peered":"2024-03-18T14:47:13.586217+0000","last_unstale":"2024-03-18T14:48:54.893212+0000","last_undegraded":"2024-03-18T14:48:54.893212+0000","last_fullsized":"2024-03-18T14:48:54.893212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:54.893069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:54.893069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:34:18.776559+0000","scrub_duration":0.001515757,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"48'508","reported_seq":565,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.892914+0000","last_change":"2024-03-18T14:47:59.892840+0000","last_active":"2024-03-18T14:47:59.892914+0000","last_peered":"2024-03-18T14:47:59.892914+0000","last_clean":"2024-03-18T14:47:59.892914+0000","last_became_active":"2024-03-18T14:47:17.485983+0000","last_became_peered":"2024-03-18T14:47:17.485983+0000","last_unstale":"2024-03-18T14:47:59.892914+0000","last_undegraded":"2024-03-18T14:47:59.892914+0000","last_fullsized":"2024-03-18T14:47:59.892914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'508","last_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_deep_scrub":"48'508","last_deep_scrub_stamp":"2024-03-18T14:47:59.892698+0000","last_clean_scrub_stamp":"2024-03-18T14:47:59.892698+0000","objects_scrubbed":2,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:09.621704+0000","scrub_duration":0.014862227,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":389,"num_write_kb":4285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"19'808","reported_seq":1662,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:12.868732+0000","last_change":"2024-03-18T14:49:12.868699+0000","last_active":"2024-03-18T14:49:12.868732+0000","last_peered":"2024-03-18T14:49:12.868732+0000","last_clean":"2024-03-18T14:49:12.868732+0000","last_became_active":"2024-03-18T14:47:58.518826+0000","last_became_peered":"2024-03-18T14:47:58.518826+0000","last_unstale":"2024-03-18T14:49:12.868732+0000","last_undegraded":"2024-03-18T14:49:12.868732+0000","last_fullsized":"2024-03-18T14:49:12.868732+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'808","last_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_deep_scrub":"19'808","last_deep_scrub_stamp":"2024-03-18T14:49:12.868590+0000","last_clean_scrub_stamp":"2024-03-18T14:49:12.868590+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:29:15.049791+0000","scrub_duration":0.0020447400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":42313,"num_write":766,"num_write_kb":187424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":343,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":60,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.433725+0000","last_change":"2024-03-18T14:47:55.146560+0000","last_active":"2024-03-18T14:47:59.433725+0000","last_peered":"2024-03-18T14:47:59.433725+0000","last_clean":"2024-03-18T14:47:59.433725+0000","last_became_active":"2024-03-18T14:47:17.467084+0000","last_became_peered":"2024-03-18T14:47:17.467084+0000","last_unstale":"2024-03-18T14:47:59.433725+0000","last_undegraded":"2024-03-18T14:47:59.433725+0000","last_fullsized":"2024-03-18T14:47:59.433725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:47:55.146445+0000","last_clean_scrub_stamp":"2024-03-18T14:47:55.146445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:08:18.045577+0000","scrub_duration":0.001483484,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"49'714","reported_seq":772,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:15.111897+0000","last_change":"2024-03-18T14:48:15.111868+0000","last_active":"2024-03-18T14:48:15.111897+0000","last_peered":"2024-03-18T14:48:15.111897+0000","last_clean":"2024-03-18T14:48:15.111897+0000","last_became_active":"2024-03-18T14:47:14.615477+0000","last_became_peered":"2024-03-18T14:47:14.615477+0000","last_unstale":"2024-03-18T14:48:15.111897+0000","last_undegraded":"2024-03-18T14:48:15.111897+0000","last_fullsized":"2024-03-18T14:48:15.111897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'714","last_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_deep_scrub":"49'714","last_deep_scrub_stamp":"2024-03-18T14:48:15.111773+0000","last_clean_scrub_stamp":"2024-03-18T14:48:15.111773+0000","objects_scrubbed":2,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:10:42.897278+0000","scrub_duration":0.0035563420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":611,"num_write_kb":4379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"19'841","reported_seq":956,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:13.922452+0000","last_change":"2024-03-18T14:48:13.922417+0000","last_active":"2024-03-18T14:48:13.922452+0000","last_peered":"2024-03-18T14:48:13.922452+0000","last_clean":"2024-03-18T14:48:13.922452+0000","last_became_active":"2024-03-18T14:47:14.627831+0000","last_became_peered":"2024-03-18T14:47:14.627831+0000","last_unstale":"2024-03-18T14:48:13.922452+0000","last_undegraded":"2024-03-18T14:48:13.922452+0000","last_fullsized":"2024-03-18T14:48:13.922452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'841","last_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_deep_scrub":"19'841","last_deep_scrub_stamp":"2024-03-18T14:48:13.922312+0000","last_clean_scrub_stamp":"2024-03-18T14:48:13.922312+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:26:07.012895+0000","scrub_duration":0.001932132,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":33163,"num_write":808,"num_write_kb":147473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":53,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.991593+0000","last_change":"2024-03-18T14:48:32.991566+0000","last_active":"2024-03-18T14:48:32.991593+0000","last_peered":"2024-03-18T14:48:32.991593+0000","last_clean":"2024-03-18T14:48:32.991593+0000","last_became_active":"2024-03-18T14:47:17.525494+0000","last_became_peered":"2024-03-18T14:47:17.525494+0000","last_unstale":"2024-03-18T14:48:32.991593+0000","last_undegraded":"2024-03-18T14:48:32.991593+0000","last_fullsized":"2024-03-18T14:48:32.991593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:32.991433+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.991433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:52:17.772535+0000","scrub_duration":0.0017641169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"49'832","reported_seq":887,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:32.903787+0000","last_change":"2024-03-18T14:49:32.903757+0000","last_active":"2024-03-18T14:49:32.903787+0000","last_peered":"2024-03-18T14:49:32.903787+0000","last_clean":"2024-03-18T14:49:32.903787+0000","last_became_active":"2024-03-18T14:47:14.626947+0000","last_became_peered":"2024-03-18T14:47:14.626947+0000","last_unstale":"2024-03-18T14:49:32.903787+0000","last_undegraded":"2024-03-18T14:49:32.903787+0000","last_fullsized":"2024-03-18T14:49:32.903787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'832","last_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_deep_scrub":"49'832","last_deep_scrub_stamp":"2024-03-18T14:49:32.903637+0000","last_clean_scrub_stamp":"2024-03-18T14:49:32.903637+0000","objects_scrubbed":2,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:31:00.399413+0000","scrub_duration":0.020877258999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":706,"num_write_kb":20817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"19'755","reported_seq":878,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:02.755685+0000","last_change":"2024-03-18T14:48:02.755643+0000","last_active":"2024-03-18T14:48:02.755685+0000","last_peered":"2024-03-18T14:48:02.755685+0000","last_clean":"2024-03-18T14:48:02.755685+0000","last_became_active":"2024-03-18T14:47:13.587919+0000","last_became_peered":"2024-03-18T14:47:13.587919+0000","last_unstale":"2024-03-18T14:48:02.755685+0000","last_undegraded":"2024-03-18T14:48:02.755685+0000","last_fullsized":"2024-03-18T14:48:02.755685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'755","last_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_deep_scrub":"19'755","last_deep_scrub_stamp":"2024-03-18T14:48:02.755531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:02.755531+0000","objects_scrubbed":0,"log_size":755,"log_dups_size":0,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:02:29.654586+0000","scrub_duration":0.0021170160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":30598,"num_write":718,"num_write_kb":94228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":59,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:06.200760+0000","last_change":"2024-03-18T14:48:06.200732+0000","last_active":"2024-03-18T14:48:06.200760+0000","last_peered":"2024-03-18T14:48:06.200760+0000","last_clean":"2024-03-18T14:48:06.200760+0000","last_became_active":"2024-03-18T14:47:17.464186+0000","last_became_peered":"2024-03-18T14:47:17.464186+0000","last_unstale":"2024-03-18T14:48:06.200760+0000","last_undegraded":"2024-03-18T14:48:06.200760+0000","last_fullsized":"2024-03-18T14:48:06.200760+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:06.200603+0000","last_clean_scrub_stamp":"2024-03-18T14:48:06.200603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:39.509393+0000","scrub_duration":0.001625727,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"49'117","reported_seq":214,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:56.867175+0000","last_change":"2024-03-18T14:48:56.867148+0000","last_active":"2024-03-18T14:48:56.867175+0000","last_peered":"2024-03-18T14:48:56.867175+0000","last_clean":"2024-03-18T14:48:56.867175+0000","last_became_active":"2024-03-18T14:47:13.603593+0000","last_became_peered":"2024-03-18T14:47:13.603593+0000","last_unstale":"2024-03-18T14:48:56.867175+0000","last_undegraded":"2024-03-18T14:48:56.867175+0000","last_fullsized":"2024-03-18T14:48:56.867175+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'117","last_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_deep_scrub":"49'117","last_deep_scrub_stamp":"2024-03-18T14:48:56.867050+0000","last_clean_scrub_stamp":"2024-03-18T14:48:56.867050+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:46:05.807234+0000","scrub_duration":0.0054496529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"48'1015","reported_seq":1073,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.243504+0000","last_change":"2024-03-18T14:48:00.243456+0000","last_active":"2024-03-18T14:48:00.243504+0000","last_peered":"2024-03-18T14:48:00.243504+0000","last_clean":"2024-03-18T14:48:00.243504+0000","last_became_active":"2024-03-18T14:47:17.462523+0000","last_became_peered":"2024-03-18T14:47:17.462523+0000","last_unstale":"2024-03-18T14:48:00.243504+0000","last_undegraded":"2024-03-18T14:48:00.243504+0000","last_fullsized":"2024-03-18T14:48:00.243504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"48'1015","last_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_deep_scrub":"48'1015","last_deep_scrub_stamp":"2024-03-18T14:48:00.243357+0000","last_clean_scrub_stamp":"2024-03-18T14:48:00.243357+0000","objects_scrubbed":2,"log_size":1015,"log_dups_size":0,"ondisk_log_size":1015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:50:27.083493+0000","scrub_duration":0.025715788,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":903,"num_write_kb":12751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"19'809","reported_seq":893,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-03-18T14:47:59.437738+0000","last_change":"2024-03-18T14:47:59.429894+0000","last_active":"2024-03-18T14:47:59.437738+0000","last_peered":"2024-03-18T14:47:59.437738+0000","last_clean":"2024-03-18T14:47:59.437738+0000","last_became_active":"2024-03-18T14:47:59.425001+0000","last_became_peered":"2024-03-18T14:47:59.425001+0000","last_unstale":"2024-03-18T14:47:59.437738+0000","last_undegraded":"2024-03-18T14:47:59.437738+0000","last_fullsized":"2024-03-18T14:47:59.437738+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:41:13.125753+0000","last_clean_scrub_stamp":"2024-03-18T14:41:13.125753+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:43:11.520575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":28189,"num_write":773,"num_write_kb":109954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":366,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:28.266867+0000","last_change":"2024-03-18T14:48:28.266840+0000","last_active":"2024-03-18T14:48:28.266867+0000","last_peered":"2024-03-18T14:48:28.266867+0000","last_clean":"2024-03-18T14:48:28.266867+0000","last_became_active":"2024-03-18T14:47:17.504504+0000","last_became_peered":"2024-03-18T14:47:17.504504+0000","last_unstale":"2024-03-18T14:48:28.266867+0000","last_undegraded":"2024-03-18T14:48:28.266867+0000","last_fullsized":"2024-03-18T14:48:28.266867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:28.266739+0000","last_clean_scrub_stamp":"2024-03-18T14:48:28.266739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:57:54.852182+0000","scrub_duration":0.001750777,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"49'722","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:22.125405+0000","last_change":"2024-03-18T14:48:22.125361+0000","last_active":"2024-03-18T14:48:22.125405+0000","last_peered":"2024-03-18T14:48:22.125405+0000","last_clean":"2024-03-18T14:48:22.125405+0000","last_became_active":"2024-03-18T14:47:14.618506+0000","last_became_peered":"2024-03-18T14:47:14.618506+0000","last_unstale":"2024-03-18T14:48:22.125405+0000","last_undegraded":"2024-03-18T14:48:22.125405+0000","last_fullsized":"2024-03-18T14:48:22.125405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'722","last_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_deep_scrub":"49'722","last_deep_scrub_stamp":"2024-03-18T14:48:22.125213+0000","last_clean_scrub_stamp":"2024-03-18T14:48:22.125213+0000","objects_scrubbed":1,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:52.616287+0000","scrub_duration":0.0073768690000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1388043,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":246,"num_read_kb":1522,"num_write":596,"num_write_kb":9870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"19'838","reported_seq":1040,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:32.319566+0000","last_change":"2024-03-18T14:48:32.319536+0000","last_active":"2024-03-18T14:48:32.319566+0000","last_peered":"2024-03-18T14:48:32.319566+0000","last_clean":"2024-03-18T14:48:32.319566+0000","last_became_active":"2024-03-18T14:47:13.607961+0000","last_became_peered":"2024-03-18T14:47:13.607961+0000","last_unstale":"2024-03-18T14:48:32.319566+0000","last_undegraded":"2024-03-18T14:48:32.319566+0000","last_fullsized":"2024-03-18T14:48:32.319566+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'838","last_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_deep_scrub":"19'838","last_deep_scrub_stamp":"2024-03-18T14:48:32.319415+0000","last_clean_scrub_stamp":"2024-03-18T14:48:32.319415+0000","objects_scrubbed":0,"log_size":838,"log_dups_size":0,"ondisk_log_size":838,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:44:23.817576+0000","scrub_duration":0.0021636070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":92522,"num_write":796,"num_write_kb":175863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:35.186479+0000","last_change":"2024-03-18T14:48:35.186457+0000","last_active":"2024-03-18T14:48:35.186479+0000","last_peered":"2024-03-18T14:48:35.186479+0000","last_clean":"2024-03-18T14:48:35.186479+0000","last_became_active":"2024-03-18T14:47:17.513980+0000","last_became_peered":"2024-03-18T14:47:17.513980+0000","last_unstale":"2024-03-18T14:48:35.186479+0000","last_undegraded":"2024-03-18T14:48:35.186479+0000","last_fullsized":"2024-03-18T14:48:35.186479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:35.186376+0000","last_clean_scrub_stamp":"2024-03-18T14:48:35.186376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:16.210842+0000","scrub_duration":0.0012427849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"19'455","reported_seq":508,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:06.901190+0000","last_change":"2024-03-18T14:49:06.901135+0000","last_active":"2024-03-18T14:49:06.901190+0000","last_peered":"2024-03-18T14:49:06.901190+0000","last_clean":"2024-03-18T14:49:06.901190+0000","last_became_active":"2024-03-18T14:47:14.627123+0000","last_became_peered":"2024-03-18T14:47:14.627123+0000","last_unstale":"2024-03-18T14:49:06.901190+0000","last_undegraded":"2024-03-18T14:49:06.901190+0000","last_fullsized":"2024-03-18T14:49:06.901190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'455","last_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_deep_scrub":"19'455","last_deep_scrub_stamp":"2024-03-18T14:49:06.901004+0000","last_clean_scrub_stamp":"2024-03-18T14:49:06.901004+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:30.295133+0000","scrub_duration":0.0017306369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":8387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"19'794","reported_seq":916,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:36.282803+0000","last_change":"2024-03-18T14:48:36.282775+0000","last_active":"2024-03-18T14:48:36.282803+0000","last_peered":"2024-03-18T14:48:36.282803+0000","last_clean":"2024-03-18T14:48:36.282803+0000","last_became_active":"2024-03-18T14:47:14.616075+0000","last_became_peered":"2024-03-18T14:47:14.616075+0000","last_unstale":"2024-03-18T14:48:36.282803+0000","last_undegraded":"2024-03-18T14:48:36.282803+0000","last_fullsized":"2024-03-18T14:48:36.282803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'794","last_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_deep_scrub":"19'794","last_deep_scrub_stamp":"2024-03-18T14:48:36.282660+0000","last_clean_scrub_stamp":"2024-03-18T14:48:36.282660+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:57:06.866213+0000","scrub_duration":0.002052969,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":33227,"num_write":736,"num_write_kb":159227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"49'513","reported_seq":571,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:44.167643+0000","last_change":"2024-03-18T14:48:44.167598+0000","last_active":"2024-03-18T14:48:44.167643+0000","last_peered":"2024-03-18T14:48:44.167643+0000","last_clean":"2024-03-18T14:48:44.167643+0000","last_became_active":"2024-03-18T14:47:17.493258+0000","last_became_peered":"2024-03-18T14:47:17.493258+0000","last_unstale":"2024-03-18T14:48:44.167643+0000","last_undegraded":"2024-03-18T14:48:44.167643+0000","last_fullsized":"2024-03-18T14:48:44.167643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'513","last_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_deep_scrub":"49'513","last_deep_scrub_stamp":"2024-03-18T14:48:44.167470+0000","last_clean_scrub_stamp":"2024-03-18T14:48:44.167470+0000","objects_scrubbed":2,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:24:23.984399+0000","scrub_duration":0.0045384910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":409,"num_write_kb":4291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.782173+0000","last_change":"2024-03-18T14:48:43.782145+0000","last_active":"2024-03-18T14:48:43.782173+0000","last_peered":"2024-03-18T14:48:43.782173+0000","last_clean":"2024-03-18T14:48:43.782173+0000","last_became_active":"2024-03-18T14:47:13.603435+0000","last_became_peered":"2024-03-18T14:47:13.603435+0000","last_unstale":"2024-03-18T14:48:43.782173+0000","last_undegraded":"2024-03-18T14:48:43.782173+0000","last_fullsized":"2024-03-18T14:48:43.782173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:43.782027+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.782027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:13:15.688873+0000","scrub_duration":0.001457711,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"19'866","reported_seq":1813,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.304440+0000","last_change":"2024-03-18T14:48:16.304402+0000","last_active":"2024-03-18T14:48:16.304440+0000","last_peered":"2024-03-18T14:48:16.304440+0000","last_clean":"2024-03-18T14:48:16.304440+0000","last_became_active":"2024-03-18T14:47:58.520883+0000","last_became_peered":"2024-03-18T14:47:58.520883+0000","last_unstale":"2024-03-18T14:48:16.304440+0000","last_undegraded":"2024-03-18T14:48:16.304440+0000","last_fullsized":"2024-03-18T14:48:16.304440+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'866","last_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_deep_scrub":"19'866","last_deep_scrub_stamp":"2024-03-18T14:48:16.304277+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.304277+0000","objects_scrubbed":0,"log_size":866,"log_dups_size":0,"ondisk_log_size":866,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:48.629601+0000","scrub_duration":0.0019085510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":71656,"num_write":824,"num_write_kb":213508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.306230+0000","last_change":"2024-03-18T14:48:26.306201+0000","last_active":"2024-03-18T14:48:26.306230+0000","last_peered":"2024-03-18T14:48:26.306230+0000","last_clean":"2024-03-18T14:48:26.306230+0000","last_became_active":"2024-03-18T14:47:17.505247+0000","last_became_peered":"2024-03-18T14:47:17.505247+0000","last_unstale":"2024-03-18T14:48:26.306230+0000","last_undegraded":"2024-03-18T14:48:26.306230+0000","last_fullsized":"2024-03-18T14:48:26.306230+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T14:48:26.306069+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.306069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:38:30.387655+0000","scrub_duration":0.0016197469999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"49'667","reported_seq":723,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:43.325577+0000","last_change":"2024-03-18T14:48:43.325544+0000","last_active":"2024-03-18T14:48:43.325577+0000","last_peered":"2024-03-18T14:48:43.325577+0000","last_clean":"2024-03-18T14:48:43.325577+0000","last_became_active":"2024-03-18T14:47:13.607355+0000","last_became_peered":"2024-03-18T14:47:13.607355+0000","last_unstale":"2024-03-18T14:48:43.325577+0000","last_undegraded":"2024-03-18T14:48:43.325577+0000","last_fullsized":"2024-03-18T14:48:43.325577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'667","last_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_deep_scrub":"49'667","last_deep_scrub_stamp":"2024-03-18T14:48:43.325445+0000","last_clean_scrub_stamp":"2024-03-18T14:48:43.325445+0000","objects_scrubbed":1,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:25:34.059380+0000","scrub_duration":0.0059039319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":594,"num_write_kb":5447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"19'777","reported_seq":938,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.996115+0000","last_change":"2024-03-18T14:48:34.996077+0000","last_active":"2024-03-18T14:48:34.996115+0000","last_peered":"2024-03-18T14:48:34.996115+0000","last_clean":"2024-03-18T14:48:34.996115+0000","last_became_active":"2024-03-18T14:47:17.521534+0000","last_became_peered":"2024-03-18T14:47:17.521534+0000","last_unstale":"2024-03-18T14:48:34.996115+0000","last_undegraded":"2024-03-18T14:48:34.996115+0000","last_fullsized":"2024-03-18T14:48:34.996115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'777","last_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_deep_scrub":"19'777","last_deep_scrub_stamp":"2024-03-18T14:48:34.995981+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.995981+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:01:55.769418+0000","scrub_duration":0.0016469410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":63650,"num_write":737,"num_write_kb":118429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"49'132","reported_seq":190,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:16.155328+0000","last_change":"2024-03-18T14:48:16.155271+0000","last_active":"2024-03-18T14:48:16.155328+0000","last_peered":"2024-03-18T14:48:16.155328+0000","last_clean":"2024-03-18T14:48:16.155328+0000","last_became_active":"2024-03-18T14:47:17.466514+0000","last_became_peered":"2024-03-18T14:47:17.466514+0000","last_unstale":"2024-03-18T14:48:16.155328+0000","last_undegraded":"2024-03-18T14:48:16.155328+0000","last_fullsized":"2024-03-18T14:48:16.155328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'132","last_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_deep_scrub":"49'132","last_deep_scrub_stamp":"2024-03-18T14:48:16.155164+0000","last_clean_scrub_stamp":"2024-03-18T14:48:16.155164+0000","objects_scrubbed":2,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:46:45.049526+0000","scrub_duration":0.01302034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194354,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":23,"num_write_kb":12301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"19'819","reported_seq":969,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:26.881673+0000","last_change":"2024-03-18T14:48:26.881644+0000","last_active":"2024-03-18T14:48:26.881673+0000","last_peered":"2024-03-18T14:48:26.881673+0000","last_clean":"2024-03-18T14:48:26.881673+0000","last_became_active":"2024-03-18T14:47:14.577890+0000","last_became_peered":"2024-03-18T14:47:14.577890+0000","last_unstale":"2024-03-18T14:48:26.881673+0000","last_undegraded":"2024-03-18T14:48:26.881673+0000","last_fullsized":"2024-03-18T14:48:26.881673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'819","last_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_deep_scrub":"19'819","last_deep_scrub_stamp":"2024-03-18T14:48:26.881518+0000","last_clean_scrub_stamp":"2024-03-18T14:48:26.881518+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:04:28.442532+0000","scrub_duration":0.0018602099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":48633,"num_write":759,"num_write_kb":156019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"49'388","reported_seq":447,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:58.846131+0000","last_change":"2024-03-18T14:48:58.846091+0000","last_active":"2024-03-18T14:48:58.846131+0000","last_peered":"2024-03-18T14:48:58.846131+0000","last_clean":"2024-03-18T14:48:58.846131+0000","last_became_active":"2024-03-18T14:47:13.586584+0000","last_became_peered":"2024-03-18T14:47:13.586584+0000","last_unstale":"2024-03-18T14:48:58.846131+0000","last_undegraded":"2024-03-18T14:48:58.846131+0000","last_fullsized":"2024-03-18T14:48:58.846131+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'388","last_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_deep_scrub":"49'388","last_deep_scrub_stamp":"2024-03-18T14:48:58.845949+0000","last_clean_scrub_stamp":"2024-03-18T14:48:58.845949+0000","objects_scrubbed":2,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:00:57.289400+0000","scrub_duration":0.014630426,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":259,"num_write_kb":4254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"19'753","reported_seq":1544,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:34.006327+0000","last_change":"2024-03-18T14:48:34.006287+0000","last_active":"2024-03-18T14:48:34.006327+0000","last_peered":"2024-03-18T14:48:34.006327+0000","last_clean":"2024-03-18T14:48:34.006327+0000","last_became_active":"2024-03-18T14:47:59.424374+0000","last_became_peered":"2024-03-18T14:47:59.424374+0000","last_unstale":"2024-03-18T14:48:34.006327+0000","last_undegraded":"2024-03-18T14:48:34.006327+0000","last_fullsized":"2024-03-18T14:48:34.006327+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'753","last_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_deep_scrub":"19'753","last_deep_scrub_stamp":"2024-03-18T14:48:34.006180+0000","last_clean_scrub_stamp":"2024-03-18T14:48:34.006180+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:49:48.268263+0000","scrub_duration":0.0020697799999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":21124,"num_write":698,"num_write_kb":105668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":334,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"49'637","reported_seq":702,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:37.276261+0000","last_change":"2024-03-18T14:48:37.276237+0000","last_active":"2024-03-18T14:48:37.276261+0000","last_peered":"2024-03-18T14:48:37.276261+0000","last_clean":"2024-03-18T14:48:37.276261+0000","last_became_active":"2024-03-18T14:47:17.514815+0000","last_became_peered":"2024-03-18T14:47:17.514815+0000","last_unstale":"2024-03-18T14:48:37.276261+0000","last_undegraded":"2024-03-18T14:48:37.276261+0000","last_fullsized":"2024-03-18T14:48:37.276261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'637","last_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_deep_scrub":"49'637","last_deep_scrub_stamp":"2024-03-18T14:48:37.276150+0000","last_clean_scrub_stamp":"2024-03-18T14:48:37.276150+0000","objects_scrubbed":4,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:39:24.235330+0000","scrub_duration":0.033569338999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":12291,"num_write":534,"num_write_kb":16644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"19'768","reported_seq":910,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:24.918817+0000","last_change":"2024-03-18T14:48:24.918788+0000","last_active":"2024-03-18T14:48:24.918817+0000","last_peered":"2024-03-18T14:48:24.918817+0000","last_clean":"2024-03-18T14:48:24.918817+0000","last_became_active":"2024-03-18T14:47:17.478508+0000","last_became_peered":"2024-03-18T14:47:17.478508+0000","last_unstale":"2024-03-18T14:48:24.918817+0000","last_undegraded":"2024-03-18T14:48:24.918817+0000","last_fullsized":"2024-03-18T14:48:24.918817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'768","last_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_deep_scrub":"19'768","last_deep_scrub_stamp":"2024-03-18T14:48:24.918665+0000","last_clean_scrub_stamp":"2024-03-18T14:48:24.918665+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:59:13.351912+0000","scrub_duration":0.0019970980000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":43429,"num_write":727,"num_write_kb":126338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"49'486","reported_seq":543,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:40.201661+0000","last_change":"2024-03-18T14:48:40.201631+0000","last_active":"2024-03-18T14:48:40.201661+0000","last_peered":"2024-03-18T14:48:40.201661+0000","last_clean":"2024-03-18T14:48:40.201661+0000","last_became_active":"2024-03-18T14:47:17.461933+0000","last_became_peered":"2024-03-18T14:47:17.461933+0000","last_unstale":"2024-03-18T14:48:40.201661+0000","last_undegraded":"2024-03-18T14:48:40.201661+0000","last_fullsized":"2024-03-18T14:48:40.201661+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'486","last_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_deep_scrub":"49'486","last_deep_scrub_stamp":"2024-03-18T14:48:40.201531+0000","last_clean_scrub_stamp":"2024-03-18T14:48:40.201531+0000","objects_scrubbed":2,"log_size":486,"log_dups_size":0,"ondisk_log_size":486,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:20:43.816048+0000","scrub_duration":0.022989102000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8164414,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":360,"num_write_kb":8157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"19'786","reported_seq":902,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:14.358917+0000","last_change":"2024-03-18T14:48:14.358860+0000","last_active":"2024-03-18T14:48:14.358917+0000","last_peered":"2024-03-18T14:48:14.358917+0000","last_clean":"2024-03-18T14:48:14.358917+0000","last_became_active":"2024-03-18T14:47:17.462794+0000","last_became_peered":"2024-03-18T14:47:17.462794+0000","last_unstale":"2024-03-18T14:48:14.358917+0000","last_undegraded":"2024-03-18T14:48:14.358917+0000","last_fullsized":"2024-03-18T14:48:14.358917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'786","last_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_deep_scrub":"19'786","last_deep_scrub_stamp":"2024-03-18T14:48:14.358720+0000","last_clean_scrub_stamp":"2024-03-18T14:48:14.358720+0000","objects_scrubbed":0,"log_size":786,"log_dups_size":0,"ondisk_log_size":786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:44.366879+0000","scrub_duration":0.002172177,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":46033,"num_write":752,"num_write_kb":97022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"49'218","reported_seq":276,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:33.322592+0000","last_change":"2024-03-18T14:48:33.322553+0000","last_active":"2024-03-18T14:48:33.322592+0000","last_peered":"2024-03-18T14:48:33.322592+0000","last_clean":"2024-03-18T14:48:33.322592+0000","last_became_active":"2024-03-18T14:47:13.608075+0000","last_became_peered":"2024-03-18T14:47:13.608075+0000","last_unstale":"2024-03-18T14:48:33.322592+0000","last_undegraded":"2024-03-18T14:48:33.322592+0000","last_fullsized":"2024-03-18T14:48:33.322592+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"49'218","last_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_deep_scrub":"49'218","last_deep_scrub_stamp":"2024-03-18T14:48:33.322410+0000","last_clean_scrub_stamp":"2024-03-18T14:48:33.322410+0000","objects_scrubbed":3,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:42:53.714913+0000","scrub_duration":0.013451792000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":117,"num_write_kb":4153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"19'862","reported_seq":1018,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:04.811496+0000","last_change":"2024-03-18T14:48:04.811455+0000","last_active":"2024-03-18T14:48:04.811496+0000","last_peered":"2024-03-18T14:48:04.811496+0000","last_clean":"2024-03-18T14:48:04.811496+0000","last_became_active":"2024-03-18T14:47:14.581608+0000","last_became_peered":"2024-03-18T14:47:14.581608+0000","last_unstale":"2024-03-18T14:48:04.811496+0000","last_undegraded":"2024-03-18T14:48:04.811496+0000","last_fullsized":"2024-03-18T14:48:04.811496+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'862","last_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_deep_scrub":"19'862","last_deep_scrub_stamp":"2024-03-18T14:48:04.811326+0000","last_clean_scrub_stamp":"2024-03-18T14:48:04.811326+0000","objects_scrubbed":0,"log_size":862,"log_dups_size":0,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:23:50.253544+0000","scrub_duration":0.0019389279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":46348,"num_write":811,"num_write_kb":148189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"19'893","reported_seq":1110,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:25.901440+0000","last_change":"2024-03-18T14:49:25.901396+0000","last_active":"2024-03-18T14:49:25.901440+0000","last_peered":"2024-03-18T14:49:25.901440+0000","last_clean":"2024-03-18T14:49:25.901440+0000","last_became_active":"2024-03-18T14:47:14.627681+0000","last_became_peered":"2024-03-18T14:47:14.627681+0000","last_unstale":"2024-03-18T14:49:25.901440+0000","last_undegraded":"2024-03-18T14:49:25.901440+0000","last_fullsized":"2024-03-18T14:49:25.901440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'893","last_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_deep_scrub":"19'893","last_deep_scrub_stamp":"2024-03-18T14:49:25.901228+0000","last_clean_scrub_stamp":"2024-03-18T14:49:25.901228+0000","objects_scrubbed":0,"log_size":893,"log_dups_size":0,"ondisk_log_size":893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:06:24.965402+0000","scrub_duration":0.0022755779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":81096,"num_write":846,"num_write_kb":241445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"19'868","reported_seq":1026,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:20.386726+0000","last_change":"2024-03-18T14:48:20.386699+0000","last_active":"2024-03-18T14:48:20.386726+0000","last_peered":"2024-03-18T14:48:20.386726+0000","last_clean":"2024-03-18T14:48:20.386726+0000","last_became_active":"2024-03-18T14:47:17.497568+0000","last_became_peered":"2024-03-18T14:47:17.497568+0000","last_unstale":"2024-03-18T14:48:20.386726+0000","last_undegraded":"2024-03-18T14:48:20.386726+0000","last_fullsized":"2024-03-18T14:48:20.386726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'868","last_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_deep_scrub":"19'868","last_deep_scrub_stamp":"2024-03-18T14:48:20.386579+0000","last_clean_scrub_stamp":"2024-03-18T14:48:20.386579+0000","objects_scrubbed":0,"log_size":868,"log_dups_size":0,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:25:30.056603+0000","scrub_duration":0.0021468730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":60628,"num_write":828,"num_write_kb":139145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"19'848","reported_seq":1747,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:00.430554+0000","last_change":"2024-03-18T14:48:00.430554+0000","last_active":"2024-03-18T14:48:00.430554+0000","last_peered":"2024-03-18T14:48:00.430554+0000","last_clean":"2024-03-18T14:48:00.430554+0000","last_became_active":"2024-03-18T14:48:00.421749+0000","last_became_peered":"2024-03-18T14:48:00.421749+0000","last_unstale":"2024-03-18T14:48:00.430554+0000","last_undegraded":"2024-03-18T14:48:00.430554+0000","last_fullsized":"2024-03-18T14:48:00.430554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'848","last_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_deep_scrub":"19'848","last_deep_scrub_stamp":"2024-03-18T14:47:53.227611+0000","last_clean_scrub_stamp":"2024-03-18T14:47:53.227611+0000","objects_scrubbed":0,"log_size":848,"log_dups_size":0,"ondisk_log_size":848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:34:28.797143+0000","scrub_duration":0.001925731,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18662,"num_write":810,"num_write_kb":67828,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":394,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"19'793","reported_seq":935,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:49:01.040284+0000","last_change":"2024-03-18T14:49:01.040237+0000","last_active":"2024-03-18T14:49:01.040284+0000","last_peered":"2024-03-18T14:49:01.040284+0000","last_clean":"2024-03-18T14:49:01.040284+0000","last_became_active":"2024-03-18T14:47:17.467127+0000","last_became_peered":"2024-03-18T14:47:17.467127+0000","last_unstale":"2024-03-18T14:49:01.040284+0000","last_undegraded":"2024-03-18T14:49:01.040284+0000","last_fullsized":"2024-03-18T14:49:01.040284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'793","last_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_deep_scrub":"19'793","last_deep_scrub_stamp":"2024-03-18T14:49:01.040123+0000","last_clean_scrub_stamp":"2024-03-18T14:49:01.040123+0000","objects_scrubbed":0,"log_size":793,"log_dups_size":0,"ondisk_log_size":793,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:20:38.411811+0000","scrub_duration":0.0019907240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46880,"num_write":743,"num_write_kb":117484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"19'751","reported_seq":900,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-03-18T14:48:25.860761+0000","last_change":"2024-03-18T14:48:25.860728+0000","last_active":"2024-03-18T14:48:25.860761+0000","last_peered":"2024-03-18T14:48:25.860761+0000","last_clean":"2024-03-18T14:48:25.860761+0000","last_became_active":"2024-03-18T14:47:14.628058+0000","last_became_peered":"2024-03-18T14:47:14.628058+0000","last_unstale":"2024-03-18T14:48:25.860761+0000","last_undegraded":"2024-03-18T14:48:25.860761+0000","last_fullsized":"2024-03-18T14:48:25.860761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"19'751","last_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_deep_scrub":"19'751","last_deep_scrub_stamp":"2024-03-18T14:48:25.860614+0000","last_clean_scrub_stamp":"2024-03-18T14:48:25.860614+0000","objects_scrubbed":0,"log_size":751,"log_dups_size":0,"ondisk_log_size":751,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:46:21.411178+0000","scrub_duration":0.0021021099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63112,"num_write":707,"num_write_kb":122485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5562,"num_read_kb":2922624,"num_write":48854,"num_write_kb":8484042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2553,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51721,"ondisk_log_size":51721,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":137159600,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":632,"num_read_kb":130436,"num_write":16066,"num_write_kb":262732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":274432000,"data_stored":274319200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":836325,"internal_metadata":0},"log_size":19710,"ondisk_log_size":19710,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":32,"seq":137438953530,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":413608,"kb_used_data":95968,"kb_used_omap":175,"kb_used_meta":317456,"kb_avail":93958232,"statfs":{"total":96636764160,"available":96213229568,"internally_reserved":0,"allocated":98271232,"data_stored":97979929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":325075841},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.41599999999999998,"15min":0.48199999999999998},"min":{"1min":0.26000000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.53900000000000003,"5min":4.165,"15min":4.165},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38500000000000001,"15min":0.39500000000000002},"min":{"1min":0.27800000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.51600000000000001,"5min":1.419,"15min":1.419},"last":0.35899999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.38100000000000001,"15min":0.36299999999999999},"min":{"1min":0.309,"5min":0.251,"15min":0.251},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.38300000000000001,"15min":0.375},"min":{"1min":0.30299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.31900000000000001}]},{"osd":2,"last update":"Mon Mar 18 14:51:25 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.38800000000000001},"min":{"1min":0.33400000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53600000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.746,"15min":1.083},"min":{"1min":0.29299999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.58599999999999997,"5min":16.358000000000001,"15min":16.358000000000001},"last":0.39800000000000002}]}]},{"osd":2,"up_from":30,"seq":128849018939,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379320,"kb_used_data":63024,"kb_used_omap":7,"kb_used_meta":316280,"kb_avail":93992520,"statfs":{"total":96636764160,"available":96248340480,"internally_reserved":0,"allocated":64536576,"data_stored":64271595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":323871259},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.24299999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.36299999999999999,"15min":0.35899999999999999},"min":{"1min":0.28399999999999997,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.54900000000000004,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.30099999999999999}]},{"osd":1,"last update":"Mon Mar 18 14:51:20 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36099999999999999,"15min":0.35799999999999998},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52400000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39300000000000002},"min":{"1min":0.27600000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.51200000000000001,"5min":0.629,"15min":0.629},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Mar 18 14:51:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.40400000000000003},"min":{"1min":0.30599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.55700000000000005,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.377},{"interface":"front","average":{"1min":0.441,"5min":0.432,"15min":0.42799999999999999},"min":{"1min":0.308,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57099999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.36299999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084347,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376648,"kb_used_data":59968,"kb_used_omap":241,"kb_used_meta":316430,"kb_avail":93995192,"statfs":{"total":96636764160,"available":96251076608,"internally_reserved":0,"allocated":61407232,"data_stored":61127238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":324024992},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Mar 18 14:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.33500000000000002,"15min":0.33300000000000002},"min":{"1min":0.254,"5min":0.182,"15min":0.182},"max":{"1min":0.52700000000000002,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.32300000000000001,"15min":0.29799999999999999},"min":{"1min":0.27200000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Mon Mar 18 14:51:17 2024","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.371,"15min":0.35899999999999999},"min":{"1min":0.30099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.58599999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.34599999999999997,"15min":0.32100000000000001},"min":{"1min":0.28499999999999998,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Mon Mar 18 14:51:26 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40600000000000003,"15min":0.38800000000000001},"min":{"1min":0.30599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52900000000000003,"5min":1.034,"15min":1.034},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.40000000000000002,"15min":0.377},"min":{"1min":0.33200000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.54300000000000004,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.40500000000000003}]}]},{"osd":1,"up_from":29,"seq":124554051643,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367824,"kb_used_data":51912,"kb_used_omap":392,"kb_used_meta":315511,"kb_avail":94004016,"statfs":{"total":96636764160,"available":96260112384,"internally_reserved":0,"allocated":53157888,"data_stored":52890898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":323083487},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52400000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35699999999999998},"min":{"1min":0.26700000000000002,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.40500000000000003}]},{"osd":2,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38800000000000001,"15min":0.38100000000000001},"min":{"1min":0.27300000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.48299999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Mar 18 14:51:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.40699999999999997,"15min":0.41399999999999998},"min":{"1min":0.27000000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51100000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.45300000000000001,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.59099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60375040,"data_stored":60344439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":247136,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":52125696,"data_stored":52108099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":402209,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":64098304,"data_stored":64079164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7653,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":97832960,"data_stored":97787498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":179327,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T14:51:58.442 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:58.442 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:58.443 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-18T14:41:13.125753+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=41, tm_sec=13, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=14, tm_min=47, tm_sec=51, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T14:51:58.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub 2024-03-18T14:51:58.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.598+0000 7fe853d6b700 1 Processor -- start 2024-03-18T14:51:58.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.598+0000 7fe853d6b700 1 -- start start 2024-03-18T14:51:58.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe853d6b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 0x7fe84c063a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe853d6b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 0x7fe84c0ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe853d6b700 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c0ada60 con 0x7fe84c1416e0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe853d6b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0aca40 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe853d6b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0acce0 con 0x7fe84c0ad690 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 0x7fe84c0ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe852308700 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe84c1416e0 0x7fe84c141b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:53298/0 (socket says 172.21.15.57:53298) 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe852308700 1 -- 172.21.15.57:0/770301961 learned_addr learned my addr 172.21.15.57:0/770301961 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851b07700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 0x7fe84c063a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe850b05700 1 -- 172.21.15.57:0/770301961 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262276888 0 0) 0x7fe84c0ada60 con 0x7fe84c1416e0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe850b05700 1 -- 172.21.15.57:0/770301961 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838003570 con 0x7fe84c1416e0 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 -- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 msgr2=0x7fe84c063a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T14:51:58.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 0x7fe84c063a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 -- 172.21.15.57:0/770301961 >> v1:172.21.15.57:6789/0 conn(0x7fe84c1416e0 legacy=0x7fe84c141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 -- 172.21.15.57:0/770301961 --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0aa5b0 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851b07700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 0x7fe84c063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.599+0000 7fe851306700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 0x7fe84c0ac0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe848009910 tx=0x7fe8480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5de567ef8881424a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe850b05700 1 -- 172.21.15.57:0/770301961 <== mon.1 v2:172.21.15.57:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800b690 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe850b05700 1 -- 172.21.15.57:0/770301961 <== mon.1 v2:172.21.15.57:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84800b7f0 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe850b05700 1 -- 172.21.15.57:0/770301961 <== mon.1 v2:172.21.15.57:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84800bb90 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 -- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 msgr2=0x7fe84c0ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 0x7fe84c0ac0b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe848009910 tx=0x7fe8480091a0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 -- 172.21.15.57:0/770301961 shutdown_connections 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0ad690 0x7fe84c063a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 --2- 172.21.15.57:0/770301961 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c0aa1c0 0x7fe84c0ac0b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 -- 172.21.15.57:0/770301961 >> 172.21.15.57:0/770301961 conn(0x7fe84c06a4d0 msgr2=0x7fe84c06a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T14:51:58.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 -- 172.21.15.57:0/770301961 shutdown_connections 2024-03-18T14:51:58.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.600+0000 7fe853d6b700 1 -- 172.21.15.57:0/770301961 wait complete. 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 Processor -- start 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 -- start start 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0aa1c0 0x7fe84c11c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe84c0ad690 0x7fe84c13d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 --2- >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c1416e0 0x7fe84c11d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c151290 con 0x7fe84c0ad690 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 -- --> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c1520a0 con 0x7fe84c1416e0 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe853d6b700 1 -- --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c151530 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe851b07700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0aa1c0 0x7fe84c11c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe851306700 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe84c0ad690 0x7fe84c13d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.602+0000 7fe851b07700 1 --2- >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0aa1c0 0x7fe84c11c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3302/0 says I am v2:172.21.15.57:55358/0 (socket says 172.21.15.57:55358) 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 -- 172.21.15.57:0/2351045957 learned_addr learned my addr 172.21.15.57:0/2351045957 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe852308700 1 --2- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c1416e0 0x7fe84c11d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 -- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c1416e0 msgr2=0x7fe84c11d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 --2- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3301/0,v1:172.21.15.57:6790/0] conn(0x7fe84c1416e0 0x7fe84c11d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 -- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe84c0ad690 msgr2=0x7fe84c13d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 --2- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe84c0ad690 0x7fe84c13d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 -- 172.21.15.57:0/2351045957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009420 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851306700 1 --2- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe84c0ad690 0x7fe84c13d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe851b07700 1 --2- 172.21.15.57:0/2351045957 >> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] conn(0x7fe84c0aa1c0 0x7fe84c11c4b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00ec80 tx=0x7fe83c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00c920 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c00ca80 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe853d6b700 1 -- 172.21.15.57:0/2351045957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848009420 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00ce00 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.603+0000 7fe853d6b700 1 -- 172.21.15.57:0/2351045957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c11c9f0 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.604+0000 7fe853d6b700 1 -- 172.21.15.57:0/2351045957 --> [v2:172.21.15.57:3302/0,v1:172.21.15.57:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe84c065180 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.604+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 4 ==== mgrmap(e 11) v1 ==== 53490+0+0 (secure 0 0 0) 0x7fe83c013680 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.605+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 4172+0+0 (secure 0 0 0) 0x7fe83c05b480 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.605+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 --> v1:172.21.15.57:6808/50245 -- command(tid 1: {"prefix": "get_command_descriptions", "pgid": "4.11"}) v1 -- 0x7fe830052de0 con 0x7fe83004f0c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.605+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== mon.2 v2:172.21.15.57:3302/0 6 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe83c05dac0 con 0x7fe84c0aa1c0 2024-03-18T14:51:58.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-18T14:51:58.606+0000 7fe841ffb700 1 -- 172.21.15.57:0/2351045957 <== osd.2 v1:172.21.15.57:6808/50245 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fe830052de0 con 0x7fe83004f0c0 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:0 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:1 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:2 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:abort 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:assert 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:bench [] [] [] [] 2024-03-18T14:51:58.634 INFO:teuthology.orchestra.run.smithi057.stderr:bluefs debug_inject_read_zeros 2024-03-18T14:51:58.635 INFO:teuthology.orchestra.run.smithi057.stderr:bluefs files list 2024-03-18T14:51:58.635 INFO:teuthology.orchestra.run.smithi057.stderr:bluefs stats 2024-03-18T14:51:58.635 INFO:teuthology.orchestra.run.smithi057.stderr:bluestore allocator dump block 2024-03-18T14:51:58.635 INFO:teuthology.orchestra.run.smithi057.stderr:Error EINVAL: invalid command 2024-03-18T14:51:58.636 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-18T14:51:58.637 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub' 2024-03-18T14:51:58.639 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-18T14:51:58.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T14:51:58.639 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.647 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T14:51:58.647 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T14:51:58.647 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.696 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T14:51:58.697 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T14:51:58.697 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.747 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T14:51:58.748 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-18T14:51:58.748 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T14:51:58.748 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.817 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T14:51:58.817 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T14:51:58.817 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.892 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T14:51:58.892 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T14:51:58.892 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:58.967 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T14:51:58.967 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T14:51:58.967 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.037 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T14:51:59.037 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-18T14:51:59.037 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T14:51:59.037 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.097 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T14:51:59.097 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T14:51:59.097 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.159 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T14:51:59.159 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-18T14:51:59.159 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T14:51:59.159 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.209 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T14:51:59.209 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T14:51:59.209 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.259 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T14:51:59.259 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T14:51:59.259 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T14:51:59.310 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T14:51:59.310 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-18T14:51:59.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'mons down, quorum' | egrep -v 'out of quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'missing required features' | head -n 1 2024-03-18T14:51:59.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:51:59.391 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-18T14:51:59.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:51:59.691 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-18T14:51:59.792 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:51:59.792 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-18T14:51:59.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:51:59.861 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-18T14:51:59.977 INFO:tasks.ceph:Archiving mon data... 2024-03-18T14:51:59.978 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/data/mon.a.tgz 2024-03-18T14:51:59.978 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-18T14:51:59.996 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.PB5rdYW1H5 2024-03-18T14:51:59.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PB5rdYW1H5 2024-03-18T14:52:00.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.PB5rdYW1H5 2024-03-18T14:52:00.301 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.PB5rdYW1H5 is 488KB 2024-03-18T14:52:00.398 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.PB5rdYW1H5 2024-03-18T14:52:00.416 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/data/mon.b.tgz 2024-03-18T14:52:00.416 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-18T14:52:00.473 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.jOZyveeOPS 2024-03-18T14:52:00.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.jOZyveeOPS 2024-03-18T14:52:00.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.jOZyveeOPS 2024-03-18T14:52:00.750 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.jOZyveeOPS is 495KB 2024-03-18T14:52:00.846 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.jOZyveeOPS 2024-03-18T14:52:00.863 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/data/mon.c.tgz 2024-03-18T14:52:00.864 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-18T14:52:00.920 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.ym1oUm74vt 2024-03-18T14:52:00.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ym1oUm74vt 2024-03-18T14:52:01.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.ym1oUm74vt 2024-03-18T14:52:01.196 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.ym1oUm74vt is 495KB 2024-03-18T14:52:01.295 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.ym1oUm74vt 2024-03-18T14:52:01.313 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-18T14:52:01.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T14:52:01.355 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T14:52:01.358 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T14:52:01.437 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T14:52:01.458 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T14:52:01.478 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T14:52:01.478 INFO:tasks.ceph:Archiving crash dumps... 2024-03-18T14:52:01.480 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi057/crash 2024-03-18T14:52:01.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T14:52:01.508 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi087/crash 2024-03-18T14:52:01.509 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T14:52:01.537 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi129/crash 2024-03-18T14:52:01.538 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T14:52:01.569 INFO:tasks.ceph:Compressing logs... 2024-03-18T14:52:01.569 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T14:52:01.572 DEBUG:teuthology.orchestra.run.smithi087:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T14:52:01.582 DEBUG:teuthology.orchestra.run.smithi129:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T14:52:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49712.log 2024-03-18T14:52:01.597 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55222.log 2024-03-18T14:52:01.612 INFO:teuthology.orchestra.run.smithi087.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37291.log 2024-03-18T14:52:01.630 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53403.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55222.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49712.log.gz 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45474.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43607.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55222.log.gz 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51443.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45474.log.gz 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43607.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.53403.log.gz 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45321.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51443.log: gzip 89.3%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43607.log.gz-- 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53989.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45321.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51443.log.gz 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52717.log 2024-03-18T14:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45321.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55586.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53989.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45686.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52717.log: /var/log/ceph/ceph-client.admin.55586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52717.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 87.1% 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55586.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42458.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45686.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41188.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42663.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42664.log: /var/log/ceph/ceph-client.admin.41188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43811.log 2024-03-18T14:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41188.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41496.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42663.log: /var/log/ceph/ceph-client.admin.43811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41137.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42663.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41496.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43811.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48422.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41496.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54683.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41137.log: /var/log/ceph/ceph-client.admin.48422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54928.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41137.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54683.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48422.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49170.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54928.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54683.log.gz 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52005.log 2024-03-18T14:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54928.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46519.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52005.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52005.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52451.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46519.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54340.log: /var/log/ceph/ceph-client.admin.52451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52057.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45941.log 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52451.log.gz 2024-03-18T14:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9%/var/log/ceph/ceph-client.admin.52057.log: -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55380.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52057.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53940.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41865.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55380.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45941.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44265.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55380.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41865.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53940.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54732.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41865.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40207.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44265.log: /var/log/ceph/ceph-client.admin.54732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45525.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44265.log.gz 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.40207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-03-18T14:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54732.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45525.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40207.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43505.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3%/var/log/ceph/ceph-client.admin.43913.log: -- replaced with /var/log/ceph/ceph-client.admin.45525.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55847.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43505.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz-5 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:--verbose -- /var/log/ceph/ceph-client.admin.48313.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43505.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53305.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48313.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.55847.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55798.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53305.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53305.log.gz 2024-03-18T14:52:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55486.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55798.log: /var/log/ceph/ceph-client.admin.43709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48663.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55798.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49008.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48663.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55486.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51861.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49008.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54291.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43021.log: 87.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.51861.log.gz--verbose 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:-- /var/log/ceph/ceph-osd.2.log 2024-03-18T14:52:01.637 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55537.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54291.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53815.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47905.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55537.log: /var/log/ceph/ceph-client.admin.53815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47756.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55537.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53815.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53766.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41975.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47905.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47756.log.gz 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54879.log 2024-03-18T14:52:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41975.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53766.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41975.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53060.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43352.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54879.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55429.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53060.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51396.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42791.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43352.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53619.log 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55429.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51396.log.gz 2024-03-18T14:52:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52913.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42791.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53619.log: /var/log/ceph/ceph-client.admin.52913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41651.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53619.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52913.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42230.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48885.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41651.log: /var/log/ceph/ceph-client.admin.42230.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41651.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41763.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42230.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40854.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53158.log 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48885.log.gz 2024-03-18T14:52:01.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.40854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51540.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41763.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40854.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43556.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51540.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53158.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49761.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51540.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49369.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54234.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49761.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43556.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49761.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49369.log.gz 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49467.log 2024-03-18T14:52:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53256.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54234.log.gz 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49614.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53256.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49467.log.gz 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49614.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.53256.log.gz-5 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:--verbose -- /var/log/ceph/ceph-client.admin.45584.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49614.log.gz 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55692.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50070.log: 89.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.45584.log.gz--verbose 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:-- /var/log/ceph/ceph-client.admin.52058.log 2024-03-18T14:52:01.642 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55692.log: /var/log/ceph/ceph-client.admin.52058.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55692.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52058.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52962.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54185.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52962.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52962.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54185.log: 95.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54185.log.gz 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48172.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52815.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44214.log: /var/log/ceph/ceph-client.admin.48172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51637.log 2024-03-18T14:52:01.643 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41547.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48172.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52815.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45117.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42128.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51637.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41547.log: /var/log/ceph/ceph-client.admin.45117.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.41547.log.gz--verbose 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:-- /var/log/ceph/ceph-client.admin.51859.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45117.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42128.log: /var/log/ceph/ceph-client.admin.51859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42461.log 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42128.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51859.log.gz 2024-03-18T14:52:01.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48716.log: /var/log/ceph/ceph-client.admin.42461.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.42461.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53474.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43301.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51564.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51862.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53474.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51564.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43301.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51564.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55741.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.51862.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52864.log: /var/log/ceph/ceph-client.admin.55741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2024-03-18T14:52:01.645 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55741.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42179.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46094.log: /var/log/ceph/ceph-client.admin.41445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55643.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42179.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55643.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42179.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47573.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55643.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48689.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50392.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47573.log.gz 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51588.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43760.log 2024-03-18T14:52:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50392.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48689.log.gz 2024-03-18T14:52:01.647 INFO:teuthology.orchestra.run.smithi129.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37344.log 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50392.log.gz 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54585.log 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51588.log.gz 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43760.log.gz 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48097.log: /var/log/ceph/ceph-client.admin.54585.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54585.log.gz 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-18T14:52:01.656 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45737.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45270.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45737.log: /var/log/ceph/ceph-client.admin.45270.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45737.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45270.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52452.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45066.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53717.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52452.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53717.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45066.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53717.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51349.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42842.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45372.log 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42842.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51349.log.gz 2024-03-18T14:52:01.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45372.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42842.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45372.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43964.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43964.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43964.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42995.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45423.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49565.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49565.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.45423.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.39447.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49565.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51108.log 2024-03-18T14:52:01.658 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47757.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.39813.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51108.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47757.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47757.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47626.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54536.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47626.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54536.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54536.log.gz 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39865.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-03-18T14:52:01.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.39865.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48199.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39865.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55271.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54977.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50278.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54977.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55271.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50278.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54977.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50278.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46043.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42332.log 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44316.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46043.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42332.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42332.log.gz 2024-03-18T14:52:01.660 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41394.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54038.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48913.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54038.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41394.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54038.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48913.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48913.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52668.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42077.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52400.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52668.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42077.log: /var/log/ceph/ceph-client.admin.44066.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42077.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-03-18T14:52:01.661 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52570.log 2024-03-18T14:52:01.662 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49908.log 2024-03-18T14:52:01.662 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52570.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-18T14:52:01.662 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49908.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52570.log.gz 2024-03-18T14:52:01.662 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.x.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49908.log.gz 2024-03-18T14:52:01.664 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47755.log 2024-03-18T14:52:01.664 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46451.log 2024-03-18T14:52:01.664 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47755.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.47755.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54830.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46451.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46451.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54830.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47479.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41343.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52176.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41343.log: 87.8%/var/log/ceph/ceph-client.admin.52176.log: -- replaced with /var/log/ceph/ceph-client.admin.41343.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52176.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45219.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43658.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45219.log: /var/log/ceph/ceph-client.admin.43658.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45219.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43658.log.gz 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41916.log 2024-03-18T14:52:01.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2024-03-18T14:52:01.666 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41916.log: 93.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41916.log.gz 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49810.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52766.log 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47758.log 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52766.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2024-03-18T14:52:01.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52766.log.gz 2024-03-18T14:52:01.668 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47758.log.gz 2024-03-18T14:52:01.668 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-03-18T14:52:01.668 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39919.log 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55328.log 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.39919.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55328.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39919.log.gz 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55328.log.gz 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45992.log 2024-03-18T14:52:01.669 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45168.log 2024-03-18T14:52:01.670 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48616.log 2024-03-18T14:52:01.670 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45992.log.gz 2024-03-18T14:52:01.670 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48616.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45168.log.gz 2024-03-18T14:52:01.671 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48616.log.gz 2024-03-18T14:52:01.671 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41290.log 2024-03-18T14:52:01.671 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51735.log 2024-03-18T14:52:01.671 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41598.log 2024-03-18T14:52:01.671 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51735.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41290.log.gz 2024-03-18T14:52:01.672 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41598.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51735.log.gz 2024-03-18T14:52:01.672 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41598.log.gz 2024-03-18T14:52:01.672 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2024-03-18T14:52:01.672 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42843.log 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41239.log 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42843.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41239.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42843.log.gz 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41239.log.gz 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53570.log 2024-03-18T14:52:01.674 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-18T14:52:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53570.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-18T14:52:01.675 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.b.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53570.log.gz 2024-03-18T14:52:01.676 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-18T14:52:01.685 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48859.log 2024-03-18T14:52:01.686 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48859.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48859.log.gz 2024-03-18T14:52:01.687 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49981.log 2024-03-18T14:52:01.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49981.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49981.log.gz 2024-03-18T14:52:01.688 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53668.log 2024-03-18T14:52:01.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53668.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53668.log.gz 2024-03-18T14:52:01.689 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49106.log 2024-03-18T14:52:01.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49106.log.gz 2024-03-18T14:52:01.691 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2024-03-18T14:52:01.692 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46400.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2024-03-18T14:52:01.692 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50168.log 2024-03-18T14:52:01.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50168.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50168.log.gz 2024-03-18T14:52:01.693 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55173.log 2024-03-18T14:52:01.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55173.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55173.log.gz 2024-03-18T14:52:01.694 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49663.log 2024-03-18T14:52:01.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49663.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49663.log.gz 2024-03-18T14:52:01.696 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53521.log 2024-03-18T14:52:01.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53521.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53521.log.gz 2024-03-18T14:52:01.697 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45839.log 2024-03-18T14:52:01.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45839.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45839.log.gz 2024-03-18T14:52:01.698 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52619.log 2024-03-18T14:52:01.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52619.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52619.log.gz 2024-03-18T14:52:01.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2024-03-18T14:52:01.701 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54389.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2024-03-18T14:52:01.701 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53354.log 2024-03-18T14:52:01.702 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53354.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53354.log.gz 2024-03-18T14:52:01.703 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-18T14:52:01.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-18T14:52:01.735 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43862.log 2024-03-18T14:52:01.748 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-18T14:52:01.749 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43862.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43862.log.gz 2024-03-18T14:52:01.749 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49057.log 2024-03-18T14:52:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49057.log.gz 2024-03-18T14:52:01.750 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40783.log 2024-03-18T14:52:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.40783.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40783.log.gz 2024-03-18T14:52:01.753 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43403.log 2024-03-18T14:52:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43403.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43403.log.gz 2024-03-18T14:52:01.754 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44141.log 2024-03-18T14:52:01.760 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40905.log 2024-03-18T14:52:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.40905.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40905.log.gz 2024-03-18T14:52:01.761 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-18T14:52:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.b.log: 91.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-18T14:52:01.764 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-03-18T14:52:01.765 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44015.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-03-18T14:52:01.765 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49859.log 2024-03-18T14:52:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49859.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49859.log.gz 2024-03-18T14:52:01.766 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-18T14:52:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.44141.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44141.log.gz 2024-03-18T14:52:01.771 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54487.log 2024-03-18T14:52:01.772 INFO:teuthology.orchestra.run.smithi057.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-18T14:52:01.773 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54487.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54487.log.gz 2024-03-18T14:52:01.773 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2024-03-18T14:52:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46145.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2024-03-18T14:52:01.774 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.36924.log 2024-03-18T14:52:01.775 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.36924.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.36924.log.gz 2024-03-18T14:52:01.775 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42662.log 2024-03-18T14:52:01.776 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42662.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42662.log.gz 2024-03-18T14:52:01.776 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54781.log 2024-03-18T14:52:01.777 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54781.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54781.log.gz 2024-03-18T14:52:01.777 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-03-18T14:52:01.778 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42665.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-03-18T14:52:01.778 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39763.log 2024-03-18T14:52:01.779 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.39763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39763.log.gz 2024-03-18T14:52:01.779 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53011.log 2024-03-18T14:52:01.780 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53011.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53011.log.gz 2024-03-18T14:52:01.780 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52006.log 2024-03-18T14:52:01.781 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52006.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52006.log.gz 2024-03-18T14:52:01.781 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52374.log 2024-03-18T14:52:01.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52374.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52374.log.gz 2024-03-18T14:52:01.782 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42026.log 2024-03-18T14:52:01.783 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42026.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42026.log.gz 2024-03-18T14:52:01.783 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50773.log 2024-03-18T14:52:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50773.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50773.log.gz 2024-03-18T14:52:01.784 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45788.log 2024-03-18T14:52:01.785 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45788.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45788.log.gz 2024-03-18T14:52:01.785 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51492.log 2024-03-18T14:52:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51492.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51492.log.gz 2024-03-18T14:52:01.786 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43250.log 2024-03-18T14:52:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43250.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43250.log.gz 2024-03-18T14:52:01.787 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2024-03-18T14:52:01.788 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43076.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2024-03-18T14:52:01.788 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49516.log 2024-03-18T14:52:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49516.log.gz 2024-03-18T14:52:01.789 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-03-18T14:52:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41704.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-03-18T14:52:01.790 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46349.log 2024-03-18T14:52:01.791 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46349.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46349.log.gz 2024-03-18T14:52:01.791 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51686.log 2024-03-18T14:52:01.792 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51686.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51686.log.gz 2024-03-18T14:52:01.793 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41031.log 2024-03-18T14:52:01.793 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43074.log 2024-03-18T14:52:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43074.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43074.log.gz 2024-03-18T14:52:01.794 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54634.log 2024-03-18T14:52:01.795 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54634.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54634.log.gz 2024-03-18T14:52:01.795 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54087.log 2024-03-18T14:52:01.796 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54087.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54087.log.gz 2024-03-18T14:52:01.796 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53109.log 2024-03-18T14:52:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53109.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53109.log.gz 2024-03-18T14:52:01.797 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-03-18T14:52:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49312.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-03-18T14:52:01.798 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51020.log 2024-03-18T14:52:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51020.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51020.log.gz 2024-03-18T14:52:01.799 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52255.log 2024-03-18T14:52:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52255.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52255.log.gz 2024-03-18T14:52:01.800 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52202.log 2024-03-18T14:52:01.801 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52202.log.gz 2024-03-18T14:52:01.801 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51232.log 2024-03-18T14:52:01.802 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51232.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51232.log.gz 2024-03-18T14:52:01.802 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-03-18T14:52:01.803 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42871.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-03-18T14:52:01.803 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54438.log 2024-03-18T14:52:01.804 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41031.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41031.log.gz 2024-03-18T14:52:01.805 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54438.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54438.log.gz 2024-03-18T14:52:01.805 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2024-03-18T14:52:01.806 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.40075.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2024-03-18T14:52:01.806 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41814.log 2024-03-18T14:52:01.807 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.41814.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41814.log.gz 2024-03-18T14:52:01.807 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53891.log 2024-03-18T14:52:01.808 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53891.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz 2024-03-18T14:52:01.808 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55124.log 2024-03-18T14:52:01.809 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55124.log.gz 2024-03-18T14:52:01.809 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2024-03-18T14:52:01.810 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45635.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2024-03-18T14:52:01.810 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49418.log 2024-03-18T14:52:01.811 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49418.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49418.log.gz 2024-03-18T14:52:01.811 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54136.log 2024-03-18T14:52:01.812 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.54136.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54136.log.gz 2024-03-18T14:52:01.812 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-18T14:52:01.821 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48812.log 2024-03-18T14:52:01.833 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43199.log 2024-03-18T14:52:01.834 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48812.log.gz 2024-03-18T14:52:01.846 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43199.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43199.log.gz 2024-03-18T14:52:01.857 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47959.log 2024-03-18T14:52:01.868 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-03-18T14:52:01.868 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47959.log.gz 2024-03-18T14:52:01.879 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43454.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-03-18T14:52:01.880 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52253.log 2024-03-18T14:52:01.891 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52253.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52253.log.gz 2024-03-18T14:52:01.892 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-03-18T14:52:01.910 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-03-18T14:52:01.910 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-03-18T14:52:01.936 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51516.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-03-18T14:52:01.936 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48144.log 2024-03-18T14:52:01.939 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-18T14:52:01.942 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-18T14:52:01.943 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48144.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48144.log.gz 2024-03-18T14:52:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55026.log 2024-03-18T14:52:01.944 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.55026.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55026.log.gz 2024-03-18T14:52:01.945 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42281.log 2024-03-18T14:52:01.952 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42281.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42281.log.gz 2024-03-18T14:52:01.952 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48522.log 2024-03-18T14:52:01.953 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48522.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48522.log.gz 2024-03-18T14:52:01.953 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47904.log 2024-03-18T14:52:01.963 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47904.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47904.log.gz 2024-03-18T14:52:02.344 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-18T14:52:05.582 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-18T14:52:08.209 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-18T14:52:08.330 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-18T14:52:08.430 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-18T14:52:14.166 INFO:teuthology.orchestra.run.smithi087.stderr:/var/log/ceph/ceph-client.0.37291.log: 92.8% -- replaced with /var/log/ceph/ceph-client.0.37291.log.gz 2024-03-18T14:52:14.170 INFO:teuthology.orchestra.run.smithi087.stderr: 2024-03-18T14:52:14.170 INFO:teuthology.orchestra.run.smithi087.stderr:real 0m12.570s 2024-03-18T14:52:14.170 INFO:teuthology.orchestra.run.smithi087.stderr:user 0m12.112s 2024-03-18T14:52:14.171 INFO:teuthology.orchestra.run.smithi087.stderr:sys 0m0.448s 2024-03-18T14:52:14.240 INFO:teuthology.orchestra.run.smithi129.stderr:/var/log/ceph/ceph-client.1.37344.log: 92.8% -- replaced with /var/log/ceph/ceph-client.1.37344.log.gz 2024-03-18T14:52:14.241 INFO:teuthology.orchestra.run.smithi129.stderr: 2024-03-18T14:52:14.241 INFO:teuthology.orchestra.run.smithi129.stderr:real 0m12.612s 2024-03-18T14:52:14.241 INFO:teuthology.orchestra.run.smithi129.stderr:user 0m12.186s 2024-03-18T14:52:14.241 INFO:teuthology.orchestra.run.smithi129.stderr:sys 0m0.417s 2024-03-18T14:52:45.370 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-18T14:52:49.214 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-18T14:52:49.215 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-18T14:52:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m47.629s 2024-03-18T14:52:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:user 1m52.683s 2024-03-18T14:52:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m3.530s 2024-03-18T14:52:49.216 INFO:tasks.ceph:Archiving logs... 2024-03-18T14:52:49.216 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi057/log 2024-03-18T14:52:49.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T14:53:04.607 DEBUG:teuthology.misc:Transferring archived files from smithi087:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi087/log 2024-03-18T14:53:04.607 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T14:53:06.772 DEBUG:teuthology.misc:Transferring archived files from smithi129:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi129/log 2024-03-18T14:53:06.774 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T14:53:08.890 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub' 2024-03-18T14:53:08.891 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-18T14:53:08.906 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph.py", line 1306, in osd_scrub_pgs manager.raw_cluster_cmd('tell', pgid, 'deep-scrub') File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1638, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi057 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub' 2024-03-18T14:53:08.906 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-18T14:53:08.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T14:53:08.909 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T14:53:08.912 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T14:53:09.017 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-18T14:53:09.030 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-18T14:53:09.031 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:53:09.033 DEBUG:teuthology.orchestra.run.smithi087:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:53:09.036 DEBUG:teuthology.orchestra.run.smithi129:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:53:09.051 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2024-03-18T14:53:09.054 INFO:teuthology.orchestra.run.smithi087.stderr:bash: ntpq: command not found 2024-03-18T14:53:09.055 INFO:teuthology.orchestra.run.smithi129.stderr:bash: ntpq: command not found 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +1762us[+1765us] +/- 99ms 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -969us[ -966us] +/- 70ms 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -216us[ -213us] +/- 69ms 2024-03-18T14:53:09.056 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:=============================================================================== 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +1761us[+1844us] +/- 99ms 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -985us[ -902us] +/- 70ms 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -223us[ -140us] +/- 69ms 2024-03-18T14:53:09.059 INFO:teuthology.orchestra.run.smithi087.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:=============================================================================== 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +1765us[+1767us] +/- 99ms 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:^* hv02.front.sepia.ceph.com 3 6 377 3 -956us[ -954us] +/- 70ms 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -230us[ -228us] +/- 68ms 2024-03-18T14:53:09.061 INFO:teuthology.orchestra.run.smithi129.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:53:09.062 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-18T14:53:09.076 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-18T14:53:09.076 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-18T14:53:09.093 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T14:53:09.176 DEBUG:teuthology.orchestra.run.smithi087:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T14:53:09.244 DEBUG:teuthology.orchestra.run.smithi129:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T14:53:09.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:53:09.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:09.346 DEBUG:teuthology.orchestra.run.smithi087:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:53:09.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:09.378 DEBUG:teuthology.orchestra.run.smithi129:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-03-18T14:53:09.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:09.410 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-18T14:53:09.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-18T14:53:09.437 INFO:teuthology.task.internal:Duration was 1288.463718 seconds 2024-03-18T14:53:09.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-18T14:53:09.453 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-18T14:53:09.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T14:53:09.456 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T14:53:09.458 DEBUG:teuthology.orchestra.run.smithi129:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T14:53:09.504 INFO:teuthology.orchestra.run.smithi087.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:53:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:53:09.509 INFO:teuthology.orchestra.run.smithi129.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:53:09.968 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-18T14:53:09.968 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-03-18T14:53:09.969 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T14:53:09.996 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com 2024-03-18T14:53:09.997 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T14:53:10.021 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi129.front.sepia.ceph.com 2024-03-18T14:53:10.022 DEBUG:teuthology.orchestra.run.smithi129:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T14:53:10.049 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-18T14:53:10.049 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T14:53:10.051 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T14:53:10.064 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T14:53:10.137 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-18T14:53:10.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T14:53:10.140 DEBUG:teuthology.orchestra.run.smithi087:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T14:53:10.142 DEBUG:teuthology.orchestra.run.smithi129:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T14:53:10.221 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-18T14:53:10.235 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-18T14:53:10.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T14:53:10.264 DEBUG:teuthology.orchestra.run.smithi087:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T14:53:10.291 DEBUG:teuthology.orchestra.run.smithi129:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T14:53:10.319 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-18T14:53:10.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.337 DEBUG:teuthology.orchestra.run.smithi087:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.340 DEBUG:teuthology.orchestra.run.smithi129:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.362 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-03-18T14:53:10.363 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = core 2024-03-18T14:53:10.386 INFO:teuthology.orchestra.run.smithi129.stdout:kernel.core_pattern = core 2024-03-18T14:53:10.399 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:10.439 DEBUG:teuthology.orchestra.run.smithi087:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:10.456 DEBUG:teuthology.orchestra.run.smithi129:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T14:53:10.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:10.473 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-18T14:53:10.486 INFO:teuthology.task.internal:Transferring archived files... 2024-03-18T14:53:10.486 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi057 2024-03-18T14:53:10.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T14:53:10.527 DEBUG:teuthology.misc:Transferring archived files from smithi087:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi087 2024-03-18T14:53:10.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T14:53:10.564 DEBUG:teuthology.misc:Transferring archived files from smithi129:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849/remote/smithi129 2024-03-18T14:53:10.564 DEBUG:teuthology.orchestra.run.smithi129:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T14:53:10.601 INFO:teuthology.task.internal:Removing archive directory... 2024-03-18T14:53:10.601 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T14:53:10.603 DEBUG:teuthology.orchestra.run.smithi087:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T14:53:10.606 DEBUG:teuthology.orchestra.run.smithi129:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T14:53:10.653 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-18T14:53:10.668 INFO:teuthology.task.internal:Not uploading archives. 2024-03-18T14:53:10.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-18T14:53:10.683 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-18T14:53:10.683 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T14:53:10.685 DEBUG:teuthology.orchestra.run.smithi087:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T14:53:10.687 DEBUG:teuthology.orchestra.run.smithi129:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T14:53:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 14:53 /home/ubuntu/cephtest 2024-03-18T14:53:10.702 INFO:teuthology.orchestra.run.smithi087.stdout: 393225 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 14:53 /home/ubuntu/cephtest 2024-03-18T14:53:10.711 INFO:teuthology.orchestra.run.smithi129.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 14:53 /home/ubuntu/cephtest 2024-03-18T14:53:10.712 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-18T14:53:10.727 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-18T14:53:10.742 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi057 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub' 2024-03-18T14:53:10.743 INFO:teuthology.nuke:Checking targets against current locks 2024-03-18T14:53:10.768 DEBUG:teuthology.nuke:shortname: smithi057 2024-03-18T14:53:10.769 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T14:53:10.794 DEBUG:teuthology.nuke:shortname: smithi087 2024-03-18T14:53:10.795 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T14:53:10.799 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.267992', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAJfV/jyRQmvrL+3NnMMQg6k3n71Nw5hcbLSieS0T2q+yKEAl8+wqbncR9HYcYlDzM6d4nOQrec4Wj+jlXWcfQ='} 2024-03-18T14:53:10.814 DEBUG:teuthology.nuke:shortname: smithi129 2024-03-18T14:53:10.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T14:53:10.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.266254', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCncwcaS3ehB2ay4KEnSJKHfPNQmVRubaRsYO3lulZE+fAjF1tLzuzrEl71eyvFV8IwGIZeP6g9YbH+nIUYMRbk='} 2024-03-18T14:53:10.838 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608849', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:21:26.269644', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNb2+khwLDMJH2Uy3mBoJdiwh56TQVI8Yk90WBgifLD5l1p/j+51boEicE5oInvcALKY3yoihdFya6ixKzZAz9w='} 2024-03-18T14:53:10.850 INFO:teuthology.orchestra.console.smithi057:Power off 2024-03-18T14:53:10.850 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T14:53:10.875 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-03-18T14:53:10.875 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:10.893 INFO:teuthology.orchestra.console.smithi129:Power off 2024-03-18T14:53:10.894 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T14:53:10.908 INFO:teuthology.orchestra.console.smithi087:Power off 2024-03-18T14:53:10.908 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T14:53:10.916 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-18T14:53:10.918 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2024-03-18T14:53:10.918 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:10.929 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-03-18T14:53:10.930 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:10.940 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-03-18T14:53:10.952 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-03-18T14:53:14.917 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:14.941 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:14.953 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:15.027 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-18T14:53:15.051 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2024-03-18T14:53:15.062 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-03-18T14:53:19.032 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:19.052 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:19.063 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:19.142 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-18T14:53:19.162 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2024-03-18T14:53:19.173 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-03-18T14:53:19.263 INFO:teuthology.orchestra.console.smithi129:Power off completed 2024-03-18T14:53:23.146 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:23.173 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T14:53:23.256 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-18T14:53:23.283 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-03-18T14:53:23.357 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-03-18T14:53:23.383 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-03-18T14:53:23.488 INFO:teuthology.run:Summary data: description: fs/upgrade/featureful_client/old_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-compat_client/quincy}} duration: 1288.463718175888 failure_reason: 'Command failed on smithi057 with status 22: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 4.11 deep-scrub''' flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-03-18T14:53:23.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T14:53:23.583 INFO:teuthology.run:FAIL